CN114327049B - AR application-based prompting method and device, electronic equipment and readable medium - Google Patents

AR application-based prompting method and device, electronic equipment and readable medium Download PDF

Info

Publication number
CN114327049B
CN114327049B CN202111488286.9A CN202111488286A CN114327049B CN 114327049 B CN114327049 B CN 114327049B CN 202111488286 A CN202111488286 A CN 202111488286A CN 114327049 B CN114327049 B CN 114327049B
Authority
CN
China
Prior art keywords
prompt
scene
level
risk
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111488286.9A
Other languages
Chinese (zh)
Other versions
CN114327049A (en
Inventor
林雅明
彭飞
邓竹立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 58 Information Technology Co Ltd
Original Assignee
Beijing 58 Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing 58 Information Technology Co Ltd filed Critical Beijing 58 Information Technology Co Ltd
Priority to CN202111488286.9A priority Critical patent/CN114327049B/en
Publication of CN114327049A publication Critical patent/CN114327049A/en
Application granted granted Critical
Publication of CN114327049B publication Critical patent/CN114327049B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides a prompting method, a prompting device, electronic equipment and a readable medium based on AR application, wherein the method comprises the following steps: displaying a corresponding AR content interface, identifying whether a real-time marker in an image is a target marker by acquiring a current acquisition image corresponding to a current observation view angle and carrying out content recognition on the current acquisition image, if the current acquisition image contains the target marker, determining a prompt level according to a target scene corresponding to the target marker, and outputting prompt information, so that whether the marker in the current acquisition image is the target marker is judged by a real-time image recognition mode, and the prompt information is output according to the target scene represented by the target marker.

Description

AR application-based prompting method and device, electronic equipment and readable medium
Technical Field
The present invention relates to the field of AR technology, and in particular, to an AR application-based prompting method, an AR application-based prompting device, an electronic device, and a computer readable medium.
Background
With the development and advancement of technology, augmented reality (Augmented Reality, AR) technology is increasingly being applied, for example, AR applications and AR cell phone games with entertainment properties. Because the AR technology is a technology of seamlessly connecting real world information and virtual world information, making the AR technology into a mobile game can improve entertainment and playability of the game, and is extremely easy to enthusiasm for the game, so that when some players play the game, the security of the environment is easily ignored due to the immersion of the game. Therefore, as the AR mobile game brings stronger immersion to the user compared with other mobile games, the AR mobile game is easier to attract all the attention of the user, so that the user cannot pay attention to the surrounding environment, and certain potential safety hazards are provided.
Disclosure of Invention
The embodiment of the invention provides a prompting method, a prompting device, electronic equipment and a computer readable storage medium based on an AR application, which are used for solving the problems that a user cannot be effectively reminded of safety and weak prompting force in the process of running the AR application in the prior art.
The embodiment of the invention discloses a prompting method based on AR application, which comprises the following steps:
responding to the AR content display interface, and acquiring a current acquired image corresponding to the current observation visual angle;
performing content identification on the current acquired image to obtain at least one real-time marker;
if the at least one real-time marker comprises a target marker, determining a target scene corresponding to the target marker;
and determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level.
Optionally, if the at least one real-time marker includes a target marker, determining a target scene corresponding to the target marker includes:
taking at least one real-time marker successfully matched with a preset marker in the current acquired image as a target marker;
acquiring scene mapping information aiming at the target marker, wherein the scene mapping information comprises a corresponding relation between the preset marker and a preset scene;
and acquiring a target scene corresponding to the target marker from the scene mapping information.
Optionally, the target marker includes a vehicle interior component, the target scene includes an in-vehicle scene corresponding to the vehicle interior component, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
Acquiring the activity state information of a preset terminal, wherein the activity state information at least comprises the movement speed;
if the movement speed is greater than or equal to a preset speed threshold, determining that the in-vehicle scene is a vehicle driving scene, determining that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputting dangerous prompt information corresponding to the dangerous prompt level;
if the movement speed is smaller than a preset speed threshold, determining that the scene in the vehicle is a vehicle parking scene, determining that a prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
Optionally, the target marker includes a traffic outdoor marker, the target scene includes a traffic outdoor scene corresponding to the traffic outdoor marker, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
determining the prompt level corresponding to the outdoor traffic environment as a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
Optionally, the target marker includes a secure outdoor marker, the target scene includes a secure outdoor scene corresponding to the secure outdoor marker, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
And determining the prompt level corresponding to the safe outdoor scene as a safe prompt level, and outputting the safe prompt information corresponding to the safe prompt level.
Optionally, the outputting the danger prompt information corresponding to the danger prompt level includes:
displaying a dangerous prompt window corresponding to the dangerous prompt level in the AR content interface, wherein the dangerous prompt window at least comprises dangerous prompt information corresponding to the dangerous prompt level and a first exit control, and the dangerous prompt information is information for prompting a user to close a preset AR application;
responding to touch operation for the first exit control, and closing the AR content interface;
or if the display duration of the danger prompt window is longer than or equal to a preset time threshold, closing the AR content interface.
Optionally, the outputting risk prompt information corresponding to the risk prompt level includes:
displaying a risk inquiry window corresponding to the risk prompt level in the AR content interface, wherein the risk inquiry window comprises risk inquiry information, a second exit control and a confirmation control, and the risk inquiry information is information for inquiring whether a user needs to close a preset AR application;
Closing the AR content interface in response to a touch operation for the second exit control;
or closing the risk inquiry window in response to the touch operation of the confirmation control.
Optionally, the outputting the security prompt information corresponding to the security prompt level includes:
and displaying a safety prompt window on the AR content interface, wherein the safety prompt window comprises safety prompt information which is information for reminding a user to pay attention to safety.
The embodiment of the invention also discloses a prompting device based on the AR application, which comprises:
the image acquisition module is used for detecting the running of the AR application of the user terminal and acquiring at least one acquired image corresponding to the current observation visual angle;
the image classification module is used for classifying the acquired images;
the environment information acquisition module is used for acquiring environment information corresponding to a preset target marker if the acquired image is identified to contain the target marker;
and the prompt information output module is used for acquiring the prompt level corresponding to the environment information and outputting the prompt information corresponding to the prompt level.
Optionally, the environmental information obtaining module includes:
A target marker determination sub-module, configured to use at least one real-time marker successfully matched with a preset marker in the current acquired image as a target marker;
the scene mapping information acquisition sub-module is used for acquiring scene mapping information aiming at the target marker, wherein the scene mapping information comprises a corresponding relation between the preset marker and a preset scene;
and the target scene determining sub-module is used for acquiring a target scene corresponding to the target marker from the scene mapping information.
Optionally, the target marker includes a vehicle interior component, the target scene includes an in-vehicle scene corresponding to the vehicle interior component, and the prompt information output module includes:
the mobile terminal comprises an activity state information acquisition sub-module, a control module and a control module, wherein the activity state information acquisition sub-module acquires the activity state information of a preset terminal, and the activity state information at least comprises a movement speed;
the dangerous prompt sub-module determines that the in-vehicle scene is a vehicle driving scene if the movement speed is greater than or equal to a preset speed threshold, determines that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputs dangerous prompt information corresponding to the dangerous prompt level;
And if the movement speed is smaller than a preset speed threshold, determining that the in-vehicle scene is a vehicle parking scene, determining that a prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
Optionally, the target marker includes a traffic outdoor marker, the target scene includes a traffic outdoor scene corresponding to the traffic outdoor marker, and the prompt information output module includes:
the second risk prompting sub-module is used for determining the prompting level corresponding to the outdoor traffic environment as a risk prompting level and outputting risk prompting information corresponding to the risk prompting level.
Optionally, the target scene includes a secure outdoor scene corresponding to the secure outdoor sign, and the prompt information output module includes:
and the safety prompt sub-module is used for determining the prompt level corresponding to the safety outdoor scene as the safety prompt level and outputting the safety prompt information corresponding to the safety prompt level.
The embodiment of the invention also discloses electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
The memory is used for storing a computer program;
the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.
Embodiments of the invention also disclose one or more computer-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in the embodiments of the invention.
The embodiment of the invention has the following advantages:
the method and the device can be applied to a mobile terminal, the corresponding AR content interface is displayed in a graphical user interface of the mobile terminal, the current acquisition image corresponding to the current observation view angle is obtained, the content identification is carried out on the current acquisition image, whether the real-time marker in the image is the target marker is identified, if the current acquisition image contains at least one target marker, the prompt level is determined according to the target scene corresponding to the target marker, and prompt information is output, so that whether the marker in the current acquisition image is the target marker is judged in a real-time image identification mode, and the prompt information is output according to the target scene represented by the target marker, and therefore when a user runs an AR application in an environment with potential safety hazard, the user is reminded through the output of the prompt information on the AR content interface, the risk of accidents encountered by the user when the user uses the AR application program is reduced, and the safety of the user using the AR application is improved.
Drawings
FIG. 1 is a flow chart of steps of an AR application based prompting method provided in an embodiment of the present invention;
FIG. 2 is a block diagram of an AR application-based reminder provided in an embodiment of the present invention;
FIG. 3 is a block diagram of an electronic device provided in an embodiment of the invention;
fig. 4 is a schematic diagram of a computer readable medium provided in an embodiment of the invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
As an example, as technology develops and advances, AR technology is increasingly being applied, such as AR application programs and AR mobile games with entertainment properties (AR applications described below). When a user runs an AR application, the AR technology enables a real environment to be overlapped with a virtual environment in real time by applying virtual information to the real world, so that the real environment and the virtual environment can be simultaneously displayed in a graphical user interface of a user terminal, and the user can interact with the virtual world in the real world through the graphical user interface.
The AR application can bring brand new interaction experience to the user by virtue of the characteristics of virtual-real fusion, virtual-real interaction and the like. In some existing AR applications, the player is encouraged to go home and go outdoors, and the player has more power to explore the world while bringing more real experience to the user, so the AR is favored by the vast users. The AR application is more interesting than the common mobile phone application, and the user is more easy to indulge, so that some users can open the AR application when driving or crossing a road. However, the AR application brings a stronger immersion to the user, so that the player is immersed in the AR application and cannot notice the nearby environment, and has a certain potential safety hazard, while the AR application does not provide a strong enough warning for the phenomenon.
In this regard, one of the core invention points is that a corresponding AR content interface is displayed in a graphical user interface of a mobile terminal, a current acquisition image corresponding to a current viewing angle is obtained, and content identification is performed on the current acquisition image to identify whether a real-time marker in the image is a target marker, if the current acquisition image contains at least one target marker, a prompt level is determined according to a target scene corresponding to the target marker, and prompt information is output, so that whether the marker in the current acquisition image is the target marker is judged in a real-time image identification manner, and prompt information is output according to the target scene represented by the target marker, thereby realizing that when a user runs an AR application in an environment with potential safety hazard, the user is reminded by outputting the prompt information on the AR content interface, reducing the risk of accidents encountered by the user when the user uses the AR application, and improving the safety of the AR application.
In order to facilitate understanding of technical solutions according to embodiments of the present invention by those skilled in the art, the following explains and describes some technical terms related to the embodiments of the present invention:
The scene mapping information is the corresponding relation between the preset marker and the preset scene and is used for confirming the target scene corresponding to the target marker.
And the dangerous prompt level is determined as the dangerous prompt level if the environment where the user is located is considered to have extremely high dangerous degree and is most likely to cause safety accidents. For example, when the user is running the AR application while driving the vehicle, the terminal confirms that the in-vehicle scene is a vehicle driving scene, and that traffic accidents are likely to occur, and confirms the in-vehicle scene as a danger prompt level.
And the risk prompt level is determined as the risk prompt level if the environment where the user is located is considered to have a certain safety risk and a certain probability of causing a safety accident. For example, when the user runs the AR application while crossing the road, the terminal confirms that the target scene is an outdoor traffic scene, and if there is a certain probability that a traffic accident occurs, the terminal confirms the target scene as a risk prompt level.
The safety prompt level is considered to be safer in the environment where the user is located, but still is in the open air, the user needs to be reminded of the surrounding environment at any time so as to ensure that the emergency is handled at any time, and the safety prompt level is confirmed. For example, when the user is in a park, school, or other environment to run the AR application, the terminal confirms that the target scene is a safe outdoor scene, and if there is a low probability that a safety accident will occur, the terminal confirms the target scene as a safety prompt level.
Specifically, referring to fig. 1, a step flowchart of an AR application-based prompting method provided in an embodiment of the present invention may specifically include the following steps:
step 101, responding to an AR content display interface, and acquiring a current acquired image corresponding to a current observation visual angle;
when a user opens an AR application at a terminal, a graphical display interface on his terminal displays an AR content interface. The AR application is an integrated application that combines a real world with a virtual world, and a user can view a virtual image overlapping the real world by presenting a virtual material preset in the AR application in the real world. The terminal can respond to the running of the AR application, the camera is opened to shoot the real scene in the real world, the real scene in the AR application is generated, the preset material for creating the AR application is displayed in the real scene, and a user can see the combined picture of the virtual scene of the AR application and the real world in the AR content interface. The preset materials of the AR application comprise static materials and dynamic materials, the static materials can comprise virtual ornaments, virtual scenes and the like, and the dynamic materials can comprise virtual roles, virtual rewards and the like.
When the preset terminal is a local terminal device, the preset terminal can be a handheld terminal device with a camera such as a tablet personal computer and an intelligent terminal, or can be an AR device. Wherein the AR device may include an AR headset, an AR control device, and the like.
In an example, a user can see an AR picture displayed by superposition of a real picture and virtual information in the AR headset, and the terminal can realize interaction with the virtual character by detecting actions of the character in the real world and acquire a current acquired image corresponding to a current observation visual angle of the user in real time according to the picture shot by the camera.
In another example, when the preset terminal is a handheld terminal device, a user performs operations such as clicking and sliding in an AR content interface or moving a camera in the process of using the AR application, so as to perform interaction between a real scene and a virtual scene and virtual content of the AR application, and then the terminal obtains a current acquired image corresponding to a current viewing angle of the user according to a picture shot by the camera in real time.
102, performing content identification on the current acquired image to obtain at least one real-time marker;
after the terminal acquires the current acquired image, the current acquired image can be input into an image recognition model for content recognition, so that the image characteristics of the current acquired image can be acquired, and the recognized image characteristics are compared with a preset image characteristic library to determine target image characteristics, wherein the image characteristics can be color characteristics, texture characteristics, shape characteristics, spatial relationship characteristics and the like of the image. And the terminal can provide preset markers for providing preset marker feature information, then the target image features and the preset marker feature information are used for comparison, so that at least one real-time marker can be contained in the current acquired image, the image decision on an objective object is made through visual perception of an image recognition model, the image recognition model can completely run on user equipment without any network connection, and therefore, when the scene is changed, the user can more sensitively respond, and under the condition of no network, the user can be prompted for safety, and the risk of safety accidents encountered by the user when the AR application program is used is reduced.
In an example, when the user is in a main driving position in the vehicle, the AR application is opened, the terminal may acquire a current acquired image of the real environment in which the user is located through the current view angle of the camera, and acquire an image feature of the current acquired image in the current view angle, if the acquired image feature is a "ring shape", the "ring shape" is compared with a preset image feature library, and when the preset image library contains the image feature of the "ring shape", the "ring shape" may be determined as the target image feature. Then, the "ring shape" is used as the target image feature to be compared with the preset marker feature information, and the real-time marker contained in the current acquired image can be determined to be the "steering wheel" through comparison.
Step 103, if the at least one real-time marker comprises a target marker, determining a target scene corresponding to the target marker;
after determining that at least one real-time marker successfully matched with the preset marker exists in the current acquired image, the real-time marker can be used as a target marker. Then, scene mapping information aiming at the target marker is obtained, wherein the scene mapping information comprises a corresponding relation between a preset marker and a preset scene, for example, when the preset marker is a vehicle interior component, the corresponding preset scene is set as an in-vehicle scene, when the preset marker is a traffic outdoor marker, the corresponding preset scene is set as a traffic outdoor scene, when the preset marker is a safe outdoor marker, the corresponding preset scene is set as a safe outdoor scene, and the like. Wherein the vehicle interior component may be a steering wheel, dashboard, vehicle seat, etc.; the traffic outdoor sign can be a road marking, a traffic light, a traffic railing and the like; the safe outdoor sign can be trees, lawns, flower beds, other pedestrians and the like.
Through the mapping relation, the terminal can acquire the target scene corresponding to the target marker by acquiring the scene mapping information of the target marker.
In one example, after the terminal determines that the real-time marker included in the current acquired image is the "steering wheel", the terminal uses the "steering wheel" as the target marker, and then obtains scene mapping information for the "steering wheel", and the target scene can be determined to be the "in-vehicle scene" through comparison of the mapping relations.
In another example, after the terminal determines that the real-time marker included in the current acquired image is the "zebra stripes", the terminal uses the "zebra stripes" as the target marker, and then obtains scene mapping information for the "zebra stripes", and the terminal can determine that the target scene is the "outdoor traffic scene" through comparison of the mapping relations.
Step 104, determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level.
When the terminal determines that the target marker is a vehicle interior component, the target scene comprises an in-vehicle scene corresponding to the vehicle interior component, and the terminal acquires activity state information, wherein the activity state information at least comprises a movement speed. If the movement speed is greater than or equal to a preset speed threshold, determining that the scene in the vehicle is a vehicle driving scene, then determining that the prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputting dangerous prompt information corresponding to the dangerous prompt level by the terminal; if the movement speed is smaller than the preset speed threshold, determining that the scene in the vehicle is a vehicle parking scene, determining that the prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level. The vehicle interior components may be, among other things, steering wheels, dashboards, center controls, vehicle seats, etc.
In one example, when the user is in an in-vehicle environment and opens the AR application, the terminal may determine that the user is in an in-vehicle scene through real-time markers such as a steering wheel, a dashboard, a center control, etc. in the currently acquired image. When the terminal determines that the user is in the in-vehicle scene, the activity state of the user is judged by acquiring activity state information, wherein the activity state information at least comprises a movement speed, a preset speed threshold value is set for the movement speed, and the preset speed threshold value can be set to be 0.1km/h. When the acquired movement speed is greater than or equal to 0.1km/h, the user is in a state of controlling the vehicle to run, the terminal can determine that the scene in the vehicle is a vehicle running scene, determine that the prompt level corresponding to the vehicle running scene is a dangerous prompt level, and output dangerous prompt information corresponding to the dangerous prompt level. And when the acquired movement speed is less than 0.1km/h, the user is in a state of not controlling the vehicle to run, the terminal can determine that the in-vehicle scene is a vehicle parking scene, determine that the prompt level corresponding to the vehicle parking scene is a risk prompt level, and output risk prompt information corresponding to the risk prompt level.
In another example, when the terminal determines that the user is in the vehicle interior, the terminal can also determine the position of the user in the vehicle interior through the markers in the current acquired image, so as to determine whether the activity state information needs to be acquired to determine the activity state of the user. For example, when the front image including the steering wheel marker in the current acquired image, it may be determined that the user is in the main driving position; when the current acquired image contains a side image of a steering wheel marker or a part of center control marker, the fact that the user is in a copilot position can be determined; when the front collected image contains a driving seat marker or a car window marker, the position of the rear seat of the user can be determined. The terminal can judge whether the activity state information is required to be acquired according to different positions of the user to judge the activity state of the user, and output risk prompt information with different prompt levels. For example, when the user is located in the main driving position, that is, the user activity state information needs to be acquired to determine whether the user is driving the vehicle, and when the user is driving the vehicle, the terminal can determine the prompt level as the dangerous prompt level and output dangerous prompt information corresponding to the dangerous prompt level; when the user is located in the co-driver seat and the rear seat, the terminal can determine that the prompt level is a risk prompt level without acquiring the activity state information of the user, and output risk prompt information corresponding to the risk prompt level.
When the terminal determines that the target marker comprises the traffic outdoor marker, the terminal can determine that the target scene comprises the traffic outdoor scene corresponding to the traffic outdoor marker, determine that the prompting level corresponding to the traffic outdoor environment is a risk prompting level, and output risk prompting information corresponding to the risk prompting level. The traffic outdoor sign can be a road marking, a traffic light, etc.
In one example, when the user is turning on the AR application while crossing a road, the terminal may determine that the user is in a traffic outdoor scene according to the markers identified in the current acquired image, such as zebra stripes, traffic guardrails, traffic lights, and the like. When the terminal determines that the user is in the traffic outdoor scene, the terminal can judge that the prompt level corresponding to the traffic outdoor environment is the risk prompt level, and output risk prompt information corresponding to the risk prompt level.
When the terminal determines that the target marker comprises the safety outdoor marker, the terminal can determine that the target scene comprises the safety outdoor scene corresponding to the safety outdoor marker, determine that the prompt level corresponding to the safety outdoor environment is a safety prompt level, and output safety prompt information corresponding to the safety prompt level. The safety outdoor sign can be a tree, a lawn, a flower bed and the like.
In one example, when the user is walking outdoors, the AR application is opened, and the terminal may determine that the user is in a safe outdoor scene such as a park, school road, pedestrian road, or the like, according to the flower bed, lawn, tree, or the like identified in the current acquired image. When the terminal determines that the user is in a safe outdoor scene, the terminal can judge that the prompt level corresponding to the traffic outdoor environment is a safe prompt level and output the safe danger prompt information corresponding to the safe prompt level.
When the terminal determines that the scene where the user is located is a dangerous prompt level, a dangerous prompt window corresponding to the dangerous prompt level is displayed in the AR content interface, wherein the dangerous prompt window at least comprises dangerous prompt information corresponding to the dangerous prompt level and a first exit control, and the dangerous prompt information is information for prompting the user to close a preset AR application; when a user clicks the first exit control, the terminal can respond to touch operation aiming at the first exit control and close the AR content interface; meanwhile, a preset time threshold is set in the danger prompt window, and when the display time of the danger prompt window is greater than or equal to the preset time threshold, the terminal can automatically close the AR content interface.
In one example, when the terminal determines that the user is in a vehicle driving scene, the prompt level can be determined to be a dangerous prompt level, a dangerous prompt window corresponding to the dangerous prompt level is displayed in the AR content interface, and when the dangerous prompt window is displayed, at least dangerous prompt information corresponding to the dangerous prompt level is included, for example, "warning-! Identifying that the user is in a dangerous scenario, please immediately exit the application-! "etc. And the dangerous prompt window also comprises a first exit control, the first exit control comprises a countdown, the countdown is a preset time threshold, and the first exit control comprises words such as 'immediately exiting (5 s)'. After the dangerous prompt window is popped up, the user can click the first exit control to immediately exit the AR application, or can wait for the countdown to finish, the terminal automatically exits the AR application, and the dangerous prompt window can not be closed, and the user can only be forced to exit the AR application by the countdown and clicking the first exit control, so that the user can be ensured not to cause potential safety hazards when driving a vehicle or other dangerous conditions.
When the terminal determines that the scene where the user is positioned is the risk prompt level, a risk inquiry window corresponding to the risk prompt level is displayed in the AR content interface, and the risk inquiry window comprises a second exit control and a confirmation control. When the user clicks the second exit control, the terminal responds to touch operation aiming at the second exit control, and the AR content interface is closed; when the user clicks the confirmation control, the terminal responds to the touch operation of the confirmation control, closes the risk inquiry window, and the user can continue to use the AR application.
In one example, when the terminal determines that the user is in a risk outdoor scene such as crossing a road, and the prompt level is determined to be a risk prompt level, a risk query window corresponding to the risk prompt level is displayed in the AR content interface, and when the risk query window is displayed, at least risk query information corresponding to the risk prompt level is included therein, for example, "attention-! Recognizing that the user is in a risk scene, please observe the surroundings, and judging whether the application is required to be exited or not-! "wait for the typeface, and also include the second and withdraw from the control in the risk inquiry window, include, withdraw from the control, etc. typeface like" withdraw from immediately "on the second, and confirm the control, include, such as" continue to apply "etc. typeface on the control. After the risk inquiry window is popped up, the user can observe the environment where the user is located according to the prompt of the risk inquiry information, judge whether the user needs to exit the AR application, and click a second exit control when the user considers that the environment where the user is located is the risk environment, so that the user can immediately exit the AR application; and when the user considers that the environment is a safe environment, the user can click on the confirmation control to continue to use the AR application. The risk inquiry window can be displayed when the terminal recognizes that the user is in a risk outdoor scene, so that the safety of the user when the AR program is operated is ensured, and potential safety hazards caused by the fact that the user cannot notice the surrounding environment due to immersion in the AR application are avoided.
When the terminal determines that the scene where the user is located is the security prompt level, a security prompt window corresponding to the security prompt level is displayed on the AR content interface, and security prompt information is included in the security prompt window, wherein the security prompt information is information for reminding the user to pay attention to security.
In one example, when the terminal determines that the user is in a safe outdoor scene such as a cell, a square, etc., and the prompt level is determined to be a safe prompt level, a safe prompt window corresponding to the safe prompt level is displayed in the AR content interface. The safety prompt window may have a certain transparency, and the display position may be any position right above, right below, etc. of the screen, which does not affect the use of the AR application by the user, and when the safety prompt window is displayed, at least includes safety prompt information corresponding to the safety prompt level, for example, "remind-! Note that observe the surrounding environment-! "etc., the user can slide the security prompt window upward, rightward or in any direction, close the security prompt window, and continue using the AR application.
In another example, when the terminal determines that the user is in a park, school, or other safe outdoor scene, the prompt level is determined to be the safe prompt level, a safe prompt window corresponding to the safe prompt level is displayed in the AR content interface, and the safe prompt window has a certain transparency and does not affect the experience of the user using the AR application. When the safety prompt window is displayed, at least safety prompt information corresponding to the safety prompt level is included, for example, "prompt-! Recognizing that the user is in an outdoor scenario, please observe the surrounding environment-! "etc. And a closing control is also included in the safety prompt window, and words such as closing are included on the closing window control. The preset time threshold can also be set in the safety prompt window, and a countdown, such as a word like "closing (5 s)", is included in the closing control. After the security prompt window is popped up, the user can click on the close control to close the security prompt window. When the safety prompt window sets a preset time threshold, the terminal can also wait for the end of countdown, and automatically close the safety prompt window application. The safety prompt window can remind the user of paying attention to the surrounding environment, and the situation that potential safety hazards are caused because the user is immersed in the safety prompt window when the AR application is set up is avoided.
The method and the device can be applied to a mobile terminal, the corresponding AR content interface is displayed in a graphical user interface of the mobile terminal, the current acquisition image corresponding to the current observation view angle is obtained, the content identification is carried out on the current acquisition image, whether the real-time marker in the image is the target marker is identified, if the current acquisition image contains at least one target marker, the prompt level is determined according to the target scene corresponding to the target marker, and prompt information is output, so that whether the marker in the current acquisition image is the target marker is judged in a real-time image identification mode, and the prompt information is output according to the target scene represented by the target marker, and therefore when a user runs an AR application in an environment with potential safety hazard, the user is reminded through the output of the prompt information on the AR content interface, the risk of accidents encountered by the user when the user uses the AR application program is reduced, and the safety of the user using the AR application is improved.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 2, a block diagram of a prompting device based on AR application provided in an embodiment of the present invention is shown, which may specifically include the following modules:
the image acquisition module 201 is configured to detect an operation of an AR application of the user terminal, and acquire at least one acquired image corresponding to a current viewing angle;
an image classification module 202, configured to perform image classification on the acquired image;
the environmental information obtaining module 203 is configured to obtain environmental information corresponding to a target marker if it is identified that the acquired image includes the target marker set in advance;
and the prompt information output module 204 is configured to obtain a prompt level corresponding to the environmental information, and output prompt information corresponding to the prompt level.
In an alternative embodiment, if the at least one real-time marker includes a target marker, determining a target scene corresponding to the target marker, the environment information obtaining module 203 includes:
a target marker determination sub-module, configured to use at least one real-time marker successfully matched with a preset marker in the current acquired image as a target marker;
the scene mapping information acquisition sub-module is used for acquiring scene mapping information aiming at the target marker, wherein the scene mapping information comprises a corresponding relation between the preset marker and a preset scene;
And the target scene determining sub-module is used for acquiring a target scene corresponding to the target marker from the scene mapping information.
In an alternative embodiment, the target marker includes a vehicle interior component, the target scene includes an in-vehicle scene corresponding to the vehicle interior component, and the prompt information output module 204 includes:
the mobile terminal comprises an activity state information acquisition sub-module, a control module and a control module, wherein the activity state information acquisition sub-module acquires the activity state information of a preset terminal, and the activity state information at least comprises a movement speed;
the dangerous prompt sub-module determines that the in-vehicle scene is a vehicle driving scene if the movement speed is greater than or equal to a preset speed threshold, determines that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputs dangerous prompt information corresponding to the dangerous prompt level;
and if the movement speed is smaller than a preset speed threshold, determining that the in-vehicle scene is a vehicle parking scene, determining that a prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
In an alternative embodiment, the target marker includes a traffic outdoor marker, the target scene includes a traffic outdoor scene corresponding to the traffic outdoor marker, and the prompt information output module includes:
The second risk prompting sub-module is used for determining the prompting level corresponding to the outdoor traffic environment as a risk prompting level and outputting risk prompting information corresponding to the risk prompting level.
In an alternative embodiment, the target marker includes a secure outdoor marker, the target scene includes a secure outdoor scene corresponding to the secure outdoor marker, and the prompt information output module includes:
and the safety prompt sub-module is used for determining the prompt level corresponding to the safety outdoor scene as the safety prompt level and outputting the safety prompt information corresponding to the safety prompt level.
In an alternative embodiment, the danger prompting submodule is specifically configured to:
displaying a dangerous prompt window corresponding to the dangerous prompt level in the AR content interface, wherein the dangerous prompt window at least comprises dangerous prompt information corresponding to the dangerous prompt level and a first exit control, and the dangerous prompt information is information for prompting a user to close a preset AR application;
responding to touch operation for the first exit control, and closing the AR content interface;
or if the display duration of the danger prompt window is longer than or equal to a preset time threshold, closing the AR content interface.
In an alternative embodiment, the first risk prompting sub-module and/or the second risk prompting sub-module are specifically configured to:
displaying a risk inquiry window corresponding to the risk prompt level in the AR content interface, wherein the risk inquiry window comprises risk inquiry information, a second exit control and a confirmation control, and the risk inquiry information is information for inquiring whether a user needs to close a preset AR application;
closing the AR content interface in response to a touch operation for the second exit control;
or closing the risk inquiry window in response to the touch operation of the confirmation control.
In an alternative embodiment, the safety prompt submodule is specifically configured to:
and displaying a safety prompt window on the AR content interface, wherein the safety prompt window comprises safety prompt information which is information for reminding a user to pay attention to safety.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
In addition, the embodiment of the invention also provides an electronic device, as shown in fig. 3, which comprises a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302 and the memory 303 complete communication with each other through the communication bus 304,
A memory 303 for storing a computer program;
the processor 301 is configured to execute the program stored in the memory 303, and implement the method according to the embodiment of the present invention:
responding to the AR content display interface, and acquiring a current acquired image corresponding to the current observation visual angle;
performing content identification on the current acquired image to obtain at least one real-time marker;
if the at least one real-time marker comprises a target marker, determining a target scene corresponding to the target marker;
and determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level.
In an alternative embodiment, if the at least one real-time marker includes a target marker, determining a target scene corresponding to the target marker includes:
taking at least one real-time marker successfully matched with a preset marker in the current acquired image as a target marker;
acquiring scene mapping information aiming at the target marker, wherein the scene mapping information comprises a corresponding relation between the preset marker and a preset scene;
and acquiring a target scene corresponding to the target marker from the scene mapping information.
In an alternative embodiment, the target marker includes a vehicle interior component, the target scene includes an in-vehicle scene corresponding to the vehicle interior component, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
acquiring the activity state information of a preset terminal, wherein the activity state information at least comprises the movement speed;
if the movement speed is greater than or equal to a preset speed threshold, determining that the in-vehicle scene is a vehicle driving scene, determining that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputting dangerous prompt information corresponding to the dangerous prompt level;
if the movement speed is smaller than a preset speed threshold, determining that the scene in the vehicle is a vehicle parking scene, determining that a prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
In an alternative embodiment, the target marker includes a traffic outdoor marker, the target scene includes a traffic outdoor scene corresponding to the traffic outdoor marker, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
Determining the prompt level corresponding to the outdoor traffic environment as a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level.
In an alternative embodiment, the target marker includes a secure outdoor marker, the target scene includes a secure outdoor scene corresponding to the secure outdoor marker, the determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level includes:
and determining the prompt level corresponding to the safe outdoor scene as a safe prompt level, and outputting the safe prompt information corresponding to the safe prompt level.
In an optional embodiment, the outputting the danger prompt information corresponding to the danger prompt level includes:
displaying a dangerous prompt window corresponding to the dangerous prompt level in the AR content interface, wherein the dangerous prompt window at least comprises dangerous prompt information corresponding to the dangerous prompt level and a first exit control, and the dangerous prompt information is information for prompting a user to close a preset AR application;
responding to touch operation for the first exit control, and closing the AR content interface;
Or if the display duration of the danger prompt window is longer than or equal to a preset time threshold, closing the AR content interface.
In an optional embodiment, the outputting risk prompting information corresponding to the risk prompting level includes:
displaying a risk inquiry window corresponding to the risk prompt level in the AR content interface, wherein the risk inquiry window comprises risk inquiry information, a second exit control and a confirmation control, and the risk inquiry information is information for inquiring whether a user needs to close a preset AR application;
closing the AR content interface in response to a touch operation for the second exit control;
or closing the risk inquiry window in response to the touch operation of the confirmation control.
In an optional embodiment, the outputting the security prompt information corresponding to the security prompt level includes:
and displaying a safety prompt window on the AR content interface, wherein the safety prompt window comprises safety prompt information which is information for reminding a user to pay attention to safety.
The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the terminal and other devices.
The memory may include random access memory (Random Access Memory, RAM) or non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment provided by the present invention, as shown in fig. 4, there is further provided a computer readable storage medium 401 having instructions stored therein, which when run on a computer, cause the computer to perform an AR application based prompting method as described in the above embodiment.
In yet another embodiment of the present invention, a computer program product comprising instructions, which when run on a computer, causes the computer to perform an AR application based prompting method as described in the above embodiments is also provided.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as risk and risk, and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (8)

1. A method of prompting based on an AR application, the method comprising:
responding to the AR content display interface, and acquiring a current acquired image corresponding to the current observation visual angle;
performing content identification on the current acquired image to obtain at least one real-time marker;
if the at least one real-time marker comprises a target marker, determining a target scene corresponding to the target marker;
determining a prompt level corresponding to the target scene, and outputting prompt information corresponding to the prompt level;
the target mark comprises a vehicle interior component, a traffic outdoor mark and a safety outdoor mark, wherein the target scene comprises an in-vehicle scene corresponding to the vehicle interior component, a traffic outdoor scene corresponding to the traffic outdoor mark and a safety outdoor scene corresponding to the safety outdoor mark, the prompt level corresponding to the target scene is determined, prompt information corresponding to the prompt level is output, and the target mark comprises:
Acquiring the activity state information of a preset terminal, wherein the activity state information at least comprises the movement speed;
if the movement speed is greater than or equal to a preset speed threshold, determining that the in-vehicle scene is a vehicle driving scene, determining that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputting dangerous prompt information corresponding to the dangerous prompt level;
if the movement speed is smaller than a preset speed threshold, determining that the in-vehicle scene is a vehicle parking scene, determining that a prompt level corresponding to the vehicle parking scene is a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level;
determining a prompt level corresponding to the outdoor traffic environment as a risk prompt level, and outputting risk prompt information corresponding to the risk prompt level;
and determining the prompt level corresponding to the safe outdoor scene as a safe prompt level, and outputting the safe prompt information corresponding to the safe prompt level.
2. The method of claim 1, wherein if the at least one real-time marker comprises a target marker, determining a target scene corresponding to the target marker comprises:
Taking at least one real-time marker successfully matched with a preset marker in the current acquired image as a target marker;
acquiring scene mapping information aiming at the target marker, wherein the scene mapping information comprises a corresponding relation between the preset marker and a preset scene;
and acquiring a target scene corresponding to the target marker from the scene mapping information.
3. The method of claim 1, wherein outputting the hazard prompt information corresponding to the hazard prompt level comprises:
displaying a dangerous prompt window corresponding to the dangerous prompt level in the AR content interface, wherein the dangerous prompt window at least comprises dangerous prompt information corresponding to the dangerous prompt level and a first exit control, and the dangerous prompt information is information for prompting a user to close a preset AR application;
responding to touch operation for the first exit control, and closing the AR content interface;
or if the display duration of the danger prompt window is longer than or equal to a preset time threshold, closing the AR content interface.
4. The method according to claim 1, wherein the outputting risk prompting information corresponding to the risk prompting level includes:
Displaying a risk inquiry window corresponding to the risk prompt level in the AR content interface, wherein the risk inquiry window comprises risk inquiry information, a second exit control and a confirmation control, and the risk inquiry information is information for inquiring whether a user needs to close a preset AR application;
closing the AR content interface in response to a touch operation for the second exit control;
or closing the risk inquiry window in response to the touch operation of the confirmation control.
5. The method according to claim 1, wherein the outputting the security hint information corresponding to the security hint level includes:
and displaying a safety prompt window on the AR content interface, wherein the safety prompt window comprises safety prompt information which is information for reminding a user to pay attention to safety.
6. An AR application-based reminder device, the device comprising:
the image acquisition module is used for detecting the running of the AR application of the user terminal and acquiring at least one acquired image corresponding to the current observation visual angle;
the image classification module is used for classifying the acquired images;
the environment information acquisition module is used for acquiring a target scene corresponding to a preset target marker if the acquired image is identified to contain the target marker;
The prompt information output module is used for acquiring the prompt level corresponding to the target scene and outputting the prompt information corresponding to the prompt level;
the target mark comprises a vehicle interior component, a traffic outdoor mark and a safety outdoor mark, the target scene comprises an in-vehicle scene corresponding to the vehicle interior component, a traffic outdoor scene corresponding to the traffic outdoor mark and a safety outdoor scene corresponding to the safety outdoor mark, and the prompt information output module comprises:
the mobile terminal comprises an activity state information acquisition sub-module, a control module and a control module, wherein the activity state information acquisition sub-module acquires the activity state information of a preset terminal, and the activity state information at least comprises a movement speed;
the dangerous prompt sub-module determines that the in-vehicle scene is a vehicle driving scene if the movement speed is greater than or equal to a preset speed threshold, determines that a prompt level corresponding to the vehicle driving scene is a dangerous prompt level, and outputs dangerous prompt information corresponding to the dangerous prompt level;
the first risk prompting sub-module determines that the in-vehicle scene is a vehicle parking scene if the movement speed is smaller than a preset speed threshold, determines that a prompting level corresponding to the vehicle parking scene is a risk prompting level, and outputs risk prompting information corresponding to the risk prompting level;
The second risk prompting sub-module is used for determining a prompting level corresponding to the outdoor traffic environment as a risk prompting level and outputting risk prompting information corresponding to the risk prompting level;
and the safety prompt sub-module is used for determining the prompt level corresponding to the safety outdoor scene as the safety prompt level and outputting the safety prompt information corresponding to the safety prompt level.
7. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;
the memory is used for storing a computer program;
the processor is configured to implement the method according to any one of claims 1-5 when executing a program stored on a memory.
8. A computer-readable medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-5.
CN202111488286.9A 2021-12-07 2021-12-07 AR application-based prompting method and device, electronic equipment and readable medium Active CN114327049B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111488286.9A CN114327049B (en) 2021-12-07 2021-12-07 AR application-based prompting method and device, electronic equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111488286.9A CN114327049B (en) 2021-12-07 2021-12-07 AR application-based prompting method and device, electronic equipment and readable medium

Publications (2)

Publication Number Publication Date
CN114327049A CN114327049A (en) 2022-04-12
CN114327049B true CN114327049B (en) 2023-07-25

Family

ID=81049154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111488286.9A Active CN114327049B (en) 2021-12-07 2021-12-07 AR application-based prompting method and device, electronic equipment and readable medium

Country Status (1)

Country Link
CN (1) CN114327049B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107122702A (en) * 2017-03-13 2017-09-01 北京集创北方科技股份有限公司 Safety device and safety method
CN107422942A (en) * 2017-08-15 2017-12-01 吴金河 A kind of control system and method for immersion experience
CN109523105A (en) * 2018-08-27 2019-03-26 中铁上海工程局集团有限公司 A kind of visualization Risk Identification and equipment based on bim Yu ar technology
CN110833691A (en) * 2019-10-30 2020-02-25 佛山市艾温特智能科技有限公司 Security protection method, system and readable storage medium based on AR game
CN111752373A (en) * 2019-03-28 2020-10-09 上海擎感智能科技有限公司 Vehicle-mounted interaction method, device and system
CN112288882A (en) * 2020-10-30 2021-01-29 北京市商汤科技开发有限公司 Information display method and device, computer equipment and storage medium
CN112598805A (en) * 2020-12-24 2021-04-02 浙江商汤科技开发有限公司 Prompt message display method, device, equipment and storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9824601B2 (en) * 2012-06-12 2017-11-21 Dassault Systemes Symbiotic helper
US10366290B2 (en) * 2016-05-11 2019-07-30 Baidu Usa Llc System and method for providing augmented virtual reality content in autonomous vehicles
US20180191769A1 (en) * 2016-12-30 2018-07-05 Glen J. Anderson Augmented reality monitor
CN109733391A (en) * 2018-12-10 2019-05-10 北京百度网讯科技有限公司 Control method, device, equipment, vehicle and the storage medium of vehicle

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107122702A (en) * 2017-03-13 2017-09-01 北京集创北方科技股份有限公司 Safety device and safety method
CN107422942A (en) * 2017-08-15 2017-12-01 吴金河 A kind of control system and method for immersion experience
CN109523105A (en) * 2018-08-27 2019-03-26 中铁上海工程局集团有限公司 A kind of visualization Risk Identification and equipment based on bim Yu ar technology
CN111752373A (en) * 2019-03-28 2020-10-09 上海擎感智能科技有限公司 Vehicle-mounted interaction method, device and system
CN110833691A (en) * 2019-10-30 2020-02-25 佛山市艾温特智能科技有限公司 Security protection method, system and readable storage medium based on AR game
CN112288882A (en) * 2020-10-30 2021-01-29 北京市商汤科技开发有限公司 Information display method and device, computer equipment and storage medium
CN112598805A (en) * 2020-12-24 2021-04-02 浙江商汤科技开发有限公司 Prompt message display method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN114327049A (en) 2022-04-12

Similar Documents

Publication Publication Date Title
CN110660254B (en) Traffic signal lamp detection and intelligent driving method and device, vehicle and electronic equipment
Park et al. In‐vehicle AR‐HUD system to provide driving‐safety information
Galko et al. Vehicle-Hardware-In-The-Loop system for ADAS prototyping and validation
Charisi et al. Children's views on identification and intention communication of self-driving vehicles
WO2020122986A1 (en) Driver attention detection using heat maps
EP3653441A1 (en) Blocked information displaying method and system for use in autonomous vehicle
Rogé et al. Low conspicuity of motorcycles for car drivers: dominant role of bottom-up control of visual attention or deficit of top-down control?
CN111767831B (en) Method, apparatus, device and storage medium for processing image
Young et al. Investigating the impact of static roadside advertising on drivers' situation awareness
Anderson et al. Feasibility study on the utilization of microsoft hololens to increase driving conditions awareness
CN114327049B (en) AR application-based prompting method and device, electronic equipment and readable medium
CN115355926B (en) Method, device, equipment and storage medium for vehicle navigation
CN110796740A (en) Security protection method, system and readable storage medium based on AR game
Kim et al. The usefulness of augmenting reality on vehicle head-up display
CN111569420A (en) Real environment track early warning method and system, VR playing equipment and storage medium
Rossi et al. Vehicle hardware-in-the-loop system for ADAS virtual testing
Cummings et al. Unreliable Pedestrian Detection and Driver Alerting in Intelligent Vehicles
CN112770139A (en) Virtual competition system and method for vehicle
KR102301074B1 (en) Traffic safety education method using VR contents
CN113470394A (en) Augmented reality display method and related device, vehicle and storage medium
JP2019109138A (en) Display device, display method, and display program
Kim et al. Interaction between AR Cue Types and Environmental Conditions in Autonomous Vehicles
Xie et al. Simulation‐Based Research on Driver Visibility of Black‐and‐White Striped Vehicles
Li Safe training of traffic assistants for detection of dangerous accidents
Wang et al. Driving process’ analysis and HUD design based on conditional autonomous traffic safety

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant