CN111752390A - Interface visual security detection method, device, equipment and storage medium - Google Patents
Interface visual security detection method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111752390A CN111752390A CN202010593609.XA CN202010593609A CN111752390A CN 111752390 A CN111752390 A CN 111752390A CN 202010593609 A CN202010593609 A CN 202010593609A CN 111752390 A CN111752390 A CN 111752390A
- Authority
- CN
- China
- Prior art keywords
- interface
- visual
- responded
- determining
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 311
- 238000001514 detection method Methods 0.000 title claims abstract description 43
- 230000003993 interaction Effects 0.000 claims abstract description 53
- 238000000034 method Methods 0.000 claims abstract description 47
- 230000002452 interceptive effect Effects 0.000 claims abstract description 5
- 230000004382 visual function Effects 0.000 claims description 52
- 230000015654 memory Effects 0.000 claims description 20
- 239000000126 substance Substances 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 7
- 238000012545 processing Methods 0.000 abstract description 4
- 238000012216 screening Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 20
- 238000010586 diagram Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30268—Vehicle interior
Abstract
The application discloses a visual safety detection method, a visual safety detection device, an interface visual safety detection equipment and a storage medium, and relates to the fields of image processing and automatic driving (including autonomous parking). The specific implementation scheme is as follows: determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interactive instruction under the condition that the vehicle is in a running state; determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded; and determining whether the interface to be responded responds to the vehicle-mounted interaction instruction or not according to the visual safety of the interface to be responded. The vehicle-mounted interaction interface detection method and device can detect the visual safety of the to-be-responded interface corresponding to the vehicle machine operation instruction of the driver in the vehicle running process, filter the to-be-responded interface which influences the driving, and respond the vehicle machine interaction instruction to the interface meeting the visual safety requirement, so that the dynamic detection screening of the to-be-responded interface is realized, the vehicle machine interaction requirement to a certain degree can be met, and the driving safety can be improved.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to a method, an apparatus, a device, and a storage medium for detecting visual security of an interface.
Background
In the driving process of the vehicle, when the driver operates the vehicle machine, the driving operation of the driver is influenced to a certain extent, so that safety accidents are easy to occur. To avoid this, some adjustment should be made to the interaction between the driver and the vehicle.
Disclosure of Invention
The application provides a visual security detection method, a visual security detection device, an interface visual security detection equipment and a storage medium.
According to an aspect of the present application, there is provided a method for detecting visual security of an interface, including:
determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interactive instruction under the condition that the vehicle is in a running state;
determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded;
and determining whether the interface to be responded responds to the vehicle-machine interaction instruction or not according to the visual safety of the interface to be responded.
According to another aspect of the present application, there is provided a visual security detection apparatus for an interface, including:
the first determining module is used for determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interactive instruction under the condition that the vehicle is in a running state;
the second determining module is used for determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded;
and the third determining module is used for determining whether the interface to be responded responds to the vehicle-machine interaction instruction according to the visual safety of the interface to be responded.
According to another aspect of the present application, an electronic device is provided, and functions of the electronic device may be implemented by hardware, or may be implemented by software that performs responses by hardware. The hardware or software includes one or more modules corresponding to the above-described functions.
In one possible design, the electronic device includes a processor and a memory, the memory is used for storing a program for supporting the electronic device to execute the method for detecting the visual security of the interface, and the processor is configured to execute the program stored in the memory. The electronic device may also include a communication interface for communicating with other devices or a communication network.
According to another aspect of the present application, there is provided a non-transitory computer readable storage medium storing computer instructions for an electronic device and computer software instructions for the electronic device, including a program for performing the method for visual security detection of an interface as described above.
According to the technology of the application, the driving safety problem caused by interaction between a driver and a vehicle machine in the driving process of the vehicle is solved. The vehicle-mounted interaction interface detection method and device can detect the visual safety of the to-be-responded interface corresponding to the vehicle machine operation instruction of the driver in the vehicle running process, filter the to-be-responded interface which influences the driving, and respond the vehicle machine interaction instruction to the interface meeting the visual safety requirement, so that the dynamic detection screening of the to-be-responded interface is realized, the vehicle machine interaction requirement to a certain degree can be met, and the driving safety can be improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a schematic diagram of a method for visual security detection of an interface according to an embodiment of the present application;
FIG. 2 is a schematic diagram of step S20 of a method for visual security detection of an interface according to an embodiment of the present application;
FIG. 3 is a schematic diagram of an example of an application according to an embodiment of the present application;
FIG. 4 is a schematic diagram of step S22 of a method for visual security detection of an interface according to an embodiment of the present application;
FIG. 5 is a schematic diagram of an example of an application according to another embodiment of the present application;
FIG. 6 is a schematic diagram of step S20 of a method for visual security detection of an interface according to another embodiment of the present application;
FIG. 7 is a diagram illustrating a step S25 of a method for visual security inspection of an interface according to an embodiment of the present application;
FIG. 8 is a schematic diagram of step S20 of a method for visual security detection of an interface according to another embodiment of the present application;
FIG. 9 is a schematic diagram of an example of an application according to another embodiment of the present application;
FIG. 10 is a schematic diagram of a method of visual security detection of an interface according to another embodiment of the present application;
FIG. 11 is a schematic diagram of a method of visual security detection of an interface according to another embodiment of the present application;
FIG. 12 is a schematic view of a visual security detection apparatus of an interface according to an embodiment of the present application;
FIG. 13 is a block diagram of an electronic device for implementing a method for visual security detection of an interface according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
According to an embodiment of the present application, as shown in fig. 1, the present application provides a method for detecting visual security of an interface, including:
s10: and under the condition that the vehicle is in a running state, determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interaction instruction.
The vehicle-mounted interaction instruction is used for calling and operating a page required to be displayed on a vehicle-mounted device. The car machine interaction instruction can be a voice instruction or a touch instruction.
The interface to be responded can be understood as an interface which can be displayed on the vehicle-mounted device and can be operated. The interface to be responded can be each page corresponding to a vehicle-mounted system of the vehicle-mounted device, and can also be each page corresponding to an application program installed in the vehicle-mounted system. For example, the interface to be responded may be a vehicle-mounted system interface including an application icon on a vehicle, or may also be a homepage of a music application installed on the vehicle-mounted system, a music playing page, a song list detail page, a map navigation interface, a news information interface, and the like, which is not limited herein.
The interface to be responded, which needs to respond to the car machine interaction instruction, can be understood as an interface which needs to respond to and execute the car machine interaction instruction. The interface can be an interface which is displayed currently on the vehicle machine, and can also be any interface which is not displayed in the background. The interface to be responded can be determined through the analysis of the vehicle-machine interaction instruction.
S20: and determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded.
The attribute information may include at least information related to visual interface elements of the interface to be responded to. Determining the visual safety of the interface to be responded can be understood as determining whether the interface design of the interface to be responded meets the reading habit of the driver, whether the reading and the operation of the driver are interfered, whether the attention concentration degree of the driver on the vehicle driving is greatly influenced, whether the reading difficulty and the reading time of the driver are increased, and the like.
S30: and determining whether the interface to be responded responds to the vehicle-mounted interaction instruction or not according to the visual safety of the interface to be responded.
When the visual safety of the interface to be responded does not meet the use requirement in the driving state, the interface to be responded does not respond to the vehicle-mounted interaction instruction, namely the interface to be responded is not displayed on the vehicle-mounted interaction device or the interface to be responded does not respond to the operation of the driver.
When the visual safety of the interface to be identified meets the use requirement in the driving state, the interface to be responded responds to the vehicle-mounted machine interaction instruction, namely the interface to be responded is displayed on the vehicle-mounted machine or the interface to be responded responds to the operation of a driver.
The vehicle-mounted interaction interface detection method and device can detect the visual safety of the to-be-responded interface corresponding to the vehicle machine operation instruction of the driver in the vehicle running process, filter the to-be-responded interface which influences the driving, and respond the vehicle machine interaction instruction to the interface meeting the visual safety requirement, so that the dynamic detection screening of the to-be-responded interface is realized, the vehicle machine interaction requirement to a certain degree can be met, and the driving safety can be improved.
In one example, a method for visual security detection of an interface, further comprises:
and identifying the source of the received vehicle-machine interaction instruction, and judging whether the received vehicle-machine interaction instruction is the vehicle-machine interaction instruction initiated by the driver.
If the command is initiated by the driver, the steps from S10 to S30 are executed.
In one embodiment, as shown in fig. 2, determining the visual security of the interface to be responded according to the attribute information of the interface to be responded includes:
s21: and determining a target interface element in the interface to be responded according to the attribute information of the interface to be responded.
The target interface element may include any visual interface element displayed on the interface to be responded to. As shown in fig. 3, for example, the target interface element may include text, control buttons, a function area wireframe, a progress bar, a drag bar, a pattern, and other elements visible on any interface.
The determined target interface elements can be visual interface elements in the interface to be responded or all visual interface elements in the interface to be responded. When the determined target interface element is a visual interface element in the interface to be responded, the determined target interface element can be understood as a screened effective visual element. While visual interface elements that are not targeted interface elements may be understood as invalid visual elements.
For example, there may be elements in an interface that relate to user usage functions, such as turn-inducing text, that may be considered active visual elements. While elements unrelated to user functionality, such as map non-line details, decorative graphics, etc., may be perceived as non-effective visual elements that are subject to the integrity and decorativeness of the interface functionality, but which need not be understood and are unrelated to the use functionality.
S22: and determining the visual safety of the target interface element according to the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information.
Visual characteristic information may be understood as relevant information that can affect its display effect on the interface. That is, information that can affect the visual effect that the interface element presents in the interface. For example, in the case that the type of the target interface element is a text interface element, one or more of font size (size) information, color contrast information, and text number information may be included in each of the current visual characteristic information and the standard visual characteristic information. In the case that the type of the target interface element is an icon interface element, the current visual characteristic information and the standard visual characteristic information may include one or more of icon size (size) information, line width (thickness) information, color contrast information, information on a distance between adjacent icons, and icon style information. In the case where the type of the target interface element is a line interface element, the current visual characteristic information and the standard visual characteristic information may include one or more of line length information, line width (thickness) information, and color contrast information.
The current visual characteristic information may be understood as the relevant visual characteristic information that can be read from the data of the target interface element. The standard visual characteristic information can be understood as a standard value that the same kind of interface elements meet the visual safety requirement. The specific numerical value range of each parameter in the standard visual characteristic information can be selected and adjusted according to the types of different interface elements. For example, in the case of the interface element being text, the standard visual characteristic information may be: the font size is between 4.5mm and 7.5mm, the font line length is between 7 and 13 characters, and the contrast ratio of the character color to the background color is more than 3: 1. In the case where the interface element is an icon, the standard visual characteristic information may be: the size of the icon is between 9mm and 12mm, the width of the line is between 10 percent and 12 percent, and the contrast ratio of the color of the icon to the color of the background is more than 3: 1.
Determining the visual security of the target interface element may be understood as determining whether the design of the target interface element meets the reading habit of the driver, whether the reading and operation of the driver are disturbed, whether the reading difficulty of the driver is increased, whether the reading time of the driver is increased, whether the attention concentration of the driver on the driving of the vehicle is greatly influenced, and the like.
S23: and determining the visual safety of the interface to be responded according to the visual safety of the target interface element.
Determining the visual security of the interface to be responded may be determined according to the visual security of one or more target interface elements in the interface.
In this embodiment, by comparing the current visual feature information of the target interface element in the interface to be responded with the standard visual feature, the visual security of the target interface element can be accurately detected, and the visual security of the corresponding interface to be responded can be further accurately determined according to the visual security of the target interface element.
In one embodiment, determining a target interface element in a to-be-responded interface includes:
and determining at least one target interface element from the visual interface elements according to the style information and/or the function information of the visual interface elements of the interface to be responded.
The visual interface element may include any element of the interface to be responded to that is capable of being visually seen. For example, title text, explanatory text, icon buttons, map route lines, functional area line frames, progress bars, drag bars, map non-line details, background pictures, and any other functional interface elements and decorative interface elements visible on the interface to be responded.
Style information may be understood as information used to determine the type of visual interface element. For example, whether the visual interface element is text or a background map is determined by style information.
Functional information may be understood as information that is used to determine the functionality of a visual interface element. For example, the explicit changing condition of the state of the visual interface element can be determined by the function information, such as that the active icon can be clicked or grayed out, whether the background will change, whether the icon is a decorative icon or a functional icon, whether the text is descriptive text or decorative text, and the like.
In this embodiment, by using the style information and/or the function information, effective interface elements required for determining the interface visual security can be quickly screened from the visual interface elements.
In one embodiment, determining each target interface element from the visual interface elements comprises:
and at least determining the contained text interface elements, icon interface elements and line interface elements from all the visual interface elements.
In this embodiment, the visual security of the interface can be accurately and effectively detected through the text interface element, the icon interface element and the line interface element.
In one embodiment, as shown in fig. 4, determining the visual security of the target interface element according to the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information includes:
s221: and determining standard visual characteristic information corresponding to the target interface element according to the type of the target interface element.
The type of target interface element may be understood as determining which interface element the target interface element is specific to. For example, the type of target interface element may be text, icons, lines, patterns, and the like.
In one example, if the target interface element is determined to be a text according to the type of the target interface element, then standard visual feature information of the text is obtained.
S222: and comparing the current visual characteristic information with the standard visual characteristic information to obtain a comparison result.
The comparison result may include whether the current visual characteristic information matches or does not match the standard visual characteristic information. For example, if the target interface element is a text, the current visual characteristic information of the text interface element is 6.5mm in text size, and the standard visual characteristic information of the corresponding standard text interface element is 4.5mm to 7.5mm in text size, the current visual characteristic information of the text interface element is considered to be matched with the standard visual characteristic information. For another example, if the target interface element is an icon interface element, the current visual feature information of the icon interface element is that the size of the icon is 7mm, and the standard visual feature information of the corresponding standard icon interface element is that the size of the icon is 9mm to 12mm, the current visual feature information of the icon interface element is considered to be not matched with the standard visual feature information.
S223: and determining that the visual safety of the target interface element meets the requirement under the condition that the comparison result is that the current visual characteristic information is matched with the standard visual characteristic information.
In this embodiment, the type of the target interface element is used to accurately obtain the corresponding standard visual characteristic information, so that the accurate standard visual characteristic information can be used to compare with the current visual characteristic information of the target interface element, thereby improving the accuracy of determining the visual security of the target interface element.
In one embodiment, determining the visual security of the interface to be responded to according to the visual security of the target interface element includes:
and under the condition that the proportion of the target interface elements meeting the visual safety requirement in each visual interface element of the interface to be responded reaches a threshold proportion, determining that the visual safety of the interface to be responded meets the requirement. The threshold ratio may be selected and adjusted as desired. It should be noted that each visual interface element of the interface to be responded may be understood as all visual interface elements in the interface to be responded, and may also be understood as an effective visual interface element.
In this embodiment, the visual security of the interface to be responded can be accurately and effectively determined by the proportion of the target interface element meeting the visual security requirement in each visual interface element of the interface to be responded.
In one example, as shown in FIG. 5, determining the visual security of the interface to respond includes:
and determining the effective visual element (target visual element) and the decorative graphic element according to the style information and/or the function information of each visual element in the interface to be responded. Wherein the active visual elements include text, active icons, and lines.
And extracting the current visual feature information of the character visual elements in the effective visual elements, wherein the current visual feature information of the character visual elements comprises the font size and the color contrast.
And extracting the current visual characteristic information of the visual elements of the active icons in the effective visual elements, wherein the current visual characteristic information of the visual elements of the active icons comprises icon size, line thickness and color contrast.
And extracting the current visual feature information of the line visual elements in the effective visual elements, wherein the current visual feature information of the line visual elements comprises line length, fine line thickness and color contrast.
And respectively carrying out visual safety judgment on the current visual feature information of the character visual elements, the current visual feature information of the movable icon visual elements and the current visual feature information of the movable line visual elements by utilizing the standard visual feature information of each visual element.
And determining which visual elements in the interface to be responded are safe visual elements (target interface elements meeting the visual safety requirement) and which are unsafe visual elements (target interface elements not meeting the visual safety requirement) according to the judgment result. And further determining whether the interface to be responded meets the visual safety requirement according to the proportion of the safe visual elements in all the effective visual elements.
In one embodiment, as shown in fig. 6, determining the visual security of the interface to be responded according to the attribute information of the interface to be responded includes:
s24: and determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded.
The visual function blocks can be understood as different function areas which are displayed visually in the interface to be responded. For example, as shown in fig. 3, when the interface to be responded is a music playing interface, the interface to be responded includes a play progress bar function block located in the middle of the interface, a music switching/pausing function block located at the lower left of the play progress bar function block, a play music cover block located above the play progress bar function block, a page return function block located above the play music cover block, a shortcut bar block located at the left side of the play music cover block, and a play mode/play list block located at the lower right of the play progress bar function block.
The determination of the visual function block may be determined using a div (division) tag in the attribute information. The determination may also be made by style information in the attribute information.
S25: and determining whether the quantity of the text information displayed in the visual functional blocks is overloaded or not under the condition that the quantity of the visual functional blocks meets the threshold requirement.
Whether the text information amount is overloaded or not can be understood as whether the text sentence length or the number of texts contained in the visual function block influences the speed of quick reading and information acquisition of the driver or not. For example, when the number of characters in the visual function block is too large, it is considered that the visual function block is not suitable for the driver to perform the visual operation in the process of driving the vehicle, and further, the amount of character information is considered to be overloaded.
The threshold requirement for the number of visual functional blocks may be selected and adjusted as desired. In order to facilitate operation in the case of driving the vehicle, the number of visual function blocks may be as small as possible.
S26: and under the condition that the text information quantity displayed in the visual function block is not overloaded, determining that the visual safety of the interface to be responded meets the requirement.
In this embodiment, the visual security of the interface to be responded can be effectively and accurately determined by detecting the number of the visual function blocks and whether the amount of the text information in the visual function blocks is overloaded.
In one embodiment, as shown in fig. 7, the determining whether the amount of text information displayed in the visual function block is overloaded includes:
s251: the number of characters contained in the visual function block is determined.
The determination of the number of characters can utilize title tags in the attribute information, and can also utilize character block occupation judgment.
S252: and determining that the text information amount of the visual functional block is not overloaded when the number of the texts contained in the visual functional block is not larger than the threshold number.
In this embodiment, the text information amount of each visual function block can be accurately and effectively determined by using the text amount contained in each visual function block.
In one embodiment, as shown in fig. 8, determining the visual security of the interface to be responded according to the attribute information of the interface to be responded includes:
s27: and comparing the current visual characteristic information of the target interface element in the interface to be responded with the corresponding standard visual characteristic information according to the attribute information of the interface to be responded to obtain a comparison result.
The step of comparing the current visual characteristic information of the target interface element with the corresponding standard visual characteristic information may refer to the above embodiments.
S28: and under the condition that the comparison result is that the current visual characteristic information is matched with the standard visual characteristic information, determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded.
S29: and under the condition that the number of the visual function blocks meets the threshold requirement and the quantity of the text information displayed in the visual function blocks is not overloaded, determining that the visual safety of the interface to be responded meets the requirement.
Reference is made to the above embodiments as to whether the text message amount of the visual function block is overloaded.
In this embodiment, the visual security of the interface to be responded can be determined more accurately and effectively by comparing the current visual feature information of the target interface element with the corresponding standard visual feature information and combining the text information amount overload detection of the visual function block.
In one example, as shown in fig. 9, determining the visual security of the interface to be responded according to the attribute information of the interface to be responded includes:
and determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded.
And under the condition that the number of the visual function blocks does not meet the threshold requirement, generating risk prompt information of information overload, wherein the risk prompt information of the information overload is used for prompting a driver whether the interface to be responded still needs to respond.
And under the condition that the number of the visual function blocks meets the threshold requirement, determining whether the text information quantity displayed in the visual function blocks is overloaded or not according to the text quantity in the visual function blocks.
And under the condition that the text information quantity displayed in the visual function block is not overloaded, determining that the visual safety of the interface to be responded meets the requirement.
And under the condition that the text information quantity displayed in the visual function block is overloaded, generating risk prompt information of information overload, wherein the risk prompt information of information overload is used for prompting a driver whether to make the interface to be responded respond or not.
In one embodiment, as shown in fig. 10, determining whether the interface to be responded responds to the car machine interaction instruction according to the visual security of the interface to be responded includes:
s31: and under the condition that the visual safety of the interface to be responded meets the requirement, responding the vehicle-mounted interaction instruction by the interface to be responded.
In one embodiment, as shown in fig. 10, determining whether the interface to be responded responds to the car machine interaction instruction according to the visual security of the interface to be responded includes:
s32: and generating risk prompt information under the condition that the visual safety of the interface to be responded does not meet the requirement.
S33: and determining whether the interface to be responded responds to the vehicle-mounted interaction instruction or not according to the received feedback information corresponding to the risk prompt information.
According to the method and the device, the risk prompt information can be sent to the driver under the condition that the visual safety of the interface to be responded does not meet the requirement, so that the driver can further autonomously judge whether the interface to be responded needs to continue to respond to the vehicle-mounted interaction instruction.
In one example, as shown in fig. 11, a method for visual security detection of an interface includes:
judging whether the vehicle is in a running state or not under the conditions of starting of the vehicle-mounted system, central control display of a vehicle-mounted system functional module and receiving a vehicle-mounted machine interaction instruction;
if the vehicle is not in a running state, enabling a to-be-responded interface corresponding to the vehicle-machine interaction instruction to respond and normally display the to-be-responded interface on the vehicle machine;
if the vehicle is in a driving state, judging the visual safety of visual elements (target interface elements) in the interface to be responded;
if the visual safety does not meet the requirement, the interface to be responded does not respond to the vehicle-mounted interaction instruction, is not displayed on the vehicle-mounted interaction device and cannot be used by a driver;
if the visual safety meets the requirement, judging whether the text information quantity of the visual function block in the interface to be responded is overloaded or not;
and if the text information amount of the visual function block is not overloaded, responding the vehicle-mounted interaction instruction by the interface to be responded and displaying the vehicle-mounted interaction instruction on the vehicle-mounted interaction device for a driver to operate.
And if the text information amount of the visual function block is overloaded, generating risk prompt information to prompt the driver of the risk of driving the vehicle after the response of the interface to be responded.
In an example, the visual safety detection method of the interface of each embodiment may be executed by an on-board system of a vehicle machine, a vehicle control system, or a server.
According to an embodiment of the present application, as shown in fig. 12, there is provided an apparatus for visual security detection of an interface, including:
the first determining module 10 is configured to determine a to-be-responded interface which needs to respond to the car-machine interaction command when the vehicle is in a driving state.
And the second determining module 20 is configured to determine the visual security of the interface to be responded according to the attribute information of the interface to be responded.
And a third determining module 30, configured to determine, according to the visual security of the interface to be responded, whether the interface to be responded responds to the car machine interaction instruction to be displayed on the car machine.
In one embodiment, the second determining module 20 includes:
and the first determining submodule is used for determining a target interface element in the interface to be responded according to the attribute information of the interface to be responded.
And the second determining submodule is used for determining the visual safety of the target interface element according to the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information.
And the third determining submodule is used for determining the visual safety of the interface to be responded according to the visual safety of the target interface element.
In one embodiment, the second determination submodule includes:
and the first determining unit is used for determining the standard visual characteristic information corresponding to the target interface element according to the type of the target interface element.
And the comparison unit is used for comparing the current visual characteristic information with the standard visual characteristic information to obtain a comparison result.
And the second determining unit is used for determining that the visual safety of the target interface element meets the requirement under the condition that the comparison result is that the current visual characteristic information is matched with the standard visual characteristic information.
In one embodiment, the third determining sub-module is further configured to determine that the visual security of the interface to be responded meets the requirement if the proportion of the target interface elements meeting the visual security requirement in each visual interface element of the interface reaches a threshold proportion.
In one embodiment, the second determining module 20 includes:
and the fourth determining submodule is used for determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded.
And the fifth determining submodule is used for determining whether the quantity of the text information displayed in the visual functional blocks is overloaded or not under the condition that the quantity of the visual functional blocks meets the threshold requirement.
And the sixth determining submodule is used for determining that the visual safety of the interface to be responded meets the requirement under the condition that the text information quantity displayed in the visual function block is not overloaded.
In one embodiment, the fifth determination submodule includes:
and the third determining unit is used for determining the number of characters contained in the visual function block.
And the fourth determining unit is used for determining that the text information amount of the visual functional block is not overloaded under the condition that the number of the texts contained in the visual functional block is not more than the threshold number.
In one embodiment, the second determining module 20 includes:
and the comparison sub-module is used for comparing the current visual characteristic information of the target interface element in the interface to be responded with the corresponding standard visual characteristic information according to the attribute information of the interface to be responded to so as to obtain a comparison result.
And the seventh determining submodule is used for determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded under the condition that the comparison result is that the current visual feature information is matched with the standard visual feature information.
And the eighth determining submodule is used for determining that the visual safety of the interface to be responded meets the requirement under the condition that the number of the visual function blocks meets the threshold requirement and the text information quantity displayed in the visual function blocks is not overloaded.
In one embodiment, the third determining module 30 includes:
and the display sub-module is used for displaying the response vehicle-mounted interaction instruction of the interface to be responded on the vehicle-mounted device under the condition that the visual safety of the interface to be responded meets the requirement.
In one embodiment, the third determining module 30 includes:
and the generation submodule is used for generating risk prompt information under the condition that the visual safety of the interface to be responded does not meet the requirement.
And the ninth determining submodule is used for determining whether the interface to be responded responds to the vehicle-mounted interaction instruction to be displayed on the vehicle-mounted device according to the received feedback information corresponding to the risk prompt information.
The functions of the visual security detection apparatus for an interface may refer to various embodiments of the visual security detection method for an interface, and are not described herein again.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
As shown in fig. 13, it is a block diagram of an electronic device according to the method for visual security detection of an interface of the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 13, the electronic apparatus includes: one or more processors 1301, memory 1302, and interfaces for connecting the various components, including high speed interfaces and low speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 13 illustrates an example of a processor 1301.
The memory 1302, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the method for visual security detection of an interface in the embodiments of the present application (e.g., the first determination module 10, the second determination module 20, and the third determination module 30 shown in fig. 12). The processor 1301 executes various functional applications of the server and data processing, namely, a method for implementing visual security detection of an interface in the above method embodiments, by running non-transitory software programs, instructions and modules stored in the memory 1302.
The memory 1302 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device according to visual security detection of the interface, and the like. Further, the memory 1302 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 1302 may optionally include memory located remotely from processor 1301, which may be connected to an electronic device for visual security detection of an interface via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the method of visual security detection of an interface may further comprise: an input device 1303 and an output device 1304. The processor 1301, the memory 1302, the input device 1303 and the output device 1304 may be connected by a bus or other means, and fig. 13 illustrates the bus connection.
The input device 1303 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the electronic device for visual security detection of the interface, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, and the like. The output devices 1304 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the responding computers and having a client-server relationship to each other.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (21)
1. A method for visual security detection of an interface, comprising:
determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interactive instruction under the condition that the vehicle is in a running state;
determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded;
and determining whether the interface to be responded responds to the vehicle-machine interaction instruction or not according to the visual safety of the interface to be responded.
2. The method of claim 1, wherein the determining the visual security of the interface to be responded according to the attribute information of the interface to be responded comprises:
determining a target interface element in the interface to be responded according to the attribute information of the interface to be responded;
determining the visual safety of the target interface element according to the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information;
and determining the visual safety of the interface to be responded according to the visual safety of the target interface element.
3. The method of claim 2, wherein determining the visual security of the target interface element based on the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information comprises:
determining standard visual feature information corresponding to the target interface element according to the type of the target interface element;
comparing the current visual characteristic information with the standard visual characteristic information to obtain a comparison result;
and determining that the visual safety of the target interface element meets the requirement under the condition that the comparison result is that the current visual characteristic information is matched with the standard visual characteristic information.
4. The method of claim 2, wherein the determining the visual security of the interface to respond from the visual security of the target interface element comprises:
and under the condition that the proportion of the target interface elements meeting the visual safety requirement in each visual interface element of the interface reaches a threshold proportion, determining that the visual safety of the interface to be responded meets the requirement.
5. The method of claim 2, wherein the current visual characteristic information and the standard visual characteristic information comprise:
under the condition that the type of the target interface element is a text interface element, the current visual characteristic information and the standard visual characteristic information at least comprise font size information and/or color contrast information;
under the condition that the type of the target interface element is an icon interface element, the current visual characteristic information and the standard visual characteristic information at least comprise icon size information, line width information and/or color contrast information;
and under the condition that the type of the target interface element is a line interface element, the current visual characteristic information and the standard visual characteristic information at least comprise line length information, line width information and/or color contrast information.
6. The method of claim 1, wherein the determining the visual security of the interface to be responded according to the attribute information of the interface to be responded comprises:
determining the number of visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded;
determining whether the amount of text information displayed in the visual functional blocks is overloaded if the number of visual functional blocks meets a threshold requirement;
and under the condition that the text information quantity displayed in the visual function block is not overloaded, determining that the visual safety of the interface to be responded meets the requirement.
7. The method of claim 6, wherein said determining whether an amount of textual information displayed in the visual function block is overloaded comprises:
determining the number of characters contained in the visual function block;
determining that an amount of text information for the visual functional block is not overloaded if a number of text included in the visual functional block is not greater than a threshold number.
8. The method of claim 1, wherein the determining the visual security of the interface to be responded according to the attribute information of the interface to be responded comprises:
comparing the current visual characteristic information of the target interface element in the interface to be responded with the corresponding standard visual characteristic information according to the attribute information of the interface to be responded to obtain a comparison result;
determining the number of visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded under the condition that the comparison result is that the current visual feature information is matched with the standard visual feature information;
and under the condition that the number of the visual function blocks meets the threshold requirement and the quantity of the text information displayed in the visual function blocks is not overloaded, determining that the visual safety of the interface to be responded meets the requirement.
9. The method according to any one of claims 1 to 8, wherein the determining whether the interface to be responded responds to the car machine interaction instruction according to the visual security of the interface to be responded comprises:
and under the condition that the visual safety of the interface to be responded meets the requirement, responding the vehicle-machine interaction instruction by the interface to be responded.
10. The method according to any one of claims 1 to 8, wherein the determining whether the interface to be responded responds to the car machine interaction instruction according to the visual security of the interface to be responded comprises:
generating risk prompt information under the condition that the visual safety of the interface to be responded does not meet the requirement;
and determining whether the interface to be responded responds to the vehicle-machine interaction instruction or not according to the received feedback information corresponding to the risk prompt information.
11. An apparatus for visual security detection of an interface, comprising:
the first determining module is used for determining a to-be-responded interface which needs to respond to the vehicle-mounted machine interactive instruction under the condition that the vehicle is in a running state;
the second determining module is used for determining the visual safety of the interface to be responded according to the attribute information of the interface to be responded;
and the third determining module is used for determining whether the interface to be responded responds to the vehicle-machine interaction instruction according to the visual safety of the interface to be responded.
12. The apparatus of claim 11, wherein the second determining means comprises:
the first determining submodule is used for determining a target interface element in the interface to be responded according to the attribute information of the interface to be responded;
the second determining submodule is used for determining the visual safety of the target interface element according to the current visual characteristic information of the target interface element and the corresponding standard visual characteristic information;
and the third determining submodule is used for determining the visual safety of the interface to be responded according to the visual safety of the target interface element.
13. The apparatus of claim 12, wherein the second determination submodule comprises:
the first determining unit is used for determining standard visual characteristic information corresponding to the target interface element according to the type of the target interface element;
the comparison unit is used for comparing the current visual characteristic information with the standard visual characteristic information to obtain a comparison result;
and the second determining unit is used for determining that the visual safety of the target interface element meets the requirement under the condition that the comparison result is that the current visual characteristic information is matched with the standard visual characteristic information.
14. The apparatus of claim 12, wherein the third determining sub-module is further configured to determine that the visual security of the interface to be responded meets the requirement if a proportion of target interface elements that meet the visual security requirement among the visual interface elements of the interface reaches a threshold proportion.
15. The apparatus of claim 11, wherein the second determining means comprises:
the fourth determining submodule is used for determining the number of the visual function blocks contained in the interface to be responded according to the attribute information of the interface to be responded;
a fifth determining submodule, configured to determine whether an amount of text information displayed in the visual function block is overloaded when the number of the visual function blocks meets a threshold requirement;
and the sixth determining submodule is used for determining that the visual safety of the interface to be responded meets the requirement under the condition that the text information quantity displayed in the visual function block is not overloaded.
16. The apparatus of claim 15, wherein the fifth determination submodule comprises:
a third determining unit, configured to determine the number of characters included in the visual function block;
a fourth determining unit, configured to determine that the amount of text information of the visual function block is not overloaded when the number of texts included in the visual function block is not greater than the threshold number.
17. The apparatus of claim 11, wherein the second determining means comprises:
the comparison submodule is used for comparing the current visual characteristic information of the target interface element in the interface to be responded with the corresponding standard visual characteristic information according to the attribute information of the interface to be responded to obtain a comparison result;
a seventh determining submodule, configured to determine, according to the attribute information of the interface to be responded, the number of visual function blocks included in the interface to be responded when the comparison result is that the current visual feature information matches the standard visual feature information;
and the eighth determining submodule is used for determining that the visual safety of the interface to be responded meets the requirement under the condition that the number of the visual function blocks meets the threshold requirement and the quantity of the text information displayed in the visual function blocks is not overloaded.
18. The apparatus of any of claims 11 to 17, wherein the third determining means comprises:
and the display submodule is used for responding the vehicle-machine interaction instruction by the interface to be responded under the condition that the visual safety of the interface to be responded meets the requirement.
19. The apparatus of any of claims 11 to 17, wherein the third determining means comprises:
the generating submodule is used for generating risk prompt information under the condition that the visual safety of the interface to be responded does not meet the requirement;
and the ninth determining submodule is used for determining whether the interface to be responded responds to the vehicle-machine interaction instruction or not according to the received feedback information corresponding to the risk prompt information.
20. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 10.
21. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010593609.XA CN111752390B (en) | 2020-06-27 | 2020-06-27 | Visual safety detection method, device and equipment for interface and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010593609.XA CN111752390B (en) | 2020-06-27 | 2020-06-27 | Visual safety detection method, device and equipment for interface and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111752390A true CN111752390A (en) | 2020-10-09 |
| CN111752390B CN111752390B (en) | 2024-04-05 |
Family
ID=72677313
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010593609.XA Active CN111752390B (en) | 2020-06-27 | 2020-06-27 | Visual safety detection method, device and equipment for interface and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111752390B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130057397A1 (en) * | 2011-09-01 | 2013-03-07 | GM Global Technology Operations LLC | Method of operating a vehicle safety system |
| US20150310287A1 (en) * | 2014-04-28 | 2015-10-29 | Ford Global Technologies, Llc | Gaze detection and workload estimation for customized content display |
| CN106956592A (en) * | 2016-01-08 | 2017-07-18 | 腾讯科技（深圳）有限公司 | Vehicle-mounted HMI adjusting methods and device |
| CN107226087A (en) * | 2017-05-26 | 2017-10-03 | 西安电子科技大学 | A kind of structured road automatic Pilot transport vehicle and control method |
| CN108898116A (en) * | 2018-07-02 | 2018-11-27 | 科大讯飞股份有限公司 | A kind of safe driving detection method, device, equipment and storage medium |
| CN109298822A (en) * | 2018-09-04 | 2019-02-01 | 广州小鹏汽车科技有限公司 | The visual interactive system and method for vehicle-carrying display screen |
| CN109313530A (en) * | 2017-05-16 | 2019-02-05 | 苹果公司 | Equipment, method and graphic user interface for carrying out navigating and interacting with control object between user interface |
| CN110140342A (en) * | 2017-07-14 | 2019-08-16 | 华为技术有限公司 | Locking screen interface processing method and terminal |
| CN110171372A (en) * | 2019-05-27 | 2019-08-27 | 广州小鹏汽车科技有限公司 | Interface display method, device and the vehicle of car-mounted terminal |
| CN110262859A (en) * | 2018-03-12 | 2019-09-20 | 上海擎感智能科技有限公司 | The adaptive screen method of UI control layout, system, storage medium and electric terminal |
| CN110525212A (en) * | 2018-05-24 | 2019-12-03 | 广州小鹏汽车科技有限公司 | Large-size screen monitors control method, apparatus and system are controlled in a kind of vehicle |
-
2020
- 2020-06-27 CN CN202010593609.XA patent/CN111752390B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130057397A1 (en) * | 2011-09-01 | 2013-03-07 | GM Global Technology Operations LLC | Method of operating a vehicle safety system |
| US20150310287A1 (en) * | 2014-04-28 | 2015-10-29 | Ford Global Technologies, Llc | Gaze detection and workload estimation for customized content display |
| CN106956592A (en) * | 2016-01-08 | 2017-07-18 | 腾讯科技（深圳）有限公司 | Vehicle-mounted HMI adjusting methods and device |
| CN109313530A (en) * | 2017-05-16 | 2019-02-05 | 苹果公司 | Equipment, method and graphic user interface for carrying out navigating and interacting with control object between user interface |
| CN107226087A (en) * | 2017-05-26 | 2017-10-03 | 西安电子科技大学 | A kind of structured road automatic Pilot transport vehicle and control method |
| CN110140342A (en) * | 2017-07-14 | 2019-08-16 | 华为技术有限公司 | Locking screen interface processing method and terminal |
| CN110262859A (en) * | 2018-03-12 | 2019-09-20 | 上海擎感智能科技有限公司 | The adaptive screen method of UI control layout, system, storage medium and electric terminal |
| CN110525212A (en) * | 2018-05-24 | 2019-12-03 | 广州小鹏汽车科技有限公司 | Large-size screen monitors control method, apparatus and system are controlled in a kind of vehicle |
| CN108898116A (en) * | 2018-07-02 | 2018-11-27 | 科大讯飞股份有限公司 | A kind of safe driving detection method, device, equipment and storage medium |
| CN109298822A (en) * | 2018-09-04 | 2019-02-01 | 广州小鹏汽车科技有限公司 | The visual interactive system and method for vehicle-carrying display screen |
| CN110171372A (en) * | 2019-05-27 | 2019-08-27 | 广州小鹏汽车科技有限公司 | Interface display method, device and the vehicle of car-mounted terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111752390B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102205251B1 (en) | System and method for interacting with a touch screen interface utilizing an intelligent stencil mask | |
| CN102460362B (en) | Glyph entry on computing device | |
| US9058105B2 (en) | Automated adjustment of input configuration | |
| US9262051B2 (en) | Method and apparatus for displaying pop-up | |
| US11527155B2 (en) | Time-segmented signal timing method and apparatus for traffic light, electronic device and storage medium | |
| RU2662632C2 (en) | Presenting fixed format documents in reflowed format | |
| CN104331474A (en) | Page processing method and device | |
| JP7214702B2 (en) | Method for detecting length of train, apparatus for detecting length of train, electronic device, storage medium and computer program | |
| CN110675644A (en) | Method and device for identifying road traffic lights, electronic equipment and storage medium | |
| CN106445956B (en) | Shopping data management method and device | |
| CN111121814A (en) | Navigation method, navigation device, electronic equipment and computer readable storage medium | |
| CN108700978B (en) | Assigning textures to graphical keyboards based on subject textures of an application | |
| CN112926000A (en) | Display area rendering method, device and equipment, readable storage medium and product | |
| CN110727383A (en) | Touch interaction method and device based on small program, electronic equipment and storage medium | |
| CN111126063A (en) | Text quality evaluation method and device | |
| CN112231214A (en) | Page testing method and device, electronic equipment and medium | |
| CN110865421A (en) | Business model training method, obstacle detection method and device and electronic equipment | |
| CN111752390B (en) | Visual safety detection method, device and equipment for interface and storage medium | |
| CN111754488A (en) | Interface visual readability detection method, device, equipment and storage medium | |
| CN112433723A (en) | Personalized list development method and device | |
| CN111352685A (en) | Input method keyboard display method, device, equipment and storage medium | |
| CN112558810A (en) | Method, device, equipment and storage medium for detecting fingertip position | |
| JP2021096220A (en) | Method, apparatus, electronic device and storage medium for displaying ar navigation | |
| CN112445983A (en) | Search result processing method, device and equipment and computer readable storage medium | |
| WO2020231575A1 (en) | System and method for selecting relevant content in an enhanced view mode |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20211011 Address after: 100176 101, floor 1, building 1, yard 7, Ruihe West 2nd Road, economic and Technological Development Zone, Daxing District, Beijing Applicant after: Apollo Zhilian (Beijing) Technology Co.,Ltd. Address before: 2 / F, baidu building, No. 10, Shangdi 10th Street, Haidian District, Beijing 100085 Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant |