CN111179268A

CN111179268A - Vehicle-mounted terminal abnormality detection method and device and vehicle-mounted terminal

Info

Publication number: CN111179268A
Application number: CN202010190806.7A
Authority: CN
Inventors: 寿喆佶; 陈豪
Original assignee: Ningbo Joynext Technology Corp
Current assignee: Ningbo Joynext Technology Corp
Priority date: 2020-03-18
Filing date: 2020-03-18
Publication date: 2020-05-19
Anticipated expiration: 2040-03-18
Also published as: CN111179268B

Abstract

The application relates to a vehicle-mounted terminal abnormality detection method and device and a vehicle-mounted terminal. The method comprises the following steps: responding to the triggering operation of the function button, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; and if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal. By processing and analyzing the image, the method can realize the terminal abnormity detection, avoid the condition that data is easy to lose in the transmission process caused by a frame detection mode, and improve the accuracy of the detection result. Meanwhile, by comparing the actual characters with the expected characters, whether the page jumped after the button is triggered is normal or not can be judged quickly, external interference in the test process can be effectively reduced by detecting the characters, and test cost is saved.

Description

Vehicle-mounted terminal abnormality detection method and device and vehicle-mounted terminal

Technical Field

The application relates to the technical field of vehicle networking, in particular to a vehicle-mounted terminal abnormality detection method and device and a vehicle-mounted terminal.

Background

In the human-computer interaction process, users often implement information transmission and exchange through a human-computer interaction interface of a touch terminal product or buttons on hardware equipment of the touch terminal product. Taking the vehicle-mounted terminal as an example, the user may display a corresponding functional interface on the display screen by touching a button image (soft button) displayed on the vehicle-mounted display screen or an entity button (hard button) on the vehicle-mounted terminal. Accordingly, when the in-vehicle terminal malfunctions and is abnormal, the abnormality may include two types, a hard button abnormality and a soft button abnormality, respectively.

At present, the abnormal type of the terminal product is usually detected by a frame detection method, specifically, in the frame detection method, a "project file" (code) is made by using a picture configuration software of a computer, and then the "project file" which is programmed is downloaded to a processor of the terminal product through a serial communication port of the computer and the terminal product to operate, so as to detect whether the terminal product is abnormal or not. However, in the frame detection method, frame data is easily lost during multiple reciprocal transmission processes of data, so that the data to be detected is incomplete, and the accuracy of the detection result is low.

Disclosure of Invention

In view of the above, it is necessary to provide a vehicle-mounted terminal abnormality detection method, device, vehicle-mounted terminal and computer-readable storage medium for solving the above technical problems.

In one aspect, an embodiment of the present invention provides an abnormality detection method for a vehicle-mounted terminal, where the method includes:

responding to the triggering operation of a function button of the vehicle-mounted terminal, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image;

identifying characters in the actual page image to obtain actual characters;

and if the actual characters are not matched with the expected characters corresponding to the expected page images, determining that the page jumped after the functional button is triggered is abnormal.

In one embodiment, the function buttons are soft buttons; before the step of responding to the triggering operation of the function button of the vehicle-mounted terminal, the method further comprises the following steps:

responding to the approach trigger operation of the soft button, and acquiring an actual button special effect image of the soft button; the soft buttons have corresponding desired button special effect images;

and if the actual button special effect image is not matched with the expected button special effect image, determining that the response of the soft button is abnormal after the soft button is close to the trigger.

In one embodiment, the method further comprises:

identifying respective button special effect features of the actual button special effect image and the desired button special effect image; the button special effect feature comprises at least one of a button shape feature, a button brightness feature and a button chroma feature;

if the button special effect features of the actual button special effect image are not matched with the button special effect features of the expected button special effect image, judging that the actual button special effect image is not matched with the expected button special effect image;

prior to the step of identifying the respective button special effect features of the actual button special effect image and the desired button special effect image, the method further comprises:

acquiring a plurality of candidate expected button special effect images; the candidate expected button special effect images respectively have corresponding ambient brightness adaptation modes;

determining a current environment brightness adaptation mode of the vehicle-mounted terminal;

and extracting a candidate expected button special effect image corresponding to the current environment brightness adaptation mode from the plurality of candidate expected button special effect images as the expected button special effect image.

In one embodiment, an actual appearing icon is included in the actual page image, an expected appearing icon is included in the expected page image, and the icon position of the expected appearing icon in the expected page image is matched with the icon position of the actual appearing icon in the actual page image; the method further comprises the following steps:

if the actual appearing icon is matched with the expected appearing icon and the actual character is matched with the expected character, determining that a page jumped after the functional button is triggered is normal;

and if the actual icon does not match the expected icon or the actual character does not match the expected character, determining that the page jumped after the functional button is triggered is abnormal.

In one embodiment, the method further comprises:

scanning the actual page image;

when the actual icon appears in the actual page image, executing an icon matching task thread, and continuing to scan the actual page image; the icon matching task thread is used for matching the actually appearing icon with the expected appearing icon and outputting an icon matching result;

when the icon matching result output by the icon matching task thread is not matched in the process of scanning the actual page image, terminating a plurality of currently executed icon matching task threads, and judging that the actually-appearing icon is not matched with the expected-appearing icon.

In one embodiment, the actual characters are multiple, and the expected page image is provided with a plurality of corresponding expected characters; the method further comprises the following steps:

judging whether a plurality of actual characters contain a plurality of expected characters or not;

if yes, judging that the actual character is matched with the expected character;

if not, the actual character is judged not to be matched with the expected character.

In one embodiment, the soft buttons have corresponding desired references, which are characters or pictures;

the step of executing the trigger operation to the soft button comprises the following steps:

screenshot is carried out on a terminal interface of the vehicle-mounted terminal to obtain a first button image to be searched;

identifying the position of the expected reference in the first button image to be searched as a target position;

determining a button position of the soft button on the terminal interface based on the target position;

and on the terminal interface, carrying out simulated click operation on the button position so as to execute triggering operation on the soft button.

In one embodiment, the step of performing a trigger operation on the soft button includes:

capturing a terminal interface of the vehicle-mounted terminal to obtain a second button image to be searched; the second button image to be searched comprises candidate icons;

acquiring a button icon of the soft button;

determining an icon matched with the button icon as a target icon in the candidate icons of the second to-be-searched button image;

determining the position of the target icon in the second button image to be searched as the button position of the soft button on the terminal interface;

on the terminal interface, carrying out simulated click operation on the button position so as to execute triggering operation on the soft button;

the function button is a hard button; the step of executing a trigger operation on the hard button includes:

acquiring a button identifier of the hard button;

calling a signal instruction corresponding to the button identifier; the signal instruction is used for executing triggering operation on the hard button.

On the other hand, an embodiment of the present invention provides an abnormality detection apparatus for a vehicle-mounted terminal, where the apparatus includes:

the image acquisition module is used for responding to the triggering operation of a function button of the vehicle-mounted terminal and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image;

the character recognition module is used for recognizing characters in the actual page image to obtain actual characters;

and the abnormity determining module is used for determining that the page jumped after the functional button is triggered is abnormal if the actual character is not matched with the expected character corresponding to the expected page image.

In another aspect, an embodiment of the present invention provides a vehicle-mounted terminal, including a memory and a processor, where the memory stores a computer program, and the processor implements a step of an abnormality detection method for the vehicle-mounted terminal when executing the computer program.

In still another aspect, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing the steps of an abnormality detection method for a vehicle-mounted terminal.

In another aspect, an embodiment of the present invention provides a vehicle, including a vehicle-mounted terminal, where the vehicle-mounted terminal is configured to, in response to a trigger operation on a function button of the vehicle-mounted terminal, obtain an image of a terminal interface of the vehicle-mounted terminal, and use the image as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; and if the actual characters are not matched with the expected characters corresponding to the expected page images, determining that the page jumped after the functional button is triggered is abnormal.

One of the above technical solutions has the following advantages or beneficial effects: acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image by responding to triggering operation of a function button of the vehicle-mounted terminal, wherein the function button has a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal; according to the method, the abnormal detection of the button can be realized by processing and analyzing the image, the condition that data is easy to lose in the transmission process due to a frame detection mode is avoided, and the accuracy of the detection result is improved. Meanwhile, by comparing the actual characters with the expected characters, whether the page jumped after the functional buttons are triggered is normal or not can be judged quickly, and since the UI (user interface) design can be changed frequently in the research and development process, but the characters on the UI design can not be changed too frequently, the external interference in the test process can be effectively reduced by detecting the characters, and the test cost is saved.

Drawings

Fig. 1 is an application environment diagram of an abnormality detection method of a vehicle-mounted terminal in one embodiment.

Fig. 2 is a schematic flow chart of an abnormality detection method of the in-vehicle terminal in one embodiment.

FIG. 3 is a schematic flow chart diagram of a method for detecting a soft button response normality in one embodiment.

FIG. 4A illustrates a schematic diagram of a terminal interface of a vehicle terminal, in one embodiment.

FIG. 4B illustrates a diagram of a jump page, in one embodiment.

Fig. 5 is a schematic flowchart of an abnormality detection method of the in-vehicle terminal in another embodiment.

Fig. 6 is a schematic configuration diagram of an abnormality detection device of the in-vehicle terminal in one embodiment.

Fig. 7 is an internal configuration diagram of the in-vehicle terminal in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

The abnormality detection method for the vehicle-mounted terminal is applicable to detection and debugging of various terminals with soft and hard buttons, wherein the vehicle-mounted terminal is taken as an example and can be applied to an application environment shown in fig. 1, and specifically comprises a display screen 101, a processor 102 and a database 103, wherein the display screen 101 and the database 103 are respectively in communication connection with the processor 102 in a wired or wireless manner, the terminal interface can perform screen switching and display of various buttons, the database 103 is used for storing relevant button data on the terminal interface, and the processor 102 can be an engine accessed by the database 103.

In addition, the control of the display content of the terminal interface can be realized by a hard button (a physical button) on the vehicle-mounted terminal or a soft button (a virtual button) provided by the terminal interface, and the hard button and the soft button can be collectively called as a functional button; furthermore, the Display screen 101 may be a Liquid Crystal Display (LCD) screen or other types of Display screens such as an Organic Light-Emitting Diode (OLED) Display, configured as a touch screen, and the types are not limited to a vector pressure sensing technology touch screen, a resistive technology touch screen, a capacitive technology touch screen, an infrared technology touch screen, and a surface acoustic wave technology touch screen.

It should be noted that, in the embodiment of the present invention, the processor 102 may be a processor group including a plurality of processors, or may be a single processor; the processor can be a built-in processor installed on the vehicle-mounted terminal or an external processor independent of the vehicle-mounted terminal.

In one embodiment, as shown in fig. 2, an abnormality detection method for a vehicle-mounted terminal is provided, which is described by taking the method as an example applied to the vehicle-mounted terminal in fig. 1, and includes the following steps:

step S202, responding to the trigger operation of a function button of the vehicle-mounted terminal, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image.

The function button can be understood as a vehicle-mounted terminal button with a certain function, and can be divided into a soft button and a hard button, the soft button can be understood as a button with a certain function displayed on a screen, if the soft button is triggered, a corresponding ideal page can be presented on a terminal interface of the vehicle-mounted terminal, and the ideal page image can be understood as the expected page image. Specifically, for example, if the soft button is a volume adjustment button, when the soft button is triggered, the desired page image may be a window or a drawing page in which volume adjustment appears on the terminal interface.

When the button is detected to be abnormal, the execution triggering operation of the soft button of the vehicle-mounted terminal can be realized through a pre-written code; of course, the trigger can be manually triggered, and the setting can be specifically carried out according to the actual situation.

It should be noted that the method may not be limited to the anomaly detection applied to the vehicle-mounted terminal, that is, the function button is not limited to the function button of the vehicle-mounted terminal, but may also be a button on a terminal such as a mobile phone, a notebook computer, a tablet computer, and a wearable device.

In the embodiment of the present invention, the way of acquiring the image of the terminal interface of the vehicle-mounted terminal may be multiple, for example, by using an image acquisition code or an application program, when the test button is triggered to operate, the screen of the page skipped after the function button is triggered is captured, or the terminal interface image is acquired by using a scanner, a camera or other imaging devices, which is not limited herein.

In addition, the acquired image of the terminal interface of the vehicle-mounted terminal may be in various forms, for example, the image of the whole terminal interface may be acquired, or the image of one or more specific positions on the terminal interface may be acquired; it should be noted that the shape, size, format, etc. of the image can be selected and set according to actual situations.

And step S204, identifying characters in the actual page image to obtain actual characters.

Specifically, after the actual page image is acquired, the characters contained in the actual page image can be analyzed through an image analysis technology or other image processing technologies, or a plurality of characters are analyzed to form a character string, and the actually analyzed characters or character string are compared with expected characters or character strings to judge whether the page jumped after the functional button is triggered is normal. Since the UI design of the interface is frequently changed in the research and development process, but the character string is not changed too frequently, the detection of the character string is beneficial to reducing the external interference in the test process.

The characters or character strings may be selected as text information, such as chinese characters, foreign characters, numbers, special symbols, and the like. Further, the text information should be recognized in any format, for example, in the case of chinese characters, in the form of clerical script, cursive script, artistic font, etc. In addition, no matter where the text information is located on the terminal interface, the text information should be recognized.

Step S206, if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal.

In this step, after the actual character in step S204 is obtained, an expected character corresponding to the expected page image may be called from a local or cloud database, and then the actual character and the expected character corresponding to the expected page image are compared to check whether they are matched, and if they are not matched, it is determined that the function button is abnormal. For example, a system of the vehicle-mounted terminal may store a desired page image B of the function button a in advance, where B corresponds to a desired character C; of course, the desired character C corresponding to the function button a may be stored in advance. And after button triggering operation is carried out on the A, if the image actually displayed on the terminal interface contains the C, determining that the page jumped after the A is triggered has no abnormity.

It should be noted that, if the actual character matches the expected character corresponding to the expected page image, it may be determined that the page skipped after the function button is triggered is normal, or it may be determined that the page is temporarily normal, and the next detection step of the function button may be performed, which is not limited herein.

Of course, the button abnormity detection mode can be performed by directly comparing whether the actual page image is matched with the expected page image, and specifically, whether the button is abnormal can be judged by comparing whether the actual page image is consistent with the expected page image; more specifically, comparing whether the actual page image and the expected page image are consistent or not can compare whether all the features in the two images are consistent or extract one or some key features in the two images for comparison, and the comparison can also be performed by comparing the data amount, the space occupancy rate and other attribute information of the two images, and the setting can be specifically performed according to the actual situation.

In the above embodiments of the present invention, the execution main body may be a processor or a controller of the vehicle-mounted terminal, or may be an external server, a cloud server, or the like connected to the vehicle-mounted terminal, and may of course be selected and changed according to actual situations.

In the abnormality detection method of the vehicle-mounted terminal of the embodiment, the image of the terminal interface of the vehicle-mounted terminal is acquired as the actual page image by responding to the triggering operation of the function button of the vehicle-mounted terminal; the function button is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal; according to the method, the abnormal detection of the button can be realized by processing and analyzing the image, the condition that data is easy to lose in the transmission process due to a frame detection mode is avoided, and the accuracy of the detection result is improved. Meanwhile, by comparing the actual characters with the expected characters, whether the page jumped after the functional buttons are triggered is normal or not can be judged quickly, since the UI design can be changed frequently in the research and development process, but the characters on the UI design can not be changed too frequently, the external interference in the test process can be effectively reduced by detecting the characters, different functional buttons can correspond to the same expected characters, the database capacity requirement is reduced, and the test cost is saved. In addition, the method can be used for detecting the abnormality of the function button and is also suitable for detecting the abnormality of the hard button, and the method has strong universality and wide detection range. Further, as a more accurate detection result is obtained, the influence of an inaccurate detection result on subsequent function development and problem troubleshooting can be avoided.

In another embodiment, the number of desired characters is at least two; each expected character has a corresponding expected character position in the expected page image; after step S204, the method for detecting an abnormality of the in-vehicle terminal may further include: acquiring the actual character position of an actual character in an actual page image; if the actual character is matched with at least two expected characters, comparing the expected character position of each expected character with the actual character position of the matched actual character; and if the expected character position is inconsistent with the actual character position, determining that the function button is abnormal.

By continuing the above example, the system of the vehicle-mounted terminal may store in advance an expected page image B of the function button a, where B corresponds to an expected character C, and after the button trigger operation is performed on a, if an image actually displayed on the terminal interface may contain C but does not correspond to the expected page image B, it cannot be determined that a is abnormal completely and accurately; therefore, the method of the embodiment is also provided in a targeted manner, namely, not only is the character comparison performed, but also the character position comparison is performed, when the character and the character position are matched, the functional button can be determined to be normal, otherwise, if one of the conditions of character mismatch and character position mismatch is met, the functional button is determined to be abnormal. The method is simple and easy to control, can realize abnormal detection of the button, is quick and efficient, and has the advantages of difficult data loss in the detection process and high accuracy of the detection result.

In another embodiment, the function button is a soft button, and before step S202, the abnormality detecting method of the in-vehicle terminal may further include: responding to the approaching trigger operation of the soft button, and acquiring an actual button special effect image of the soft button; the soft buttons also have corresponding desired button special effect images; and if the actual button special effect image is not matched with the expected button special effect image, determining that the response of the soft button is abnormal after the soft button is close to the trigger.

Here, the approach to the trigger operation may be understood as an operation of gradually approaching the soft button before triggering to the soft button, and an appearance of a part of the soft button may be changed during the trigger operation of gradually approaching the soft button; for example, when a user's finger is close to a portion of the soft button, an icon corresponding to the soft button will be enlarged, brightened or discolored, and so on, so that when detecting whether the soft button is normal or not, it can be first detected whether the soft button can present a preset screen dynamic response (such as enlargement, brightening or discoloring) after receiving an instruction of a proximity trigger.

Specifically, in this step, the processor 102 may receive or call a proximity trigger instruction or code for the soft button from the outside, so that the processor 102 determines that the soft button is being subjected to a proximity trigger operation, and then acquires an actual button special effect image of the soft button by responding to the proximity trigger operation on the soft button. The actual button special effect image of the soft button can be obtained by screen capture of the terminal interface, and can also be obtained by selecting other modes according to actual conditions.

In another embodiment, the method further comprises:

identifying respective button special effect features of the actual button special effect image and the desired button special effect image; the button special effect feature comprises at least one of a button shape feature, a button brightness feature and a button chroma feature; and if the button special effect features of the actual button special effect image are not matched with the button special effect features of the expected button special effect image, judging that the actual button special effect image is not matched with the expected button special effect image.

In specific implementation, the actual button special effect image and the expected button special effect image both have corresponding button special effect characteristics. Wherein the button special effect feature may include at least one of a button shape feature, a button brightness feature, and a button chroma feature. The button special effect feature may be an icon appearance change feature of the soft button, such as the above-mentioned enlargement, brightening, or color change, that is, the shape feature, the brightness feature, and the chromaticity feature of the soft button icon are changed, and of course, the button special effect feature is not limited thereto, and the actual setting is used as the standard.

The abnormality detection method of the vehicle-mounted terminal may further include: one or more button special effect features of button shape features, button brightness features, and button chroma features of the actual button special effect image and the desired button special effect image are identified. Then, comparing the respective button special effect features of the actual button special effect image and the desired button special effect image, if the button special effect feature of the actual button special effect image is not matched with the button special effect feature of the desired button special effect image, it can be determined that the actual button special effect image is not matched with the desired button special effect image, otherwise, it can be determined that the actual button special effect image is matched with the desired button special effect image.

In the embodiment, the abnormal state can be detected more favorably by detecting the shape of the button and considering the brightness and the chromaticity, and the accuracy of the detection result is improved.

In another embodiment, prior to the step of identifying the respective button special effect features of the actual button special effect image and the desired button special effect image, the method further comprises:

acquiring a plurality of candidate expected button special effect images; the candidate expected button special effect images respectively have corresponding ambient brightness adaptation modes; determining a current environment brightness adaptation mode of the vehicle-mounted terminal; and extracting a candidate expected button special effect image corresponding to the current environment brightness adaptation mode from the plurality of candidate expected button special effect images as the expected button special effect image.

The environment brightness adaptation mode may specifically be a mode in which the brightness of an image displayed on the terminal interface is adapted to the external environment. For example, the ambient brightness adaptation mode may specifically include a daytime mode, a nighttime mode, a dusk mode, a tunnel mode, a bright light mode, and the like. Wherein each ambient brightness adaptation mode has a corresponding candidate desired button special effect image. For example, 8 am to 4 pm may be switched to the daytime mode, and 8 pm to 6 am may be switched to the nighttime mode. Because the external ambient brightness is different in different time periods or driving environments, the appearance characteristics such as display brightness, chromaticity and the like on the terminal interface also need to be adapted correspondingly. For example, in the night mode, the external environment brightness is dark, and the display brightness on the terminal interface is correspondingly dark. Correspondingly, when the button special effect images are matched, the current ambient brightness adaptation mode of the vehicle-mounted terminal needs to be determined, so that the corresponding expected button special effect images can be determined, and then the corresponding expected button special effect images are matched with the actual button special effect images.

In the embodiment, the corresponding expected button special effect image is determined according to the current environment brightness adaptation mode of the vehicle-mounted terminal, and then the expected button special effect image is matched with the actual button special effect image, so that the accuracy of the abnormal detection of the vehicle-mounted terminal is improved.

In another embodiment, an actual appearing icon is included in the actual page image, an expected appearing icon is included in the expected page image, and the icon position of the expected appearing icon in the expected page image is matched with the icon position of the actual appearing icon in the actual page image; the method further comprises the following steps:

if the actual appearing icon is matched with the expected appearing icon and the actual character is matched with the expected character, determining that a page jumped after the functional button is triggered is normal; and if the actual icon does not match the expected icon or the actual character does not match the expected character, determining that the page jumped after the functional button is triggered is abnormal.

In a specific implementation, one or more icons may be included in the actual page image, and for the purpose of distinguishing the description, one or more icons in the actual page image are named as actual appearance icons. Similarly, the icon in the desired page image is named the icon desired to appear.

In this embodiment, in addition to character matching, matching of icons may be performed simultaneously. And when the one or more actual-appearing icons are matched with the corresponding one or more expected-appearing icons and the one or more actual characters are matched with the corresponding one or more expected characters, determining that the page jumped after the functional button is triggered is normal. When the one or more actual appearing icons do not match the one or more expected appearing icons, or the one or more actual characters do not match the one or more expected characters, then a page exception to jump after the function button was triggered may be determined.

In the embodiment, through the simultaneous matching of the characters and the icons, the accuracy of the abnormal detection of the vehicle-mounted terminal is ensured, and meanwhile, the efficiency of the abnormal detection of the vehicle-mounted terminal is improved.

In one embodiment, the method further comprises:

scanning the actual page image;

In a specific implementation, the actual page image may be scanned according to a certain rule, for example, the actual page image is scanned from top to bottom and from left to right. And generating an icon task thread every time when the actual icon is scanned, starting execution of the icon task thread after the icon task thread is generated, matching the actual icon and the expected icon, and outputting an icon matching result.

Then, the content of the image which is not scanned in the actual page image is continuously scanned, and when the next actual icon appears, another icon task thread is generated so as to match the scanned next actual icon with the corresponding expected icon.

During the scanning of the actual page image, one or more executing icon matching task threads may be generated. When a matching task is completed by one of the currently executed icon matching task threads and a matching result that an actually appearing icon is not matched with an expected appearing icon is output, all currently executed icon matching task threads can be immediately terminated, and the fact that the actually appearing icon in the actual page image is not matched with the expected appearing icon in the expected page image is judged.

In the embodiment, the multiple icons can be synchronously matched through the multithreading parallel and pipeline technology, the next icon matching task is started without waiting for the completion of one icon matching task, and all icon matching tasks are immediately stopped when some icon is unmatched, so that the efficiency of abnormality detection of the vehicle-mounted terminal is improved.

In another embodiment, the actual characters are plural, and the desired page image has a corresponding plurality of desired characters; the method further comprises the following steps:

judging whether a plurality of actual characters contain a plurality of expected characters or not; if yes, judging that the actual character is matched with the expected character; if not, the actual character is judged not to be matched with the expected character.

In the specific implementation, a plurality of actual characters can be recognized from the actual page image, then whether the recognized actual characters contain all expected characters or not is judged, and whether the actual characters are matched with the expected characters or not is judged according to the judgment result, so that matching does not need to be carried out on each character one by one, and the efficiency of abnormality detection of the vehicle-mounted terminal is improved.

To facilitate a person skilled in the art to understand the foregoing embodiments deeply, fig. 4A shows a schematic diagram of a terminal interface of a vehicle-mounted terminal according to an embodiment. As shown, the in-vehicle terminal may have a soft button 401 and a hard button 402, and by touching the soft button 401 and the hard button 402, the terminal interface may jump to a corresponding jump page. FIG. 4B illustrates a diagram of a jump page of an embodiment. As shown in the figure, when the soft button of "music" is triggered, the user jumps to a music playing page, where the music playing page may include characters 403 such as "music station", "enjoyed music", and the like, and may further include various icons 404, the skipped music playing page is identified, the identified actual characters are matched with the expected characters, and the identified actual appearing icons are matched with the expected appearing icons, and when the characters and the icons are both matched, the skipped page may be determined to be correct, otherwise, the skipped page may be abnormal.

In another embodiment, in the button detection process, in order to ensure the accuracy of the detection result and avoid the detection result being abnormal due to the existence of random errors or interference, the detection result may be verified by multiple detections. As shown in fig. 5, in a specific abnormality detection method for a vehicle-mounted terminal, a detection number i may be first obtained; the detection times i are the times of executing the trigger operation on the function button; and if the detection times are not more than a preset time specified value, executing proximity trigger operation on a certain soft button of the terminal interface. Then, judging whether the actual response effect of the soft button after responding to the proximity trigger operation is matched with the expected response effect, if so, further executing the trigger operation on the soft button; if not, determining that the proximity trigger response of the soft button is abnormal, and performing screenshot on the current terminal interface to obtain and store a real-time scene image. After the soft button is triggered, identifying characters in an actual jump page, matching the identified characters with expected characters, and matching an actual icon in the actual jump page with an expected icon; if the characters and the icons are matched, initializing i to 0, and detecting a hard button of the vehicle-mounted terminal; and if the characters and/or the icons are not matched, confirming that the trigger response of the soft button is abnormal, and carrying out screenshot on the current terminal interface to obtain and store a real-time scene image. And when the proximity trigger response abnormity of the soft button or the trigger response abnormity is confirmed, updating i to i +1, and returning to the step of judging whether the detection frequency is greater than a preset frequency specified value. If the detection frequency is larger than a preset frequency specified value, initializing i to 0, and detecting a hard button of the vehicle-mounted terminal. Since the detection process of the hard button of the vehicle-mounted terminal is similar to the soft button detection process, the description is omitted here.

It should be noted that the predetermined number of times may be obtained by experiment before testing, or may be determined by experience or other reference data, and the specific value is not limited herein.

In another embodiment, if it is determined that the soft button is abnormal, the abnormality detecting method of the in-vehicle terminal further includes: extracting an actual page image as an abnormal real-time scene image; and storing the abnormal real-time scene image.

It can be understood that if a certain soft button is determined to be abnormal, the method can timely record and store the actual page image displayed on the terminal interface at the moment; specifically, in the process of extracting the actual page image, the actual page image can be directly extracted through an image acquisition instruction to be used as an abnormal real-time scene image; and operations such as compression, format conversion and the like can be performed on the actual page image, so that an abnormal real-time scene image is obtained. Of course, the abnormal real-time scene image may not be obtained through the actual page image, but the screenshot is obtained on the terminal interface at the moment when the abnormality of the soft button is determined.

When the abnormal real-time scene image is stored, the abnormal real-time scene image can be stored in a folder created under a fixed path, and the image information corresponding to the abnormal real-time scene image is marked, wherein the image information can comprise information such as the name of a function button of the abnormal real-time scene, the time when the function button is detected to be abnormal, and the abnormality caused by any condition, so that developers can inquire and retrieve related records of the abnormality when the abnormal problem is checked and solved.

In another embodiment, the terminal interface includes actual page content; the step S202 may specifically include: screenshot is carried out on the actual page content in the terminal interface to serve as an actual page image; the screenshot operation can be realized through codes or can be completed through a client or an application program with the screenshot function. The method is simple to control and convenient to operate, improves the image acquisition efficiency and the button abnormity detection efficiency, and has strong practicability.

In another embodiment, the performing the triggering operation on the soft button in step S202 may specifically include: acquiring the button position of a soft button on a terminal interface; and performing simulated click operation on the button position on the terminal interface to trigger the soft button.

In one embodiment, with continued reference to fig. 4A, the soft button has a corresponding desired reference, which may be a character or a picture (the desired reference for the "navigate" button in fig. 4A may be a "navigate" character string, or an icon picture above the "navigate" character string, and the location of the "navigate" soft button may be found by finding the character string or icon picture); specifically, the step of acquiring the button position of the soft button on the terminal interface may include: screenshot is carried out on a terminal interface of the vehicle-mounted terminal to obtain a first button image to be searched; identifying a position expected to be referred in the first button image to be searched as a target position; and determining the button position of the soft button on the terminal interface based on the target position. The method helps to quickly find the soft button and perform a simulated click operation.

Another specific embodiment is that the step of obtaining the button position of the soft button on the terminal interface may specifically include: capturing a terminal interface of the vehicle-mounted terminal to obtain a second button image to be searched; the second button image to be searched comprises candidate icons; acquiring a button icon of a soft button; determining an icon matched with the button icon as a target icon in the candidate icons of the second to-be-searched button image; and determining the position of the target icon in the second to-be-searched button image as the button position of the soft button on the terminal interface.

The second button image to be searched can be understood as an image currently displayed on the terminal interface, and a plurality of soft buttons (candidate images) can be displayed on the image, wherein one of the soft buttons is the soft button to be detected; and each soft button has its specific location coordinates (image location); the second button image to be searched obtained through screenshot can be used for comparing with the button icon of the soft button, and then the button position of the soft button is matched, and automatic triggering of the soft button is achieved.

In order to accurately trigger a soft button (for example, a button) to be detected on the terminal interface, the position coordinates of the a button on the terminal interface are acquired. Firstly, acquiring an image of the whole interface by screenshot of a terminal interface; the icon style (button icon) of the a button is searched from an external database, and then in the image, a button image (target image) matching with the icon of the a button is determined, so that the button position of the a button in the image can be obtained.

Specifically, the image jpg and Bitmap (Bitmap) can be converted into each other by using an IDutScreenshotService interface in an external database and code, thereby facilitating the search for the target image in the second to-be-searched button image. The method can accurately match the button position of the soft button to be detected, ensures the accuracy and success rate of button triggering, and improves the reliability of the detection result.

It should be noted that the system can intelligently retrieve the corresponding button data in the database 103 for matching according to the current page (i.e. the intercepted first button-to-be-searched image) when performing the triggering operation: for example, if the normal test is performed on the media playing page, when detecting whether the soft button is abnormal or the screen is frozen, the soft button flag related to the media playing page is automatically retrieved from the database 103 and automatically matched with the current page; if the map navigation interface is used, the soft button marks of the map navigation interface are called for matching, so that the picture marks corresponding to the Application are not required to be configured manually when different apps (applications) are tested, and detailed operations are reduced.

In another embodiment, the button icon has a corresponding icon location range, and the candidate image matching with the button icon can be searched within the location range of the candidate icon in the second button image to be searched as the target icon.

I.e. triggering a soft button (e.g. b-button) to be detected on the terminal interface, can be implemented by the following method. Firstly, acquiring an image of the whole interface by screenshot of a terminal interface; searching an external database to obtain the icon style (button icon) of the b button and the position coordinate range (icon position range) of the b button approximately on the interface, then determining a candidate image (target image) matched with the icon of the b button within the position range of the icon of the image, and then obtaining a more accurate button position of the b button in the image. The method improves the searching speed of the soft button by reducing the searching range of the soft button, realizes the quick triggering of the soft button and has high detection efficiency.

In another embodiment, when the function buttons include both soft buttons and hard buttons, the abnormality detection for the soft buttons and the hard buttons may be completed by performing abnormality detection for the soft buttons and then determining whether the hard buttons are abnormal. As for the specific embodiment of the abnormality detection of the soft button and the abnormality detection of the hard button, reference is made to fig. 5, and the above-mentioned abnormality detection method for the soft button is also applicable to abnormality detection of the hard button without conflicting with the actual situation, so that the method shown in fig. 5 is not the only abnormality detection method for the soft button and the hard button.

It should be noted that, if the hard button is detected first and then the soft button is detected, if the hard button is abnormal, it may cause the display screen 101 to be unable to normally touch, and at this time, the subsequent soft button detection work will be affected; therefore, by adopting the detection mode of firstly detecting the soft button and then detecting the hard button, the problem that the soft button cannot be normally detected due to the abnormality of the hard button can be avoided.

Further, the advantage of detecting the soft button first and then the hard button is that: if the hard button is detected first, the original screen page freezing may occur, but after the hard button page switching, the screen returns to normal, which will miss the test result of the screen freezing and is not beneficial to the problem discovery. The soft button is detected firstly, namely the current screen state is detected firstly, then the hard button is detected, and the screen picture is switched, so that the problem of screen freezing can be found more comprehensively.

In another embodiment, the step of performing the hard button triggering operation on the hard button may specifically include: acquiring a button identifier of a hard button; calling a signal instruction corresponding to the button identifier; the signal instructions are for performing a hard button toggle operation on a hard button. Each hard button may have a unique button identification; when a request for detecting a certain hard button is sent to the vehicle-mounted terminal, the vehicle-mounted terminal can call a corresponding signal instruction by identifying the button identifier of the hard button so as to simulate the operation of executing button triggering on the hard button; the method realizes the automatic triggering of the hard button, has simple and reasonable control, quick response of the button triggering program and high accuracy of the detection result.

In another embodiment, when the abnormality detection method of the vehicle-mounted terminal is executed, a database tool can be created locally at the vehicle-mounted terminal; the database can be linked with the codes, an operation interface is provided, all data, pictures, texts and the like are visual and visible, the database access operation is carried out without manually inputting sql language, and the button images can be directly intercepted or stored through the database. The database is linked with the code, so that in the data storage operation process, the system can automatically acquire the version number of the test terminal returned by the code, the version number corresponds to the stored data, the next time the data information is called, the corresponding data can be automatically returned according to the version number of the test terminal, one ID can correspond to a plurality of test terminal versions, when the test versions need to be rolled back for testing, the database does not need to be revised again, the data of the previous database is covered for testing, and the method can effectively adapt to all terminal tests before the existing version.

According to the abnormity detection method of the vehicle-mounted terminal, no manual operation is needed in the long-time test process, only the setting is carried out according to a computer program, and the detection program is automatically triggered at set time intervals. The set time interval can be set by self according to the actual situation, and is not limited here.

The operation procedure for detecting abnormality of the soft button and the hard button (in which the button abnormality indicates a button crash) will be further explained by a specific example.

First, verify whether the soft button crashes: and searching a button to be detected in the current page as a key value for checking whether to crash. And triggering the button, wherein the expected result is that the jumped secondary drawing page contains expected characters, and if the actual result is not in accordance with the expected result, judging that the button is abnormal. For example, when a car machine tests a test case played by a radio for a long time, the car machine is in a first-level picture, namely a radio playing page, at the moment, a setting button in a menu bar is used as a button to be detected, when the setting button is triggered, the picture is switched to a second-level picture, at the moment, character analysis can be carried out on the second-level picture, if the analyzed result shows that an actual character does not contain an expected character, the actual character does not accord with the expected character, and the current detection result is judged to be abnormal; if the number of times specified value is set to 20 times, namely if the number of times of trial reaches 20 times, the actual character in the page still does not contain the expected character, the set button is determined to be abnormal; if the actual characters in the picture within 20 times of attempts contain the expected characters, the setting button is determined to work normally; after the soft button detection is completed, the next hard button detection can be performed.

Secondly, verify whether the hard button crashes: hard buttons may be understood as rows of buttons located on the side of the display 101 of the in-vehicle machine. Firstly, selecting a hard button as a key value for checking that the car machine is in occasional halt, triggering the button, wherein the expected result is that actual characters in a jumped corresponding drawing page contain expected characters, and if the actual characters do not accord with the expected characters, judging that the button is abnormal. For example, when the car machine tests a test case for playing music for a long time, a test picture is positioned on a media playing page, a hard button 'MENU' is selected as a button to be detected, the button is triggered, a desired drawing page should jump to a main MENU interface, a 'MENU' character string should be arranged in the main MENU interface, and if an actual result is not consistent with the desired result, the button is judged to be abnormal; if the specified number of times is still set to 20 times, namely if the number of times of attempts reaches 20 times, the MENU character string still does not appear in the page, and the MENU button can be determined to be abnormal; if the MENU character string appears in the picture within 20 times of trying, the MENU button is considered to work normally. Combining the two verification processes, the anomaly detection result can include four situations, namely: the soft button is dead halt, and the hard button is normal; the soft button is dead halt, and the hard button is dead halt; the soft button is normal, and the hard button is dead; the soft button is normal and the hard button is normal.

It should be noted that when the soft button or the hard button is abnormal, the idutscreenshop service interface in the code can be used to capture the dead page of the vehicle-mounted terminal, and the captured dead page is saved to a local fixed path in a jpg picture format, so as to present a dead real-time scene for the developer; subsequently, the IMarkableTracingservice interface is called, and log information of related tests is output to a certain local path, so that developers can conveniently troubleshoot and solve the problems.

It should be understood that for the foregoing method embodiments, although the steps in the flowcharts are shown in order indicated by the arrows, the steps are not necessarily performed in order indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in the flow charts of the method embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least a portion of the sub-steps or stages of other steps.

Based on the same idea as the abnormality detection method of the in-vehicle terminal in the above embodiment, an abnormality detection device of the in-vehicle terminal is also provided herein.

In one embodiment, as shown in fig. 6, there is provided an abnormality detection apparatus of a vehicle-mounted terminal, including: an image acquisition module 601, a character recognition module 602, and an anomaly determination module 603, wherein:

the image acquisition module 601 is configured to acquire an image of a terminal interface of the vehicle-mounted terminal as an actual page image in response to a trigger operation on a function button of the vehicle-mounted terminal; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image;

a character recognition module 602, configured to recognize characters in an actual page image to obtain actual characters;

an exception determining module 603, configured to determine that the page skipped after the function button is triggered is abnormal if the actual character does not match the expected character corresponding to the expected page image.

In another embodiment, the function buttons are soft buttons; the abnormality detection device for the in-vehicle terminal further includes: the proximity response matching module is used for responding to proximity trigger operation of the soft button and acquiring an actual button special effect image of the soft button; the soft buttons also have corresponding desired button special effect images; and if the actual button special effect image is not matched with the expected button special effect image, determining that the response of the soft button is abnormal after the soft button is close to the trigger.

In one embodiment, the apparatus further comprises:

a special effect recognition module for recognizing button special effect characteristics of the actual button special effect image and the expected button special effect image respectively; the button special effect feature comprises at least one of a button shape feature, a button brightness feature and a button chroma feature; if the button special effect features of the actual button special effect image are not matched with the button special effect features of the expected button special effect image, judging that the actual button special effect image is not matched with the expected button special effect image;

the device further comprises:

the candidate special effect image acquisition module is used for acquiring a plurality of candidate expected button special effect images; the candidate expected button special effect images respectively have corresponding ambient brightness adaptation modes;

the current mode determining module is used for determining a current environment brightness adaptation mode of the vehicle-mounted terminal;

and the expected special effect image determining module is used for extracting a candidate expected button special effect image corresponding to the current environment brightness adaptation mode from the plurality of candidate expected button special effect images to serve as the expected button special effect image.

In one embodiment, an actual appearing icon is included in the actual page image, an expected appearing icon is included in the expected page image, and the icon position of the expected appearing icon in the expected page image is matched with the icon position of the actual appearing icon in the actual page image; the apparatus is further configured to:

In one embodiment, the apparatus is further configured to:

scanning the actual page image; when the actual icon appears in the actual page image, executing an icon matching task thread, and continuing to scan the actual page image; the icon matching task thread is used for matching the actually appearing icon with the expected appearing icon and outputting an icon matching result; when the icon matching result output by the icon matching task thread is not matched in the process of scanning the actual page image, terminating a plurality of currently executed icon matching task threads, and judging that the actually-appearing icon is not matched with the expected-appearing icon.

In one embodiment, the actual characters are plural, and the desired page image has a corresponding plurality of desired characters; the apparatus is further configured to:

In another embodiment, the function buttons are soft buttons, and the image capturing module 601 may be specifically configured to: acquiring the button position of a soft button on a terminal interface; and on a terminal interface, performing simulated click operation on the button position to execute triggering operation on the soft button.

In another embodiment, the soft buttons have corresponding desired references, the desired references being characters or pictures; the image acquisition module 601 may be further configured to: screenshot is carried out on a terminal interface of the vehicle-mounted terminal to obtain a first button image to be searched; identifying a position expected to be referred in the first button image to be searched as a target position; and determining the button position of the soft button on the terminal interface based on the target position.

In another embodiment, the image acquisition module 601 is further configured to: capturing a terminal interface of the vehicle-mounted terminal to obtain a second button image to be searched; the second button image to be searched comprises candidate icons; acquiring a button icon of a soft button; determining an icon matched with the button icon as a target icon in the candidate icons of the second to-be-searched button image; and determining the position of the target icon in the second to-be-searched button image as the button position of the soft button on the terminal interface.

In another embodiment, the function button is a hard button, and the image capturing module 601 may be specifically configured to: acquiring a button identifier of a hard button; calling a signal instruction corresponding to the button identifier; the signal instructions are for performing a hard button toggle operation on a hard button.

In another embodiment, the abnormality detection device of the in-vehicle terminal further includes: the detection frequency acquisition module is used for acquiring the detection frequency; the detection times are the times of executing triggering operation on the function button; if the detection times are not greater than a preset times specified value, a notification message is sent to the image acquisition module 601; and if the detection times are larger than the times specified value, determining that the function button is abnormal.

In another embodiment, if it is determined that the function button is abnormal, the abnormality detecting apparatus of the in-vehicle terminal further includes: the marking module is used for extracting an actual page image as an abnormal real-time scene image; and storing the abnormal real-time scene image.

In another embodiment, the terminal interface includes actual page content; the image obtaining module 601 is specifically configured to capture an actual page content in the terminal interface as an actual page image.

For specific limitations of the abnormality detection device of the vehicle-mounted terminal, reference may be made to the above limitations of the abnormality detection method of the vehicle-mounted terminal, and details thereof are not repeated here. Each module in the abnormality detection apparatus of the vehicle-mounted terminal may be entirely or partially implemented by software, hardware, or a combination thereof. The modules can be embedded in a hardware form or independent from the processor 102 in the vehicle-mounted terminal, or can be stored in a memory in the vehicle-mounted terminal in a software form, so that the processor 102 can call and execute operations corresponding to the modules.

In addition, in the embodiment of the abnormality detection apparatus of the vehicle-mounted terminal illustrated above, the logical division of the program modules is only an example, and in practical applications, the above functions may be allocated by different program modules according to needs, for example, due to the configuration requirements of corresponding hardware or the convenience of implementation of software, that is, the internal structure of the abnormality detection apparatus of the vehicle-mounted terminal is divided into different program modules to complete all or part of the above described functions.

In one embodiment, a vehicle-mounted terminal is provided, and the internal structure thereof may be as shown in fig. 7. The vehicle-mounted terminal comprises a processor, a memory, a network interface, a database and a display screen which are connected through a system bus. Wherein, the processor of the vehicle-mounted terminal is used for providing calculation and control capability. The memory of the vehicle-mounted terminal comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The display screen of the vehicle-mounted terminal is used for presenting a terminal interface. The database of the in-vehicle terminal is used for storing button image data. The network interface of the vehicle-mounted terminal can be used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement an abnormality detection method of a vehicle-mounted terminal.

Those skilled in the art will appreciate that the structure shown in fig. 7 is only a block diagram of a part of the structure related to the present application, and does not constitute a limitation to the in-vehicle terminal to which the present application is applied, and a specific in-vehicle terminal may include more or less components than those shown in the figure, or combine some components, or have a different arrangement of components.

In one embodiment, a vehicle-mounted terminal is provided, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the following steps when executing the computer program: responding to the triggering operation of a function button of the vehicle-mounted terminal, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; and if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal.

In one embodiment, the function buttons are soft buttons; the processor, when executing the computer program, further performs the steps of: responding to the approaching trigger operation of the soft button, and acquiring an actual button special effect image of the soft button; the soft buttons also have corresponding desired button special effect images; and if the actual button special effect image is not matched with the expected button special effect image, determining that the response of the soft button is abnormal after the soft button is close to the trigger.

In one embodiment, the processor, when executing the computer program, further performs the steps of:

In one embodiment, an actual appearing icon is included in the actual page image, an expected appearing icon is included in the expected page image, and the icon position of the expected appearing icon in the expected page image is matched with the icon position of the actual appearing icon in the actual page image; the processor, when executing the computer program, further performs the steps of:

In one embodiment, the actual characters are plural, and the desired page image has a corresponding plurality of desired characters; the processor, when executing the computer program, further performs the steps of:

In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring the button position of a soft button on a terminal interface; and on a terminal interface, performing simulated click operation on the button position to execute triggering operation on the soft button.

In one embodiment, the soft buttons have corresponding desired references, the desired references being characters or pictures; the processor, when executing the computer program, further performs the steps of: screenshot is carried out on a terminal interface of the vehicle-mounted terminal to obtain a first button image to be searched; identifying a position expected to be referred in the first button image to be searched as a target position; and determining the button position of the soft button on the terminal interface based on the target position.

In one embodiment, the processor, when executing the computer program, further performs the steps of: capturing a terminal interface of the vehicle-mounted terminal to obtain a second button image to be searched; the second button image to be searched comprises candidate icons; acquiring a button icon of a soft button; determining an icon matched with the button icon as a target icon in the candidate icons of the second to-be-searched button image; and determining the position of the target icon in the second to-be-searched button image as the button position of the soft button on the terminal interface.

In one embodiment, the function buttons are hard buttons; the processor, when executing the computer program, further performs the steps of: responding to a hard button triggering operation of a hard button of the vehicle-mounted terminal, acquiring an image of a terminal interface, and obtaining a page image to be identified; the hard buttons have corresponding intended page images; identifying characters in the page image to be identified to obtain page characters to be compared; and if the page character to be compared is not matched with the expected page character corresponding to the expected page image, determining that the hard button is abnormal.

In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring a button identifier of a hard button; calling a signal instruction corresponding to the button identifier; the signal instructions are for performing a hard button toggle operation on a hard button.

In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: responding to the triggering operation of a function button of the vehicle-mounted terminal, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; and if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal.

In one embodiment, the computer program when executed by the processor implements the steps of: responding to the approaching trigger operation of the soft button, and acquiring an actual button special effect image of the soft button; the soft buttons also have corresponding desired button special effect images; and if the actual button special effect image is not matched with the expected button special effect image, determining that the soft button is abnormal.

In one embodiment, the computer program when executed by the processor implements the steps of:

identifying respective button special effect features of the actual button special effect image and the desired button special effect image; the button special effect feature comprises at least one of a button shape feature, a button brightness feature and a button chroma feature; if the button special effect features of the actual button special effect image are not matched with the button special effect features of the expected button special effect image, judging that the actual button special effect image is not matched with the expected button special effect image; prior to the step of identifying the respective button special effect features of the actual button special effect image and the desired button special effect image, the method further comprises: acquiring a plurality of candidate expected button special effect images; the candidate expected button special effect images respectively have corresponding ambient brightness adaptation modes; determining a current environment brightness adaptation mode of the vehicle-mounted terminal; and extracting a candidate expected button special effect image corresponding to the current environment brightness adaptation mode from the plurality of candidate expected button special effect images as the expected button special effect image.

In one embodiment, an actual appearing icon is included in the actual page image, an expected appearing icon is included in the expected page image, and the icon position of the expected appearing icon in the expected page image is matched with the icon position of the actual appearing icon in the actual page image; the computer program when executed by a processor implements the steps of:

In one embodiment, the actual characters are plural, and the desired page image has a corresponding plurality of desired characters; the computer program when executed by a processor implements the steps of:

In one embodiment, the computer program when executed by the processor implements the steps of: acquiring the button position of a soft button on a terminal interface; and on a terminal interface, performing simulated click operation on the button position to execute triggering operation on the soft button.

In one embodiment, the soft buttons have corresponding desired references, the desired references being characters or pictures; the computer program when executed by a processor implements the steps of: screenshot is carried out on a terminal interface of the vehicle-mounted terminal to obtain a first button image to be searched; identifying a position expected to be referred in the first button image to be searched as a target position; and determining the button position of the soft button on the terminal interface based on the target position.

In one embodiment, the computer program when executed by the processor implements the steps of: capturing a terminal interface of the vehicle-mounted terminal to obtain a second button image to be searched; the second button image to be searched comprises candidate icons; acquiring a button icon of a soft button; determining an icon matched with the button icon as a target icon in the candidate icons of the second to-be-searched button image; and determining the position of the target icon in the second to-be-searched button image as the button position of the soft button on the terminal interface.

In one embodiment, the computer program when executed by the processor implements the steps of: responding to a hard button triggering operation of a hard button of the vehicle-mounted terminal, acquiring an image of a terminal interface, and obtaining a page image to be identified; the hard buttons have corresponding intended page images; identifying characters in the page image to be identified to obtain page characters to be compared; and if the page character to be compared is not matched with the expected page character corresponding to the expected page image, determining that the hard button is abnormal.

In one embodiment, the computer program when executed by the processor implements the steps of: acquiring a button identifier of a hard button; calling a signal instruction corresponding to the button identifier; the signal instructions are for performing a hard button toggle operation on a hard button.

In one embodiment, a vehicle is provided, the type, specification, model, etc. of which are not limited; specifically, the vehicle includes the above-described in-vehicle terminal; the vehicle-mounted terminal is used for responding to the triggering operation of a function button of the vehicle-mounted terminal, and acquiring an image of a terminal interface of the vehicle-mounted terminal as an actual page image; the function button is used for jumping the terminal interface from a current page to an expected page after being triggered, and the expected page is provided with a corresponding expected page image; identifying characters in the actual page image to obtain actual characters; and if the actual character is not matched with the expected character corresponding to the expected page image, determining that the page jumped after the functional button is triggered is abnormal. Through installing this vehicle terminal for the button of this vehicle detects more high-efficient and accurate, remains the scene of button anomaly and crash in real time, makes the complete saving of test result, is convenient for follow-up carry out pertinence debugging and maintenance.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The terms "comprises" and "comprising," as well as any variations thereof, of the embodiments herein are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or (module) elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Reference herein to "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

References to "first \ second" herein are merely to distinguish between similar objects and do not denote a particular ordering with respect to the objects, it being understood that "first \ second" may, where permissible, be interchanged with a particular order or sequence. It should be understood that "first \ second" distinct objects may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced in sequences other than those illustrated or described herein.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. An abnormality detection method of a vehicle-mounted terminal includes:

identifying characters in the actual page image to obtain actual characters;

2. The method of claim 1, wherein the function button is a soft button; before the step of responding to the triggering operation of the function button of the vehicle-mounted terminal, the method further comprises the following steps:

3. The method of claim 2, further comprising:

4. The method according to any one of claims 1 to 3, characterized in that an actual appearance icon is included in the actual page image, an expected appearance icon is included in the expected page image, and the icon position of the expected appearance icon in the expected page image is matched with the icon position of the actual appearance icon in the actual page image; the method further comprises the following steps:

5. The method of claim 4, further comprising:

scanning the actual page image;

6. The method of claim 4, wherein the actual characters are plural, the desired page image having a corresponding plurality of desired characters; the method further comprises the following steps:

7. A method according to claim 2 or 3, wherein the soft buttons have corresponding desired references, being characters or pictures;

8. The method according to claim 2 or 3, wherein the step of performing a toggle operation on the soft button comprises:

acquiring a button icon of the soft button;

acquiring a button identifier of the hard button;

9. An abnormality detection device of a vehicle-mounted terminal, characterized by comprising:

10. An in-vehicle terminal comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method according to any one of claims 1 to 8 when executing the computer program.