CN111061601A - HMI (human machine interface) test simulation system for product - Google Patents
HMI (human machine interface) test simulation system for product Download PDFInfo
- Publication number
- CN111061601A CN111061601A CN201911305934.5A CN201911305934A CN111061601A CN 111061601 A CN111061601 A CN 111061601A CN 201911305934 A CN201911305934 A CN 201911305934A CN 111061601 A CN111061601 A CN 111061601A
- Authority
- CN
- China
- Prior art keywords
- upper computer
- test
- simulation
- product
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012360 testing method Methods 0.000 title claims abstract description 105
- 238000004088 simulation Methods 0.000 title claims abstract description 96
- 238000013515 script Methods 0.000 claims abstract description 30
- 238000004891 communication Methods 0.000 claims description 31
- 238000000034 method Methods 0.000 claims description 16
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 239000011159 matrix material Substances 0.000 claims description 3
- 238000012937 correction Methods 0.000 abstract description 2
- 238000003780 insertion Methods 0.000 abstract 1
- 230000037431 insertion Effects 0.000 abstract 1
- 239000000047 product Substances 0.000 description 60
- 238000013461 design Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 4
- 230000018109 developmental process Effects 0.000 description 4
- 230000032683 aging Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000012356 Product development Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000006227 byproduct Substances 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2273—Test methods
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a product HMI test simulation system, which comprises an equipment input event simulation system and a signal simulation device; the equipment input event simulation system comprises a terminal program and an upper computer which are installed on a product to be tested, wherein the upper computer simulates an input event on the product to be tested to automatically generate a test script, and then carries out artificial editing or signal insertion checking items; the terminal program receives an instruction sent by the upper computer, records an input event and transmits the input event back to the upper computer; the signal simulation device generates and sends a corresponding simulation signal to a tested product according to the received simulation instruction. The invention can realize unattended and automatic trusteeship test; the test error possibly generated during manual test is avoided, and the error correction work is reduced; the efficiency of test work that has improved. The invention can expand the type of the test to expand the breadth of the test service.
Description
Technical Field
The invention belongs to the technical field of product testing, and particularly relates to a product HMI (human machine interface) testing simulation system.
Background
Along with the market of passenger cars entering the high-speed and high-quality development period, various vehicle-mounted embedded devices focusing on 'intelligence + interactive experience' are also continuously released. The intelligent cockpit is one of concepts which are concerned by automobile manufacturers and users undoubtedly, and the intelligent cockpit is integrated with a vehicle-mounted information entertainment system, a full liquid crystal instrument, a rear seat entertainment system, a head-up display device, a remote control device and the like.
The HMI image function requirements on the automobile embedded equipment are more and more abundant, and a common industry pain point exists in the product development and test stage. Taking an in-vehicle infotainment system (also called "central control") as an example, in a supplier of a front-loading in-vehicle infotainment system of a passenger car in China or an OEM manufacturer, the following puzzles are commonly found by product developers:
-shorter SOP period
Due to the mode of design and development based on software and hardware platform products, the requirement on the online time of the vehicle-mounted information entertainment system products is more and more intense, and the overall development and test speed is correspondingly accelerated. In the process of continuously iterating and updating the product, the test work of the product becomes more complicated before the product is on the market, and the requirement on the test efficiency is improved along with the verification test work including a plurality of repeatability.
Increase in product testing investment
The test period is approximately half of the development period, the traditional HMI test method is a pure manual test, the test result and the manual record are judged by human eyes, and the efficiency is low. The camera is combined with the manipulator, which is a common means, but the process of inputting test cases is complicated, the manipulator takes time to execute actions, and the recording precision of the camera pictures is not high. The whole testing efficiency is improved by personnel investment, and the pressure in the aspect of cost is intensified.
Difficulty in ensuring product quality
The levels of the test personnel input are uneven; the product is matched with a plurality of automobile models, the complexity of the system is increased, and the difficulty of recurrent problem reproduction is increased; the characteristics of the system determine that the prior art cannot meet the requirements, and cannot simulate long-time operation to increase the aging speed and search risks, so that the product quality cannot be guaranteed to fall to a real place.
Difficulty of obtaining real vehicle environment
In the testing stage, the real vehicle resources are difficult to obtain, and the laboratory is required to simulate the real vehicle environment as much as possible so as to reduce the real vehicle resource occupation.
In addition, the laboratory environment also limits the period of exposure of some product problems, and the aging of a product system is required to be accelerated through tests as much as possible so as to search risks and avoid the risks in advance.
Disclosure of Invention
The invention aims to solve the technical problem of providing a product HMI test simulation system aiming at the defects of the prior art.
In order to achieve the technical purpose, the technical scheme adopted by the invention is as follows:
a product HMI test simulation system comprises an equipment input event simulation system and a signal simulation device;
the equipment input event simulation system comprises a terminal program and an upper computer which are installed on a product to be tested, and the product to be tested is provided with an operating system which realizes graphic display based on a Linux kernel;
the upper computer simulates an input event on a tested product to automatically generate a test script, and then manually edits or inserts a signal check item;
when the test script is executed, a test script instruction is sent to a tested product to be executed through a communication module of the terminal program, and meanwhile, a screen shot image of the terminal program is received and subjected to lattice comparison to confirm a test result;
the terminal program receives an instruction sent by an upper computer, records an input event and transmits the input event back to the upper computer, or receives an upper computer message, executes the input event instruction and intercepts a screen image instruction, transmits a screenshot image back to the upper computer, and performs image comparison with an expected reference image;
the signal simulation device generates and sends a corresponding simulation signal to a tested product according to the received simulation instruction.
In order to optimize the technical scheme, the specific measures adopted further comprise:
the signal simulation device comprises an automobile signal simulation device for automobile central control and instrument test, wherein the automobile signal simulation device provides an ON/OFF signal of an automobile battery power supply + B, an ON/OFF signal of an electric appliance power supply ACC of a part of an automobile, an ON/OFF signal of an ignition device IG, an ON/OFF signal of an electronic hand brake PKB, a reversing ON/OFF signal, a vehicle speed, an engine speed, a steering wheel key signal, a vehicle door sensor signal, a temperature sensor signal, a resistance value and a high-low level signal which are input to an automobile instrument in a simulation mode.
The terminal program comprises an input event monitoring module, a Framebuffer image frame data intercepting module and a Socket communication module with an upper computer;
the input event monitoring module monitors input events input by an input device, records the events in sequence and sends the recorded process data of the input events to the upper computer through the communication module of the upper computer;
the Framebuffer image frame data intercepting module utilizes Framebuffer to allow an application program to access image display hardware equipment through a specified interface, receives an instruction of an upper computer through the upper computer Socket communication module, acquires and intercepts required Framebuffer image frame data in real time, transmits the acquired Framebuffer image frame data to the upper computer through the upper computer Socket communication module, and verifies an input event simulation result.
The upper computer comprises a simulation instruction generation module, a comparison module and a Socket communication module with a terminal program;
the simulation instruction generation module is used for manually adding and deleting input event instructions; manually adding scripts to enable the HMI test simulation system of the product to simulate and send an input event instruction of manual addition and deletion through the signal simulation device control module; and manually adding a result checking instruction, namely requiring the screen capture of the tested product to be returned for the upper computer to carry out image result comparison;
the comparison module receives Framebuffer image frame data from a terminal program, and performs dot-matrix comparison on the Framebuffer image frame data and a preset image to generate a test report in an HTML form so as to achieve the aim of HMI test simulation;
and the Socket communication module of the terminal program sends an instruction of an input event in a test script, a simulation signal instruction generated by the signal simulation device and a result checking instruction to the terminal program and executes the simulation signal instruction and the result checking instruction on a tested product so as to simulate the input of input events such as screen touch, key pressing and the like and signals on the tested product.
The simulation instruction generation module is further configured to convert, for the screen resolution of the product to be tested, point coordinates of an upper left starting point of the relative screenshot on the upper computer into coordinates on the screen of the product to be tested, and to position the trigger input event.
In the simulation instruction generating module, a conversion formula for converting the point coordinates of the single-point touch event into the coordinates on the screen of the tested product is as follows:
X2＝(X1×Horizontal)÷Width；
Y2＝(Y1×Vertical)÷Height；
wherein, X2: corresponding to the x coordinate of the point on the screen of the tested product;
y2, corresponding to the Y coordinate of the point on the screen of the tested product;
x1: acquiring a point x coordinate relative to an upper left starting point of the screenshot on the upper computer system;
y1: acquiring a point y coordinate relative to an upper left starting point of the screenshot on the upper computer system;
horizontal: horizontal pixels of a product screen under test;
vertical: vertical pixels of a product screen under test;
width: displaying the width of the screenshot on the upper computer system;
height: and displaying the height of the screenshot on the upper computer system.
The invention has the following beneficial effects:
1. the invention has obvious high efficiency compared with the prior method for HMI related test of vehicle-mounted products. The invention can record the touch and key input events on the tested product and automatically generate the test script; through reasonable script design and adjustable multiple execution, unattended and automatic trusteeship testing is realized; the method has simple design, the compiling of the test script is very easy to operate, and the digitalized instruction input setting avoids the test error possibly generated during the manual test and reduces the work of deviation correction; the method of the invention provides test result confirmation and HTML form test report forms, can check the statistical result and display the screen shot of the Fail test item, and further improves the efficiency of test work.
2. The design method of the invention can expand the test types, namely, the signal device with various forms is externally connected, the signal instruction required by the test is input through the script according to the device interface definition, and the HMI simulation test of the product is assisted to expand the breadth of the test service.
Drawings
FIG. 1 is a schematic system configuration of the system of the present invention;
FIG. 2 is a block diagram of the system of the present invention;
FIG. 3 is a flow chart of the operation of the system of the present invention;
FIG. 4 is a flowchart illustrating a process of recording, editing, and confirming execution of the upper computer according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating the process of performing feedback by monitoring the terminal program according to the embodiment of the present invention.
Detailed Description
Embodiments of the present invention are described in further detail below with reference to the accompanying drawings.
Referring to fig. 1, the HMI test simulation system for a product of the present invention includes an equipment input event simulation system and a signal simulation apparatus;
in the embodiment, the signal simulation device comprises an automobile signal simulation device for automobile central control and instrument testing, the automobile signal simulation device can provide an ON/OFF signal of an automobile battery power supply + B, an ON/OFF signal of an electric appliance power supply ACC of a part of an automobile, an ON/OFF signal of an ignition device IG, an ON/OFF signal of an electronic hand brake PKB, a reversing ON/OFF signal, a vehicle speed, an engine speed, a steering wheel key signal, a vehicle door sensor signal, a temperature sensor signal, a resistance value and a high-low level signal which are input to an automobile instrument in a simulation mode, and the analog signals which need to be input are determined by a system of a product to be tested.
The equipment input event simulation system comprises a terminal program and an upper computer which are installed on a product to be tested, and the product to be tested is provided with an operating system which realizes graphic display based on a Linux kernel;
the upper computer simulates and receives an input event triggered by manual operation on a tested product, automatically generates a test script, and then manually edits or inserts an automobile signal inspection item;
when the test script is executed, a test script instruction is sent to a tested product to be executed through a communication module of the terminal program, and meanwhile, a screen shot image of the terminal program is received and subjected to lattice comparison to confirm a test result;
the terminal program receives an instruction sent by an upper computer, records an input event and transmits the input event back to the upper computer, or receives an upper computer message, executes the input event instruction and intercepts a screen image instruction, transmits a screenshot image back to the upper computer, and performs image comparison with an expected reference image;
the automobile signal simulation device generates and sends corresponding simulation pulse, voltage and resistance signals to a tested product according to the received pulse, voltage and resistance simulation instructions.
In the embodiment, the terminal program mainly receives an input event instruction in a test script of the upper computer and a signal sent by the signal simulation device through a communication module of the upper computer, executes the input event instruction on a tested product, and sends the input event type on the tested product and compressed data of an abstract Framebuffer image frame of a display frame buffer area to the upper computer.
The terminal program comprises an input event monitoring module, a Framebuffer image frame data intercepting module and a Socket communication module with an upper computer;
the input event monitoring module monitors input events input manually through a touch screen, a key input device and the like, records the events in sequence and sends the recorded process data of the input events to the upper computer through the communication module of the upper computer;
the Framebuffer image frame data intercepting module utilizes Framebuffer to allow an application program to access image display hardware equipment through a specified interface without concerning the technical characteristics of bottom hardware details, receives an instruction of an upper computer through the Socket communication module of the upper computer, acquires and intercepts required Framebuffer image frame data in real time, transmits the Framebuffer image frame data to the upper computer through the Socket communication module of the upper computer, and verifies an input event simulation result.
In the embodiment, after receiving input event process data, the upper computer completes the recording of the manual input event, and can also add, delete and modify the input event through a simulation instruction generation module of the input event such as single-point and multi-point touch, convert the coordinates of the input event added by the upper computer according to the screen resolution of the tested product, and then transmit the coordinates back to the tested product according to the settable speed to perform the playing so as to complete the simulation of the input event process.
The upper computer comprises a simulation instruction generation module, a comparison module and a Socket communication module with a terminal program;
the simulation instruction generation module is used for manual editing, namely adding and deleting input event instructions; manually adding scripts to enable the HMI test simulation system of the product to simulate and send an input event instruction of manual addition and deletion through the signal simulation device control module; and manually adding a result checking instruction, namely requiring the screen capture of the tested product to be returned for the upper computer to carry out image result comparison;
the comparison module receives Framebuffer image frame data from a terminal program, and performs dot-matrix comparison on the Framebuffer image frame data and a preset image to generate a test report in an HTML form so as to achieve the aim of HMI test simulation;
and the Socket communication module of the terminal program sends an instruction of an input event in a test script, a simulation signal instruction generated by the signal simulation device and a result checking instruction to the terminal program and executes the simulation signal instruction and the result checking instruction on a tested product so as to simulate the input events such as screen touch, key pressing and the like on the tested product and the input of automobile signals.
In an embodiment, the simulation instruction generating module may convert a point coordinate of an upper left starting point of a relative screenshot on the upper computer into a coordinate on a screen of the product to be tested, for positioning a trigger input event, and may adapt to a variety of product screens, according to a screen resolution of the product to be tested.
In an embodiment, in the simulation instruction generating module, a conversion formula for converting a point coordinate of a single-point touch event into a coordinate on a screen of a tested product is as follows:
X2＝(X1×Horizontal)÷Width；
Y2＝(Y1×Vertical)÷Height；
wherein, X2: corresponding to the x coordinate of the point on the screen of the tested product;
y2, corresponding to the Y coordinate of the point on the screen of the tested product;
x1: acquiring a point x coordinate relative to an upper left starting point of the screenshot on the upper computer system;
y1: acquiring a point y coordinate relative to an upper left starting point of the screenshot on the upper computer system;
horizontal: horizontal pixels of a product screen under test;
vertical: vertical pixels of a product screen under test;
width: displaying the width of the screenshot on the upper computer system;
height: and displaying the height of the screenshot on the upper computer system.
Referring to fig. 3, the workflow of the system of the present invention includes the following steps:
step 1: the user selects a certain connected device as a recording terminal on the upper computer, clicks a recording button in an upper computer program, starts a recording mode, and informs the terminal program through a Socket communication module with the terminal program;
step 2: after receiving an upper computer instruction through a Socket communication module of an upper computer, a terminal program enters a monitoring mode and starts to monitor an input event of an input device of a system layer on the device;
and step 3: a series of operations of a user on input equipment on a terminal are sent to an upper computer one by one through a Socket communication module of the upper computer;
and 4, step 4: the upper computer converts the operation into simulation instructions one by one through a simulation instruction generating module, namely each automatic test script, and converts the coordinates on the screen of the tested product into point coordinates of a left upper starting point of a relative screen capture on the upper computer according to the screen resolution of the tested product, so that a user can conveniently check and modify the point coordinates;
and 5: the user can edit and modify the recorded test script in a self-defined way on the upper computer, such as inserting other input simulation instructions, inserting operation instructions of the automobile signal simulator and inserting inspection items to confirm the test result, and then storing the test items;
step 6: the user can select a test set or a certain test item, select the test execution speed and the execution times, and sequentially execute the automatic test scripts;
and 7: the simulation instruction generation module of the upper computer generates simulation instructions such as pulses, voltages, resistors and the like, and sends the simulation instructions to the automobile signal simulation device through serial port communication, so that the automobile signal simulation device generates corresponding signals such as pulses, voltages, resistors and the like and inputs the signals to the tested object;
and 8: after receiving each instruction of the upper computer, the terminal program executes the instruction;
and step 9: the terminal program transmits Framebuffer image frame data to be checked back to the upper computer;
step 10: after receiving Framebuffer image frame data, the upper computer performs lattice comparison with a preset image, and only compares one or more selected areas or only compares images outside one or more selected areas according to the setting of the test script;
step 11: and the upper computer generates a test report in an HTML form according to the image comparison result for a user to check.
Referring to fig. 4, the recording, editing, executing and confirming process of the upper computer includes the following steps:
step 1: clicking a recording button on the upper computer picture to start recording;
step 2: the upper computer receives operation instructions of terminal programs one by one through a communication module with a terminal Socket;
and step 3: the upper computer analyzes the received instruction, converts the operation coordinate according to the screen resolution of the tested object and the screenshot position on the upper computer, and displays the operation coordinate on an upper computer program for a user to check or modify;
and 4, step 4: a user edits, inserts and deletes a test script on an interface and operates a tested object;
and 5: analyzing the user operation through a simulation instruction generation module to generate an automatic test script;
step 6: the user operation interface selects the test item, the execution speed and the execution times and clicks the execution test button;
and 7: and the upper computer executes all the test scripts in the selected test project in sequence until the last test script is obtained. Generating an executable operation instruction of the tested object through a simulation instruction generating module;
and 8: the method comprises the steps that operation instructions are sent to a tested object one by one through a Socket communication module of a terminal, or the operation instructions are sent to an automobile signal simulator through serial port communication to generate signals which are input to the tested object;
and step 9: the upper computer receives the returned screenshot of the terminal program in real time;
step 10: after receiving Framebuffer image frame data, the upper computer performs lattice comparison with a preset image, and only compares one or more selected areas or only compares images outside one or more selected areas according to the setting of the test script;
step 11: and the upper computer generates a test report in an HTML form according to the image comparison result for a user to check.
Referring to fig. 5, the terminal program listening execution feedback process includes the following steps:
step 1: the terminal program receives a recording instruction of an upper computer through a communication module and starts to monitor an input event on the equipment;
step 2: the input instructions are forwarded to an upper computer one by one;
and step 3: the terminal keeps being connected with the upper computer through a heartbeat program, and after instruction execution information of the upper computer is received, the received lower instructions are executed one by one until the last instruction is reached;
and 4, step 4: performing Framebuffer image frame screen capture operation;
and 5: and transmitting the Framebuffer image frame data back to the upper computer through the upper computer Socket communication module.
The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above-mentioned embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may be made by those skilled in the art without departing from the principle of the invention.
Claims (6)
1. A product HMI test simulation system is characterized by comprising an equipment input event simulation system and a signal simulation device;
the equipment input event simulation system comprises a terminal program and an upper computer which are installed on a product to be tested, and the product to be tested is provided with an operating system which realizes graphic display based on a Linux kernel;
the upper computer simulates an input event on a tested product to automatically generate a test script, and then manually edits or inserts a signal check item;
when the test script is executed, a test script instruction is sent to a tested product to be executed through a communication module of the terminal program, and meanwhile, a screen shot image of the terminal program is received and subjected to lattice comparison to confirm a test result;
the terminal program receives an instruction sent by an upper computer, records an input event and transmits the input event back to the upper computer, or receives an upper computer message, executes the input event instruction and intercepts a screen image instruction, transmits a screenshot image back to the upper computer, and performs image comparison with an expected reference image;
the signal simulation device generates and sends a corresponding simulation signal to a tested product according to the received simulation instruction.
2. The HMI product test simulation system of claim 1, wherein the signal simulation device comprises a vehicle signal simulation device facing vehicle central control and instrument test, and the vehicle signal simulation device provides ON/OFF signals of a vehicle battery power supply + B, ON/OFF signals of a vehicle part electric appliance power supply ACC, ON/OFF signals of an ignition device IG, ON/OFF signals of an electronic hand brake PKB, reverse ON/OFF signals, vehicle speed, engine speed, steering wheel key signals, door sensor signals, temperature sensor signals, resistance values and high and low level signals input to a vehicle instrument in a simulation mode.
3. The HMI test simulation system of claim 1, wherein the terminal program comprises an input event monitoring module, a Framebuffer image frame data intercepting module and a Socket communication module with an upper computer;
the input event monitoring module monitors input events input by an input device, records the events in sequence and sends the recorded process data of the input events to the upper computer through the communication module of the upper computer;
the Framebuffer image frame data intercepting module utilizes Framebuffer to allow an application program to access image display hardware equipment through a specified interface, receives an instruction of an upper computer through the upper computer Socket communication module, acquires and intercepts required Framebuffer image frame data in real time, transmits the acquired Framebuffer image frame data to the upper computer through the upper computer Socket communication module, and verifies an input event simulation result.
4. The HMI test simulation system of claim 1, wherein the upper computer comprises a simulation instruction generation module, a comparison module and a Socket communication module with a terminal program;
the simulation instruction generation module is used for manually adding and deleting input event instructions; manually adding scripts to enable the HMI test simulation system of the product to simulate and send an input event instruction of manual addition and deletion through the signal simulation device control module; and manually adding a result checking instruction, namely requiring the screen capture of the tested product to be returned for the upper computer to carry out image result comparison;
the comparison module receives Framebuffer image frame data from a terminal program, and performs dot-matrix comparison on the Framebuffer image frame data and a preset image to generate a test report in an HTML form so as to achieve the aim of HMI test simulation;
and the Socket communication module of the terminal program sends an instruction of an input event in a test script, a simulation signal instruction generated by the signal simulation device and a result checking instruction to the terminal program and executes the simulation signal instruction and the result checking instruction on a tested product so as to simulate the input of input events such as screen touch, key pressing and the like and signals on the tested product.
5. The HMI test simulation system of claim 1, wherein the simulation instruction generation module is further configured to convert, for the screen resolution of the product under test, the point coordinates of the top left starting point of the relative screen shot on the upper computer into coordinates on the screen of the product under test for locating the trigger input event.
6. The HMI test simulation system for a product according to claim 1, wherein in the simulation instruction generation module, a conversion formula for converting point coordinates of a single-point touch event into coordinates on a screen of a product under test is as follows:
X2＝(X1×Horizontal)÷Width；
Y2＝(Y1×Vertical)÷Height；
wherein, X2: corresponding to the x coordinate of the point on the screen of the tested product;
y2, corresponding to the Y coordinate of the point on the screen of the tested product;
x1: acquiring a point x coordinate relative to an upper left starting point of the screenshot on the upper computer system;
y1: acquiring a point y coordinate relative to an upper left starting point of the screenshot on the upper computer system;
horizontal: horizontal pixels of a product screen under test;
vertical: vertical pixels of a product screen under test;
width: displaying the width of the screenshot on the upper computer system;
height: and displaying the height of the screenshot on the upper computer system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911305934.5A CN111061601B (en) | 2019-12-18 | 2019-12-18 | Product HMI test simulation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911305934.5A CN111061601B (en) | 2019-12-18 | 2019-12-18 | Product HMI test simulation system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111061601A true CN111061601A (en) | 2020-04-24 |
| CN111061601B CN111061601B (en) | 2023-11-17 |
Family
ID=70302070
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911305934.5A Active CN111061601B (en) | 2019-12-18 | 2019-12-18 | Product HMI test simulation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111061601B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112685299A (en) * | 2020-12-25 | 2021-04-20 | 广东乐心医疗电子股份有限公司 | Automatic test method, device, electronic equipment and readable storage medium |
| CN113884121A (en) * | 2021-08-27 | 2022-01-04 | 惠州市德赛西威汽车电子股份有限公司 | Semi-automatic point inspection method for man-machine interaction interface of vehicle-mounted instrument |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103901307A (en) * | 2014-04-22 | 2014-07-02 | 上海扬梓投资管理有限公司 | Testing system and method applied to vehicle-mounted multimedia device |
| US20140303756A1 (en) * | 2013-04-05 | 2014-10-09 | Stephan A. Tarnutzer | Human-Machine Interface Test System |
| CN105843734A (en) * | 2016-03-18 | 2016-08-10 | 厦门美图移动科技有限公司 | Automatic test method and device and computing device |
-
2019
- 2019-12-18 CN CN201911305934.5A patent/CN111061601B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140303756A1 (en) * | 2013-04-05 | 2014-10-09 | Stephan A. Tarnutzer | Human-Machine Interface Test System |
| CN103901307A (en) * | 2014-04-22 | 2014-07-02 | 上海扬梓投资管理有限公司 | Testing system and method applied to vehicle-mounted multimedia device |
| CN105843734A (en) * | 2016-03-18 | 2016-08-10 | 厦门美图移动科技有限公司 | Automatic test method and device and computing device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112685299A (en) * | 2020-12-25 | 2021-04-20 | 广东乐心医疗电子股份有限公司 | Automatic test method, device, electronic equipment and readable storage medium |
| CN112685299B (en) * | 2020-12-25 | 2024-05-17 | 广东乐心医疗电子股份有限公司 | Automatic test method, device, electronic equipment and readable storage medium |
| CN113884121A (en) * | 2021-08-27 | 2022-01-04 | 惠州市德赛西威汽车电子股份有限公司 | Semi-automatic point inspection method for man-machine interaction interface of vehicle-mounted instrument |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111061601B (en) | 2023-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105808432B (en) | Rail traffic Traction Drive control unit software automated testing system and method | |
| US11216358B2 (en) | Video game testing and automation framework | |
| CN106776294B (en) | Automatic android mobile phone testing method and system | |
| KR101118602B1 (en) | Method and system for gui testing with scene-driven scenario | |
| CN111061601B (en) | Product HMI test simulation system | |
| CN110830791B (en) | Automatic testing method, device and system for software function of television complete machine | |
| US20170322637A1 (en) | Mouse action capture and replay system and method, recording medium, and program product | |
| CA2963254C (en) | Contextual monitoring perspective selection during training session | |
| EP3278322A1 (en) | Method and system for customizing a recorded real time simulation based on simulation metadata | |
| CN108132724A (en) | A kind of touch screen debugs detection method and device | |
| CN106598865B (en) | Software testing method and device | |
| CN114115200A (en) | NVH (noise, vibration and harshness) testing system and NVH testing method for electric automobile electric drive assembly | |
| US20160357890A1 (en) | Verification Log Analysis | |
| US11398162B2 (en) | Contextual monitoring perspective selection during training session | |
| CN207337401U (en) | A kind of automobile cabin human-computer interaction assessment system | |
| CN109581104A (en) | A kind of vehicle entertainment system testing touch screen method | |
| CN111737141A (en) | Black box automatic testing system and method combined with deep learning technology | |
| CN115856482A (en) | MP 5-based 360-panorama abnormal working condition automatic testing method | |
| CN114936358A (en) | Human-computer interaction based verification method and verification system | |
| CN113495844B (en) | Automatic testing method, device and system based on virtual click and storage medium | |
| CN102063553B (en) | Method for analog simulation development of automobile OBD (On-Board Diagnostics) code reading card | |
| CN114036044A (en) | Openvr development drive-based debugging method | |
| CN113642172A (en) | Simulation operation method and system for micro-assembly process | |
| CN106682249B (en) | Model-independent universal publish/subscribe interface test system and method | |
| CN107422847A (en) | A kind of method and system of remote testing virtual role acceleration magnitude |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |