CN110703948A - Touch screen operation recording and broadcasting system and method - Google Patents
Touch screen operation recording and broadcasting system and method Download PDFInfo
- Publication number
- CN110703948A CN110703948A CN201910954677.1A CN201910954677A CN110703948A CN 110703948 A CN110703948 A CN 110703948A CN 201910954677 A CN201910954677 A CN 201910954677A CN 110703948 A CN110703948 A CN 110703948A
- Authority
- CN
- China
- Prior art keywords
- module
- recording
- touch screen
- data
- broadcasting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A touch screen operation recording and broadcasting system and a method thereof are provided, wherein the touch screen operation recording and broadcasting system comprises a touch screen access module, a master control access module, a recording and broadcasting module and a storage module; the touch screen access module is connected with the touch screen; the master control access module is connected with the master controller; the recording and broadcasting module is connected with the touch screen access module and the master control access module, and the storage module is connected with the recording and broadcasting module; in a recording state, in a communication process between the touch screen and the main controller, the recording and broadcasting module captures data sent by the touch screen to the main controller as recording data and stores the recording data in the storage module; in a playing state, the recording and playing module acquires the stored recording data from the storage module and sends the recording data to the master control access module, so that the master control access module outputs the recording data to the master controller.
Description
Technical Field
The application relates to the technical field of automatic testing of intelligent equipment, in particular to a touch screen operation recording and broadcasting system and method.
Background
With the rise of intelligent devices, such as mobile phones, watches, tablet computers, and the like, touch screens gradually replace input devices such as keyboards and the like to become the main human-computer interaction interfaces of the intelligent devices. In the processes of main controller development, software development and equipment development of intelligent equipment, various pressure tests need to be performed, wherein a specified operation path needs to be input through a touch screen, and the stability and reliability of the main controller under various scenes need to be tested by detecting the response of the main controller equipment.
There are currently three ways to perform touch screen operations: manual operation, namely, operating the touch screen by a tester through fingers to execute repeated tests; the manual operation is simulated through a manipulator, a touch head is arranged on the manipulator, and the touch head replaces a finger to perform touch operation; a test program is installed in the tested device, and then an external controller is communicated with the test program to control the tested device to execute various actions so as to replace the input of the touch screen.
However, the above three current touch screen operation methods all have their limitations: when manual testing is adopted, the attention of a tester cannot be concentrated for a long time depending on manual operation, and the consistency of the testing cannot be ensured when the touch screen is operated according to a planned path for a long time; moreover, the manual work cannot be uninterrupted, for example, the operation is uninterrupted for 24 hours every day in 7 days; meanwhile, manual testing cannot adapt to different scenes and environments, for example, manual testing cannot be performed in a high-temperature environment of 65 ℃. When the manipulator simulates the manual operation of a human, the manipulator can only execute simple point and sliding operation because the manipulator can not be as flexible as fingers, and can not be used for complicated operations such as double light points, drawing, pressing, light point sliding, rotating and the like; meanwhile, the size of the manipulator is too large, so that the manipulator cannot be suitable for equipment testing in a small high-low temperature box. When a test program is installed in the tested device, the built-in test program needs to communicate with an external controller, occupies the calculation and storage capacity of the tested device, and is an intrusive test influencing the performance of the tested device, so that the built-in test program is not an ideal test method. The non-invasive test refers to operating the system under test completely according to various operations of the system under test in a use scene. The intrusive test is a test mode which is carried out by implanting a test program into a tested system (intelligent equipment such as a mobile phone, a watch and the like) and controlling the behavior of the tested system through command interaction between an external controller and the test program,
in summary, the touch screen operation methods in the prior art cannot provide a method capable of efficiently and accurately copying the touch input of the touch screen without affecting the device under test.
Disclosure of Invention
The technical problem solved by the application is how to efficiently and accurately copy the touch input of the touch screen on the basis of not influencing the tested equipment.
In order to solve the technical problem, an embodiment of the present application provides a touch screen operation recording and broadcasting system, where the system includes a touch screen access module, a master control access module, a recording and broadcasting module, and a storage module; the touch screen access module is connected with the touch screen; the master control access module is connected with the master controller; the recording and broadcasting module is connected with the touch screen access module and the master control access module, and the storage module is connected with the recording and broadcasting module; in a recording state, in a communication process between the touch screen and the main controller, the recording and broadcasting module captures data sent by the touch screen to the main controller as recording data and stores the recording data in the storage module; in a playing state, the recording and playing module acquires the stored recording data from the storage module and sends the recording data to the master control access module, so that the master control access module outputs the recording data to the master controller.
Optionally, the system further includes a clock module, and the clock module is connected to the recording and playing module;
in a recording state, the clock module starts timing, when the touch screen sends data to the main controller, the recording and broadcasting module acquires timing time of the clock module, generates a timestamp, and stores the timestamp and the captured recording data into the storage module; when the system is switched to a playing state, the clock module starts to time, and when the time reaches the time stamp, the clock module controls the recording and playing module to output the recording data corresponding to the time stamp to the main controller.
Optionally, the touch screen sends an interrupt signal to the main controller, where the interrupt signal is used to indicate the start of communication; in the recording state, if the recording and broadcasting module captures the interrupt signal, the timing time of the clock module is acquired, and the timestamp is generated.
Optionally, the touch screen includes a register unit, where the register unit is configured to store touch point operation data converted according to a received input operation; if the recording and broadcasting module captures the interrupt signal, acquiring the timing time of the clock module, and generating the timestamp, wherein the steps comprise: if the recording and broadcasting module captures the interrupt signal, the contact operation data is obtained from the register unit, the current contact is judged to be valid according to the contact operation data, if the current contact is valid, the timing time of the clock module is obtained, the timestamp is generated, the data sent to the main controller by the touch screen is captured as recording data, and the timestamp and the recording data are correspondingly stored in the storage module.
Optionally, the system further includes an instruction receiving module, where the instruction receiving module is connected to the recording and broadcasting module; the instruction receiving module is used for receiving an input recording instruction or playing instruction; when the instruction receiving module receives an input recording instruction, the touch screen operation recording and broadcasting system is switched to a recording state; when the instruction receiving module receives an input playing instruction, the touch screen operates the recording and playing system to be switched to a playing state.
Optionally, the instruction receiving module is further connected to the storage module, and the instruction receiving module is configured to receive a reset instruction; when the reset instruction is received, the instruction receiving module deletes the touch operation data stored in the storage module.
Optionally, the system further includes a terminal access module, where the terminal access module is connected to the instruction receiving module; the system is connected with the terminal through the terminal access module and receives the instruction sent by the terminal to control the instruction receiving module.
Optionally, the recording and playing module is implemented by an FPGA.
The application also provides a touch screen operation recording and broadcasting method, which comprises the following steps: connecting a main controller to a main control access module; if the touch screen is in the playing state, the stored recording data is obtained from the storage module, and the recording data is obtained by the recording module in the recording state and is sent to the main controller by the touch screen according to the input contact operation; and sending the recorded data to the master control access module so that the master control access module outputs the recorded data to the master controller.
Optionally, before the obtaining the stored recording data from the storage module, the method further includes: connecting the touch screen to a touch screen access module; if the current recording state is reached, capturing data which is generated by the touch screen according to input contact operation and sent to the main controller in the communication process of the touch screen and the main controller as recording data; and storing the recorded data to the storage module.
Compared with the prior art, the technical scheme of the embodiment of the application has the following beneficial effects:
the embodiment of the application provides a touch screen operation recording and broadcasting system, which comprises a touch screen access module, a master control access module, a recording and broadcasting module and a storage module; the touch screen access module is connected with the touch screen; the master control access module is connected with the master controller; the recording and broadcasting module is connected with the touch screen access module and the master control access module, and the storage module is connected with the recording and broadcasting module; in a recording state, in a communication process between the touch screen and the main controller, the recording and broadcasting module captures data sent by the touch screen to the main controller as recording data and stores the recording data in the storage module; in a playing state, the recording and playing module acquires the stored recording data from the storage module and sends the recording data to the master control access module, so that the master control access module outputs the recording data to the master controller. Compared with the prior art, the touch screen operation recording and broadcasting system stores the data sent to the main controller by the touch screen according to the operation of the user as the recording data when the user operates the touch screen. After the recording is finished, the recorded data can be played, the action of the user for operating the touch screen can be restored intact, and the action of the user for operating the touch screen can be restored repeatedly by playing the recorded data repeatedly. Therefore, under the condition of not invading equipment, the touch input of the touch screen can be efficiently and accurately copied for multiple times, the touch screen is replaced to repeatedly communicate with the main controller, and the response of the main controller is detected to test the stability and reliability of the main controller under various scenes.
Furthermore, the touch screen operation recording and broadcasting system records the time of sending data to the main controller by the touch screen in a recording state, the communication process of the touch screen and the main controller and the time of sending data to the main controller by the touch screen through the clock module; and in the playing state, timing is performed again through the clock module, so that the recording and playing module sends the recorded data to the main controller according to the time when the touch screen sends the data to the main controller during recording, and the communication process between the touch screen and the main controller is restored according to the clock sequence.
Furthermore, when the recording and broadcasting module catches the touch screen and sends an interrupt signal to the main controller, one-time communication is represented to start, and the recording and broadcasting module generates a corresponding timestamp to indicate the time of the communication. And the recording and broadcasting module identifies when the touch screen and the main controller start to communicate and all communication times in a recording state according to an interrupt signal sent by the touch screen to the main controller.
Furthermore, the touch screen operation recording and playing system provides an instruction receiving module, and a user or equipment can issue various instructions such as recording, playing instructions and resetting instructions to the instruction receiving module, so that the operations of switching the states of the recording and playing states, deleting the recording data stored in the storage module and the like are realized.
Furthermore, the terminal can be connected with the touch screen operation recording and broadcasting system through the terminal access module, an operation instruction is issued to the touch screen operation recording and broadcasting system, a technician can write a script on the terminal, the instruction is automatically issued to the touch screen operation recording and broadcasting system, and automatic testing is achieved.
Furthermore, the application also provides a touch screen operation recording and broadcasting system for realizing the function of the recording and broadcasting module by the FPGA, and the touch screen operation recording and broadcasting system is small in hardware, can execute complex touch screen operation in various scenes and various environments, and completely simulates the operation of the tested equipment in the actual working state.
Drawings
Fig. 1 is a schematic structural diagram of a touch screen operation recording and playing system according to an embodiment of the present application;
fig. 2 is a flowchart illustrating an operation of the recording module in a recording state according to an embodiment of the present application;
fig. 3 is a flowchart illustrating an operation of the recording and playing module in the playing state according to an embodiment of the present application;
fig. 4 is a schematic application diagram of a touch screen operation recording and playing system according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a touch screen operation recording and broadcasting system designed based on an FPGA according to an embodiment of the present application;
fig. 6 is a schematic flowchart of a method for recording and playing a touch screen operation according to an embodiment of the present application.
Detailed Description
As background art, the existing three current touch screen operation methods cannot efficiently and accurately copy the touch input of the touch screen without affecting the device under test.
In order to solve the technical problem, an embodiment of the present application provides a touch screen operation recording and broadcasting system, where the system includes a touch screen access module, a master control access module, a recording and broadcasting module, and a storage module; the touch screen access module is connected with the touch screen; the master control access module is connected with the master controller; the recording and broadcasting module is connected with the touch screen access module and the master control access module, and the storage module is connected with the recording and broadcasting module; in a recording state, in a communication process between the touch screen and the main controller, the recording and broadcasting module captures data sent by the touch screen to the main controller as recording data and stores the recording data in the storage module; in a playing state, the recording and playing module acquires the stored recording data from the storage module and sends the recording data to the master control access module, so that the master control access module outputs the recording data to the master controller.
By adopting the scheme of the embodiment, the problems of the three schemes in the prior art can be solved, and the touch input of the touch screen can be efficiently and accurately copied on the basis of not influencing the tested equipment.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, embodiments accompanying the present application are described in detail below with reference to the accompanying drawings.
Referring to fig. 1, fig. 1 provides a schematic structural diagram of a touch screen operation recording and playing system; the system comprises a touch screen access module 10, a master control access module 11, a recording and broadcasting module 12 and a storage module 13; the touch screen access module 10 is connected with the touch screen; the master control access module 11 is connected with a master controller; the recording and broadcasting module 12 is connected with the touch screen access module 10 and the master control access module 11, and the storage module 13 is connected with the recording and broadcasting module 12.
The touch screen access module 10 is a terminal used for accessing a touch screen in a touch screen operating system, and may be a bus access terminal designed according to IIC or SPI, or other types of access terminals designed according to a connection mode between the touch screen and a main controller. The main control access module 11 is a terminal for accessing a main controller in the touch screen operating system, and the terminal design corresponds to the touch screen access module 11.
In a recording state, in a communication process between the touch screen and the main controller, the recording and playing module 12 captures data sent by the touch screen to the main controller as recording data, and stores the recording data in the storage module 13.
The touch screen adopts a set of transparent absolute coordinate positioning system, can be positioned according to received hand motions, and avoids repeated positioning; the touch screen can detect gesture operations of a user including flicking, tapping, double tapping, zooming-in, pressing, tapping sliding, rotating and the like. The touch screen is preferably transparent, and the transparent characteristic of the touch screen can be realized through material technology.
When a user operates the touch screen, the touch screen generates data communicated to the main controller according to information such as the number of triggered contacts on the touch screen operated by the user, the position of each contact on the touch screen, gestures operated by the user and the like, and sends the data to the main controller through the bus. The number of the contacts can be 0, 1 or more, and when the number of the contacts is 0, the touch screen is not in contact at the moment; the position of each touch point on the touch screen is a set of absolute coordinates determined from the absolute coordinate system of the touch screen.
Specifically, in the recording state, the touch screen is connected to the touch screen access module 10, the main controller is connected to the main control access module 11, and the touch screen is in normal communication with the main controller. The user can operate on the touch screen to be used as the input of the touch screen, the touch screen converts received operation into communication data and transmits the communication data to the main controller, and therefore the user can communicate with the main controller. The recording module 12 captures the data of this communication as recording data and stores it in the storage module 13.
In a playing state, the recording and playing module 12 obtains the stored recording data from the storage module 13, and sends the recording data to the main control access module 11, so that the main control access module 11 outputs the recording data to the main controller.
Specifically, the recording and playing module 12 takes out the recorded data stored in the storage module 13, sends the recorded data to the main controller, and restores the communication process between the touch screen and the main controller in the recording state. In the playing state, the touch screen does not need to participate in the communication process, and the touch screen does not need to be connected to the touch screen access module 10.
Optionally, a capacitive touch screen is adopted in the current mobile phone, tablet computer and other terminals, the capacitive touch screen is connected with a main controller through an Integrated Circuit bus (IIC, Inter-Integrated Circuit which is a Serial communication bus) or a Serial bus (a bus technology implemented by a Serial Peripheral Interface (SPI), and when the touch screen is the touch screen of the mobile phone or the tablet computer, the main controller is a back plate of the mobile phone or the tablet computer; the main controller is a master device, the touch screen is a slave device, and the touched effective data is transmitted on buses such as an IIC bus or an SPI bus. In particular, the recording and playing module 12 may include a bus, a data capture module, and a data playing module. The touch screen access module 10 and the master control access module 11 can access the bus and communicate through the bus. The data capturing module can capture data on the bus in a recording state, that is, data sent by the touch screen to the main controller, and store the data in the storage module 13. In the playing state, the data playing module obtains the stored recording data from the storage module 13 and sends the data to the main controller through the bus.
In the above embodiment, the touch screen operation recording and playing system records the data communicated between the touch screen and the main controller as the recorded data for storage when the user operates the touch screen. After the recording is finished, the recorded data can be played, the action of the user for operating the touch screen can be restored intact, and the action of the user for operating the touch screen can be restored repeatedly by playing the recorded data repeatedly. Therefore, under the condition of not invading equipment, the touch input of the touch screen can be efficiently and accurately copied for multiple times, the touch screen is replaced to repeatedly communicate with the main controller, and the response of the main controller is detected to test the stability and reliability of the main controller under various scenes.
In one embodiment, the touch screen operation recording and broadcasting system in fig. 1 may further include a clock module, and the clock module is connected to the recording and broadcasting module 12. In a recording state, the clock module starts timing, when the touch screen sends data to the main controller, the recording and broadcasting module 12 acquires the timing time of the clock module, generates a timestamp, and stores the timestamp and the captured recording data into the storage module; when the system is switched to a playing state, the clock module starts to time, and when the time reaches the time stamp, the clock module controls the recording and playing module 12 to output the recorded data corresponding to the time stamp to the main controller.
In the embodiment, the touch screen operation recording and broadcasting system records the time of sending data to the main controller by the touch screen in a recording state, in the communication process of the touch screen and the main controller through the clock module; and in the playing state, timing is performed again through the clock module, so that the recording and playing module sends corresponding recorded data to the main controller according to the time when the touch screen sends data to the main controller during recording, and the communication process between the touch screen and the main controller is restored according to the clock sequence.
In one embodiment, the touch screen sends an interrupt signal to the master controller, wherein the interrupt signal is used for indicating the start of communication; in the recording state, if the recording and broadcasting module captures the interrupt signal, the timing time of the clock module is acquired, and the timestamp is generated.
When the recording and broadcasting module catches the touch screen and sends an interrupt signal to the main controller, one-time communication is represented to start, and the recording and broadcasting module generates a corresponding timestamp to indicate the time of the one-time communication. And the recording and broadcasting module identifies when the touch screen and the main controller start to communicate and all communication times in a recording state according to an interrupt signal sent by the touch screen to the main controller.
In one embodiment, the touch screen comprises a register unit for storing touch point operation data converted according to a received input operation; if the recording and broadcasting module captures the interrupt signal, acquiring the timing time of the clock module, and generating the timestamp, wherein the steps comprise: if the recording and broadcasting module captures the interrupt signal, the contact operation data is obtained from the register unit, the current contact is judged to be valid according to the contact operation data, if the current contact is valid, the timing time of the clock module is obtained, the timestamp is generated, the data sent to the main controller by the touch screen is captured as recording data, and the timestamp and the recording data are correspondingly stored in the storage module.
The touch screen converts the input operation of a user into touch operation data after receiving the input operation, the touch operation data is cached in the register unit, and in the communication process with the main controller, the touch screen acquires the touch operation data for communication from the register unit and sends the touch operation data to the main controller.
In the recording state, if the recording and broadcasting module captures an interrupt signal, whether the touch screen receives effective contact input needs to be verified, and if the touch screen receives effective contact input, communication data on a bus is acquired for recording; if the touch screen does not receive a valid touch input, no recording is required.
In this embodiment, a process of detecting the input of the recording and broadcasting module to the effective contact of the touch screen in the recording state is added, so that the recording and broadcasting module is ensured to record effective communication data, and the communication process between the touch screen and the main controller is restored more accurately.
Optionally, referring to fig. 2, fig. 2 provides a flowchart of an operation of the recording module in a recording state; when the touch screen consists of an upper input screen, an identification unit and a register unit, the identification unit is respectively connected with the input screen and the register unit, and the sending unit is connected with the register unit; the input screen receives input touch operation; the identification unit acquires the touch operation received on the input screen, converts the touch operation into the touch operation data, and stores the touch operation data into the register unit; the recording and broadcasting module is connected to a bus for communicating the touch screen with the main controller, and captures data sent by the touch screen to the bus in the communication process of the touch screen and the main controller, and the operation of the recording and broadcasting module specifically comprises the following steps:
step S200, the recording and playing module receives a recording start instruction. The touch screen operates the recording and broadcasting system to enter a recording state, and the recording and broadcasting module starts recording; in addition, when the recording and broadcasting module receives a recording starting instruction, the clock module starts timing.
Step S201, when detecting that the touch screen sends an interrupt signal to the main controller, reading the first three bytes of the register unit.
When the recording and broadcasting module catches the touch screen and sends an interrupt signal to the main controller, the recording and broadcasting module represents that one-time communication starts, and first three bytes in a register unit of the touch screen are read by the recording and broadcasting module. The register unit of the touch screen is used for caching touch operation data in primary communication, the first three bytes represent a working mode, a gesture and the number of contacts, and after the primary communication is finished, the register unit clears the cached touch operation data.
Step S202, according to the byte representing the number of the contact points, detecting whether the number of the contact points is 0. If the number of the contacts is 0, the contacts are not input on the touch screen this time, namely the touch screen does not receive effective contact input, the data acquisition operation is not executed, the step S201 is skipped to, and the touch screen is waited to send a next interrupt signal to the main controller; if the number of the contacts is not 0, the touch screen receives an effective contact input, and the step S203 is continuously executed.
Step S203, acquiring the timing time of the clock module, generating a timestamp, and taking the data sent to the main controller by the touch screen in the current interrupt signal on the slave bus as recording data.
When the recording and broadcasting module confirms that the effective contact is received, the timing time of the clock module at the moment is obtained, and a timestamp representing the communication at the time is generated; and simultaneously, data sent to the main controller by the touch screen is acquired from the bus to be used as recording data.
And step S204, when the communication is detected to be finished, correspondingly storing the time stamp and the recorded data into a storage module.
And when the recording and broadcasting module detects that the communication on the bus is finished, the recording and broadcasting module indicates that the communication is finished, correspondingly stores the timestamp and the acquired recording data into the storage module, and continues to wait for the next communication, namely, captures the touch screen from the bus again and sends an interrupt signal to the main controller.
Step S205, when the recording module receives the instruction to end recording, the recording is ended.
With continued reference to fig. 3, fig. 3 provides a flow chart of the operation of the recording and playing module in the playing state; the operation of the recording and playing module may specifically include the following steps:
in step S300, an instruction to start playing is received. When the recording and broadcasting module receives a playing start instruction, the touch screen operates the recording and broadcasting system to enter a playing state, and the recording and broadcasting module starts playing. In addition, when the recording and broadcasting module receives a broadcasting start instruction, the clock module starts to time.
Step S301, the recording and playing module takes out a group of recorded data and the corresponding time stamp from the storage module.
Step S302, acquiring the timing time of the clock module, and sending an interrupt signal to the main controller when the timing time is equal to the timestamp. In the playing state, the recording and playing module needs to replace the touch screen to communicate with the main controller, the recording and playing module sends an interrupt signal to the main controller, and when the timing time of the clock module is equal to the time stamp of the recorded data, the recording and playing module sends the interrupt signal to inform the main controller of the start of the communication.
Step S303, when the start of bus communication is detected, transmits the recorded data to the main controller. If the bus can start communication, the recording and broadcasting module sends the recorded data to the main controller as the current communication data to complete the current communication with the main controller.
And step S304, after the recording and broadcasting module finishes one-time communication, continuously acquiring the next group of recorded data and the corresponding time stamp from the storage module, and repeating the steps S301 to S303 until the recording and broadcasting module receives a recording finishing instruction or the recording and broadcasting module traverses all the recorded data in the storage module, and the broadcasting is finished.
In one embodiment, the touch screen operation recording and broadcasting system further comprises an instruction receiving module, wherein the instruction receiving module is connected with the recording and broadcasting module; the instruction receiving module is used for receiving an input recording instruction or playing instruction; when the instruction receiving module receives an input recording instruction, the touch screen operation recording and broadcasting system is switched to a recording state; when the instruction receiving module receives an input playing instruction, the touch screen operates the recording and playing system to be switched to a playing state. Specifically, the instruction receiving module is used for receiving an instruction input by a user or sent to the touch screen operation recording and playing system by other equipment. The command can be a recording command for switching the system to a recording state and a playing command for switching the touch screen to a playing state. The instruction receiving module can be realized by a physical key or a virtual key.
In this embodiment, the touch screen operation recording and playing system provides an instruction receiving module, and a user or a device can issue a recording or playing instruction to the instruction receiving module to realize state switching between the recording state and the playing state.
In one embodiment, the instruction receiving module is further connected to the storage module, and the instruction receiving module is configured to receive a reset instruction; when the reset instruction is received, the instruction receiving module deletes the touch operation data stored in the storage module.
Specifically, the user or other device may also issue a reset instruction to the instruction receiving module to delete the touch operation data stored in the storage module.
In one embodiment, the touch screen operation recording and broadcasting system further includes a terminal access module, and the terminal access module is connected with the instruction receiving module; the system is connected with the terminal through the terminal access module and receives the instruction sent by the terminal to control the instruction receiving module.
The terminal can be a mobile phone, a computer, a server and other terminal equipment, the touch screen operation recording and broadcasting system provides a terminal access module so as to enable the system to be connected to the terminal, and the terminal issues the recording instruction, the playing instruction, the resetting instruction and other instructions to the touch screen operation recording and broadcasting system.
In this embodiment, the terminal can be connected with the touch screen operation recording and broadcasting system through the terminal access module, and an operation instruction is issued to the touch screen operation recording and broadcasting system, so that a technician can write a script on the terminal, and automatically issue an instruction to the touch screen operation recording and broadcasting system, thereby realizing automatic testing.
Referring to fig. 4, fig. 4 is a schematic application diagram of a touch screen operation recording and playing system; in the using process, the touch screen 40 and the main controller 42 are respectively connected to the touch screen operation recording and broadcasting system 41, in the recording state, the touch screen 40 and the main controller 42 normally communicate, and the touch screen operation recording and broadcasting system 41 captures the recording data sent to the main controller 42 by the touch screen 40 in the communication process and stores the data; in the playing state, the touch screen operation recording system 41 replaces the touch screen 40 to communicate with the main controller 42, and the communication process between the touch screen 40 and the main controller 42 in the recording state is restored. The touch screen operation recording and broadcasting system 41 can also be connected with the terminal 43, and receives an instruction issued by the terminal 43 to execute a corresponding operation.
In an embodiment, the recording and playing module in the touch screen operation recording and playing system may be implemented by an FPGA (field programmable Gate Array, which is a semiconductor device formed by a Configurable Logic Block (CLB) matrix connected by a programmable interconnect). Referring to fig. 5, fig. 5 provides a schematic structural diagram of a touch screen operation recording and playing system designed based on an FPGA. The FPGA51 realizes the functions of the recording and broadcasting module, and the touch screen access module 10 and the main control access module 11 are interfaces connected with the FPGA51 and corresponding to the touch screen or the main control.
The storage module 13 is connected to the FPGA51 and configured to store recorded data, and may be implemented by a storage device such as a storage card (e.g., a T card), and if the storage card is used, the storage card may be connected to the FPGA51 through a card socket (e.g., a T card socket).
The terminal access module 52 is connected to the FPGA51 and is used for connecting with a terminal device, and the implementation device is determined by the connection mode between the FPGA51 and the terminal. For example, when the FPGA51 is to be USB connected to a computer, the terminal access module 52 may be a USB controller (e.g., CYUSB 3014).
The clock module is a module for providing a clock function for the FPGA and can be realized by adopting a timer or a clock source; the power supply module is a device for supplying electric energy for the operation of the FPGA and can be a power supply interface, when the power supply interface is connected to a power supply, the power supply can be supplied for the FPGA, and the clock and the power supply can be realized through one clock and power supply module.
Optionally, the FPGA51 may also be connected to an intermediate data storage module 54 for storing intermediate data during recording and playing; the function of this intermediate data storage module 54 may be implemented by a register (DDR 2).
In this embodiment, a touch screen operation recording and broadcasting system is provided, in which an FPGA implements a function of a recording and broadcasting module, and the touch screen operation recording and broadcasting system is small in hardware, and can perform complex touch screen operations in various scenes and various environments, thereby completely simulating operations of a device under test in an actual working state.
The present application further provides a method for recording and broadcasting touch screen operations, please refer to fig. 6, where fig. 6 provides a schematic flow diagram of the method for recording and broadcasting touch screen operations, and the method specifically includes the following steps:
step S600, connecting the main controller to the main control access module.
Step S601, if the current state is in the play state, obtaining the stored recording data from the storage module, where the recording data is obtained by the recording and playing module in the record state, and the data is sent to the main controller by the touch screen according to the input touch operation.
Step S602, sending the recorded data to the master access module, so that the master access module outputs the recorded data to the master controller.
In an embodiment, before acquiring the stored recording data from the storage module in step S601 in fig. 6, the method may further include: connecting the touch screen to a touch screen access module; if the current recording state is reached, capturing data which is generated by the touch screen according to input contact operation and sent to the main controller in the communication process of the touch screen and the main controller as recording data; and storing the recorded data to the storage module.
For more contents of the working principle and the working mode of the touch screen operation recording and broadcasting method, reference may be made to the related descriptions in fig. 1 to fig. 5, which are not repeated herein.
Although the present application is disclosed above, the present application is not limited thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present disclosure, and it is intended that the scope of the present disclosure be defined by the appended claims.
Claims (10)
1. A touch screen operation recording and broadcasting system is characterized by comprising a touch screen access module, a master control access module, a recording and broadcasting module and a storage module;
the touch screen access module is connected with the touch screen;
the master control access module is connected with the master controller;
the recording and broadcasting module is connected with the touch screen access module and the master control access module, and the storage module is connected with the recording and broadcasting module;
in a recording state, in a communication process between the touch screen and the main controller, the recording and broadcasting module captures data sent by the touch screen to the main controller as recording data and stores the recording data in the storage module;
in a playing state, the recording and playing module acquires the stored recording data from the storage module and sends the recording data to the master control access module, so that the master control access module outputs the recording data to the master controller.
2. The system of claim 1, further comprising a clock module, said clock module being coupled to said recording module;
in a recording state, the clock module starts timing, when the touch screen sends data to the main controller, the recording and broadcasting module acquires timing time of the clock module, generates a timestamp, and stores the timestamp and the captured recording data into the storage module;
when the system is switched to a playing state, the clock module starts to time, and when the time reaches the time stamp, the clock module controls the recording and playing module to output the recording data corresponding to the time stamp to the main controller.
3. The system of claim 2, wherein the touch screen sends an interrupt signal to the master controller, the interrupt signal indicating a start of communication; in the recording state, if the recording and broadcasting module captures the interrupt signal, the timing time of the clock module is acquired, and the timestamp is generated.
4. The system according to claim 3, wherein the touch screen includes a registering unit for storing contact operation data converted according to the received input operation;
if the recording and broadcasting module captures the interrupt signal, acquiring the timing time of the clock module, and generating the timestamp, wherein the steps comprise:
if the recording and broadcasting module captures the interrupt signal, the contact operation data is obtained from the register unit, the current contact is judged to be valid according to the contact operation data, if the current contact is valid, the timing time of the clock module is obtained, the timestamp is generated, the data sent to the main controller by the touch screen is captured as recording data, and the timestamp and the recording data are correspondingly stored in the storage module.
5. The system of claim 1, further comprising an instruction receiving module, wherein the instruction receiving module is connected to the recording module;
the instruction receiving module is used for receiving an input recording instruction or playing instruction;
when the instruction receiving module receives an input recording instruction, the touch screen operation recording and broadcasting system is switched to a recording state;
when the instruction receiving module receives an input playing instruction, the touch screen operates the recording and playing system to be switched to a playing state.
6. The system of claim 5, wherein the instruction receiving module is further connected to the storage module, and the instruction receiving module is configured to receive a reset instruction;
when the reset instruction is received, the instruction receiving module deletes the touch operation data stored in the storage module.
7. The system according to claim 5 or 6, characterized in that the system further comprises a terminal access module, wherein the terminal access module is connected with the instruction receiving module;
the system is connected with the terminal through the terminal access module and receives the instruction sent by the terminal to control the instruction receiving module.
8. The system of claim 1, wherein the recording module is implemented by an FPGA.
9. A method for recording and broadcasting touch screen operations is characterized by comprising the following steps:
connecting a main controller to a main control access module;
if the touch screen is in the playing state, the stored recording data is obtained from the storage module, and the recording data is obtained by the recording module in the recording state and is sent to the main controller by the touch screen according to the input contact operation;
and sending the recorded data to the master control access module so that the master control access module outputs the recorded data to the master controller.
10. The method of claim 9, wherein prior to retrieving the stored recording data from the storage module, further comprising:
connecting the touch screen to a touch screen access module;
if the current recording state is reached, capturing data which is generated by the touch screen according to input contact operation and sent to the main controller in the communication process of the touch screen and the main controller as recording data;
and storing the recorded data to the storage module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910954677.1A CN110703948B (en) | 2019-10-09 | 2019-10-09 | Touch screen operation recording and broadcasting system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910954677.1A CN110703948B (en) | 2019-10-09 | 2019-10-09 | Touch screen operation recording and broadcasting system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110703948A true CN110703948A (en) | 2020-01-17 |
| CN110703948B CN110703948B (en) | 2022-09-27 |
Family
ID=69198938
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910954677.1A Active CN110703948B (en) | 2019-10-09 | 2019-10-09 | Touch screen operation recording and broadcasting system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110703948B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111708474A (en) * | 2020-05-26 | 2020-09-25 | 广州朗国电子科技有限公司 | Method and device for simulating user touch operation, storage medium and all-in-one machine equipment |
| CN115686334A (en) * | 2022-10-31 | 2023-02-03 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609385A (en) * | 2009-07-17 | 2009-12-23 | 中兴通讯股份有限公司南京分公司 | A kind of method and system of utilizing a plurality of resistive touch screens to realize the multiple spot input |
| CN102881307A (en) * | 2012-09-05 | 2013-01-16 | 北京得力天方信息科技有限公司 | Video and audio recording and playing system and method |
| CN103853383A (en) * | 2014-03-05 | 2014-06-11 | 中南大学 | Method of realizing touch screen driver in Uboot (Universal Bootloader Loader) |
| CN105468094A (en) * | 2014-09-10 | 2016-04-06 | 中兴通讯股份有限公司 | Method for operating computer terminal and computer terminal |
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
-
2019
- 2019-10-09 CN CN201910954677.1A patent/CN110703948B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101609385A (en) * | 2009-07-17 | 2009-12-23 | 中兴通讯股份有限公司南京分公司 | A kind of method and system of utilizing a plurality of resistive touch screens to realize the multiple spot input |
| CN102881307A (en) * | 2012-09-05 | 2013-01-16 | 北京得力天方信息科技有限公司 | Video and audio recording and playing system and method |
| CN103853383A (en) * | 2014-03-05 | 2014-06-11 | 中南大学 | Method of realizing touch screen driver in Uboot (Universal Bootloader Loader) |
| CN105468094A (en) * | 2014-09-10 | 2016-04-06 | 中兴通讯股份有限公司 | Method for operating computer terminal and computer terminal |
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111708474A (en) * | 2020-05-26 | 2020-09-25 | 广州朗国电子科技有限公司 | Method and device for simulating user touch operation, storage medium and all-in-one machine equipment |
| CN115686334A (en) * | 2022-10-31 | 2023-02-03 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
| CN115686334B (en) * | 2022-10-31 | 2023-11-28 | 荣耀终端有限公司 | Operation control method, electronic device and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110703948B (en) | 2022-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107707792B (en) | Camera module, terminal equipment and shooting control method | |
| US8275599B2 (en) | Embedded bus emulation | |
| US9710105B2 (en) | Touchscreen testing | |
| CN110703948B (en) | Touch screen operation recording and broadcasting system and method | |
| TW201518933A (en) | Testing device and testing method thereof | |
| CN104575342A (en) | Integral liquid crystal module testing device | |
| CN103744763A (en) | Mobile terminal synchronous control method of PC (personal computer) end in automated testing | |
| CN110955631A (en) | File access tracking method and device, storage medium and terminal | |
| US20140354310A1 (en) | Capacitive Sensor Testing | |
| CN104202637A (en) | Key remote control and target dragging method | |
| CN215599311U (en) | Chip testing device | |
| CN112685299A (en) | Automatic test method, device, electronic equipment and readable storage medium | |
| TWI420318B (en) | A non-intrusive general-purpose common busbar switching device | |
| CN102645978B (en) | Can simulating keyboard output signal analogue means | |
| CN103544079B (en) | Flash memory chip data recovery achieving system and method based on programmable logic controller | |
| CN110554939A (en) | method, system and terminal for debugging embedded equipment | |
| JP5204343B1 (en) | Test system and program | |
| CN107025058B (en) | Information writing method and device of mobile terminal and mobile terminal | |
| US20180203556A1 (en) | Display control system, display control method, and display device | |
| CN110888656B (en) | Multifunctional programming device and programming method | |
| CN101777323B (en) | Method for computer system to set monitor and relevant computer system | |
| WO2023035466A1 (en) | Information marking system | |
| CN114461479A (en) | Method and device for debugging multimedia processing chip, storage medium and electronic equipment | |
| CN107481595B (en) | FPGA experiment board debugging system | |
| CN108628714B (en) | Test method and system of mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |