CN113093981B - Method and equipment for generating long graphs of operation steps by screen recording of Android terminal - Google Patents
Method and equipment for generating long graphs of operation steps by screen recording of Android terminal Download PDFInfo
- Publication number
- CN113093981B CN113093981B CN202110507657.7A CN202110507657A CN113093981B CN 113093981 B CN113093981 B CN 113093981B CN 202110507657 A CN202110507657 A CN 202110507657A CN 113093981 B CN113093981 B CN 113093981B
- Authority
- CN
- China
- Prior art keywords
- touch
- message
- screen
- long
- screen recording
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/4448—Receiver circuitry for the reception of television signals according to analogue transmission standards for frame-grabbing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method and equipment for generating an operation step long graph by screen recording of an android terminal. The method overcomes the defects that touch operation is not obvious enough and files are overlarge in the screen recording demonstration operation step, the generation and the export of the long graph of the operation step are realized on the basis of the traditional screen recording, the implementation is simple, and the obtained long graph of the operation step is more convenient to communicate.
Description
Technical Field
The invention relates to the technical field of Android terminals, in particular to a method for generating long operation step graphs by screen recording of an Android terminal, a computer storage medium and the Android terminal.
Background
When using Android terminals (especially mobile phones and tablets), there is often a need to know how to enter a certain interface of a certain application, for example, a terminal client feeds back a problem of a certain third-party application to a terminal manufacturer, and the client sometimes only screens the problematic interface and then sends the screen shot to the manufacturer, and the manufacturer is not familiar with the third-party application and does not know how to obtain the interface. The manufacturer then requires the customer to provide a step in the operation to demonstrate how to access the interface.
In view of the above problems, the most used solution at present is to record a screen, but the screen recording cannot accurately demonstrate the touch operation of a finger of a user, because some interfaces perform a touch screen operation, the interfaces have no obvious change, such as button clicking, and if the click effect of the application button is not obvious enough, the operation steps cannot be quickly identified from a video obtained by the screen recording. And the video obtained by recording the screen is also relatively large and inconvenient to transmit information.
Disclosure of Invention
Aiming at the defects of the prior art, the invention aims to provide a method and equipment for generating a long picture of operation steps by screen recording of an Android terminal.
In order to achieve the purpose, the invention adopts the following technical scheme:
a method for generating long graphs of operation steps by screen recording of an Android terminal comprises the following specific processes:
a full-screen transparent touch message monitoring interface is realized in a System UI, the interface is a View which is positioned before any application after being opened, and the View is defined as TouchAptureView; the touchstartView is closed by default and is opened and closed synchronously with the screen recording, and only monitors the touch message of the touch screen after the touchscreen is opened, and does not intercept the touch message;
when the screen recording is started by clicking, the touchscapureView can be synchronously displayed and starts to count from 0, and meanwhile, the touchscapureView starts to monitor the touch information of the touch screen;
when the touch screen is operated in the screen recording process, the touchstartview identifies whether the touch operation is clicking or sliding when the up message is received each time by judging the change of the down, move and up values of the touch message (one down to one up is one touch operation), and stores the identified result and the corresponding timing time of the up to a touch information database; the table structure of the touch information database is (type, startX, startY, endX, endY, time), a data structure TouchInfo is defined to correspond to each item of data in the table, wherein the type is used for recording whether the touch operation is clicking or sliding, and the (startX, startY) is used for recording the position corresponding to the down message of the touch operation; (endX, endY) is used for recording the position corresponding to the up message of the touch operation, and the time is used for recording the timing time of the up message of the touch operation;
when the screen recording is finished by clicking, the screen recording saves the recorded video to a set position, and a dialog box is popped up by the TouchCaptureView before closing for a user to select whether to export the long picture of the operation step;
when the user selects to derive the long operation step chart, the touchscapureview combines the video obtained by screen recording and the touch information data in the screen recording process stored in the touch information database to obtain a final long operation step chart:
1) acquiring all touch information data stored in a touch information database in the screen recording process, and arranging the touch information data from small to large according to the timing time of the up message to obtain an array of touch info;
2) traversing each item of data in the array of the TouchInfo, analyzing a picture of a frame corresponding to the time of each item of data in the TouchInfo from a video recorded on a screen, and drawing an operation drawing on the picture of the corresponding frame according to the type of each item of data;
3) splicing the pictures of each frame obtained in the step 2) together according to the sequence of the timing time of the up message from small to large to obtain a long picture of the operation step;
4) exporting long images of the spliced operation steps and storing the long images to a set position;
5) touchscapureview closes and prompts the user to manipulate the step-long-picture save location.
Further, in the above method, the timing of touchscapureview is in units of 0.1 second.
Further, in the above method, a value of type of 1 indicates a click, and a value of 2 indicates a slide.
Further, in the above method, in step 2), if the type corresponds to a click, the operation prompt graph is a solid circle with (startX, startY) as a center; if the type corresponds to sliding, the operation prompt diagram is an arrow, and the arrow points to (endX, endY) from (startX, startY).
Further, in the method, in step 3), in the long drawing of the operation step, a gap is left between the previous drawing and the next drawing, and an arrow points to the next drawing from the previous drawing.
A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the above-mentioned method.
An Android terminal comprising a processor and a memory, the memory for storing a computer program; the processor is configured to implement the above method when executing the computer program.
The invention has the beneficial effects that: the method overcomes the defects that touch operation is not obvious enough and files are overlarge in the screen recording demonstration operation step, the generation and the export of the long graph of the operation step are realized on the basis of the traditional screen recording, the implementation is simple, and the obtained long graph of the operation step is more convenient to communicate.
Detailed Description
The present invention will be further described below, and it should be noted that the present embodiment is based on the technical solution, and a detailed implementation manner and a specific operation process are provided, but the protection scope of the present invention is not limited to the present embodiment.
The embodiment provides a method for generating a long graph of operation steps by screen recording of an Android terminal, which specifically comprises the following steps:
a full-screen transparent touch message monitoring interface is realized in a System UI, the interface is a View which is positioned before any application after being opened, and the View is defined as TouchAptureView; the touchstartView is closed by default and is opened and closed synchronously with the screen recording, and only monitors the touch message of the touch screen after the touchscreen is opened, and does not intercept the touch message;
when the screen recording is started, the touchscapureview is synchronously displayed and starts to count from 0, and the count is in units of 0.1 second, and simultaneously the touchscapureview starts to monitor the touch message of the touch screen.
When the touch screen is operated in the screen recording process, the touchscapureview identifies whether the touch operation is clicking or sliding each time when the up message is received by judging the changes of the down, move and up values of the touch message, and stores the identified result and the timing time (the timing time of the touchscapureview) corresponding to the up to the touch information database; the table structure of the touch information database is (type, startX, startY, endX, endY, time), and a data structure TouchInfo is defined to correspond to each item of data in the table, where the type is used to record whether the touch operation is a click or a slide, and in this embodiment, 1 represents a click and 2 represents a slide; (startX, startY) is configured to record a position corresponding to the down message of the touch operation; (endX, endY) is used for recording the position corresponding to the up message of the touch operation, and the time is used for recording the timing time (in 0.1 second, the timing time of touchscapureView) when the up message of the touch operation occurs.
When the screen recording is finished by clicking, the screen recording saves the recorded video to a set position, and a dialog box is popped up by the TouchCaptureView before closing for a user to select whether to export the long picture of the operation step;
when the user selects to derive the long operation step chart, the touchscapureview combines the video obtained by screen recording and the touch information data in the screen recording process stored in the touch information database to obtain a final long operation step chart:
1) acquiring all touch information data stored in a touch information database in the screen recording process, and arranging the touch information data from small to large according to the timing time of the up message to obtain an array of touch info;
2) traversing each item of data in the array of the TouchInfo, analyzing a picture of a frame corresponding to the time of each item of data in the TouchInfo from a video recorded on a screen, and drawing an operation prompt graph on the picture of the corresponding frame according to the type of each item of data, wherein if the type corresponds to a click, the operation prompt graph is a red solid circle with (startX, startY) as the center of the circle; if the type corresponds to sliding, the operation prompt is a red bold arrow, and the arrow points to (endX, endY) from (startX, startY).
3) Splicing the pictures of each frame obtained in the step 2) together according to the sequence from small to large of the timing time of the up message to obtain a long picture of the operation step. For aesthetic and intuitive reasons, a little gap is left between the previous drawing and the next drawing, and an arrow is drawn to point from the previous drawing to the next drawing.
4) And exporting the long images of the operation steps after splicing and storing the long images to a set position.
5) Touchscapureview closes and prompts the user to manipulate the step-long-picture save location.
Various corresponding changes and modifications can be made by those skilled in the art based on the above technical solutions and concepts, and all such changes and modifications should be included in the protection scope of the present invention.
Claims (7)
1. A method for generating long graphs of operation steps by screen recording of an Android terminal is characterized by comprising the following specific processes:
a full-screen transparent touch message monitoring interface is realized in a System UI, the interface is a View which is positioned before any application after being opened, and the View is defined as TouchAptureView; the touchstartView is closed by default and is opened and closed synchronously with the screen recording, and only monitors the touch message of the touch screen after the touchscreen is opened, and does not intercept the touch message;
when the screen recording is started by clicking, the touchscapureView can be synchronously displayed and starts to count from 0, and meanwhile, the touchscapureView starts to monitor the touch information of the touch screen;
when the touch screen is operated in the screen recording process, the touchstartView identifies whether the touch operation is clicking or sliding each time when the up message is received by judging the change of the down value, the move value and the up value of the touch message, and stores the identified result and the timing time corresponding to the up into a touch information database; the table structure of the touch information database is (type, startX, startY, endX, endY, time), a data structure TouchInfo is defined to correspond to each item of data in the table, wherein the type is used for recording whether the touch operation is clicking or sliding, and the (startX, startY) is used for recording the position corresponding to the down message of the touch operation; (endX, endY) is used for recording the position corresponding to the up message of the touch operation, and the time is used for recording the timing time of the up message of the touch operation;
when the screen recording is finished by clicking, the screen recording saves the recorded video to a set position, and a dialog box is popped up by the TouchCaptureView before closing for a user to select whether to export the long picture of the operation step;
when the user selects to derive the long operation step chart, the touchscapureview combines the video obtained by screen recording and the touch information data in the screen recording process stored in the touch information database to obtain a final long operation step chart:
1) acquiring all touch information data stored in a touch information database in the screen recording process, and arranging the touch information data from small to large according to the timing time of the up message to obtain an array of touch info;
2) traversing each item of data in the array of the TouchInfo, analyzing a picture of a frame corresponding to the time of each item of data in the TouchInfo from a video recorded on a screen, and drawing an operation drawing on the picture of the corresponding frame according to the type of each item of data;
3) splicing the pictures of each frame obtained in the step 2) together according to the sequence of the timing time of the up message from small to large to obtain a long picture of the operation step;
4) exporting long images of the spliced operation steps and storing the long images to a set position;
5) touchscapureview closes and prompts the user to manipulate the step-long-picture save location.
2. The method of claim 1, wherein the timing of touchscapureview is in units of 0.1 seconds.
3. The method of claim 1, wherein a type value of 1 indicates a click and a value of 2 indicates a swipe.
4. The method according to claim 1, wherein in step 2), if the type corresponds to a click, the operation prompt map is a solid circle with (startX, startY) as a center; if the type corresponds to sliding, the operation prompt diagram is an arrow, and the arrow points to (endX, endY) from (startX, startY).
5. The method according to claim 1, wherein in step 3), the operation step is performed in a long graph, a gap is left between the previous graph and the next graph, and an arrow points from the previous graph to the next graph.
6. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method of any one of claims 1 to 5.
7. An Android terminal, comprising a processor and a memory, the memory being configured to store a computer program; the processor is adapted to carry out the method of any one of claims 1 to 5 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110507657.7A CN113093981B (en) | 2021-05-10 | 2021-05-10 | Method and equipment for generating long graphs of operation steps by screen recording of Android terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110507657.7A CN113093981B (en) | 2021-05-10 | 2021-05-10 | Method and equipment for generating long graphs of operation steps by screen recording of Android terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113093981A CN113093981A (en) | 2021-07-09 |
| CN113093981B true CN113093981B (en) | 2022-03-29 |
Family
ID=76664866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110507657.7A Active CN113093981B (en) | 2021-05-10 | 2021-05-10 | Method and equipment for generating long graphs of operation steps by screen recording of Android terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113093981B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114845155B (en) * | 2022-03-10 | 2024-02-20 | 广州轻微课教育科技有限公司 | On-line video processing method and system for screen recording answering |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104866384A (en) * | 2014-02-20 | 2015-08-26 | 纬创资通股份有限公司 | Method and system for rapidly testing and detecting mobile device |
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
| CN109286718A (en) * | 2017-07-21 | 2019-01-29 | 珠海格力电器股份有限公司 | A kind of record screen method, apparatus and electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102511029A (en) * | 2010-06-18 | 2012-06-20 | 松下电器产业株式会社 | Operation support device and operation support method |
| KR102007749B1 (en) * | 2012-08-29 | 2019-08-06 | 삼성전자주식회사 | Screen recording method of terminal, apparauts thereof, and medium storing program source thereof |
| JP2014215788A (en) * | 2013-04-25 | 2014-11-17 | 株式会社リコー | Information processing system, information processing method, and program |
-
2021
- 2021-05-10 CN CN202110507657.7A patent/CN113093981B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104866384A (en) * | 2014-02-20 | 2015-08-26 | 纬创资通股份有限公司 | Method and system for rapidly testing and detecting mobile device |
| CN109286718A (en) * | 2017-07-21 | 2019-01-29 | 珠海格力电器股份有限公司 | A kind of record screen method, apparatus and electronic equipment |
| CN107870725A (en) * | 2017-11-30 | 2018-04-03 | 广东欧珀移动通信有限公司 | Record screen method, apparatus and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113093981A (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI509409B (en) | Methods and systems for viewing log data recorded during execution of a program | |
| US9317413B2 (en) | Testing device and testing method thereof | |
| CN106780685B (en) | A kind of generation method and terminal of dynamic picture | |
| CN110837474A (en) | Script recording method, device, terminal and storage medium | |
| TW201739263A (en) | Method and device for capturing video during playback | |
| CN105808233B (en) | Screen recording method and device | |
| US11941728B2 (en) | Previewing method and apparatus for effect application, and device, and storage medium | |
| CN113093981B (en) | Method and equipment for generating long graphs of operation steps by screen recording of Android terminal | |
| WO2020052062A1 (en) | Detection method and device | |
| CN114766093A (en) | Screen recording method and device and computer readable storage medium | |
| CN109669831A (en) | A kind of test method and electronic equipment | |
| CN110062287A (en) | Target object control method and device, storage medium, electronic equipment | |
| WO2024104113A1 (en) | Screen capture method, screen capture apparatus, electronic device, and readable storage medium | |
| CN112416751A (en) | Processing method and device for interface automation test and storage medium | |
| CN111399735B (en) | Screen capturing method, screen capturing device, electronic equipment and storage medium | |
| CN115543831A (en) | Test script generation method, device, equipment and storage medium | |
| CN113194279B (en) | Recording method of network conference, computer readable storage medium and electronic device | |
| CN111880602B (en) | Dropped frame detection method and device | |
| WO2021129416A1 (en) | Method and apparatus for controlling frame rate of mobile terminal, computer device and storage medium | |
| CN111258877B (en) | Method and device for detecting visible time of first screen page and electronic equipment | |
| CN107315554A (en) | A kind of method for displaying user interface and device | |
| CN113157186A (en) | Method and equipment for generating long graphs of operation steps by Android terminal | |
| CN114945104B (en) | Television software probability problem reproduction method and device and television | |
| CN110569184A (en) | test method and terminal equipment | |
| US20240094876A1 (en) | Screenshot method, electronic device, and computer program product thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |