CN110908584B - Playback display control method and device for screen recording data - Google Patents

Playback display control method and device for screen recording data Download PDF

Info

Publication number
CN110908584B
CN110908584B CN201911205216.0A CN201911205216A CN110908584B CN 110908584 B CN110908584 B CN 110908584B CN 201911205216 A CN201911205216 A CN 201911205216A CN 110908584 B CN110908584 B CN 110908584B
Authority
CN
China
Prior art keywords
touch
information
touch operation
operation information
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911205216.0A
Other languages
Chinese (zh)
Other versions
CN110908584A (en
Inventor
许泽臣
刘勇成
袁思思
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Netease Hangzhou Network Co Ltd
Original Assignee
Netease Hangzhou Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netease Hangzhou Network Co Ltd filed Critical Netease Hangzhou Network Co Ltd
Priority to CN201911205216.0A priority Critical patent/CN110908584B/en
Publication of CN110908584A publication Critical patent/CN110908584A/en
Application granted granted Critical
Publication of CN110908584B publication Critical patent/CN110908584B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • G06F3/04855Interaction with scrollbars
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486Drag-and-drop

Abstract

The disclosure provides a playback display control method and device for screen recording data; wherein, the method comprises the following steps: playing video information of the screen recording data in a first area of a graphical user interface; determining operation information under the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of touch operation and event information corresponding to the touch operation; and displaying the operation information in a target area of the graphical user interface. According to the embodiment, in the process of replaying the screen recording data, the detailed process of the touch operation in the screen recording process can be better shown, and richer operation information of the touch operation is shown to a user.

Description

Playback display control method and device for screen recording data
Technical Field
The disclosure relates to the technical field of video processing, in particular to a playback display control method and device for screen recording data.
Background
In an existing playback display control scheme for screen recording data, when the playing progress of video information reaches a corresponding moment, a touch position of touch operation is displayed in a form of a small dot at a corresponding position in the video information. However, the above playback display control scheme of screen recording data may have disadvantages: the specific touch operation process in the screen recording process cannot be well demonstrated.
Disclosure of Invention
In view of this, the embodiments of the present disclosure at least provide a playback display control method and apparatus for screen recording data, which can display more abundant operation information of touch operations to a user.
In a first aspect, an embodiment of the present disclosure provides a playback display control method for screen recording data, including:
playing video information of the screen recording data in a first area of a graphical user interface;
determining operation information under the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of touch operation and event information corresponding to the touch operation;
and displaying the operation information in a target area of the graphical user interface.
In an alternative embodiment, the target area is a second area;
the second region and the first region are different display regions of the graphical user interface.
In an alternative embodiment, the target area comprises at least a partial area of the first area; the same and/or different operation information is displayed in the first area and the target area, and under the condition that the same operation information is displayed in the first area and the target area, the same operation information has different information display forms in the first area and the target area.
In an optional implementation manner, before determining the operation information at the play progress according to the play progress of the video information, the method further includes:
in response to an operation information screening instruction, screening at least one target operation information type from a plurality of operation information types;
the determining the operation information under the playing progress according to the playing progress of the video information includes:
and determining the operation information corresponding to the target operation information type at the playing progress according to the playing progress of the video information.
In an optional implementation, the touch type includes: one or more of click operation, long press operation, drag operation, re-press operation and continuous click operation.
In an alternative embodiment, the event information includes at least one of: the control triggered by the touch operation, the function realized by the touch operation and the result achieved by the touch operation.
In an optional implementation, the operation information further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
In an optional implementation manner, for a case that the operation information includes a number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
aiming at the condition that the operation information type comprises touch operation strength, the touch operation strength comprises: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
In an alternative embodiment, the displaying the operation information in the target area of the graphical user interface includes:
and displaying the operation information in the target area in one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a stacking chart and a sector chart.
In a second aspect, an embodiment of the present disclosure further provides a playback display control apparatus for screen recording data, including:
the first display module is used for playing video information of the screen recording data in a first area of a graphical user interface;
the determining module is used for determining operation information under the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of touch operation and event information corresponding to the touch operation;
and the second display module is used for displaying the operation information in a target area of the graphical user interface.
In an alternative embodiment, the target area is a second area;
the second region and the first region are different display regions of the graphical user interface.
In an alternative embodiment, the target region comprises at least a partial region of the first region; the same and/or different operation information is displayed in the first area and the target area, and under the condition that the same operation information is displayed in the first area and the target area, the same operation information has different information display forms in the first area and the target area.
In an optional embodiment, the method further comprises: the screening module is used for responding to the operation information screening instruction and screening at least one target operation information type from a plurality of operation information types;
the determining module is used for determining the operation information corresponding to the target operation information type in the playing progress according to the playing progress of the video information.
In an optional implementation manner, the touch type includes: one or more of click operation, long press operation, drag operation, re-press operation and continuous click operation.
In an alternative embodiment, the event information includes at least one of: the control triggered by the touch operation, the function realized by the touch operation and the result achieved by the touch operation.
In an optional implementation manner, the operation information further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
In an optional implementation manner, for a case that the operation information includes a number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
aiming at the condition that the operation information type comprises touch operation strength, the touch operation strength comprises: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
In an optional embodiment, the second display module, when displaying the operation information in the target area of the graphical user interface, is configured to:
and displaying the operation information in the target area in one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a stacking chart and a sector chart.
In a third aspect, an embodiment of the present disclosure further provides a computer device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the computer device is running, the machine-readable instructions when executed by the processor performing the steps of the first aspect described above, or any possible implementation of the first aspect.
In a fourth aspect, this disclosed embodiment also provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps in the first aspect or any one of the possible implementation manners of the first aspect.
According to the method and the device for displaying the touch operation, the video information of the screen recording data is played in the first area of the graphical user interface, the operation information under the corresponding playing progress is determined according to the playing progress of the video information, the operation information at least comprises the touch type of the touch operation and the event information corresponding to the touch operation, and therefore when the operation information is displayed in the target area of the graphical user interface, the detailed process of the touch operation in the screen recording process can be better displayed, and richer operation information of the touch operation is displayed to a user.
In order to make the aforementioned objects, features and advantages of the present disclosure more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
To more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present disclosure and therefore should not be considered as limiting the scope, and those skilled in the art will be able to derive other related drawings based on these drawings without inventive effort.
Fig. 1 is a flowchart illustrating a playback display control method for screen recording data according to an embodiment of the present disclosure;
fig. 2 shows a specific example of positions of a first area and a second area in a playback display control method of screen recording data provided by an embodiment of the present disclosure;
fig. 3 shows a specific example of operation information displayed in a first area and a second area in the playback display control method of screen recording data provided in the embodiment of the present disclosure;
fig. 4 is a schematic diagram illustrating a playback apparatus for video information provided by an embodiment of the present disclosure;
fig. 5 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described clearly and completely with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, not all of the embodiments. The components of the embodiments of the present disclosure, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
Research shows that in the existing playback display control scheme of screen recording data, when the playing progress of video information reaches corresponding time, the touch position of touch operation is displayed in the form of a small dot at the corresponding position in the video information. However, the above playback display control scheme of screen recording data may have disadvantages: specific touch operation processes in the screen recording process cannot be well shown, for example, in some learning, analyzing and testing scenes aiming at the screen recording data, targeted information cannot be obtained through playback of the screen recording data.
Based on the research, the present disclosure provides a playback display control method and device for screen recording data, in an embodiment of the present disclosure, video information of the screen recording data is played in a first area of a graphical user interface, and operation information at a corresponding playing progress is determined according to the playing progress of the video information, where the operation information at least includes a touch type of a touch operation and event information corresponding to the touch operation, so that when the operation information is displayed in a target area of the graphical user interface, a detailed process of the touch operation in a screen recording process can be better displayed, and richer operation information of the touch operation is displayed to a user.
The above-mentioned drawbacks are the results of the inventor after practical and careful study, and therefore, the discovery process of the above-mentioned problems and the solutions proposed by the present disclosure to the above-mentioned problems should be the contribution of the inventor in the process of the present disclosure.
The technical solutions in the present disclosure will be described clearly and completely with reference to the accompanying drawings in the present disclosure, and it is to be understood that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. The components of the present disclosure, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, presented in the figures, is not intended to limit the scope of the claimed disclosure, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the disclosure without making creative efforts, shall fall within the protection scope of the disclosure.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
To facilitate understanding of the present embodiment, first, a detailed description is given of a playback display control method for screen recording data disclosed in an embodiment of the present disclosure, where an execution subject of the playback display control method for screen recording data provided in an embodiment of the present disclosure is generally a computer device with certain computing power, and the computer device includes, for example: a terminal device, which may be a User Equipment (UE), a mobile device, a User terminal, a cellular phone, a cordless phone, a Personal Digital Assistant (PDA), a handheld device, a computing device, a vehicle mounted device, a wearable device, or a server or other processing device. In some possible implementations, the playback display control method of screen recording data can be implemented by a processor calling computer readable instructions stored in a memory.
The playback display control method of screen recording data provided by the embodiment of the present disclosure is described with an execution subject as an example.
Referring to fig. 1, a flowchart of a playback display control method for screen recording data provided in the embodiment of the present disclosure is shown, where the method includes steps S101 to S103, where:
s101: playing video information of the screen recording data in a first area of a graphical user interface;
s102: determining operation information under the playing progress according to the playing progress of the video information;
s103: and displaying the operation information in a target area of the graphical user interface.
The following describes each of the above-mentioned steps S101 to S103 in detail.
I: in S101, the first area on the gui may be a partial area in the gui.
The terminal equipment can respond to a screen recording data playing control instruction triggered by a user and play video information of screen recording data in a first area of a graphical user interface.
II: in the above S102, the operation information at least includes a touch type of the touch operation and event information corresponding to the touch operation.
In another embodiment, the operation information further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
Specifically, in the generation process of the screen recording data, the original operation information corresponding to each touch operation is recorded.
The original operation information includes, for example: the touch control type of each touch control operation, the event information corresponding to each touch control operation, the operation track of each touch control operation, the starting position of each touch control operation, the ending position of each touch control operation, the starting time of each touch control operation, the ending time of each touch control operation and the pressing force degree of each touch control operation.
And the operation information to be displayed in the target area may include:
the original operation information of each touch operation, and/or the operation information obtained based on each touch operation, such as the total number of all touch operations, the number of operations of each type of touch operation, and the like.
When the operation information is displayed, all the displayable operation information can be displayed, and part of the operation information can be screened from all the displayable operation information and displayed in the pastoral area according to the needs of the user.
In a case where a part of the operation information is filtered from all the operation information that can be displayed and displayed in the target area according to a user' S need, in another embodiment, before S102, the method further includes:
and screening at least one target operation information type from the plurality of operation information types in response to the operation information screening instruction.
Here, the operation information type is type information corresponding to different operation information.
Then S102 may be: and determining the operation information corresponding to the target operation information type at the playing progress according to the playing progress of the video information.
Specifically, the method comprises the following steps:
a: for the case that the operation information includes the number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
here, the number of touch operations includes, but is not limited to, one or more of the following a 1-a 5:
the total click number a1 is the total number of times that the user performs a click operation on the touch terminal. The click operation means that when a user performs touch operation on the touch terminal, the displacement of the touch point is smaller than a preset displacement threshold, and the duration of the touch operation is smaller than a preset touch operation time threshold.
In the case that the operation information includes the total number of clicks, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
and screening the click operations from all the touch operations according to the initial position, the end position, the initial time and the end time of each touch operation, and generating operation information according to the screened number of the click operations.
a2 total dragging times refers to the total dragging times of the touch terminal by the user. The dragging operation refers to that when a user performs touch operation on the touch terminal, the displacement of the touch point is larger than a preset displacement threshold value.
In the case that the operation information includes the total number of times of dragging, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
and screening the dragging operations from all the touch operations according to the initial position and the end position of each touch operation, and generating operation information according to the screened quantity of the dragging operations.
a3 total long press times is the total times of long press operations performed by the user on the touch terminal. The long-press operation means that when a user performs a touch operation on the touch terminal, the duration of the touch operation is longer than a preset touch operation time threshold, and the displacement of a touch point is smaller than a preset position threshold.
In the case where the operation information includes the total number of times of pressing, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
screening long press operation from all touch operation according to the operation track of each touch operation; and/or screening long press operation from all touch operation according to the initial position, the end position, the initial time and the end time of each touch operation; and generating operation information based on the screened number of long press operations.
The total number of times of pressing of the a4 is the total number of times of pressing operations performed by the user for the touch terminal. The re-pressing operation refers to that when a user performs touch operation on the touch terminal, the pressing force of the touch operation is greater than a preset pressing force threshold.
The pressing strength threshold may be determined according to usage habits of different users, that is, the pressing strength thresholds corresponding to different users may be the same or different.
In the case where the operation information includes the total weight by number, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
according to the pressing force degree of each touch operation, screening the re-pressing operation from all touch operations; and generating operation information according to the screened number of the operation.
a5 total continuous clicking times, which is the total times of continuous clicking performed by the user for the touch terminal; and continuously clicking, namely performing at least two times of clicking operations on the touch terminal by the user, wherein the time interval between every two adjacent times of clicking operations is smaller than a preset time interval threshold.
In the case where the operation information includes the total number of consecutive clicks, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
screening click operations from all touch operations according to the initial position, the end position, the initial time and the end time of each touch operation;
determining whether the two clicking operations are continuous clicking operations or not according to the ending time of the previous clicking operation and the starting time of the next clicking operation in every two adjacent clicking operations screened out so as to determine at least one group of continuous clicking operations from the clicking operations; and generating operation information according to the determined number of the continuous clicking operations.
It should be noted that a certain touch operation may only include any one of the above-mentioned clicking, dragging, long-pressing, and continuous clicking, and may also include a plurality of the above-mentioned clicking, dragging, long-pressing, and continuous clicking.
For example, after the user performs the long press operation, the drag operation is directly performed. Or the pressing force is larger than the pressing force threshold value in the long-time pressing operation process of the user, so that the touch operation can be used as long-time pressing operation or re-pressing operation.
Therefore, in the case where the number of touch operations includes a total number of clicks, a total number of drags, a total length number of clicks, a total weight number of clicks, and a total number of consecutive clicks, a sum of the total number of clicks, the total number of drags, the total length number of clicks, the total weight number of clicks, and the total number of consecutive clicks may be greater than the number of actual touch operations.
B: for the case that the operation information includes a pressing force degree of the touch operation, here, the pressing force degree of the touch operation includes: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
Here, the total duration of the touch operation may be divided into a plurality of touch operation time periods by a preset duration. When dividing, the following situations can be included:
the total duration T of the touch operation is an integral multiple of a preset duration threshold T:
and determining the preset time length threshold T as the time length corresponding to each touch operation time period, and finally determining T/T touch operation time periods.
The total duration T of the touch operation is not an integral multiple of a preset duration threshold T:
(1) and determining N touch operation time periods according to the preset time length threshold, wherein N is obtained by rounding down the result of dividing T by T. And then the remainder of dividing T by T is determined as the duration of the last touch operation time period.
Alternatively, the first and second electrodes may be,
(2) determining N touch time periods according to a preset time threshold, wherein N is obtained by rounding down a result of dividing T by T; at this time, the remainder of dividing T by T is omitted.
In addition, the plurality of touch operation time periods may also be determined in other manners.
For example, in a plurality of touch operation time periods, the duration of each touch operation time period is set to 1 second, the total duration of the touch operation is 5 seconds, and the touch operation force has 5 force values corresponding to each second of the total duration.
If the total duration of the touch operation is 5.3 seconds, the touch operation force has 6 force values, wherein the first 5 force values correspond to the first 5 touch operation time periods of 1 second duration one by one, and the 6 th force value corresponds to the last 0.3 second.
Or if the total duration of the touch operation is 5.3 seconds, the touch operation strength is 5 strength values in total, the first 4 strength values correspond to the first 4 force values for 1 second one by one, and the 5 th strength value corresponds to the last 1.3 seconds.
When the operation information includes the touch operation strength, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
determining a target touch operation corresponding to the playing progress from each touch operation according to the playing progress of the video information, and the starting time and the ending time of each touch operation;
and generating operation information based on the pressing force degree of the target touch operation.
C: the operation information includes a touch type. Here, the touch type includes: one or more of click operation, long press operation, drag operation, re-press operation and continuous click operation.
For the case that the operation information includes the touch type, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
determining a target touch operation corresponding to the playing progress from each touch operation according to the playing progress of the video information, and the starting time and the ending time of each touch operation;
and generating operation information based on the original operation information of the target touch operation.
D: the operation information includes: and event information. Here, the event information includes at least one of: the control triggered by the touch operation, the function realized by the touch operation and the result achieved by the touch operation.
For example, when the playback display control method of screen recording data is used for playing back game screen recording data, the control initiated by touch operation includes, for example: a release control of a certain skill, a direction movement control, etc.
The functions realized by the touch operation include, for example: skills release, movement, evasion, etc.
The results of the touch operation include, for example: dodging enemy attack, exiting the enemy attack moving range and the like.
Here, the event information corresponding to each touch operation can be generated according to the response result of each touch operation in the screen recording process by the touch terminal and stored in association with the corresponding touch operation.
In the case where the operation information includes event information, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
determining a target touch operation corresponding to the playing progress from each touch operation according to the playing progress of the video information, and the starting time and the ending time of each touch operation;
and generating operation information according to the event information stored in association with the target touch operation.
E: for the case that the operation information includes the touch operation time, here, the touch operation time includes the start time and/or the end time of each touch operation.
The operation information includes: in the case of including the touch operation time, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
determining a target touch operation corresponding to the playing progress from each touch operation according to the playing progress of the video information, and the starting time and the ending time of each touch operation;
and generating operation information based on the starting time and/or the ending time corresponding to the target touch operation.
F: for the case that the operation information includes the start position and the end position, the operation information corresponding to the operation information at the play progress may be generated in the following manner:
determining a target touch operation corresponding to the playing progress from each touch operation according to the playing progress of the video information, and the starting time and the ending time of each touch operation;
and generating operation information according to the original operation information of the target touch operation.
III: in S103 above, in one possible case, the target area is a second area, and the second area is a different display area of the graphical user interface from the first area. For example, the second area may be displayed as a data panel, and the video information of the screen recording data may be displayed in the first area while the operation information is displayed on the data panel.
The relative position of the first area and the second area can be specifically set according to actual needs.
For example, in the example corresponding to fig. 2, the graphical user interface includes a first area and a second area, and one of the areas is different from the second area, the first area is used for displaying video information of screen recording data, and the second area is used for displaying operation information.
In another possible case, the target region comprises at least a partial region of the first region. In this case, the target region may completely overlap with the first region or may partially overlap with the first region.
In this case, the same and/or different operation information is displayed in the first region and the target region, and when the same operation information is displayed in the first region and the target region, the same operation information is displayed in a different information presentation form in the first region and the target region.
Taking playback of video information obtained by recording a screen in a game process as an example, the generated operation information includes position information of touch operation, as shown in fig. 3, a touch indication identifier corresponding to the touch operation may be generated and displayed in the second area; and simultaneously, displaying the operation indication mark in the first area based on the position information of the touch operation.
For example, in this fig. 3, the target region includes the second region, and a partial region in the first region. The method comprises the steps of playing screen recording data in a first area, wherein two target touch operation orders are correspondingly formed in the current playing progress, touch points 1 and touch points 2 respectively corresponding to the two target touch operations are respectively formed in the first area, and touch identification marks respectively corresponding to the two touch operations are displayed in the first area according to touch operation positions respectively corresponding to the two touch operations. Meanwhile, in the second area, the touch type, the event information and the touch operation strength corresponding to the two touch operations are displayed.
The touch type corresponding to the touch point 1 is click operation, the event information is trigger evasion key, and the touch operation strength is 50;
the touch type corresponding to the touch point 2 is a long press operation, the event information is a start direction key, and the touch operation strength is 30.
Meanwhile, touch identification marks respectively corresponding to the secondary touch operation and the sitting operation are displayed in the second area, so that a user can distinguish the secondary touch operation according to the touch identification marks respectively displayed in the first area and the second area.
It should be noted here that the touch indication identifiers corresponding to different touch operations are different. The color or shape may be different.
As shown in fig. 3, the shapes of the touch indication marks corresponding to the two touch operations are different.
In addition, different information display forms can be specifically set according to actual needs, and are not limited here.
In another embodiment, a third area different from the first area and the second area may be further included on the graphical user interface for displaying other contents, such as identity information of a video-recording main player, or test parameters set during a game test.
For example, when the target area of the graphical user interface displays the operation information, the operation information may be displayed in the target area in the form of one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a pile-up diagram, and a sector diagram.
In another embodiment, the target area may further include a first area, the same and/or different operation information is displayed in the first area and the second area, and in the case that the same operation information is displayed in the first area and the second area, the same operation information is displayed in a different form in the first area and the second area.
According to the method and the device for displaying the touch operation, the video information of the screen recording data is played in the first area of the graphical user interface, the operation information under the corresponding playing progress is determined according to the playing progress of the video information, the operation information at least comprises the touch type of the touch operation and the event information corresponding to the touch operation, and therefore when the operation information is displayed in the target area of the graphical user interface, the detailed process of the touch operation in the screen recording process can be better displayed, and richer operation information of the touch operation is displayed to a user.
Based on the same inventive concept, the embodiment of the present disclosure further provides a playback display control device for screen recording data corresponding to the playback display control method for screen recording data, and as the principle of the device in the embodiment of the present disclosure for solving the problem is similar to the playback display control method for screen recording data in the embodiment of the present disclosure, the implementation of the device may refer to the implementation of the method, and repeated details are omitted.
Referring to fig. 4, a schematic diagram of a playback display control apparatus for recorded data provided in an embodiment of the present disclosure is shown, where the apparatus includes: a first display module 41, a determination module 42, and a second display module 43; wherein:
the first display module 41 is configured to play video information of the screen recording data in a first area of a graphical user interface;
a determining module 42, configured to determine, according to the playing progress of the video information, operation information in the playing progress, where the operation information at least includes a touch type of a touch operation and event information corresponding to the touch operation;
and a second display module 43, configured to display the operation information in a target area of the graphical user interface.
According to the method and the device for displaying the touch operation, the video information of the screen recording data is played in the first area of the graphical user interface, the operation information under the corresponding playing progress is determined according to the playing progress of the video information, the operation information at least comprises the touch type of the touch operation and the event information corresponding to the touch operation, and therefore when the operation information is displayed in the target area of the graphical user interface, the detailed process of the touch operation in the screen recording process can be better displayed, and richer operation information of the touch operation is displayed to a user.
In an alternative embodiment, the target area is a second area;
the second region and the first region are different display regions of the graphical user interface.
In an alternative embodiment, the target region comprises at least a partial region of the first region; the same and/or different operation information is displayed in the first area and the target area, and under the condition that the same operation information is displayed in the first area and the target area, the same operation information has different information display forms in the first area and the target area.
In an optional embodiment, the method further comprises: a screening module 44, configured to screen at least one target operation information type from the multiple operation information types in response to the operation information screening instruction;
the determining module 42 is configured to determine, according to the playing progress of the video information, operation information corresponding to the type of the target operation information at the playing progress.
In an optional implementation manner, the touch type includes: one or more of click operation, long press operation, drag operation, re-press operation and continuous click operation.
In an alternative embodiment, the event information includes at least one of: the control triggered by the touch operation, the function realized by the touch operation and the result achieved by the touch operation.
In an optional implementation manner, the operation information further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
In an optional implementation manner, for a case that the operation information includes a number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
aiming at the condition that the operation information type comprises touch operation strength, the touch operation strength comprises: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
In an optional embodiment, the first display module 41, when displaying the operation information in the target area of the graphical user interface, is configured to:
and displaying the operation information in the target area in one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a stacking chart and a sector chart.
The description of the processing flow of each module in the device and the interaction flow between the modules may refer to the related description in the above method embodiments, and will not be described in detail here.
An embodiment of the present disclosure further provides a computer device, as shown in fig. 5, which is a schematic structural diagram of the computer device provided in the embodiment of the present disclosure, and includes:
a processor 51, a memory 52, and a bus 53; the storage 52 is used for storing execution instructions and comprises a memory 521 and an external storage 522; the memory 521 is also referred to as an internal memory, and is used for temporarily storing the operation data in the processor 51 and the data exchanged with the external memory 522 such as a hard disk, the processor 51 exchanges data with the external memory 522 through the memory 521, and when the computer device is operated, the processor 51 communicates with the memory 52 through the bus 53, so that the processor 51 executes the following instructions in a user mode:
playing video information of the screen recording data in a first area of a graphical user interface;
determining operation information under the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of touch operation and event information corresponding to the touch operation;
and displaying the operation information in a target area of the graphical user interface.
In a possible embodiment, in the instruction executed by the processor 51, in an alternative embodiment, the target area is a second area;
the second region and the first region are different display regions of the graphical user interface.
In a possible embodiment, the processor 51 executes instructions in which the target area comprises at least a partial area of the first area; the same and/or different operation information is displayed in the first area and the target area, and under the condition that the same operation information is displayed in the first area and the target area, the same operation information has different information display forms in the first area and the target area.
In a possible implementation manner, the instructions executed by the processor 51, before determining the operation information at the play progress according to the play progress of the video information, further include:
in response to an operation information screening instruction, screening at least one target operation information type from a plurality of operation information types;
the determining the operation information under the playing progress according to the playing progress of the video information includes:
and determining the operation information corresponding to the target operation information type at the playing progress according to the playing progress of the video information.
In a possible implementation manner, in the instructions executed by the processor 51, the touch type includes: one or more of click operation, long press operation, drag operation, re-press operation and continuous click operation.
In a possible embodiment, the processor 51 executes instructions in which the event information includes at least one of: the control triggered by the touch operation, the function realized by the touch operation and the result achieved by the touch operation.
In a possible implementation manner, the operation information in the instructions executed by the processor 51 further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
In one possible implementation, in the instruction executed by the processor 51, for a case that the operation information includes a number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
aiming at the condition that the operation information type comprises touch operation strength, the touch operation strength comprises: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
In a possible embodiment, the instructions executed by the processor 51 for displaying the operation information in the target area of the graphical user interface include:
and displaying the operation information in the target area in one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a stacking chart and a sector chart.
The embodiments of the present disclosure also provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the playback display control method for screen recording data in the above method embodiments are executed.
The computer program product of the playback display control method for screen recording data provided in the embodiments of the present disclosure includes a computer readable storage medium storing a program code, where instructions included in the program code may be used to execute steps of the playback display control method for screen recording data described in the above method embodiments, which may be specifically referred to in the above method embodiments and are not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, apparatus, and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
Finally, it should be noted that: the above-mentioned embodiments are merely specific embodiments of the present disclosure, which are used for illustrating the technical solutions of the present disclosure and not for limiting the same, and the scope of the present disclosure is not limited thereto, and although the present disclosure is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive of the technical solutions described in the foregoing embodiments or equivalent technical features thereof within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present disclosure, and should be construed as being included therein. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims (9)

1. A playback display control method of screen recording data is characterized by comprising the following steps:
playing video information of the screen recording data in a first area of a graphical user interface;
in response to an operation information screening instruction, screening at least one target operation information type from a plurality of operation information types;
determining operation information corresponding to the target operation information type at the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of a touch operation and event information corresponding to the touch operation; the touch type includes: one or more of click operation, long press operation, drag operation, heavy press operation and continuous click operation; the event information includes at least one of: a control triggered by the touch operation, a function realized by the touch operation, and a result reached by the touch operation;
and displaying the operation information in a target area of the graphical user interface.
2. The playback display control method according to claim 1, wherein the target region is a second region;
the second region and the first region are different display regions of the graphical user interface.
3. The playback display control method according to claim 1, characterized in that the target region includes at least a partial region of the first region; the same and/or different operation information is displayed in the first area and the target area, and under the condition that the same operation information is displayed in the first area and the target area, the same operation information has different information display forms in the first area and the target area.
4. The playback display control method according to claim 1, wherein the operation information further includes: the number of touch operations, one or more of an operation track of each touch operation, a starting position of each touch operation, an ending position of each touch operation, a starting time of each touch operation, an ending time of each touch operation, and a pressing force degree of each touch operation.
5. The playback display control method according to claim 4, wherein, for a case where the operation information includes a number of touch operations, the number of touch operations includes: one or more of total click times, total drag times, total length times, total weight times and total continuous click times;
aiming at the condition that the operation information comprises touch operation strength, the touch operation strength comprises: and the pressing force value of each touch operation time period in a plurality of touch operation time periods lasting in the touch operation each time.
6. The playback display control method according to claim 1, wherein the displaying the operation information in a target area of a graphical user interface includes:
and displaying the operation information in the target area in one or more of a scatter diagram, a thermodynamic diagram, a bar chart, a line chart, a stacking chart and a sector chart.
7. A playback display control apparatus of recorded screen data, comprising:
the first display module is used for playing video information of the screen recording data in a first area of a graphical user interface;
the screening module is used for responding to the operation information screening instruction and screening at least one target operation information type from a plurality of operation information types;
the determining module is used for determining operation information corresponding to the target operation information type at the playing progress according to the playing progress of the video information, wherein the operation information at least comprises a touch type of a touch operation and event information corresponding to the touch operation; the touch type includes: one or more of click operation, long press operation, drag operation, heavy press operation and continuous click operation; the event information includes at least one of: a control triggered by the touch operation, a function realized by the touch operation, and a result reached by the touch operation;
and the second display module is used for displaying the operation information in a target area of the graphical user interface.
8. A computer device, comprising: a processor, a memory and a bus, the memory storing machine readable instructions executable by the processor, the processor and the memory communicating via the bus when a computer device is running, the machine readable instructions when executed by the processor performing the steps of the playback display control method of screen recording data according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that a computer program is stored thereon, which, when being executed by a processor, performs the steps of the playback display control method of screen recording data according to any one of claims 1 to 6.
CN201911205216.0A 2019-11-29 2019-11-29 Playback display control method and device for screen recording data Active CN110908584B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911205216.0A CN110908584B (en) 2019-11-29 2019-11-29 Playback display control method and device for screen recording data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911205216.0A CN110908584B (en) 2019-11-29 2019-11-29 Playback display control method and device for screen recording data

Publications (2)

Publication Number Publication Date
CN110908584A CN110908584A (en) 2020-03-24
CN110908584B true CN110908584B (en) 2021-07-30

Family

ID=69820874

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911205216.0A Active CN110908584B (en) 2019-11-29 2019-11-29 Playback display control method and device for screen recording data

Country Status (1)

Country Link
CN (1) CN110908584B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111632373B (en) * 2020-05-30 2021-05-28 腾讯科技(深圳)有限公司 Method and device for starting game and computer readable storage medium
CN114205447B (en) * 2021-12-16 2023-09-12 Oppo广东移动通信有限公司 Shortcut setting method and device of electronic equipment, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105378597A (en) * 2013-07-10 2016-03-02 三星电子株式会社 Method for displaying and electronic device thereof
CN107870725A (en) * 2017-11-30 2018-04-03 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN108052261A (en) * 2017-12-07 2018-05-18 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN108256071A (en) * 2018-01-17 2018-07-06 广东欧珀移动通信有限公司 Generation method, device, terminal and the storage medium of record screen file
CN109718537A (en) * 2018-12-29 2019-05-07 努比亚技术有限公司 Game video method for recording, mobile terminal and computer readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140045060A (en) * 2012-10-08 2014-04-16 엘지전자 주식회사 Mobile terminal and method for controlling thereof
CN108111903A (en) * 2018-01-17 2018-06-01 广东欧珀移动通信有限公司 Record screen document play-back method, device and terminal

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105378597A (en) * 2013-07-10 2016-03-02 三星电子株式会社 Method for displaying and electronic device thereof
CN107870725A (en) * 2017-11-30 2018-04-03 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN108052261A (en) * 2017-12-07 2018-05-18 广东欧珀移动通信有限公司 Record screen method, apparatus and terminal
CN108256071A (en) * 2018-01-17 2018-07-06 广东欧珀移动通信有限公司 Generation method, device, terminal and the storage medium of record screen file
CN109718537A (en) * 2018-12-29 2019-05-07 努比亚技术有限公司 Game video method for recording, mobile terminal and computer readable storage medium

Also Published As

Publication number Publication date
CN110908584A (en) 2020-03-24

Similar Documents

Publication Publication Date Title
CN110908584B (en) Playback display control method and device for screen recording data
CN111298449B (en) Control method and device in game, computer equipment and storage medium
JP6205767B2 (en) Learning support device, learning support method, learning support program, learning support system, and server device
CN110772795B (en) Game history operation display method, device, equipment and readable storage medium
US20160132209A1 (en) Operation system, operation control method, and operation control program
US10918955B2 (en) Techniques for displaying character play records on a game map
CN110215684B (en) Game object control method and device
CN110711384A (en) Game history operation display method, device and equipment
CN111494935A (en) Method and device for controlling virtual object in game
CN111701241A (en) Form switching method and device, storage medium and computer equipment
KR101436308B1 (en) Method of providing game replay, game replay server performing the same and storage media storing the same
CN113596598A (en) Game information processing method, device, equipment and storage medium
CN107626105B (en) Game picture display method and device, storage medium and electronic equipment
WO2021101734A1 (en) Server-based mechanics help determination from aggregated user data
JP6233809B2 (en) GAME SYSTEM, CONTROL METHOD AND COMPUTER PROGRAM USED FOR THE SAME
CN106984044B (en) Method and equipment for starting preset process
TW202303528A (en) Ar collection method, terminal, device and computer readable storage medium
CN113271486B (en) Interactive video processing method, device, computer equipment and storage medium
CN112807670A (en) Interaction method and device for virtual card game, electronic equipment and storage medium
CN110354494B (en) Method and device for controlling object in game, computer equipment and storage medium
CN111282264B (en) Virtual object control method and device
CN111414115A (en) Key control method, computer readable storage medium and terminal thereof
CN106648606A (en) Method and device for displaying information
CN113926188A (en) Game information display method and device and electronic equipment
JP7404541B2 (en) Virtual object control method, device, computer device, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant