CN114666668A - Video playback method, system, equipment and storage medium - Google Patents

Video playback method, system, equipment and storage medium Download PDF

Info

Publication number
CN114666668A
CN114666668A CN202210269634.1A CN202210269634A CN114666668A CN 114666668 A CN114666668 A CN 114666668A CN 202210269634 A CN202210269634 A CN 202210269634A CN 114666668 A CN114666668 A CN 114666668A
Authority
CN
China
Prior art keywords
playback
screen
video
mode
video playback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210269634.1A
Other languages
Chinese (zh)
Other versions
CN114666668B (en
Inventor
唐琦松
林平
吴鑫
靳志业
鲁埝生
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai I Search Software Co ltd
Original Assignee
Shanghai I Search Software Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai I Search Software Co ltd filed Critical Shanghai I Search Software Co ltd
Priority to CN202210269634.1A priority Critical patent/CN114666668B/en
Publication of CN114666668A publication Critical patent/CN114666668A/en
Application granted granted Critical
Publication of CN114666668B publication Critical patent/CN114666668B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region

Abstract

The invention discloses a video playback method, a system, equipment and a storage medium, wherein the video playback method comprises the following steps: acquiring an event log and a screen video, and acquiring a video playback request; matching a corresponding video playback mode to perform video playback based on the obtained playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode. The invention is convenient to play back the recorded screen content on the large screen on the small screen, and keeps the definition to the maximum extent.

Description

Video playback method, system, equipment and storage medium
Technical Field
The invention relates to a video playback method, a video playback system, video playback equipment and a storage medium, and belongs to the technical field of security audit.
Background
In order to ensure the compliance of the business executed by business personnel on a computer, the complete process of actual operation is generally recorded in a screen recording mode, so that the audit is convenient afterwards. The screen recording mode is mature, and the format capable of being stored is very many, so that the screen recording method is widely applied. Many monitoring and auditing systems store a large amount of video content that can be viewed at any time.
The general screen recording software does not consider the problem of screen resolution adaptation, and if the recorded screen resolution is small, but the screen resolution of a computer used in the playback is large, the playback does not have any problem. If the resolution of the played back video is contrary, for example, the video is recorded on a 4K resolution PC screen and played back on a 720P resolution mobile phone screen, the resolution of the played back video has to be reduced to the resolution of the mobile phone, the content on the screen is difficult to see clearly, and the post-audit and video content positioning are inconvenient.
Disclosure of Invention
The present invention is directed to overcome the deficiencies in the prior art and provide a video playback method, system, device and storage medium, which facilitate playback of recorded content on a large screen on a small screen and maintain the definition to the maximum extent. In order to achieve the purpose, the invention is realized by adopting the following technical scheme:
in a first aspect, the present invention provides a video playback method, including:
acquiring an event log and a screen video, and acquiring a video playback request;
matching a corresponding video playback mode to perform video playback based on the obtained playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
With reference to the first aspect, further, the acquiring the event log and the screen recording includes:
starting a screen recorder and a system event monitor;
starting screen recording, and recording the number and the position of screens;
when a system event is monitored, recording the positions of a cursor and a mouse, and the title and the position of a window;
and ending screen recording and stopping system event monitoring.
With reference to the first aspect, further, the split screen mode is:
and extracting the content of the appointed screen from the screen video for playback according to the acquired playback request.
With reference to the first aspect, further, the window mode is:
reading a specified application name from the acquired playback request;
searching all time points and occurrence areas of the application from the event log according to the application name;
and extracting the content of the appearing area from the screen video for playback.
With reference to the first aspect, further, if the application specified at a certain time point does not appear, the screen recording at the time point is blank, and the content at the time point is automatically skipped during playback.
With reference to the first aspect, further, the cursor following mode is:
determining the size of a preset following area according to the acquired playback request;
extracting the position of the cursor at each time point from the event log;
determining a cursor area of each time point based on the position of the cursor and the size of the following area;
and extracting the content of the cursor area from the screen video for playback.
With reference to the first aspect, preferably, the normal mode is: playback of the entire area of the screen recording.
In a second aspect, the present invention provides a video playback system comprising:
an acquisition module: the system comprises a video processing module, a video playing module and a video playing module, wherein the video processing module is used for acquiring an event log and a screen video and acquiring a video playback request;
a playback module: the video playback module is used for matching the corresponding video playback mode to perform video playback based on the acquired playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
With reference to the second aspect, the system further comprises a server, wherein the server is used for storing the event log and the screen recording.
With reference to the second aspect, preferably, the server is connected to the playback module.
With reference to the second aspect, preferably, the obtaining module includes a screen recorder and a system event listener connected to the server;
the screen recorder is used for recording a screen;
the system event listener is used for monitoring system events.
With reference to the second aspect, preferably, the obtaining module further includes an interaction module connected to the playback module; the interaction module is used for acquiring a video playback request.
In a third aspect, the present invention provides a playback device comprising a processor and a storage medium;
the storage medium is used for storing instructions;
the processor is configured to operate in accordance with the instructions to perform the steps of the method of the first aspect.
In a fourth aspect, the invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method of the first aspect.
Compared with the prior art, the video playback method, the system, the equipment and the storage medium provided by the embodiment of the invention have the beneficial effects that:
the method comprises the steps of obtaining an event log and a screen video and obtaining a video playback request; and matching the corresponding video playback mode for video playback based on the acquired playback request. The video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode. According to the invention, the content of the region of interest can be dynamically displayed instead of all screen contents according to the needs of the user, so that the screen recording content on a large screen can be conveniently played back on a small screen; the invention can maintain the definition to the maximum degree no matter the resolution of the recorded screen is high or low.
Drawings
Fig. 1 is a flowchart of a video playback method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a normal mode in a video playback method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a split screen mode in a video playback method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a window mode in a video playback method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a cursor following mode in a video playback method according to an embodiment of the present invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings. The following examples are only for illustrating the technical solutions of the present invention more clearly, and the protection scope of the present invention is not limited thereby.
The first embodiment is as follows:
as shown in fig. 1, an embodiment of the present invention provides a video playback method, including:
acquiring an event log and a screen video, and acquiring a video playback request;
matching a corresponding video playback mode to perform video playback based on the acquired playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
Step 1: and acquiring an event log and a screen video.
Step 1.1: and starting a screen recorder and a system event monitor.
In the present embodiment, the screen recorder is a recorder based on the RDP protocol, and is capable of recording all RDP data representing screen changes. And the system event listener acquires all window information and keyboard and mouse events through the windows original input API.
Step 1.2: and starting screen recording, and recording the number and the position of the screens.
Step 1.3: upon monitoring system events, the cursor and mouse position, as well as the title and position of the window, are recorded.
Step 1.4: and ending screen recording and stopping system event monitoring.
And 2, step: a video playback request is obtained.
And step 3: and matching the corresponding video playback mode to perform video playback based on the acquired playback request.
The video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event logs in an auxiliary mode, and the playback area with the determined size is selected from the screen recording for video playback.
The video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
The conventional mode is: playback of the entire area of the screen recording. The size of the playback video is equal to the size at the time of recording. As shown in fig. 2, the screen recording includes a screen 1, a screen 2, and a screen 3, and the entire areas of the screen recording, i.e., the playback screen 1, the screen 2, and the screen 3, are played back.
The split screen mode is as follows: and extracting the content of the appointed screen from the screen video for playback according to the acquired playback request. The size of the playback video is equal to the size of the designated video playback zone. As shown in fig. 3, the screen recording includes a screen 1, a screen 2, and a screen 3, and the playback request specifies playback of the screen 1, and the content of the screen 1 is extracted from the screen recording and played back.
The window mode is: reading a specified application name from the acquired playback request; searching all time points and occurrence areas of the application from the event log according to the application name; and extracting the content of the appearing area from the screen video for playback. As shown in fig. 4, the designated application is app1, all time points of occurrence of app1 and screen 1 and screen 2 are found from the event log, and the content of the window corresponding to screen 1 and screen 2 is extracted from the screenshot for playback.
The size of the playback video in the windowed mode is the maximum footprint of all simultaneously occurring windows. If at a certain time, the designated application has three windows, each of which occupies a complete screen, then the size of the playback video is three screens.
If the application specified at a certain time point does not appear, the screen recording at the time point is blank, and the content at the time point is automatically skipped during playback.
The cursor following mode is: determining the size of a preset following area according to the acquired playback request; extracting the position of the cursor at each time point from the event log; determining a cursor area of each time point based on the position of the cursor and the size of the following area; and extracting the content of the cursor area from the screen video for playback. As shown in fig. 5, the size of the preset following area is determined, and a cursor is extracted from the event log and passes through the screen 1, the screen 3 and the screen 2 in sequence; and determining a cursor area of each time point based on the position of the cursor and the size of the following area, extracting the content of the cursor area from the screen recording for playback, wherein the content of the playback area changes along with the change of the cursor moving track.
Example two:
an embodiment of the present invention provides a video playback system, including:
an acquisition module: the system comprises a video processing module, a video playing module and a video playing module, wherein the video processing module is used for acquiring an event log and a screen video and acquiring a video playback request;
a playback module: the video playback module is used for matching the corresponding video playback mode to perform video playback based on the acquired playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
A video playback system further comprises a server for storing event logs and screenshots.
Example three:
the embodiment provides a playback device, comprising a processor and a storage medium;
the storage medium is to store instructions;
the processor is configured to operate in accordance with the instructions to perform the steps of the method of embodiment one.
Example four:
embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method of an embodiment.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, several modifications and variations can be made without departing from the technical principle of the present invention, and these modifications and variations should also be regarded as the protection scope of the present invention.

Claims (10)

1. A video playback method, comprising:
acquiring an event log and a screen video, and acquiring a video playback request;
matching a corresponding video playback mode to perform video playback based on the obtained playback request; the video playback mode is based on a playback area calculation mode specified by a playback request, the position and the size of the playback area are determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
2. The video playback method of claim 1, wherein the obtaining the event log and the screen recording comprises:
starting a screen recorder and a system event monitor;
starting screen recording, and recording the number and the position of screens;
when a system event is monitored, recording the positions of a cursor and a mouse, and the title and the position of a window;
and ending screen recording and stopping system event monitoring.
3. The video playback method according to claim 1, wherein the split screen mode is:
and extracting the content of the appointed screen from the screen video for playback according to the acquired playback request.
4. The video playback method according to claim 1, wherein the window mode is:
reading a specified application name from the acquired playback request;
searching all time points and occurrence areas of the application from the event log according to the application name;
and extracting the content of the appearing area from the screen video for playback.
5. The video playback method according to claim 4, wherein if the application specified at a certain time point does not appear, the screen recording at the time point is blank, and the content at the time point is automatically skipped at the time of playback.
6. The video playback method according to claim 1, wherein the cursor following mode is:
determining the size of a preset following area according to the acquired playback request;
extracting the position of the cursor at each time point from the event log;
determining a cursor area of each time point based on the position of the cursor and the size of the following area;
and extracting the content of the cursor area from the screen video for playback.
7. A video playback system, comprising:
an acquisition module: the system is used for acquiring event logs and screen videos and acquiring video playback requests;
a playback module: the video playback module is used for matching the corresponding video playback mode to perform video playback based on the acquired playback request; the video playback mode is based on a playback area specified by a playback request, the size of the playback area is determined by adopting event log assistance, and the playback area with the determined size is selected from the screen video for video playback; the video playback mode includes: a normal mode, a split screen mode, a window mode, and a cursor following mode.
8. The video playback system of claim 7, further comprising a server for storing event logs and screenshots.
9. A playback device comprising a processor and a storage medium;
the storage medium is used for storing instructions;
the processor is configured to operate in accordance with the instructions to perform the steps of the method of any of claims 1 to 6.
10. Computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
CN202210269634.1A 2022-03-18 2022-03-18 Video playback method, system, equipment and storage medium Active CN114666668B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210269634.1A CN114666668B (en) 2022-03-18 2022-03-18 Video playback method, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210269634.1A CN114666668B (en) 2022-03-18 2022-03-18 Video playback method, system, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN114666668A true CN114666668A (en) 2022-06-24
CN114666668B CN114666668B (en) 2024-03-15

Family

ID=82029784

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210269634.1A Active CN114666668B (en) 2022-03-18 2022-03-18 Video playback method, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114666668B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374258B1 (en) * 1997-11-17 2002-04-16 Sony Corporation Data recording and reproducing apparatus and method for recording and reproducing data from a non-linear recording medium
JP2008257424A (en) * 2007-04-04 2008-10-23 Sky Kk Terminal monitoring method, terminal monitor and terminal monitoring program
US20080282160A1 (en) * 2007-04-06 2008-11-13 James Ian Tonnison Designated screen capturing and automatic image exporting
US20140178033A1 (en) * 2012-12-25 2014-06-26 Huawei Technologies Co., Ltd. Video playback method, terminal, and system
US20150146226A1 (en) * 2013-11-27 2015-05-28 Konica Minolta Inc. Image forming apparatus, display method for an operation screen, and computer program
US10735793B1 (en) * 2019-03-15 2020-08-04 Adobe Inc. Recording and playing back image variations
CN111526312A (en) * 2016-11-29 2020-08-11 华为技术有限公司 Screen recording and playing method, screen recording terminal and screen playing terminal
JP2021072630A (en) * 2020-12-18 2021-05-06 インターデイジタル マディソン パテント ホールディングス ソシエテ パー アクシオン サンプリフィエ Video playback method, terminal, and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6374258B1 (en) * 1997-11-17 2002-04-16 Sony Corporation Data recording and reproducing apparatus and method for recording and reproducing data from a non-linear recording medium
JP2008257424A (en) * 2007-04-04 2008-10-23 Sky Kk Terminal monitoring method, terminal monitor and terminal monitoring program
US20080282160A1 (en) * 2007-04-06 2008-11-13 James Ian Tonnison Designated screen capturing and automatic image exporting
US20140178033A1 (en) * 2012-12-25 2014-06-26 Huawei Technologies Co., Ltd. Video playback method, terminal, and system
US20150146226A1 (en) * 2013-11-27 2015-05-28 Konica Minolta Inc. Image forming apparatus, display method for an operation screen, and computer program
CN111526312A (en) * 2016-11-29 2020-08-11 华为技术有限公司 Screen recording and playing method, screen recording terminal and screen playing terminal
US10735793B1 (en) * 2019-03-15 2020-08-04 Adobe Inc. Recording and playing back image variations
JP2021072630A (en) * 2020-12-18 2021-05-06 インターデイジタル マディソン パテント ホールディングス ソシエテ パー アクシオン サンプリフィエ Video playback method, terminal, and system

Also Published As

Publication number Publication date
CN114666668B (en) 2024-03-15

Similar Documents

Publication Publication Date Title
CN104488277B (en) For monitoring the method and apparatus of media presentation
RU2312412C2 (en) Reproduction device and reproduction method
US7054540B2 (en) Information processing apparatus and method, and program storage medium
JP2020536455A (en) Recommended video methods, recommended video equipment, computer equipment and storage media
CN111818123B (en) Network front-end remote playback method, device, equipment and storage medium
CN102057400A (en) Image processing device, image processing method, and computer program
CN108111903A (en) Record screen document play-back method, device and terminal
CN103970533A (en) Method and device for recording captured information on screen
CN111930975A (en) Ship navigation data playback and analysis system and method
CN111078519A (en) Method and device for backtracking abnormal monitoring behaviors and electronic equipment
CN103324513A (en) Program annotation method and device
JP4555214B2 (en) Information presenting apparatus, information presenting method, information presenting program, and information recording medium
JP4431109B2 (en) Recording / reproducing system, recording apparatus, reproducing apparatus, recording medium, recording / reproducing method, recording method, reproducing method, program, and program recording medium
US20180225289A1 (en) Audio/video file playback method and audio/video file playback apparatus
CN114666668B (en) Video playback method, system, equipment and storage medium
CN115396729B (en) Video target frame determining method, device, equipment and storage medium
JP4625862B2 (en) Authoring apparatus and authoring method
JP2006509317A (en) Playback operation control method in interactive optical disk device
CN113382268B (en) Live broadcast anomaly analysis method, live broadcast anomaly analysis device, computer equipment and storage medium
CN110569184B (en) Test method and terminal equipment
WO2021142607A1 (en) Vehicle diagnosis process playback method, apparatus, and readable storage medium
JP2006510164A (en) Recording / reproducing system, recording / reproducing method, program, and recording medium
CN113992878B (en) Remote desktop operation auditing method, device and equipment
JP2008210068A (en) Data processor, data processing method and program
US20230377606A1 (en) Video editing projects using single bundled video files

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant