CN114758284A - Graphic session auditing method of operation and maintenance auditing system - Google Patents

Graphic session auditing method of operation and maintenance auditing system Download PDF

Info

Publication number
CN114758284A
CN114758284A CN202210471196.7A CN202210471196A CN114758284A CN 114758284 A CN114758284 A CN 114758284A CN 202210471196 A CN202210471196 A CN 202210471196A CN 114758284 A CN114758284 A CN 114758284A
Authority
CN
China
Prior art keywords
picture
graphic
session
gray
maintenance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210471196.7A
Other languages
Chinese (zh)
Inventor
龙鹏宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chongqing Changan Automobile Co Ltd
Original Assignee
Chongqing Changan Automobile Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chongqing Changan Automobile Co Ltd filed Critical Chongqing Changan Automobile Co Ltd
Priority to CN202210471196.7A priority Critical patent/CN114758284A/en
Publication of CN114758284A publication Critical patent/CN114758284A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/22—Matching criteria, e.g. proximity measures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
    • G06F21/55—Detecting local intrusion or implementing counter-measures
    • G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Human Resources & Organizations (AREA)
  • Computer Security & Cryptography (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Hardware Design (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses a graphic session auditing method of an operation and maintenance auditing system, which is characterized in that the operation and maintenance auditing system is installed, and the resolution ratio of the graphic session during operation and maintenance is set; carrying out operation and maintenance processing, and waiting for the historical graphic sessions to reach a certain number by an auditor; the auditor selects the graphic session with sensitive operation, checks the corresponding video playback and selects a specific area in the video for marking, and the specific area is used for generating a picture library; the auditor sets a picture comparison strategy; auditors select historical graphic sessions in batches for automatic auditing; and the auditor carries out manual audit on the graphic session marked as containing the sensitive operation according to the result of the automatic audit of the operation and maintenance audit system. The invention uses the operation and maintenance auditing system to automatically audit the graphic session, the picture library is pre-calibrated by an auditor, and then the operation and maintenance auditing system automatically audits the graphic session by applying various strategies, thereby realizing the preliminary screening of the graphic session and enabling the auditor to carry out high-efficiency audit.

Description

Graphic session auditing method of operation and maintenance auditing system
Technical Field
The invention relates to the technical field of operation and maintenance auditing, in particular to a graphic session auditing method of an operation and maintenance auditing system.
Background
With the continuous application of the operation and maintenance auditing system, a large number of operation and maintenance historical sessions are generated every day in the business inside an enterprise. The sessions comprise a character protocol and a graphic protocol, and for the character protocol, an auditor can usually perform quick audit on operation and maintenance historical sessions in a mode of searching operation and maintenance contents; however, for the graphic protocol, the auditor can only check the operation and maintenance historical sessions one by playing back the operation and maintenance video. The auditing method for replaying the video not only ensures that the workload of auditors is huge, but also cannot accurately and efficiently find out sensitive operation, consumes time, easily leaks event details, and is not favorable for key operation of the auditors concentrating the attention in the video.
Disclosure of Invention
Aiming at the defects of the prior art, the technical problems to be solved by the invention are as follows: how to provide a graph session auditing method of an operation and maintenance auditing system, which is convenient and reliable to operate and improves auditing efficiency.
In order to solve the technical problem, the invention adopts the following technical scheme:
a graphic session auditing method of an operation and maintenance auditing system comprises the following steps:
(1) installing an operation and maintenance auditing system, and setting the resolution ratio of the graph session during operation and maintenance;
(2) carrying out operation and maintenance processing, and waiting for the historical graphic sessions to reach a certain number by an auditor;
(3) the auditor selects the graphic session with sensitive operation, checks the corresponding video playback and selects a specific area in the video for marking, and the specific area is used for generating a picture library;
(4) the auditor sets a picture comparison strategy;
(5) auditors select historical graphic sessions in batches for automatic auditing;
(6) and the auditor carries out manual audit on the graphic session marked as containing the sensitive operation according to the result of the automatic audit of the operation and maintenance audit system.
As optimization, in the operation of generating the picture library in the step (3), the auditor plays back the historical graphic session with a specific resolution, plays back part of the video, judges whether sensitive operation exists, if so, the auditor performs cutting and selecting operation on the video frame with the sensitive operation, only the area of the sensitive operation is reserved, the sensitive operation picture selected by the auditor is stored on the server, and is associated with the corresponding picture library in the database of the server.
As optimization, in the step (4), the image comparison strategy comprises image graying configuration, image comparison efficiency configuration and image library configuration;
picture graying configuration: whether graying processing is carried out or not during picture comparison and an algorithm used during the graying processing, wherein the algorithm is any one of a component method, a maximum value method, an average value method and a weighted average method;
the component method comprises the following steps: taking the brightness of three components in the color image as the gray values of three gray images according to the formula (1), selecting one gray image according to the application requirement,
Gray1(i，j)＝R(i，j)
Gray2(i，j)＝G(i，j)
Gray3(i，j)＝B(i，j) (1)
in the formula, Gray (i, j) is the Gray value of the pixel point (i, j), R (i, j) is the red value of the pixel point (i, j), G (i, j) is the green value of the pixel point (i, j), and B (i, j) is the blue value of the pixel point (i, j);
maximum method: taking the maximum value of the three-component brightness in the color image as the gray value of the gray map according to the formula (2);
Gray(i，j)＝max{R(i，j)，G(i，j)，B(i，j)} (2)
average value method: averaging the three-component brightness in the color image according to a formula (3) to obtain a gray value;
Gray(i，j)＝(R(i，j)+G(i，j)+B(i，j))/3 (3)
weighted average method: carrying out weighted average on the three components by different weights according to a formula (4);
Gray(i，j)＝0.299*R(i，j)+0.578*G(i，j)+0.114*B(i，j) (4)
picture contrast efficiency configuration: several factors determining the picture contrast efficiency include offset step length, picture contrast area and picture contrast direction;
and (3) picture library configuration: resolution applicable to the picture library, operating system applicable to the picture library, and session protocol applicable to the picture library.
As an optimization, in step (5), the automatic audit comprises the following steps:
(a) auditors select graphic sessions needing automatic auditing in batches;
(b) the auditor selects a graph comparison strategy used for automatic audit;
(c) the program traverses the graphic conversation and processes each frame of the graphic conversation;
(d) for each frame of the pictures, searching the sensitive operation pictures by using picture comparison logic;
(e) if the sensitive operation picture is found in the video frame, the sensitive operation exists in the image session, the position of the video frame is recorded, and meanwhile the sensitive operation exists in the image session is marked.
As an optimization, the picture comparison logic in step (d) comprises the following steps:
(I) comparing video frames of the graphic conversation as input pictures;
(II) taking out the picture from the corresponding picture library as a sensitive picture according to the picture library configuration of the picture comparison strategy;
(III) carrying out graying processing on the input picture according to the picture graying configuration;
(IV) determining an offset step length, a direction and a region according to the image contrast efficiency configuration;
(V) sequentially taking picture elements for comparison according to the sequence of upper left, lower right and upper right;
and (VI) if the gray values of the pixel points are the same as those of the sensitive operation pictures, determining that the sensitive operation pictures are found in the video frame, otherwise, determining that no sensitive operation pictures exist.
In conclusion, the beneficial effects of the invention are as follows: the invention uses the operation and maintenance auditing system to automatically audit the graphic session, the picture library is pre-calibrated by an auditor, and the operation and maintenance auditing system automatically audits the graphic session by applying various strategies, thereby realizing the preliminary screening of the graphic session and enabling the auditor to carry out high-efficiency auditing.
Drawings
For purposes of promoting a better understanding of the objects, aspects and advantages of the invention, reference will now be made in detail to the present invention as illustrated in the accompanying drawings, in which:
FIG. 1 is a flowchart of the generation of a picture library in the present invention;
FIG. 2 is a flow chart of the automatic audit in the present invention;
FIG. 3 is a flow chart of the picture comparison logic of the present invention;
fig. 4 is a schematic diagram illustrating the composition of the image comparison strategy in the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings.
As shown in fig. 1 to 4, a graphical session auditing method of an operation and maintenance auditing system in this embodiment includes the following steps:
(1) installing an operation and maintenance auditing system, and setting the resolution ratio of the graph session during operation and maintenance;
(2) carrying out operation and maintenance processing, and waiting for the historical graphic sessions to reach a certain number by an auditor;
(3) the auditor selects the graphic session with sensitive operation, checks the corresponding video playback and selects a specific area in the video for marking, and the specific area is used for generating a picture library;
(4) the auditor sets a picture comparison strategy;
(5) auditors select historical graphic sessions in batches to perform automatic audit;
(6) and the auditor carries out manual audit on the graphic session marked as containing the sensitive operation according to the result of the automatic audit of the operation and maintenance audit system.
In this specific embodiment, in the operation of generating the picture library in step (3), the auditor plays back the historical graphic session with a specific resolution, plays back part of the video, and determines whether there is a sensitive operation, such as displaying an icon, displaying characters, and displaying pictures in a window, if there is a sensitive operation, the auditor performs cutting and selecting operations on the video frame with the sensitive operation, only the area of the sensitive operation is reserved, and the sensitive operation picture selected by the auditor is saved on the server and is associated with the corresponding picture library in the database of the server.
In this embodiment, in the step (4), the image comparison policy includes image graying configuration, image comparison efficiency configuration, and image library configuration;
picture graying configuration: whether graying processing is carried out or not during picture comparison and an algorithm used during graying processing are adopted, wherein the algorithm is any one of a component method, a maximum value method, an average value method and a weighted average method;
a component method comprises the following steps: taking the brightness of three components in the color image as the gray values of three gray images according to the formula (1), selecting one gray image according to the application requirement,
Gray1(i，j)＝R(i，j)
Gray2(i，j)＝G(i，j)
Gray3(i，j)＝B(i，j) (1)
in the formula, Gray (i, j) is the Gray value of the pixel point (i, j), R (i, j) is the red value of the pixel point (i, j), G (i, j) is the green value of the pixel point (i, j), and B (i, j) is the blue value of the pixel point (i, j);
maximum value method: taking the maximum value of the three-component brightness in the color image as the gray value of the gray image according to the formula (2);
Gray(i，j)＝max{R(i，j)，G(i，j)，B(i，j)} (2)
average value method: averaging the three-component brightness in the color image according to a formula (3) to obtain a gray value;
Gray(i，j)＝(R(i，j)+G(i，j)+B(i，j))/3 (3)
weighted average method: carrying out weighted average on the three components according to a formula (4) by using different weights; because human eyes have highest sensitivity to green and lowest sensitivity to blue, a reasonable gray image can be obtained by carrying out weighted average on RGB three components according to the following formula;
Gray(i，j)＝0.299*R(i，j)+0.578*G(i，j)+0.114*B(i，j) (4)
and (3) picture contrast efficiency configuration: several factors determining the picture contrast efficiency include offset step length, picture contrast area and picture contrast direction;
and (3) picture library configuration: the resolution applicable to the picture library, the operating system applicable to the picture library, such as Windows Server 2016, CentOS, etc., and the session protocol applicable to the picture library, such as VNC, RDP, etc.
In this embodiment, in step (5), the automatic audit includes the following steps:
(a) auditors select graphic sessions needing automatic auditing in batches;
(b) the auditor selects a graph comparison strategy used for automatic audit;
(c) the program traverses the graphic conversation and processes each frame of the graphic conversation;
(d) for each frame of the taken pictures, searching the sensitive operation pictures by using picture comparison logic;
(e) and if the sensitive operation picture is found in the video frame, the sensitive operation exists in the graphic session, the position of the video frame is recorded, and the sensitive operation exists in the graphic session is marked.
In this embodiment, the logic for comparing pictures in step (d) includes the following steps:
comparing video frames of a graphic conversation as input pictures;
(II) taking out the picture from the corresponding picture library as a sensitive picture according to the picture library configuration of the picture comparison strategy;
(III) carrying out graying processing on the input picture according to the picture graying configuration;
(IV) determining an offset step length, a direction and a region according to the image contrast efficiency configuration;
(V) sequentially taking picture elements for comparison according to the sequence of upper left, lower right and upper right;
and (VI) if the gray values of the pixel points are the same as those of the sensitive operation pictures, determining that the sensitive operation pictures are found in the video frame, otherwise, determining that no sensitive operation pictures exist.
Finally, it is noted that the above-mentioned embodiments illustrate rather than limit the invention, and that, while the invention has been described with reference to preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (5)

1. A graphic session auditing method of an operation and maintenance auditing system is characterized by comprising the following steps: the method comprises the following steps:
(1) installing an operation and maintenance auditing system, and setting the resolution ratio of the graph session during operation and maintenance;
(2) carrying out operation and maintenance processing, and waiting for the historical graphic sessions to reach a certain number by an auditor;
(3) the auditor selects the graphic session with sensitive operation, checks the corresponding video playback and selects a specific area in the video for marking, and the specific area is used for generating a picture library;
(4) the auditor sets a picture comparison strategy;
(5) auditors select historical graphic sessions in batches for automatic auditing;
(6) and the auditor carries out manual audit on the graphic session marked as containing the sensitive operation according to the result of the automatic audit of the operation and maintenance audit system.
2. The graphical session auditing method of an operation and maintenance auditing system of claim 1, characterized in that: in the operation of generating the picture library in the step (3), the auditor plays back the historical graphic session with a specific resolution, plays back part of the video, judges whether sensitive operation exists in the video, if so, cuts and selects the video frame with the sensitive operation, only reserves the area of the sensitive operation, stores the sensitive operation picture selected by the auditor on the server, and associates the sensitive operation picture with the corresponding picture library in the database of the server.
3. The graphical session auditing method of an operation and maintenance auditing system of claim 1, characterized in that: in the step (4), the image comparison strategy comprises image graying configuration, image comparison efficiency configuration and image library configuration;
picture graying configuration: whether graying processing is carried out or not during picture comparison and an algorithm used during graying processing are adopted, wherein the algorithm is any one of a component method, a maximum value method, an average value method and a weighted average method;
the component method comprises the following steps: taking the brightness of three components in the color image as the gray values of three gray images according to the formula (1), selecting one gray image according to the application requirement,
Gray1(i,J)＝R(i,j)
Gray2(i，j)＝G(i，j)
Gray3(i，j)＝B(i，j) (1)
in the formula, Gray (i, j) is the Gray value of the pixel point (i, j), R (i, j) is the red value of the pixel point (i, j), G (i, j) is the green value of the pixel point (i, j), and B (i, j) is the blue value of the pixel point (i, j);
maximum method: taking the maximum value of the three-component brightness in the color image as the gray value of the gray map according to the formula (2);
Gray(i，j)＝max{R(i，j)，G(i，j)，B(i，j)} (2)
average value method: averaging the three-component brightness in the color image according to a formula (3) to obtain a gray value;
Gray(i，j)＝(R(i，j)+G(i，j)+B(i，j))/3 (3)
weighted average method: carrying out weighted average on the three components according to a formula (4) by using different weights;
Gray(i，j)＝0.299*R(i，j)+0.578*G(i，j)+0.114*B(i，j) (4)
picture contrast efficiency configuration: several factors determining the picture contrast efficiency include offset step length, picture contrast area, and picture contrast direction;
and (3) picture library configuration: resolution applicable to the picture library, operating system applicable to the picture library, and session protocol applicable to the picture library.
4. The graphical session auditing method of an operation and maintenance auditing system of claim 3, characterized in that: in step (5), the automatic audit comprises the steps of:
(a) auditors select graphic sessions needing automatic auditing in batches;
(b) the auditor selects a graph comparison strategy used for automatic audit;
(c) the program traverses the graphic conversation and processes each frame of the graphic conversation;
(d) for each frame of the pictures, searching the sensitive operation pictures by using picture comparison logic;
(e) and if the sensitive operation picture is found in the video frame, the sensitive operation exists in the graphic session, the position of the video frame is recorded, and the sensitive operation exists in the graphic session is marked.
5. The graphical session auditing method of an operation and maintenance auditing system of claim 4, characterized in that: the picture comparison logic in step (d) comprises the following steps:
(I) comparing video frames of the graphic conversation as input pictures;
(II) taking the picture from the corresponding picture library as a sensitive picture according to the picture library configuration of the picture comparison strategy;
(III) carrying out graying processing on the input picture according to the picture graying configuration;
(IV) determining an offset step length, a direction and a region according to the picture contrast efficiency configuration;
(V) sequentially taking pixel points for comparison according to the sequence of upper left, lower right and upper right;
(VI) if the gray values of the pixel points are the same as those of the sensitive operation pictures, the sensitive operation pictures are found in the video frame, otherwise, the sensitive operation pictures are not found.
CN202210471196.7A 2022-04-28 2022-04-28 Graphic session auditing method of operation and maintenance auditing system Pending CN114758284A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210471196.7A CN114758284A (en) 2022-04-28 2022-04-28 Graphic session auditing method of operation and maintenance auditing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210471196.7A CN114758284A (en) 2022-04-28 2022-04-28 Graphic session auditing method of operation and maintenance auditing system

Publications (1)

Publication Number Publication Date
CN114758284A true CN114758284A (en) 2022-07-15

Family

ID=82333153

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210471196.7A Pending CN114758284A (en) 2022-04-28 2022-04-28 Graphic session auditing method of operation and maintenance auditing system

Country Status (1)

Country Link
CN (1) CN114758284A (en)

Similar Documents

Publication Publication Date Title
JP5334402B2 (en) Display apparatus and method for improving flicker of video
TWI392377B (en) Method for enhancing contrast of digital image and related computer and computing system
CN108682367B (en) Display self-monitoring method and display
JP2001343957A (en) Liquid crystal display device
US20070236410A1 (en) Image display apparatus and display screen burn-in prevention method
US8351697B2 (en) Method for detection of film mode or camera mode
CN102054424B (en) Image processing apparatus and image processing method
US20050237432A1 (en) Apparatus, method, and program for processing image
US8659654B2 (en) Image verification with tiered tolerance
EP1874038A1 (en) Integrated histogram auto adaptive contrast control (ACC)
CN101621704A (en) Color enhancement for graphic images
CN107801093A (en) Video Rendering method, apparatus, computer equipment and readable storage medium storing program for executing
CN110490838B (en) Method and device for processing boundaries of areas with different resolutions of display panel
CN113112947B (en) Display device and driving method thereof
JP4958875B2 (en) Method for driving liquid crystal display device and liquid crystal display device
CN114758284A (en) Graphic session auditing method of operation and maintenance auditing system
US7743342B2 (en) Moving-image icon generating apparatus
CN113923296B (en) Interface display method, device and computer readable storage medium
CN106603887A (en) Signal windowing display method and signal windowing display system
US7834888B2 (en) Mechanism for color-space neutral (video) effects scripting engine
CN111402796A (en) Image processing method and image processing system
US7768538B2 (en) Hybrid data planes
JP2846777B2 (en) Image information processing method and image information processing apparatus
US10867373B2 (en) Dynamic overlay display properties adjustment methods and systems
JP2820036B2 (en) Display device gradation correction circuit

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination