CN107948563A - A kind of user's operation behavior auditing method based on video acquisition - Google Patents

A kind of user's operation behavior auditing method based on video acquisition Download PDF

Info

Publication number
CN107948563A
CN107948563A CN201711240091.6A CN201711240091A CN107948563A CN 107948563 A CN107948563 A CN 107948563A CN 201711240091 A CN201711240091 A CN 201711240091A CN 107948563 A CN107948563 A CN 107948563A
Authority
CN
China
Prior art keywords
user
video
behavior
auditing method
recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711240091.6A
Other languages
Chinese (zh)
Inventor
曹伟
吴松洋
刘占斌
汪俊明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Third Research Institute of the Ministry of Public Security
Original Assignee
Third Research Institute of the Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Third Research Institute of the Ministry of Public Security filed Critical Third Research Institute of the Ministry of Public Security
Priority to CN201711240091.6A priority Critical patent/CN107948563A/en
Publication of CN107948563A publication Critical patent/CN107948563A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3438Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses the user's operation behavior auditing method based on video acquisition, its binding operation screen video, operator's video to audit user behavior with operation log.This programme gathers user's operation behavior by various dimensions, realizes the complete audit to user's operation behavior, effectively solves the problems of current scheme.

Description

A kind of user's operation behavior auditing method based on video acquisition
Technical field
The present invention relates to network technique field, and in particular to network security technology.
Background technology
Effect in life becomes more and more important, various regions number of users also rapid growth, but in network construction and application process In also there are the user behaviors for being much difficult to monitoring and management, so need to audit to user behavior, briefly, use Family operation behavior audit technique is a kind of method that user's operation behavior is recorded and analyzed, including is used the product by the user The various daily records produced in journey and other information.
How to perceive user's operation behavior, realize the audit to user behavior, and according to auditing result to user behavior into Row control, is always insoluble problem, and user's operation behavioral data record but faces in practical applications with analytic process Many challenges, its main cause is that the audit of user behavior must solve following three technological difficulties that are mutually related.
1. data acquisition technology
User's operation behavior is diversified, in order to therefrom obtain the number of energy effective monitoring and audit user behavior in time According to, it would be desirable to customization needs the user's operation behavior type audited, and only the behavior of all types user's operation is carried out comprehensive Record, could for analytical auditing user operation behavior, strengthen monitoring to user and provide the firsthand information with management.
2. data scrubbing technology
The user's operation behavior of required audit is collected by various technological means at present, it has in face of big data of auditing The problem of amount, it has to be possible to extract the critical data of reflection user's specific operation behavior, and do not lose effective in data Information.For audit user's operation behavior, it is necessary to which various user's operation behavioral datas are cut out, filter and are polymerize, weight is rejected Multiple, redundancy, invalid and minor details data, by unordered, mixed and disorderly data preparation into orderly, complete number According to this is the necessary hand of analysis of key data, and solid data basis is established for audit user behavior.
3. data analysis technique
User's operation behavioral data needs meticulous design and analysis, and data are associated, are counted with excavating, and are aided with Intuitively show form so that management of product person is clear, legibly finds user's operation rule and warning information, is the pipe of product Reason brings the guidance in any decision-making.
User's operation behavior auditing technology is never only simple data record and inquiry, only gathers behavior number extensively According to, data are cut out, are filtered, are polymerize, are counted with analyzing, and shown in the form of intuitively, user's behavior auditing could be made Technology really becomes the decision-making assistant of management of product person.
Most importantly, in the prior art the audit of user's operation behavior simply by operation log, its data source It is relatively simple, cause auditing result accuracy not high.
The content of the invention
For existing network user's operation behavior auditing only by the problems of operation log, it is necessary to a kind of more complete The user's operation behavior auditing scheme in face.
For this reason, problem to be solved by this invention is to provide a kind of user's operation behavior auditing side based on video acquisition Method.
To solve the above-mentioned problems, the user's operation behavior auditing method provided by the invention based on video acquisition, it is described Auditing method binding operation screen video, operator's video audit user behavior with operation log.
Further, all operations form operator control panel during the auditing method records user's operation by screen recording Curtain video.
Further, when carrying out screen recording, continue screen printing picture, and continuously Load Image, carry out screen video Record.
Further, the auditing method is by imaging the behavior state formation behaviour for recording user during whole operation Make people's video.
Further, in operator's video record, it is based on Streaming Media frame J MF using JAVA and opens camera to operation Personnel state real-time recording, forms the video data of user's operation.
The present invention is realized using various dimensions collection user's operation behavior and is mutually tied operation display with operation log with operator Close to audit to user behavior, realize the complete audit to user's operation behavior, effectively solve present in current scheme Problem.
Brief description of the drawings
The present invention is further illustrated below in conjunction with the drawings and specific embodiments.
Fig. 1 is the implementation schematic diagram that user's operation behavior auditing is carried out in present example;
User's operation flow is carried out in the present example of Fig. 2 positions and records flow chart.
Embodiment
In order to make the technical means, the creative features, the aims and the efficiencies achieved by the present invention easy to understand, tie below Conjunction is specifically illustrating, and the present invention is further explained.
This programme gathers user's operation behavior by various dimensions, carries out various dimensions to Internet Products ' Customer operation behavior accordingly Complete audit.
This programme by all operations during screen recording record product use, forms operation display video first; Secondly corresponding individual of camera (such as front camera) the record product user in whole operation flow on product is utilized Behavior state, forms operator's video;And this two classes video data is deposited preservation (being stored in database) in real time, is follow-up audit Strategy provides data and supports;At the same time by product systems log recording user's operation behavior, operation log is formed.
Thus, this programme by the user's operation gathered in real time video data by (recording all behaviour during whole use The operation display video of work and the operator's video for recording operator's state in whole operation flow) mutually tied with syslog data Close and carry out user behavior audit, so as to fulfill the comprehensive user behavior audit of various dimensions.
Referring to Fig. 1 which shows this programme carries out a kind of embodiment schematic diagram of user's operation behavior auditing.
As seen from the figure, this example provides data branch by gathering user's operation video data in real time for follow-up audit strategy Hold.
Here user's operation video data includes the operation display video data and note of record all operating processes of user Record operator's behavior video data of personal behavior state of the end user in whole operation flow.
Operation display video data in this example is formed by way of film recording, especially by continuous screen printing Picture, and continuously Load Image, to realize screen recording.
This example carry out film recording when, be the bitmap data using whole product display area as data source, with certain Frame per second bitmap data is acquired, be then fed into encoder carry out coded treatment, coding result is finally saved as into standard Video format.Wherein, encoder determines the coding compression performance of bitmap data the quality of whole film recording.
Film recording generally has 3 kinds of modes:Current active forms video recording, it is full frame video recording and freely specify region video recording.
Referring to Fig. 2 which shows this example carries out the example of product operation flow recording.As seen from the figure, it is shielded by recording Software come realize product operation flow record, record screen software start after first create MPEG4 encoder objects, then selection video recording Pattern, then proceed by video recording after choosing pattern, to MPEG4 encoders carry out initial configuration, encoder is according to configuration Information is then carried out accordingly every width screen bitmaps of acquisition with certain frame per second after determining the frame structure of ethnic group of MPEG4 video flowings Frame pattern coding, and the result of coding is write into video stream file according to MPEG4 videos flow structure during coding, most Afterwards video stream file is preserved after screen is recorded.
Accordingly, the idiographic flow for carrying out product operation flow recording is as follows:
(1) record screen software is started;
(2) MPEG4 encoder objects are created;
(3) selection record screen pattern:Current active forms video recording, it is full frame video recording and freely specify region video recording;
(4) basis then proceeds by video recording after choosing pattern;
(5) initial configuration is carried out to MPEG4 encoders;
(6) to video flowing write-in squence header;
(7) bitmap data is obtained;
(8) bitmap is sent to MPEG-4 encoders;
(9) judge whether to need to write GOPHeader, it is necessary to then be transferred to step (10) to video flowing;Need not, then it is transferred to Step (11);
(10) GOPHeader is write to video flowing;
(11) RGB is converted into YUV;
(12) current encoded frame type is judged:If P frames, step (13) is transferred to;If I frames, step (14) is transferred to;
(13) P frame PictureHeader are write to video flowing, and is transferred to step (15);
(14) to video flowing write-in I frames PictureHeader;
(15) macroblock partition is carried out, every macroblock size here is 16*16 pixels, comprising 4 as block;
(16) judge whether to write sliceHeader to video flowing:If so, it is transferred to step (17);If it is not, it is transferred to step (20);
(17) sliceHeader is write to video flowing;
(18) current encoded frame type is judged:If P frames, step 19 is transferred to;If I frames, step (20) is transferred to;
(19) motion compensated prediction is carried out, if prediction difference, is transferred to step (20);If motion vector, step is transferred to (27);
(20) will be split as block;
(21) dct transform is carried out;
(22) quantified;Need to carry out inverse quantization, be transferred to step (23), otherwise, be transferred to step (25);
(23) inverse quantization is carried out;
(24) idct transform is carried out, and is transferred to step (19);
(25) Zig-Zag scannings are carried out;
(26) process encoding is carried out;
(27) VLC is encoded;
(28) write to video flowing as block coding result;
(29) whether coded macroblocks encodes and finishes, if being transferred to step (30);If it is not, it is transferred to step (20);
(30) judge whether frame coding finishes, if so, being transferred to step (31);If it is not, it is transferred to step (15);
(31) judge whether to terminate record screen, if terminating record screen;If it is not, it is transferred to step (7).
Operator's behavior video data in this example to be formed by corresponding camera to record, can be by using JAVA Camera is opened based on Streaming Media frame J MF and realizes product operation personnel state real-time recording.
Accordingly, this example is when it is implemented, such as by the PC front cameras of calling operational network product to operator Activity is formed and recorded, and JAVA Streaming Medias frame (JMF) can be used to obtain camera video data, and basic step is as follows:
First, the information of video capture device is obtained;
Then, the facility information further according to acquirement determines the position of equipment.
Finally, after finding the position of equipment, the CreatePlayer methods of Manager create in invocation framenort Player, when Player is commenced play out, has begun to the process of capture.
Acquisition for capture device information, there is a variety of methods, can also inquire about spy by inquiring about the form specified Fixed device name.
Comprise the following steps that:
First all capture devices are recalled, obtain capture device list in vfw beginning device name be exactly to regard Frequency capture device;
Obtain the medialocator addresses of equipment;
Player is created, at the beginning of Play, has begun to the process of video capture;
It is video file to preserve camera data
For the above-mentioned user's operation video data gathered in real time, this example can carry out Audit data comparison, to ensure to produce The security that product use.
Since basic operation log audit data include operator, operating time and operation content, this example is by from adopting The video segment of corresponding period is extracted in the user's operation video data of collection to be compared, can by product operation flow video By the uniformity of definite operation content and operating time, can determine the uniformity of operator by operator's behavior video, Thus security that product uses is ensured.
From upper example, this example passes through the recording of product operation flow, operating personnel's behavior recording and traditional approach day The mode of will audit, which is combined, audits user's operation behavior, provides video reference for behavior auditing, ensures auditing result Reliability and security.
Basic principle, main feature and the advantages of the present invention of the present invention has been shown and described above.The technology of the industry Personnel are it should be appreciated that the present invention is not limited to the above embodiments, and the above embodiments and description only describe this The principle of invention, without departing from the spirit and scope of the present invention, various changes and modifications of the present invention are possible, these changes Change and improvement all fall within the protetion scope of the claimed invention.The claimed scope of the invention by appended claims and its Equivalent thereof.

Claims (5)

1. the user's operation behavior auditing method based on video acquisition, it is characterised in that the auditing method binding operation screen Video, operator's video audit user behavior with operation log.
2. user's operation behavior auditing method according to claim 1, it is characterised in that the auditing method passes through screen All operations form operation display video during recording record user's operation.
3. user's operation behavior auditing method according to claim 2, it is characterised in that when carrying out screen recording, continue Screen printing picture, and continuously Load Image, carry out screen video recording.
4. user's operation behavior auditing method according to claim 1, it is characterised in that the auditing method passes through shooting Record behavior state of the user during whole operation and form operator's video.
5. user's operation behavior auditing method according to claim 4, it is characterised in that in operator's video record, Streaming Media frame J MF is based on using JAVA and opens camera to operating personnel's state real-time recording, forms the video of user's operation Data.
CN201711240091.6A 2017-11-30 2017-11-30 A kind of user's operation behavior auditing method based on video acquisition Pending CN107948563A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711240091.6A CN107948563A (en) 2017-11-30 2017-11-30 A kind of user's operation behavior auditing method based on video acquisition

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711240091.6A CN107948563A (en) 2017-11-30 2017-11-30 A kind of user's operation behavior auditing method based on video acquisition

Publications (1)

Publication Number Publication Date
CN107948563A true CN107948563A (en) 2018-04-20

Family

ID=61948028

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711240091.6A Pending CN107948563A (en) 2017-11-30 2017-11-30 A kind of user's operation behavior auditing method based on video acquisition

Country Status (1)

Country Link
CN (1) CN107948563A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102768845A (en) * 2011-05-03 2012-11-07 中国移动通信集团公司 Video index method and system
JP2013045280A (en) * 2011-08-24 2013-03-04 Nippon Signal Co Ltd:The Method for displaying operation moving picture and operation and motion log
CN105843848A (en) * 2016-03-14 2016-08-10 上海沪景信息科技有限公司 Business monitoring data processing method, system, database system and electronic equipment
CN106330919A (en) * 2016-08-26 2017-01-11 国家电网公司 Operation and maintenance safety auditing method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102768845A (en) * 2011-05-03 2012-11-07 中国移动通信集团公司 Video index method and system
JP2013045280A (en) * 2011-08-24 2013-03-04 Nippon Signal Co Ltd:The Method for displaying operation moving picture and operation and motion log
CN105843848A (en) * 2016-03-14 2016-08-10 上海沪景信息科技有限公司 Business monitoring data processing method, system, database system and electronic equipment
CN106330919A (en) * 2016-08-26 2017-01-11 国家电网公司 Operation and maintenance safety auditing method and system

Similar Documents

Publication Publication Date Title
WO2018150024A1 (en) Method for image processing and video compression
US8625973B2 (en) Method and apparatus for operating a video system
CN101860731B (en) Video information processing method, system and server
Liu et al. Visual quality assessment: recent developments, coding applications and future trends
DE69907798T2 (en) Converting compressed images
CN108259934B (en) Method and apparatus for playing back recorded video
AU2022246412A2 (en) A method and apparatus for conducting surveillance
DE69732089T2 (en) DEVICE AND METHOD FOR THE TIMELY AND SPATIAL INTEGRATION AND MANAGEMENT OF A VARIETY OF VIDEOS AND STORAGE MEDIUM FOR STORING A PROGRAM THEREFOR
CN111787398A (en) Video compression method, device, equipment and storage device
Yeo Efficient processing of compressed images and video
Liang et al. Detection of double compression for HEVC videos with fake bitrate
CN108833938A (en) Method and apparatus for selecting video cover
Johnston et al. Video tampering localisation using features learned from authentic content
KR102090785B1 (en) syntax-based method of providing inter-operative processing with video analysis system of compressed video
KR102187376B1 (en) syntax-based method of providing selective video surveillance by use of deep-learning image analysis
DE60312711T2 (en) METHOD AND DEVICE FOR CODING PICTURE AND / OR AUDIO DATA
CN111277800A (en) Monitoring video coding and playing method and device, electronic equipment and storage medium
CN106454388A (en) Method and device for determining live broadcast setting information
Unterweger et al. Building a post-compression region-of-interest encryption framework for existing video surveillance systems: Challenges, obstacles and practical concerns
CN206117878U (en) Intelligent video analysis device, equipment and video monitor system
CN107483916A (en) The control method of audio frequency and video archival quality detecting system
CN107948563A (en) A kind of user's operation behavior auditing method based on video acquisition
WO2020171388A2 (en) Method of identifying abnormal motion object in compressed image using motion vector trajectory and pattern
CN107666610A (en) Desktop video content analysis method
CN104125430B (en) Video moving object detection method, device and video monitoring system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180420

RJ01 Rejection of invention patent application after publication