CN107734305A - It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show - Google Patents
It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show Download PDFInfo
- Publication number
- CN107734305A CN107734305A CN201711059349.2A CN201711059349A CN107734305A CN 107734305 A CN107734305 A CN 107734305A CN 201711059349 A CN201711059349 A CN 201711059349A CN 107734305 A CN107734305 A CN 107734305A
- Authority
- CN
- China
- Prior art keywords
- information
- unit
- project
- construction
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/96—Tree coding, e.g. quad-tree coding
Abstract
The present invention provides a kind of electric power construction field informationization monitoring system commanded using remote speech with job site various dimensions solid show, including Web ends backstage, Cloud Server and mobile terminal application system, wherein：Web ends backstage, the details of project under construction and the periodically typing of plan can be carried out to Cloud Server by Web ends backstage by network connection, administrative staff with the Cloud Server；Mobile terminal application system, with the Cloud Server wireless connection, including module of registering, project management module, mapping module and remote speech video directing module；Cloud Server, for from the synchronizing information of Web ends backstage typing to the mobile terminal application system, the project construction information will to be stored, job site register information and project statistical information, receive and send the job site live video data stream.The present invention can carry out the management of real-time, specification and various dimensions to job site.
Description
Technical Field
The invention relates to the field of electric power construction management, in particular to an electric power construction site informatization monitoring system using remote voice command and construction site multidimensional three-dimensional display.
Background
At present, china is in a rapid development stage, infrastructure construction is increased all over the country, electric power facility construction is in a high-speed development stage, a plurality of electric power projects are often started and constructed simultaneously, safety supervision is not sufficient, and therefore potential safety hazards exist in construction sites and construction quality. The video monitoring transmission technology applied to the electric power construction site at present has defects in the aspects of real-time supervision, progress mastering, site commanding and the like. Meanwhile, the signal quality of a construction site causes the problems of jamming, noise point and the like of a monitored image. In addition, some construction sites do not have monitoring equipment, and remote management personnel cannot know the site situation. Therefore, real-time, standardized, and multidimensional management of the power construction site is very important.
Meanwhile, the video surveillance of the existing construction site is limited by factors such as monitoring equipment, network lines and the like, the situations of jamming, poor image quality and the like occur, monitoring dead angles exist, meanwhile, remote management personnel cannot conduct real-time command on the site, and errors occurring in the construction process cannot be corrected in time.
Disclosure of Invention
In view of the above problems, the present invention aims to provide an electric power construction site informatization monitoring system using remote voice command and construction site multidimensional stereo display.
The purpose of the invention is realized by adopting the following technical scheme:
the utility model provides an use electric power construction site information-based monitored control system of long-range voice command and job site multidimension degree three-dimensional show, includes Web end backstage, cloud ware and mobile terminal application system, wherein:
the Web end background is connected with the cloud server through a network, and managers can input detailed information of construction projects and periodic plans into the cloud server through the Web end background;
the mobile terminal application system is in wireless connection with the cloud server and comprises a sign-in module, a project management module, a map module and a remote voice and video command module;
the sign-in module is used for signing in, signing out and recording construction site information for construction site personnel, acquiring relevant construction site sign-in information and project construction information, uploading the relevant construction site sign-in information and the project construction information to the cloud server and sending the relevant construction site sign-in information and the project construction information to the project management module;
the project management module is used for counting and managing the project construction information, the sign-in information of the construction site, the detailed information of the construction project and the periodic plan, and synchronizing the obtained statistical information to the cloud server;
the map module is used for displaying on a map according to the project construction information and the job site sign-in information;
the remote voice and video command module is used for a construction site worker to initiate live construction site broadcast, and a manager to watch the live construction site broadcast and perform remote voice guidance;
and the cloud server is used for synchronizing the information input from the Web end background to the mobile terminal application system, storing the project construction information, the job site check-in information and the project statistical information, and receiving and sending the live construction video data stream.
The beneficial effects of the invention are as follows:
(1) The system is convenient for construction responsible persons, management and control responsible persons and safety supervision responsible persons to respectively take their own functions in a construction site, and multi-dimensional and three-dimensional power construction site management is realized;
(2) The system has strong real-time performance and interactive information management and control of engineering progress and performance. The server data is communicated with the mobile phone application and the Web background, and engineering management statistics is carried out, so that managers, leaders and the like can see the management condition of a construction site in real time;
(3) The system can carry out live video broadcasting of a construction site and remote command in real time, so that remote personnel can command the site construction condition through voice and correct errors possibly occurring in the construction process in time.
Drawings
The invention is further illustrated by means of the attached drawings, but the embodiments in the drawings do not constitute any limitation to the invention, and for a person skilled in the art, other drawings can be obtained on the basis of the following drawings without inventive effort.
FIG. 1 is a frame structure of the present invention;
FIG. 2 is a block diagram of a mobile terminal application system according to the present invention;
FIG. 3 is a schematic diagram of one embodiment of the present invention;
FIG. 4 is a schematic diagram of one embodiment of the present invention;
fig. 5 is a block diagram of a HEVC video coding unit according to the present invention.
Reference numerals:
the system comprises a Web end background 1, a cloud server 2, a mobile terminal application system 3, a check-in module 31, a project management module 32, a map module 33, a remote voice video command module 34, a construction check-in unit 310, a management check-in unit 312, a security supervision check-in unit 314, a report unit 320, a project statistic unit 322, a video acquisition unit 340, an HEVC video coding unit 342, a data stream unit 344, an intra-frame prediction coding sub-unit 3420, an inter-frame prediction coding sub-unit 3421 and a quantization processing sub-unit 3422.
Detailed Description
The invention is further described in connection with the following application scenarios.
Referring to fig. 1-2, in an embodiment of the present invention, an electric power construction site informatization monitoring system using remote voice command and construction site multidimensional stereo display is provided, including a Web end background 1, a cloud server 2 and a mobile terminal application system 3, wherein:
the Web end background 1 is connected with the cloud server 2 through a network, and managers can input detailed information of construction projects and periodic plans into the cloud server 2 through the Web end background 1;
the mobile terminal application system 3 is in wireless connection with the cloud server 2 and comprises a sign-in module 31, a project management module 32, a map module 33 and a remote voice and video command module 34;
the sign-in module 31 is used for allowing construction site personnel to sign in, sign out and record construction site information, acquiring relevant construction site sign-in information and project construction information, uploading the relevant construction site sign-in information and project construction information to the cloud server 2 and sending the construction site sign-in information and project construction information to the project management module 32;
the project management module 32 is configured to count and manage the project construction information, job site sign-in information, construction project detailed information, and periodic plan, and synchronize the acquired statistical information to the cloud server 2;
the map module 33 is configured to display on a map according to the project construction information and the job site check-in information;
the remote voice and video command module 34 is used for a construction site worker to initiate live construction site broadcast, and a manager to watch the live construction site broadcast and perform remote voice guidance;
and the cloud server 2 is used for synchronizing the information input from the Web end background 1 to the mobile terminal application system 3, storing the project construction information, the job site check-in information and the project statistical information, and receiving and sending the live construction video data stream.
According to the embodiment of the invention, the construction responsible person, the management and control responsible person and the safety supervision responsible person can respectively take their own duties in the construction site conveniently, and the multidimensional and three-dimensional power construction site management is realized; the method has the advantages of strong real-time performance and interactive information management and control of project progress and performance. The server is in data communication with the mobile phone end application and the Web background, and carries out engineering management statistics, so that managers, leaders and the like can see the management condition of a construction site in real time; the construction site and remote commanding video live broadcast can be carried out in real time, so that remote personnel can timely correct errors possibly occurring in the construction process through voice command of site construction conditions.
In another embodiment of the present invention, the check-in module 31 includes a construction check-in unit 310, a control check-in unit 312 and a safety supervision check-in unit 314, and the construction site check-in information includes check-in, check-out time and positioning information;
the construction sign-in unit 310 is used for signing in after a construction site person in charge arrives at the site, acquiring detailed information and a periodic plan of a construction project from the cloud server 2 end, selecting a construction project, and counting the number of construction persons; after the construction of the current day is finished, signing out and filling related project construction information; the construction check-in unit 310 uses the GPS to locate the acquired accurate check-in place in real time; the construction check-in unit 310 uploads the acquired check-in information, check-out information, construction number and related project construction information to the cloud server 2 and sends the information to the project management module 32 for data statistics;
the control sign-in unit 312 is used for signing in after a control worker is in place, selecting a construction project, uploading a construction site photo and judging a risk level; signing out after construction and bottom delivery in the same day; the control sign-in unit 312 uploads the acquired construction site pictures and evaluation risk levels to the cloud server 2 and sends the pictures and evaluation risk levels to the project management module 32 for data statistics;
the safety supervision sign-in unit 314 is used for safety supervision staff to sign in after arriving at a site, and the safety supervision staff mainly records the number of the co-workers and the information of the co-workers; signing out after construction and bottom delivery in the same day; the security monitoring sign-in unit 314 uploads the acquired number of the persons in the same row and the information of the persons in the same row to the cloud server 2 and sends the information to the project management module 32 for data statistics.
According to the embodiment of the invention, referring to fig. 4, a product manager inputs detailed information of projects and related plans through a Web end background and synchronizes data to a cloud server, and a job site responsible person, a management and control person and a safety supervision person respectively acquire related information of the projects from the cloud server through a mobile terminal application system, record daily job site sign-in information and project construction information, and synchronize data to the cloud server.
In another embodiment of the present invention, the project management module 32 includes a reporting unit 320 and a project statistics unit 322, wherein:
the report unit 320 is configured to perform statistics according to the data obtained from the construction check-in unit 310, the control check-in unit 312, and the safety supervision check-in unit 314, and generate a report;
the project counting unit 322 is used for counting the project construction information, displaying the progress and project early warning of each construction project according to the detailed information of the construction project and the periodic plan, and counting the project inventory number, the constructed project number, the finished project number, the project operating rate and the project completion rate.
In another embodiment of the present invention, the map module 33 is configured to display, according to the project construction information and the job site check-in information, on a map, specifically: the map module 33 acquires the job site sign-in information and the project construction information acquired from the sign-in module 31 by using a high-grade map interface, displays the job site sign-in information and the project construction information acquired from the sign-in module 31 on a map by modifying the map style, and has the functions of screening, counting and searching.
In the embodiment of the invention, referring to fig. 5, a product manager inputs detailed information of a project and a related plan through a Web end background and synchronizes data to a cloud server, a job site responsible person, a management and control person and a safety supervision person respectively acquire the related information of the project from the cloud server through a mobile terminal application system, record daily job site sign-in information and project construction information, synchronize the data to the cloud server, a high-resolution map interface is accessed to the front end of the mobile terminal application system, and the mobile terminal application system calls the high-resolution map interface and presents the data in a map module.
In another embodiment of the present invention, the remote voice video command module 34 comprises a video capture unit 340, an hevc video coding unit 342 and a data stream unit 344, wherein:
the video acquisition unit 340 is used for acquiring a video image of a construction site;
the HEVC video coding unit 342 is configured to code the collected construction site video image to obtain a live video data stream;
the data streaming unit 344 is configured to send the live video data stream to the cloud server 2 in real time.
The HEVC is an abbreviation of High Efficiency Video Coding, is an international Video compression standard, and can be used to replace the h.264 Video compression standard in the prior art.
In another embodiment of the present invention, referring to fig. 3, the HEVC video coding unit 342 encodes video in HEVC quadtree coding structure, and includes an intra prediction coding sub-unit 3420, an inter prediction coding sub-unit 3421, and a quantization processing sub-unit 3422, where:
the intra-frame prediction encoding subunit 3420 is configured to predict a current block to be encoded by using surrounding encoded pixels according to correlation between adjacent pixels in a single frame image, and obtain intra-frame prediction information;
the inter-frame prediction encoding subunit 3421 is configured to perform motion estimation and motion compensation on the current frame image by using a previously encoded reconstructed frame as a reference frame according to a correlation between adjacent frames in the image time domain, so as to obtain inter-frame prediction information;
a quantization processing subunit 3422, configured to perform conversion, sampling, quantization, and entropy coding processing on the prediction information obtained by the intra-frame prediction coding subunit 3420 or the inter-frame prediction coding subunit 3421 and the residual data obtained by the block to be coded in sequence, so as to obtain a live video data stream.
In another embodiment of the present invention, the determination of the size of the prediction unit in the intra-prediction coding sub-unit 3420 specifically includes:
(1) Setting the size of a coding tree unit CTU of an HEVC video coding unit 342 to be 64 multiplied by 64, and counting the number of the coding tree units CTU contained in an input single-frame image;
(2) Performing fast Fourier transform on each coding tree unit CTU of the image, and acquiring a significance image S of each coding tree unit CTU by adopting the following self-defined function n (x)；
S i (x)＝g(x)·F -1 [exp(R i (ω)+P i (ω))]
Wherein, the first and the second end of the pipe are connected with each other,
R i (ω)＝L i (ω)-h i (ω)*L i (ω)
in the formula, S i (x) Representing a salient image, P i (omega) represents the phase spectrum obtained by the coding tree unit CTU after fast Fourier transform, R i (ω) represents the residual spectrum, L i (omega) represents an amplitude spectrum obtained by performing fast Fourier transform on the part of the code tree unit CTU, performing square sum evolution to be compensated and taking log logarithm of the square sum evolution, and h i (ω) represents the convolution kernel of the mean filtering, F -1 Representing an inverse fast Fourier transform function, g (x) representing a Gaussian blur filter function;
(3) Calculating current significance image S by adopting information entropy function i (x) And the information entropy of 4 subblocks arranged in a 2 multiplied by 2 way, comparing the entropy value of each block, determining whether the current block is subjected to subblock division processing, and selecting the optimal division result from 64 multiplied by 64 to 4 multiplied by 4 for the size of a prediction unit PU according to the information entropy result calculated by each subblock, wherein:
the information entropy function used is:
wherein E represents information entropy, P j Representing the probability of having a grey value j appearing in the image, j representing the grey value;
obtaining the current saliency image S i (x) The information entropy result is used as a father block, the information entropy result is compared with the information entropy of four sub-blocks of the father block, if the difference of the information entropy values of the four sub-blocks is not more than 10% and is less than the information entropy of the father block, the division is ended, the father block is used for carrying out intra-frame prediction and coding, if the information entropy value of any one sub-block is more than the information entropy of the father block or the information entropy of any one sub-block is more than 10% compared with the information entropy of other sub-blocks, the father block needs to be divided, and the method is suitable for carrying out intra-frame prediction and coding by using the sub-blocks; and in the same way, taking the subblock above as a root node of the quadtree, comparing the information entropy with the quadtree subblock, and judging whether the subblock needs to be divided until the size of the PU (prediction Unit) is 4 multiplied by 4. At this decisionIf the size of the prediction unit PU suitable for segmentation is found in the loop process of (1), the loop process is skipped, and the above-mentioned determination process is performed on each coding tree unit CTU of the picture to achieve the purpose of determining the segmentation size in advance.
(4) The saliency image S i (x) The block division result is applied to the corresponding coding tree unit CTU to obtain the final optimal prediction division result of the coding tree unit CTU.
The HEVC video coding unit divides each frame of image into Coding Tree Units (CTUs) which are not overlapped with each other, the Coding Tree Units (CTUs) can also be continuously decomposed into Coding Units (CU), and the coding units can be continuously decomposed into Prediction Units (PU) and Transformation Units (TU); the coding tree unit CTU is the largest coding processing unit supported by the HEVC video coding unit; the coding unit CU is the most basic unit of the HEVC formed after the coding tree units CTU are divided according to the quad-tree coding structure, and after each CTB is divided by the quad-tree structure, the coding unit CU which is positioned at the top end of the quad-tree and has the coding depth of 0 is called as a maximum coding unit LCU; when HEVC is coded, each coding unit CU is divided into a prediction unit PU and a transformation unit TU according to a syntax structure defined by realization and participates in coding work; the prediction unit PU is the most basic unit used by HEVC in intra/inter prediction, is obtained by being divided by a coding unit CU, and can only be in a square shape during intra prediction, and can be divided into rectangles during inter prediction coding.
In the embodiment of the invention, in an HEVC quad-tree coding structure, the method is adopted to judge the size of a prediction unit in an HEVC intra-frame prediction coding subunit, accurately obtain the optimal coding depth of each block to be coded, determine the size of each encoder, and then perform intra-frame prediction coding on the encoder, so that the accuracy of intra-frame prediction coding can be improved, the accuracy of the coding unit for eliminating the spatial redundancy of video image signals is improved, the efficiency of intra-frame prediction coding is improved, and a foundation is provided for ensuring the real-time performance of video live broadcast in a construction site.
In another embodiment of the present invention, the inter-frame prediction encoding sub-unit 3421 further selects different inter-frame prediction modes for inter-frame prediction according to the region motion characteristics of the image, specifically:
(1) And performing inter-frame prediction coding depth judgment on each coding tree unit CTU to be coded, and determining the optimal coding depth of each coding unit CU.
(2) Calculating the regional motion characteristics (RMF) of each Coding Unit (CU) of the selected coding depth d Wherein, the adopted regional motion characteristic function is as follows;
in the formula, RMF d Representing the characteristic of the motion of a region at a coding depth d, CU cur(x,y) Representing the pixel value, CU, at a pixel point (x, y) col(x,y) Representing the pixel value, L, of a matching block at pixel point (x, y) in the encoded reference frame mv Representing the inter-frame motion amplitude of the current block, obtained by the 2-norm of the motion vector, Q p Representing the quantization step size, N d Representing the side length of a Coding Unit (CU) block at the current depth, and d representing the coding depth;
(3) According to a preset threshold value TH 1 、TH 2 Determining the motion area thereof:
if RMF d <TH 1 If the current CU belongs to a gentle motion area, taking SKIP/merge, inter 2 Nx 2N and intra 2Nx 2N as candidate Inter-frame prediction modes, and entering the step (4);
if TH is 1 <RMF d <TH 2 Taking SKIP/merge, inter 2 Nx 2N, SMP and intra modes as candidate Inter prediction modes when the current CU belongs to a moderate motion area, and entering the step (4);
if RMF d >TH 2 The current CU belongs to a complex motion area, and all the inter prediction modes are candidate modesEntering step (4), wherein all inter prediction modes include: SKIP/merge, square, SMP, AMP, and intra modes;
(4) And performing rate distortion cost comparison on the candidate modes, and selecting the mode with the minimum expected distortion as the optimal inter-frame prediction mode to perform inter-frame prediction.
In the embodiment of the invention, the method is adopted to select different inter-frame prediction modes according to the motion characteristics of the video image, so that accurate classification can be performed according to the motion characteristics of the blocks to be coded, unnecessary inter-frame prediction modes are eliminated according to different classifications, and the complexity of unit operation is reduced.
In another embodiment of the present invention, in the inter-frame prediction coding sub-unit 3421, inter-frame prediction coding depth determination is performed on each coding tree unit CTU to be coded, and the optimal coding depth of each coding unit CU is determined, specifically:
calculating the residual error of the coding tree unit CTU at the same position with the adjacent frame in each coding tree unit CTU of 64 x 64, and counting the proportion xi of the largest coding unit LCU occupied by non-zero value, and comparing it with the set threshold TH L A comparison is made, wherein the largest coding unit LCU size is 64 x 64:
preferably, the threshold value TH L ＝5％；
When xi is less than or equal to TH L And judging that the similarity of the LCU at the same position between the adjacent frames is higher, and adopting the current LCU to perform the following operation without deeply dividing the current LCU to the lower layer.
When xi>TH L Then, if the similarity of the largest coding unit LCU at the same position between adjacent frames is determined to be small, the current largest coding unit LCU needs to perform a further decision process, which specifically includes:
(1) Calculating frame difference dispersion FDD of current coding unit CU d And frame difference dispersion FDD of four subblocks thereof d+1 The frame difference dispersion function is adopted as follows:
in the formula, FDD d A frame difference dispersion representing the current depth d,represents the pixel value at the coordinate (x, y) position in the coding unit CU,represents the pixel value, M, at the coordinate (x, y) position of the neighboring frame co-location coding unit CU d Representing the current coded depth index, where M d ＝2 d ，N d Representing a side length of a coding unit, CU, block at a current depth;
(2) If it is notOr FDD of 4 sub-blocks d+1 When the size difference exceeds 10%, judging that the current coding unit CU is divided into four units, and returning to the step (1) to process each sub-unit;
(3) If it is notAnd FDD of four sub-blocks d+1 And when the size difference does not exceed 10%, judging that the segmentation process is terminated, and performing further inter-frame prediction and coding processing by adopting the depth d of the current coding unit CU.
In the above embodiment of the present invention, in the HEVC quadtree coding structure, when inter-frame prediction coding is performed, the depth of each coding unit CU included in each coding tree unit CTU is reasonably allocated by using the above method, wherein the coding depth of each coding unit CU can be accurately determined by using the frame difference dispersion between adjacent frames as a basis, so as to determine the size of the coding unit CU to be used, and lay a foundation for the inter-frame prediction coding of a video in a subsequent unit.
Finally, it should be noted that the above embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the protection scope of the present invention, although the present invention is described in detail with reference to the preferred embodiments, it should be analyzed by those skilled in the art that modifications or equivalent substitutions can be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.
Claims (8)
1. The utility model provides an use electric power construction site information-based monitored control system of long-range voice command and job site multidimension degree three-dimensional show which characterized in that, includes Web end backstage, cloud ware and mobile terminal application system, wherein:
the Web end background is connected with the cloud server through a network, and managers can input detailed information of construction projects and periodic plans into the cloud server through the Web end background;
the mobile terminal application system is in wireless connection with the cloud server and comprises a sign-in module, a project management module, a map module and a remote voice and video command module;
the sign-in module is used for signing in, signing out and recording construction site information for construction site personnel, acquiring relevant construction site sign-in information and project construction information, uploading the relevant construction site sign-in information and the project construction information to the cloud server and sending the relevant construction site sign-in information and the project construction information to the project management module;
the project management module is used for counting and managing the project construction information, the construction site check-in information, the detailed information of the construction project and the periodic plan, and synchronizing the obtained statistical information to the cloud server;
the map module is used for displaying on a map according to the project construction information and the construction site check-in information;
the remote voice and video command module is used for a construction site worker to initiate live construction site broadcast, and a manager to watch the live construction site broadcast and perform remote voice guidance;
and the cloud server is used for synchronizing the information input from the Web end background to the mobile terminal application system, storing the project construction information, the job site check-in information and the project statistical information, and receiving and sending the live construction video data stream.
2. The electric power construction site informatization monitoring system using remote voice command and construction site multidimensional stereo display is characterized in that the check-in module comprises a construction check-in unit, a control check-in unit and a security monitoring check-in unit; the construction site sign-in information comprises sign-in time, sign-out time and positioning information; wherein: the sign-in module includes that the construction signs in the unit, management and control sign-in unit and the safety supervision sign-in unit supply the construction site person of charge, management and control personnel and the safety supervision personnel respectively to carry out the entering of construction site information of signing in and project construction information.
3. The system of claim 1, wherein the project management module comprises a report unit and a project statistic unit, wherein:
the report unit is used for counting and generating a report according to the data acquired from the construction check-in unit, the control check-in unit and the safety supervision check-in unit;
and the project counting unit is used for counting the project construction information, displaying the progress and project early warning of each construction project according to the detailed information and the periodic plan of the construction project, and counting the number of project inventories, the number of constructed projects, the number of finished projects, the project operating rate and the project completion rate.
4. The system according to claim 1, wherein the map module is configured to display on a map according to the project construction information and the job site check-in information, and specifically includes: the map module acquires the job site sign-in information and the project construction information acquired from the sign-in module by using a high-grade map interface, displays the job site sign-in information and the project construction information acquired from the sign-in module on a map by modifying the map style, and meanwhile, the map has the functions of screening, counting and searching.
5. The system of claim 1, wherein the remote video/voice command module comprises a video capture unit, an HEVC video coding unit and a data stream unit, and wherein:
the video acquisition unit is used for acquiring a video image of a construction site;
the HEVC video coding unit is used for coding the collected construction site video images to obtain a live video data stream;
and the data stream unit is used for transmitting the live video data stream to a cloud server in real time.
6. The system according to claim 5, wherein the HEVC video coding unit encodes a video by adopting an HEVC quad-tree coding structure, and comprises an intra-frame predictive coding subunit, an inter-frame predictive coding subunit and a quantization processing subunit, wherein:
the intra-frame prediction coding subunit is used for predicting a current block to be coded by using pixels which are coded around according to the correlation between adjacent pixels in a single-frame image to acquire intra-frame prediction information;
the inter-frame prediction coding subunit is used for performing motion estimation and motion compensation on the current frame image by using a previously coded reconstructed frame as a reference frame according to the correlation between adjacent frames in the image time domain to acquire inter-frame prediction information;
and the quantization processing subunit is used for sequentially carrying out conversion, sampling, quantization and entropy coding on the prediction information obtained by the intra-frame prediction coding subunit or the inter-frame prediction coding subunit and residual data obtained by the blocks to be coded so as to obtain the live video data stream.
7. The system according to claim 6, wherein the determination of the prediction unit size in the intra-frame prediction coding subunit is specifically:
(1) Setting the size of a Coding Tree Unit (CTU) of an HEVC video coding unit to be 64 multiplied by 64, and counting the number of the CTUs contained in an input single-frame image;
(2) Carrying out fast Fourier transform on each coding tree unit CTU of the image, and acquiring a significant image S of each coding tree unit CTU by adopting the following custom function n (x)；
S i (x)＝g(x)·F -1 [exp(R i (ω)+P i (ω))]
Wherein the content of the first and second substances,
R i (ω)＝L i (ω)-h i (ω)*L i (ω)
in the formula, S i (x) Representing a salient image, P i (omega) represents the phase spectrum obtained by the coding tree unit CTU after fast Fourier transform, R i (ω) represents the residual spectrum, L i (omega) represents an amplitude spectrum obtained by performing fast Fourier transform on the part of the code tree unit CTU, performing square sum evolution to be compensated and taking log logarithm of the square sum evolution, and h i (ω) represents the convolution kernel of the mean filtering, F -1 Representing an inverse fast Fourier transform function, g (x) representing a Gaussian blur filter function;
(3) Calculating current saliency image S by using information entropy function i (x) And the information entropy of 4 subblocks arranged in a 2 multiplied by 2 mode, comparing the entropy value of each block, determining whether the current block is subjected to subblock division processing, and selecting an optimal division result from 64 multiplied by 64 to 4 multiplied by 4 for the size of a Prediction Unit (PU) according to the information entropy result calculated by each subblock, wherein:
the information entropy function used is:
wherein E represents information entropy, P j Representing the probability of having a grey value j appearing in the image, j representing the grey value;
the obtained current saliency image S i (x) The information entropy result of the father block is compared with the information entropy values of the four sub blocks, if the difference of the information entropy values of the four sub blocks is not more than 10% and is smaller than the information entropy of the father block, the division is ended, the father block is adopted for intra-frame prediction and encoding, if the information entropy value of any one sub block is larger than the information entropy of the father block or the information entropy of any one sub block is larger than 10% compared with other sub blocks, the father block needs to be divided, and the method is suitable for intra-frame prediction and encoding by adopting the sub blocks; in this way, the sub-block above is taken as the root node of the quadtree, the information entropy of the sub-block is compared with the quadtree sub-block, and whether the sub-block needs to be divided is judged until the size of the prediction unit PU is 4 × 4. In the cyclic process of this determination, if the size of the prediction unit PU suitable for the segmentation is found, the cyclic process is skipped, and the above-mentioned determination process is performed for each coding tree unit CTU of the picture, so as to achieve the purpose of determining the segmentation size in advance.
(4) The saliency image S i (x) The block division result is applied to the corresponding coding tree unit CTU to obtain the final optimal prediction division result of the coding tree unit CTU.
8. The system according to claim 6, wherein the inter-frame prediction encoding subunit further selects different inter-frame prediction modes for inter-frame prediction according to the regional motion characteristics of the image, specifically:
(1) And performing inter-frame prediction coding depth judgment on each coding tree unit CTU to be coded, and determining the optimal coding depth of each coding unit CU.
(2) Calculating the regional motion characteristics (RMF) of each Coding Unit (CU) of the selected coding depth d Wherein, the adopted regional motion characteristic function is;
in the formula, RMF d Representing the characteristic of the motion of a region at a coding depth d, CU cur(x,y) Representing the pixel value at a pixel point (x, y), CU col(x,y) Representing the pixel value, L, of a matching block at pixel point (x, y) in the encoded reference frame mv Representing the inter-frame motion amplitude of the current block, obtained by the 2 norm of the motion vector, Q p Representing the quantization step size, N d Representing the side length of a Coding Unit (CU) block at the current depth, and d representing the coding depth;
(3) According to a preset threshold value TH 1 、TH 2 Determining the motion region thereof:
if RMF d <TH 1 Taking SKIP/merge, inter 2 Nx 2N and intra 2Nx 2N as candidate Inter-frame prediction modes when the current CU belongs to a gentle motion area;
if TH is 1 <RMF d <TH 2 Taking SKIP/merge, inter 2 Nx 2N, SMP and intra modes as candidate Inter-frame prediction modes when the current CU belongs to a moderate motion area;
if RMF d >TH 2 The current CU belongs to a complex motion region, and all inter prediction modes are candidate modes, where all inter prediction modes include: SKIP/merge, square, SMP, AMP, and intra modes;
(4) And carrying out rate distortion cost comparison on the candidate modes, and selecting the mode with the minimum expected distortion as the optimal inter-frame prediction mode to carry out inter-frame prediction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711059349.2A CN107734305A (en) | 2017-11-01 | 2017-11-01 | It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711059349.2A CN107734305A (en) | 2017-11-01 | 2017-11-01 | It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107734305A true CN107734305A (en) | 2018-02-23 |
Family
ID=61221989
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711059349.2A Pending CN107734305A (en) | 2017-11-01 | 2017-11-01 | It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107734305A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961627A (en) * | 2018-06-11 | 2018-12-07 | 苏州工业园区金禾电气设备有限公司 | Electric power equipment on-site security warning information issuing method |
| CN109302616A (en) * | 2018-10-09 | 2019-02-01 | 北京佳讯飞鸿电气股份有限公司 | A kind of HEVC Inter Prediction High-speed Algorithm based on RC prediction |
| CN113435656A (en) * | 2021-07-06 | 2021-09-24 | 郑州航空工业管理学院 | Visual management method and system for project progress |
| CN114418555A (en) * | 2022-03-28 | 2022-04-29 | 四川高速公路建设开发集团有限公司 | Project information management method and system applied to intelligent construction |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873861A (en) * | 2014-02-24 | 2014-06-18 | 西南交通大学 | Coding mode selection method for HEVC (high efficiency video coding) |
| CN104156812A (en) * | 2014-08-04 | 2014-11-19 | 江苏鼎思科技发展有限公司 | Construction project construction site original data acquisition system and acquisition method |
| CN106127409A (en) * | 2016-07-04 | 2016-11-16 | 中国科学院深圳先进技术研究院 | A kind of remote power cooperation interaction method and system based on intelligent glasses |
| CN106408187A (en) * | 2016-09-13 | 2017-02-15 | 安徽广行物联科技有限公司 | Transparent regulation system for interior decoration design and construction |
-
2017
- 2017-11-01 CN CN201711059349.2A patent/CN107734305A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103873861A (en) * | 2014-02-24 | 2014-06-18 | 西南交通大学 | Coding mode selection method for HEVC (high efficiency video coding) |
| CN104156812A (en) * | 2014-08-04 | 2014-11-19 | 江苏鼎思科技发展有限公司 | Construction project construction site original data acquisition system and acquisition method |
| CN106127409A (en) * | 2016-07-04 | 2016-11-16 | 中国科学院深圳先进技术研究院 | A kind of remote power cooperation interaction method and system based on intelligent glasses |
| CN106408187A (en) * | 2016-09-13 | 2017-02-15 | 安徽广行物联科技有限公司 | Transparent regulation system for interior decoration design and construction |
Non-Patent Citations (1)
| Title |
|---|
| 冯磊: "数字视频的HEVC编码快速算法的研究", 《中国优秀博士论文全文数据库》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961627A (en) * | 2018-06-11 | 2018-12-07 | 苏州工业园区金禾电气设备有限公司 | Electric power equipment on-site security warning information issuing method |
| CN109302616A (en) * | 2018-10-09 | 2019-02-01 | 北京佳讯飞鸿电气股份有限公司 | A kind of HEVC Inter Prediction High-speed Algorithm based on RC prediction |
| CN113435656A (en) * | 2021-07-06 | 2021-09-24 | 郑州航空工业管理学院 | Visual management method and system for project progress |
| CN113435656B (en) * | 2021-07-06 | 2023-05-30 | 郑州航空工业管理学院 | Project progress visual management method and system |
| CN114418555A (en) * | 2022-03-28 | 2022-04-29 | 四川高速公路建设开发集团有限公司 | Project information management method and system applied to intelligent construction |
| CN114418555B (en) * | 2022-03-28 | 2022-06-07 | 四川高速公路建设开发集团有限公司 | Project information management method and system applied to intelligent construction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103609121B (en) | Pattern of integrating and the selection of adaptive motion vector predictive mode candidate | |
| CN107734305A (en) | It is a kind of to use remote speech commander and the electric power construction field informationization monitoring system of job site various dimensions solid show | |
| CN103444176B (en) | Coding of transform coefficients for video coding | |
| CN103609118B (en) | Parallelization close friend for video coding merges candidate | |
| CN103430539B (en) | Decoded picture buffer management | |
| CN103636215B (en) | Video data application non-square is converted | |
| CN104969552B (en) | The reduced intra prediction mode decision of storage | |
| CN104396247B (en) | Method and apparatus for the adaptive loop filter based on LCU of video coding | |
| CN103339935B (en) | Motion vector prediction | |
| CN104937936A (en) | Mode decision simplification for intra prediction | |
| CN108605124A (en) | A kind of method and device of coding and decoding video | |
| CN107566848A (en) | The method and device of encoding and decoding | |
| CN105532007A (en) | Adaptive deblocking filtering for non-luma components in video coding | |
| CN103636202A (en) | Quantization parameter prediction in video coding | |
| CN103931192A (en) | Method and device for determining motion vector for video coding or video decoding | |
| CN104137546A (en) | Signaling quantization matrices for video coding | |
| CN104756499A (en) | Reference picture status for video coding | |
| CN106998470A (en) | Coding/decoding method, coding method, decoding device and encoding device | |
| CN106664411A (en) | Motion-compensated partitioning | |
| CN105357523B (en) | One kind being based on HOSVD algorithm video compression system and method | |
| WO2018170793A1 (en) | Method and apparatus for decoding video data, and method and apparatus for encoding video data | |
| CN108028945A (en) | The apparatus and method of conversion are performed by using singleton coefficient update | |
| CN106507106A (en) | Video interprediction encoding method based on reference plate | |
| CN117499671A (en) | Video image prediction method and device | |
| CN109729352A (en) | The method and apparatus for determining the motion vector of affine coding block |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180223 |