CN110545402A - underground monitoring video processing method, computer equipment and storage medium - Google Patents
underground monitoring video processing method, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110545402A CN110545402A CN201910761495.2A CN201910761495A CN110545402A CN 110545402 A CN110545402 A CN 110545402A CN 201910761495 A CN201910761495 A CN 201910761495A CN 110545402 A CN110545402 A CN 110545402A
- Authority
- CN
- China
- Prior art keywords
- frame image
- processed
- processing mode
- compressed data
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention is suitable for the field of computers, and provides an underground monitoring video processing method, computer equipment and a storage medium, wherein the underground monitoring video processing method comprises the following steps: acquiring a monitoring video file to be processed from an underground monitoring video acquisition module; selecting a processing mode of a frame image to be processed of a monitoring video file; the processing modes comprise a first processing mode and a second processing mode, and the frame image to be processed is compressed through the selected processing mode to obtain first compressed data; carrying out coding pretreatment on the first compressed data to obtain second compressed data after the coding pretreatment; and entropy coding the second compressed data and sending the second compressed data to the monitoring end outside the well. According to the scheme of the invention, by selecting the processing mode of the frame image to be processed, the processing mode can be selected according to the characteristics of each frame image in the video file, so that the spatial redundancy and the temporal redundancy are reduced to the maximum extent, the compression effect of the video file is improved, the transmission is facilitated, the monitoring effect is improved, and the safety of underground workers is guaranteed.
Description
Technical Field
the invention belongs to the technical field of mine monitoring, and particularly relates to an underground monitoring video processing method, computer equipment and a storage medium.
background
coal is one of the main energy sources in China and is the basis of national economy and social development. However, the underground operation of the coal mine in China is far away from the ground, the terrain is complex, the environment is severe, personnel and equipment are scattered, and in recent years, mine safety accidents and natural disasters frequently occur, so that huge economic loss and adverse social effects are caused, and the remote multimedia communication service becomes necessary. Ground monitoring personnel need to directly communicate information with underground personnel, need to directly issue commands to the underground personnel, need to comprehensively and visually monitor the actual production situation of the underground working site, find the accident head in time to prevent the accident, and also can provide relevant first-hand site data for the experience and the training of analyzing the accident afterwards and summarizing the emergency rescue process. Therefore, the quality of video and voice communication is a major consideration of the mining multimedia communication system.
From an information theory perspective, a video image can serve as a source, and data describing the source is the sum of the information content and the information redundancy. There are many kinds of information redundancy, such as spatial redundancy, temporal redundancy, structural redundancy, knowledge redundancy, visual redundancy, etc., and data compression essentially reduces these redundancy amounts. It can be seen that the reduction in the amount of redundancy can reduce the amount of data without reducing the amount of source information. The image can be viewed as a multi-dimensional function and the compression substantially reduces its correlation. In the existing video processing method, compression of video is generally achieved by singly compressing video information from a spatial redundancy direction or a temporal redundancy direction of a video image.
however, the existing video processing method has poor compression effect, the underground operation of the coal mine is far away from the ground, the terrain is complex, the environment is severe, personnel and equipment are scattered, the communication is difficult, the monitoring effect is greatly influenced, and the requirements of people cannot be met.
Disclosure of Invention
The embodiment of the invention aims to provide an underground monitoring video processing method, and aims to solve the problems that the existing video processing method is poor in compression effect, underground operation of a coal mine is far away from the ground, the terrain is complex, the environment is severe, personnel and equipment are scattered, communication is difficult, the monitoring effect is greatly influenced, and the requirements of people cannot be met. To a problem of (a).
The embodiment of the invention is realized in such a way that the method for processing the underground monitoring video comprises the following steps:
Acquiring a monitoring video file to be processed from an underground monitoring video acquisition module;
Selecting a processing mode of a frame image to be processed of the monitoring video file; the processing modes comprise a first processing mode and a second processing mode, the first processing mode is a processing mode for acquiring the difference between the actual pixel value and the predicted pixel value of the macro block in the frame image to be processed, and the second processing mode is a processing mode for acquiring the difference between the actual motion vector and the predicted motion vector between the macro block in the frame image to be processed and the corresponding macro block in the reference frame image;
Compressing the frame image to be processed through the selected processing mode to obtain first compressed data;
carrying out coding pretreatment on the first compressed data to obtain second compressed data after the coding pretreatment; the encoding preprocessing is performed by transforming the first compressed data from a spatial domain to a frequency domain and quantizing transform coefficients into at least two discrete integer values;
And entropy coding the second compressed data and sending the second compressed data to the monitoring end outside the well.
it is a further object of the present invention to provide a computer device comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the downhole surveillance video processing method described above.
It is a further object of the present invention to provide a computer readable storage medium having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of the downhole surveillance video processing method described above.
According to the underground monitoring video processing method provided by the embodiment of the invention, the processing mode of the frame image to be processed is selected according to the preset model, so that the processing mode can be selected in a targeted manner according to the characteristics of each frame of image in the video file, the spatial redundancy and the temporal redundancy are reduced to the maximum extent, the compression effect of the video file is improved, and the transmission is facilitated.
drawings
fig. 1 is an application environment diagram of a method for processing a downhole monitoring video according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for processing downhole surveillance video according to an embodiment of the present invention;
Fig. 3 is a flowchart of a processing mode for selecting a frame image to be processed of the surveillance video file in the downhole surveillance video processing method according to the embodiment of the present invention;
Fig. 4 is a flowchart of performing inverse processing and filtering processing on second compressed data according to an embodiment of the present invention;
FIG. 5 is a block diagram showing an internal configuration of a computer device according to an embodiment.
Detailed Description
in order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms unless otherwise specified. These terms are only used to distinguish one element from another. For example, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script, without departing from the scope of the present application.
Fig. 1 is an application environment diagram of a method for processing a downhole monitoring video according to an embodiment of the present invention, as shown in fig. 1, in the application environment, the method includes a downhole monitoring video collecting end 110, an outdoor monitoring end 120, and a wireless device 130. The method for processing the downhole monitoring video is applied to the downhole monitoring video acquisition terminal 110.
The downhole monitoring video acquisition terminal 110 includes a processing module, a video acquisition module, and a wireless communication module, which may be a smart phone, a tablet computer, a notebook computer, a desktop computer, or the like, but is not limited thereto. Because the underground operation of the coal mine is far away from the ground, the terrain is complex, the environment is severe, preferably, an ARM core processing system of an underground monitoring video acquisition end takes an S3C6410 processor as a core, a high-capacity low-power-consumption Mobile-level double-channel static random access memory (Mobile DDR SDRAM) and a high-capacity NAND Flash memory (NAND Flash) as external memories are adopted, a high-capacity TF card is additionally arranged as an auxiliary memory to store a large amount of audio and video data, and meanwhile, a video acquisition module transmits the data to the core system through an infrared Camera (Camera) interface, so that the problems that the traditional video monitoring scheme is small in light illumination adaptation range and cannot adapt to the light intensity range from black to high light and the like can be effectively avoided.
The monitoring terminal 120 may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, and the like. The downhole monitoring video collecting terminal 110 and the extrawell monitoring terminal 120 may be connected to the wireless device 130 for communication, which is not limited herein.
the wireless device 130 mainly provides a wireless access point for the underground monitoring video acquisition terminal 110 and the outdoor monitoring terminal 120, in the embodiment of the present invention, the wireless device 130 may specifically be a wireless AP (access point), and the wireless AP may provide long-distance wireless connection to a wired local area network or long-distance wired connection to a small wireless local area network, so as to achieve the purpose of extending the network range.
As shown in fig. 2, in an embodiment, a method for processing a downhole monitoring video is provided, and this embodiment is mainly illustrated by applying the method to the downhole monitoring video capturing end 110 in fig. 1. A method for processing underground monitoring videos specifically comprises the following steps:
Step S202, a monitoring video file to be processed is obtained from the underground monitoring video acquisition module.
in the embodiment of the present invention, the downhole monitoring video collecting terminal 110 is disposed in a mine and is configured to collect a monitoring video file, and the collected monitoring video file is processed by a processing module in the downhole monitoring video collecting terminal 110 and then sent to the monitoring terminal 120 outside the mine. The downhole monitoring video acquisition module may be a camera.
step S204, selecting a processing mode of a frame image to be processed of the monitoring video file; the processing modes include a first processing mode and a second processing mode, the first processing mode is a processing mode for acquiring the difference between the actual pixel value and the predicted pixel value of the macro block in the frame image to be processed, and the second processing mode is a processing mode for acquiring the difference between the actual motion vector and the predicted motion vector between the macro block in the frame image to be processed and the corresponding macro block in the reference frame image.
in the embodiment of the invention, the monitoring video file is composed of a plurality of frames of images, and the process of processing the monitoring video file is actually the process of processing each frame of image in the monitoring video file. The frame image to be processed refers to a frame image currently being processed. The macroblock refers to a plurality of blocks with different sizes, wherein the frame image to be processed is divided into the blocks, and one macroblock consists of a luminance pixel block and two additional chrominance pixel blocks. In general, a luminance block is a 16x16 sized block of pixels, while the size of two chrominance image blocks of pixels depends on the sampling format of their image. In the embodiment of the present invention, a macroblock may be composed of 16 × 16 or 16 × 8 or 8 × 16 or 8 × 8 pixel blocks, and the 8 × 8 pixel block may be further divided into 8 × 4 or 4 × 8 or 4 × 4 pixel blocks. The size of the block is flexibly selected by adapting to different application environments and requirements by using the variable-size block, so that the division of the moving object is more accurate.
in the implementation of the invention, the first processing mode realizes the compression of the image structure redundancy of the frame to be processed by acquiring the difference between the actual pixel value and the predicted pixel value of the macro block and then storing the difference between the actual pixel value and the predicted pixel value instead of the actual pixel value. The pixel value is a value given by a computer when the document image is digitized, and represents average luminance information of a certain small block of the document, or average reflection (transmission) density information of the small block. The structural redundancy is the redundancy existing on the image structure of a checkered floor, a honeycomb, a brick wall, a straw mat and the like, wherein in some scenes, an obvious image distribution pattern exists and the same or similar texture structure appears. The predicted pixel value is a pixel value of a neighboring macroblock of a current macroblock, and the pixel value of the neighboring macroblock is a weighted average of pixel values of neighboring macroblocks of a plurality of neighboring macroblocks in a preset macroblock set. The weighted average value of the pixel values of the adjacent macro blocks is used as the predicted pixel value, so that the accuracy of the predicted pixel value can be effectively improved, the error of compressing an underground monitoring video file is reduced, the underground monitoring effect of an outdoor monitoring end is improved, underground operation can be better guided according to a monitoring picture, timely and effective rescue measures can be made according to the accurate monitoring picture after collapse occurs, and the rescue effect is improved.
In the embodiment of the present invention, in the second processing mode, the difference between the actual motion vector and the predicted motion vector between the macroblock in the frame image to be processed and the corresponding macroblock in the reference frame image is the offset of the macroblock in the frame image to be processed with respect to the corresponding macroblock in the reference frame image, and the difference between the actual motion vector and the predicted motion vector is stored instead of the actual motion vector, so as to compress the visual redundancy of the frame image to be processed. Visual redundancy is the non-uniform and non-linear sensitivity of the human visual system to image fields, sensitive to brightness variations and relatively insensitive to chrominance variations; sensitive to object edges, the inner region is relatively insensitive; sensitive to the overall structure and relatively insensitive to internal details, image information can be traded off according to these visual characteristics. In the embodiment of the present invention, according to the position relationship between the reference frame image and the frame image to be processed, the frame image to be processed may be divided into a forward reference frame, that is, a reference frame located before the frame to be processed, and a backward reference frame, that is, a reference frame located after the frame to be processed. The reference frame can be a frame image selected from at least two previous frame images of the frame image to be processed, and a reference frame with the best effect is selected to achieve the best prediction effect; or the reference frame image is a previous frame image of the frame image to be processed and a next frame image of the frame image to be processed, and a bidirectional reference mode is adopted to effectively reduce the prediction error. In the embodiment of the invention, the corresponding macro block of the macro block in the frame image to be processed in the reference frame image is the block most similar to the macro block in the frame image to be processed. Preferably, the most similar block may be determined by a three-step search algorithm, which takes the minimum mean absolute error as a criterion, that is, at the center point of a 16 × 16 pixel block search area, takes half of the maximum search length of the search area as a step size, calculates the mean absolute error of the center point and the surrounding 8 neighboring points, then takes the minimum mean absolute error point as a center, reduces the step size to half of the original step size, and so on, and then, to the third step, reduces the step size by half, calculates the mean absolute error value, where the point motion vector with the minimum mean absolute error is the value to be obtained. The searching efficiency is effectively improved by utilizing the three-step searching algorithm, the searching efficiency of the underground monitoring video is further improved, the processing efficiency of the underground monitoring video is improved, the video transmission efficiency is further improved, the time difference between the monitoring picture of the outdoor monitoring end and the underground monitoring video acquisition end is reduced, a worker can timely control the underground operation condition in the monitoring picture of the outdoor monitoring end, a problem solving instruction is timely sent out when a problem is found, the problem is prevented, and safety guarantee is provided for underground operation personnel.
step S206, the frame image to be processed is compressed through the selected processing mode, and first compressed data is obtained.
In the embodiment of the present invention, the first compressed data is a difference between an actual motion vector and a predicted motion vector between a macroblock in the frame image to be processed and a corresponding macroblock in the reference frame image, or a difference between an actual pixel value and a predicted pixel value of the macroblock, and then the difference between the actual pixel value and the predicted pixel value is used according to the selected processing mode.
step S208, carrying out coding preprocessing on the first compressed data to obtain second compressed data after coding preprocessing; the encoding preprocessing is performed by transforming the first compressed data from a spatial domain to a frequency domain and quantizing transform coefficients to at least two discrete integer values.
In the embodiment of the present invention, the encoding preprocessing refers to processing performed on the first compressed data before entropy encoding in the next step is performed. Spatial image data is often difficult to compress; adjacent samples have strong correlation and the energy is generally uniformly distributed in an image, so that in order to discard some data and reduce the data accuracy without significantly affecting the image quality, a suitable transformation method is selected to make the image easy to compress, for example, by focusing the energy of the image, concentrating the energy on a few meaningful values, and the frequency domain is a characteristic which is more prominent and easy to process.
In embodiments of the invention, the transform coefficients are quantized to discrete values, reducing the pre-measurement of integer coefficients and eliminating high frequency coefficients that are not easily perceived. Meanwhile, the output bit rate can be controlled to be maintained at a constant value basically, so that the image quality of the monitoring video is ensured, and monitoring personnel can clearly know the underground condition to prevent the situation in advance.
And step S210, entropy coding the second compressed data, and sending the second compressed data to the monitoring end 120 outside the well.
In the embodiment of the invention, entropy coding is coding without losing any information according to the entropy principle in the coding process. Information entropy is the average amount of information (a measure of uncertainty) of a source. Common entropy coding methods are: shannon (Shannon) coding, Huffman (Huffman) coding and arithmetic coding (arithmetric coding). The function of entropy coding is to convert the element symbols of the video sequence into a compressed code stream for transmission, so as to be transmitted to the monitoring end 120.
According to the underground monitoring video processing method provided by the embodiment of the invention, the processing mode of the frame image to be processed is selected according to the preset model, the processing mode can be selected according to the characteristics of each frame image in the video file, the space redundancy and the time redundancy are reduced to the maximum extent, the compression effect of the video file is improved, the transmission is convenient, the monitoring effect is further improved, monitoring personnel can timely and accurately control the underground condition so as to timely send out an operation instruction, or accurate rescue measures are made according to the monitoring picture after collapse, and the rescue efficiency is improved.
In an embodiment, as shown in fig. 3, step S204 may specifically include the following steps:
step S302, determining whether the frame image to be processed is a first frame image of the video file.
Step S304, if yes, selecting a first processing mode to process the frame image to be processed.
Step S306, if not, selecting the processing mode of the frame image to be processed according to the correlation between the frame image to be processed and the reference frame image.
in the embodiment of the present invention, since there is no relative motion between the macro block in the first frame image and the macro block corresponding to the reference frame, the first frame image of the surveillance video file is generally processed in the first processing mode.
In the embodiment of the present invention, the process of selecting the processing mode of the frame image to be processed according to the correlation between the processed image and the reference frame image is as follows: firstly, according to the resolution of the characteristic image in the horizontal direction, equally dividing the image in the horizontal direction of the frame image to be processed by n, secondly, shifting the sub-image in the n equally divided interval by n-1 units, carrying out correlation operation with the image in the corresponding interval in the reference frame image, calculating the cross-correlation value of the image, and finally carrying out normalization operation on the obtained n cross-correlation values. The second processing mode is selected if more than 50% of the cross-correlation values are greater than 0.5, otherwise the first processing mode is selected.
According to the underground monitoring video processing method provided by the embodiment of the invention, the processing mode of the frame image to be processed is selected according to the correlation between the frame image to be processed and the reference frame image, and the structural redundancy and the visual redundancy in the video file can be effectively judged, so that the processing mode is reasonably selected, the underground monitoring video file is compressed to the maximum extent, the transmission efficiency is improved, the monitoring delay of an outdoor monitoring end is reduced, the monitoring effect of an underground monitoring system is further improved, monitoring personnel can accurately and timely control the situation under the speech, the trouble is prevented, and the safety of underground operating personnel is effectively guaranteed.
In one embodiment, as shown in fig. 4, a method for processing a downhole monitoring video is different from the method shown in fig. 2 in that steps S402 and S404 are further included.
Step S402, performing reverse processing on the second compressed data to obtain third compressed data after the reverse processing; the processing procedure of the reverse processing is the reverse procedure of the encoding preprocessing.
In the embodiment of the present invention, the inverse process of the encoding preprocessing process is an inverse transform process of transforming from a spatial domain to a frequency domain and an inverse quantization process of quantizing a transform coefficient. The reverse processed third compressed data may be used for local decoding.
Step S404, performing filtering processing on the third compressed data, and caching the filtered compressed data as a reference frame image of a next frame image.
In the implementation of the present invention, the third compressed data is subjected to loop filtering, and the loop filtering modifies two pixels on the same side of the macroblock/block boundary by a content adaptive non-linear algorithm. Artifacts due to different prediction types or different quantization parameters of neighboring macroblocks can be eliminated by filtering. In this case of block boundaries, filtering can eliminate artifacts that may be caused by the transform/quantization and differences from neighboring block motion vectors.
According to the method for processing the underground monitoring video, provided by the embodiment of the invention, the server 130 can decode the compressed data by performing the reverse processing on the second compressed data, and then the third compressed data obtained by the reverse processing is subjected to the filtering processing to eliminate the artificial traces, so that the processing effect on the underground monitoring video is improved.
According to the underground monitoring video processing method provided by the scheme of the invention, the processing mode of the frame image to be processed is selected according to the preset model, the processing mode can be selected according to the characteristics of each frame image in the video file, the spatial redundancy and the temporal redundancy are reduced to the maximum extent, the compression effect of the video file is improved, the transmission is facilitated, and the monitoring effect is improved. The scheme of the invention flexibly selects the size of the block by using the variable-size block to adapt to different application environments and requirements, so that the division of the moving object is more accurate; the predicted pixel value is represented by the weighted average value of the pixel values of the adjacent macroblocks, so that the accuracy of the predicted pixel value can be effectively improved; by selecting a reference frame with the best effect from multiple forward reference frames or adopting a reference mode of a forward reference frame and a backward reference frame, the prediction error can be effectively reduced, and the prediction effect is improved. Meanwhile, artificial traces are eliminated through filtering processing, the processing effect of the underground monitoring video is improved, the monitoring quality is further improved, the working personnel can effectively master the underground monitored condition, the operation instruction can be timely and accurately sent to the underground, the reliable basis is improved for the collapsed rescue work, the rescue efficiency is improved, and the life safety of the worker is guaranteed.
FIG. 5 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may be specifically the downhole monitoring video capturing end 110 in fig. 1. As shown in fig. 5, the computer apparatus includes a processor, a memory, a network interface, an input device, and a display screen connected through a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by the processor, causes the processor to implement a downhole surveillance video processing method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform a method of downhole surveillance video processing. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is proposed, the computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring a monitoring video file to be processed from an underground monitoring video acquisition module;
Selecting a processing mode of a frame image to be processed of the monitoring video file; the processing modes comprise a first processing mode and a second processing mode, the first processing mode is a processing mode for acquiring the difference between the actual pixel value and the predicted pixel value of the macro block in the frame image to be processed, and the second processing mode is a processing mode for acquiring the difference between the actual motion vector and the predicted motion vector between the macro block in the frame image to be processed and the corresponding macro block in the reference frame image;
Compressing the frame image to be processed through the selected processing mode to obtain first compressed data;
Carrying out coding pretreatment on the first compressed data to obtain second compressed data after coding pretreatment; the encoding preprocessing is performed by transforming the first compressed data from a spatial domain to a frequency domain and quantizing transform coefficients into at least two discrete integer values;
And entropy coding the second compressed data and sending the second compressed data to an out-of-well monitoring end.
In one embodiment, a computer readable storage medium is provided, having a computer program stored thereon, which, when executed by a processor, causes the processor to perform the steps of:
Acquiring a monitoring video file to be processed from an underground monitoring video acquisition module;
selecting a processing mode of a frame image to be processed of the monitoring video file; the processing modes comprise a first processing mode and a second processing mode, the first processing mode is a processing mode for acquiring the difference between the actual pixel value and the predicted pixel value of the macro block in the frame image to be processed, and the second processing mode is a processing mode for acquiring the difference between the actual motion vector and the predicted motion vector between the macro block in the frame image to be processed and the corresponding macro block in the reference frame image;
Compressing the frame image to be processed through the selected processing mode to obtain first compressed data;
Carrying out coding pretreatment on the first compressed data to obtain second compressed data after coding pretreatment; the encoding preprocessing is performed by transforming the first compressed data from a spatial domain to a frequency domain and quantizing transform coefficients into at least two discrete integer values;
and entropy coding the second compressed data and sending the second compressed data to an out-of-well monitoring end.
It should be understood that, although the steps in the flowcharts of the embodiments of the present invention are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in various embodiments may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
it will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the program is executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (10)
1. A method of downhole surveillance video processing, the method comprising:
Acquiring a monitoring video file to be processed from an underground monitoring video acquisition module;
selecting a processing mode of a frame image to be processed of the monitoring video file; the processing modes comprise a first processing mode and a second processing mode, the first processing mode is a processing mode for acquiring the difference between the actual pixel value and the predicted pixel value of the macro block in the frame image to be processed, and the second processing mode is a processing mode for acquiring the difference between the actual motion vector and the predicted motion vector between the macro block in the frame image to be processed and the corresponding macro block in the reference frame image;
Compressing the frame image to be processed through the selected processing mode to obtain first compressed data;
Carrying out coding pretreatment on the first compressed data to obtain second compressed data after coding pretreatment; the encoding preprocessing is performed by transforming the first compressed data from a spatial domain to a frequency domain and quantizing transform coefficients into at least two discrete integer values;
And entropy coding the second compressed data and sending the second compressed data to an out-of-well monitoring end.
2. the method according to claim 1, wherein the selecting a processing mode of the to-be-processed frame image of the surveillance video file comprises:
Judging whether the frame image to be processed is a first frame image of the video file;
If yes, selecting a first processing mode to process the frame image to be processed;
And if not, selecting the processing mode of the frame image to be processed according to the correlation between the frame image to be processed and the reference frame image.
3. The method of claim 1, wherein the predicted pixel values are pixel values of neighboring macroblocks of a current macroblock, and the pixel values of the neighboring macroblocks are weighted averages of pixel values of neighboring macroblocks of a plurality of the neighboring macroblocks in a predetermined macroblock set.
4. the method according to claim 1, wherein the reference frame image is a frame image selected from at least two previous frame images of the frame image to be processed.
5. the method according to claim 1, wherein the reference frame image is a previous frame image of the frame image to be processed and a next frame image of the frame image to be processed.
6. A method as claimed in claim 1, wherein the macroblock is formed from a 16x16 or 16x 8 or 8 x16 or 8 x 8 block of pixels.
7. The method of claim 6, wherein the 8 x 8 pixel blocks are further divided into 8 x 4 or 4 x 8 or 4 x 4 pixel blocks.
8. The method of claim 1, further comprising:
performing reverse processing on the second compressed data to obtain third compressed data after the reverse processing; the processing procedure of the reverse processing is the reverse procedure of the encoding preprocessing;
And filtering the third compressed data, and caching the compressed data after filtering as a reference frame image of the next frame image.
9. a computer device comprising a memory and a processor, the memory having stored therein a computer program which, when executed by the processor, causes the processor to carry out the steps of the downhole surveillance video processing method according to any of claims 1 to 8.
10. a computer-readable storage medium, having stored thereon a computer program which, when executed by a processor, causes the processor to carry out the steps of the downhole monitoring video processing method according to any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910761495.2A CN110545402A (en) | 2019-08-18 | 2019-08-18 | underground monitoring video processing method, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910761495.2A CN110545402A (en) | 2019-08-18 | 2019-08-18 | underground monitoring video processing method, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110545402A true CN110545402A (en) | 2019-12-06 |
Family
ID=68711651
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910761495.2A Pending CN110545402A (en) | 2019-08-18 | 2019-08-18 | underground monitoring video processing method, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110545402A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955571A (en) * | 2023-03-10 | 2023-04-11 | 深圳市启明智显科技有限公司 | Image storage method, device and system for embedded equipment |
| CN117560494A (en) * | 2024-01-11 | 2024-02-13 | 中国矿业大学 | Encoding method for rapidly enhancing underground low-quality video |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1845608A (en) * | 2006-05-19 | 2006-10-11 | 北京工业大学 | Video interframe compression method based on space-time correlation |
| CN101610417A (en) * | 2009-07-09 | 2009-12-23 | 华为技术有限公司 | A kind of image filling method, device and equipment |
| US20100002765A1 (en) * | 2008-07-01 | 2010-01-07 | Hitachi Kokusai Electric Inc. | Image encoding apparatus and method |
| CN102186070A (en) * | 2011-04-20 | 2011-09-14 | 北京工业大学 | Method for realizing rapid video coding by adopting hierarchical structure anticipation |
| CN102256137A (en) * | 2011-07-13 | 2011-11-23 | 西安电子科技大学 | Context-prediction-based polar light image lossless coding method |
| CN103686166A (en) * | 2013-11-18 | 2014-03-26 | 深圳市云宙多媒体技术有限公司 | Fast prediction mode selection method and system based on correlation analysis |
| CN104135662A (en) * | 2014-08-19 | 2014-11-05 | 哈尔滨工业大学 | Improved H.264 compressed encoding method for video file under limited bandwidth and emission rate condition |
| CN107197281A (en) * | 2017-05-12 | 2017-09-22 | 武汉斗鱼网络科技有限公司 | A kind of method and electronic equipment for realizing estimation |
-
2019
- 2019-08-18 CN CN201910761495.2A patent/CN110545402A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1845608A (en) * | 2006-05-19 | 2006-10-11 | 北京工业大学 | Video interframe compression method based on space-time correlation |
| US20100002765A1 (en) * | 2008-07-01 | 2010-01-07 | Hitachi Kokusai Electric Inc. | Image encoding apparatus and method |
| CN101610417A (en) * | 2009-07-09 | 2009-12-23 | 华为技术有限公司 | A kind of image filling method, device and equipment |
| CN102186070A (en) * | 2011-04-20 | 2011-09-14 | 北京工业大学 | Method for realizing rapid video coding by adopting hierarchical structure anticipation |
| CN102256137A (en) * | 2011-07-13 | 2011-11-23 | 西安电子科技大学 | Context-prediction-based polar light image lossless coding method |
| CN103686166A (en) * | 2013-11-18 | 2014-03-26 | 深圳市云宙多媒体技术有限公司 | Fast prediction mode selection method and system based on correlation analysis |
| CN104135662A (en) * | 2014-08-19 | 2014-11-05 | 哈尔滨工业大学 | Improved H.264 compressed encoding method for video file under limited bandwidth and emission rate condition |
| CN107197281A (en) * | 2017-05-12 | 2017-09-22 | 武汉斗鱼网络科技有限公司 | A kind of method and electronic equipment for realizing estimation |
Non-Patent Citations (2)
| Title |
|---|
| 朱秀昌，刘峰，胡栋: "《数字图像处理与通信 修订版》", 31 July 2008, 北京邮电大学出版社 * |
| 罗钧: "《嵌入式数字媒体处理器原理与开发 基于TI达芬奇DM8168系列》", 30 June 2016 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955571A (en) * | 2023-03-10 | 2023-04-11 | 深圳市启明智显科技有限公司 | Image storage method, device and system for embedded equipment |
| CN117560494A (en) * | 2024-01-11 | 2024-02-13 | 中国矿业大学 | Encoding method for rapidly enhancing underground low-quality video |
| CN117560494B (en) * | 2024-01-11 | 2024-03-19 | 中国矿业大学 | Encoding method for rapidly enhancing underground low-quality video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10721466B2 (en) | Video encoding method, video decoding method, computer device and storage medium | |
| US10582196B2 (en) | Generating heat maps using dynamic vision sensor events | |
| US11206405B2 (en) | Video encoding method and apparatus, video decoding method and apparatus, computer device, and storage medium | |
| US10051271B2 (en) | Coding structure | |
| CN104954791A (en) | Method for selecting key frame from wireless distributed video coding for mine in real time | |
| US11949879B2 (en) | Video coding method and apparatus, computer device, and storage medium | |
| CN111193927B (en) | Encoded data processing method, apparatus, computer device and storage medium | |
| JPWO2008047865A1 (en) | Image quality evaluation method, image quality evaluation system, and image quality evaluation program | |
| CN104320622A (en) | Embedded video enhancement system for open source server software | |
| US8582876B2 (en) | Hybrid codec for compound image compression | |
| CN110545402A (en) | underground monitoring video processing method, computer equipment and storage medium | |
| US20070041653A1 (en) | System and method of quantization | |
| US20210037251A1 (en) | Video encoding method and apparatus, video decoding method and apparatus, computer device, and storage medium | |
| CN104937934A (en) | Autoregressive pixel prediction in the neighborhood of image borders | |
| US10021398B2 (en) | Adaptive tile data size coding for video and image compression | |
| Chen et al. | Learning to compress videos without computing motion | |
| CN104702959A (en) | Intra-frame prediction method and system of video coding | |
| CN103391437A (en) | High-dynamic image vision lossless compression method and device | |
| CN113489976A (en) | Predictive coding method and device and electronic equipment | |
| EP4340360A2 (en) | Image component prediction method, encoder, decoder and storage medium | |
| EP3742734A1 (en) | Method and device for selecting prediction direction in image encoding, and storage medium | |
| CN113507611B (en) | Image storage method and device, computer equipment and storage medium | |
| Pal et al. | Low overhead spatiotemporal video compression over smartphone based delay tolerant network | |
| CN107181943B (en) | A kind of satellite sequence Lossless Image Compression Algorithm method and system based on Mixed Entropy Coding | |
| CN100499819C (en) | Method for reducing bit rate requirements for encoding multimedia data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191206 |