CN117440250A - Photoelectric peri-scanning video real-time dynamic splicing method and device - Google Patents
Photoelectric peri-scanning video real-time dynamic splicing method and device Download PDFInfo
- Publication number
- CN117440250A CN117440250A CN202311579431.3A CN202311579431A CN117440250A CN 117440250 A CN117440250 A CN 117440250A CN 202311579431 A CN202311579431 A CN 202311579431A CN 117440250 A CN117440250 A CN 117440250A
- Authority
- CN
- China
- Prior art keywords
- thumbnail
- data
- splicing
- photoelectric
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000001360 synchronised effect Effects 0.000 claims abstract description 22
- 238000010586 diagram Methods 0.000 claims description 19
- 230000005693 optoelectronics Effects 0.000 claims description 16
- 230000015654 memory Effects 0.000 claims description 15
- 238000005259 measurement Methods 0.000 claims description 5
- 125000004122 cyclic group Chemical group 0.000 claims description 4
- 230000011218 segmentation Effects 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 9
- 230000033001 locomotion Effects 0.000 abstract description 8
- 101710131668 Epithelial discoidin domain-containing receptor 1 Proteins 0.000 description 15
- 102100036725 Epithelial discoidin domain-containing receptor 1 Human genes 0.000 description 15
- 238000012544 monitoring process Methods 0.000 description 13
- 238000004458 analytical method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000003139 buffering effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 101100498819 Caenorhabditis elegans ddr-1 gene Proteins 0.000 description 1
- 101100498823 Caenorhabditis elegans ddr-2 gene Proteins 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
Abstract
The invention relates to the technical field of image processing, and provides a photoelectric peri-scan video real-time dynamic splicing method and device. The method comprises the following steps: receiving photoelectric video original data, a clock signal and a line field synchronizing signal; receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal; and splicing the new thumbnail data with the history thumbnail data to obtain a splice graph, and displaying the splice graph in a second area. According to the invention, the photoelectric video original data is converted into the thumbnail data, and the thumbnail data is spliced and displayed in the second area, so that the movement track of multiple targets can be observed and tracked through each thumbnail, and compared with a panoramic video splicing mode, the attention of direct use of thumbnail splicing to details and display quality is low, so that the splicing efficiency is high, and the real-time performance is good.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a photoelectric peri-scan video real-time dynamic splicing method and device.
Background
The traditional photoelectric detection equipment has limited detection field angle and can not meet the requirement of large field observation under specific application scenes. If the photoelectric video image is directly displayed, the full view of the observed area cannot be obtained, and the observation and tracking of the motion trail of multiple targets are inconvenient, so that a technique for performing mosaic display on the optical television frequency image is required to meet the observation requirements of large field of view and multiple target tracking in a specific application scene.
With research and development of computer image processing technology, image stitching technology has been increasingly focused and applied. The current mainstream stitching mode is panoramic video stitching. However, the panoramic video stitching algorithm has complex modeling, poor real-time performance and higher requirement on the hardware performance of the computer, and when running on a computer with lower hardware performance, image display is possibly blocked, and observation is affected.
In view of this, overcoming the drawbacks of the prior art is a problem to be solved in the art.
Disclosure of Invention
The invention aims to solve the technical problems that in the prior art, panoramic video stitching is used for stitching and displaying photoelectric video images, but a panoramic video stitching algorithm is complex in modeling and poor in instantaneity, and has higher requirements on the hardware performance of a computer, and when the panoramic video stitching algorithm runs on a computer with lower hardware performance, image display is possibly blocked, so that observation is affected.
The invention adopts the following technical scheme:
in a first aspect, a method for dynamically splicing a photoelectric peri-scan video in real time, dividing an overall display area into a first area and a second area, displaying the photoelectric video in the first area, and displaying a spliced photoelectric thumbnail in the second area, the splicing method includes:
receiving photoelectric video original data, a clock signal and a line field synchronizing signal;
receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal;
splicing the new thumbnail data with the history thumbnail data to obtain a spliced image, and displaying the spliced image in a second area; wherein the history thumbnail data is thumbnail data that has been displayed in the second area.
Preferably, when the second area includes M rows of thumbnail strips, and each row of thumbnail strips is horizontally arranged to display N pieces of thumbnail data, the splicing the new thumbnail data and the history thumbnail data to obtain a splice map specifically includes:
splicing the new thumbnail data with the (1, 2) - (1, N) historical thumbnail data to obtain a local splicing diagram for displaying the thumbnail strips in the 1 st row; when the (1, 2) - (1, N) historical thumbnail data are sequentially arranged from left to right, the new thumbnail data are spliced on the right side of the (1, N) historical thumbnail data, and when the (1, 2) - (1, N) historical thumbnail data are sequentially arranged from right to left, the new thumbnail data are spliced on the left side of the (1, N) historical thumbnail data;
Splicing the (i, 1) th historical thumbnail data with the (i+1, 2) th historical thumbnail data to obtain a local splicing diagram for displaying the (i+1) th row thumbnail strip; when the (i+1, 2) th to (i+1, N) th history thumbnail data are sequentially arranged from left to right, the (i, 1) th history thumbnail data are spliced on the right side of the (i+1, N) th history thumbnail data, when the (i+1, 2) th to (i+1, N) th history thumbnail data are sequentially arranged from right to left, the (i, 1) th history thumbnail data are spliced on the left side of the (i+1, N) th history thumbnail data, i is a positive integer, i is smaller than M, and the (i, j) th history thumbnail data are the j th thumbnail data in the i th row thumbnail strip displayed in the second area;
and splicing the partial splice graphs for displaying the thumbnail strips in each row sequentially from top to bottom to obtain the splice graph for displaying the second area.
Preferably, the splicing the new thumbnail data with the (1, 2) - (1, n) -th history thumbnail data specifically includes:
and splicing the kth line data in the new thumbnail data with the kth line data in the (1, 2) - (1, N) historical thumbnail data.
Preferably, the splicing the new thumbnail data and the history thumbnail data to obtain a spliced graph, and displaying the spliced graph in the second area, further includes:
after the splicing is carried out to obtain a splicing image, writing the splicing image into a cache;
and reading the spliced graph from the buffer according to the clock signal, the line field synchronous signal and the splicing command of the upper computer, and sending the spliced graph to a display control unit for display.
Preferably, the upper computer sends the splicing command once every preset time t; wherein, the angle of view of the photoelectric video sensorMultiplying the scanning period T of the photoelectric video sensor and dividing by 360 degrees to obtain the preset time T.
Preferably, when the angle of view of the optoelectronic video sensorWhen the scanning period T of the photoelectric video sensor is 24s and is 2.3 degrees, the preset time is 0.1533s.
Preferably, the size of the first area and the size of the second area are determined by the size of the whole display area, the number of thumbnail images to be observed, the size of the original image of the optoelectronic video and the thumbnail ratio, and specifically include:
calculating to obtain the size of the thumbnail according to the size and the thumbnail proportion of the original image of the photoelectric video;
calculating the number of lines required to be occupied when the thumbnail is displayed in the whole line of the whole display area by taking the width of the whole display area as a measurement standard, and calculating a first actual proportion of the photoelectric video which can be displayed and corresponds to the line number required to be occupied when the thumbnail is displayed is removed;
Taking the height of the whole display area as a measurement standard, calculating the number of columns required to be occupied when the thumbnail is displayed in the whole display area, and calculating a second actual proportion of the photoelectric video which can be displayed and corresponds to the removed number of columns required to be occupied when the thumbnail is displayed;
and selecting a segmentation mode corresponding to the largest one of the first actual proportion and the second actual proportion to determine and obtain the size of the first area and the size of the second area.
Preferably, the first actual ratio；
The second actual proportionThe method comprises the steps of carrying out a first treatment on the surface of the Wherein W is the width of the whole display area, H is the height of the whole display area, num is the number of thumbnail images to be observed, k is the thumbnail ratio, < >>Is the width of the original image of the photoelectric video, +.>Is the height of the original image of the optoelectronic video.
In a second aspect, the invention also provides a device for dynamically splicing the photoelectric peri-scan video in real time, which divides an overall display area into a first area and a second area, displays the photoelectric video in the first area, and displays spliced photoelectric thumbnails in the second area, wherein the device comprises a thumbnail generation module, a thumbnail splicing module and a display module;
the thumbnail generation module is used for receiving photoelectric video original data, clock signals and line field synchronizing signals; receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal; the upper computer sends the splicing command once every preset time interval;
The thumbnail splicing module is used for splicing the new thumbnail data with the history thumbnail data to obtain a splicing diagram; wherein the history thumbnail data is thumbnail data that has been displayed in the second area.
The display module is used for superposing the photoelectric video, the splice graph and the graphic display input and then outputting and displaying the superposed photoelectric video, the splice graph and the graphic display input; wherein the mosaic is displayed in a second area.
In a third aspect, the present invention further provides a device for implementing the method for dynamically splicing the photoelectric cycloscan video in real time, where the device includes:
at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the processor, for executing the method for real-time dynamic splicing of the photoelectric cycloscan video according to the first aspect.
In a fourth aspect, the present invention also provides a non-volatile computer storage medium storing computer executable instructions for execution by one or more processors to perform the method of the first aspect for electro-optical cyclic video real-time dynamic stitching.
According to the invention, the photoelectric video original data is converted into the thumbnail data, and the thumbnail data is spliced and displayed in the second area, so that the movement track of multiple targets can be observed and tracked through each thumbnail, and compared with a panoramic video splicing mode, the attention of direct use of thumbnail splicing to details and display quality is low, so that the splicing efficiency is high, and the real-time performance is good.
Drawings
In order to more clearly illustrate the technical solution of the embodiments of the present invention, the drawings that are required to be used in the embodiments of the present invention will be briefly described below. It is evident that the drawings described below are only some embodiments of the present invention and that other drawings may be obtained from these drawings without inventive effort for a person of ordinary skill in the art.
Fig. 1 is a schematic flow chart of a real-time dynamic splicing method of photoelectric circumferential scanning video provided by an embodiment of the invention;
FIG. 2 is a schematic flow chart of another method for dynamically splicing photoelectric cycloscan video in real time according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a first method for dynamically splicing a photoelectric peri-scan video in real time according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart of another method for dynamically splicing photoelectric cycloscan video in real time according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a second method for dynamically splicing photoelectric cycloscan video in real time according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a third method for dynamically splicing photoperiod-time video according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a fourth method for dynamically splicing a photoelectric peri-scan video in real time according to an embodiment of the present invention;
fig. 8 is a schematic view of an application scenario of a real-time dynamic splicing method of a photoelectric peri-scan video provided by an embodiment of the present invention;
fig. 9 is a schematic diagram of an architecture of a real-time dynamic splicing device for photoelectric cycloscan according to an embodiment of the present invention;
fig. 10 is a schematic diagram of an architecture of another real-time dynamic splicing device for photoelectric cycloscan according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of a real-time dynamic splicing device for photoelectric cycloscan according to an embodiment of the present invention;
FIG. 12 is a schematic flow chart of a method executed by the real-time dynamic splicing device for photoelectric cycloscan according to an embodiment of the present invention;
FIG. 13 is a schematic flow chart of a method executed by another embodiment of the present invention;
Fig. 14 is a schematic structural diagram of still another real-time dynamic splicing device for photoelectric cycloscan according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
In the description of the present invention, the terms "inner", "outer", "longitudinal", "transverse", "upper", "lower", "top", "bottom", etc. refer to an orientation or positional relationship based on that shown in the drawings, merely for convenience of describing the present invention and do not require that the present invention must be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
The terms "first," "second," and the like herein are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first", "a second", etc. may explicitly or implicitly include one or more such feature. In the description of the present application, unless otherwise indicated, the meaning of "a plurality" is two or more.
In addition, the technical features of the embodiments of the present invention described below may be combined with each other as long as they do not collide with each other.
Example 1:
in order to solve the problem, embodiment 1 of the present invention provides a real-time dynamic splicing method for a panoramic video, which divides an overall display area into a first area and a second area, displays a photoelectric video in the first area, and displays a spliced photoelectric thumbnail in the second area, as shown in fig. 1:
in step 201, optoelectronic video raw data, a clock signal, and a line field synchronization signal are received.
In step 202, a splicing command from an upper computer is received, and a frame of photoelectric video original data read recently is converted into new thumbnail data according to the splicing command, a clock signal and a line field synchronizing signal; the upper computer sends the splicing command once at preset time t; in alternative embodiments, the field angle may be measured by an optoelectronic video sensor Multiplying the scanning period T of the photoelectric video sensor, dividing by 360 degrees to obtain the preset time T, and expressing the preset time T in the form of a mathematical formula as follows:
the splicing command, the clock signal and the line field synchronizing signal are used for ensuring synchronous display of the photoelectric video and the thumbnail.
In this case, a practical application is also exemplified when the angle of view of the optoelectronic video sensorWhen the scanning period T of the photoelectric video sensor is 24s and is 2.3 degrees, the preset time is 0.1533s, namely, the upper computer sends a splicing command every 0.1533 s.
In step 203, the new thumbnail data and the history thumbnail data are spliced to obtain a splice map, and the splice map is displayed in a second area; wherein the history thumbnail data is thumbnail data that has been displayed in the second area. And when the thumbnail data is not displayed in the second area, the new thumbnail data is directly displayed in the second area without splicing.
According to the embodiment, the photoelectric video original data are converted into the thumbnail data, and the thumbnail data are spliced and displayed in the second area, so that the movement track of multiple targets can be observed and tracked through each thumbnail, and compared with a panoramic video splicing mode, the attention of direct use of thumbnail splicing to details and display quality is low, so that the splicing efficiency is high, and the instantaneity is good.
In an alternative embodiment, when the second area includes M rows of thumbnail strips, each row of thumbnail strips is horizontally arranged to display N pieces of thumbnail data (i.e., each row of thumbnail strips includes N pieces of thumbnail windows, each thumbnail window displays one piece of thumbnail data), the new thumbnail data and the historical thumbnail data are spliced to obtain a splice map, as shown in fig. 2, specifically including:
in step 301, splicing new thumbnail data with (1, 2) - (1, N) historical thumbnail data to obtain a local splicing diagram for displaying the 1 st row of thumbnail strips; the new thumbnail data is spliced on one side of the (1, N) th historical thumbnail data far away from the (1, N-1) th historical thumbnail data, namely when the (1, 2) th to (1, N) th historical thumbnail data are sequentially arranged from left to right, the new thumbnail data is spliced on the right side of the (1, N) th historical thumbnail data, and when the (1, 2) th to (1, N) th historical thumbnail data are sequentially arranged from right to left, the new thumbnail data is spliced on the left side of the (1, N) th historical thumbnail data; wherein M and N are positive integers, which are obtained by empirical analysis by a person skilled in the art, and the splicing of the new thumbnail data with the (1, 2) - (1, N) historical thumbnail data specifically comprises:
And splicing the kth line data in the new thumbnail data with the kth line data in the (1, 2) - (1, N) historical thumbnail data, namely splicing each line of data in the new thumbnail data with the corresponding line of data in the corresponding historical thumbnail data. Wherein k is a positive integer, and k is less than or equal to the number of lines of data contained in each thumbnail data.
In step 302, the (i, 1) th history thumbnail data is spliced with the (i+1, 2) th history thumbnail data to obtain a local splice diagram for displaying the (i+1) th row thumbnail strip; the (i, 1) historical thumbnail data are spliced on one side of the (i+1, N) historical thumbnail data far away from the (i+1, N-1) historical thumbnail data, namely when the (i+1, 2) th historical thumbnail data are sequentially arranged from left to right, the (i, 1) th historical thumbnail data are spliced on the right side of the (i+1, N) th historical thumbnail data, and when the (i+1, 2) th historical thumbnail data are sequentially arranged from right to left, the (i, 1) th historical thumbnail data are spliced on the left side of the (i+1, N) th historical thumbnail data; i is a positive integer, and i is smaller than M, the (i, j) th history thumbnail data is the j-th thumbnail data in the i-th row thumbnail stripe already displayed in the second area, j is a positive integer, and j is smaller than or equal to N; likewise, the splicing the (i, 1) th history thumbnail data with the (i+1, 2) th history thumbnail data specifically includes:
And splicing the kth line data of the (i, 1) historical thumbnail data with the kth line data in the (i+1, 2) to (i+1, N) historical thumbnail data.
In step 303, the partial mosaic for displaying the thumbnail strips in each row is sequentially stitched from top to bottom, so as to obtain the mosaic for displaying in the second area.
In the specific processing, the method is realized by a first-in first-out register (First In First Out, abbreviated as FIFO), as shown in fig. 3, and specifically includes: m FIFOs are provided, the depth of each FIFO is obtained by analysis of the size of the second area by a person skilled in the art, each FIFO can accommodate N pieces of thumbnail Data for storing the partial mosaic of the corresponding line, and Data (i, j) (k) is used to represent the kth line Data of the (i, j) th historical thumbnail Data stored in the FIFO.
Splicing new thumbnail data with (1, 2) - (1, N) historical thumbnail data, wherein the method specifically comprises the following steps: reading the k-th row to-be-spliced Data { Data (1, 2) (k), data (1, 3) (k), … …, data (1, N) (k) } of the 2 nd column to the N-th column of the 1 st row thumbnail strip from the FIFO (1), and splicing the k-th row Data newData (k) of the current newly arrived thumbnail (namely the new thumbnail Data) with the k-th row to obtain the k-th row spliced Data of the 1 st row thumbnail strip, wherein the k-th row spliced Data is composed of { Data (1, 2) (k), data (1, 3) (k), … …, data (1, N) (k), newData (k) }; the above operation is performed for each line of data contained in the thumbnail data, and a partial mosaic for displaying the thumbnail strip at line 1 is finally obtained.
The (i, 1) th history thumbnail data and the (i+1, 2) th history thumbnail data are spliced, specifically:
the method comprises the steps of reading k row to-be-spliced Data (i, 1) (k) of a 1 st column of an i-th row of the thumbnail strip from a FIFO (i), reading k row to-be-spliced Data { Data (i+1, 2) (k), data (i+1, 3) (k), … …, data (i+1, N) (k) } of a 2 nd column of the i-th row of the thumbnail strip from the FIFO (i+1), and splicing the two to obtain k row to-be-spliced Data of the i+1 row of the thumbnail strip, wherein the k row to-be-spliced Data comprises { Data (i+1, 2) (k), data (i+1, 3) (k), … …, data (i+1, N) (k), data (i, 1) (k) }; where Data (i, j) (k) represents the kth line Data of the jth thumbnail in the ith line thumbnail stripe, newData (k) represents the kth line Data of the new thumbnail Data.
In practical use, in order to ensure synchronous display of the mosaic image and the optoelectronic video, after the mosaic image is generated, the mosaic image is not directly displayed, but is waited for a clock signal, a line-field synchronizing signal and a splicing command of an upper computer, and synchronous display is performed according to the clock signal, the line-field synchronizing signal and the splicing command of the upper computer, namely, the new thumbnail data and the historical thumbnail data are spliced to obtain the mosaic image, and the mosaic image is displayed in a second area, and the method further comprises: after the splicing is carried out to obtain a splicing image, writing the splicing image into a cache; and reading the spliced graph from the buffer according to the clock signal, the line field synchronous signal and the splicing command of the upper computer, and sending the spliced graph to a display control unit for display.
In practical use, considering that the first area and the second area commonly use the whole display area, when the second area is too large, the image size of the optoelectronic video in the first area is necessarily affected, in order to ensure a good display effect, the present embodiment proposes a preferred embodiment, in which the size of the first area and the size of the second area are determined by the size of the whole display area, the number Num of required observation thumbnails, the original image size of the optoelectronic video, and the thumbnail ratio, as shown in fig. 4, and specifically includes:
in step 401, a thumbnail size is calculated according to the original image size and the thumbnail scale of the optoelectronic video.
In step 402, the width of the overall display area is used as a measure to calculate the number of lines required to be occupied when displaying the thumbnail in the overall line of the overall display area, and calculate the first actual proportion of the photovoltaic video that can be displayed after the number of lines required to be occupied for displaying the thumbnail is removed.
In step 403, the height of the entire display area is used as a measurement standard, the number of columns required to be occupied when the thumbnail is displayed in the entire column of the entire display area is calculated, and the second actual proportion of the photo video that can be displayed after the number of columns required to be occupied by the thumbnail is removed is calculated.
In step 404, the division method corresponding to the largest one of the first actual proportion and the second actual proportion is selected to determine the size of the first region and the size of the second region.
Wherein the first actual proportionThe method comprises the steps of carrying out a first treatment on the surface of the The second actual proportionThe method comprises the steps of carrying out a first treatment on the surface of the Wherein W is the width of the whole display area, H is the height of the whole display area, num is the number of thumbnail images to be observed, k is the thumbnail ratio, and the thumbnail ratio is obtained by analysis according to experience by a person skilled in the art,>is the width of the original image of the photoelectric video, +.>Is the height of the original image of the optoelectronic video.
The above steps 402 and 403 can be understood as two different dividing modes, that is, the step 402 corresponds to the dividing mode as shown in fig. 5, and the thumbnail occupies the whole line of the display area; step 403 corresponds to the split as shown in fig. 6, with the thumbnail occupying the entire column display of the entire display area.
The first area and the second area are obtained by dividing the largest first area (namely, the largest first actual proportion and the largest second actual proportion) in the two dividing modes, so that the spliced thumbnail images can be displayed and the photoelectric video can be displayed to the greatest extent.
In practical use, tracking a target track by using an optical television frequency is often used for playing a monitoring video of a monitoring camera, and considering that in practical use, due to limited monitoring view angles of a single camera, a plurality of cameras are often arranged at various positions of an important monitoring area, for example, a plurality of cameras are arranged on a gallery at intervals according to corresponding distances, and cameras are arranged at corners or intersections of the gallery so as to realize monitoring of a wider area, the embodiment further provides a preferred implementation mode, which specifically comprises the following steps:
dividing the second region into a third region and a fourth region; after converting the latest read frame of photoelectric video original data into new thumbnail data, performing target matching and target track analysis on the new thumbnail data and the historical thumbnail data.
If the target exists in the new thumbnail data obtained through matching, and the moving track of the target is judged to be in a horizontal trend by combining the historical thumbnail data, the new thumbnail data and the historical thumbnail data are spliced and displayed in a third area, wherein the splicing direction is left and right splicing, namely the splicing mode in the method in the embodiment; as shown in fig. 7.
If the target exists in the new thumbnail data obtained through matching, and the moving track of the target is judged to be in a vertical trend by combining the historical thumbnail data, the new thumbnail data and the historical thumbnail data are spliced and displayed in a fourth area, wherein the splicing direction is up and down splicing, namely the new thumbnail data is spliced above or below the previous frame of thumbnail data; as shown in fig. 7. The moving track is relatively horizontal and vertical, and in actual use, the moving track is measured by a horizontal component and a vertical component of the average moving speed of the target, if the horizontal component is greater than the vertical component, the moving track is horizontal, otherwise, the moving track is vertical.
Marking an arrow pointing to the movement trend of the target on the periphery of the corresponding target (such as right above the target) in the original photoelectric video presented in the first area based on the movement track of the target, and if the existence of the target is detected in the previous frame of thumbnail data and the disappearance of the target is detected in the next frame of thumbnail data, determining a first camera which can acquire the video of the target next according to the distribution relation among a plurality of cameras and the movement trend of the target, and switching the whole display area from displaying the video of the current camera to displaying the video of the first camera; the video collected by each camera is transmitted to the central processing platform, the video of the corresponding camera is transmitted to the display area by the central processing platform for display, and the distribution relation among the cameras is preset by a person skilled in the art and stored in the central processing platform.
After the whole display area is switched from displaying the video of the current camera to displaying the video of the first camera, judging whether the monitoring visual angles of the first camera and the current camera can be spliced in the same direction according to the distribution relation among the cameras, wherein the video of the two cameras can be spliced left and right or vertically without adjusting the direction of any video. If the current camera can be spliced in the same direction, the thumbnail data corresponding to the first camera and the historical thumbnail data of the current camera are spliced and displayed, and if the current camera cannot be spliced in the same direction, the historical thumbnail data of the current camera is emptied, and only the thumbnail data corresponding to the first camera is displayed.
For example, as shown in fig. 8, fig. 8 is a top view of an important monitoring location, in which, in accordance with the position distribution shown in fig. 8, a camera is installed at each position of the important monitoring location, for example, if the current display area displays the video of the camera c5, when detecting that the target moves rightwards in the video monitored by the camera c5, a spliced thumbnail is displayed in the third area, when the target disappears, the display area is switched to the camera c10 when knowing that the right side of the monitoring field of view of the camera c5 is the camera c10 according to the distribution relation between the cameras, so as to monitor whether the target enters the monitoring field of view of the camera c10, and if the monitoring field of view distribution of the camera c10 is the same as the distribution direction of the camera c5, the latest thumbnail data obtained by the camera c10 is spliced in the third area to be displayed so as to be convenient for being able to continuously monitor the moving track of the target in real time. The distribution relation between the cameras comprises the position distribution of the cameras and the monitoring field distribution of the cameras (namely, the directions corresponding to the up, down, left and right directions of the video displayed in the first area).
It should be noted that, the preferred embodiment is suitable for the situation that the number of display screens is insufficient and targets in the monitoring area are fewer, and when the targets to be monitored appear, the cameras can be switched in the mode described in the embodiment to achieve real-time tracking of the targets.
Example 2:
on the basis of embodiment 1, the embodiment also provides a real-time dynamic splicing device for the photoelectric cycloscan, which divides the whole display area into a first area and a second area, displays the photoelectric video in the first area, and displays the spliced photoelectric thumbnail in the second area, wherein the device comprises a thumbnail generation module, a thumbnail splicing module and a display module as shown in fig. 9.
The thumbnail generation module is used for receiving photoelectric video original data, clock signals and line field synchronizing signals; receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal; and the upper computer sends the splicing command once every preset time.
The thumbnail splicing module is used for splicing the new thumbnail data with the history thumbnail data to obtain a splicing diagram; wherein the history thumbnail data is thumbnail data that has been displayed in the second area.
The display module is used for superposing the photoelectric video, the splice graph and the graphic display input and then outputting and displaying the superposed photoelectric video, the splice graph and the graphic display input; wherein the mosaic is displayed in a second area.
Wherein the thumbnail generation module is also referred to as a thumbnail generation unit in the subsequent embodiments, and the thumbnail stitching module is also referred to as a thumbnail read-write control unit in the subsequent embodiments.
In order to realize synchronous display of the photoelectric video and the thumbnail, in actual use, the photoelectric cycloscan real-time dynamic splicing device is shown in fig. 10, and comprises an original data caching unit, an original data read-write control unit, a thumbnail generation unit, a thumbnail data caching unit, a thumbnail data read-write control unit, a display control unit and two double rate synchronous dynamic random access memories (Double Data Rate SDRAM, abbreviated as DDR), which are also called DDR1 and DDR2 in the follow-up; the original data buffer unit, the original data read-write control unit, the thumbnail generation unit, the thumbnail data buffer unit, the thumbnail data read-write control unit and the display control unit are realized by a Field programmable gate array (Field-Programmable Gate Array, abbreviated as FPGA). In an alternative embodiment, the FPGA is model JFM7K 325T; DDR selects SCB13H4G160AF-11MI model.
The original data buffer unit is used for receiving and buffering the photoelectric video original data, the clock signal and the line field synchronous signal, sending the clock signal and the line field synchronous signal to the original data read-write control unit, receiving the read buffer signal sent by the original data read-write control unit, reading data according to the read buffer signal and transmitting the data to the original data read-write control unit.
The original data read-write control unit is used for receiving an upper computer command and a display clock signal and a line field synchronizing signal sent by the display control unit, generating a read-write DDR1 signal, reading data from the DDR1 according to the read DDR1 signal, forwarding the data to the display control unit, and writing the data sent by the original data caching unit into the DDR1 according to the write DDR1 signal. The upper computer command comprises an optoelectronic original video window switch, a position and a size.
The thumbnail generating unit is used for receiving a command sent by the upper computer, generating thumbnail data, clock signals and line field synchronizing signals from the data, clock signals and line field synchronizing signals which are originally input by the photoelectric video, and sending the thumbnail data to the thumbnail data caching unit. The upper computer commands include thumbnail splicing commands (i.e., the splicing commands described above), window switches, positions and sizes.
The thumbnail buffer unit is used for receiving and buffering thumbnail data, clock signals and line field synchronizing signals, sending the clock signals and the line field synchronizing signals to the thumbnail data read-write control unit, receiving the read buffer signals sent by the thumbnail data read-write control unit, reading data according to the read buffer signals and transmitting the data to the thumbnail data read-write control unit.
The thumbnail data read-write control unit is used for receiving the clock signal and the line field synchronizing signal sent by the upper computer command and the display control unit, generating a read-write DDR2 signal, reading data from the DDR2 according to the read control signal, forwarding the data to the display control unit, reading the data from the original data cache unit according to the write control signal, and writing the data into the DDR2 after splicing. The upper computer commands comprise thumbnail splicing commands, window switches, positions and sizes.
The display control unit is used for receiving and caching the data, clock signals and line field synchronizing signals input by graphic display, sending the display clock signals and the line field synchronizing signals to the original data read-write control unit and the thumbnail data read-write control unit, reading the original data from the original data read-write control unit, reading the spliced thumbnail data from the thumbnail data read-write control unit, and outputting and displaying the original data, the thumbnail data and the graphic display input data after superposition.
The DDR1 is used for reading and writing the original data according to the reading and writing DDR1 signal generated by the original data reading and writing control unit; the DDR2 is used for reading and writing the thumbnail data according to the reading and writing DDR2 signals generated by the thumbnail data reading and writing control unit.
In this embodiment, the overall display area shown in fig. 11 is taken as an example, and the overall display area shown in fig. 11 includes 1920 columns and 1080 rows, wherein the photoelectric original video window displays photoelectric original video, and is used for observing real-time display of the photoelectric video and detail display of an observation target, and the window size is H columns and I rows, 320H is less than or equal to 1920, and 240 is less than or equal to I is less than or equal to 1080; the photoelectric thumbnail strip video window displays a photoelectric thumbnail real-time dynamic splice diagram, and is used for observing thumbnail splice display in a certain time and space range of the photoelectric video and tracking and grasping the approximate motion trail of an observation target. The photoelectric thumbnail strip video is formed by combining M rows and N columns of thumbnail windows (shown as WinMN in FIG. 11), namely M rows of thumbnail strips, wherein each row of thumbnail strip comprises N columns of thumbnail windows, the thumbnail windows are J columns and K rows, J is more than or equal to 80 and less than or equal to 640, and K is more than or equal to 64 and less than or equal to 512. And calculating the value ranges of M and N according to the graphic display resolution, the photoelectric original video display resolution, the photoelectric thumbnail video display resolution and the processing capacity of the current hardware platform, wherein the value range of M is more than or equal to 1 and less than or equal to 8, and the value range of N is more than or equal to 2 and less than or equal to 24.
When a thumbnail splicing command is received, the currently input photoelectric thumbnail (i.e. the new thumbnail data in the embodiment 1) is sent to the 1 st row and the N th column window for display; the thumbnail displayed by the original row 1 and column N window (i.e. history thumbnail data) is sent to the row 1 and column (N-1) window for display (as shown in FIG. 11, when one thumbnail is added, the top right corner is inserted, and other photoelectric images are moved leftwards and downwards); when M is more than or equal to 2, the video displayed by the original (M-1) row and column 1 window is sent to the M row and column N window for display; video displayed by the original M-th row and N-th column window is sent to the M-th row and N-1-th column window for display. And the like, namely when a thumbnail splicing command is received, new thumbnail data enter the 1 st row and the N th column of window display, and the video displayed by each subsequent window sequentially goes to the next window for display. The currently input photoelectric thumbnail video does not enter the 1 st row and the N th column window for display any more, and each thumbnail window keeps the current display unchanged. The upper computer sends a thumbnail splicing command to the thumbnail data read-write control unit every interval time t, and the calculation formula of t is as follows:
wherein,the field angle of the photoelectric video sensor is, and T is the scanning period of the photoelectric video sensor.
The following is a complete flow executed by the photoelectric cycloscan real-time dynamic splicing device according to the embodiment, as shown in fig. 12, with the size of the photoelectric original video window being 640 columns and 512 rows, and the photoelectric thumbnail stripe video is formed by combining 4 rows and 15 columns of thumbnail windows, and the size of the thumbnail window being 128 columns and 102 rows, for example:
in step 501, the raw data is cached: the original data caching unit receives data, a clock signal and a line field synchronizing signal which are originally input by the photoelectric video, caches the ith line of original data according to the line field synchronizing signal, and simultaneously sends the clock signal and the line field synchronizing signal to the original data read-write control unit, wherein I is more than or equal to 1 and less than or equal to I; in an alternative embodiment, i=512.
In step 502, raw data is read: the original data read-write control unit generates a read cache signal according to the clock signal and the line field synchronizing signal sent by the original data cache unit and sends the read cache signal to the original data cache unit. The original data caching unit reads the ith row of original data according to the read caching signal and sends the ith row of original data to the original data read-write control unit.
In step 503, the raw data is written to DDR1: the original data read-write control unit generates a write DDR1 signal according to the clock signal and the line field synchronous signal sent by the original data buffer unit, and writes the i-th original data into DDR1 according to the write DDR1 signal. When the next line data, clock signal and line field synchronizing signal originally input by the photoelectric video come, the step 501 is shifted to; when the original input of the optoelectronic video is stopped, then steps 501, 502 and 503 are no longer performed.
In step 504, a thumbnail is generated: the thumbnail generating unit receives the data, clock signal and line field synchronizing signal originally input by the photoelectric video, generates thumbnail data (i.e. new thumbnail data in embodiment 1) according to the command of the upper computer, and sends the clock signal and the line field synchronizing signal to the thumbnail data caching unit.
In step 505, thumbnail data is cached: the thumbnail data caching unit is connected with the thumbnail data, the clock signal and the line field synchronizing signal, caches the kth line of thumbnail data according to the line field synchronizing signal, and simultaneously sends the clock signal and the line field synchronizing signal to the thumbnail data read-write control unit, wherein K is more than or equal to 1 and less than or equal to K; in an alternative embodiment, k=102.
In step 506, the thumbnail data is read: the thumbnail data read-write control unit generates a read cache signal according to the clock signal and the line field synchronizing signal sent by the thumbnail data cache unit and sends the read cache signal to the thumbnail data cache unit. The thumbnail data buffer unit reads the k row of thumbnail data according to the read buffer signal and sends the k row of thumbnail data to the thumbnail data read-write control unit. When the thumbnail splicing command is not received, the step 507 is shifted to; when the thumbnail splice command is received, the flow proceeds to step 508.
In step 507, the thumbnail data is written to DDR2: the thumbnail data read-write control unit generates a write DDR2 signal according to the clock signal and the line field synchronous signal sent by the thumbnail data buffer unit, and writes the k row thumbnail data into DDR2 according to the write DDR2 signal. When the next row data of the thumbnail, the clock signal and the row field synchronizing signal arrive, the step is shifted to step 504; when the original input of the optoelectronic video is stopped, the thumbnail generation is also stopped, and then the steps 504, 505, 506 and 507 are not performed any more.
In step 508, the data to be spliced (i.e., the history thumbnail data in embodiment 1) is read from DDR2: the thumbnail data read-write control unit generates a read DDR2 signal according to the clock signal and the line field synchronous signal sent by the thumbnail data buffer unit, sequentially reads the kth data in each thumbnail window in the 1 st line to the M th line according to the read DDR2 signal, and obtains the kth line to-be-spliced data of the M th line and sends the kth line to the thumbnail data read-write control unit; in an alternative embodiment, m=4.
In step 509, data stitching: and the thumbnail data read-write control unit performs data splicing on the read k-row thumbnail data and the k-row data to be spliced of the M rows read from the DDR2 to obtain k-row spliced data of the M rows.
In step 510, the splice data is written to DDR2: the thumbnail data read-write control unit generates a write DDR2 signal according to the clock signal and the line field synchronous signal sent by the thumbnail data buffer unit, and writes the k-th splicing data of M lines into DDR2 according to the write DDR2 signal; when the data, clock signal and line field sync signal of the next (k+1) th line of the thumbnail image come, go to step 504; when the original input of the optoelectronic video is stopped, the thumbnail generation is also stopped, and then the steps 504, 505, 506, 508, 509 and 510 are not performed.
In step 511, the graphical display input: the display control unit receives the data, clock signal and line field synchronizing signal input by the graphic display, and sends the clock signal and the line field synchronizing signal to the original data read-write control unit and the thumbnail data read-write control unit.
In step 512, the raw display data is read from DDR 1: the original data read-write control unit generates a read DDR1 signal according to the clock signal, the row field synchronous signal and the upper computer command sent by the display control unit, and reads one row of original display data from DDR1 according to the read DDR1 signal to send to the display control unit.
In step 513, thumbnail display data is read from DDR 2: the thumbnail data read-write control unit generates a read DDR2 signal according to the clock signal, the row field synchronous signal and the upper computer command sent by the display control unit, and reads one row of thumbnail display data from DDR2 according to the read DDR2 signal to send to the display control unit.
In step 514, the graphical display outputs: the display control unit performs display output according to the input clock signal, the line field synchronizing signal and the upper computer command. If no photoelectric original video window or photoelectric thumbnail strip video window is overlapped on a row corresponding to the current graphic display input, directly outputting the row to be used as graphic display, and then turning to step 511 to process the next row; if the photoelectric original video window is superimposed on one line of the current graphic display input, the step 512 is shifted to, after the received line of original display data is superimposed with one line of data of the current graphic display input, outputting and displaying, and then the step 511 is shifted to the next line of processing; if the line of the current graphic display input has the photoelectric thumbnail stripe video window superimposed, the step goes to step 513, and the display control unit superimposes the received line of thumbnail display data with the line of the current graphic display input, then outputs and displays the superimposed line of thumbnail display data, and goes to step 511 to process the next line.
The step 509, as shown in fig. 13, specifically includes:
in step 601, as shown in fig. 3, 4 FIFOs are set in the thumbnail data read-write control unit, the FIFO depth is 1920, and the k-th row data to be spliced of 4 rows is respectively sent into the 4 FIFOs. The k row Data to be spliced of the m row is formed by { Data (m, 1) (k), data (m, 2) (k), data (m, 3) (k), … …, data (m, 15) (k) }, wherein m is more than or equal to 1 and less than or equal to 4, and Data (m, 15) (k) represents the k row Data of the m row and 15 column thumbnail windows; the m-th row and the 15-th column refer to thumbnail windows of the m-th row and the 15-th column, and the k-th row refers to k-th row data in corresponding thumbnail data.
In step 602, when m=1, the k-th row to-be-spliced Data { Data (1, 2) (k), data (1, 3) (k), … …, data (1, 15) (k) } of the thumbnail windows of the 2 nd column to the 15 th column in the 1 st row thumbnail stripe is read from the FIFO1, and the k-th row spliced Data of the thumbnail stripe of the 1 st row is obtained by splicing the current newly arrived thumbnail k-th row Data newData (k) with the Data { Data (1, 2) (k), data (1, 3) (k), … …, data (1, 15) (k), newData (k) }.
In step 603, when m is greater than or equal to 2, the Data to be spliced (m-1, 1) (k) of the kth row thumbnail window of the 1 st column in the (m-1) th row thumbnail stripe is read from the FIFO (m), the Data { Data (m, 2) (k), data (m, 3) (k), … …, data (m, 15) (k) } of the kth row thumbnail window of the 2 nd column to the 15 th column thumbnail window in the m-th row thumbnail stripe is read from the FIFOm, and the Data { Data (m, 2) (k), data (m, 3) (k), … …, data (m, 15) (k), data (m-1, 1) (k) } of the kth row thumbnail stripe is spliced.
Fig. 14 is a schematic structural diagram of an embodiment of the present invention of a real-time dynamic splicing device for photoelectric cycloscan. The device for dynamically splicing the photoelectric cycloscan video in real time in this embodiment includes one or more processors 21 and a memory 22. In fig. 14, a processor 21 is taken as an example.
The processor 21 and the memory 22 may be connected by a bus or otherwise, which is illustrated in fig. 14 as a bus connection.
The memory 22 is used as a non-volatile computer readable storage medium for storing non-volatile software programs and non-volatile computer executable programs, such as the electro-optical cyclic video real-time dynamic stitching method of embodiment 1. The processor 21 executes the electro-optical Zhou Saoshi frequency real-time dynamic stitching method by running non-volatile software programs and instructions stored in the memory 22.
The memory 22 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 22 may optionally include memory located remotely from processor 21, which may be connected to processor 21 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The program instructions/modules are stored in the memory 22, which when executed by the one or more processors 21, perform the electro-optical cyclic video real-time dynamic stitching method of embodiment 1 described above.
It should be noted that, because the content of information interaction and execution process between modules and units in the above-mentioned device and system is based on the same concept as the processing method embodiment of the present invention, specific content may be referred to the description in the method embodiment of the present invention, and will not be repeated here.
Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the embodiments may be implemented by a program that instructs associated hardware, the program may be stored on a computer readable storage medium, the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, and alternatives falling within the spirit and principles of the invention.
Claims (10)
1. The real-time dynamic splicing method of the photoelectric cycloscan video is characterized in that an integral display area is divided into a first area and a second area, the photoelectric video is displayed in the first area, and the spliced photoelectric thumbnail is displayed in the second area, and the splicing method comprises the following steps:
Receiving photoelectric video original data, a clock signal and a line field synchronizing signal;
receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal;
splicing the new thumbnail data with the history thumbnail data to obtain a spliced image, and displaying the spliced image in a second area; wherein the history thumbnail data is thumbnail data that has been displayed in the second area.
2. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 1, wherein when the second area includes M rows of thumbnail strips, and each row of thumbnail strips is horizontally arranged to display N thumbnail data, the splicing the new thumbnail data with the historical thumbnail data to obtain a splice map specifically includes:
splicing the new thumbnail data with the (1, 2) - (1, N) historical thumbnail data to obtain a local splicing diagram for displaying the thumbnail strips in the 1 st row; when the (1, 2) - (1, N) historical thumbnail data are sequentially arranged from left to right, the new thumbnail data are spliced on the right side of the (1, N) historical thumbnail data, and when the (1, 2) - (1, N) historical thumbnail data are sequentially arranged from right to left, the new thumbnail data are spliced on the left side of the (1, N) historical thumbnail data;
Splicing the (i, 1) th historical thumbnail data with the (i+1, 2) th historical thumbnail data to obtain a local splicing diagram for displaying the (i+1) th row thumbnail strip; when the (i+1, 2) th to (i+1, N) th history thumbnail data are sequentially arranged from left to right, the (i, 1) th history thumbnail data are spliced on the right side of the (i+1, N) th history thumbnail data, when the (i+1, 2) th to (i+1, N) th history thumbnail data are sequentially arranged from right to left, the (i, 1) th history thumbnail data are spliced on the left side of the (i+1, N) th history thumbnail data, i is a positive integer, i is smaller than M, and the (i, j) th history thumbnail data are the j th thumbnail data in the i th row thumbnail strip displayed in the second area;
and splicing the partial splice graphs for displaying the thumbnail strips in each row sequentially from top to bottom to obtain the splice graph for displaying the second area.
3. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 2, wherein the splicing the new thumbnail data with the (1, 2) - (1, n) -th historical thumbnail data specifically comprises:
And splicing the kth line data in the new thumbnail data with the kth line data in the (1, 2) - (1, N) historical thumbnail data.
4. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 2, wherein the splicing the new thumbnail data and the history thumbnail data to obtain a spliced image, and displaying the spliced image in a second area, further comprises:
after the splicing is carried out to obtain a splicing image, writing the splicing image into a cache;
and reading the spliced graph from the buffer according to the clock signal, the line field synchronous signal and the splicing command of the upper computer, and sending the spliced graph to a display control unit for display.
5. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 1, wherein the upper computer sends the splicing command once every preset time t; wherein, the angle of view of the photoelectric video sensorMultiplying the scanning period T of the photoelectric video sensor and dividing by 360 degrees to obtain the preset time T.
6. The method for dynamically splicing photoelectric cycloscan video in real time according to claim 5, wherein when the angle of view of the photoelectric video sensor isWhen the scanning period T of the photoelectric video sensor is 24s and is 2.3 degrees, the preset time is 0.1533s.
7. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 1, wherein the size of the first area and the size of the second area are determined by the size of the whole display area, the number of thumbnail images to be observed, the size of the original image of the photoelectric video and the thumbnail ratio, and specifically comprises the following steps:
calculating to obtain the size of the thumbnail according to the size and the thumbnail proportion of the original image of the photoelectric video;
calculating the number of lines required to be occupied when the thumbnail is displayed in the whole line of the whole display area by taking the width of the whole display area as a measurement standard, and calculating a first actual proportion of the photoelectric video which can be displayed and corresponds to the line number required to be occupied when the thumbnail is displayed is removed;
taking the height of the whole display area as a measurement standard, calculating the number of columns required to be occupied when the thumbnail is displayed in the whole display area, and calculating a second actual proportion of the photoelectric video which can be displayed and corresponds to the removed number of columns required to be occupied when the thumbnail is displayed;
and selecting a segmentation mode corresponding to the largest one of the first actual proportion and the second actual proportion to determine and obtain the size of the first area and the size of the second area.
8. The method for dynamically splicing the photoelectric cycloscan video in real time according to claim 7, wherein the first actual proportion ；
The second actual proportionThe method comprises the steps of carrying out a first treatment on the surface of the Wherein W is the width of the whole display area, H is the height of the whole display area, num is the number of thumbnail images to be observed, k is the thumbnail ratio, < >>Is the width of the original image of the photoelectric video, +.>Is the height of the original image of the optoelectronic video.
9. The device is characterized in that an integral display area is divided into a first area and a second area, photoelectric video is displayed in the first area, spliced photoelectric thumbnails are displayed in the second area, and the device comprises a thumbnail generation module, a thumbnail splicing module and a display module;
the thumbnail generation module is used for receiving photoelectric video original data, clock signals and line field synchronizing signals; receiving a splicing command from an upper computer, and converting the latest read frame of photoelectric video original data into new thumbnail data according to the splicing command, a clock signal and a line field synchronous signal; the upper computer sends the splicing command once every preset time interval;
the thumbnail splicing module is used for splicing the new thumbnail data with the history thumbnail data to obtain a splicing diagram; wherein the history thumbnail data is thumbnail data that has been displayed in the second area;
The display module is used for superposing the photoelectric video, the splice graph and the graphic display input and then outputting and displaying the superposed photoelectric video, the splice graph and the graphic display input; wherein the mosaic is displayed in a second area.
10. The utility model provides a photoelectric peri-scan video real-time dynamic splicing device which is characterized in that the device comprises:
at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor for performing the method of electro-optical cyclic video real-time dynamic stitching of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311579431.3A CN117440250A (en) | 2023-11-24 | 2023-11-24 | Photoelectric peri-scanning video real-time dynamic splicing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311579431.3A CN117440250A (en) | 2023-11-24 | 2023-11-24 | Photoelectric peri-scanning video real-time dynamic splicing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117440250A true CN117440250A (en) | 2024-01-23 |
Family
ID=89558306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311579431.3A Pending CN117440250A (en) | 2023-11-24 | 2023-11-24 | Photoelectric peri-scanning video real-time dynamic splicing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117440250A (en) |
-
2023
- 2023-11-24 CN CN202311579431.3A patent/CN117440250A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8749667B2 (en) | System and method for maintaining maximum input rate while up-scaling an image vertically | |
| CN105872432B (en) | The apparatus and method of quick self-adapted frame rate conversion | |
| CN109413392B (en) | Embedded multi-channel video image acquisition and parallel processing system and method | |
| US11182908B2 (en) | Dense optical flow processing in a computer vision system | |
| CN103631698A (en) | Camera PTZ (pan/tilt/zoom) control method and device for target tracking | |
| CN103647937A (en) | An image tracking system and an image data processing method thereof | |
| WO2020228353A1 (en) | Motion acceleration-based image search method, system, and electronic device | |
| US11682212B2 (en) | Hierarchical data organization for dense optical flow processing in a computer vision system | |
| CN103533313A (en) | Geographical position based panoramic electronic map video synthesis display method and system | |
| CN110211039B (en) | Image processing method and device | |
| CN116486250A (en) | Multi-path image acquisition and processing method and system based on embedded type | |
| CN113313201A (en) | Multi-target detection and distance measurement method based on Swin transducer and ZED camera | |
| CN113365028A (en) | Method, device and system for generating routing inspection path | |
| CN109708662B (en) | High-frame-frequency high-precision injection type star atlas simulation test platform based on target identification | |
| CN117440250A (en) | Photoelectric peri-scanning video real-time dynamic splicing method and device | |
| CN110647173A (en) | Video tracking system and method | |
| CN112884803A (en) | Real-time intelligent monitoring target detection method and device based on DSP | |
| JP2013142636A (en) | Infrared target detector | |
| JP3853976B2 (en) | Radar device, similar device, and image data writing method | |
| KR101081934B1 (en) | Image generation apparatus and panoramic image generation method thereof | |
| CN105469374A (en) | High-speed high-capacity infrared image data real time display method | |
| CN110087011B (en) | Industrial equipment vibration video acquisition and storage system based on high-speed camera | |
| CN111479166A (en) | Multi-pointer memory access method and video frame rate conversion device | |
| CN103327269A (en) | High speed radar video display processing method with progressive output mode | |
| CN114125403B (en) | Endoscope display method and device, electronic equipment and FPGA |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |