CN102170550B - Method and device of image mosaic imaging in background of wide field of view - Google Patents

Method and device of image mosaic imaging in background of wide field of view Download PDF

Info

Publication number
CN102170550B
CN102170550B CN201110052397A CN201110052397A CN102170550B CN 102170550 B CN102170550 B CN 102170550B CN 201110052397 A CN201110052397 A CN 201110052397A CN 201110052397 A CN201110052397 A CN 201110052397A CN 102170550 B CN102170550 B CN 102170550B
Authority
CN
China
Prior art keywords
image
pattern
format
sdram
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201110052397A
Other languages
Chinese (zh)
Other versions
CN102170550A (en
Inventor
高玉龙
白旭
吴少川
常坚
管修挚
沙学军
马永奎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Harbin Institute of Technology
Original Assignee
Harbin Institute of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harbin Institute of Technology filed Critical Harbin Institute of Technology
Priority to CN201110052397A priority Critical patent/CN102170550B/en
Publication of CN102170550A publication Critical patent/CN102170550A/en
Application granted granted Critical
Publication of CN102170550B publication Critical patent/CN102170550B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

A method and a device of image mosaic imaging in a background of wide field of view belong to the field of image processing. The invention solves the problem that high cost, wasting of resources and unstable system work are caused by adopting multiple image collecting terminals and monitoring equipment to observe related targets in wide field of view. The method comprises the following steps: 1.collecting n PAL format images of a goal object by an image collecting terminal according to the range of observation of the image collecting terminal; 2.converting the PAL format images collected by step 1 into CIF format images to obtain n CIF format images; 3.storing the n CIF format images data into writing FIFO; 4.storing data of the n CIF format images stored into the writing FIFO into an SDRAM to be treated with image mosaic with an address interlacing rule; and 5. reading the image data stored in the SDRAM and showing the mosaic images .

Description

Image mosaic formation method and device under the wide surround of a comparison field
Technical field
The present invention relates to view data after a kind of image decompressor the be expert at relative theory and the method for the image mosaic under the field sync signal control, belong to image processing field.
Background technology
At present; Under the scouting situation of civil and military; The situation that big visual field all might occur, but, can not see the target of all angles in the big visual field simultaneously because the visual field at IMAQ terminal (such as camera or target seeker) is narrower; People can only be installed by a plurality of IMAQs terminal and surveillance equipment removes to observe the related objective in the big visual field, have caused like this that cost is too high, the instability of the wasting of resources and system works.
Summary of the invention
The present invention seeks to remove to observe the related objective in the big visual field in order to solve existing a plurality of IMAQs terminal and the surveillance equipment of adopting; Caused like this that cost is too high, the problem of unstable of the wasting of resources and system works, image mosaic formation method and device under a kind of wide surround of a comparison field are provided.
Image mosaic formation method under the wide surround of a comparison field according to the invention, this method may further comprise the steps:
Step 1, according to the range of observation at IMAQ terminal, the n width of cloth PAL format-pattern of object is gathered at the IMAQ terminal, the sampled images data rate is 13.5M;
Step 2, the PAL format-pattern that step 1 is collected convert the CIF format-pattern to, obtain n width of cloth CIF format-pattern;
Step 3, said n width of cloth CIF format-pattern data are deposited in write FIFO,
Step 4, to depositing the n width of cloth CIF format-pattern The data interleave address rale store write among the FIFO in SDRAM, carry out image mosaic and handle; To depositing the process of n width of cloth CIF format-pattern The data interleave address rale store in SDRAM of writing among the FIFO in be:
Satisfying line synchronizing signal at the same time is that blanking H=0, field sync signal are that effective V=1, field signal are a strange F=1 and write under the situation of effective four conditions of FIFO; Clock with 90M writes SDRAM with n width of cloth CIF format-pattern data; Write data and carry out according to the interleave address rule, said interleave address rule is:
With the page or leaf is that unit stores, storage four width of cloth images in every page, the write sequence of four width of cloth images in every page be upper left, upper right a, left side down, the bottom right,
The address that the image of top-left position writes SDRAM is:
0 1 . . . . . . 360 - 1 720 721 . . . . . . 720 + ( 360 - 1 ) . . . . . . 2 m × 360 2 m × 360 + 1 . . . . . . 2 m × 360 + ( 360 - 1 ) . . . . . . 2 × 287 × 360 2 × 287 × 360 + 1 . . . . . . 2 × 287 × 360 + ( 360 - 1 ) = 20699 ;
The address that the image of upper-right position writes SDRAM is:
360 361 . . . . . . 720 - 1 1080 1081 . . . . . . 1080 + ( 720 - 1 ) . . . . . . ( 2 m + 1 ) × 360 ( 2 m + 1 ) × 360 + 1 . . . . . . ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . ( 2 × 287 + 1 ) × 360 2 × 287 × 360 + 1 . . . . . . ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 207359 ;
The address that the image of left side upper/lower positions writes SDRAM is:
720 × 288 720 × 288 + 1 . . . . . . 720 × 288 + ( 360 - 1 ) 720 × 288 + 720 720 × 288 + 721 . . . . . . 720 × 288 + 720 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 m × 360 720 × 288 + 2 m × 360 + 1 . . . . . . 720 × 288 + 2 m × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 720 × 288 + 2 × 287 × 360 + 1 . . . . . . 720 × 288 + 2 × 287 × 360 + ( 360 - 1 ) = 414359 ;
The address that the bottom right images of positions writes SDRAM is:
720 × 288 + 360 720 × 288 + 360 + 1 . . . . . . 720 × 288 + 360 + ( 360 - 1 ) 720 × 288 + 1080 720 × 288 + 1081 . . . . . . 720 × 288 + 1080 + ( 360 - 1 ) . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 . . . . . . 720 × 288 + ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 414719 ;
FIFO (First In First Out) is a kind of data buffer of first in first out.
SDRAM is a data storage card at a high speed.
When storage,, need write view data in the SDRAM memory according to interleave address rule shown in Figure 8 for the CIF format-pattern that guarantees different angles appears at position shown in Figure 7.The 1st width of cloth CIF form corresponding angle be 30 degree to 25 degree, start address is 0, when reaching 360-1 in the address, writes address 720 to data, rather than 360, writes 288 row view data according to this rule always; The initial address of the 2nd width of cloth CIF format-pattern be 360, the 1 line data corresponding address be 360 to 719, the 2 line data corresponding address be 720+360 to 720+720-1, and the like, write altogether 288 the row.The corresponding initial address of the 3rd width of cloth CIF format-pattern is that the 720 * 288, the 1st row corresponding address is 720 * 288 to 720 * 288+360-1, then to write 288 row with the 1st identical rule; The corresponding initial address of the 4th width of cloth CIF format-pattern is 720 * 288+360, and the 1st row corresponding address is 720 * 288+360 to 720 * 288+720-1, then to write 288 row with the 2nd identical rule; 8 width of cloth of other the 2 pages of correspondences rule and preceding 4 width of cloth regular identical is the initial address difference, and it is 720 * 576 * 2 that the 2nd start of Page address is the 720 * 576,3rd page.
Carrying out image mosaic is treated to: the image stored that interweaves amounts to
Figure GDA00001664117600032
page or leaf; The image of page or leaf connects together successively and splices processing with , and every page four width of cloth CIF format-pattern is spliced into a width of cloth PAL format-pattern;
Step 5, read the view data that is stored among the SDRAM, and demonstrate spliced image.
Image mosaic imaging device under the wide surround of a comparison field of realization said method; It comprises IMAQ terminal, image D/A modular converter, image compression module, wireless transmitting system, image decompressor module, image mosaic module, image display, operational order transmission system and controls module
Control module output acquisition signal and give the operational order transmission system; Operational order transmission system output acquisition instructions is given the IMAQ terminal; Image D/A modular converter is exported to the PAL format-pattern that collects in the IMAQ terminal; Image D/A modular converter becomes digital signal to export to image compression module the analog signal conversion of input; Image after image compression module will be compressed is exported to the image decompressor module through wireless transmitting system; Image after the image decompressor module will decompress is exported to the image mosaic module, and the image mosaic module is carried out image mosaic down in the stitching image order control that controls module output, and the image mosaic module will splice good image and exported to the image display demonstration and export.
The image mosaic module comprises image C IF format converting module, writes FIFO, SDRAM, reads FIFO, four picture processing modules and image A/D modular converter,
Image C IF format converting module converts the PAL format-pattern that receives into the CIF format-pattern; CIF format-pattern after image C IF format converting module will be changed deposits in writes FIFO; When write FIFO write full after with data output and interweave at a high speed and be stored among the SDRAM; Read FIFO from the SDRAM sense data; And through the splicing of finishing dealing with of four picture processing modules, image handles for image A/D modular converter after the splicing of four picture processing modules output numeral, image after the splicing of the simulation after image A/output of D modular converter is handled.
Advantage of the present invention: through image mosaic, can show the image in 4 field ranges in IMAQ terminal at a PAL format-pattern, can significantly enlarge field range through increasing number of pages.Compare original method, the IMAQ terminal of use and monitor number reduce number_picture-1, promptly only use an IMAQ terminal and surveillance equipment.All targets in the big field range can be observed continuously through image mosaic, target can better be kept watch on or catch.Significantly reduce the number of IMAQ terminal and graphic display terminal, increased the stability and the reliability of system, also reduced the consumption of electric energy accordingly, had the function of energy-conserving and environment-protective.
Description of drawings
Fig. 1 is the flow chart of the image mosaic formation method under the wide surround of a comparison field;
Fig. 2 is the structural representation of the image mosaic imaging device under the wide surround of a comparison field;
Fig. 3 is the structural representation of execution mode three described image mosaic modules;
Fig. 4 is an angle sketch map of observing big field range;
Fig. 5 is the sketch map that concerns between the capable field sync signal in the picture signal;
Fig. 6 is the rough schematic view that concerns between the capable field sync signal in the picture signal;
Fig. 7 is the corresponding relation sketch map of IMAQ terminal viewing angle and image;
Fig. 8 is an image memory address interlacing rule sketch map.
Embodiment
Embodiment one: below in conjunction with Fig. 1, Fig. 4 to Fig. 8 this execution mode is described, the image mosaic formation method under the said wide surround of a comparison field of this execution mode is characterized in that this method may further comprise the steps:
Step 1, according to the range of observation at IMAQ terminal, the n width of cloth PAL format-pattern of object is gathered at the IMAQ terminal, the sampled images data rate is 13.5M;
Step 2, the PAL format-pattern that step 1 is collected convert the CIF format-pattern to, obtain n width of cloth CIF format-pattern;
Step 3, said n width of cloth CIF format-pattern data are deposited in write FIFO,
Step 4, to depositing the n width of cloth CIF format-pattern The data interleave address rale store write among the FIFO in SDRAM, carry out image mosaic and handle;
Step 5, read the view data that is stored among the SDRAM, and demonstrate spliced image.
The digital image processing techniques that this execution mode relates to be subjects such as light harvesting, microelectronics, computer science, applied mathematics in the comprehensive frontier branch of science of one, it is the subject that rises extensively and profoundly and gradually along with computer application.Along with improving constantly of capability of personal computers, make the range of application of digital image processing techniques and scale constantly enlarge.The automatic splicing of digital picture is one of them research branch, has very high theory and practice and is worth.
The image mosaic technology can solve since imaging device such as camera because of the restriction of self visual angle and size; Can not produce the problem of big image; So-called image mosaic is exactly by two width of cloth and abovely has partly overlapping image and generate the more wide-field image of a width of cloth, should keep the characteristic of original image and will realize seamless transitions simultaneously.Thereby have a very wide actual application value, its research has also been promoted the research of image processing related algorithm.
The present invention discloses the multiple image splicing in a kind of image wireless communication.The view data that under the control of the capable field sync signal that the image decompressor module produces, the image decompressor module is provided is handled.This joining method mainly comprises three key technologies, i.e. image C IF format conversion, the image high speed storing with read, the image memory address interweaves.At first according to the relation between CIF form and the PAL form; Employing is taken out the field and view data is carried out the conversion of CIF form with the method for owing to sample; Image after the conversion is put into according to sampling rate and is write FIFO, writes image data memory to data with the speed of 90M according to the interleave address rule under the control of the field sync signal of when the FIFO number reaches certain number, being expert at.Be unit with the page or leaf from the video memory reads image data to reading the FIFO according to the row field sync signal according to operational order then, carry out digital-to-analogue conversion through image D/A device and show reading view data among the FIFO at last.This image split-joint method just can be kept watch on the pass scope bigger tens even tens times than itself range of observation with an IMAQ terminal; Expanded the range of observation of keeping watch on greatly; And because the minimizing of acquisition terminal can increase the stability and the reliability of whole system; Significantly reduce the expense of IMAQ terminal and surveillance equipment, further reduce its power consumption, have environment-friendly function.
N width of cloth PAL format-pattern obtains by following formula in the step 1:
In the formula, all_angle is the observation field range of object;
Signal_angle is the range of observation at IMAQ terminal;
The resolution of every width of cloth PAL format-pattern is 720 * 576.
At first confirm to need to observe the scope of visual field, adopt angle to represent all_angle, as shown in Figure 4.This viewpoint definition be with the IMAQ terminal on a horizontal plane, be center line OL with IMAQ terminal forward line stretcher, the angle between the right and left OM and the ON.The angle signal_angle that can observe according to the IMAQ terminal then; Confirm the pairing picture number n of CIF form; Promptly
Figure GDA00001664117600062
if all_angle is not an integral multiple divided by signal_angle, the image that then remains angle at last is as piece image.
At first obtain view data, field signal F, field sync signal V and line synchronizing signal H from the image decompressor module.Follow-up all operations all are at H, V, and F control is handled and is adjusted the later view data that decompresses down.This invention mainly comprises the CIF format conversion of view data, the high speed storing of view data with read image memory address three parts that interweave.
The process that the PAL format-pattern that step 1 is collected in the step 2 converts the CIF format-pattern to is:
In line synchronizing signal is effective H=1 and field sync signal when being effective V=1, through the mode of owing to sample the PAL format-pattern that step 1 collects is sampled, and the sampled images data rate is 6.75M, and the resolution of image becomes 360 * 576; Simultaneously, give up the even field picture data of said PAL format-pattern, convert the CIF format-pattern to, the resolution of said CIF format-pattern is 360 * 288.
The resolution of normal pal mode image is 720X576, and every width of cloth image comprises two of odd evens, and image data rates is 13.5M, in step 2, image data rates is reduced to 6.75M from 13.5M, and this moment, image resolution ratio was 360X576; Meanwhile, give up the even field picture data of said PAL format-pattern, convert the CIF format-pattern to, the resolution of said CIF format-pattern is 360 * 288.Through the CIF format conversion, four width of cloth images originally become piece image through being placed on different positions.
In the step 4 be to depositing the process of n width of cloth CIF format-pattern The data interleave address rale store in SDRAM of writing among the FIFO in:
Satisfying line synchronizing signal at the same time is that blanking H=0, field sync signal are that effective V=1, field signal are a strange F=1 and write under the situation of effective four conditions of FIFO; Clock with 90M writes SDRAM with n width of cloth CIF format-pattern data; Write data and carry out according to the interleave address rule, said interleave address rule is:
With the page or leaf is that unit stores, storage four width of cloth images in every page, the write sequence of four width of cloth images in every page be upper left, upper right a, left side down, the bottom right,
The address that the image of top-left position writes SDRAM is:
0 1 . . . . . . 360 - 1 720 721 . . . . . . 720 + ( 360 - 1 ) . . . . . . 2 m × 360 2 m × 360 + 1 . . . . . . 2 m × 360 + ( 360 - 1 ) . . . . . . 2 × 287 × 360 2 × 287 × 360 + 1 . . . . . . 2 × 287 × 360 + ( 360 - 1 ) = 20699 ;
The address that the image of upper-right position writes SDRAM is:
360 361 . . . . . . 720 - 1 1080 1081 . . . . . . 1080 + ( 720 - 1 ) . . . . . . ( 2 m + 1 ) × 360 ( 2 m + 1 ) × 360 + 1 . . . . . . ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . ( 2 × 287 + 1 ) × 360 2 × 287 × 360 + 1 . . . . . . ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 207359 ;
The address that the image of left side upper/lower positions writes SDRAM is:
720 × 288 720 × 288 + 1 . . . . . . 720 × 288 + ( 360 - 1 ) 720 × 288 + 720 720 × 288 + 721 . . . . . . 720 × 288 + 720 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 m × 360 720 × 288 + 2 m × 360 + 1 . . . . . . 720 × 288 + 2 m × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 720 × 288 + 2 × 287 × 360 + 1 . . . . . . 720 × 288 + 2 × 287 × 360 + ( 360 - 1 ) = 414359 ;
The address that the bottom right images of positions writes SDRAM is:
720 × 288 + 360 720 × 288 + 360 + 1 . . . . . . 720 × 288 + 360 + ( 360 - 1 ) 720 × 288 + 1080 720 × 288 + 1081 . . . . . . 720 × 288 + 1080 + ( 360 - 1 ) . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 . . . . . . 720 × 288 + ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 414719 ;
FIFO (First In First Out) is a kind of data buffer of first in first out.
SDRAM is a data storage card at a high speed.
When storage,, need write view data in the SDRAM memory according to interleave address rule shown in Figure 8 for the CIF format-pattern that guarantees different angles appears at position shown in Figure 7.The 1st width of cloth CIF form corresponding angle be 30 degree to 25 degree, start address is 0, when reaching 360-1 in the address, writes address 720 to data, rather than 360, writes 288 row view data according to this rule always; The initial address of the 2nd width of cloth CIF format-pattern be 360, the 1 line data corresponding address be 360 to 719, the 2 line data corresponding address be 720+360 to 720+720-1, and the like, write altogether 288 the row.The corresponding initial address of the 3rd width of cloth CIF format-pattern is that the 720 * 288, the 1st row corresponding address is 720 * 288 to 720 * 288+360-1, then to write 288 row with the 1st identical rule; The corresponding initial address of the 4th width of cloth CIF format-pattern is 720 * 288+360, and the 1st row corresponding address is 720 * 288+360 to 720 * 288+720-1, then to write 288 row with the 2nd identical rule; 8 width of cloth of other the 2 pages of correspondences rule and preceding 4 width of cloth regular identical is the initial address difference, and it is 720 * 576 * 2 that the 2nd start of Page address is the 720 * 576,3rd page.
Carrying out image mosaic in the step 4 is treated to: the image stored that interweaves amounts to
Figure GDA00001664117600082
page or leaf; The image of page or leaf connects together successively and splices processing with
Figure GDA00001664117600083
, and every page four width of cloth CIF format-pattern is spliced into a width of cloth PAL format-pattern.
Reading the condition that is stored in the view data among the SDRAM in the step 5 is: line synchronizing signal is blanking H=0, and field sync signal is effective V=1, and field signal is a strange F=1;
Reads image data is positive sequence or backward, positive sequence for read successively the 1st page to
Figure GDA00001664117600084
page or leaf; Backward for read
Figure GDA00001664117600085
successively the page or leaf to 1 page;
The speed of reads image data is 90M.
The 1st kind is read the image of corresponding page or leaf according to operational order, as read the 1st page from the address 0 to (720x576-1), corresponding angle is 30 to spend to 10 degree; The 2nd page then for 720x576 to 720x576x2-1, corresponding angle is 10 to spend-10 degree, the 2nd page then for 720x576x2 to 720x576x3-1, corresponding angle is spent-30 and is spent for-10.The 2nd kind for since the 1st page to the 3rd page, and order reads from SDRAM, or with opposite process from the 3rd page to the 1st page.
Get the data read in the memory when reading FIFO; Relation according to row signal (H) useful signal and blanking signal; It is the blanking signal that the every capable signal of image comprises 720 pixel useful signals and 144 pixels; Owing to read the 13.5M that clock is the PAL call format that reads of FIFO; In order during 144 blanking signals of correspondence, to read the clock that needs to delegation's 720 view data from memory is 720 * 13.5/144=67.5M; Be difficult to reach so high storage speed for common memory device, adopt the SDRAM device among the present invention, consider clock rate that the present invention under the situation of ranks conversion expense, conversion expense, automatic updating cost and system design surplus between BANK of SDRAM itself adopts 90M image data storage in SDRAM.Because same controller is adopted in the read-write of SDRAM, so the read-write clock of SDRAM is 90M.
Passing through the spliced view data of said method; At the H signal is valid period (H=1); F is strange (F=1), under the V situation that effectively (V=1) three conditions all satisfy, reads and gives image A/D modular converter and change and show from reading FIFO with the speed of 13.5M.
Embodiment two: this execution mode is described below in conjunction with Fig. 2, Fig. 5 and Fig. 6; The device of the image mosaic formation method under the wide surround of a comparison field of realization execution mode one; It comprises IMAQ terminal 1, image D/A modular converter 2, image compression module 3, wireless transmitting system 4, image decompressor module 5, image mosaic module 6, image display 7, operational order transmission system 8 and controls module 9
Control module 9 output acquisition signals and give operational order transmission system 8; Operational order transmission system 8 output acquisition instructions are given IMAQ terminal 1; Image D/A modular converter 2 is exported to the PAL format-pattern that collects in IMAQ terminal 1; Image D/A modular converter 2 becomes digital signal to export to image compression module 3 analog signal conversion of input; Image after image compression module 3 will be compressed is exported to image decompressor module 5 through wireless transmitting system 4; Image after image decompressor module 5 will decompress is exported to image mosaic module 6, and image mosaic module 6 is carried out image mosaic down in the stitching image order control that controls module 9 output, and image mosaic module 6 will splice good image and exported to image display 7 demonstrations and export.
Fig. 2 has provided the block diagram of image wireless transmission.The image that gather at IMAQ terminal 1 in this system splices the image from different angles through overcompression, wireless system transmission and after decompressing, and reaches the purpose of on a display screen, seeing the image of a plurality of angles simultaneously.Patent of the present invention mainly provides the joining method of the CIF format-pattern of different angles a PAL format picture.
When carrying out image mosaic, need utilize the capable field sync signal of picture signal that the data and the processing of gathering are controlled, so that view data can be carried out image mosaic by the correct store through cache of writing.Therefore, at first introduce the relevant knowledge of picture signal.It is a signal of the capable field synchronization of continually varying band in time that picture signal is used the method representation of simulation; Will with the image of a PAL form in the horizontal direction with any convergent-divergent of vertical direction; Can consider the digitized representations method of picture signal, i.e. the method for expressing of CCIR656.In this kind method for expressing; TV signal earlier with component format (YBCbBCrOB2B2) expression, is expressed as the data flow of a 8bit again, and the order of data flow is Cb0Y0Cr0Y1Cb2Y2Cr2Y3 ... Each pixel accounts for 2 bytes, and the pixel clock after the quantification is 13.5MHz.Fig. 5 has provided between the synchronizing signal in the two field picture (comprising two field signals), the relation between synchronizing signal and the view data.As can be seen from Figure 5 a two field picture comprises two (strange with idol), and effective line number of every is 288 row, every row be 720 effectively as number, being image resolution ratio is 720 * 576.Fig. 6 has carried out simplifying processing to Fig. 5, and emphasis has been described the relation between the capable field sync signal, can better understand image split-joint method like this.
Embodiment three: this execution mode is described below in conjunction with Fig. 3; This execution mode is described further execution mode two; Image mosaic module 6 comprises image C IF format converting module 6-1, writes FIFO6-2, SDRAM6-3, reads FIFO6-4, four picture processing module 6-5 and image A/D modular converter 6-6
Image C IF format converting module 6-1 converts the PAL format-pattern that receives into the CIF format-pattern; CIF format-pattern after image C IF format converting module 6-1 will change deposits in writes FIFO6-2; When write FIFO6-2 write full after with data output and interweave at a high speed and be stored among the SDRAM6-3; Read FIFO6-4 from the SDRAM6-3 sense data; And through the four picture processing module 6-5 splicing of finishing dealing with, image handles for image A/D modular converter 6-6 after the splicing of four picture processing module 6-5 output numeral, image after the splicing of the simulation after image A/D modular converter 6-6 output is handled.
Embodiment four: this execution mode is described further execution mode two, and the capacity of writing FIFO6-2 is 512 bytes, and the capacity of reading FIFO6-4 is 720 * 576 bytes.
Embodiment five: this execution mode provides a specific embodiment, and in the present embodiment, the angle that needs to observe is ± 30 degree, and promptly all_angle is 60 degree, and the range of observation signal_angle of the visual field at IMAQ terminal 1 is 5 degree,
The n width of cloth PAL format-pattern of object, the n=60/5=12 width of cloth are gathered in execution in step one, IMAQ terminal.
Execution in step two, the PAL format-pattern that step 1 is collected convert the CIF format-pattern to, obtain n width of cloth CIF format-pattern;
In line synchronizing signal is effective H=1 and field sync signal when being effective V=1, through the mode of owing to sample the PAL format-pattern that step 1 collects is sampled, and the sampled images data rate is 6.75M, and the resolution of image becomes 360 * 576; Simultaneously, give up the even field picture data of said PAL format-pattern, convert the CIF format-pattern to, the resolution of said CIF format-pattern is 360 * 288.
Execution in step three, said n width of cloth CIF format-pattern data are deposited in write FIFO.
Depositing the condition of writing FIFO in is: line synchronizing signal is effective H=1, and field sync signal is effective V=1, and field signal is a strange F=1.
Execution in step four, to depositing the n width of cloth CIF format-pattern The data interleave address rale store write among the FIFO in SDRAM, carry out image mosaic and handle;
Satisfying line synchronizing signal at the same time is that blanking H=0, field sync signal are that effective V=1, field signal are a strange F=1 and write under the situation of effective four conditions of FIFO; Clock with 90M writes SDRAM with n width of cloth CIF format-pattern data; Write data and carry out according to the interleave address rule, as shown in Figure 8.
With the page or leaf is that unit stores, storage four width of cloth images in every page, the write sequence of four width of cloth images in every page be upper left, upper right a, left side down, the bottom right,
In the present embodiment, the PAL format-pattern is the 12/4=3 page or leaf altogether, and is as shown in Figure 7.Secondary number of CIF format-pattern and the corresponding image angle of every width of cloth CIF format-pattern that every width of cloth PAL format-pattern comprises have been provided among Fig. 7.IMAQ terminal 1 begins scan edge to the right by Far Left, and the corresponding image of 30 degree this moment appears at the 1st width of cloth at first, is 30 degree when 25 spend in angle; Image finally rests on 25 degree, then in the position display and the real-time update of first width of cloth; Image is presented at the 2nd width of cloth; Angular range be 25 degree to 20 degree, rest on 20 degree at last, and the like can obtain the angle that follow-up picture stops.If the IMAQ terminal from-30 the degree begin scanning, this moment image appear at the 12nd width of cloth at first, angular range for-30 spend-25 the degree, final picture rest on-25 the degree, follow-up can and the like.Whole splicing and principle are as shown in Figure 3.
Execution in step five reads the view data that is stored among the SDRAM, and demonstrates spliced image.
Through image mosaic, can show the image in 4 field ranges in IMAQ terminal at a PAL format-pattern, can significantly enlarge field range through increasing number of pages.Compare original method, the IMAQ terminal of use and monitor number reduce number_picture-1, promptly only use an IMAQ terminal and surveillance equipment.All targets in the big field range can be observed continuously through image mosaic, target can better be kept watch on or catch.Significantly reduce the number of IMAQ terminal and graphic display terminal, increased the stability and the reliability of system, also reduced the consumption of electric energy accordingly, had the function of energy-conserving and environment-protective.

Claims (8)

1. the image mosaic formation method under the wide surround of a comparison field is characterized in that, this method may further comprise the steps:
Step 1, according to the range of observation at IMAQ terminal, the n width of cloth PAL format-pattern of object is gathered at the IMAQ terminal, the sampled images data rate is 13.5M;
Step 2, the PAL format-pattern that step 1 is collected convert the CIF format-pattern to, obtain n width of cloth CIF format-pattern;
Step 3, said n width of cloth CIF format-pattern data are deposited in write FIFO,
Step 4, to depositing the n width of cloth CIF format-pattern The data interleave address rale store write among the FIFO in SDRAM, carry out image mosaic and handle; To depositing the process of n width of cloth CIF format-pattern The data interleave address rale store in SDRAM of writing among the FIFO in be:
Satisfying line synchronizing signal at the same time is that blanking H=0, field sync signal are that effective V=1, field signal are a strange F=1 and write under the situation of effective four conditions of FIFO; Clock with 90M writes SDRAM with n width of cloth CIF format-pattern data; Write data and carry out according to the interleave address rule, said interleave address rule is:
With the page or leaf is that unit stores, storage four width of cloth images in every page, the write sequence of four width of cloth images in every page be upper left, upper right a, left side down, the bottom right,
The address that the image of top-left position writes SDRAM is:
0 1 . . . . . . 360 - 1 720 721 . . . . . . 720 + ( 360 - 1 ) . . . . . . 2 m × 360 2 m × 360 + 1 . . . . . . 2 m × 360 + ( 360 - 1 ) . . . . . . 2 × 287 × 360 2 × 287 × 360 + 1 . . . . . . 2 × 287 × 360 + ( 360 - 1 ) = 20699 ;
The address that the image of upper-right position writes SDRAM is:
360 361 . . . . . . 720 - 1 1080 1081 . . . . . . 1080 + ( 720 - 1 ) . . . . . . ( 2 m + 1 ) × 360 ( 2 m + 1 ) × 360 + 1 . . . . . . ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . ( 2 × 287 + 1 ) × 360 2 × 287 × 360 + 1 . . . . . . ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 207359 ;
The address that the image of left side upper/lower positions writes SDRAM is:
720 × 288 720 × 288 + 1 . . . . . . 720 × 288 + ( 360 - 1 ) 720 × 288 + 720 720 × 288 + 721 . . . . . . 720 × 288 + 720 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 m × 360 720 × 288 + 2 m × 360 + 1 . . . . . . 720 × 288 + 2 m × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 720 × 288 + 2 × 287 × 360 + 1 . . . . . . 720 × 288 + 2 × 287 × 360 + ( 360 - 1 ) = 414359 ;
The address that the bottom right images of positions writes SDRAM is:
720 × 288 + 360 720 × 288 + 360 + 1 . . . . . . 720 × 288 + 360 + ( 360 - 1 ) 720 × 288 + 1080 720 × 288 + 1081 . . . . . . 720 × 288 + 1080 + ( 360 - 1 ) . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 . . . . . . 720 × 288 + ( 2 m + 1 ) × 360 + ( 360 - 1 ) . . . . . . 720 × 288 + 2 × 287 × 360 . . . . . . 720 × 288 + ( 2 × 287 + 1 ) × 360 + ( 360 - 1 ) = 414719 ;
Carrying out image mosaic is treated to: the image stored that interweaves amounts to
Figure FDA00001664117500024
page or leaf, the image of page or leaf connects together successively and splices processing with
Figure FDA00001664117500025
;
Step 5, read the view data that is stored among the SDRAM, and demonstrate spliced image.
2. the image mosaic formation method under the wide surround of a comparison field according to claim 1 is characterized in that, n width of cloth PAL format-pattern obtains by following formula in the step 1:
Figure FDA00001664117500031
In the formula, all_angle is the observation field range of object;
Signal_angle is the range of observation at IMAQ terminal;
The resolution of every width of cloth PAL format-pattern is 720 * 576.
3. the image mosaic formation method under the wide surround of a comparison field according to claim 1 is characterized in that, the process that the PAL format-pattern that step 1 is collected in the step 2 converts the CIF format-pattern to is:
In line synchronizing signal is effective H=1 and field sync signal when being effective V=1, through the mode of owing to sample the PAL format-pattern that step 1 collects is sampled, and the sampled images data rate is 6.75M, and the resolution of image becomes 360 * 576; Simultaneously, give up the even field picture data of said PAL format-pattern, convert the CIF format-pattern to, the resolution of said CIF format-pattern is 360 * 288.
4. the image mosaic formation method under the wide surround of a comparison field according to claim 1 is characterized in that, deposits the condition of writing FIFO in the step 3 in to be: line synchronizing signal is effective H=1, and field sync signal is effective V=1, and field signal is a strange F=1.
5. the image mosaic formation method under the wide surround of a comparison field according to claim 1; It is characterized in that; Reading the condition that is stored in the view data among the SDRAM in the step 5 is: line synchronizing signal is blanking H=0, and field sync signal is effective V=1, and field signal is a strange F=1;
Reads image data is positive sequence or backward, positive sequence for read successively the 1st page to
Figure FDA00001664117500032
page or leaf; Backward for read
Figure FDA00001664117500033
successively the page or leaf to 1 page;
The speed of reads image data is 90M.
6. realize the device of the image mosaic formation method under the described wide surround of a comparison field of claim 1; It is characterized in that; It comprises IMAQ terminal (1), image D/A modular converter (2), image compression module (3), wireless transmitting system (4), image decompressor module (5), image mosaic module (6), image display (7), operational order transmission system (8) and controls module (9)
Control module (9) output acquisition signal and give operational order transmission system (8); Operational order transmission system (8) output acquisition instructions is given IMAQ terminal (1); Image D/A modular converter (2) is exported to the PAL format-pattern that collects in IMAQ terminal (1); Image D/A modular converter (2) becomes digital signal to export to image compression module (3) analog signal conversion of input; Image after image compression module (3) will be compressed is exported to image decompressor module (5) through wireless transmitting system (4); Image after image decompressor module (5) will decompress is exported to image mosaic module (6), and image mosaic module (6) is carried out image mosaic down in the stitching image order control that controls module (9) output, and image mosaic module (6) will splice good image and exported to image display (7) demonstration and export.
7. the image mosaic imaging device under the wide surround of a comparison field according to claim 6; It is characterized in that; Image mosaic module (6) comprises image C IF format converting module (6-1), writes FIFO (6-2), SDRAM (6-3), read FIFO (6-4), four picture processing modules (6-5) and image A/D modular converter (6-6)
Image C IF format converting module (6-1) converts the PAL format-pattern that receives into the CIF format-pattern; CIF format-pattern after image C IF format converting module (6-1) will be changed deposits in writes FIFO (6-2); When write FIFO (6-2) write full after with data output and interweave at a high speed and be stored among the SDRAM (6-3); Read FIFO (6-4) from SDRAM (6-3) sense data; And through the splicing of finishing dealing with of four picture processing modules (6-5), image handles for image A/D modular converter (6-6) after the splicing of four picture processing modules (6-5) output numeral, image after the splicing of the simulation after image A/D modular converter (6-6) output is handled.
8. the image mosaic imaging device under the wide surround of a comparison field according to claim 7 is characterized in that, the capacity of writing FIFO (6-2) is 512 bytes, and the capacity of reading FIFO (6-4) is 720 * 576 bytes.
CN201110052397A 2011-03-04 2011-03-04 Method and device of image mosaic imaging in background of wide field of view Expired - Fee Related CN102170550B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110052397A CN102170550B (en) 2011-03-04 2011-03-04 Method and device of image mosaic imaging in background of wide field of view

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110052397A CN102170550B (en) 2011-03-04 2011-03-04 Method and device of image mosaic imaging in background of wide field of view

Publications (2)

Publication Number Publication Date
CN102170550A CN102170550A (en) 2011-08-31
CN102170550B true CN102170550B (en) 2012-10-17

Family

ID=44491506

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110052397A Expired - Fee Related CN102170550B (en) 2011-03-04 2011-03-04 Method and device of image mosaic imaging in background of wide field of view

Country Status (1)

Country Link
CN (1) CN102170550B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106506987A (en) * 2016-11-17 2017-03-15 西安诺瓦电子科技有限公司 LED display control methods, image mosaic Method of Edge Optimizing and processing meanss

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102917199A (en) * 2012-11-08 2013-02-06 重庆信科设计有限公司 Resolution conversion method for universal video surveillance image
CN103093485B (en) * 2013-01-28 2015-09-02 广东威创视讯科技股份有限公司 Full view video cylindrical surface image storage method and system
CN103179401A (en) * 2013-03-19 2013-06-26 燕山大学 Processing method and device for multi-agent cooperative video capturing and image stitching
CN103475819B (en) * 2013-09-04 2017-01-18 青岛海信网络科技股份有限公司 Ultra-high definition intelligent video camera and image data splicing method thereof
KR20190088532A (en) * 2016-12-01 2019-07-26 엘지전자 주식회사 IMAGE DISPLAY DEVICE AND IMAGE DISPLAY SYSTEM WITH THE SAME
CN107172368A (en) * 2017-04-21 2017-09-15 西安诺瓦电子科技有限公司 Many video source splicing display methods and processing unit and application, PLD

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1589050A (en) * 2004-09-23 2005-03-02 美博通信设备(北京)有限公司 Method for shooting and browsing panoramic film using mobile terminal
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN201523431U (en) * 2009-09-03 2010-07-07 中国电子科技集团公司第四十一研究所 Video montaging device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7006709B2 (en) * 2002-06-15 2006-02-28 Microsoft Corporation System and method deghosting mosaics using multiperspective plane sweep

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1589050A (en) * 2004-09-23 2005-03-02 美博通信设备(北京)有限公司 Method for shooting and browsing panoramic film using mobile terminal
CN101345843A (en) * 2008-08-28 2009-01-14 中兴通讯股份有限公司 Method and system for implementing full view video of visible mobile terminal
CN201523431U (en) * 2009-09-03 2010-07-07 中国电子科技集团公司第四十一研究所 Video montaging device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106506987A (en) * 2016-11-17 2017-03-15 西安诺瓦电子科技有限公司 LED display control methods, image mosaic Method of Edge Optimizing and processing meanss
CN106506987B (en) * 2016-11-17 2019-12-24 西安诺瓦星云科技股份有限公司 LED display control method, image splicing edge optimization method and processing device

Also Published As

Publication number Publication date
CN102170550A (en) 2011-08-31

Similar Documents

Publication Publication Date Title
CN102170550B (en) Method and device of image mosaic imaging in background of wide field of view
JP3695119B2 (en) Image synthesizing apparatus and recording medium storing program for realizing image synthesizing method
JP4327246B2 (en) Multicolor image processing apparatus and signal processing apparatus
WO2008032590A1 (en) Image distribution system, server, and client terminal
US8004542B2 (en) Video composition apparatus, video composition method and video composition program
JP2002055672A (en) Real-size display system
CN109714524B (en) Image pickup apparatus, system, control method of image pickup apparatus, and storage medium
WO2003067517B1 (en) Apparatus and method for providing electronic image manipulation in video conferencing applications
CN104270578A (en) Method and system for processing multi-channel video images based on network transmitting
CN104394316A (en) Camera cloud deck posture testing system
CN1202660C (en) Over range image display device and method of monitor
US11570384B2 (en) Image sensor employing varied intra-frame analog binning
JP2013142636A (en) Infrared target detector
CN113066011B (en) Image processing method, device, system, medium and electronic equipment
CN101640773B (en) Method and device for amplifying and compressing sub-picture video signals, and television with same
US20050174444A1 (en) Electronic camera apparatus and image processing method thereof
WO2012060271A1 (en) Image processing method, image processing device, and imaging device
CN111050066A (en) Zooming method and device, aircraft, flight system and storage medium
CN107147624B (en) Panoramic picture processing method, display device and playback equipment
JP4984630B2 (en) Video signal converter
WO2020162293A1 (en) Image processing device, image processing method, and image processing system
KR101268391B1 (en) Image processing apparatus and method thereof
CN210274277U (en) LED display video processor with pre-splicing function
JP3096756B2 (en) Image conversion device
CN117440250A (en) Photoelectric peri-scanning video real-time dynamic splicing method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20121017

Termination date: 20150304

EXPY Termination of patent right or utility model