CN104125410A - Panoramic video multi-lens exposure compensation method and device thereof - Google Patents

Panoramic video multi-lens exposure compensation method and device thereof Download PDF

Info

Publication number
CN104125410A
CN104125410A CN 201410314390 CN201410314390A CN104125410A CN 104125410 A CN104125410 A CN 104125410A CN 201410314390 CN201410314390 CN 201410314390 CN 201410314390 A CN201410314390 A CN 201410314390A CN 104125410 A CN104125410 A CN 104125410A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
exposure compensation
exposure
panorama
partition
panoramic
Prior art date
Application number
CN 201410314390
Other languages
Chinese (zh)
Other versions
CN104125410B (en )
Inventor
吴雪梅
Original Assignee
深圳英飞拓科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The invention provides a panoramic video multi-lens exposure compensation method and a device thereof. The method comprises the following steps: acquiring the overlapping region of a panoramic partition map, and performing brightness counting on the overlapping region while writing into a memory to obtain the average brightness value of the overlapping region; selecting the exposure compensation coefficient of one panoramic partition map as a reference value, and acquiring a first exposure compensation coefficient corresponding to each panoramic partition map according to the relation between the average brightness value of the overlapping region and the exposure compensation coefficient; acquiring an average exposure compensation coefficient according to the first exposure compensation coefficients of all panoramic partition maps; acquiring a second exposure compensation coefficient corresponding to each panoramic partition map by taking the average exposure compensation coefficient as a reference value according to the relation between the average brightness value and the average exposure compensation coefficient; performing exposure compensation on respective corresponding panoramic partition map according to the second exposure compensation coefficient while reading video data. A method for performing appropriate phase balance exposure compensation on the overlapping area and a device thereof are provided.

Description

一种全景视频多镜头曝光补偿方法及其装置 One kind of panoramic video multi-lens exposure compensation method and device

技术领域 FIELD

[0001] 本发明涉及视频摄像领域,具体说的是一种全景视频多镜头曝光补偿方法及其装置。 [0001] The present invention relates to the field of video cameras, particularly to a multi-panoramic video camera exposure compensation method and apparatus.

背景技术 Background technique

[0002] 在高清视频摄像过程中经常需要考虑曝光控制问题,曝光补偿是一种曝光控制方式,为了得到正确的曝光,不仅需要考虑曝光时间,还需要考虑曝光参数,如果场景光源偏暗,则需增加曝光值;若场景过亮,则需要减小曝光值。 [0002] In the high-definition video imaging process often need to consider the problem of exposure control, the exposure is an exposure compensation control, in order to obtain proper exposure, the exposure time is not only the need to consider further exposure parameter to be considered, if the scene illuminant dim, then need to increase the exposure value; if the scene is too bright, it is necessary to decrease the exposure value. 景物亮度对比越小,曝光越准确,反之则偏差加大,在全景摄像机摄像中,由于各个前端镜头所拍摄的场景不一样,在输出全景图时,经常会出现相邻镜头输出的全景分区图亮度会有明显差异,影响全景图整体的视觉效果,因此有必要对全景视频不同区域进行差异化曝光补偿,减小各全景分区图之间亮度的差异,使输出的全景图看起来更加的清晰,曝光更加的正确。 Scene brightness contrast smaller, more accurate exposure, and vice versa to increase the deviation, in the panoramic imaging camera, the scene captured by the lens since each distal end is not the same, when the output of the panorama, the panorama of the output partition map adjacent lenses often occur brightness will appear more clearly obvious differences affect the overall visual effect panoramic view it is necessary to differentiate the different regions panoramic video of exposure compensation, to reduce the difference in brightness between the partitions FIG panorama, the panorama of the output exposure more correct.

发明内容 SUMMARY

[0003] 本发明所要解决的技术问题是:提供一种将全景视频提取为具有重叠部分的全景分区图后对重叠区域进行合适、相平衡的曝光补偿的方法及其装置。 [0003] The present invention solves the technical problem are: to provide a video extractor is a panoramic view of a panorama partition after overlapping portion suitable to overlap region, exposure compensation method and apparatus is balanced.

[0004] 为了解决上述技术问题,本发明采用的技术方案为: [0004] In order to solve the above problems, the present invention adopts the technical solution as follows:

[0005] -种全景视频多镜头曝光补偿方法,包括: [0005] - Multi-Species panoramic video camera exposure compensation method, comprising:

[0006] S101 :采集视频数据,将视频数据进行ISP图像信号处理; [0006] S101: capturing video data, the video data image signal processing ISP;

[0007] S102 :根据拼接参数提取变换得到两幅以上的全景分区图,获得重叠区域; [0007] S102: extracting transform two or more partitions panoramic view of splicing parameters to obtain overlapping region;

[0008] S103 :所述两幅以上的全景分区图写入内存,同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; [0008] S103: The above two panorama FIG write memory partition, while the respective web panorama FIG overlapping region partition luminance statistics, an average luminance value of the overlap region;

[0009] S104:选择其中一幅全景分区图的曝光补偿系数作为参考值,根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; [0009] S104: Select a partition map panoramic exposure compensation coefficient as a reference value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficient, a first exposure to obtain compensation coefficients of each partition panorama view corresponding web;

[0010] S105 :由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; [0010] S105: The average exposure compensation coefficient obtained by the first compensation coefficients of all the panoramic exposure zone map;

[0011] S106:以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; [0011] S106: the second exposure compensation coefficients to the average exposure compensation coefficient as a reference value, and the relationship between the average amplitude of each exposure compensation coefficient obtained panoramic view corresponding partition of the average luminance value;

[0012] S107:读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图进行曝光补偿; [0012] S107: while reading out the video data of each corresponding partition map panoramic exposure compensation is performed in accordance with a second exposure compensation coefficient;

[0013] S108 :对视频数据进行压缩编码处理; [0013] S108: the video data compression-encoding process;

[0014] S109 :得到视频流后解码显不。 [0014] S109: After the obtained video stream decoding is not significant.

[0015] 本发明提供的另一个技术方案为: [0015] Another aspect of the present invention provides for:

[0016] 一种全景视频多镜头曝光补偿装置,包括依次连接的视频数据采集模块、图像处理模块、FPGA处理模块、压缩编码模块和解码显示模块; [0016] A multi-panoramic video camera exposure compensation apparatus includes a video data acquisition module which are sequentially connected, the image processing module, FPGA module processing, compression coding and decoding module display module;

[0017] 所述FPGA处理模块包括提取变换单元、亮度统计单元、存储单元、运算单元和曝光补偿单元;所述提取变换单元、亮度统计单元、运算单元和曝光补偿单元分别与所述存储单元连接; [0017] The extraction module comprises converting FPGA processing unit, the luminance statistics unit, a storage unit, an arithmetic unit, and exposure compensation unit; extracting the transform unit, the luminance statistics unit, an arithmetic unit, and exposure compensation unit is connected to the storage unit ;

[0018] 所述运算单元包括依次连接的第一运算单元、第二运算单元和第三运算单元; [0018] The operation unit comprises a first arithmetic unit connected in turn, the second operation unit and third operation unit;

[0019] 所述视频数据采集模块,用于采集视频数据后发送至所述图像处理模块; [0019] The video data acquisition module, configured to send to the image processing module after capturing video data;

[0020] 所述图像处理模块,用于将视频数据进行ISP图像信号处理后发送至FPGA处理模块; [0020] The image processing module, video data for the ISP transmits to the image signal processing FPGA processing module;

[0021] 所述提取变换单元,用于根据拼接参数提取变换得到两幅以上的全景分区图,获得重叠区域; [0021] The extracting and converting means, for extracting the parameters according transform splicing two or more partitions panoramic view is obtained overlapping area;

[0022] 所述存储单元,用于缓存所述两幅以上的全景分区图; [0022] The storage unit, used for more than two partitions FIG buffering the panorama;

[0023] 所述亮度统计单元,用于两幅以上的全景分区图写入内存的同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; FIG panorama partition while [0023] the luminance statistics unit for two or more memory writes the luminance statistics for each partition web panorama FIG overlapping area, an average luminance value of the overlap region;

[0024] 所述第一运算单元,用于选择其中一幅全景分区图的曝光补偿系数作为参考值, 根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; [0024] The first operation unit, wherein the exposure compensation coefficient for selecting a panoramic zone map as a reference value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficients obtained for each partition map corresponding to the web panorama first exposure compensation coefficient;

[0025] 所述第二运算单元,用于由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; [0025] The second operation unit for obtaining an average exposure compensation coefficients from the first compensation coefficients of all the panoramic exposure zone map;

[0026] 所述第三运算单元,用于以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; [0026] The third operation unit, for an average exposure compensation coefficient as a reference value, a second exposure to obtain compensation coefficients of each partition panorama view corresponding web according to the relationship between the average luminance value and the average exposure compensation coefficient;

[0027] 所述曝光补偿单元,用于读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图进行曝光补偿; [0027] The exposure compensation means for simultaneously reading out the video data of each corresponding partition map panoramic exposure compensation is performed in accordance with a second exposure compensation coefficient;

[0028] 所述压缩编码模块,用于对视频数据进行压缩编码处理后发送至所述解码显示模块; [0028] The compression encoding means for compressing the video data after the encoding processing is transmitted to the decoding display module;

[0029] 所述解码显示模块,用于得到视频流后解码显示。 The [0029] decode the display module configured to display the obtained video stream decoding.

[0030] 本发明的有益效果在于:区别于现有技术的全景图输出过程中存在各场景曝光不一致而导致输出的全景图具有亮度差异,不清晰等问题。 [0030] Advantageous effects of the present invention is that: each scene exposure caused by incorrect panorama output brightness difference, other problems not clear panorama output process is different from the prior art. 本发明提供一种全景视频多镜头曝光补偿方法和装置,通过将采集的视频数据提取变换得到具有重叠区域的多幅全景分区图,进行重叠区域的平均亮度统计,得到各幅全景分区图的第一曝光补偿系数及其平均曝光补偿系数,再以平均曝光补偿系数为参考值得到第二曝光补偿系数并进行曝光补偿,上述过程得到的用于最终曝光补偿的第二曝光补偿系数能很好的平衡各幅全景分区图之间的亮度差异,使输出的全景图更加清晰,曝光更加正确。 The present invention provides a first plurality panoramic video camera exposure compensation apparatus and method, to obtain pieces having a partition map panorama overlapping area extracting video data converted by the collected statistics for the average brightness of the overlapping area, to give each of the web of FIG partition panorama exposure compensation coefficient and a compensation coefficient average exposure, then the average worth exposure compensation factor to the second reference coefficient, and the exposure compensation exposure compensation, the second compensation coefficients exposure compensation for the final exposure process can be well obtained brightness difference between the equilibrium partitioning each web panorama view panorama output enable clearer, more accurate exposure.

附图说明 BRIEF DESCRIPTION

[0031] 图1为本发明一实施例的一种全景视频多镜头曝光补偿方法流程图; [0031] FIG 1 a panoramic video implement a multi-lens exposure compensation flowchart of a method embodiment of the present invention;

[0032] 图2为本发明一实施例的一种全景视频多镜头曝光补偿装置的结构图; [0032] FIG. 2 configuration diagram of a panoramic video camera embodiment of the multi-exposure compensation apparatus according to an embodiment of the present invention;

[0033] 图3为本发明一实施例一实现示例的全景分区图。 [0033] FIG. 3 panorama view of a partition of an implementation example of embodiment of the present invention.

[0034] 标号说明: [0034] Description of Reference Numerals:

[0035] 10-视频数据采集模块; 20-图像处理模块; 30-FPGA处理模块; [0035] 10- video data acquisition module; image processing module 20; 30-FPGA processing module;

[0036] 40-压缩编码模块; 50-解码显示模块; 31-提取变换单元; [0036] The compression encoding module 40; 50 decoding the display module; 31- extracting and converting means;

[0037] 32-亮度统计单元; 33-存储单元; 34_运算单元; [0037] 32- brightness statistic unit; 33 a storage unit; 34_ arithmetic unit;

[0038] 35-曝光补偿单元。 [0038] 35 exposure compensation unit.

具体实施方式 detailed description

[0039] 为详细说明本发明的技术内容、构造特征、所实现目的及效果,以下结合实施方式并配合附图详予说明。 [0039] The teachings of the present invention in detail, structural features, objects and effects of the implementation, the following embodiments in conjunction with the accompanying drawings and to be described in detail.

[0040] 本发明最关键的构思在于:区别现有技术全景图仅经过简单图像处理后便直接输出的处理方式,本发明将视频数据提取变换获得具有重叠区域的全景分区图,再根据亮度值与曝光补偿系数之间的关系二次计算得到最佳的曝光补偿系数后进行曝光补偿,输出曝光正确,各镜头分区图无明显亮度差异的全景图。 [0040] The key concept of the present invention, wherein: the difference between the prior art panoramic image after only simple processing mode after the image processing of the direct output, the present invention is to create a panoramic video data extracting and converting FIG partition having an overlap region, and then the luminance value panorama after the relationship between the exposure and the second compensation coefficients calculated optimum exposure compensation coefficient exposure compensation, correct exposure output, each shot partitions FIG no luminance difference.

[0041] 请参阅图1,为本发明一实施例的一种全景视频多镜头曝光补偿方法流程图。 [0041] Referring to FIG. 1, a panoramic video implement a multi-lens exposure compensation flowchart of a method embodiment of the present invention.

[0042] 本发明提供一种全景视频多镜头曝光补偿方法,包括: [0042] The present invention provides a multi-panoramic video camera exposure compensation method, comprising:

[0043] S101 :采集视频数据,将视频数据进行ISP图像信号处理; [0043] S101: capturing video data, the video data image signal processing ISP;

[0044] S102 :根据拼接参数提取变换得到两幅以上的全景分区图,获得重叠区域; [0044] S102: extracting transform two or more partitions panoramic view of splicing parameters to obtain overlapping region;

[0045] S103 :所述两幅以上的全景分区图写入内存,同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; [0045] S103: The above two panorama FIG write memory partition, while the respective web panorama FIG overlapping region partition luminance statistics, an average luminance value of the overlap region;

[0046] S104:选择其中一幅全景分区图的曝光补偿系数作为参考值,根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; [0046] S104: Select a partition map panoramic exposure compensation coefficient as a reference value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficient, a first exposure to obtain compensation coefficients of each partition panorama view corresponding web;

[0047] S105 :由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; [0047] S105: The average exposure compensation coefficient obtained by the first compensation coefficients of all the panoramic exposure zone map;

[0048] S106 :以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; [0048] S106: the second exposure compensation coefficients to the average exposure compensation coefficient as a reference value, and the relationship between the average amplitude of each exposure compensation coefficient obtained panoramic view corresponding partition of the average luminance value;

[0049] S107:读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图进行曝光补偿 [0049] S107: while reading out the video data of each corresponding partition map panoramic exposure compensation is performed in accordance with a second exposure compensation coefficient

[0050] S108 :对视频数据进行压缩编码处理; [0050] S108: the video data compression-encoding process;

[0051] S109 :得到视频流后解码显不。 [0051] S109: After the obtained video stream decoding is not significant.

[0052] 从上述描述可知,本发明的有益效果在于:本发明提供的一种全景视频多镜头曝光补偿方法,通过将采集的视频数据提取变换得到具有重叠区域的多幅全景分区图,对重叠区域进行亮度统计,通过亮度值与曝光补偿系数之间的关系便能得到各幅全景分区图的第一曝光补偿系数及其平均曝光补偿系数,再以平均曝光补偿系数为参考值得到第二曝光补偿系数并进行曝光补偿,上述过程得到的用于最终曝光补偿的第二曝光补偿系数能很好的平衡各幅全景分区图之间的亮度差异,使输出的全景图更加清晰,曝光更加正确。 [0052] From the above description, the advantageous effects of the present invention: one kind of a panoramic video camera according to the present invention provides a multi-exposure compensation methods, data collected by the video transform plurality extracted with FIG panorama partition overlap region of overlapping region luminance statistics, be able to get a first correction coefficient and the average exposure exposure compensation coefficients panorama web by partitions FIG relationship between the luminance value of the exposure compensation coefficient, and then an average coefficient of the reference exposure compensation is worth a second exposure to the compensation coefficient and exposure compensation, the second compensation coefficients exposure compensation for the final exposure process can be obtained a good balance between the difference in brightness of each web panorama partition map, so that the output of the panorama clearer, more accurate exposure. 克服现有技术的全景图输出过程中由于各场景曝光不一致而导致输出的全景图具有明显的亮度差异,全景图不清晰等问题。 Since each scene exposure caused by incorrect output panorama obvious difference in brightness, and so on is not clear panorama panorama output process overcomes the prior art.

[0053] 进一步的,所述步骤S103中的"对各幅全景分区图中的重叠区域进行亮度统计, 得到重叠区域的平均亮度值"包括: [0053] Further, the step S103 'luminance statistics for each partition web panorama FIG overlapping area, an average luminance value of the overlap region "comprises:

[0054] 将全景分区图中重叠区域的像素亮度值相加后除以所述重叠区域的像素总个数得到各幅全景分区图中每个重叠区域的平均亮度值。 [0054] The pixel luminance values ​​of the overlap region in FIG panorama partition dividing the overlapping area of ​​the total number of pixels obtained by adding the average luminance value for each region of each web overlapped partition panorama FIG.

[0055] 通过上述方案便能得到各幅全景分区图中每一个重叠区域的平均亮度值,具体的,如第一幅全景分区图的重叠区域设为A3,则重叠区域A3的平均亮度值便为A3中所有的像素亮度值相加后除以A3区域的总像素个数。 [0055] will be able to obtain an average luminance value for each region of each web overlapped panorama through said partition FIG embodiment, particularly, as an overlapping area of ​​FIG panorama partition A3 is set, the average luminance value of the overlap region A3 will for all pixel luminance values ​​A3, A3 region divided by the total number of pixels after the addition. 设第二幅全景分区图与第一幅全景分区图的重叠区域为B1,则重叠区域B1的平均亮度值为B1中所有的像素亮度值相加后除以B1 区域中的总像素个数,以此类推得到各幅全景分区图的重叠区域对应的平均亮度值。 A second partition disposed FIG panorama web overlaps the first region is a panorama partition FIG B1, the luminance values ​​of all the pixels overlap the average luminance value of the area B1 B1 divided by the sum of the total number of pixels in the B1 region, each web so obtained overlapping area panorama partition map corresponding to the average luminance value.

[0056] 进一步的,步骤S107包括:将所有全景分区图的视频数据乘以各自对应的第二曝光补偿系数。 [0056] Further, the step S107 comprises: a partition map all panoramic video data by a second compensation coefficient corresponding to each exposure.

[0057] 上述方案中,在得到各幅全景分区图对应的最适合的第二曝光补偿系数后便进行曝光补偿处理,曝光补偿处理是实时逐像素进行的,对从内存中读取的第一幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,第二幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,以此类推即完成曝光补偿运算。 [0057] In the above embodiment, exposure compensation process in the most suitable exposure compensation coefficient of each second partition panorama view corresponding web after exposure compensation process is performed in real time pixel by pixel, to read from the first memory web panorama partition map video data directly to the Y component by a second exposure compensation coefficients corresponding thereto, the Y component of the second web of FIG partition panorama video data directly by a second exposure compensation coefficients corresponding thereto, i.e., so the exposure is completed compensation operations.

[0058] 进一步的,步骤S104至步骤S106中所述第二曝光补偿系数的运算每500帧进行一次。 [0058] Further, the second exposure operation steps S104 to S106 of the compensation coefficient step is performed every 500 frames. 由于曝光补偿系数调整每500帧才进行一次,故亮度平均值和曝光补偿系数的运算, 实时性要求不高,每500帧更新一个值亦可接受,这样处理后输出的全景图不仅保证了正确的曝光,还能节省资源的使用。 Since the exposure compensation coefficient adjusting only once every 500, so the exposure compensation and the average luminance calculation coefficient, less demanding real-time, updated every 500 also acceptable value, thus treated panoramic view of not only guarantees correct output exposure, but also save use of resources.

[0059] 进一步的,步骤S103至步骤S106中涉及的运算过程采用复合乘法器资源进行流水式运算。 [0059] Further, the operation process to step S103 to step S106 involved composite multipliers for pipelined operation. 在视频数据处理运算的过程中采用复用乘法器资源来进行流水式运算,这样的处理方式不需要做缓存处理,不仅能节省资源的使用,还能提高处理速度。 In the video data processing operation in the process flow performed by complex multiplier resource calculation formula, it does not require such a caching approach, not only can reduce resource usage, but also improve the processing speed.

[0060] 请参阅图2,本发明还提供另一个技术方案: [0060] Referring to FIG. 2, the present invention provides another technical solution:

[0061] 一种全景视频多镜头曝光补偿装置,包括依次连接的视频数据采集模块10、图像处理模块20、FPGA处理模块30、压缩编码模块40和解码显示模块50 ; [0061] A multi-panoramic video camera exposure compensation apparatus comprising video data capture module 10 are sequentially connected, the image processing module 20, FPGA processing module 30, a compression encoding module 40 and decoding the display module 50;

[0062] 所述FPGA处理模块30包括提取变换单元31、亮度统计单元32、存储单元33、运算单元34和曝光补偿单元35 ;所述提取变换单元31、亮度统计单元32、运算单元34和曝光补偿单元35分别与所述存储单元33连接; [0062] The processing module 30 includes an extraction FPGA conversion unit 31, the luminance statistics unit 32, storage unit 33, operation unit 34 and the exposure compensation unit 35; the extracting and converting means 31, the luminance statistics unit 32, arithmetic unit 34 and the exposure compensation unit 35 are respectively connected to the storage unit 33;

[0063] 所述运算单元34包括依次连接的第一运算单元34、第二运算单元34和第三运算单元34 ; [0063] The operation unit 34 comprises a first arithmetic unit 34 are sequentially connected, a second operation unit 34 and the third calculation means 34;

[0064] 所述视频数据采集模块10,用于采集视频数据后发送至所述图像处理模块20 ; [0064] The video data acquisition module 10, for collecting the video data to the image processing module 20;

[0065] 所述图像处理模块20,用于将视频数据进行ISP图像信号处理后发送至FPGA处理模块30 ; After [0065] The image processing module 20, for the video data transmitted to the ISP signal processing FPGA image processing module 30;

[0066] 所述提取变换单元31,用于根据拼接参数提取变换得到两幅以上的全景分区图, 获得重叠区域; [0066] The extraction conversion unit 31, for extracting the transformation parameters obtained according splicing two or more partitions panoramic view is obtained overlapping area;

[0067] 所述存储单元33,用于缓存所述两幅以上的全景分区图; [0067] The storage unit 33, used for more than two partitions FIG buffering the panorama;

[0068] 所述亮度统计单元32,用于两幅以上的全景分区图写入内存的同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; While [0068] the luminance statistics unit 32, a panorama partition map the two or more memory writes the luminance statistics for each partition web panorama FIG overlapping area, an average luminance value of the overlap region;

[0069] 所述第一运算单元34,用于选择其中一幅全景分区图的曝光补偿系数作为参考值,根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; [0069] The first operation unit 34, to select the exposure compensation coefficients a panorama partition map as the reference value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficients obtained for each partition map web panorama compensation coefficient corresponding to the first exposure;

[0070] 所述第二运算单元34,用于由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; [0070] The second operation unit 34, for an average exposure compensation coefficient obtained by the first compensation coefficients of all the panoramic exposure zone map;

[0071] 所述第三运算单元34,用于以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; [0071] The third arithmetic unit 34, for an average exposure compensation coefficient as a reference value, a second exposure to obtain compensation coefficients of each partition panorama view corresponding web according to the relationship between the average luminance value and the average exposure compensation coefficient;

[0072] 所述曝光补偿单元35,用于读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图进行曝光补偿; [0072] The exposure compensation unit 35, for simultaneously reading out the video data of each corresponding partition map panoramic exposure compensation is performed in accordance with a second exposure compensation coefficient;

[0073] 所述压缩编码模块40,用于对视频数据进行压缩编码处理后发送至所述解码显示模块50 ; [0073] The compression encoding module 40, a video data compression coding process after the decoding is transmitted to the display module 50;

[0074] 所述解码显示模块50,用于得到视频流后解码显示。 The [0074] decode the display module 50, decodes the video stream to obtain the display.

[0075] 从上述描述可知,本发明的有益效果在于:本发明提供的一种全景视频多镜头曝光补偿装置,通过FPGA处理模块30中的提取变换单元31将视频数据进行提取变换得到具有重叠区域的多幅全景分区图;通过运算单元34二次运算得到各幅全景分区图的第二曝光补偿系数,这样得到的曝光补偿系数能使各幅全景分区图之间的亮度差异最小,使输出的全景图更加的清晰,曝光更加的正确,不会存在不同场景的分区图不清晰及曝光不均等问题。 [0075] From the above description, the advantageous effects of the present invention: one kind of a panoramic video camera according to the present invention provides a multi-exposure compensation apparatus, the video data extracted by the conversion FPGA processing module 30 extracts the overlapping region conversion unit 31 having obtained FIG panorama plurality of partition; exposure compensation coefficients obtained for each partition panorama web by the arithmetic unit 34 of FIG secondary compensation coefficient calculating a second exposure, brightness can be obtained so that the difference between the minimum amplitude panorama partition map, so that the output more clear panorama, more exposure is correct, there will be no partition map different scenarios unclear and uneven exposure and other issues.

[0076] 本方案中,全景视频数据的获取是由若干个固定焦距和夹角的前端镜头组成,保证相邻两路视频之间有一定的重叠区域,FPGA处理模块30中的提取变换单元31根据拼接参数将获取的视频数据进行提取变换,获得具有重叠区域的多幅全景分区图,在经过FPGA 处理模块30曝光处理后再根据拼接参数合成一个全景视频输出,得到全景图。 [0076] In the present embodiment, the panoramic video data acquired by a plurality of fixed focal length and the angle of the front lens composition, to ensure a certain degree of overlapping area between adjacent two-way video, extracting and converting means 30 in the processing module FPGA 31 the video data for splicing extracting and converting the obtained parameters, to obtain multiple partitioned panoramic view of a region of overlap in the exposure processing module 30 through the FPGA synthesis process followed by a panoramic video output according splicing parameters resulting panorama.

[0077] 进一步的,所述亮度统计模块还包括将全景分区图中的重叠区域的像素亮度值相加后除以所述重叠区域的像素总个数得到各幅全景分区图中每个重叠区域的平均亮度值。 [0077] Further, the luminance statistics module further includes a luminance value of the pixel of the overlap region in FIG panorama partition divided by the sum of the total number of pixels of each web overlapped area obtained panoramic partitions each overlap region in FIG. average luminance value.

[0078] 通过亮度统计模块的亮度统计便能得到各幅全景分区图中每一个重叠区域的平均亮度值,具体的,如第一幅全景分区图的重叠区域设为A3,则重叠区域A3的平均亮度值便为A3中所有的像素亮度值相加后除以A3区域的总像素个数。 [0078] will be able to obtain an average luminance value for each region of each web overlapped partition panorama FIG statistical luminance brightness statistic module, specifically, such as the overlapping area of ​​a panorama zone map is set to A3, A3 of the overlap region the average luminance value A3 will after all pixel luminance values ​​divided by the sum of the total number of pixels in area A3. 设第二幅全景分区图与第一幅全景分区图的重叠区域为B1,则重叠区域B1的平均亮度值为B1中所有的总像素亮度值相加后除以B1区域中的总像素个数,以此类推得到各幅全景分区图的重叠区域对应的平均亮度值。 A second partition disposed FIG panorama web overlaps the first region is a panorama partition FIG B1, overlapping the pixel luminance values ​​of all the total average luminance value of the area B1 B1 divided by the sum of the total number of pixels in the region B1 average luminance value, to give each of the web so panorama partition map corresponding to the overlapping area.

[0079] 进一步的,所述曝光补偿模块包括将所有全景分区图的视频数据乘以各自对应的第二曝光补偿系数。 [0079] Further, the exposure compensation module includes a partition map all panoramic video data by a second compensation coefficient corresponding to each exposure.

[0080] 上述方案中,在运算单元34得到各幅全景分区图对应的最适合的第二曝光补偿系数后便通过曝光补偿单元35进行曝光补偿处理,曝光补偿单元35的曝光补偿处理是实时逐像素进行的,对从存储单元33中读取的第一幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,第二幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,以此类推即完成曝光补偿运算。 [0080] In the above embodiment, the arithmetic unit 34 to obtain the most suitable exposure compensation coefficients of the second partition web panorama view corresponding compensation process after exposure by the exposure compensation unit 35, an exposure compensation processing unit 35 of the exposure compensation by real-time the pixels, Y component of the panorama of a partition map read from the storage unit 33 directly to the video data by a second exposure compensation coefficients corresponding thereto, Y component of the second web of FIG partition panorama video data directly multiplied corresponding second exposure compensation coefficient, and so the exposure compensation operation is completed.

[0081] 进一步的,所述FPGA处理模块30中的亮度统计单元32和运算单元34每500帧视频数据便重新运算获取所述第二曝光补偿系数的值。 [0081] Further, the luminance of the statistics FPGA processing unit 32 of the module 30 and the arithmetic unit 34 every 500 frames of video data to obtain the value will recalculate the second exposure compensation coefficients.

[0082] 由于FPGA处理模块30中的亮度统计单元32和运算单元34调整每500帧才进行一次,故亮度平均值和曝光补偿系数的运算,实时性要求不高,每500帧更新一个值亦可接受,这样处理后输出的全景图不仅保证了正确的曝光,还能节省内存资源的占用。 [0082] Since the luminance statistics FPGA processing unit 32 of the module 30 and the arithmetic unit 34 adjusts only once every 500, so the exposure compensation and the average luminance calculation coefficient, less demanding real-time, to update a value of each 500 also acceptable, panorama after such treatment not only ensures the output of correct exposure, but also save the memory resources.

[0083] 进一步的,所述FPGA处理模块30还包括复用乘法器单元,所述复用乘法器单元分别与所述亮度统计单元32和运算单元34连接,用于采用复合乘法器资源进行流水式运算。 [0083] Further, the FPGA processing module 30 also comprises a complex multiplier unit, the multiplexed luminance respectively connected to the counting unit 32 and the arithmetic unit 34 with a multiplier unit, a multiplier for composite resources water type operations. 在视频数据处理运算的过程中采用复用乘法器资源来进行流水式运算,这样的处理方式不需要做缓存处理,不仅能节省资源的使用,还能提高处理速度。 In the video data processing operation in the process flow performed by complex multiplier resource calculation formula, it does not require such a caching approach, not only can reduce resource usage, but also improve the processing speed.

[0084] 请参照图3,就上述实施例提供一个示例: [0084] Referring to FIG. 3, an exemplary embodiment of the above:

[0085] 本示例中由具有四个具有固定焦距和夹角的前端镜头拍摄获取视频数据,四个前端镜头相邻的两路视频之间有一定的重叠区域,在视频数据采集模块10采集视频数据后, 发送至图像处理模块20进行ISP图像处理后将视频数据发送至FPGA处理模块30中进行处理。 [0085] In this example acquires the video data having four front lens having a fixed focal length and shooting angle, a certain degree of overlapping area between adjacent front lens four two-way video, the video capture video data acquisition module 10 after the data is transmitted to the image processing module 20 performs image processing after the ISP transmits video data to the FPGA processing module 30 for processing. 通过FPGA处理模块30中的提取变换单元31根据上层PC所传递的拼接参数,将视频数据经过提取和柱面映射变换后得到全景分区图,具体生成的图像请参阅图3。 FPGA processing module 30 by extracting the parameter conversion unit 31 according to the upper splicing passed PC, the video data after the extraction and the cylindrical partition mapping transform panorama FIG specifically generated image See Figure 3.

[0086] 将四幅全景分区图缓存入存储单元33,在写入存储单元33的同时需要对各幅全景分区图的重叠区域进行亮度统计,得到各幅全景分区图中的重叠区域的平均亮度值。 [0086] The panorama four partition map into the cache storage unit 33, the luminance required for the overlapping regions of the web statistical panorama partition map while written in the memory unit 33, an average luminance value of each of the overlapping area of ​​the web of FIG partition panorama . 具体的为:将全景分区图中重叠区域的像素亮度值相加后除以所述重叠区域的像素总个数得到各幅全景分区图中每个重叠区域的平均亮度值。 Specifically as follows: the luminance value of the pixel divided by the overlap area after adding the partition panorama FIG overlap region average total number of pixels for each luminance value of each web panorama partitions overlap region in FIG. 设A3为全景分区图1与全景分区图2的重叠区域的平均亮度值,B1为全景分图区2与全景分区图1的重叠区域的平均亮度值,B3 为全景分区图2与全景分区图3的重叠区域的平均亮度值,C1为全景分区图3与全景分区图2的重叠区域的平均亮度值,C3为全景分区图3与全景分区图4的重叠区域的平均亮度值,D1为全景分区图4与全景分区图3的重叠区域的平均亮度值。 Provided A3 panorama partition FIG average luminance value of the overlap region panorama partition of FIG. 2, B1 panorama partition map region 2 and the average luminance values ​​of the overlap region of the panorama partition of FIG. 1, B3 panorama partition 2 panoramic partition FIG. average luminance value of the overlap region 3, C1 panorama partition 3 average luminance value of the overlap region panorama partition of FIG. 2, C3 average luminance value of the panorama partition 3 and the overlapping area panorama partition of FIG. 4, D1 panorama FIG partition 4 and the average luminance value of the overlap region of the partition of FIG. 3 panorama.

[0087] 在将四幅全景分区图读出存储单元33的同时,需要进行实时曝光补偿运算,具体的曝光补偿运算为: While [0087] In the panorama four partition map storage unit 33 is read out, the need for real-time exposure compensation calculation, calculation of the specific exposure compensation:

[0088] 关于相邻两幅图像的曝光补偿系数与平均亮度值具有以下关系: [0088] Exposure compensation coefficient on the average brightness of the two images adjacent values ​​have the following relationship:

[0089] [0089]

Figure CN104125410AD00091

(1) (1)

[0090] 其中gi,gj为图像i和图像j的曝光补偿系数,R(i,j)为图像i和图像j的重叠区域。 [0090] where gi, gj exposure compensation coefficients images i and j in the image, R (i, j) for the images i and j in the overlap region of the image.

[0091] 要使图像i和图像j的亮度差异最小,则当公式(1)中e = 〇时满足条件,也就是: [0091] For the luminance difference images i and j image is minimized then when the equation (1) satisfies the condition e = square, namely:

[0092] gil^u^-gjlj^Uj) = 0 (2) [0092] gil ^ u ^ -gjlj ^ Uj) = 0 (2)

[0093] 其中,曝光系数gi#0。 [0093] wherein the exposure coefficient gi # 0.

[0094] 根据公式(2)便可计算得到各幅全景分区图的曝光补偿系数,设四幅全景分区图的第一曝光补偿系数为数gl、g2、g3和g4 ; [0094] According to Equation (2) can be calculated by the compensation coefficient of each web panoramic exposure zone map, a partition provided in FIG panorama four first exposure compensation coefficient number gl, g2, g3, and G4;

[0095] 具体的计算过程如下: [0095] The calculation procedure is as follows:

[0096] 当以第一幅全景分区图为参考通道,取其曝光补偿系数gl为一个常数,即假设gl =Μ, Μ为一个常数。 [0096] In the first one when a panoramic picture shows the partition of the reference channel, whichever gl exposure compensation coefficient is a constant which assumes gl = Μ, Μ is a constant. 由公式(2)有: By equation (2):

[0097] g2 = MXA3/B1 ; [0097] g2 = MXA3 / B1;

[0098] g3 = g2XB3/Cl ; [0098] g3 = g2XB3 / Cl;

[0099] g4 = g3XC3/Dl。 [0099] g4 = g3XC3 / Dl.

[0100] 当以第二幅全景分区图的曝光补偿系数为参考通道时,取其曝光补偿系数g2为常数M,根据公式(2)有: [0100] When the exposure compensation partition coefficient of the second web of FIG panorama as a reference channel, whichever is the exposure compensation coefficient g2 is a constant M, according to equation (2):

[0101] gi = MXB1/A3 ; [0101] gi = MXB1 / A3;

[0102] g3 = MXB3/C1 [0102] g3 = MXB3 / C1

[0103] g4 = g3XC3/Dl。 [0103] g4 = g3XC3 / Dl.

[0104] 当以第三幅全景分区图的曝光补偿系数为参考通道时,取其曝光补偿系数g3为常数M,根据公式(2)有: [0104] When the exposure compensation coefficients of the third web panorama partition map as a reference channel, whichever is the exposure compensation coefficient g3 is a constant M, according to equation (2):

[0105] g1 = g2XBl/A3 ; [0105] g1 = g2XBl / A3;

[0106] g2 = MXC1/B3 ; [0106] g2 = MXC1 / B3;

[0107] g4 = MXC3/Dl。 [0107] g4 = MXC3 / Dl.

[0108] 当以第四幅全景分区图的曝光补偿系数为参考通道时,取其曝光补偿系数g4为常数M,根据公式(2)有: [0108] When the exposure compensation coefficient fourth partition FIG panorama web as a reference channel, whichever is the exposure compensation coefficient g4 constant M, according to equation (2):

[0109] gj = g2XBl/A3 ; [0109] gj = g2XBl / A3;

[0110] g2 = gsXCl/B3 ; [0110] g2 = gsXCl / B3;

[0111] g3 = MXDl/C3〇 [0111] g3 = MXDl / C3〇

[0112] 可根据最终调试的曝光效果选出该采用哪一幅图像为参考通道。 [0112] which may be employed to select the reference channel as a final image is a debug exposure.

[0113] 由四幅全景分区图的第一曝光补偿系数gl、g2、g 3和g4得到平均曝光补偿系数K, 具体的为: [0113] by a first panoramic exposure compensation coefficient gl four zone map, g2, g 3, and g4 average exposure compensation coefficient K, specifically as follows:

[0114] s = g1+g2+g3+g4 ; [0114] s = g1 + g2 + g3 + g4;

[0115] k = s/4。 [0115] k = s / 4.

[0116] 将每一幅全景分区图的曝光系数&、&、&和&相加后除以全景分区图的幅数4得到。 [0116] The panorama web divided by the partition coefficients for each picture to be a panoramic exposure zone map &, &, & and 4 & adding obtained.

[0117] 以算术平均曝光补偿系数K为参考通道,根据公式gi = gi*M/k得到所有全景分区图的第二曝光补偿系数gl、g2、g3和g4。 [0117] In the exposure arithmetic average compensation coefficient K as a reference channel, a second exposure to obtain compensation coefficients gl all partitions FIG panorama according to the formula gi = gi * M / k, g2, g3 and g4.

[0118] 最后通过曝光补偿单元35进行曝光补偿运算,将对从存储单元33中读取的第一幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,第二幅全景分区图视频数据的Y分量直接乘以与其对应的第二曝光补偿系数,以此类推即完成曝光补偿运算。 Y component [0118] Finally, the exposure compensation unit 35 perform exposure compensation operation, will read from the storage unit 33 of FIG partition a panorama video data directly by a second exposure compensation coefficients corresponding thereto, the second web FIG panorama partition Y component video data is directly multiplied by the compensation coefficient corresponding to the second exposure, and so the exposure compensation operation is completed.

[0119] 再从存储单元33中按处理器所能接收的视频帧格式读出视频数据送入后端的压缩编码模块40进行压缩编码处理,最后将视频流送到PC或者解码器解码显示。 [0119] can receive is again read from the storage unit 33 by the video processor into the rear end of the frame format of the video data compression encoding module 40 compression coding, the video stream and finally decoded by the decoder to a PC or a display.

[0120] 具体的,曝光补偿系数的运算调整每500帧才进行一次亮度平均值和曝光补偿系数的运算,实时性要求不高,每500帧更新一个值亦可接受,在FPGA处理模块30内部可考虑复用乘法器资源,不需要再做缓存,节省资源的使用。 [0120] Specifically, the exposure adjustment operation only computes compensation coefficients, less demanding real-time and the average luminance of each exposure compensation coefficient 500, updated every 500 also acceptable value, the processing module within the FPGA 30 could be considered multiplexing multipliers, you do not need to cache, saving the use of resources.

[0121] 综上所述,本发明提供的一种全景视频多镜头曝光补偿方法及其装置,通过进行二次参考得到各幅全景分区图对应的第二曝光补偿系数,不仅能很好的平衡各幅全景分区图之间的亮度差异,使输出的全景图更加清晰,曝光更加正确;而且曝光补偿系数的运算为每500帧进行一次,实时性要求不高,能快速的得到需要的曝光补偿系数,完成曝光补偿; 进一步的,曝光补偿系数的运算采用复用乘法器资源,能进行流水式运算而避免资源的占用。 [0121] In summary a panoramic video camera according to the present invention provides a multi-exposure compensation method and apparatus, the second exposure to obtain compensation coefficients of each partition web panorama view corresponding secondary by reference, not only a good balance the difference in brightness between the web panorama partition map, so that the output of the panorama clearer, more accurate exposure; and exposure compensation coefficient calculation once every 500 frames, less demanding real-time, can quickly obtain a desired exposure compensation coefficient, complete exposure compensation; further calculates the exposure compensation coefficients using a complex multiplier resource, a pipelined operation can be performed so that it takes resources. 本发明克服现有技术的全景图输出过程中由于各场景曝光不一致而导致输出的全景图具有明显的亮度差异,全景图不清晰等问题。 Since each scene exposure caused by incorrect output panorama obvious difference in brightness, and so on is not clear panorama panorama output process of the present invention overcomes the prior art.

[0122] 以上所述仅为本发明的实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。 [0122] The foregoing is only embodiments of the present invention, not intended to limit the scope of the present invention, all utilize the present specification and drawings taken equivalent structures or equivalent process, or other direct or indirect application Related technical fields shall fall within the scope of protection of the present invention.

Claims (10)

  1. 1. 一种全景视频多镜头曝光补偿方法,其特征在于,包括: 5101 :采集视频数据,将视频数据进行ISP图像信号处理; 5102 :根据拼接参数提取变换得到两幅以上的全景分区图,获得重叠区域; 5103 :所述两幅以上的全景分区图写入内存,同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; S104:选择其中一幅全景分区图的曝光补偿系数作为参考值,根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; S105 :由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; S106:以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; 5107 :读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图 A multi-panoramic video camera exposure compensation method, characterized by comprising: 5101: capturing video data, the video data image signal processing ISP; 5102: extracting transform two or more partitions panoramic view of splicing parameters to obtain overlap region; 5103: two or more of the panorama FIG write memory partition, while the respective web panorama FIG overlapping region partition luminance statistics, an average luminance value of the overlap region; S104: select a partition map panorama exposure compensation coefficient as a reference value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficient, a first exposure to obtain compensation coefficients of each partition panorama view corresponding web; S105: all compensated by the first exposure zone map panorama exposure compensation coefficient average coefficient; S106: the average exposure compensation coefficient as a reference value, a second exposure to obtain compensation coefficients of each partition panorama view corresponding web according to the relationship between the average luminance value and the average exposure compensation coefficient; 5107: read out while the video data according to a second exposure compensation coefficients corresponding to the respective partitions FIG panorama 行曝光补偿; 5108 :对视频数据进行压缩编码处理; 5109 :得到视频流后解码显示。 Exposure compensation line; 5108: video data compression-encoding process; 5109: decoding the video stream to obtain a display.
  2. 2. 根据权利要求1所述的一种全景视频多镜头曝光补偿方法,其特征在于,所述步骤S103中的"对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值"包括: 将全景分区图中重叠区域的像素亮度值相加后除以所述重叠区域的像素总个数得到各幅全景分区图中每个重叠区域的平均亮度值。 2. According to a panoramic video camera of the multi-exposure compensation to claim 1, characterized in that the "luminance statistics for each partition web panorama FIG overlapping area of ​​the step S103, the average luminance in the overlap region value "comprising: a luminance value of a pixel of the overlap region in the panoramic FIG partition divided by the sum of the total number of pixels in the overlapping area obtained average luminance value of each web panorama partition each overlap region in FIG.
  3. 3. 根据权利要求1所述的一种全景视频多镜头曝光补偿方法,其特征在于,步骤S107 包括: 将所有全景分区图的视频数据乘以各自对应的第二曝光补偿系数。 3. According to a panoramic video camera of the multi-exposure compensation to claim 1, characterized in that, the step S107 comprises: a partition map all panoramic video data by a second compensation coefficient corresponding to each exposure.
  4. 4. 根据权利要求1所述的一种全景视频多镜头曝光补偿方法,其特征在于,步骤S104 至步骤S106中所述第二曝光补偿系数的运算每500帧进行一次。 4. According to a panoramic video of the multi-lens exposure compensation method according to claim 1, wherein the calculating step S104 to step S106, the second exposure compensation coefficients once every 500 frames.
  5. 5. 根据权利要求1所述的一种全景视频多镜头曝光补偿方法,其特征在于,步骤S103 至步骤S106中涉及的运算过程采用复合乘法器资源进行流水式运算。 5. According to a panoramic video camera of the multi-exposure compensation to claim 1, characterized in that the computing process in step S103 to step S106 involves using the Complex Multiplier resource pipelined operation.
  6. 6. -种全景视频多镜头曝光补偿装置,其特征在于,包括依次连接的视频数据采集模块、图像处理模块、FPGA处理模块、压缩编码模块和解码显示模块; 所述FPGA处理模块包括提取变换单元、亮度统计单元、存储单元、运算单元和曝光补偿单元;所述提取变换单元、亮度统计单元、运算单元和曝光补偿单元分别与所述存储单元连接; 所述运算单元包括依次连接的第一运算单元、第二运算单元和第三运算单元; 所述视频数据采集模块,用于采集视频数据后发送至所述图像处理模块; 所述图像处理模块,用于将视频数据进行ISP图像信号处理后发送至FPGA处理模块; 所述提取变换单元,用于根据拼接参数提取变换得到两幅以上的全景分区图,获得重置区域; 所述存储单元,用于缓存所述两幅以上的全景分区图; 所述亮度统计单元,用于两幅以上的全景分 6. - Multi-Species panoramic video camera exposure compensation apparatus comprising video data capture modules are sequentially connected, the image processing module, the processing module FPGA, compression encoding and decoding module display module; FPGA processing module comprises extracting the transform unit luminance statistical unit, a storage unit, an arithmetic unit, and exposure compensation unit; extracting the transform unit, the luminance statistics unit, an arithmetic unit, and exposure compensation unit is connected to the memory cells; the arithmetic unit comprises a first arithmetic sequentially connected after the image processing module, video data for an image signal processing performed ISP; unit, second operation unit and third operation unit; after the video data acquisition module, for collecting the video data to the image processing module sent to the FPGA processing module; the extracting and converting means for converting the extracted parameters obtained according to the above two splicing panorama partition map, obtaining reset region; the storage unit for two or more cache partitions FIG said panorama ; the luminance statistics unit, more than two points for panoramic 图写入内存的同时对各幅全景分区图中的重叠区域进行亮度统计,得到重叠区域的平均亮度值; 所述第一运算单元,用于选择其中一幅全景分区图的曝光补偿系数作为参考值,根据重叠区域的平均亮度值与曝光补偿系数之间的关系,得到各幅全景分区图对应的第一曝光补偿系数; 所述第二运算单元,用于由所有全景分区图的第一曝光补偿系数得到平均曝光补偿系数; 所述第三运算单元,用于以平均曝光补偿系数作为参考值,根据平均亮度值与平均曝光补偿系数之间的关系式得到各幅全景分区图对应的第二曝光补偿系数; 所述曝光补偿单元,用于读出视频数据的同时根据第二曝光补偿系数对各自对应的全景分区图进行曝光补偿; 所述压缩编码模块,用于对视频数据进行压缩编码处理后发送至所述解码显示模块; 所述解码显示模块,用于得到视频 FIG simultaneously be written to memory for each partition web panorama FIG overlapping area luminance statistics, an average luminance value of the overlap region; the first operation unit, wherein the exposure compensation for selecting a panoramic partition coefficients as a reference in FIG. value, the relationship between the average luminance values ​​of the overlap region and the exposure compensation coefficient, a first exposure to obtain compensation coefficients of each partition panorama view corresponding web; the second operation unit for the first exposure of all partitions FIG panorama average exposure compensation factor compensation coefficient; the third arithmetic unit, for an average exposure compensation coefficient as a reference value, to give each of the corresponding web panorama partition map according to the relationship between the average luminance value of the average exposure of the second compensation coefficients exposure compensation coefficient; the exposure compensation means for simultaneously reading out the video data of each corresponding partition map panoramic exposure compensation is performed in accordance with a second exposure compensation coefficient; the compression-encoding means for encoding the video data compression process after the decoding is transmitted to the display module; decoding the display module is configured to obtain video 流后解码显示。 After the display stream decoding.
  7. 7. 根据权利要求6所述的一种全景视频多镜头曝光补偿装置,其特征在于,所述亮度统计模块还包括将全景分区图中的重叠区域的像素亮度值相加后除以所述重叠区域的像素总个数得到各幅全景分区图中每个重叠区域的平均亮度值。 7. According to a multi-panoramic video camera according to claim 6, wherein the exposure compensation apparatus, wherein, the luminance statistics module further comprising after dividing the overlapping area of ​​the pixel luminance values ​​of the overlap in the panorama of the partition of FIG adding the total number of pixels of the region average luminance value for each region of each web overlapped partition panorama FIG.
  8. 8. 根据权利要求6所述的一种全景视频多镜头曝光补偿装置,其特征在于,所述曝光补偿模块包括将所有全景分区图的视频数据乘以各自对应的第二曝光补偿系数。 8. A panoramic video in accordance with claim 6, wherein said multi-lens exposure compensation apparatus, wherein, said exposure compensation module comprises all partitions FIG panoramic video data by a second compensation coefficient corresponding to each exposure.
  9. 9. 根据权利要求6所述的一种全景视频多镜头曝光补偿装置,其特征在于,所述FPGA 处理模块中的亮度统计单元和运算单元每500帧视频数据便重新运算获取所述第二曝光补偿系数的值。 9. A panoramic video in accordance with claim 6, wherein said multi-lens exposure compensation apparatus, wherein the processing module FPGA luminance statistics unit and an operation unit 500 for each video data acquired will recalculate the second exposure value of the compensation coefficient.
  10. 10. 根据权利要求6所述的一种全景视频多镜头曝光补偿装置,其特征在于,所述FPGA 处理模块还包括复用乘法器单元,所述复用乘法器单元分别与所述亮度统计单元和运算单元连接,用于采用复合乘法器资源进行流水式运算。 A multi-panoramic video camera according to claim 6, said exposure compensation apparatus, wherein the processing module further includes a multiplexing FPGA multiplier unit, a multiplier unit, respectively, multiplexing the luminance statistics unit and an operation unit connected to the multiplier for composite resources pipelined operation.
CN 201410314390 2014-07-02 2014-07-02 One kind of panoramic video multi-lens exposure compensation method and device CN104125410B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201410314390 CN104125410B (en) 2014-07-02 2014-07-02 One kind of panoramic video multi-lens exposure compensation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201410314390 CN104125410B (en) 2014-07-02 2014-07-02 One kind of panoramic video multi-lens exposure compensation method and device

Publications (2)

Publication Number Publication Date
CN104125410A true true CN104125410A (en) 2014-10-29
CN104125410B CN104125410B (en) 2017-04-12

Family

ID=51770662

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201410314390 CN104125410B (en) 2014-07-02 2014-07-02 One kind of panoramic video multi-lens exposure compensation method and device

Country Status (1)

Country Link
CN (1) CN104125410B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516614A (en) * 2015-11-27 2016-04-20 联想(北京)有限公司 Information processing method and electronic device
CN105979238A (en) * 2016-07-05 2016-09-28 深圳市德赛微电子技术有限公司 Method for controlling global imaging consistency of multiple cameras

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060028549A1 (en) * 2004-08-04 2006-02-09 Grindstaff Gene A Real-time composite image comparator
CN1837853A (en) * 2006-04-28 2006-09-27 武汉大学 Seam eliminating method for mosaic of remote sensing image
CN102347015A (en) * 2011-09-15 2012-02-08 青岛海信电器股份有限公司 Image brightness compensation method and device as well as liquid crystal television
CN102741878A (en) * 2010-10-26 2012-10-17 株式会社摩如富 Image processing device, image processing method, and image processing program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060028549A1 (en) * 2004-08-04 2006-02-09 Grindstaff Gene A Real-time composite image comparator
CN1837853A (en) * 2006-04-28 2006-09-27 武汉大学 Seam eliminating method for mosaic of remote sensing image
CN102741878A (en) * 2010-10-26 2012-10-17 株式会社摩如富 Image processing device, image processing method, and image processing program
CN102347015A (en) * 2011-09-15 2012-02-08 青岛海信电器股份有限公司 Image brightness compensation method and device as well as liquid crystal television

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105516614A (en) * 2015-11-27 2016-04-20 联想(北京)有限公司 Information processing method and electronic device
CN105979238A (en) * 2016-07-05 2016-09-28 深圳市德赛微电子技术有限公司 Method for controlling global imaging consistency of multiple cameras

Also Published As

Publication number Publication date Type
CN104125410B (en) 2017-04-12 grant

Similar Documents

Publication Publication Date Title
US9031343B2 (en) Systems and methods for encoding light field image files having a depth map
US20120218442A1 (en) Global alignment for high-dynamic range image generation
US8199222B2 (en) Low-light video frame enhancement
CN103905730A (en) Shooting method of mobile terminal and mobile terminal
US20110205381A1 (en) Tone mapping for low-light video frame enhancement
CN101276465A (en) Method for automatically split-jointing wide-angle image
CN103888683A (en) Mobile terminal and shooting method thereof
CN1592361A (en) Apparatus and method for improving the quality of a picture having a high illumination difference
CN101877767A (en) Method and system for generating three-dimensional panoramic continuous video through six-channel video source
US20140071330A1 (en) System and method for enhanced monoimaging
JP2005197952A (en) Imaging device and imaging method
CN101808250A (en) Dual vision-based three-dimensional image synthesizing method and system
CN101223552A (en) Video processing method and device for depth extraction
US20130021505A1 (en) Multiple image processing
CN105323552A (en) Method and system for playing panoramic video
CN104835118A (en) Method for acquiring panorama image by using two fish-eye camera lenses
CN103905741A (en) Ultra-high-definition panoramic video real-time generation and multi-channel synchronous play system
US20160028950A1 (en) Panoramic Video from Unstructured Camera Arrays with Globally Consistent Parallax Removal
CN101626454A (en) Method for intensifying video visibility
CN103327252A (en) Shooting device and shooting method thereof
CN102547302A (en) Flash synchronization using image sensor interface timing signal
JP2011066827A (en) Image processing apparatus, image processing method and program
JP2004310504A (en) Picture processing method
CN101689357B (en) Video camera
CN101895674A (en) De-interlacing method and device for monitoring video

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
GR01