CN111273050A - Signal acquisition processing method and device - Google Patents
Signal acquisition processing method and device Download PDFInfo
- Publication number
- CN111273050A CN111273050A CN202010089554.9A CN202010089554A CN111273050A CN 111273050 A CN111273050 A CN 111273050A CN 202010089554 A CN202010089554 A CN 202010089554A CN 111273050 A CN111273050 A CN 111273050A
- Authority
- CN
- China
- Prior art keywords
- signal
- modulation
- target scene
- sub
- frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
- G01P3/00—Measuring linear or angular speed; Measuring differences of linear or angular speeds
- G01P3/36—Devices characterised by the use of optical means, e.g. using infrared, visible, or ultraviolet light
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01M—TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
- G01M11/00—Testing of optical apparatus; Testing structures by optical methods not otherwise provided for
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
- G01P15/00—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Electromagnetism (AREA)
- Power Engineering (AREA)
- Multimedia (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optical Communication System (AREA)
Abstract
本公开实施例涉及信号采集处理方法和信号采集处理装置。其中,信号采集处理方法包括:对来自目标场景的光信号进行第一处理;对经所述第一处理后的光信号进行采集。本公开实施例的方法和装置减小了数据量,降低了对信号采集装置性能的要求,提高了信号采集处理速度。
Embodiments of the present disclosure relate to a signal acquisition and processing method and a signal acquisition and processing device. Wherein, the signal collection and processing method includes: performing first processing on the optical signal from the target scene; and collecting the optical signal after the first processing. The method and device of the embodiments of the present disclosure reduce the amount of data, lower the performance requirements of the signal acquisition device, and improve the signal acquisition and processing speed.
Description
技术领域technical field
本公开属于信号处理技术领域,涉及一种信号采集处理方法及装置,具体为一种信号采集处理方法和与该信号采集处理方法对应的信号采集处理装置。The present disclosure belongs to the technical field of signal processing, and relates to a signal acquisition and processing method and device, in particular to a signal acquisition and processing method and a signal acquisition and processing device corresponding to the signal acquisition and processing method.
背景技术Background technique
“图像”是当今智能时代中最重要的信息种类之一。从工业到娱乐业,从自动驾驶到移动终端,每一个细分领域都需要图像信息来帮助人类和机器“理解世界”。"Images" are one of the most important types of information in today's intelligent age. From industry to entertainment, from autonomous driving to mobile terminals, every segment needs image information to help humans and machines "understand the world".
在一些应用场景下,人们往往不直接使用采集到的图像,而是对图像做进一步的计算机算法处理后进行利用,经过这些处理之后,图片的信息具有更高的使用价值。目前的算法处理流程,一般可能是在采集图像信息之后,将该图像信息在计算机中存储,然后使用计算机对采集的图像执行图像处理算法。由于使用计算机来存储采集的数据,并进行大量的数据处理,因此现有方式处理速度慢、实时性较差、效率低。例如,目前图像处理系统的速度一般在100赫兹以内,很难满足人们在某些应用场景中的需求。In some application scenarios, people often do not use the collected images directly, but use the images after further computer algorithm processing. After these processing, the information of the images has higher use value. In the current algorithm processing flow, generally, after image information is collected, the image information is stored in a computer, and then the computer is used to execute an image processing algorithm on the collected image. Since a computer is used to store the collected data and process a large amount of data, the existing method has slow processing speed, poor real-time performance and low efficiency. For example, the speed of current image processing systems is generally within 100 Hz, which is difficult to meet people's needs in certain application scenarios.
发明内容SUMMARY OF THE INVENTION
本公开实施例提供了信号采集处理方法以及信号采集处理装置,以解决上述技术问题。Embodiments of the present disclosure provide a signal acquisition and processing method and a signal acquisition and processing device to solve the above technical problems.
根据本公开至少一个实施例,提供了一种信号采集处理方法,包括:对来自目标场景的光信号进行第一处理;对经所述第一处理后的光信号进行采集。According to at least one embodiment of the present disclosure, there is provided a signal acquisition and processing method, comprising: performing first processing on an optical signal from a target scene; and acquiring the optical signal after the first processing.
根据本公开前述任一实施例的方法,例如,还包括:基于采集的数据获得所述目标场景中的信息。The method according to any of the foregoing embodiments of the present disclosure, for example, further includes: obtaining information in the target scene based on the collected data.
根据本公开前述任一实施例的方法,例如,所述基于采集的数据获得所述目标场景中的信息包括:对采集的数据进行第二处理,以获得所述目标场景中的信息;将获得的所述信息形成图像。According to the method of any of the foregoing embodiments of the present disclosure, for example, the obtaining the information in the target scene based on the collected data includes: performing a second process on the collected data to obtain the information in the target scene; obtaining the information in the target scene; of said information to form an image.
根据本公开前述任一实施例的方法,例如,对来自目标场景的光信号进行第一处理包括:确定所述目标场景的编码信号;基于所述编码信号对所述来自所述目标场景的光信号进行编码处理,经所述编码处理后的信号为光信号。According to the method of any one of the foregoing embodiments of the present disclosure, for example, performing the first processing on the light signal from the target scene includes: determining an encoded signal of the target scene; The signal is encoded, and the encoded signal is an optical signal.
根据本公开前述任一实施例的方法,例如,所述对经所述第一处理后的光信号进行采集包括:对所述编码处理后的光信号进行采集,所述编码处理后的光信号包括所述编码信号的信息以及来自所述目标场景的光信号。According to the method of any of the foregoing embodiments of the present disclosure, for example, the collecting the first processed optical signal includes: collecting the encoded optical signal, the encoded optical signal Information including the encoded signal and light signal from the target scene is included.
根据本公开前述任一实施例的方法,例如,所述编码处理后的光信号为所述编码信号与来自所述目标场景的光信号的相乘后的积分结果。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the encoded optical signal is an integral result of the multiplication of the encoded signal and the optical signal from the target scene.
根据本公开前述任一实施例的方法,例如,对来自目标场景的光信号进行第一处理还包括:将所述来自目标场景的光信号投射到空间光调制器;所述确定所述目标场景的编码信号包括:确定所述空间光调制器的调制信号;所述基于所述编码信号对所述来自所述目标场景的光信号进行编码处理包括:基于所述空间光调制器的调制信号对所述来自目标场景的光信号进行调制。According to the method of any of the foregoing embodiments of the present disclosure, for example, performing the first processing on the light signal from the target scene further comprises: projecting the light signal from the target scene to a spatial light modulator; the determining the target scene The encoded signal includes: determining the modulation signal of the spatial light modulator; and the encoding processing of the optical signal from the target scene based on the encoded signal includes: pairing the optical signal from the target scene based on the modulation signal of the spatial light modulator The optical signal from the target scene is modulated.
根据本公开前述任一实施例的方法,例如,所述调制信号包括频率参数和相位参数,所述确定所述空间光调制器的调制信号包括:确定所述调制信号的所述频率参数;确定所述调制信号的所述相位参数;基于所述频率参数和所述相位参数,确定所述调制信号。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the modulation signal includes a frequency parameter and a phase parameter, and the determining the modulation signal of the spatial light modulator includes: determining the frequency parameter of the modulation signal; determining the phase parameter of the modulated signal; the modulated signal is determined based on the frequency parameter and the phase parameter.
根据本公开前述任一实施例的方法,例如,确定所述调制信号的所述频率参数包括:确定预采集的光信号的属性和/或类型,基于预采集的光信号的属性和/或类型,确定所述调制信号的频率参数。According to the method of any one of the foregoing embodiments of the present disclosure, for example, determining the frequency parameter of the modulated signal comprises: determining a property and/or type of a pre-collected optical signal, based on the property and/or type of the pre-collected optical signal , and determine the frequency parameter of the modulated signal.
根据本公开前述任一实施例的方法,例如,确定所述调制信号的所述频率参数包括:确定所述目标场景的复杂度;基于所述复杂度确定所述调制信号的频率参数。According to the method of any of the foregoing embodiments of the present disclosure, for example, determining the frequency parameter of the modulation signal includes: determining the complexity of the target scene; and determining the frequency parameter of the modulation signal based on the complexity.
根据本公开前述任一实施例的方法,例如,所述目标场景中包括运动物体或亮度变化物体,确定所述调制信号的所述频率参数包括:确定所述运动物体的运动参数或所述亮度变化物体的亮度变化参数,基于所述运动参数或亮度变化参数,确定所述调制信号的频率参数。According to the method of any of the foregoing embodiments of the present disclosure, for example, the target scene includes a moving object or a brightness-changing object, and determining the frequency parameter of the modulation signal includes: determining a motion parameter or the brightness of the moving object The brightness change parameter of the changing object, and the frequency parameter of the modulation signal is determined based on the motion parameter or the brightness change parameter.
根据本公开前述任一实施例的方法,例如,所述将所述来自目标场景的光信号投射到空间光调制器包括:将来自所述目标场景的光信号经过第一光学元件;经过所述第一光学元件的光信号投射到所述空间光调制器上;所述空间光调制器对经所述光学元件后投射到其上的光信号进行接收调制。According to the method of any of the foregoing embodiments of the present disclosure, for example, the projecting the optical signal from the target scene to the spatial light modulator includes: passing the optical signal from the target scene through a first optical element; The optical signal of the first optical element is projected onto the spatial light modulator; the spatial light modulator receives and modulates the optical signal projected onto the optical element after passing through the optical element.
根据本公开前述任一实施例的方法,例如,所述空间光调制器包括多个子调制单元,所述将所述来自目标场景的光信号投射到空间光调制器包括:将所述来自目标场景的光信号投射到所述空间光调制器的所述子调制单元上,所述确定所述空间光调制器的调制信号包括:确定每个所述空间光调制器的子调制单元的子调制信号;所述基于所述空间光调制器的调制信号对所述来自目标场景的光信号进行调制包括:基于所述子调制单元的子调制信号,对所述来自目标场景的光信号进行调制。According to the method of any of the foregoing embodiments of the present disclosure, for example, the spatial light modulator includes a plurality of sub-modulation units, and the projecting the light signal from the target scene to the spatial light modulator includes: converting the light signal from the target scene to the spatial light modulator. The optical signal of the spatial light modulator is projected onto the sub-modulation unit of the spatial light modulator, and the determining the modulation signal of the spatial light modulator includes: determining the sub-modulation signal of each sub-modulation unit of the spatial light modulator ; the modulating the optical signal from the target scene based on the modulation signal of the spatial light modulator includes: modulating the optical signal from the target scene based on the sub-modulation signal of the sub-modulation unit.
根据本公开前述任一实施例的方法,例如,所述子调制信号包括频率参数和相位参数,所述确定每个所述空间光调制器的子调制单元的子调制信号包括:确定每个所述子调制信号的频率参数;确定每个所述子调制信号的相位参数;基于所述子调制信号的频率参数和相位参数确定所述子调制信号。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the sub-modulation signal includes a frequency parameter and a phase parameter, and the determining the sub-modulation signal of each of the sub-modulation units of the spatial light modulator includes: determining each of the sub-modulation units of the spatial light modulator. frequency parameters of the sub-modulation signals; determining phase parameters of each of the sub-modulation signals; determining the sub-modulation signals based on the frequency parameters and phase parameters of the sub-modulation signals.
根据本公开前述任一实施例的方法,例如,所述确定所述子调制信号的频率参数包括:预先确定要从所述目标场景中获得的信息,基于要从所述目标场景中获得的信息,确定所述子调制单元的子调制信号的频率参数中的频率数量和/或频率数值。According to the method of any of the foregoing embodiments of the present disclosure, for example, the determining the frequency parameter of the sub-modulation signal includes: predetermining information to be obtained from the target scene, based on the information to be obtained from the target scene , to determine the frequency quantity and/or frequency value in the frequency parameter of the sub-modulation signal of the sub-modulation unit.
根据本公开前述任一实施例的方法,例如,所述确定每个所述子调制信号的频率参数和相位参数还包括:确定每个所述子调制单元在所述空间光调制器中的位置,还基于所述位置确定每个所述子调制单元的频率参数和/或相位参数。According to the method of any of the foregoing embodiments of the present disclosure, for example, the determining the frequency parameter and the phase parameter of each of the sub-modulation signals further comprises: determining the position of each of the sub-modulation units in the spatial light modulator , and also determine a frequency parameter and/or a phase parameter of each of the sub-modulation units based on the position.
根据本公开前述任一实施例的方法,例如,所述多个子调制单元的每个子调制单元的调制信号均采用相同的频率。According to the method of any of the foregoing embodiments of the present disclosure, for example, the modulation signal of each sub-modulation unit of the plurality of sub-modulation units adopts the same frequency.
根据本公开前述任一实施例的方法,例如,所述多个子调制单元中至少两个子调制单元的调制信号采用不同的频率。According to the method of any of the foregoing embodiments of the present disclosure, for example, modulation signals of at least two sub-modulation units in the plurality of sub-modulation units use different frequencies.
根据本公开前述任一实施例的方法,例如,所述频率数值在低频频率范围内。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency value is in a low frequency frequency range.
根据本公开前述任一实施例的方法,例如,所述多个频率数值中包括0。According to the method of any of the foregoing embodiments of the present disclosure, for example, 0 is included in the plurality of frequency values.
根据本公开前述任一实施例的方法,例如,所述多个频率数值中不包括0。According to the method of any of the foregoing embodiments of the present disclosure, for example, 0 is not included in the plurality of frequency values.
根据本公开前述任一实施例的方法,例如,所述子调制单元的调制信号的频率参数与第一时间相关,所述第一时间与对所述光信号进行采集的装置的性能参数相关。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency parameter of the modulation signal of the sub-modulation unit is related to the first time, and the first time is related to the performance parameter of the apparatus for collecting the optical signal.
根据本公开前述任一实施例的方法,例如,所述子调制单元的调制信号的频率小于或等于第一时间的倒数。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency of the modulation signal of the sub-modulation unit is less than or equal to the inverse of the first time.
根据本公开前述任一实施例的方法,例如,基于在第一时间内形成图像的数量,确定所述频率数量。According to the method of any of the preceding embodiments of the present disclosure, the number of frequencies is determined, for example, based on the number of images formed in a first time.
根据本公开前述任一实施例的方法,例如,所述频率数量与在所述第一时间内形成的图像的数量成正比。According to the method of any of the foregoing embodiments of the present disclosure, for example, the number of frequencies is proportional to the number of images formed within the first time.
根据本公开前述任一实施例的方法,例如,当所述频率数量为多个时,基于第一时间确定所述多个频率之间的数值间隔。According to the method of any one of the foregoing embodiments of the present disclosure, for example, when the number of frequencies is multiple, the numerical interval between the multiple frequencies is determined based on the first time.
根据本公开前述任一实施例的方法,例如,所述数值间隔小于等于所述第一时间的倒数。According to the method of any of the foregoing embodiments of the present disclosure, for example, the numerical interval is less than or equal to the reciprocal of the first time.
根据本公开前述任一实施例的方法,例如,所述多个子调制单元中至少三个子调制单元的相位参数不同。According to the method of any of the foregoing embodiments of the present disclosure, for example, the phase parameters of at least three sub-modulation units in the plurality of sub-modulation units are different.
根据本公开前述任一实施例的方法,例如,所述子调制单元的调制信号中相位参数的相位分布在0-2π范围内。According to the method of any of the foregoing embodiments of the present disclosure, for example, the phase distribution of the phase parameter in the modulation signal of the sub-modulation unit is in the range of 0-2π.
根据本公开前述任一实施例的方法,例如,确定每个所述空间光调制器的子调制单元的子调制信号还包括:将所述多个子调制单元分成多个组,每组包括至少两个子调制单元,每组子调制单元中的所有子调制单元在所述空间光调制器中的空间位置邻近;基于所述组确定子调制单元的子调制信号。According to the method of any of the foregoing embodiments of the present disclosure, for example, determining the sub-modulation signal of each of the sub-modulation units of the spatial light modulator further comprises: dividing the plurality of sub-modulation units into a plurality of groups, each group including at least two sub-modulation units, all sub-modulation units in each group of sub-modulation units are located adjacent to each other in the spatial light modulator; and the sub-modulation signals of the sub-modulation units are determined based on the group.
根据本公开前述任一实施例的方法,例如,所述基于所述组确定子调制单元的子调制信号包括:确定每组子调制单元的调制信号的频率值,所述每组子调制信号的频率值相同,确定每组子调制单元的调制信号的相位值,所述每组子调制信号的相位值不同。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the determining the sub-modulation signal of the sub-modulation unit based on the group includes: determining the frequency value of the modulation signal of each group of sub-modulation units, and the frequency value of the sub-modulation signal of each group is determined. If the frequency values are the same, the phase values of the modulation signals of each group of sub-modulation units are determined, and the phase values of the sub-modulation signals of each group are different.
根据本公开前述任一实施例的方法,例如,每组子调制单元的子调制信号的频率值与邻近的其他组子调制单元的调制信号的频率值不同。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency values of the sub-modulation signals of each group of sub-modulation units are different from the frequency values of the modulation signals of the adjacent groups of sub-modulation units.
根据本公开前述任一实施例的方法,例如,每组子调制单元的子调制信号的频率值与邻近的其他组子调制单元的调制信号的频率值相同。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency value of the sub-modulation signal of each group of sub-modulation units is the same as the frequency value of the modulation signals of other adjacent groups of sub-modulation units.
根据本公开前述任一实施例的方法,例如,所述子调制单元包括光学镜片,所述光学镜片以各自中心轴为轴,且以与所述子调制单元的调制信号对应的频率和相位进行摆动。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the sub-modulation units include optical mirrors, the optical mirrors have respective central axes as axes, and are performed at frequencies and phases corresponding to the modulation signals of the sub-modulation units swing.
根据本公开前述任一实施例的方法,例如,所述子调制单元包括液晶单元,所述液晶单元以所述子调制单元的调制信号对应的频率和相位进行通断。According to the method of any of the foregoing embodiments of the present disclosure, for example, the sub-modulation unit includes a liquid crystal cell, and the liquid crystal cell is turned on and off at a frequency and a phase corresponding to a modulation signal of the sub-modulation unit.
根据本公开前述任一实施例的方法,例如,所述目标场景中包括至少一个运动物体或至少一个亮度变化物体,所述对来自目标场景的光信号进行第一处理包括:根据所述运动物体或亮度变化物体的至少一个运动参数或亮度变化参数,确定调制信号中的至少一个频率参数和/或至少一个相位参数;基于所述至少一个频率参数和/或至少一个相位参数确定所述调制信号。According to the method of any of the foregoing embodiments of the present disclosure, for example, the target scene includes at least one moving object or at least one brightness-changing object, and the performing the first processing on the light signal from the target scene includes: according to the moving object or at least one motion parameter or brightness change parameter of a brightness-changing object, determine at least one frequency parameter and/or at least one phase parameter in the modulation signal; determine the modulation signal based on the at least one frequency parameter and/or at least one phase parameter .
根据本公开前述任一实施例的方法,例如,所述调制信号的频率参数的频率值范围大于或等于所述至少一个频率参数中的频率值范围。According to the method of any of the foregoing embodiments of the present disclosure, for example, the frequency value range of the frequency parameter of the modulation signal is greater than or equal to the frequency value range of the at least one frequency parameter.
根据本公开前述任一实施例的方法,例如,所述运动参数包括运动速度,所述亮度变化参数包括亮度变化速度,所述根据所述运动物体或亮度变化物体的至少一个运动参数或至少一个亮度变化参数,确定调制信号中的至少一个频率值包括:根据所述运动速度或亮度变化速度,确定所述至少一个运动物体或亮度变化物体经过光信号采集装置的一个探测单元的至少一个时间值或所述亮度变化物体的亮度变化点在经过所述探测单元的至少一个时间值;根据所述至少一个时间值确定所述至少一个频率值。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the motion parameter includes a motion speed, the brightness change parameter includes a brightness change speed, and the at least one motion parameter or at least one of the moving object or the brightness changing object Brightness change parameter, determining at least one frequency value in the modulation signal includes: determining at least one time value of the at least one moving object or the brightness changing object passing through a detection unit of the optical signal collection device according to the moving speed or the brightness changing speed Or the brightness change point of the brightness changing object is at least one time value passing through the detection unit; the at least one frequency value is determined according to the at least one time value.
根据本公开前述任一实施例的方法,例如,所述运动参数还包括加速度,所述亮度变化参数还包括亮度变化加速度,所述根据所述运动速度或所述亮度变化速度,确定所述至少一个运动物体或亮度变化物体经过光信号采集装置的一个探测单元的至少一个时间值或所述亮度变化物体的亮度变化点在经过所述探测单元的至少一个时间值包括:根据所述运动加速度和所述运动速度,分别确定所述运动物体的多个运动速度;根据所述多个运动速度,分别确定所述运动物体经过光信号采集装置的一个探测单元的多个时间值;或者,根据亮度变化加速度和亮度变化速度,分别确定所述亮度变化物体的多个亮度变化速度;根据多个亮度变化速度,分别确定所述亮度变化物体的亮度变化点经过光信号采集装置的一个探测单元的多个时间值。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the motion parameter further includes acceleration, the brightness change parameter further includes a brightness change acceleration, and determining the at least one according to the movement speed or the brightness change speed At least one time value of a moving object or a brightness-changing object passing through a detection unit of the optical signal acquisition device or at least one time value of the brightness-changing point of the brightness-changing object passing through the detection unit includes: according to the motion acceleration and For the moving speed, respectively determine multiple moving speeds of the moving object; according to the multiple moving speeds, respectively determine multiple time values for the moving object to pass through a detection unit of the optical signal acquisition device; or, according to the brightness Change acceleration and brightness change speed, respectively determine multiple brightness change speeds of the brightness change object; according to the multiple brightness change speeds, respectively determine multiple brightness change points of the brightness change object passing through a detection unit of the optical signal acquisition device. time value.
根据本公开前述任一实施例的方法,例如,对经所述第一处理后的光信号进行采集包括:将所述空间光调制器调制后的光信号投射到图像探测器;所述图像探测器对所述调制后的光信号进行采集。According to the method of any of the foregoing embodiments of the present disclosure, for example, collecting the first processed optical signal includes: projecting the optical signal modulated by the spatial light modulator to an image detector; the image detection The device collects the modulated optical signal.
根据本公开前述任一实施例的方法,例如,所述空间光调制器包括多个子调制单元,所述图像探测器包括多个子探测单元,一个子调制单元对应一个或多个图像探测器的子探测单元;所述图像探测器对所述调制后的光信号进行采集包括:所述子探测单元对与其对应的所述子调制单元调制后的光信号进行采集。According to the method of any of the foregoing embodiments of the present disclosure, for example, the spatial light modulator includes a plurality of sub-modulation units, the image detector includes a plurality of sub-detection units, and one sub-modulation unit corresponds to a sub-unit of one or more image detectors A detection unit; the collection of the modulated optical signal by the image detector includes: the sub-detection unit collects the optical signal modulated by the corresponding sub-modulation unit.
根据本公开前述任一实施例的方法,例如,所述图像探测器对所述调制后的光信号进行采集包括:在第一时间内,所述图像探测器对所述编码后的光信号进行采集,所述第一时间与所述图像探测器的性能指标相关。According to the method of any one of the foregoing embodiments of the present disclosure, for example, the acquisition of the modulated optical signal by the image detector includes: within a first time, the image detector performs an operation on the encoded optical signal. acquisition, the first time is related to the performance index of the image detector.
根据本公开前述任一实施例的方法,例如,将所述空间光调制器调制后的光信号投射到图像探测器包括:将所述空间光调制器调制后的光信号经过第二光学元件;将经过第二光学元件的光信号投射到图像探测器。According to the method of any of the foregoing embodiments of the present disclosure, for example, projecting the optical signal modulated by the spatial light modulator to the image detector comprises: passing the optical signal modulated by the spatial light modulator through a second optical element; The light signal passing through the second optical element is projected to the image detector.
根据本公开前述任一实施例的方法,例如,所述基于采集的数据获得所述目标场景中的信息包括:获取对应来自所述目标场景的光信号的编码信号;根据所述编码信号以及所述采集的数据获得所述目标场景中的信息。According to the method of any of the foregoing embodiments of the present disclosure, for example, the obtaining the information in the target scene based on the collected data includes: obtaining an encoded signal corresponding to an optical signal from the target scene; The collected data obtains information in the target scene.
根据本公开前述任一实施例的方法,例如,所述获取对应来自所述目标场景的光信号的编码信号包括:获取所述编码信号中的频率参数作为第一参数;所述根据所述编码信号以及所述采集的数据获得所述目标场景中的信息包括:基于采集的数据,获得第二参数;基于所述第一和第二参数,对所述采集的数据进行第二处理,以获得所述目标场景中的信息。According to the method of any of the foregoing embodiments of the present disclosure, for example, the acquiring an encoded signal corresponding to the optical signal from the target scene includes: acquiring a frequency parameter in the encoded signal as a first parameter; Obtaining the information in the target scene from the signal and the collected data includes: obtaining a second parameter based on the collected data; and performing a second process on the collected data based on the first and second parameters to obtain information in the target scene.
根据本公开前述任一实施例的方法,例如,所述采集的数据包括多个像素点,每个像素点与进行所述第一处理的空间光调制器的子调制单元相关,所述子调制单元为多个,被分成多个组,所述基于采集的数据,获得第二参数包括:将对应一组子调制单元的多个像素点作为一个像素点组,基于一个或多个像素点组,确定所述第二参数。According to the method of any of the foregoing embodiments of the present disclosure, for example, the collected data includes a plurality of pixel points, each pixel point is associated with a sub-modulation unit of the spatial light modulator performing the first processing, the sub-modulation There are multiple units, which are divided into multiple groups. The obtaining the second parameter based on the collected data includes: taking multiple pixel points corresponding to a group of sub-modulation units as a pixel point group, based on one or more pixel point groups , and determine the second parameter.
根据本公开另一实施例,还提供了一种信号采集处理装置,包括:信号处理装置,被配置为对来自目标场景的光信号进行第一处理;信号采集装置,被配置为对经所述第一处理后的光信号进行采集。According to another embodiment of the present disclosure, a signal acquisition and processing device is further provided, including: a signal processing device configured to perform first processing on an optical signal from a target scene; a signal acquisition device configured to The first processed optical signal is collected.
根据本公开前述任一实施例的装置,例如,还包括,信息获得装置,被配置为基于采集的数据获得所述目标场景中的信息。The apparatus according to any of the foregoing embodiments of the present disclosure, for example, further includes an information obtaining apparatus configured to obtain information in the target scene based on the collected data.
根据本公开前述任一实施例的装置,例如,所述信息获得装置进一步被配置为,对采集的数据进行第二处理,以获得所述目标场景中的信息;将所述获得的信息形成图像。According to the device according to any of the foregoing embodiments of the present disclosure, for example, the information obtaining device is further configured to perform second processing on the collected data to obtain information in the target scene; and form the obtained information into an image .
根据本公开前述任一实施例的装置,例如,所述信号处理装置进一步被配置为,确定所述目标场景的编码信号;基于所述编码信号对所述来自所述目标场景的光信号进行编码处理,经所述编码处理后的信号为光信号。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the signal processing apparatus is further configured to determine an encoded signal of the target scene; and to encode the optical signal from the target scene based on the encoded signal processing, and the encoded signal is an optical signal.
根据本公开前述任一实施例的装置,例如,所述信号采集装置进一步被配置为,对所述编码处理后的光信号进行采集,所述编码处理后的光信号包括所述编码信号的信息以及来自所述目标场景的光信号。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the signal collection apparatus is further configured to collect the encoded optical signal, where the encoded optical signal includes information of the encoded signal and the light signal from the target scene.
根据本公开前述任一实施例的装置,例如,所述编码处理后的光信号为所述编码信号与来自所述目标场景的光信号的相乘后的积分结果。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the encoded optical signal is an integral result of the multiplication of the encoded signal and the optical signal from the target scene.
根据本公开前述任一实施例的装置,例如,所述信号处理装置包括调制信号确定单元以及空间光调制器;所述调制信号确定单元被配置为确定调制信号;所述空间光调制器基于调制信号对所述来自目标场景的光信号进行调制。The apparatus according to any of the foregoing embodiments of the present disclosure, for example, the signal processing apparatus includes a modulation signal determination unit and a spatial light modulator; the modulation signal determination unit is configured to determine a modulation signal; the spatial light modulator is based on a modulation The signal modulates the light signal from the target scene.
根据本公开前述任一实施例的装置,例如,所述调制信号包括频率参数和相位参数,所述调制信号确定单元进一步被配置为,确定频率参数以及相位参数,并基于所述频率参数和所述相位参数确定所述调制信号。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the modulation signal includes a frequency parameter and a phase parameter, and the modulation signal determining unit is further configured to determine the frequency parameter and the phase parameter, and based on the frequency parameter and the phase parameter The phase parameter determines the modulated signal.
根据本公开前述任一实施例的装置,例如,所述调制信号确定单元确定预采集的光信号的属性和/或类型,基于预采集的光信号的属性和/或类型,确定所述调制信号的频率参数。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the modulation signal determination unit determines the properties and/or types of pre-collected optical signals, and determines the modulation signals based on the properties and/or types of pre-collected optical signals frequency parameter.
根据本公开前述任一实施例的装置,例如,所述调制信号确定单元确定所述目标场景的复杂度,基于所述复杂度确定所述调制信号的频率参数。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the modulation signal determination unit determines the complexity of the target scene, and determines the frequency parameter of the modulation signal based on the complexity.
根据本公开前述任一实施例的装置,例如,所述目标场景中包括运动物体或亮度变化物体,所述调制信号确定单元确定所述运动物体的运动参数或所述亮度变化物体的亮度变化参数,基于所述运动参数或亮度变化参数,确定所述调制信号的频率参数。According to the apparatus of any one of the foregoing embodiments of the present disclosure, for example, the target scene includes a moving object or a brightness-changing object, and the modulation signal determining unit determines a motion parameter of the moving object or a brightness-changing parameter of the brightness-changing object , and determine the frequency parameter of the modulated signal based on the motion parameter or the brightness change parameter.
根据本公开前述任一实施例的装置,例如,还包括,第一光学元件,来自所述目标场景的光信号经过第一光学元件;经过所述第一光学元件的光信号投射到所述空间光调制器上;所述空间光调制器对经所述光学元件后投射到其上的光信号进行接收调制。The device according to any of the foregoing embodiments of the present disclosure, for example, further comprises a first optical element, the light signal from the target scene passes through the first optical element; the light signal passing through the first optical element is projected to the space on the light modulator; the spatial light modulator receives and modulates the light signal projected onto the optical element after passing through the optical element.
根据本公开前述任一实施例的装置,例如,所述空间光调制器包括多个子调制单元,所述来自目标场景的光信号投射到所述空间光调制器的所述子调制单元上,所述调制信号确定单元确定每个所述空间光调制器的子调制单元的子调制信号;所述空间光调制器基于确定的所述子调制单元的子调制信号,对所述来自目标场景的光信号进行调制。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the spatial light modulator includes a plurality of sub-modulation units, and the optical signal from the target scene is projected onto the sub-modulation units of the spatial light modulator, so The modulation signal determining unit determines a sub-modulation signal of the sub-modulation unit of each of the spatial light modulators; the spatial light modulator, based on the determined sub-modulation signal of the sub-modulation unit, determines the light from the target scene for the light from the target scene. The signal is modulated.
根据本公开前述任一实施例的装置,例如,所述子调制信号包括频率参数和相位参数,所述调制信号确定单元确定所述频率参数和所述相位参数,基于所述子调制信号的频率参数和相位参数确定所述子调制信号。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the sub-modulation signal includes a frequency parameter and a phase parameter, and the modulation signal determining unit determines the frequency parameter and the phase parameter, based on the frequency of the sub-modulation signal The parameters and phase parameters determine the sub-modulated signal.
根据本公开前述任一实施例的装置,例如,所述调制信号确定单元进一步被配置为,预先确定要从所述目标场景中获得的信息,基于要从所述目标场景中获得的信息,确定所述子调制单元的子调制信号的频率参数中的频率数量和/或频率数值。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the modulated signal determination unit is further configured to pre-determine information to be obtained from the target scene, and based on the information to be obtained from the target scene, determine The frequency quantity and/or frequency value in the frequency parameter of the sub-modulation signal of the sub-modulation unit.
根据本公开前述任一实施例的装置,例如,所述调制信号确定单元进一步被配置为,确定每个所述子调制单元在所述空间光调制器中的位置,还基于所述位置确定每个所述子调制单元的频率参数和/或相位参数。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the modulation signal determination unit is further configured to determine a position of each of the sub-modulation units in the spatial light modulator, and to determine each of the sub-modulation units based on the position frequency parameters and/or phase parameters of each of the sub-modulation units.
根据本公开前述任一实施例的装置,例如,所述多个子调制单元的每个子调制单元的调制信号均采用相同的频率。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the modulation signal of each sub-modulation unit of the plurality of sub-modulation units adopts the same frequency.
根据本公开前述任一实施例的装置,例如,所述多个子调制单元中至少两个子调制单元的调制信号采用不同的频率。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, modulation signals of at least two sub-modulation units in the plurality of sub-modulation units use different frequencies.
根据本公开前述任一实施例的装置,例如,所述频率数值在低频频率范围内。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the frequency value is in a low frequency frequency range.
根据本公开前述任一实施例的装置,例如,所述多个频率数值中包括0。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the plurality of frequency values includes 0.
根据本公开前述任一实施例的装置,例如,所述多个频率数值中不包括0。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, 0 is not included in the plurality of frequency values.
根据本公开前述任一实施例的装置,例如,所述子调制单元的调制信号的频率参数与第一时间相关,所述第一时间与所述信号采集装置的性能参数相关。According to the device according to any of the foregoing embodiments of the present disclosure, for example, the frequency parameter of the modulation signal of the sub-modulation unit is related to the first time, and the first time is related to the performance parameter of the signal acquisition device.
根据本公开前述任一实施例的装置,例如,所述子调制单元的调制信号的频率小于或等于第一时间的倒数。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the frequency of the modulation signal of the sub-modulation unit is less than or equal to the inverse of the first time.
根据本公开前述任一实施例的装置,例如,基于在第一时间内形成图像的数量,确定所述频率数量。The apparatus according to any of the preceding embodiments of the present disclosure, for example, determines the number of frequencies based on the number of images formed within a first time.
根据本公开前述任一实施例的装置,例如,所述频率数量与在所述第一时间内形成的图像的数量成正比。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the number of frequencies is proportional to the number of images formed within the first time.
根据本公开前述任一实施例的装置,例如,当所述频率数量为多个时,基于第一时间确定所述多个频率之间的数值间隔。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, when the number of frequencies is multiple, the numerical interval between the multiple frequencies is determined based on the first time.
根据本公开前述任一实施例的装置,例如,所述数值间隔小于等于所述第一时间的倒数。According to the device of any of the foregoing embodiments of the present disclosure, for example, the numerical interval is less than or equal to the reciprocal of the first time.
根据本公开前述任一实施例的装置,例如,所述多个子调制单元中至少三个子调制单元的相位参数不同。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, at least three sub-modulation units in the plurality of sub-modulation units have different phase parameters.
根据本公开前述任一实施例的装置,例如,所述子调制单元的调制信号中相位参数的相位分布在0-2π范围内。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the phase distribution of the phase parameter in the modulation signal of the sub-modulation unit is in the range of 0-2π.
根据本公开前述任一实施例的装置,例如,所述多个子调制单元分成多个组,每组包括至少两个子调制单元,每组子调制单元中的所有子调制单元在所述空间光调制器中的空间位置邻近;所述调制信号确定单元基于所述组确定所述子调制单元的子调制信号。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the plurality of sub-modulation units are divided into a plurality of groups, each group includes at least two sub-modulation units, and all sub-modulation units in each group of sub-modulation units are in the spatial light modulation The spatial positions in the sub-modulation unit are adjacent; the modulation signal determination unit determines the sub-modulation signal of the sub-modulation unit based on the group.
根据本公开前述任一实施例的装置,例如,所述每组子调制信号的频率值相同,所述每组子调制信号的相位值不同。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the frequency values of each group of sub-modulation signals are the same, and the phase values of each group of sub-modulation signals are different.
根据本公开前述任一实施例的装置,例如,每组子调制单元的子调制信号的频率值与邻近的其他组子调制单元的调制信号的频率值不同。According to the apparatus of any one of the foregoing embodiments of the present disclosure, for example, the frequency value of the sub-modulation signal of each group of sub-modulation units is different from the frequency value of the modulation signals of other adjacent groups of sub-modulation units.
根据本公开前述任一实施例的装置,例如,每组子调制单元的子调制信号的频率值与邻近的其他组子调制单元的调制信号的频率值相同。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the frequency value of the sub-modulation signal of each group of sub-modulation units is the same as the frequency value of the modulation signals of other adjacent groups of sub-modulation units.
根据本公开前述任一实施例的装置,例如,所述子调制单元包括光学镜片,所述光学镜片以各自中心轴为轴,且以与所述子调制单元的调制信号对应的频率和相位进行摆动。According to the device according to any one of the foregoing embodiments of the present disclosure, for example, the sub-modulation unit includes an optical lens, the optical lens has a respective central axis as an axis, and performs a frequency and phase corresponding to the modulation signal of the sub-modulation unit. swing.
根据本公开前述任一实施例的装置,例如,所述子调制单元包括液晶单元,所述液晶单元以所述子调制单元的调制信号对应的频率和相位进行通断。According to the device of any of the foregoing embodiments of the present disclosure, for example, the sub-modulation unit includes a liquid crystal cell, and the liquid crystal cell is turned on and off at a frequency and phase corresponding to a modulation signal of the sub-modulation unit.
根据本公开前述任一实施例的装置,例如,所述目标场景中包括至少一个运动物体或至少一个亮度变化物体,所述调制信号确定单元进一步被配置为,根据所述运动物体或亮度变化物体的至少一个运动参数或亮度变化参数,确定调制信号中的至少一个频率参数和/或至少一个相位参数;基于所述至少一个频率参数和/或至少一个相位参数确定所述调制信号。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the target scene includes at least one moving object or at least one brightness-changing object, and the modulation signal determining unit is further configured to, according to the moving object or the brightness-changing object at least one motion parameter or brightness change parameter of the modulated signal, determine at least one frequency parameter and/or at least one phase parameter in the modulation signal; determine the modulation signal based on the at least one frequency parameter and/or at least one phase parameter.
根据本公开前述任一实施例的装置,例如,所述调制信号的频率参数的频率值范围大于或等于所述至少一个频率参数中的频率值范围。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the frequency value range of the frequency parameter of the modulation signal is greater than or equal to the frequency value range of the at least one frequency parameter.
根据本公开前述任一实施例的装置,例如,所述运动参数包括运动速度,所述亮度变化参数包括亮度变化速度,所述调制信号确定单元根据所述运动速度或亮度变化速度,确定所述至少一个运动物体或亮度变化物体经过光信号采集装置的一个探测单元的至少一个时间值或所述亮度变化物体的亮度变化点在经过所述探测单元的至少一个时间值;根据所述至少一个时间值确定所述至少一个频率值。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the motion parameter includes a motion speed, the brightness change parameter includes a brightness change speed, and the modulation signal determining unit determines the At least one time value of at least one moving object or brightness-changing object passing through a detection unit of the optical signal acquisition device or at least one time value of the brightness-changing point of the brightness-changing object passing through the detection unit; according to the at least one time value value determines the at least one frequency value.
根据本公开前述任一实施例的装置,例如,所述运动参数还包括加速度,所述亮度变化参数还包括亮度变化加速度,所述调制信号确定单元根据所述运动加速度和所述运动速度,分别确定所述运动物体的多个运动速度;根据所述多个运动速度,分别确定所述运动物体经过光信号采集装置的一个探测单元的多个时间值;或者,所述调制信号确定单元根据亮度变化加速度和亮度变化速度,分别确定所述亮度变化物体的多个亮度变化速度;根据多个亮度变化速度,分别确定所述亮度变化物体的亮度变化点经过光信号采集装置的一个探测单元的多个时间值。According to the device according to any one of the foregoing embodiments of the present disclosure, for example, the motion parameter further includes acceleration, the brightness change parameter further includes brightness change acceleration, and the modulation signal determining unit, according to the motion acceleration and the motion speed, respectively Determine a plurality of moving speeds of the moving object; according to the plurality of moving speeds, respectively determine a plurality of time values of the moving object passing through a detection unit of the optical signal acquisition device; or, the modulation signal determining unit according to the brightness Change acceleration and brightness change speed, respectively determine multiple brightness change speeds of the brightness change object; according to the multiple brightness change speeds, respectively determine multiple brightness change points of the brightness change object passing through a detection unit of the optical signal acquisition device. time value.
根据本公开前述任一实施例的装置,例如,所述信号采集装置包括图像探测器,所述空间光调制器调制后的光信号投射到图像探测器;所述图像探测器对所述调制后的光信号进行采集。According to the device of any of the foregoing embodiments of the present disclosure, for example, the signal acquisition device includes an image detector, and the optical signal modulated by the spatial light modulator is projected to the image detector; optical signal is collected.
根据本公开前述任一实施例的装置,例如,所述空间光调制器包括多个子调制单元,所述图像探测器包括多个子探测单元,一个子调制单元对应一个或多个图像探测器的子探测单元;所述子探测单元对与其对应的所述子调制单元调制后的光信号进行采集。According to the device of any of the foregoing embodiments of the present disclosure, for example, the spatial light modulator includes a plurality of sub-modulation units, the image detector includes a plurality of sub-detection units, and one sub-modulation unit corresponds to one or more sub-units of the image detector A detection unit; the sub-detection unit collects the optical signal modulated by the corresponding sub-modulation unit.
根据本公开前述任一实施例的装置,例如,所述图像探测器在第一时间内对所述编码后的光信号进行采集,所述第一时间与所述图像探测器的性能指标相关。According to the apparatus of any of the foregoing embodiments of the present disclosure, for example, the image detector collects the encoded optical signal within a first time, and the first time is related to a performance index of the image detector.
根据本公开前述任一实施例的装置,例如,还包括,第二光学元件,所述空间光调制器调制后的光信号经过第二光学元件;经过第二光学元件的光信号投射到图像探测器。The device according to any of the foregoing embodiments of the present disclosure, for example, further includes a second optical element, the optical signal modulated by the spatial light modulator passes through the second optical element; the optical signal passing through the second optical element is projected to the image detection device.
根据本公开前述任一实施例的装置,例如,所述信息获得装置进一步被配置为,获取对应来自所述目标场景的光信号的编码信号,根据所述编码信号以及所述采集的数据获得所述目标场景中的信息。According to the device according to any of the foregoing embodiments of the present disclosure, for example, the information obtaining device is further configured to obtain a coded signal corresponding to an optical signal from the target scene, and obtain the obtained data according to the coded signal and the collected data. describe the information in the target scene.
根据本公开前述任一实施例的装置,例如,所述获取对应来自所述目标场景的光信号的编码信号包括:获取所述编码信号中的频率参数作为第一参数;所述根据所述编码信号以及所述采集的数据获得所述目标场景中的信息包括:基于采集的数据,获得第二参数;基于所述第一和第二参数,对所述采集的数据进行第二处理,以获得所述目标场景中的信息。According to the apparatus according to any of the foregoing embodiments of the present disclosure, for example, the acquiring an encoded signal corresponding to the optical signal from the target scene includes: acquiring a frequency parameter in the encoded signal as a first parameter; Obtaining the information in the target scene from the signal and the collected data includes: obtaining a second parameter based on the collected data; and performing a second process on the collected data based on the first and second parameters to obtain information in the target scene.
根据本公开前述任一实施例的装置,例如,所述采集的数据包括多个像素点,每个像素点与进行所述第一处理的空间光调制器的子调制单元相关,所述子调制单元为多个,被分成多个组,所述基于采集的数据,获得第二参数包括:将对应一组子调制单元的多个像素点作为一个像素点组,基于一个或多个像素点组,确定所述第二参数。According to the device of any of the foregoing embodiments of the present disclosure, for example, the collected data includes a plurality of pixel points, each pixel point is related to a sub-modulation unit of the spatial light modulator performing the first processing, the sub-modulation There are multiple units, which are divided into multiple groups. The obtaining the second parameter based on the collected data includes: taking multiple pixel points corresponding to a group of sub-modulation units as a pixel point group, based on one or more pixel point groups , and determine the second parameter.
由于在本公开实施例的信号采集处理方法以及信号采集处理装置中,采集到的图像即为已经处理好的用户希望获得的信息,因此数据量大幅度减少,降低了对信号采集装置性能的要求,大幅度提高了信号采集处理速度。Since in the signal acquisition and processing method and the signal acquisition and processing device according to the embodiments of the present disclosure, the collected image is the information that the user wants to obtain after processing, so the amount of data is greatly reduced, and the performance requirements of the signal acquisition device are lowered. , greatly improving the signal acquisition and processing speed.
附图说明Description of drawings
图1示出了根据本公开实施例的信号采集处理方法流程图。FIG. 1 shows a flowchart of a signal acquisition and processing method according to an embodiment of the present disclosure.
图2示出了根据本公开实施例的信号采集处理装置示意图。FIG. 2 shows a schematic diagram of a signal acquisition and processing apparatus according to an embodiment of the present disclosure.
图3示出了根据本公开实施例的空间光调制器的结构示意图;FIG. 3 shows a schematic structural diagram of a spatial light modulator according to an embodiment of the present disclosure;
图4示出了根据本公开实施例的另一信号采集处理装置示意图;FIG. 4 shows a schematic diagram of another signal acquisition and processing apparatus according to an embodiment of the present disclosure;
图5示出了目标场景与采集到的数据的示意图。Figure 5 shows a schematic diagram of the target scene and the collected data.
图6为根据本公开实施例所示的另一种信号采集处理方法流程图。FIG. 6 is a flowchart of another signal acquisition and processing method according to an embodiment of the present disclosure.
图7示出了根据本公开实施例的第三种信号采集处理装置示意图。FIG. 7 shows a schematic diagram of a third signal acquisition and processing apparatus according to an embodiment of the present disclosure.
图8示出了不同途径获得的图像对比图。Figure 8 shows a comparison of images obtained by different approaches.
图9示出了一个像素点在曝光时间内的时域波形图。Figure 9 shows a time domain waveform diagram of a pixel during exposure time.
具体实施方式Detailed ways
本公开实施例中所描述的目标场景,例如是用户希望对其进行信号处理和采集的场景。场景可以是静止的场景,也可以是运动的场景,也可以是既包括运动物体,又包括静止物体的场景。本公开所说的物体,可以是静止物体,也可以是运动物体。如果是运动物体,包括能够在一段时间内产生位移的物体,也包括在该段时间内不产生位移,但亮度会发生变化的物体,例如霓虹灯。The target scene described in the embodiments of the present disclosure is, for example, a scene for which a user wishes to perform signal processing and acquisition. The scene may be a still scene, a moving scene, or a scene including both moving objects and stationary objects. The object mentioned in the present disclosure can be a stationary object or a moving object. If it is a moving object, it includes objects that can produce displacement within a period of time, and also includes objects that do not produce displacement during this period, but the brightness changes, such as neon lights.
图1示出了根据本公开实施例提供的一种信号采集处理方法,下面将根据图1来描述本公开实施例的信号采集处理方法。参见图1,信号采集处理方法100包括以下步骤S101-S102。FIG. 1 shows a signal acquisition and processing method provided according to an embodiment of the present disclosure. The signal acquisition and processing method of the embodiment of the present disclosure will be described below according to FIG. 1 . Referring to FIG. 1, the signal acquisition and processing method 100 includes the following steps S101-S102.
在S101中,对来自目标场景的光信号进行第一处理。In S101, a first process is performed on the optical signal from the target scene.
在S102中,对经第一处理后的光信号进行采集。In S102, the first processed optical signal is collected.
本公开实施例,首先对来自目标场景的光信号进行处理,然后再采集处理后的光信号。由于采集到的信号是已去除了用户不希望获得的信号,而是已经处理的用户希望获得的信息,比之现有技术的先采集后处理,数据量大幅度减少,信号处理和采集的效率大幅提高。In this embodiment of the present disclosure, the optical signal from the target scene is first processed, and then the processed optical signal is collected. Since the collected signal is the signal that the user does not want to obtain has been removed, but the information that the user wants to obtain has been processed, compared with the prior art, the data volume is greatly reduced, and the efficiency of signal processing and collection is greatly reduced. A substantial increase.
图2示出了根据本公开实施例的信号采集处理装置200示意图。信号采集处理方法100与信号采集处理装置200对应。为了说明书的简洁,将方法与装置同时描述,所有关于方法的实施例和示例与信号采集处理装置一一对应,且相同。下面根据图1、图2分别对上述方法和装置进行进一步描述。FIG. 2 shows a schematic diagram of a signal acquisition and processing apparatus 200 according to an embodiment of the present disclosure. The signal acquisition and processing method 100 corresponds to the signal acquisition and processing apparatus 200 . For the brevity of the description, the method and the device are described at the same time, and all the embodiments and examples related to the method are in one-to-one correspondence with the signal acquisition and processing device, and are the same. The above method and device will be further described below according to FIG. 1 and FIG. 2, respectively.
参见图2,信号采集处理装置200包括信号处理装置210以及信号采集装置220。信号处理装置210对来自目标场景S的光信号进行第一处理。信号采集装置220对经第一处理后的光信号进行采集。信号处理装置210例如是可以对信号进行处理的装置,例如,过滤装置,放大装置,编码装置等。信号采集装置可以是对光信号进行采集的装置,例如成像设备。例如相机、电荷耦合单元、图像探测器、光电探测器等。Referring to FIG. 2 , the signal acquisition and processing apparatus 200 includes a
在S101中,对来自目标场景的光信号进行第一处理。在信号采集出来了装置中,信号处理装置210对来自目标场景S的光信号进行第一处理。In S101, a first process is performed on the optical signal from the target scene. In the signal acquisition device, the
在一个示例中,来自目标场景的光信号例如可以是,从目标场景以反射、折射、透射、衍射等各种方式或这些方式的任意组合,投射出来的光线。第一处理包括对光信号的各种处理方式。例如是对光信号进行过滤、选择、加工以及编码处理等。In one example, the light signal from the target scene may be, for example, light projected from the target scene in various manners such as reflection, refraction, transmission, diffraction, etc., or any combination of these manners. The first processing includes various processing methods for the optical signal. For example, the optical signal is filtered, selected, processed, and encoded.
在一个示例中,第一处理可以对来自目标场景的光信号进行编码处理。例如,首先确定目标场景的编码信号。然后,根据该目标场景的编码信号,对来自目标场景的光信号进行第一处理,例如使用编码信号对来自目标场景的光信号进行编码。在一个示例中,该编码信号也可以是控制光信号的编码信号。例如,通过光学镜片或液晶单元对来自目标场景的光信号进行光路进行控制,和/或对光强等参数的控制。和/或是对不同位置投射的光信号进行标记,加载信息等等。也就是说,第一处理的过程是编码信号对目标场景的光信号的处理,处理后的信号依然是光信号。由于第一处理过程是在光学域执行的,因此其处理速度可能达到光速级别。比之现有技术中使用计算机处理采集后的数据,大幅度提高了处理速度。In one example, the first process may encode an optical signal from the target scene. For example, first determine the encoded signal of the target scene. Then, according to the encoded signal of the target scene, the first processing is performed on the optical signal from the target scene, for example, the optical signal from the target scene is encoded by using the encoded signal. In one example, the encoded signal may also be an encoded signal of the control optical signal. For example, the optical path of the light signal from the target scene is controlled by the optical lens or the liquid crystal unit, and/or the parameters such as light intensity are controlled. And/or marking light signals projected at different locations, loading information, etc. That is to say, the first processing process is the processing of the optical signal of the target scene by the encoded signal, and the processed signal is still the optical signal. Since the first processing is performed in the optical domain, its processing speed may reach the speed of light level. Compared with the prior art using a computer to process the collected data, the processing speed is greatly improved.
经过第一处理后,编码后的光信号包括了编码信号的信息以及来自目标场景的光信号。例如,编码后的光信号可以是编码信号以及来自目标场景的光信号相乘后的积分结果。如果用x(t)表示来自目标场景的光信号,y(t)表示编码信号,那么编码后的光信号s(t)可以表示为s(t)=∫x(t)y(t)dt,其中t为时间参数。After the first processing, the encoded optical signal includes the information of the encoded signal and the optical signal from the target scene. For example, the encoded optical signal may be an integral result of multiplying the encoded signal and the optical signal from the target scene. If x(t) represents the optical signal from the target scene and y(t) represents the encoded signal, then the encoded optical signal s(t) can be expressed as s(t)=∫x(t)y(t)dt , where t is the time parameter.
根据本公开的一个示例,对来自目标场景的光信号进行第一处理的信号处理装置可以包括空间光调制器。空间光调制器是指在主动控制下,能够通过单元器件,包括但不限于微镜装置、液晶单元等,调制光场的某个参量,从而将信息加载到一维或二维光场中,达到光波调制的目的。该参量包括:振幅、相位、偏振态以及非相干-相干光的转换等。本公开实施例使用空间光调制器来调制光信号,可以对不同属性的光信号进行编码,从而在后续信号采集过程中可以有选择地进行采集。According to an example of the present disclosure, the signal processing apparatus that performs the first processing on the optical signal from the target scene may include a spatial light modulator. Spatial light modulator refers to that under active control, a certain parameter of the light field can be modulated through unit devices, including but not limited to micromirror devices, liquid crystal cells, etc., so as to load information into a one-dimensional or two-dimensional light field, To achieve the purpose of light wave modulation. The parameters include: amplitude, phase, polarization state, and incoherent-coherent light conversion. In the embodiment of the present disclosure, the spatial light modulator is used to modulate the optical signal, and the optical signal with different properties can be encoded, so that the acquisition can be selectively performed in the subsequent signal acquisition process.
这样,第一处理可以包括,将来自目标场景的光信号投射到空间光调制器,然后空间光调制器对来自目标场景的光信号进行调制。相应地,编码信号可以是空间光调制器的调制信号。在调制前,首先可以确定空间光调制器的调制信号,然后基于空间光调制器的调制信号对来自目标场景的光信号进行编码调制。例如,信号采集处理装置可以包括一调制信号确定单元,用于确定空间光调制器的调制信号。调制信号确定单元可以是中央处理器,微处理器,计算机,单片机,芯片或芯片组等中的任意一个,可以通过软件、硬件或固件来实现。As such, the first processing may include projecting the light signal from the target scene to a spatial light modulator, which then modulates the light signal from the target scene. Correspondingly, the encoded signal may be the modulation signal of the spatial light modulator. Before modulation, the modulation signal of the spatial light modulator can be determined first, and then the optical signal from the target scene is coded and modulated based on the modulation signal of the spatial light modulator. For example, the signal acquisition and processing apparatus may include a modulation signal determination unit for determining the modulation signal of the spatial light modulator. The modulated signal determination unit may be any one of a central processing unit, a microprocessor, a computer, a single-chip microcomputer, a chip or a chip set, etc., and may be implemented by software, hardware or firmware.
在一个示例中,调制信号可以包括频率参数和相位参数以及振幅等其他参数中的一个或多个。本公开以频率参数和相位参数为示例进行描述。在确定空间光调制器的调制信号时,可以分别确定调制信号的频率参数和相位参数,基于频率参数和相位参数,确定调制信号。调制信号可以利用函数表示,例如余弦函数其中,f表示调制信号中的频率参数,表示调制信号中的相位参数。t表示时间参数,例如在不同时间点上的调制信号。In one example, the modulated signal may include one or more of frequency and phase parameters and other parameters such as amplitude. The present disclosure is described by taking the frequency parameter and the phase parameter as an example. When determining the modulation signal of the spatial light modulator, the frequency parameter and the phase parameter of the modulation signal can be determined respectively, and the modulation signal is determined based on the frequency parameter and the phase parameter. The modulated signal can be represented by a function, such as the cosine function where f represents the frequency parameter in the modulated signal, Represents the phase parameter in the modulated signal. t represents a time parameter, such as the modulated signal at different points in time.
在本公开实施例中,可以以多种方式和途径确定频率参数和相位参数,以确定不同的调制信号,达到不同的调制效果,方便后续对来自目标场景的光信号进行采集。In the embodiment of the present disclosure, the frequency parameter and the phase parameter can be determined in various ways and approaches to determine different modulation signals, achieve different modulation effects, and facilitate subsequent collection of optical signals from the target scene.
在一个示例中,在确定频率参数时,可以首先确定目标场景的复杂度,基于复杂度确定调制信号的频率参数。目标场景的复杂度可以从几个方面来考虑,例如,目标场景中物体的数量,运动物体的数量和/或运动参数,具有不同运动方式的运动物体的数量和/或运动参数等等。运动物体的运动参数,例如速度,加速度,物体的纹理信息,物体尺寸等。根据目标场景的复杂度来确定频率参数,可以对数据量进行适当控制和调整,有效减少不必要的数据量。In one example, when determining the frequency parameter, the complexity of the target scene may be determined first, and the frequency parameter of the modulated signal is determined based on the complexity. The complexity of the target scene can be considered from several aspects, for example, the number of objects in the target scene, the number and/or motion parameters of moving objects, the number and/or motion parameters of moving objects with different motion modes, and so on. The motion parameters of the moving object, such as speed, acceleration, texture information of the object, object size, etc. The frequency parameter is determined according to the complexity of the target scene, and the amount of data can be properly controlled and adjusted to effectively reduce the amount of unnecessary data.
此外,在另一个示例中,还可以首先确定预采集的光信号的属性和/或类型,基于预采集的光信号的属性和/或类型,确定调制信号的频率参数。这里,预采集的光信号可以是用户希望采集到的光信号,去除了用户不希望采集的光信号。预采集的光信号与用户希望从目标场景中获得的信息相关,用户只希望对他所需要的信息对应的光信号进行采集。例如预采集的光信号只包括目标场景中的特定频段的前景信息,而不包括背景信息等。In addition, in another example, the properties and/or types of the pre-collected optical signals may be determined first, and based on the properties and/or types of the pre-collected optical signals, the frequency parameters of the modulated signals are determined. Here, the pre-collected optical signal may be the optical signal that the user wants to collect, and the optical signal that the user does not want to collect is removed. The pre-collected optical signal is related to the information that the user wishes to obtain from the target scene, and the user only wishes to collect the optical signal corresponding to the information he needs. For example, the pre-collected optical signal only includes foreground information of a specific frequency band in the target scene, but does not include background information and the like.
预采集的光信号的属性和/或类型,例如可以包括光信号的亮度、频段,波长,相位以及振幅等属性。例如,预采集的光信号为亮度值较大的光信号,由于在大部分的现实场景中,亮度值较大的光信号的频谱分量集中在低频区域,因此可以设置调制信号的频率参数在低频区域。还例如,预采集的光信号为目标场景中的背景信号,由于背景信息的频谱不存在高频分量,一般只在直流分量处有值,因此可以设置频率参数为0,这样获得的采集数据为背景图像。由于本公开实施例中调制信号可以基于预采集的光信号的参数来确定,因此采集到的数据是用户希望得到的数据,获取的信息时用户希望从目标场景中获得的信息,从而有效减少了不必要的信息的采集,提高了处理和采集效率,也降低了数据量。The properties and/or types of the pre-collected optical signal may include, for example, properties such as brightness, frequency band, wavelength, phase, and amplitude of the optical signal. For example, the pre-collected optical signal is an optical signal with a large brightness value. In most real scenarios, the spectral components of the optical signal with a large brightness value are concentrated in the low-frequency region, so the frequency parameters of the modulated signal can be set in the low-frequency region. area. For another example, the pre-collected optical signal is the background signal in the target scene. Since there is no high-frequency component in the spectrum of the background information, and generally only has a value at the DC component, the frequency parameter can be set to 0, and the collected data obtained in this way is background image. Since the modulation signal in the embodiment of the present disclosure can be determined based on the parameters of the pre-collected optical signal, the collected data is the data that the user wants to obtain, and the obtained information is the information that the user wants to obtain from the target scene, thereby effectively reducing the number of The collection of unnecessary information improves the processing and collection efficiency and reduces the amount of data.
根据本公开的实施例,目标场景中可以包括运动物体。如前所述,运动物体包括移动物体,以及/或者,物体虽然没有移动,但有亮度变化,例如灯的光具有亮度变化等。在一个示例中,当目标场景中包括运动物体时,在确定调制信号的频率参数时还可以根据运动物体的运动参数来确定。例如,高速运动物体的频谱带宽会比低速运动物体的带宽大很多。因此可以根据运动物体的速度,确定频率参数。由于本公开实施例中调制信号可以基于目标场景中的运动物体的运动参数来确定,因此在之后的采集过程中可以对运动物体轨迹进行采集,并获得运动轨迹,而无需如现有技术那样,从采集的图像序列帧中重新进行轨迹检测,有效提高了处理速度。According to an embodiment of the present disclosure, the target scene may include moving objects. As mentioned above, moving objects include moving objects, and/or objects that do not move but have brightness changes, for example, the light of a lamp has brightness changes and the like. In an example, when the target scene includes a moving object, the frequency parameter of the modulation signal may also be determined according to the motion parameter of the moving object when determining the frequency parameter. For example, the spectral bandwidth of a high-speed moving object will be much larger than that of a slow-moving object. Therefore, the frequency parameter can be determined according to the speed of the moving object. Since the modulation signal in the embodiment of the present disclosure can be determined based on the motion parameters of the moving object in the target scene, the trajectory of the moving object can be collected in the subsequent acquisition process, and the motion trajectory can be obtained, without the need to, as in the prior art, The trajectory detection is re-implemented from the acquired image sequence frames, which effectively improves the processing speed.
由于来自目标场景的光信号包括来自场景各个方位的光线,为了对来自目标场景各个方位的光信号进行调制,在本公开实施例中,可以对来自目标场景各个方位的光信号分别设置调制信号并调制,从而可以在后续采集过程中准确采集目标场景中各个方位的信息。图3示出了根据本公开实施例的空间光调制器的结构示意图。参见图3,空间光调制器210包括多个子调制单元211。例如包括几十个,几百个或上千、上万个子调制单元。图3中仅画出16个子调制单元211作为示例,其他子调制单元未画出。这些子调制单元是独立的单元,各个子调制单元在空间上可以排成一维或二维阵列,每个单元可以独立地接收光学或电学等信号的控制,并按照调制信号改变自身的光学性质。在本公开实施例中,来自目标场景的光信号可以投射到空间光调制器的多个子调制单元上,从而实现对照射在该空间光调制器上的各个方位的光波分别进行调制,实现对来自目标场景的光信号的振幅或强度、相位、偏振态、波长以及相干状态等的调制。Since the light signal from the target scene includes light from all directions of the scene, in order to modulate the light signal from all directions of the target scene, in this embodiment of the present disclosure, modulation signals can be set for the light signals from all directions of the target scene respectively and modulation, so that the information of all directions in the target scene can be accurately collected in the subsequent collection process. FIG. 3 shows a schematic structural diagram of a spatial light modulator according to an embodiment of the present disclosure. Referring to FIG. 3 , the spatial
根据本公开的一个实施例,子调制单元可以包括多种光学器件。例如,包括光学镜片,例如反射镜,反射镜以各自中心轴为轴,且以与子调制单元的调制信号对应的参数进行摆动。例如,可以预先设置调制信号对应的参数,例如频率和相位,根据设置好的频率和相位来控制反射镜的摆动频率和相位。根据另一个示例,子调制单元还可以包括液晶单元,液晶单元可以以子调制单元的调制信号对应的频率和相位进行通断,从而对光信号进行调制。According to an embodiment of the present disclosure, the sub-modulation unit may include various optical devices. For example, it includes optical mirrors, such as mirrors, which take their respective central axes as axes and oscillate with parameters corresponding to the modulation signals of the sub-modulation units. For example, parameters corresponding to the modulation signal, such as frequency and phase, can be preset, and the swing frequency and phase of the mirror can be controlled according to the set frequency and phase. According to another example, the sub-modulation unit may further include a liquid crystal unit, and the liquid crystal unit may be turned on and off at the frequency and phase corresponding to the modulation signal of the sub-modulation unit, thereby modulating the optical signal.
在确定空间光调制器的调制信号时,可以分别确定每个空间光调制器的子调制单元的子调制信号。例如,利用调制信号确定单元来确定空间光调制器的子调制单元的子调制信号。这样,在对来自目标场景的光信号进行编码时可以基于子调制单元的子调制信号,对来自目标场景的光信号进行编码调制。When determining the modulation signal of the spatial light modulator, the sub-modulation signal of the sub-modulation unit of each spatial light modulator may be determined separately. For example, the sub-modulation signal of the sub-modulation unit of the spatial light modulator is determined using the modulation signal determination unit. In this way, when the optical signal from the target scene is encoded, the optical signal from the target scene can be encoded and modulated based on the sub-modulation signal of the sub-modulation unit.
同样,子调制信号可以包括频率参数和相位参数等参数。可以分别确定子调制信号的频率参数和相位参数,基于子调制信号的频率参数和相位参数确定子调制信号。Likewise, the sub-modulation signal may include parameters such as frequency parameters and phase parameters. The frequency parameter and the phase parameter of the sub-modulation signal may be determined respectively, and the sub-modulation signal is determined based on the frequency parameter and the phase parameter of the sub-modulation signal.
与前述实施例中确定空间光调制器的调制信号的方法类似或相同,在确定子调制信号时,除了前述所有实施例提到的因素,还可以从下面几个方面的一个或多个进行考虑,来分别确定子调制信号频率参数和相位参数等。Similar to or the same as the method for determining the modulation signal of the spatial light modulator in the foregoing embodiments, when determining the sub-modulation signal, in addition to the factors mentioned in all the foregoing embodiments, one or more of the following aspects may also be considered , to determine the frequency parameters and phase parameters of the sub-modulation signal respectively.
在一个示例中,可以根据信号采集装置的性能参数确定调制信号的频率参数。信号采集装置包括成像装置,例如相机、电荷耦合单元、图像探测器等。信号采集装置的性能参数可以包括分辨率、曝光时间等等。例如,为了将离散傅里叶变换的原理用于数据采集,子调制单元的调制信号的频率可以与第一时间相关。例如,为了对运动场景进行成像,运动场景变换的最小时间一般小于第一时间,那么调制频率值可以设定为第一时间的倒数或小于第一时间的倒数。可选地,调制信号的频率可以是第一时间倒数的整数倍,也可以是非整数倍。第一时间与信号采集装置的性能参数相关。例如,第一时间可以是信号采集装置的曝光时间。In one example, the frequency parameter of the modulated signal may be determined according to the performance parameter of the signal acquisition device. Signal acquisition devices include imaging devices such as cameras, charge-coupled units, image detectors, and the like. The performance parameters of the signal acquisition device may include resolution, exposure time, and the like. For example, in order to use the principles of discrete Fourier transform for data acquisition, the frequency of the modulation signal of the sub-modulation unit may be correlated with the first time. For example, in order to image a moving scene, the minimum time for changing the moving scene is generally less than the first time, so the modulation frequency value can be set to the inverse of the first time or less than the inverse of the first time. Optionally, the frequency of the modulation signal may be an integer multiple of the inverse of the first time, or a non-integral multiple. The first time is related to performance parameters of the signal acquisition device. For example, the first time may be the exposure time of the signal acquisition device.
在一个示例中,在确定子调制信号采用的不同频率值的数量时,可以根据在上述第一时间内成像图像的数量,确定子调制信号采用的不同的频率值的数量。也就是说,不同频率值数量与预成像图像的数量成比例。例如,在压缩采样应用中,当用户希望在第一时间内获得多幅图像时,可以设置多个不同频率,例如4个或大于4个。当用户希望在第一时间内获得较少幅成像图像时,可以设置较少的不同频率,例如3个或小于3个。In one example, when determining the number of different frequency values adopted by the sub-modulation signal, the number of different frequency values adopted by the sub-modulation signal may be determined according to the number of images imaged in the first time. That is, the number of different frequency values is proportional to the number of pre-imaged images. For example, in the compression sampling application, when the user wishes to obtain multiple images in the first time, multiple different frequencies can be set, for example, 4 or more than 4 frequencies. When the user wishes to obtain fewer imaging images in the first time, fewer different frequencies can be set, such as 3 or less than 3.
此外,在一个示例中,由于子调制单元在空间光调制器中的位置不同,因此在一个示例中,在确定子调制信号的频率参数时,还可以首先确定子调制单元在空间光调制器中的位置,基于位置确定子调制单元的频率和/或相位。参见图3,空间光调制器210中的多个子调制单元211以X1-X16进行区分,它们分布在空间光调制器210的不同位置。In addition, in one example, since the positions of the sub-modulation units in the spatial light modulator are different, in one example, when determining the frequency parameter of the sub-modulation signal, it is also possible to first determine that the sub-modulation units are in the spatial light modulator position, the frequency and/or phase of the sub-modulation unit is determined based on the position. Referring to FIG. 3 , a plurality of
在一个示例中,空间光调制器中的所有子调制单元中的每个子调制单元的调制信号均采用相同的频率,相位可以有不同。例如包括X1-X16在内的所有子调制信号的频率相同。包括X1-X16在内的所有子调制信号中至少两个的相位不同。In one example, the modulation signal of each sub-modulation unit in all the sub-modulation units in the spatial light modulator adopts the same frequency and may have different phases. For example, all sub-modulation signals including X1-X16 have the same frequency. At least two of all sub-modulation signals including X1-X16 are different in phase.
在一个示例中,空间光调制器中的多个子调制单元中至少两个子调制单元采用不同的频率。In one example, at least two of the plurality of sub-modulation units in the spatial light modulator employ different frequencies.
例如,可以将空间光调制器的多个子调制单元分成多个组,每组子调制单元中的所有子调制单元在空间光调制器中的空间位置邻近,每组包括至少两个子调制单元。例如每组包括2个子调制单元,3个子调制单元,4个子调制单元,9个子调制单元,16个子调制单元等等。然后根据每组组别、该组在空间光调制器中的位置以及每个子调制单元在该组中的位置等信息中的一个或任意多个因素,来确定该组子调制单元中每个子调制单元的调制信号的频率和相位。例如,每组子调制信号的频率值相同,每组子调制信号的频率值与邻近的其他组子调制单元的频率值不同。此外,每组子调制信号的相位值可以不同。以图3中的16个子调制单元X1-X16作为示例,参见图3,16个子调制单元X1-X16可以分成四个组,即X1-X4,X5-X8,X9-X12,X13-X16。X1-X4可以使用相同频率f1,使用不同相位0,π,π/2,3π/2。X5-X8可以使用相同频率f2,使用不同相位0,π,π/2,3π/2。X9-X12可以使用相同频率f3,使用不同相位0,π,π/2,3π/2。X13-X16使用相同频率f4,使用不同相位0,π,π/2,3π/2。f1,f2,f3和f4彼此不相同。For example, a plurality of sub-modulation units of the spatial light modulator may be divided into a plurality of groups, all sub-modulation units in each group of sub-modulation units are located adjacent to each other in the spatial light modulator, and each group includes at least two sub-modulation units. For example, each group includes 2 sub-modulation units, 3 sub-modulation units, 4 sub-modulation units, 9 sub-modulation units, 16 sub-modulation units and so on. Then, each sub-modulation unit in the group of sub-modulation units is determined according to one or more factors of information such as the group of each group, the position of the group in the spatial light modulator, and the position of each sub-modulation unit in the group. The frequency and phase of the cell's modulating signal. For example, the frequency values of each group of sub-modulation signals are the same, and the frequency values of each group of sub-modulation signals are different from the frequency values of other adjacent groups of sub-modulation units. In addition, the phase values of each group of sub-modulation signals may be different. Taking the 16 sub-modulation units X1-X16 in FIG. 3 as an example, referring to FIG. 3, the 16 sub-modulation units X1-X16 can be divided into four groups, namely X1-X4, X5-X8, X9-X12, X13-X16. X1-X4 can use the same frequency f1 and use different phases 0, π, π/2, 3π/2. X5-X8 can use the same frequency f2 and use different phases 0, π, π/2, 3π/2. X9-X12 can use the same frequency f3 and use different phases 0, π, π/2, 3π/2. X13-X16 use the same frequency f4 and use different phases 0, π, π/2, 3π/2. f1, f2, f3 and f4 are different from each other.
当然,根据用户想要从目标场景中获取的信息不同,也可以设置每组子调制信号的频率值与邻近的其他组子调制单元的子调制信号的频率值相同,每组子调制信号的相位不同。或者每组子调制信号的频率值也不同,等等。Of course, according to the different information the user wants to obtain from the target scene, the frequency value of each group of sub-modulation signals can also be set to be the same as the frequency values of the sub-modulation signals of other adjacent groups of sub-modulation units, and the phase of each group of sub-modulation signals different. Or the frequency values of each group of sub-modulation signals are also different, and so on.
在一个示例中,预先确定用户要从所述目标场景中获得的信息,或者预采集的光信号的类型,基于用户希望从所述目标场景中获得的信息,或预采集的光信号的参数,确定所述子调制单元的子调制信号的频率参数中的频率数量和/或频率数值。这里,用户要从所述目标场景中获得的信息与用户预采集的光信号可以是相关的。In one example, the information that the user wants to obtain from the target scene, or the type of the pre-collected optical signal, is pre-determined, based on the information that the user wants to obtain from the target scene, or the parameters of the pre-collected optical signal, Determine the frequency quantity and/or frequency value in the frequency parameter of the sub-modulation signal of the sub-modulation unit. Here, the information to be obtained by the user from the target scene may be related to the optical signal pre-collected by the user.
例如,当用户通过对一运动的目标场景进行处理和采集,希望对运动场景进行压缩采样,希望得到连续变化的自然图像序列。也就是说,采集到的关于目标场景的每个像素点的强度值为一段连续变化的时域波形。该时域波形在频域为稀疏的,只有少数部分频谱分量有较大非零值,而大部分频谱分量为接近于零的较小值。为了对目标场景进行压缩采样,在信号处理中可以舍弃这些较小值实现压缩采样。为了舍弃这些亮度值较小的频谱分量,也就是说为了在后续采集过程中只采集到亮度值为较大值的频谱分量,由于在大部分的现实场景中,亮度值较大的点对应的频谱分量集中在低频区域,因此,在一个示例中,可以从低频区域中选择部分频率作为调制信号的频率参数,对来自目标场景的光信号进行调制,就可以仅采集低频区域的频谱,实现压缩采样。For example, when a user processes and collects a moving target scene, he wishes to compress and sample the moving scene, and he wishes to obtain a continuously changing natural image sequence. That is to say, the acquired intensity value of each pixel point of the target scene is a continuously changing time domain waveform. The time domain waveform is sparse in the frequency domain, only a few spectral components have large non-zero values, while most spectral components have small values close to zero. In order to perform compressive sampling on the target scene, these smaller values can be discarded in signal processing to achieve compressive sampling. In order to discard these spectral components with small brightness values, that is to say, in order to collect only spectral components with large brightness values in the subsequent acquisition process, because in most real scenes, the points with large brightness values correspond to Spectral components are concentrated in the low-frequency region. Therefore, in an example, some frequencies can be selected from the low-frequency region as the frequency parameters of the modulating signal, and the optical signal from the target scene can be modulated, so that only the spectrum in the low-frequency region can be collected to achieve compression. sampling.
在一个示例中,压缩采样所采用的调制信号所用频率的频率数值可以从0开始逐渐向上增加。其频率间隔,即增加步长,可以是第一时间的倒数,或小于该倒数。另外,所有相邻频率之间的间隔是可以是相同的。其中第一时间例如可以是作为信号采集装置的相机、图像探测器等的曝光时间。In one example, the frequency value of the frequency used by the modulation signal used for the compressed sampling may start from 0 and gradually increase upward. Its frequency interval, that is, the increment step size, may be the reciprocal of the first time, or less than the reciprocal. Additionally, the spacing between all adjacent frequencies may be the same. The first time may be, for example, the exposure time of a camera, an image detector, etc. as a signal acquisition device.
此外,在一个示例中,可以基于在第一时间内成像图像的数量,确定频率数量,第一时间与信号采集装置的曝光时间相关或相同。例如,在进行利用本公开的信号采集处理方法进行对目标场景近压缩采样时,调制信号所用频率的数量可以根据用户进行信号压缩采样的压缩比例进行设置。所使用的频率数量决定了视频信号的压缩比例。使用的频率数量越少,信号压缩比例就越大,相应地,成像图像越少。使用的频率数量越多,视频信号压缩比例就越小,成像图像越多。另外,还可以结合目标场景的复杂度、目标场景中运动物体数量,运动方式,运动参数等,选用不同数量的频率,可以实现较好的压缩采样的压缩比权衡。Furthermore, in one example, the number of frequencies may be determined based on the number of images imaged in a first time that is related to or the same as the exposure time of the signal acquisition device. For example, when using the signal acquisition and processing method of the present disclosure to perform near-compressed sampling of the target scene, the number of frequencies used for modulating the signal may be set according to the compression ratio of the signal compression sampling performed by the user. The number of frequencies used determines the compression ratio of the video signal. The smaller the number of frequencies used, the greater the signal compression ratio and the correspondingly fewer images are imaged. The higher the number of frequencies used, the lower the compression ratio of the video signal and the more images are imaged. In addition, different numbers of frequencies can be selected in combination with the complexity of the target scene, the number of moving objects in the target scene, the motion mode, and the motion parameters, which can achieve a better compression ratio trade-off for compressed sampling.
还例如,用户通过对目标场景进行处理和采集,希望获得目标场景中的运动物体的运动轨迹。作为光信号采集装置的图像探测器,包括多个探测单元,每个探测单元对应采集到数据的一个像素点。由于物体在空间中运动时,运动物体出现时,在图像探测器的某个探测单元的像素点的亮度值会发生变化,其表现为,在与该像素点对应的横轴为时间、纵轴为像素亮度值的时域波形上,产生一个脉冲信号。而根据运动物体在不同的像素点出现的时刻不同,这些像素点时域波形上脉冲信号出现的时刻不同,对应频域为相位不同。因此,这种情况下,所有子调制信号的相位可以有不同。例如,为了避免相位缠绕,在一次曝光时间内,调制信号的频率的相位变化范围在0-2π范围内,不同的时刻与不同的相位一一对应。此外,可以设置所有子调制信号的频率相同,例如,频率也可以等于或小于曝光时间的倒数。也可以设置每组子调制信号的频率相同,各组之间有不同。这样,就可以在步骤S102中只采集到运动轨迹,以及运动轨迹在不同时间点处的相位分布,而不会采集到其他信息。For another example, by processing and collecting the target scene, the user wishes to obtain the motion trajectory of the moving object in the target scene. An image detector as an optical signal acquisition device includes a plurality of detection units, each detection unit corresponds to a pixel point of the collected data. When the object moves in space, when the moving object appears, the brightness value of the pixel point of a certain detection unit of the image detector will change, which is shown as the horizontal axis corresponding to the pixel point is time, vertical axis A pulse signal is generated on the time domain waveform of the pixel brightness value. According to the different times when the moving object appears at different pixel points, the times when the pulse signals appear on the time domain waveform of these pixel points are different, and the corresponding frequency domain is different in phase. Therefore, in this case, the phases of all sub-modulated signals can be different. For example, in order to avoid phase entanglement, in one exposure time, the phase variation range of the frequency of the modulation signal is in the range of 0-2π, and different moments correspond to different phases one-to-one. In addition, the frequency of all sub-modulation signals can be set to be the same, for example, the frequency can also be equal to or less than the reciprocal of the exposure time. You can also set the frequency of each group of sub-modulation signals to be the same, and there are differences between groups. In this way, only the motion trajectory and the phase distribution of the motion trajectory at different time points can be collected in step S102, without collecting other information.
由于设置了调制信号的频率和相位参数在某个值或某个范围内取值,可以从采集数据中直接获得目标场景中的运动轨迹信息,而无需像现有技术那样,对目标场景进行成像来获取多个图像序列,在图像序列中提取运动轨迹,极大地提高了轨迹检测的处理速度和处理效率。Since the frequency and phase parameters of the modulated signal are set to take values within a certain value or a certain range, the motion trajectory information in the target scene can be directly obtained from the collected data without imaging the target scene as in the prior art. It can obtain multiple image sequences and extract motion trajectories from the image sequences, which greatly improves the processing speed and processing efficiency of trajectory detection.
还例如,根据用户想要从目标场景中获得的信息,可以设置子调制信号的数值包括0或不包括0。例如,用户想要采集的光信号是目标场景中的背景信号时,由于背景信息的频谱不存在高频分量,只在直流分量处有值,因此可以设置频率参数为0,这样获得的采集数据为背景图像。当用户想要采集的光信号是去除背景信号之后的前景信息。同样,也可以设置频率参数为不是0的频率,这样获得的采集数据为去除了背景信息的信息。如果用户希望从目标场景中获得的信息可以包括背景信息,那么子调制信号的频率参数可以包括0。Also for example, according to the information the user wants to obtain from the target scene, the value of the sub-modulation signal can be set to include 0 or not include 0. For example, when the optical signal the user wants to collect is the background signal in the target scene, since the spectrum of the background information does not have high-frequency components and only has a value at the DC component, the frequency parameter can be set to 0, and the collected data obtained in this way as the background image. When the light signal the user wants to collect is the foreground information after removing the background signal. Similarly, the frequency parameter can also be set to a frequency other than 0, and the acquired data obtained in this way are information from which background information has been removed. If the information that the user wishes to obtain from the target scene may include background information, the frequency parameter of the sub-modulation signal may include 0.
还例如,当目标场景中包括运动物体(包括亮度变化物体),确定子调制信号的频率参数时,除了与前面实施例中确定调制信号的示例中提及的因素,还可以确定目标场景中运动物体的运动参数,基于运动参数或运动参数与前述实施例提及的一种或多种因素的组合,分别确定子调制单元的子调制信号的频率参数,例如频率数量和/或频率数值。所有子调制信号的频率参数可以相同,也可以不同,也可以部分频率参数相同,部分频率参数不同。在一个示例中,用户希望对目标场景中特定目标进行目标识别。由于不同的纹理、不同运动速度的目标的时域波形往往差异很大,导致其频谱差异也很大。频谱分布是多个运动物体的各种参数共同作用的结果。变化的物理量会导致频谱构成发生变化。例如原本强度较弱的频率分量处的强度激增。因此,调制信号采用这些频率值作为频率参数可实现该特定运动目标检测。为了避免识别误差,还可以将调制信号的频率值进行适当调整,例如可以是包括上述频率值的一个频率范围。Also, for example, when the target scene includes moving objects (including brightness-changing objects), when the frequency parameter of the sub-modulation signal is determined, in addition to the factors mentioned in the example of determining the modulation signal in the previous embodiment, the motion in the target scene can also be determined. The motion parameter of the object, based on the motion parameter or a combination of the motion parameter and one or more factors mentioned in the foregoing embodiments, respectively determines the frequency parameter of the sub-modulation signal of the sub-modulation unit, such as frequency quantity and/or frequency value. The frequency parameters of all the sub-modulation signals may be the same or different, and some frequency parameters may be the same and some frequency parameters may be different. In one example, the user wishes to perform target recognition on a specific target in the target scene. Since the time-domain waveforms of targets with different textures and moving speeds are often very different, the frequency spectrum is also very different. The spectral distribution is the result of the joint action of various parameters of multiple moving objects. A changing physical quantity results in a change in the spectral composition. For example, there is a surge in intensity at a frequency component that is otherwise weak. Therefore, the modulated signal adopts these frequency values as frequency parameters to realize the detection of the specific moving object. In order to avoid identification errors, the frequency value of the modulated signal can also be adjusted appropriately, for example, it can be a frequency range including the above frequency value.
在一个示例中,运动物体的运动参数包括运动速度。亮度变化物体的亮度变化参数包括亮度变化速度。这样,在根据运动参数确定频率值时,可以根据运动速度或亮度变化速度,确定运动物体经过光信号采集装置,例如图像探测器,的一个探测单元的时间值,然后根据时间值确定频率值。上述时间值可以是一个时间值,也可以是多个时间值。同样上述频率值与时间值对应,可以是一个频率值,也可以是多个频率值,构成一个频率分布。频率值与时间值相关,例如,频率值例如为时间值的倒数或小于该倒数。如果运动参数还包括运动加速度,或者亮度变化参数还包括变化加速度,还可以根据加速度和最初运动速度,确定运动物体在不同时刻的不同速度。In one example, the motion parameters of the moving object include motion speed. The brightness change parameter of the brightness change object includes the brightness change speed. In this way, when the frequency value is determined according to the motion parameter, the time value of the moving object passing through a detection unit of the optical signal acquisition device, such as an image detector, can be determined according to the motion speed or the brightness change speed, and then the frequency value is determined according to the time value. The above-mentioned time value may be one time value, or may be multiple time values. Likewise, the above-mentioned frequency value corresponds to the time value, and may be one frequency value or multiple frequency values to form a frequency distribution. The frequency value is related to the time value, eg, the frequency value is, for example, the reciprocal of the time value or less. If the motion parameter also includes motion acceleration, or the brightness change parameter also includes change acceleration, different speeds of the moving object at different times can also be determined according to the acceleration and the initial motion speed.
根据获得的多个速度,确定运动物体经过光信号采集装置的一个探测单元的多个时间值。同样,对于亮度变化物体,可以根据亮度变化加速度和最初变化速度,确定亮度变化物体的多个亮度变化速度,根据多个亮度变化速度,确定亮度变化物体经过光信号采集装置的一个探测单元的多个时间值。从而根据时间值确定频率值。例如频率值为时间值的倒数。According to the obtained multiple speeds, multiple time values of the moving object passing through a detection unit of the optical signal acquisition device are determined. Similarly, for a brightness-changing object, multiple brightness-changing speeds of the brightness-changing object can be determined according to the brightness-changing acceleration and initial changing speed, and multiple brightness-changing speeds of the brightness-changing object passing through a detection unit of the optical signal acquisition device can be determined according to the multiple brightness changing speeds. time value. The frequency value is thus determined from the time value. For example, the frequency value is the inverse of the time value.
此外,根据本公开实施例,对于子调制信号的相位参数的确定,可以与频率和/或子调制单元组相关。例如,根据前述实施例中提及的分组后的子调制单元,可以设置一组子调制单元的调制信号具有不同的相位值。为了避免出现相位缠绕问题,子调制单元的调制信号的相位分布为可以在0-2π范围内的多个不同相位,例如3个、4个或大于4个。在图像探测器的一次曝光时间内,对应图像探测器的一个探测单元,相位分布为0-2π,可以避免出现相位缠绕问题,这样运动物体出现的时刻便与频域的相位一一对应,不会出现歧义值。In addition, according to the embodiment of the present disclosure, the determination of the phase parameter of the sub-modulation signal may be related to the frequency and/or the sub-modulation unit group. For example, according to the grouped sub-modulation units mentioned in the foregoing embodiments, modulation signals of a group of sub-modulation units may be set to have different phase values. In order to avoid the phase winding problem, the phase distribution of the modulation signals of the sub-modulation units is a plurality of different phases, such as 3, 4 or more than 4, which can be in the range of 0-2π. During one exposure time of the image detector, the phase distribution corresponding to a detection unit of the image detector is 0-2π, which can avoid the problem of phase winding, so that the moment when the moving object appears corresponds to the phase in the frequency domain one by one. Ambiguous values will appear.
图4示出了根据本公开实施例的另一信号采集处理装置示意图,为了将来自目标场景的光信号更准确地投射到空间光调制器上,参见图4,在一个实施例中,该信号采集处理装置400除了包括前述所有实施例中的信号处理装置,例如空间光调制器410,以及信号采集装置,例如图像探测器420之外,还可以包括第一光学元件430。那么,可以将来自目标场景S的光信号经过第一光学元件430后,投射到空间光调制器410上,空间光调制器410对经第一光学元件430后投射到其上的光信号进行接收调制。第一光学元件可以是一个光学元件,也可以是一组光学元件。例如可以包括透镜、透镜组、棱镜、反射镜、光纤等中的一个或多个用于传送光路或成像的器件。在一个示例中,第一光学元件430可以将来自目标场景S的光信号投射到空间光调制器410上,还可以在空间光调制器410上成像。第一光学元件可以调整光路,使得来自目标场景的光信号更准确地投射到空间光调制器上。FIG. 4 shows a schematic diagram of another signal acquisition and processing apparatus according to an embodiment of the present disclosure. In order to project the light signal from the target scene onto the spatial light modulator more accurately, referring to FIG. 4 , in one embodiment, the signal The acquisition and processing device 400 may include a first
以上介绍了根据本公开实施,对来自目标场景的光信号进行第一处理的方式方法,下面进一步介绍对第一处理后的光信号进行采集的方法。The method and method for performing the first processing on the optical signal from the target scene according to the implementation of the present disclosure are described above, and the method for collecting the first processed optical signal is further described below.
在S102中,对经第一处理后的光信号进行采集。在信号采集处理装置中,信号采集装置对经第一处理后的光信号进行采集。In S102, the first processed optical signal is collected. In the signal collection and processing device, the signal collection device collects the first processed optical signal.
参见图4的信号采集处理装置400。信号采集处理装置400中,信号采集装置可以是图像探测器420或电荷耦合单元(CCD),相机等能够形成像素点阵的装置。当信号处理装置为空间光调制器410时,那么,步骤S102中,对经第一处理后的光信号进行采集包括:将空间光调制器410调制后的光信号投射到图像探测器420,然后图像探测器420对调制后的光信号进行采集。Refer to the signal acquisition and processing device 400 in FIG. 4 . In the signal acquisition and processing device 400, the signal acquisition device may be an
信号采集装置采集到的数据可以是一维或二维像素点阵,例如图像探测器上所有子探测单元将接收到的调制后的光信号转换成电信号,形成的像素点阵。每个像素点具有各自的像素值,包括亮度值和色度值以及其他信息。每个像素点包含了调制后光信号在某位置、某频率、某相位的信息或者是多种信息的组合信息。图5示出了目标场景与采集到的数据的示意图。参见图5,左侧图为目标场景,中间图为采集数据的像素点阵列,右侧图为像素点阵中的部分点阵的放大图Y1-Y16作为示例。这些采集到的像素值点可以直接利用,作为来自目标场景的信息,也可以在后续做进一步处理来获取更多来自目标场景的信息。The data collected by the signal collection device may be a one-dimensional or two-dimensional pixel lattice, for example, a pixel lattice formed by all sub-detection units on the image detector converting the received modulated optical signals into electrical signals. Each pixel has its own pixel value, including luminance and chrominance values and other information. Each pixel contains the information of a certain position, a certain frequency, a certain phase of the modulated optical signal, or a combination of various kinds of information. Figure 5 shows a schematic diagram of the target scene and the collected data. Referring to FIG. 5 , the picture on the left is the target scene, the picture in the middle is the pixel array of the collected data, and the picture on the right is the enlarged view Y1-Y16 of a part of the pixel lattice as an example. These collected pixel value points can be directly used as the information from the target scene, or can be further processed in the follow-up to obtain more information from the target scene.
在本公开中以图像探测器为例进行描述。其他信号采集装置以相同或类似方式进行工作。In this disclosure, an image detector is used as an example for description. Other signal acquisition devices work in the same or similar manner.
图像探测器可以包括多个探测单元,在本公开实施例中,每个探测单元对应空间光调制器的子调制单元的一个或多个。也就是说,一个子调制单元或多个子调制单元的调制后的光信号被图像探测单元的一个子探测器探测。当然,也可以是一个或多个子探测单元对应空间光调制器的一个子调制单元。即二者是多对一或一对多的关系。图像探测器的子探测单元对与其对应的子调制单元调制后的光信号进行采集。图像探测器采集到的图像中每一个子探测单元对应像素点包含了调制后光信号在某位置、某频率、某相位的信息或者是多种信息的组合信息。每个子探测单元对应一个像素点。参见图5中间图,采集的数据包括多个像素点,Y1-Y16表示多个像素点中的16个像素点,每个像素点可以对应空间光调制器的一个子调制单元,例如,图5中的Y1-Y16分别对应图3中的X1-X16。The image detector may include a plurality of detection units, and in the embodiment of the present disclosure, each detection unit corresponds to one or more of the sub-modulation units of the spatial light modulator. That is, the modulated optical signal of one sub-modulation unit or a plurality of sub-modulation units is detected by one sub-detector of the image detection unit. Of course, one or more sub-detection units may also correspond to one sub-modulation unit of the spatial light modulator. That is, the relationship between the two is many-to-one or one-to-many. The sub-detection unit of the image detector collects the optical signal modulated by the corresponding sub-modulation unit. In the image collected by the image detector, the corresponding pixel point of each sub-detection unit contains the information of the modulated optical signal at a certain position, a certain frequency, a certain phase, or a combination of various kinds of information. Each sub-detection unit corresponds to a pixel. Referring to the middle diagram of Fig. 5, the collected data includes multiple pixels, Y1-Y16 represent 16 pixels among the multiple pixels, and each pixel may correspond to a sub-modulation unit of the spatial light modulator, for example, Fig. 5 Y1-Y16 in Figure 3 correspond to X1-X16 in Figure 3, respectively.
在一个示例中,采集过程可以限制在一定时间内,例如,在第一时间内,对编码后的光信号进行采集,第一时间与图像探测器的性能相关。例如是图像探测器的曝光时间。即采集过程是在曝光时间内完成的。In one example, the acquisition process may be limited to a certain time, eg, the encoded optical signal is acquired for a first time, the first time being related to the performance of the image detector. An example is the exposure time of the image detector. That is, the acquisition process is completed within the exposure time.
为了将调制后的光信号全部精准投射到图像探测器上。参见图4,在一个示例中,空间光调制410与图像探测器420之间可以设置第二光学元件440。同样,第二光学元件440也可以是一个元件或元件组合。例如可以是包括透镜、透镜组、平面镜、反光镜、光纤等光学元件中的一个或多个。这样,空间光调制器410的调制后的光信号可以首先经过第二光学元件440,进一步投射到图像探测器420上进行采集。这样可以将调制后的光信号更准确的聚集在图像探测器上。In order to accurately project the modulated optical signal onto the image detector. Referring to FIG. 4 , in one example, a second
本公开实施例,由于先对目标场景光信号进行处理后再进行采集,因此采集到的图像即为用户需要获得的信息,因此数据量大幅度减少。同时,采集到的信息包含了比直接对目标场景进行成像得到的信息更多的有用信息,它将目标场景在多个频域的信息进行了记录,避免了采集装置低性能缺陷导致的信息缺失,降低了对采集装置性能的要求,例如相机帧率、传输链路带宽、存储空间等。此外,由于处理过程是在光学域执行的,因此算法的速度可达到光速级别。In the embodiment of the present disclosure, since the light signal of the target scene is processed first and then collected, the collected image is the information that the user needs to obtain, so the amount of data is greatly reduced. At the same time, the collected information contains more useful information than the information obtained by directly imaging the target scene. It records the information of the target scene in multiple frequency domains, avoiding the information loss caused by the low performance defect of the collection device. , reducing the performance requirements of the acquisition device, such as camera frame rate, transmission link bandwidth, storage space, etc. In addition, because the processing is performed in the optical domain, the algorithm can reach the speed of light.
以上介绍了根据本公开上述实施例的信号采集处理方法和装置,下面将进一步介绍根据本公开另一实施例的信号采集处理方法和装置。The signal acquisition and processing method and apparatus according to the above embodiments of the present disclosure have been described above, and the signal acquisition and processing method and apparatus according to another embodiment of the present disclosure will be further described below.
图6示出了根据本公开实施例的另一种信号采集处理方法。参见图6,在前述所有实施例和示例的基础上,该信号采集处理方法还包括步骤S103,在S103中,基于采集的数据获得所述目标场景中的信息。也就是说,在图6所示的信号采集处理方法中,在S101中,对来自目标场景的光信号进行第一处理。在S102中,对经第一处理后的光信号进行采集。在S103中,基于采集的数据获得所述目标场景中的信息。FIG. 6 shows another signal acquisition and processing method according to an embodiment of the present disclosure. Referring to FIG. 6 , on the basis of all the foregoing embodiments and examples, the signal acquisition and processing method further includes step S103 , in which information in the target scene is obtained based on the acquired data. That is, in the signal acquisition and processing method shown in FIG. 6 , in S101 , the first processing is performed on the optical signal from the target scene. In S102, the first processed optical signal is collected. In S103, information in the target scene is obtained based on the collected data.
图7示出了根据本公开实施例的第三种信号采集处理装置示意图。图6的信号采集处理方法600与图7所示的信号采集处理装置700对应。参见图7,信号采集处理装置700中,包括,信号处理装置710,例如空间光调制器,信号采集装置720,例如图像探测器,以及信息获得装置730。信息获得装置730例如可以是计算机、微处理器,中央处理单元等,其可以以软件、硬件以及固件三种实现方式中任意一种来实现。FIG. 7 shows a schematic diagram of a third signal acquisition and processing apparatus according to an embodiment of the present disclosure. The signal acquisition and processing method 600 in FIG. 6 corresponds to the signal acquisition and processing apparatus 700 shown in FIG. 7 . Referring to FIG. 7 , the signal acquisition and processing device 700 includes a
那么,图6所示的信号采集处理方法例如可以是,信号处理装置710对来自目标场景S的光信号进行第一处理,信号采集装置720对经第一处理后的光信号进行采集,信息获得装置730基于采集的数据获得所述目标场景中的信息。Then, the signal acquisition and processing method shown in FIG. 6 may be, for example, the
也就是说,在对处理后的光信号进行采集之后,还基于采集的数据获得目标场景中的信息。获得的目标场景中的信息例如可以包括,整个目标场景的成像图像、部分目标场景的图像、其中一个或多个物体的图像、某个时间点的图像、经过其他处理后的目标场景图像,物体运动轨迹、某个点或多个点信息,背景信息、前景信息等等。That is to say, after the processed optical signal is collected, information in the target scene is also obtained based on the collected data. The obtained information in the target scene may include, for example, an imaging image of the entire target scene, an image of a part of the target scene, an image of one or more objects, an image at a certain point in time, an image of the target scene after other processing, and an image of an object. Motion trajectory, information of a certain point or multiple points, background information, foreground information, etc.
在一个示例中,对采集的数据进行第二处理,以获得所述目标场景中的信息,将所述获得的信息形成图像。图像包括一张图像或多张图像,例如图片和视频序列。此外,目标场景中的信息也可以其他方式显示。例如,波形,像素值分布等形式。In one example, a second process is performed on the collected data to obtain information in the target scene, and the obtained information is formed into an image. Images include one image or multiple images, such as pictures and video sequences. In addition, the information in the target scene can also be displayed in other ways. For example, the form of waveform, pixel value distribution, etc.
在前述实施例中可以知道,在步骤S102中采集到的数据为,图像探测器上所有子探测单元将接收到的光信号转换成电信号,形成的像素点,每个像素点具有各自的像素值,即亮度值和/或色度值等。每个像素点包含了调制后光信号在某位置、某频率、某相位的信息或者是这些信息的组合信息。It can be known from the foregoing embodiments that the data collected in step S102 is that all sub-detection units on the image detector convert the received optical signals into electrical signals, and form pixels, each of which has its own pixel. value, i.e. luminance value and/or chrominance value, etc. Each pixel contains the information of a certain position, a certain frequency, a certain phase of the modulated optical signal or a combination of these information.
由于图像探测器采集调制后的光信号的过程是在一个时间段内完成的,例如在图像探测器的曝光时间内完成的,而不同的图像探测器具有不同的曝光时间T,例如T=0.01秒。而上述每个像素点包含了调制后的光信号在曝光时间段内的多个时间点的多个信息的组合。由于之前对来自目标场景的光信号进行了调制,因此本公开实施例可以从采集到的组合信息中恢复曝光时间内某个时间点的目标场景的信息。Since the process of acquiring the modulated optical signal by the image detector is completed within a period of time, for example, within the exposure time of the image detector, different image detectors have different exposure times T, such as T=0.01 second. Each of the above-mentioned pixel points includes a combination of multiple pieces of information of the modulated optical signal at multiple time points within the exposure time period. Since the optical signal from the target scene is modulated before, the embodiment of the present disclosure can recover the information of the target scene at a certain time point in the exposure time from the collected combined information.
图8示出了不同途径获得的图像对比图。即,图像探测器在曝光时间内的成像图像以及通过本公开实施例恢复的在某个时间点的成像图像的对比图。参见图8,左侧上方图像,即图8-1为目标场景,左侧下方图像,即图8-2为图像探测器在曝光时间内的成像图像,右侧3个图像,即图8-3,图8-4,图8-5为通过本公开实施例恢复的在曝光时间内的三个不同时间点t=6ms,t=60ms,t=100ms的成像图像。可以明显看出,通过本公开实施例恢复的图像比图像探测器正常拍照获得的图像更清晰,能够获得图像的细节信息。Figure 8 shows a comparison of images obtained by different approaches. That is, a contrast map of the imaged image of the image detector during the exposure time and the imaged image at a certain point in time recovered by an embodiment of the present disclosure. Referring to Figure 8, the upper left image, that is, Figure 8-1, is the target scene, the lower left image, that is, Figure 8-2, is the imaging image of the image detector during the exposure time, and the 3 images on the right, that is, Figure 8- 3, Figures 8-4, and Figures 8-5 are imaging images of three different time points t=6ms, t=60ms, and t=100ms in the exposure time recovered by the embodiment of the present disclosure. It can be clearly seen that the image recovered by the embodiment of the present disclosure is clearer than the image obtained by the normal photographing of the image detector, and the detailed information of the image can be obtained.
在一个示例中,分别获取采集数据中每个像素点在曝光时间内时域波形图,从而获得目标场景中的信息。以下以一个像素点为例进行说明。图9示出了一个像素点在曝光时间内的时域波形图。像素点的时域波形图是随机的,例如可以是正弦波形,余弦波形或其他波形等等。图9的波形图仅仅为示意图,其中横坐标表示时间参数t,其取值范围为0-T,T为图像探测器的曝光时间;纵坐标表示该像素点在不同时刻的像素值,例如亮度值。由于目标场景中可能包括运动物体或亮度变化物体,例如人拍照时眨眼睛,或汽车快速行驶场景,因此每个时间点同一个像素点的亮度值可能是不同的,通过该时域波形图可以得到曝光时间内一个像素点的亮度值变化情况。In one example, a time-domain waveform diagram of each pixel in the acquired data during the exposure time is obtained separately, so as to obtain information in the target scene. The following description takes one pixel as an example. Figure 9 shows a time domain waveform diagram of a pixel during exposure time. The time domain waveform diagram of the pixel point is random, for example, it can be a sine waveform, a cosine waveform or other waveforms and so on. The waveform diagram in FIG. 9 is only a schematic diagram, wherein the abscissa represents the time parameter t, whose value range is 0-T, and T is the exposure time of the image detector; the ordinate represents the pixel value of the pixel at different times, such as brightness value. Since the target scene may include moving objects or objects with changes in brightness, such as people blinking their eyes when taking pictures, or scenes of cars driving fast, the brightness value of the same pixel at each time point may be different. Obtain the change of the brightness value of a pixel in the exposure time.
以相同方式得到图像探测器采集到的数据中每个其他像素点对应的时域波形。同样,也可以得到在某一个时间点所有像素点的像素值,从而可以根据所有像素点的像素值恢复出该时间点的场景信息。In the same way, the time domain waveform corresponding to each other pixel point in the data collected by the image detector is obtained. Similarly, the pixel values of all the pixels at a certain time point can also be obtained, so that the scene information of the time point can be recovered according to the pixel values of all the pixel points.
为了获得采集数据中一个像素点的时域波形,根据本公开实施例,可以以空间光调制器的多个子调制单元对应的图像探测器子探测单元为单位进行恢复场景信息。例如,将子调制单元分成多个组,以每组子调制单元对应的子探测单元的像素点为单元进行恢复场景信息。还例如,也可以以多组子调制单元对应的子探测单元的像素点为单元进行恢复。单位中多组子调制单元中的组越多,则恢复的图像的分辨率越小。单位中多组子调制单元中的组越少,恢复的图像的分辨率越大。下面以图3中子调制单元X1-X16对应的子探测单元的各个像素Y1-Y16为例进行描述。In order to obtain the time-domain waveform of one pixel in the collected data, according to an embodiment of the present disclosure, scene information can be recovered in units of image detector sub-detection units corresponding to multiple sub-modulation units of the spatial light modulator. For example, the sub-modulation units are divided into multiple groups, and the scene information is restored by taking the pixel points of the sub-detection units corresponding to each group of sub-modulation units as a unit. For another example, the restoration may also be performed in units of pixel points of sub-detection units corresponding to multiple groups of sub-modulation units. The more groups in the group of sub-modulation units in the unit, the smaller the resolution of the recovered image. The fewer the groups of sub-modulation units in the unit, the greater the resolution of the recovered image. The following description will be given by taking each pixel Y1-Y16 of the sub-detection unit corresponding to the sub-modulation units X1-X16 in FIG. 3 as an example.
如图5所示,Y1-Y16像素点组在空间位置接近,近似对应物体同一位置,因此可以以Y1-Y16为单位,获得目标场景中对应该位置的信息,例如获得目标场景中对应该位置的亮度值P1。另外,像素点的色度值可以通过彩色图像传感器获得。在一个示例中,由于对应Y1-Y16的目标场景位置可能包括多个像素点,因此可以将该位置的多个像素点的亮度值均设置为亮度值P1。在另一个示例中,也可以根据先验数据,将目标场景该位置的多个像素点的亮度值设置为与P1相关。例如是P1进行滤波、平滑等各种处理后的值。这样,对每一组子调制单元对应的子探测单元的像素点组进行上述操作,就可以获得对应目标场景的各个位置的信息,形成图像。As shown in Figure 5, the Y1-Y16 pixel point group is close in space and approximately corresponds to the same position of the object. Therefore, the information of the corresponding position in the target scene can be obtained in units of Y1-Y16, such as obtaining the corresponding position in the target scene. The brightness value P1. In addition, the chromaticity value of the pixel can be obtained by a color image sensor. In an example, since the target scene position corresponding to Y1-Y16 may include multiple pixel points, the luminance values of the multiple pixel points at the position may all be set to the luminance value P1. In another example, it is also possible to set the brightness values of multiple pixels at this position of the target scene to be related to P1 according to prior data. For example, it is a value obtained by performing various processes such as filtering and smoothing by P1. In this way, by performing the above operations on the pixel point groups of the sub-detection units corresponding to each group of sub-modulation units, information of each position corresponding to the target scene can be obtained to form an image.
下面以从Y1-Y16获得亮度值P1为例进行介绍。The following is an example of obtaining the luminance value P1 from Y1-Y16.
在一个示例中,为了从采集的数据Y1-Y16中获得目标场景中的信息,例如亮度值P1,可以首先获取对应目标场景该位置的编码信号,然后根据该编码信号对采集到的数据进行解析。例如,获取Y1-Y16对应的子调制单元X1-X16的调制信号。获取每个子调制信号中的频率参数,作为数据解析的第一参数。另外,还可以基于采集得到的数据Y1-Y16,获得第二参数。之后,基于上述第一和第二参数,获得目标场景中的信息。In an example, in order to obtain the information in the target scene from the collected data Y1-Y16, such as the brightness value P1, the coded signal corresponding to the position of the target scene can be obtained first, and then the collected data can be analyzed according to the coded signal . For example, the modulation signals of the sub-modulation units X1-X16 corresponding to Y1-Y16 are acquired. The frequency parameter in each sub-modulation signal is obtained as the first parameter of data analysis. In addition, the second parameter can also be obtained based on the collected data Y1-Y16. After that, based on the above-mentioned first and second parameters, information in the target scene is obtained.
在一个示例中,第一参数例如可以以前述的空间光调制器的多个子调制单元的一个组为单位进行获取。例如,如前述实施例所述,子调制单元X1-X16还可以分成四个组,例如X1-X4,X5-X8,X9-X12,X13-X16。每个组中子调制单元的调制信号的频率参数相同,例如X1-X4可以使用相同频率f1。X5-X8可以使用相同频率f2。X9-X12可以使用相同频率f3。X13-X16使用相同频率f4,可以将每个组的频率参数fl,f2,f3和f4中的一个或多个作为第一参数。In one example, the first parameter may be acquired in units of, for example, a group of a plurality of sub-modulation units of the aforementioned spatial light modulator. For example, as described in the foregoing embodiments, the sub-modulation units X1-X16 can also be divided into four groups, such as X1-X4, X5-X8, X9-X12, X13-X16. The frequency parameters of the modulation signals of the sub-modulation units in each group are the same, for example, X1-X4 can use the same frequency f1. X5-X8 can use the same frequency f2. X9-X12 can use the same frequency f3. X13-X16 use the same frequency f4, and one or more of the frequency parameters fl, f2, f3 and f4 of each group may be used as the first parameter.
在一个示例中,采集的数据包括多个像素点,例如,Y1-Y16。每个像素点中可以得到该像素点的亮度信息。可以将对应一组子调制单元的探测单元采集到的多个像素点作为一个像素点组,基于每组像素点,确定第二参数。例如,子调制单元X1-X16分成四个组,X1-X4,X5-X8,X9-X12,X13-X16,可以将Y1-Y16同样分成四个组Y1-Y4,Y5-Y8,Y9-Y12,Y13-Y16。然后基于每个像素点组的像素值确定第二参数。In one example, the collected data includes a plurality of pixel points, eg, Y1-Y16. The brightness information of the pixel can be obtained from each pixel. The plurality of pixel points collected by the detection unit corresponding to a group of sub-modulation units may be regarded as a pixel point group, and the second parameter may be determined based on each group of pixel points. For example, sub-modulation units X1-X16 are divided into four groups, X1-X4, X5-X8, X9-X12, X13-X16, Y1-Y16 can be divided into four groups Y1-Y4, Y5-Y8, Y9-Y12 , Y13-Y16. The second parameter is then determined based on the pixel values of each pixel point group.
在一个示例中,第二参数可以根据每个像素点组中的所有像素点的像素值进行计算。例如,对每个像素点组中的所有像素点的像素值,采用四相移恢复算法得到第二参数。第二参数可以是一个或多个。In one example, the second parameter may be calculated according to pixel values of all pixels in each pixel group. For example, for the pixel values of all pixel points in each pixel point group, the second parameter is obtained by adopting a four-phase shift recovery algorithm. The second parameter can be one or more.
在一个示例中,还可以获取第三参数,第三参数可以是每个子调制信号中的相位参数。基于第三参数以及对应一组子调制单元的探测单元采集到的多个像素点,来确定第二参数。例如,基于第三参数进行四相移恢复算法,获得第二参数。In one example, a third parameter may also be obtained, and the third parameter may be a phase parameter in each sub-modulation signal. The second parameter is determined based on the third parameter and a plurality of pixel points collected by the detection unit corresponding to a group of sub-modulation units. For example, a quadrature phase shift recovery algorithm is performed based on the third parameter to obtain the second parameter.
根据从每个像素点组获得的第二参数,以及从编码信息中获取的第一参数,可以获得目标场景在对应上述像素点组的位置的频谱。According to the second parameter obtained from each pixel point group and the first parameter obtained from the encoded information, the frequency spectrum of the target scene at the position corresponding to the above-mentioned pixel point group can be obtained.
在一个示例中,可以将第一参数和第二参数作为参数,对上述采集到数据的某部分进行傅里叶逆变换,得到目标场景在对应位置的时域波形。例如,如图9所示的时域波形,在该时域波形中,显示了对应曝光时间内的不同时刻t,目标场景中该对应位置的像素点的亮度值L。这样,以相同方式获得目标场景在各个时间点的各个位置的亮度值,可以形成图像。In an example, the first parameter and the second parameter may be used as parameters, and inverse Fourier transform may be performed on a certain part of the collected data to obtain the time domain waveform of the target scene at the corresponding position. For example, as shown in the time domain waveform shown in FIG. 9 , in the time domain waveform, the luminance value L of the pixel point at the corresponding position in the target scene at different times t in the corresponding exposure time is displayed. In this way, the luminance value of each position of the target scene at each time point is obtained in the same way, and an image can be formed.
在一个示例中,目标场景中包括运动物体(包括亮度变化物体),那么可以从采集的数据中恢复出变化的多张图像。例如,当用户希望在预定时间内获取关于目标场景的信息,例如,在图像探测器的一次曝光内获取,即在一次拍摄时间内获取,那么可以获得图像探测器在正常拍照获得的单张图像中恢复出的目标场景中的运动物体在曝光时间内变化的多张图像。In one example, if the target scene includes moving objects (including objects with changes in brightness), then a plurality of images with changes can be recovered from the collected data. For example, when the user wishes to acquire information about the target scene within a predetermined time, for example, within one exposure of the image detector, that is, within one shooting time, then a single image obtained by the image detector during normal photography can be obtained. Multiple images of moving objects in the target scene recovered from exposure time change.
由于现有技术中,受限于拍摄相机的性能指标,例如相机的曝光时间,在拍摄运动物体时,在曝光时间内拍摄到的往往是虚的像,看不清场景细节。根据本公开实施例,由于在采集来自目标场景的光信号之前,对其进行了有效处理,因此可以得到在相机曝光时间内的多张细致的图像。如图8所示,左侧8-1是目标场景,8-2是图像探测器在正常拍照获得的单张图像,也就是说图像探测器在没有对预采集的数据进行任何处理的情况下拍摄的图像,右侧图8-3,8-4,8-5是信号采集装置在经过信号处理装置进行第一处理后获取的目标场景在不同时间点的三张图像信息。通过对比可以看出,通过本公开实施例的方法,普通相机成像时,对于快速运动物体一般只能模糊的虚影,而通过本公开实施例恢复的成像图像,尤其是对于快速运动物体的成像,可以恢复出其在不同时间点的细节信息,因此,本公开实施例可以在不改变现有图像采集装置的情况下,提高成像质量,获得目标场景中物体的细节信息。并且由于处理过程是光信号处理,因此处理速度超快,可以达到光速的标准。Because in the prior art, limited by the performance index of the shooting camera, such as the exposure time of the camera, when shooting a moving object, a virtual image is often shot within the exposure time, and the details of the scene cannot be seen clearly. According to the embodiments of the present disclosure, since the light signal from the target scene is effectively processed before it is collected, multiple detailed images within the camera exposure time can be obtained. As shown in Figure 8, 8-1 on the left is the target scene, and 8-2 is a single image obtained by the image detector during normal photography, that is to say, the image detector does not perform any processing on the pre-collected data. The captured images, Figures 8-3, 8-4, and 8-5 on the right are three pieces of image information of the target scene at different time points obtained by the signal acquisition device after the first processing by the signal processing device. It can be seen from the comparison that with the method of the embodiment of the present disclosure, when an ordinary camera is imaging, generally only a blurred virtual image can be obtained for a fast-moving object, while the image recovered by the embodiment of the present disclosure is especially for the imaging of a fast-moving object. , the detailed information at different time points can be recovered. Therefore, the embodiment of the present disclosure can improve the imaging quality and obtain the detailed information of the object in the target scene without changing the existing image acquisition device. And because the processing process is optical signal processing, the processing speed is super fast and can reach the standard of the speed of light.
在本公开实施例中,可以根据用户想要从目标场景中获取的信息不同,在步骤S101中,预先设置每组子调制单元的调制信号的频率参数和相位参数。这样,在步骤S103中,用户可以从采集的数据中获得目标场景中的不同信息。或者是,在信号采集处理装置中,信号处理装置预先设置每组子调制单元的调制信号的频率参数和相位参数;之后,信号信息获得装置可以从采集的数据中获得目标场景中的不同信息。也就是说,本公开实施例可以根据用户需求,应用到不同技术领域。In this embodiment of the present disclosure, according to different information that the user wants to acquire from the target scene, in step S101 , the frequency parameters and phase parameters of the modulation signals of each group of sub-modulation units are preset. In this way, in step S103, the user can obtain different information in the target scene from the collected data. Alternatively, in the signal acquisition and processing device, the signal processing device presets the frequency parameters and phase parameters of the modulated signals of each group of sub-modulation units; then, the signal information obtaining device can obtain different information in the target scene from the collected data. That is, the embodiments of the present disclosure can be applied to different technical fields according to user requirements.
在一个示例中,用户希望对目标场景进行压缩采样。目标场景中可以包括运动物体,例如如图8中左上图所示的行驶中的汽车。这样对目标场景进行压缩采样后,在不同时间点获得的多张采样图像中,对应目标场景的同一位置的像素点的强度值为,在一定时间T内的一段连续变化的时域波形,例如如图9所示的时域波形。在图9中,横坐标表示时间t,纵坐标表示像素点的强度值L,波形表示某个像素点在不同时间t的光亮度值变化。这样,所有像素点组合成的图像,为在上述时间T内的不同时间点形成的连续变化的自然图像序列。In one example, the user wishes to compress sample the target scene. The target scene may include moving objects, such as a moving car as shown in the upper left image in Figure 8 . After the target scene is compressed and sampled in this way, in the multiple sampled images obtained at different time points, the intensity value of the pixel point corresponding to the same position of the target scene is a continuous time domain waveform within a certain time T, such as The time domain waveform shown in Figure 9. In FIG. 9, the abscissa represents time t, the ordinate represents the intensity value L of the pixel point, and the waveform represents the change of the luminance value of a certain pixel point at different times t. In this way, the image formed by all the pixel points is a continuously changing natural image sequence formed at different time points within the above-mentioned time T.
由于上述时域波形在频域为稀疏的,即只有少数频谱分量有较大非零值,而大部分频谱分量为接近于零的较小值,因此,在S101中,信号处理装置对来自目标场景的光信号进行第一处理时,可以舍弃这些较小值实现压缩采样(视频压缩)。例如,通过在S101步骤中第一处理时根据上述分析设置编码信号的频率参数和相位参数,从而在S102中信号采集装置只采集亮度值为较大值的频谱分量。在S103中信息获得装置可以直接得到经过压缩后的数据。例如,在S101步骤中信号处理装置从低频区域中选择部分频率作为调制信号的频率参数,对来自目标场景的光信号进行调制。还例如,在进行利用本公开的信号采集处理方法进行对目标场景近压缩采样时,调制信号所用频率的数量还可以根据用户进行信号压缩采样的压缩比例进行设置。所使用的频率数量决定了视频信号的压缩比例。使用的频率数量越少,信号压缩比例就越大;使用的频率数量越多,视频信号压缩比例就越小。Since the above-mentioned time domain waveform is sparse in the frequency domain, that is, only a few spectral components have large non-zero values, while most spectral components are small values close to zero, therefore, in S101, the signal processing device When the light signal of the scene is subjected to the first processing, these smaller values can be discarded to implement compressed sampling (video compression). For example, by setting the frequency parameter and the phase parameter of the encoded signal according to the above analysis during the first processing in step S101, in S102, the signal acquisition device only collects spectral components with a larger luminance value. In S103, the information obtaining device can directly obtain the compressed data. For example, in step S101 , the signal processing apparatus selects some frequencies from the low-frequency region as frequency parameters of the modulated signal, and modulates the optical signal from the target scene. For another example, when using the signal acquisition and processing method of the present disclosure to perform near-compressed sampling of the target scene, the number of frequencies used for modulating the signal may also be set according to the compression ratio of the signal compression sampling performed by the user. The number of frequencies used determines the compression ratio of the video signal. The smaller the number of frequencies used, the higher the signal compression ratio; the higher the number of frequencies used, the lower the video signal compression ratio.
在一个示例中,用户希望对目标场景中的运动物体的轨迹进行检测。物体在空间中运动时,物体经过图像探测器的不同子探测单元的时刻不同,因此图像探测器的不同子探测单元可以在不同时刻能够捕捉到该物体。每个子探测单元对应像素点不同时间点具有不同亮度值,这样,对于每个像素点而言,可以根据时间点和像素点亮度值生成时域波形。这些像素点时域波形上脉冲信号出现的时刻不同,对应到频域为相位不同。在本公开中,可以在步骤S101中,信号处理装置通过空间光调制器对来自目标场景的光信号进行第一处理,例如对应图像探测器的子探测单元的像素点,编码信号为相同频率的余弦信号,其频率为图像探测器曝光时间的倒数或大于该倒数。另外,在一次曝光时间内,同一像素点的相位分布为0-2π。这样,在步骤S103中,信息获得装置可以根据采集的数据,得到目标场景中运动物体在不同位置出现时的时刻。从而可以直接得到运动物体的运动轨迹。本公开实施例可以直接从目标场景中得到轨迹信息,而无需如现有技术那样采集目标场景的多幅图像序列,然后再从多幅图像序列中进行轨迹检测。也就是说,根据步骤S102中信号采集装置采集的数据,在步骤S103中,信息获得装置只要进行一次傅里叶逆变换,就可以直接得到目标场景中的图像信息,避免了现有技术中的重建视频图像再进行处理的过程,更简单易行,且显著提高了图像形成效率。In one example, the user wishes to detect the trajectories of moving objects in the target scene. When an object moves in space, the time when the object passes through different sub-detection units of the image detector is different, so different sub-detection units of the image detector can capture the object at different times. Each sub-detection unit has different brightness values corresponding to the pixel points at different time points, so that for each pixel point, a time domain waveform can be generated according to the time point and the pixel point brightness value. These pixels appear at different times in the time domain waveform of the pulse signal, which correspond to different phases in the frequency domain. In the present disclosure, in step S101, the signal processing device may perform first processing on the light signal from the target scene through the spatial light modulator, for example, the pixel point corresponding to the sub-detection unit of the image detector, and the encoded signal is of the same frequency. A cosine signal whose frequency is the reciprocal of the image detector exposure time or greater. In addition, in one exposure time, the phase distribution of the same pixel is 0-2π. In this way, in step S103, the information obtaining device may obtain the moments when the moving objects appear at different positions in the target scene according to the collected data. Thus, the motion trajectory of the moving object can be directly obtained. The embodiments of the present disclosure can directly obtain trajectory information from the target scene, without the need to collect multiple image sequences of the target scene as in the prior art, and then perform trajectory detection from the multiple image sequences. That is to say, according to the data collected by the signal collecting device in step S102, in step S103, the information obtaining device can directly obtain the image information in the target scene as long as the inverse Fourier transform is performed once, avoiding the need for the prior art. The process of reconstructing the video image and then processing it is simpler and easier, and the image forming efficiency is significantly improved.
在一个实施例中,用户希望对目标场景中的背景进行去除。一般来说,静止的物体、环境等可被视为背景。用户感兴趣的是前段的人像、物体,包括运动物体。背景往往被作为干扰项,用户希望通过背景去除算法去掉。在本公开实施例中,考虑到背景信息的时域波形稳定,可以看作是不随时间变化的常数。对背景的时域波形进行傅里叶变换后,其频谱上不存在高频分量,只在直流分量处有值。因此,在公开中,通过在步骤S101中信号处理装置的编码信号中不采集直流分量。例如,编码信号中,不采用f=0的频率做调制信号,所有的子调制单元的调制信号都是f≠0的余弦函数。这样,在步骤S102中,就没有直流分量被采集到。由于没有采集直流分量,因此背景信息没有被图像探测器所捕捉。在步骤S103中,信息获得装置根据采集的数据,可以直接获得去除了背景的图像或图像序列。In one embodiment, the user wishes to remove the background in the target scene. In general, stationary objects, environments, etc. can be considered as backgrounds. The user is interested in the portraits and objects in the front section, including moving objects. The background is often used as an interference item, and the user hopes to remove it through the background removal algorithm. In the embodiment of the present disclosure, considering that the time domain waveform of the background information is stable, it can be regarded as a constant that does not change with time. After the Fourier transform of the background time-domain waveform, there is no high-frequency component in the spectrum, and only has a value at the DC component. Therefore, in the disclosure, the direct current component is not collected in the encoded signal of the signal processing device in step S101. For example, in the encoded signal, the frequency of f=0 is not used as the modulation signal, and the modulation signals of all sub-modulation units are cosine functions of f≠0. In this way, in step S102, no DC component is collected. Since the DC component is not acquired, the background information is not captured by the image detector. In step S103, according to the collected data, the information obtaining device may directly obtain an image or image sequence from which the background has been removed.
在一个示例中,用户希望对目标场景进行目标识别。这里所说的目标可以是某个运动物体或者虽然不运动,但亮度变化的物体,例如霓虹灯。不同的纹理、运动速度的目标的时域波形往往差异很大,导致其频谱差异也很大。频谱分布是上述物理量共同作用的结果。变化的物理量会导致频谱构成发生变化。例如原本强度较弱的频率分量处的强度激增。因此编码时采用与这些运动物体或亮度变化物体相关的频率,可实现该特定运动目标检测。例如,高速运动物体的频谱带宽会比低速运动物体的带宽大很多。本公开为了对目标场景中的特定目标(例如特定运动物体)进行检测,可以在设置调制信号时,使用特定频率参数,从而从目标场景中仅获得目标图像,实现目标识别功能。In one example, the user wishes to perform object recognition on the target scene. The target mentioned here can be a moving object or an object that does not move but changes in brightness, such as a neon light. The time-domain waveforms of targets with different textures and moving speeds are often very different, resulting in large differences in their frequency spectra. The spectral distribution is the result of the combined action of the above-mentioned physical quantities. A changing physical quantity results in a change in the spectral composition. For example, there is a surge in intensity at a frequency component that is otherwise weak. Therefore, the frequency related to these moving objects or brightness-changing objects is used in encoding, and the detection of the specific moving object can be realized. For example, the spectral bandwidth of a high-speed moving object will be much larger than that of a slow-moving object. In order to detect a specific target (for example, a specific moving object) in the target scene of the present disclosure, a specific frequency parameter can be used when setting the modulation signal, so as to obtain only the target image from the target scene and realize the target recognition function.
例如,可以预先对感兴趣物体目标的运动规律进行分析,得到感兴趣目标的频谱。运动规律例如可以包括:物体的纹理信息、速度信息以及加速度信息等。这些物理量可以体现在图像探测器对应的不同像素点的时域波形在频谱中的分布情况。For example, the motion law of the object of interest can be analyzed in advance to obtain the frequency spectrum of the object of interest. The motion law may include, for example, texture information, velocity information, and acceleration information of the object. These physical quantities can be reflected in the distribution of time-domain waveforms in the frequency spectrum of different pixel points corresponding to the image detector.
在一个示例中,目标场景中包括运动物体或亮度变化物体,那么在步骤S101中,信号处理装置可以根据运动物体的至少一个运动参数,或根据亮度变化物体的亮度变化参数,确定调制信号中的至少一个频率参数,然后基于至少一个频率参数确定调制信号。In an example, the target scene includes a moving object or a brightness-changing object, then in step S101, the signal processing apparatus may determine the modulation signal according to at least one motion parameter of the moving object, or according to the brightness-changing parameter of the brightness-changing object. at least one frequency parameter, and then determining the modulation signal based on the at least one frequency parameter.
例如,调制信号的频率参数的频率值可以是根据上述运动参数或亮度变化参数确定的一个或多个频率值。为了避免识别误差,也可以将调制信号的频率值进行适当调整,例如可以是包括上述确定的频率值的一个频率范围。For example, the frequency value of the frequency parameter of the modulation signal may be one or more frequency values determined according to the above-mentioned motion parameter or brightness change parameter. In order to avoid identification errors, the frequency value of the modulation signal can also be adjusted appropriately, for example, it can be a frequency range including the above-determined frequency value.
在一个示例中,运动物体的运动参数包括运动速度。亮度变化物体的亮度变化参数包括亮度变化速度。这样,在根据运动参数确定频率值时,可以根据运动速度或亮度变化速度,确定运动物体经过光信号采集装置的一个探测单元的时间值,然后根据时间值确定频率。如果运动参数还包括运动加速度,或者亮度变化参数还包括变化加速度,还可以根据加速度和最初运动速度,确定运动物体在不同时刻的不同速度。根据获得的多个速度,确定运动物体经过光信号采集装置的一个探测单元的多个时间值。同样,对于亮度变化物体,可以根据亮度变化加速度和最初变化速度,确定亮度变化物体的多个亮度变化速度,根据多个亮度变化速度,确定亮度变化物体经过光信号采集装置的一个探测单元的多个时间值。例如,上述时间值可以是一个或多个非零的时间值,其对应频率值可能只有1个非零值,也可能有多个非零值。In one example, the motion parameters of the moving object include motion speed. The brightness change parameter of the brightness change object includes the brightness change speed. In this way, when the frequency value is determined according to the motion parameter, the time value of the moving object passing through a detection unit of the optical signal acquisition device can be determined according to the motion speed or the brightness change speed, and then the frequency is determined according to the time value. If the motion parameter also includes motion acceleration, or the brightness change parameter also includes change acceleration, different speeds of the moving object at different times can also be determined according to the acceleration and the initial motion speed. According to the obtained multiple speeds, multiple time values of the moving object passing through a detection unit of the optical signal acquisition device are determined. Similarly, for a brightness-changing object, multiple brightness-changing speeds of the brightness-changing object can be determined according to the brightness-changing acceleration and initial changing speed, and multiple brightness-changing speeds of the brightness-changing object passing through a detection unit of the optical signal acquisition device can be determined according to the multiple brightness changing speeds. time value. For example, the above time value may be one or more non-zero time values, and the corresponding frequency value may have only one non-zero value, or may have multiple non-zero values.
这样,在根据运动物体的属性确定了调制信号的频率参数之后,可以在步骤S101中信号处理装置设置编码信号,根据设置的编码信号对来自目标场景的光信号进行编码。这样,在步骤S102中,目标场景中的非目标数据不会被采集到图像探测器中。在步骤S103中,信息获得装置根据采集的数据得到的信息只包含用户想要的特定目标的图像信息,从而实现目标识别。In this way, after the frequency parameter of the modulated signal is determined according to the property of the moving object, the signal processing apparatus may set the encoded signal in step S101, and encode the optical signal from the target scene according to the set encoded signal. In this way, in step S102, non-target data in the target scene will not be collected into the image detector. In step S103, the information obtained by the information obtaining device according to the collected data only includes the image information of the specific target desired by the user, thereby realizing target recognition.
同样,本公开实施例,通过对目标场景的光信号进行调制处理,就能够实现对目标场景中的特定目标进行采集和检测,提高了处理速度的同事,有效减小了计算量。Similarly, in the embodiment of the present disclosure, by modulating the optical signal of the target scene, the collection and detection of a specific target in the target scene can be realized, which improves the processing speed and effectively reduces the amount of calculation.
以上所述的具体实施例,对本公开的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本公开的具体实施例而已,并不用于限制本公开,凡在本公开的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本公开的保护范围之内。The specific embodiments described above further describe the purpose, technical solutions and beneficial effects of the present disclosure in detail. It should be understood that the above-mentioned specific embodiments are only specific embodiments of the present disclosure, and are not intended to limit the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure should be included within the protection scope of the present disclosure.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010089554.9A CN111273050B (en) | 2020-02-12 | 2020-02-12 | Signal acquisition processing method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010089554.9A CN111273050B (en) | 2020-02-12 | 2020-02-12 | Signal acquisition processing method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111273050A true CN111273050A (en) | 2020-06-12 |
CN111273050B CN111273050B (en) | 2022-05-20 |
Family
ID=70999426
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010089554.9A Active CN111273050B (en) | 2020-02-12 | 2020-02-12 | Signal acquisition processing method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111273050B (en) |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63171364A (en) * | 1987-01-09 | 1988-07-15 | Hitachi Ltd | Rotation speed detection device |
CN101706259A (en) * | 2009-11-25 | 2010-05-12 | 天津大学 | Concrete crack width test method based on wavefront coding technology and hand-held tester |
JPWO2009141973A1 (en) * | 2008-05-20 | 2011-09-29 | パナソニック株式会社 | Moving picture coding apparatus and moving picture coding method |
CN102509283A (en) * | 2011-09-30 | 2012-06-20 | 西安理工大学 | DSP (digital signal processor)-based target perceiving and encoding method facing optic nerve prosthesis |
CN104267407A (en) * | 2014-09-12 | 2015-01-07 | 清华大学 | Initiative imaging method and system based on compressed sampling |
CN104581166A (en) * | 2014-12-08 | 2015-04-29 | 天津大学 | Multichannel acquired image-based compressive imaging system and method |
CN105868700A (en) * | 2016-03-25 | 2016-08-17 | 哈尔滨工业大学深圳研究生院 | Vehicle type recognition and tracking method and system based on monitoring video |
CN106204586A (en) * | 2016-07-08 | 2016-12-07 | 华南农业大学 | A kind of based on the moving target detecting method under the complex scene followed the tracks of |
CN108093237A (en) * | 2017-12-05 | 2018-05-29 | 西北工业大学 | High spatial resolution optical field acquisition device and image generating method |
US20180367742A1 (en) * | 2016-03-31 | 2018-12-20 | Panasonic Intellectual Property Management Co., Ltd. | Imaging apparatus including light source, reflective encoding device, and image sensor |
CN109285132A (en) * | 2018-09-20 | 2019-01-29 | 南京大学 | A Spectral Reconstruction Method Based on Frequency Domain Coding |
CN110545379A (en) * | 2019-09-09 | 2019-12-06 | 北京理工大学 | A parallel spatio-temporal joint compression imaging method and device using DMD |
CN110650340A (en) * | 2019-04-25 | 2020-01-03 | 长沙理工大学 | Space-time multiplexing compressed video imaging method |
-
2020
- 2020-02-12 CN CN202010089554.9A patent/CN111273050B/en active Active
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS63171364A (en) * | 1987-01-09 | 1988-07-15 | Hitachi Ltd | Rotation speed detection device |
JPWO2009141973A1 (en) * | 2008-05-20 | 2011-09-29 | パナソニック株式会社 | Moving picture coding apparatus and moving picture coding method |
CN101706259A (en) * | 2009-11-25 | 2010-05-12 | 天津大学 | Concrete crack width test method based on wavefront coding technology and hand-held tester |
CN102509283A (en) * | 2011-09-30 | 2012-06-20 | 西安理工大学 | DSP (digital signal processor)-based target perceiving and encoding method facing optic nerve prosthesis |
CN104267407A (en) * | 2014-09-12 | 2015-01-07 | 清华大学 | Initiative imaging method and system based on compressed sampling |
CN104581166A (en) * | 2014-12-08 | 2015-04-29 | 天津大学 | Multichannel acquired image-based compressive imaging system and method |
CN105868700A (en) * | 2016-03-25 | 2016-08-17 | 哈尔滨工业大学深圳研究生院 | Vehicle type recognition and tracking method and system based on monitoring video |
US20180367742A1 (en) * | 2016-03-31 | 2018-12-20 | Panasonic Intellectual Property Management Co., Ltd. | Imaging apparatus including light source, reflective encoding device, and image sensor |
CN106204586A (en) * | 2016-07-08 | 2016-12-07 | 华南农业大学 | A kind of based on the moving target detecting method under the complex scene followed the tracks of |
CN108093237A (en) * | 2017-12-05 | 2018-05-29 | 西北工业大学 | High spatial resolution optical field acquisition device and image generating method |
CN109285132A (en) * | 2018-09-20 | 2019-01-29 | 南京大学 | A Spectral Reconstruction Method Based on Frequency Domain Coding |
CN110650340A (en) * | 2019-04-25 | 2020-01-03 | 长沙理工大学 | Space-time multiplexing compressed video imaging method |
CN110545379A (en) * | 2019-09-09 | 2019-12-06 | 北京理工大学 | A parallel spatio-temporal joint compression imaging method and device using DMD |
Non-Patent Citations (3)
Title |
---|
JIANG TANG, ET AL: "Single-Shot Temporal Ghost Imaging Based on Orthogonal Frequency-Division Multiplexing", 《 IEEE PHOTONICS TECHNOLOGY LETTERS》 * |
TENG JJ, ET AL: "Time-encoded single-pixel 3D imaging", 《APL PHOTONICS》 * |
陈宏伟 等: "超快平面显微成像技术", 《数据采集与处理》 * |
Also Published As
Publication number | Publication date |
---|---|
CN111273050B (en) | 2022-05-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110493494B (en) | Image fusion device and image fusion method | |
CN101605208B (en) | Image processing apparatus, imaging apparatus, image processing method | |
CN111986129A (en) | HDR image generation method and device based on multi-shot image fusion and storage medium | |
CN108154514B (en) | Image processing method, device and equipment | |
US20110134285A1 (en) | Image Processing Method, Image Processing Apparatus, Image Processing Program, and Image File Format | |
CN109493283A (en) | A kind of method that high dynamic range images ghost is eliminated | |
CN102082912A (en) | Image capturing apparatus and image processing method | |
WO2013003330A1 (en) | Modulated aperture imaging for automatic moving target detection | |
CN106489169A (en) | Method and apparatus for enlarged drawing | |
CN114374776A (en) | Camera and camera control method | |
CN110425983A (en) | A kind of monocular vision three-dimensional reconstruction distance measuring method based on polarization multi-spectrum | |
CN113365014A (en) | Parallel compressed sensing GPU (graphics processing Unit) acceleration real-time imaging system and method | |
CN111273050B (en) | Signal acquisition processing method and device | |
Trottnow et al. | The potential of light fields in media productions | |
CN103444186B (en) | Method and apparatus for optical focus | |
CN102273213A (en) | Image data obtaining method and image data obtaining device | |
CN111383242B (en) | Image fog penetration processing method and device | |
Schechner et al. | Uncontrolled modulation imaging | |
CN111915697B (en) | One-step harmonic single-pixel imaging method | |
CN204069217U (en) | A video compression acquisition system | |
JP5929774B2 (en) | Image acquisition method, apparatus, and program | |
Veeravasarapu et al. | Fast and fully automated video colorization | |
CN206639229U (en) | Dual camera is imaged and iris capturing identification integration apparatus | |
Yue et al. | Deblur a blurred RGB image with a sharp NIR image through local linear mapping | |
CN109089034A (en) | A kind of image acquiring method and image acquiring device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230419 Address after: 101407 28-3, floor 1, building 28, yard 13, Paradise West Street, Huairou District, Beijing Patentee after: Beijing Qingzhi Yuanshi Technology Co.,Ltd. Address before: 100084 No. 1 Tsinghua Yuan, Beijing, Haidian District Patentee before: TSINGHUA University |