WO2016086489A1 - 图像降噪的方法及其装置 - Google Patents
图像降噪的方法及其装置 Download PDFInfo
- Publication number
- WO2016086489A1 WO2016086489A1 PCT/CN2014/096001 CN2014096001W WO2016086489A1 WO 2016086489 A1 WO2016086489 A1 WO 2016086489A1 CN 2014096001 W CN2014096001 W CN 2014096001W WO 2016086489 A1 WO2016086489 A1 WO 2016086489A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- pixel points
- image
- raw images
- pixels
- same shooting
- Prior art date
Links
- 230000009467 reduction Effects 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims description 28
- 230000001915 proofreading effect Effects 0.000 claims description 15
- 230000000694 effects Effects 0.000 abstract description 6
- 238000005215 recombination Methods 0.000 abstract 1
- 230000006798 recombination Effects 0.000 abstract 1
- 238000012217 deletion Methods 0.000 description 4
- 230000037430 deletion Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 238000001914 filtration Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 230000004304 visual acuity Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
Definitions
- the present invention relates to the field of communications technologies, and in particular, to a method and device for image noise reduction.
- the value of a point in a digital image or a digital sequence is usually replaced by the median value of each point value in a field of the point, and the main function is to make the gray value of the surrounding pixels
- the pixels with larger differences are changed to values close to the surrounding pixel values, so that isolated noise points can be eliminated.
- using the median filtering method will reduce the image sharpness and make the image blurred; especially in the image with more points, lines and apex details, it is not suitable to use median filtering. method.
- the median filtering method is used to denoise the image, and the isolated noise can be removed.
- the median filtering method uses the color close to the gray value of the surrounding, it also blurs the edge of the image, the image sharpness decreases, and the user experience is reduced.
- the source of thermal noise is specifically because there are thermal pixels in both CCD (Charge-coupled Device) and CMOS (Complementary Metal Oxide Semiconductor) photosensitive elements.
- the problem is related to the quality and temperature of the image, and whether it is a CCD or a CMOS chip, it will inevitably generate high temperatures during operation. If the temperature of the chip rises and the noise signal is too strong, it will form mottled spots on the screen where it should not be. These points are the noise.
- the thermal noise is generated because the thermal current is superimposed on the normal signal current, so the signal current of some pixel points is larger than the normal induced current, which ultimately leads to stronger signal intensity at this pixel point, which is higher in the RAW image. .
- Such pixel points after color processing at the backend ISP, can cause noise problems such as darker or brighter colors. At present, the denoising of these noises is not well handled.
- an object of the present invention is to provide a method and apparatus for image noise reduction to improve the effect of image noise reduction processing.
- the present invention provides a method for image noise reduction, including:
- the recombining step combines the plurality of the second RAW images into a third RAW image.
- the noise reduction step comprises:
- the pixels with the brightest brightness among the plurality of pixels of the same shooting position are selected as the standard pixel points;
- the method further includes:
- a plurality of the first RAW images are compared to find pixel points on each of the first RAW images for each of the same shooting positions.
- the method further includes:
- the image signal processing step is performed by performing image signal processing on the third RAW image and outputting the image.
- the number of the cameras is two; the number of the first RAW images is two.
- the present invention also provides an apparatus for image noise reduction, comprising:
- a shooting module configured to capture the same scene by using multiple cameras, to obtain a plurality of first RAW images
- a noise reduction module configured to compare pixel points of the same shooting position in the plurality of the first RAW images, to retain standard pixel points in the plurality of pixels of the same shooting position, and to not belong to The pixel points of the standard pixel point are removed, and a plurality of second RAW images are obtained;
- a recombining module configured to combine the plurality of the second RAW images into a third RAW image.
- the noise reduction module comprises:
- a comparison submodule configured to compare pixel points of the same shooting position in the plurality of first RAW images
- a sub-module configured to select, when the brightness difference of the pixel points of the plurality of the same shooting positions is above a noise range, a pixel point with the darkest brightness among the plurality of pixels of the same shooting position as a standard pixel point;
- the device further comprises:
- a proofreading module configured to compare the plurality of the first RAW images to find pixel points on each of the first RAW images of each of the same shooting positions.
- the device further comprises:
- the image signal processing module is configured to perform image signal processing on the third RAW image to output an image.
- the number of the cameras is two; the number of the first RAW images is two.
- the invention obtains a plurality of first RAW images by capturing the same scene by using a plurality of cameras; then comparing pixel points of the same shooting position in the plurality of the first RAW images, and retaining the standard pixel points therein, And removing other pixels that do not belong to the standard pixel, and obtaining a plurality of second RAW images and combining them into a third RAW image.
- the most original image brightness information is utilized for contrast noise reduction, and a good effect of the final output image is achieved.
- the denoising effect of the image can be improved, in particular, the noise problem of photographing in a dark environment can be greatly reduced, thereby improving the image resolving power, making the captured image clearer, and capturing more details of the scene, thereby improving the user experience. Increase the market share of products.
- FIG. 1 is a schematic diagram of a device for reducing image noise according to a first embodiment of the present invention
- FIG. 2 is a schematic diagram of a device for reducing image noise provided by the second, third, and fourth embodiments of the present invention
- FIG. 3 is a flowchart of a method for image noise reduction according to a fifth embodiment of the present invention.
- FIG. 4 is a flow chart of a method for image noise reduction provided by an embodiment of the present invention.
- an apparatus 100 for image noise reduction including:
- the photographing module 10 is configured to photograph the same scene by using a plurality of cameras to obtain a plurality of first RAW images;
- the noise reduction module 20 is configured to compare pixel points of the same shooting position in the plurality of the first RAW images, to retain standard pixel points in the plurality of pixels of the same shooting position, and to not belong to the Deleting pixel points of standard pixel points to obtain a plurality of second RAW images;
- the recombining module 30 is configured to combine the plurality of the second RAW images into a third RAW image.
- a plurality of first RAW images are obtained by photographing the same scene using a plurality of cameras; and then the noise reduction processing is performed by the noise reduction module 20 on the plurality of first RAW images.
- the noise reduction module 20 compares pixel points of the same shooting position in the plurality of the first RAW images, and then selects a plurality of pixel points of the same shooting position to select standard pixel points according to the comparison result. The retention of these standard pixels and the deletion of other pixels will cause a plurality of the first RAW images to satisfy the noise reduction requirement.
- the noise reduction requirement means that a plurality of the first RAW images reach an image denoising requirement, and the number of noises and/or noise values in the image are in a reasonable interval, and the noise reduction requirement may be determined by a person skilled in the art according to a shooting environment or Experience setting for shooting scenes and characteristics of the camera.
- a corresponding second RAW image is obtained.
- a plurality of the second RAW images are combined by the recombining module 30 into a third RAW image, and the third RAW image is recombined. Therefore, in this embodiment, by using a plurality of cameras to cooperate with each other, the image noise can be eliminated, and the image sharpness can be maintained without being lowered, thereby greatly improving the image quality. Quantity, which increases user satisfaction.
- the noise reduction module 20 includes:
- a comparison sub-module 21 configured to compare pixel points of the same shooting position in the plurality of first RAW images
- a sub-module 22 configured to select a pixel point of the plurality of pixels of the same shooting position as the standard pixel point when the brightness difference of the pixel points of the plurality of the same shooting positions is above the noise range;
- a deletion sub-module 23 configured to retain standard pixel points in all the pixels of the same shooting position in each of the first RAW images, and to exclude the other of all the pixels of the same shooting position from being The pixel points of the standard pixel are deleted, and the second RAW image is obtained.
- the noise range can be preset before photographing, and a suitable noise range is set according to different photographing environments, photographing objects, and characteristics of the photographed device. Those skilled in the art can make settings based on their experience.
- the comparison sub-module 21 compares pixel points of the same shooting position in the plurality of first RAW images; and when the brightness difference of the pixels of the plurality of the same shooting positions is above the noise range, the brightness of the pixel is abnormal. High, so the selection sub-module 22 selects the pixel with the darkest brightness among the plurality of pixels of the same shooting position as the standard pixel point.
- the selection sub-module 22 selects the brightness of the plurality of pixels of the same shooting position.
- Bright pixels are used as standard pixels.
- the deletion sub-module 23 retains the standard pixel points at the same photographing position, and deletes other pixels of the same photographing position, thereby obtaining a second RAW image.
- the number of the plurality of cameras is two; the number of the first RAW images is two.
- the noise reduction module 20 compares the sub-module 21 when performing noise reduction processing. Comparing pixel points of the same shooting position in the two first RAW images; selecting the two shooting positions of the same shooting position when the brightness difference of the pixel points of the two same shooting positions is above the noise range The pixel with the darkest brightness in the pixel is used as the standard pixel; or, when the difference in the brightness of the pixel at the same shooting position is below the noise range, the brightness of the pixel in the same shooting position is selected.
- the brightest pixel points are used as standard pixel points; the deletion sub-module 23 retains standard pixel points in all the pixels of the same shooting position in each of the first RAW images, and The other pixels of the pixels of the same shooting position that do not belong to the standard pixel point are deleted, and the second RAW image is obtained. That is, the second RAW image after the two noise reduction processes can be obtained. Finally, in this embodiment, after comparing the two images, the pixels with abnormal brightness are removed, the pixels of normal brightness are retained, and the results of the comparison of the two second RAW images are recombined to form a new RAW.
- the new third RAW image has been compared to eliminate the noise generated by thermal noise and is an image that meets the noise reduction requirements.
- the number of the plurality of cameras may also be three, four, etc.; and the number of corresponding first RAW images is three, four, and the like. It can be set according to the user's request for a photographed image, and the like.
- the image noise reduction apparatus 100 further includes:
- the proofreading module 40 is configured to compare the plurality of the first RAW images to find pixel points on each of the first RAW images of each of the same shooting positions.
- the comparison sub-module 21 before comparing the pixel points of the same shooting position in the plurality of first RAW images, the comparison sub-module 21 needs to compare the plurality of the first RAW images by the proofreading module 40, Find a pixel point on each of the first RAW images for each of the same shooting positions. This is because the same scene taken by a plurality of cameras may have different positions of the pixel points on each of the first RAW images in each of the specific parts of the scene, so each of the scenes is verified by the proofreading module 40. The pixels of the part are proofread.
- the coordinate position of a pixel point in a first RAW image captured by one camera of a petal in the scene is (630, 630); and the coordinates of a pixel point in the first RAW image taken by another camera
- the location is (640, 640); the proofreading module 40 performs proofreading.
- the proofreading module 40 compares the graphics, colors, and brightness displayed in the plurality of the first RAW images to find pixel points in the same shooting position in each of the first RAW images. That is, the specific proofreading module 40 can know which structures in different images belong to the same structure of photographing by graphics, color, brightness, and the like in the image.
- the image noise reduction apparatus 100 further includes:
- the image signal processing module 50 is configured to perform image signal processing on the third RAW image to output an image.
- the image signal processing module 50 performs image signal processing on the third RAW image, and the format of the image output in the image signal processing module 50 is in RAW format or JPEG format.
- the image noise reduction device 100 can be applied to a mobile phone or a PDA. (Personal Digital Assistant), a tablet computer and the like, and the plurality of modules of the image noise reduction device 100 may be a software unit, a hardware unit or a combination of hardware and software built in the mobile terminal.
- a PDA Personal Digital Assistant
- the plurality of modules of the image noise reduction device 100 may be a software unit, a hardware unit or a combination of hardware and software built in the mobile terminal.
- a method for image noise reduction including:
- step S301 the same scene is captured by using a plurality of cameras to obtain a plurality of first RAW images; the step is a photographing step, which is implemented by the photographing module 10;
- step S302 the pixel points of the same shooting position in the plurality of the first RAW images are compared, the standard pixel points in the plurality of pixels of the same shooting position are reserved, and the standard pixels are not included.
- the pixel points of the point are removed to obtain a plurality of second RAW images; the step is a noise reduction step, which is implemented by the noise reduction module 20;
- step S303 a plurality of the second RAW images are combined into a third RAW image.
- This step is a reorganization step and is implemented by the reassembly module 30.
- the same scene is photographed by a plurality of cameras, and a plurality of different first RAW images are obtained due to the difference in the angle or the distance of the photographing and the parameters of the camera.
- the plurality of first RAW images are complemented, that is, the pixels of the same shooting position in the plurality of the first RAW images are compared, and the plurality of the same shooting positions are Standard pixel points in the pixels are reserved, and pixels that do not belong to the standard pixel points are removed, a plurality of second RAW images are obtained; finally, the plurality of the second RAW images are combined into a third RAW image.
- the standard pixel points will be set according to the specific shooting environment, the captured scene or the device, which satisfies the image noise reduction requirements.
- these cameras include CCD or CMOS sensing components.
- the noise reduction step comprises:
- the pixels with the darkest brightness among the plurality of pixels of the same shooting position are selected as the standard pixel points; the step is performed by the selection sub-module 22 Realize; or
- the pixels with the brightest brightness among the plurality of pixels of the same shooting position are selected as the standard pixel points; the step is performed by the selection sub-module 22 Realize
- the standard pixel points in all the pixels of the same photographing position are retained in each of the first RAW images, and the other pixels in all the pixels of the same photographing position are deleted, and the two RAW images are obtained. This step is implemented by the delete sub-module 23.
- Standard pixels are in the noise range.
- the noise range can be preset before photographing, for example, according to different photographing environments, photographing objects, and characteristics of the photographing device to set a suitable noise range; and those skilled in the art can set according to their experience.
- the specific selection sub-module 22 selects the pixel with the darkest brightness among the plurality of pixels of the same shooting position as the standard pixel point; Then, the pixel with the brightest brightness among the plurality of pixels of the same shooting position is selected as the standard pixel point; finally, the deleting sub-module 23 removes the other pixels that do not belong to the standard pixel point.
- the number of the cameras is two; the number of the first RAW images is two. Of course, there may be other numbers of cameras, for example, 3 or 4.
- the method further includes:
- the step is a proofreading step, implemented by the proofreading module 40; in the proofreading step In the comparison, the pixels, the colors, and the brightness displayed in the plurality of the first RAW images are compared, so that the pixel points in the same shooting position in each of the first RAW images can be found.
- the method further includes: performing image signal processing on the third RAW image to output an image.
- This step is an image signal processing step implemented by the image signal processing module 50.
- the format of the image outputted in the image signal processing step is the RAW format or the JPEG format. Users can choose to use it.
- a plurality of the first RAW images need to be compared to find pixel points of each of the same shooting positions on each of the first RAW images; that is, in different first RAW images. Finding the pixel points of each position of the scene on each of the first RAW images, then the denoising module 20 can compare the pixels of the same shooting position on the respective first RAW images according to the result of the comparison.
- the image signal processing module 50 processes the third RAW image, and therefore, the format of the image outputted in the image signal processing step is the RAW format or the JPEG format.
- step S401 the dual camera simultaneously takes a picture and outputs a RAW image
- step S402 the dedicated CPU compares, reduces noise, and combines two RAW images
- step S403 output to the ISP for backend processing
- step S404 a RAW picture or a JEPG picture is output.
- the same scene is simultaneously photographed using a dual camera, and a RAW image is simultaneously output.
- the new RAW image is the original data of the CMOS or CCD image sensor that converts the captured light source signal into a digital signal.
- the image after the noise generated by the thermal noise has been eliminated by comparison.
- the new RAW image is output to the back-end ISP, and then processed by the ISP, the setting at the time of shooting is increased, the RAW image that can be processed is output, or the color information is added and the image is compressed, and finally a picture can be output.
- Clear Jpeg picture ISP (Image Signal Processor), that is, image processing
- the main function is to post-process the signal output by the front-end image sensor.
- the main functions are linear correction, noise removal, dead point removal, interpolation, white balance, automatic exposure control, etc.
- this embodiment needs to add a processor unit for picture comparison processing before the ISP processing, that is, it implements the function of the proofreading module 40.
- the present invention obtains a plurality of first RAW images by taking a plurality of cameras to capture the same scene; and then comparing pixel points of the same shooting position in the plurality of the first RAW images, The standard pixel points are retained, and other pixels that do not belong to the standard pixel point are removed, and a plurality of second RAW images are obtained and combined into a third RAW image. Thereby, the most original image brightness information is utilized for contrast noise reduction, and a good effect of the final output image is achieved.
- the denoising effect of the image can be improved, in particular, the noise problem of photographing in a dark environment can be greatly reduced, thereby improving the image resolving power, making the captured image clearer, and capturing more details of the scene, thereby improving the user experience. Increase the market share of products.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Picture Signal Circuits (AREA)
Abstract
提供了一种图像降噪的方法及其装置，适用于通信技术领域，所述方法包括：拍摄步骤，采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；降噪步骤，将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；重组步骤，将多个所述第二RAW图像组合成第三RAW图像。借此，提高了图像降噪处理的效果。
Description
本发明涉及通信技术领域，尤其涉及一种图像降噪的方法及其装置。
在现有的图像降噪技术中，通常是通过把数字图像或数字序列中一点的值用该点的一个领域中各点值的中值代换其，主要功能是让周围象素灰度值的差比较大的像素改取与周围的像素值接近的值,从而可以消除孤立的噪声点。但是，这样的处理方式对一些细节多的图像，使用中值滤波法会降低图像锐度，使图像变得模糊；特别是在点、线、尖顶细节较多的图像中不宜采用中值滤波的方法。
因此，采用中值滤波法对图像进行去噪，可以去掉孤立的噪点，但是因为其使用平衡周围灰度值接近的色彩，同时也会使图像边缘模糊，图像锐度下降，用户体验降低。
另外一方面，热噪声的来源具体的是因为CCD(Charge-coupled Device，中电荷耦合元件)和CMOS(Complementary Metal Oxide Semiconductor，互补金属氧化物半导体)感光元件都存在有热稳定性(hot pixel)的问题，则与对成像的质量和温度有关，而无论是CCD还是CMOS芯片，在工作时都会不可避免地产生高温。如果芯片的温度升高，噪音信号过强，会在画面上不应该有的地方形成杂色的斑点，这些点就是所述的噪点。而热噪声的产生是因为热电流叠加在正常信号电流上，所以导致部分像素点的信号电流大于正常感应电流，最终导致此像素点上的信号强度更强，表现在RAW图上就是亮度更高。此类像素点在后端ISP加上色彩处理后，就会导致颜色更深或更亮等噪点问题。目前对于这些噪点的去噪并没有很好的处理方式。
综上可知，现有图像去噪技术在实际使用上显然存在不便与缺陷，所以有必要加以改进。
发明内容
针对上述的缺陷，本发明的目的在于提供一种图像降噪的方法及其装置，以提高图像降噪处理的效果。
为了实现上述目的，本发明提供一种图像降噪的方法，包括：
拍摄步骤，采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；
降噪步骤，将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；
重组步骤，将多个所述第二RAW图像组合成第三RAW图像。
根据所述的方法，所述降噪步骤包括：
将多个第一RAW图像中的同一拍摄位置的像素点进行对比；
在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者
在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；
在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中的其他像素点删除，获得所述第二RAW图像。
根据所述的方法，所述方法还包括：
校对步骤，将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。
根据所述的方法，所述方法还包括：
图像信号处理步骤，将所述第三RAW图像进行图像信号处理后输出图像。
根据上述任一项所述的方法，所述摄像头的数目为两个；所述第一RAW图像的数目为两个。
为了实现本发明的另一发明目的，本发明还提供了一种图像降噪的装置，包括：
拍摄模块，用于采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；
降噪模块，用于将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于
所述标准像素点的像素点去除，获得多个第二RAW图像；
重组模块，用于将多个所述第二RAW图像组合成第三RAW图像。
根据所述的装置，所述降噪模块包括：
对比子模块，用于将多个第一RAW图像中的同一拍摄位置的像素点进行对比；
选择子模块，用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者
用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；
删除子模块，用于在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中不属于所述标准像素点的像素点删除，获得所述第二RAW图像。
根据所述的装置，所述装置还包括：
校对模块，用于将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。
根据所述的装置，所述装置还包括：
图像信号处理模块，用于将所述第三RAW图像进行图像信号处理后输出图像。
根据上述任一项所述的装置，所述摄像头的数目为两个；所述第一RAW图像的数目为两个。
本发明通过采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；然后将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将其中的标准像素点保留，以及将不属于所述标准像素点的其他像素点去除，获得多个第二RAW图像后组合成第三RAW图像。由此，利用了最原始的图像亮度信息进行对比降噪，实现最终输出图像的良好效果。由此，可提高图像的去噪效果，特别是可大幅减少暗环境下拍照的噪点问题，从而提升图像解析力，使拍摄的图像更加清晰，可以拍摄出更多景物的细节，从而提升用户体验，增加产品的市场占有率。
图1是本发明第一实施例提供的图像降噪的装置组成示意图；
图2是本发明第二、三、四实施例提供的图像降噪的装置组成示意图；
图3是本发明第五实施例提供的图像降噪的方法流程图；
图4是本发明的一个实施例提供的图像降噪的方法流程图。
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
参见图1，在本发明的第一实施例中，提供了一种图像降噪的装置100，包括：
拍摄模块10，用于采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；
降噪模块20，用于将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；
重组模块30，用于将多个所述第二RAW图像组合成第三RAW图像。
在该实施例中，通过利用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；然后由降噪模块20对这多个第一RAW图像进行降噪处理。具体的，降噪模块20将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，然后根据对比结果，将多个所述同一拍摄位置的像素点中选择标准像素点进行保留，这些标准像素点的保留以及其他像素点的删除，将使多个所述第一RAW图像满足降噪要求。而所述降噪要求是指多个所述第一RAW图像达到图像去噪要求，图像中的噪点数量和/或噪点值在合理的区间，该降噪要求可以由本领域技术人员根据拍摄环境或者拍摄景物以及拍摄装置的特性等进行经验设置。在每个第一RAW图像进行相应的像素点的保留或者是去除后，获得对应的第二RAW图像。最后，由重组模块30将多个所述第二RAW图像组合成第三RAW图像，重新合成的第三RAW图像。由此，本实施例利用多个摄像头互相配合的方式，既能消除图像噪点，又可以保持图像锐度不被降低，大幅提升了图像质
量，从而使用户满意度提升。
参见图2，在本发明的第二实施例中，降噪模块20包括：
对比子模块21，用于将多个第一RAW图像中的同一拍摄位置的像素点进行对比；
选择子模块22，用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者
用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；
删除子模块23，用于在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中的其他不属于所述标准像素点的像素点删除，获得所述第二RAW图像。
在该实施例中，噪点范围可以在拍照前进行预设，根据不同的拍照环境、拍照对象以及拍照的装置的特性设置适合的噪点范围。本领域的技术人员可以根据其经验进行设置。对比子模块21将多个第一RAW图像中的同一拍摄位置的像素点进行对比；而在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，这说明像素点的亮度异常高，因此选择子模块22将选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点。而在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，这说明像素点的亮度偏低，因此选择子模块22将选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点。删除子模块23将所述同一拍摄位置上的标准像素点保留，并删除该同一拍摄位置其他像素点，由此获得第二RAW图像。
在本发明的一个优选实施例中，多个所述摄像头的数目为两个；所述第一RAW图像的数目为两个，具体的，降噪模块20在进行降噪处理时对比子模块21将两个第一RAW图像中的同一拍摄位置的像素点进行对比；选择子模块22在两个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择两个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者，在两个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择两个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；删除子模块23在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将
所述同一拍摄位置的所有像素点中的其他不属于所述标准像素点的像素点删除，获得所述第二RAW图像。即可以获得两个降噪处理后的第二RAW图像。最后，在该实施例中，两幅图像对比后，去掉亮度异常的像素点，保留正常亮度的像素点，并将两幅第二RAW图对比后的结果进行重新组合，形成一幅新的RAW图，新的第三RAW图已经通过对比消除掉热噪声产生的噪点，是满足降噪要求的图像。当然在其他的实施方式中，多个所述摄像头的数目还可以是为三个、四个等；而相应的所述第一RAW图像的数目为三个、四个等。可以根据用户对拍照图像的要求等进行设置。
参见图2，在本发明的第三实施例中，图像降噪的装置100还包括：
校对模块40，用于将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。
在该实施例中，在对比子模块21，用于将多个第一RAW图像中的同一拍摄位置的像素点进行对比之前，需要通过校对模块40将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。这是由于通过多个摄像头拍摄的同一景物，可能该景物中具体的每个部分在每个所述第一RAW图像上的像素点的位置是不同的，所以通过校对模块40将该景物中每个部分的像素点进行校对。例如，景物中的一个花瓣的在一个摄像头的拍摄的第一RAW图像中的像素点的坐标位置是(630，630)；而在另外一个摄像头的拍摄的第一RAW图像中的像素点的坐标位置是(640，640)；校对模块40则进行校对。校对模块40将多个所述第一RAW图像中显示的图形、颜色以及亮度进行对比，查找每个所述第一RAW图像中的所述同一拍摄位置上的像素点。即具体的校对模块40可以通过图像中的图形、颜色以及亮度等获知在不同的图像中的哪些结构属于拍摄的同一结构。
参见图2，在本发明的第四实施例中，图像降噪的装置100还包括：
图像信号处理模块50，用于将所述第三RAW图像进行图像信号处理后输出图像。
在该实施例中，图像信号处理模块50对所述第三RAW图像进行图像信号处理，并且在所述图像信号处理模块50中输出的图像的格式为RAW格式或者JPEG格式。
在上述多个实施例中，所述图像降噪的装置100可应用于手机、PDA
(Personal Digital Assistant，个人数字助理)、平板电脑等移动终端中，并且该图像降噪的装置100的多个模块可以是内置于移动终端的软件单元，硬件单元或软硬件结合单元。
参见图3，在本发明的第五实施例中，提供了一种图像降噪的方法，包括：
步骤S301中，采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；该步骤为拍摄步骤，由拍摄模块10实现；
步骤S302中，将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；该步骤为降噪步骤，由降噪模块20实现；
步骤S303中，将多个所述第二RAW图像组合成第三RAW图像。该步骤为重组步骤，由重组模块30实现。
在该实施例中，通过多个摄像头对同一景物进行拍摄，由于拍摄的角度或者是距离以及摄像头的参数等的不同，将获得多个不同的第一RAW图像。获得多个不同的第一RAW图像后，将多个第一RAW图像进行互补，即将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；最后将多个所述第二RAW图像组合成第三RAW图像。其中，标准像素点将根据具体的拍摄环境、拍摄的景物或者是装置进行设定，其满足图像的降噪要求。另外，这些摄像头包括CCD或者CMOS感光元器件。
在本发明的第六实施例中，所述降噪步骤包括：
将多个第一RAW图像中的同一拍摄位置的像素点进行对比；该步骤由对比子模块21实现；
在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；该步骤由选择子模块22实现；或者
在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；该步骤由选择子模块22实现；
在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中的其他像素点删除，获得所述二RAW图像。该步骤由删除子模块23实现。
在该实施例中，需要在每个第一RAW图像选择出符合去噪要求的像素点——标准像素点，并将其保留，而不符合去噪要求的像素点则去除。标准像素点处于噪点范围内。而该噪点范围可以在拍照前进行预设，例如根据不同的拍照环境、拍照对象以及拍照装置的特性进行设置，以设置适合的噪点范围；并且本领域的技术人员可以根据其经验进行设置。具体的选择子模块22在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；反之，则选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；最后，删除子模块23将不属于标准像素点的其他像素点去除。优选的所述摄像头的数目为两个；所述第一RAW图像的数目为两个。当然，还可以是其他数目的摄像头，例如设置3个或者是4个。
在本发明的第七实施例中，所述方法还包括：
将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点；该步骤为校对步骤，由校对模块40实现；在该校对步骤中，通过将多个所述第一RAW图像中显示的图形、颜色以及亮度进行对比，可以查找每个所述第一RAW图像中的所述同一拍摄位置上的像素点。
在本发明的另一发明实施例中，所述方法还包括：将所述第三RAW图像进行图像信号处理后输出图像。该步骤为图像信号处理步骤，由图像信号处理模块50实现。在所述图像信号处理步骤中输出的图像的格式为RAW格式或者JPEG格式。用户可以自行选择进行使用。
在该实施例中，需要将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点；即在不同的第一RAW图像中找到景物的每个位置在各个第一RAW图像上的像素点，然后，去噪模块20才能够根据对比的结果对各个第一RAW图像上的同一拍摄位置的像素点进行对比。图像信号处理模块50对第三RAW图像进行处理，因此，在所述图像信号处理步骤中输出的图像的格式为RAW格式或者JPEG格式。
参见图4，在本发明的一个实施例中，提供了一种图像降噪的方法，所述方
法描述如下：
步骤S401中，双摄像头同时拍照并输出RAW图像；
步骤S402中，专用CPU对两幅RAW图像进行对比、降噪、组合；
步骤S403中，输出到ISP进行后端处理；
步骤S404中，输出RAW图片或者JEPG图片。
在该实施例中，使用双摄像头对同一景物同时进行拍摄，并同时输出RAW图像。在ISP处理之前，首先需要对拍摄出的两幅RAW图像进行对比。对比同一拍摄位置的像素点图画中所以的像素点都对比，如果亮度差异值在噪点范围以上，则取亮度较暗的像素点为标准像素点；如果亮度差异值在噪点范围以下，则取亮度较亮的像素点为标准像素点，避免图像整体亮度下降。在两幅图像对比后，去掉亮度异常的像素点，保留正常亮度的像素点，然后将两幅RAW图像对比后的结果进行重新组合，形成一幅新的RAW图像。新的RAW图像就是CMOS或者CCD图像感应器将捕捉到的光源信号转化为数字信号的原始数据，已经通过对比消除掉热噪声产生的噪点后的图像。然后，将该新的RAW图像输出到后端ISP，再经过ISP的处理，增加拍摄时的设置，输出可处理的RAW图，或者再增加色彩信息并对图像进行压缩处理，最终可输出一幅清晰的Jpeg图片。其中，ISP(Image Signal Processor)，即图像处理，主要作用是对前端图像传感器输出的信号做后期处理，主要功能有线性纠正、噪声去除、坏点去除、内插、白平衡、自动曝光控制等，依赖于ISP才能在不同的光学条件下都能较好的还原现场细节，ISP技术在很大程度上决定了摄像头的成像质量。另一方面，本实施例需要在ISP处理前增加图片对比处理的处理器单元，即其实现的是校对模块40的功能。
综上所述，本发明通过采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；然后将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将其中的标准像素点保留，以及将不属于所述标准像素点的其他像素点去除，获得多个第二RAW图像后组合成第三RAW图像。由此，利用了最原始的图像亮度信息进行对比降噪，实现最终输出图像的良好效果。由此，可提高图像的去噪效果，特别是可大幅减少暗环境下拍照的噪点问题，从而提升图像解析力，使拍摄的图像更加清晰，可以拍摄出更多景物的细节，从而提升用户体验，增加产品的市场占有率。
当然，本发明还可有其它多种实施例，在不背离本发明精神及其实质的情况下，熟悉本领域的技术人员当可根据本发明作出各种相应的改变和变形，但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。
Claims (10)
- 一种图像降噪的方法，其特征在于，包括：拍摄步骤，采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；降噪步骤，将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；重组步骤，将多个所述第二RAW图像组合成第三RAW图像。
- 根据权利要求1所述的方法，其特征在于，所述降噪步骤包括：将多个第一RAW图像中的同一拍摄位置的像素点进行对比；在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；在每个第一RAW图像中保留所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中不属于所述标准像素点的像素点删除，获得所述第二RAW图像。
- 根据权利要求1所述的方法，其特征在于，所述方法还包括：校对步骤，将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。
- 根据权利要求1所述的方法，其特征在于，所述方法还包括：图像信号处理步骤，将所述第三RAW图像进行图像信号处理后输出图像。
- 根据权利要求1～4所述的方法，其特征在于，所述摄像头的数目为两个；所述第一RAW图像的数目为两个。
- 一种图像降噪的装置，其特征在于，包括：拍摄模块，用于采用多个摄像头对同一景物进行拍摄，获得多个第一RAW图像；降噪模块，用于将多个所述第一RAW图像中的同一拍摄位置的像素点进行对比，将多个所述同一拍摄位置的像素点中的标准像素点保留，以及将不属于所述标准像素点的像素点去除，获得多个第二RAW图像；重组模块，用于将多个所述第二RAW图像组合成第三RAW图像。
- 根据权利要求6所述的装置，其特征在于，所述降噪模块包括：对比子模块，用于将多个第一RAW图像中的同一拍摄位置的像素点进行对比；选择子模块，用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以上时，选择多个所述同一拍摄位置的像素点中亮度最暗的像素点作为标准像素点；或者用于在多个所述同一拍摄位置的像素点的亮度差异在噪点范围以下时，选择多个所述同一拍摄位置的像素点中亮度最亮的像素点作为标准像素点；删除子模块，用于在每个第一RAW图像中保留同所述同一拍摄位置的所有像素点中的标准像素点，并将所述同一拍摄位置的所有像素点中不属于所述标准像素点的像素点删除，获得所述第二RAW图像。
- 根据权利要求6所述的装置，其特征在于，所述装置还包括：校对模块，用于将多个所述第一RAW图像进行对比，查找每个所述同一拍摄位置在每个所述第一RAW图像上的像素点。
- 根据权利要求8所述的装置，其特征在于，所述装置还包括：图像信号处理模块，用于将所述第三RAW图像进行图像信号处理后输出图像。
- 根据权利要求6～9所述的装置，其特征在于，所述摄像头的数目为两个；所述第一RAW图像的数目为两个。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410729158.2A CN104469191B (zh) | 2014-12-03 | 2014-12-03 | 图像降噪的方法及其装置 |
| CN201410729158.2 | 2014-12-03 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2016086489A1 true WO2016086489A1 (zh) | 2016-06-09 |
Family
ID=52914479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/096001 WO2016086489A1 (zh) | 2014-12-03 | 2014-12-31 | 图像降噪的方法及其装置 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104469191B (zh) |
| WO (1) | WO2016086489A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112950489A (zh) * | 2021-01-12 | 2021-06-11 | 辽宁省视讯技术研究有限公司 | 一种基于多次曝光的三维场降噪的方法 |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105163027A (zh) * | 2015-09-09 | 2015-12-16 | 韩叔桓 | 一种镜头消抖的方法 |
| CN106960455A (zh) * | 2017-03-17 | 2017-07-18 | 宇龙计算机通信科技(深圳)有限公司 | 定向传声方法及终端 |
| CN109951629A (zh) * | 2017-12-21 | 2019-06-28 | 姜鹏飞 | 一种降噪处理方法及装置 |
| WO2020215263A1 (zh) * | 2019-04-24 | 2020-10-29 | 华为技术有限公司 | 一种图像处理方法及装置 |
| CN111147693B (zh) * | 2019-04-28 | 2022-04-29 | 广东小天才科技有限公司 | 一种全尺寸拍照图像的降噪方法及装置 |
| CN110519516B (zh) * | 2019-08-30 | 2020-09-25 | 联想(北京)有限公司 | 一种图像噪点的处理方法、装置及电子设备 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110075010A1 (en) * | 2009-09-30 | 2011-03-31 | Border John N | Methods for capturing and reading out images from an image sensor |
| CN102158684A (zh) * | 2010-02-12 | 2011-08-17 | 王炳立 | 具有图像增强功能的自适应场景图像辅助系统 |
| CN102883108A (zh) * | 2011-07-11 | 2013-01-16 | 佳能株式会社 | 摄像设备及其控制方法、图像处理设备和方法 |
| CN103067671A (zh) * | 2012-12-31 | 2013-04-24 | 华为技术有限公司 | 一种显示图像的方法及装置 |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7463296B2 (en) * | 2004-04-01 | 2008-12-09 | Microsoft Corporation | Digital cameras with luminance correction |
| JP4706466B2 (ja) * | 2005-12-16 | 2011-06-22 | 株式会社日立製作所 | 撮像装置 |
| CN101631202A (zh) * | 2008-07-16 | 2010-01-20 | 肖长诗 | 一种超宽动态范围图像的采集方法 |
| CN103546730A (zh) * | 2012-07-11 | 2014-01-29 | 北京博雅华录视听技术研究院有限公司 | 基于多摄像头的图像感光度增强方法 |
| CN103986874A (zh) * | 2014-05-29 | 2014-08-13 | 宇龙计算机通信科技(深圳)有限公司 | 一种图像获取装置、图像获取方法及终端 |
-
2014
- 2014-12-03 CN CN201410729158.2A patent/CN104469191B/zh active Active
- 2014-12-31 WO PCT/CN2014/096001 patent/WO2016086489A1/zh active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110075010A1 (en) * | 2009-09-30 | 2011-03-31 | Border John N | Methods for capturing and reading out images from an image sensor |
| CN102158684A (zh) * | 2010-02-12 | 2011-08-17 | 王炳立 | 具有图像增强功能的自适应场景图像辅助系统 |
| CN102883108A (zh) * | 2011-07-11 | 2013-01-16 | 佳能株式会社 | 摄像设备及其控制方法、图像处理设备和方法 |
| CN103067671A (zh) * | 2012-12-31 | 2013-04-24 | 华为技术有限公司 | 一种显示图像的方法及装置 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112950489A (zh) * | 2021-01-12 | 2021-06-11 | 辽宁省视讯技术研究有限公司 | 一种基于多次曝光的三维场降噪的方法 |
| CN112950489B (zh) * | 2021-01-12 | 2023-11-03 | 辽宁省视讯技术研究有限公司 | 一种基于多次曝光的三维场降噪的方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104469191B (zh) | 2018-07-27 |
| CN104469191A (zh) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2016086489A1 (zh) | 图像降噪的方法及其装置 | |
| CN108668093B (zh) | Hdr图像的生成方法及装置 | |
| CN112532855B (zh) | 一种图像处理方法和装置 | |
| WO2017016030A1 (zh) | 一种图像处理方法及终端 | |
| US10521891B2 (en) | Image processing apparatus, system, image processing method, and non-transitory recording medium | |
| CN107635103B (zh) | 一种图像处理方法及移动终端和介质产品 | |
| JP2015226144A (ja) | 画像処理システム、撮像装置、画像処理方法およびプログラム | |
| JP5903529B2 (ja) | 撮像装置、撮像方法及び画像処理装置 | |
| CN105960658B (zh) | 图像处理装置、摄像装置、图像处理方法以及可通过计算机处理的非暂时性的存储介质 | |
| US12058471B2 (en) | Image generating system | |
| JP2016081427A (ja) | 画像処装置および画像処理方法、並びにプログラム | |
| JP7297406B2 (ja) | 制御装置、撮像装置、制御方法およびプログラム | |
| CN107464225B (zh) | 图像处理方法、装置、计算机可读存储介质和移动终端 | |
| KR20140106221A (ko) | 다수 이미지 센서를 이용한 촬영방법 및 장치 | |
| JP2013222980A (ja) | 撮像装置及び撮像方法 | |
| KR102199472B1 (ko) | 화상 처리 장치 및 화상 처리 방법 | |
| CN116266877A (zh) | 图像处理设备和方法、摄像设备和计算机可读介质 | |
| KR101143834B1 (ko) | 화이트 밸런스 보정 장치 및 방법 | |
| CN109447925B (zh) | 图像处理方法和装置、存储介质、电子设备 | |
| JP6696596B2 (ja) | 画像処理システム、撮像装置、画像処理方法およびプログラム | |
| JP2021005798A (ja) | 撮像装置、撮像装置の制御方法およびプログラム | |
| JP2016040870A (ja) | 画像処理装置、像形成方法およびプログラム | |
| JP2015119436A (ja) | 撮像装置 | |
| US12052516B2 (en) | Flexible region of interest color processing for cameras | |
| JP2019134332A (ja) | 画像処理装置およびその制御方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14907225 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 31.10.2017) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14907225 Country of ref document: EP Kind code of ref document: A1 |