WO2017071560A1 - Procédé et dispositif de traitement d'image - Google Patents

Procédé et dispositif de traitement d'image Download PDF

Info

Publication number
WO2017071560A1
WO2017071560A1 PCT/CN2016/103239 CN2016103239W WO2017071560A1 WO 2017071560 A1 WO2017071560 A1 WO 2017071560A1 CN 2016103239 W CN2016103239 W CN 2016103239W WO 2017071560 A1 WO2017071560 A1 WO 2017071560A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
brightness
processed
pictures
photographing
Prior art date
Application number
PCT/CN2016/103239
Other languages
English (en)
Chinese (zh)
Inventor
谢书勋
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2017071560A1 publication Critical patent/WO2017071560A1/fr

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/71Circuitry for evaluating the brightness variation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/76Circuitry for compensating brightness variation in the scene by influencing the image signals

Definitions

  • This document relates to, but is not limited to, the field of image processing technology, and in particular, to a picture processing method and apparatus.
  • the mobile terminal cannot achieve long-time exposure when taking a picture, and the picture captured during capturing an instantaneous object or scene is unclear, and even the instantaneously appearing object or scene cannot be captured.
  • Embodiments of the present invention provide a picture processing method and apparatus, which can enable a mobile terminal to clearly capture an instantaneous appearance of an object or a scene.
  • a picture processing apparatus provided by an embodiment of the present invention, where the picture processing apparatus includes:
  • the photographing module is configured to perform an exposure photographing operation every preset time interval
  • Obtaining a module configured to acquire a to-be-processed image in the image obtained by the exposure photographing operation, wherein the brightness of the to-be-processed image is greater than the brightness of the image obtained by the photographing operation when the exposure photographing operation is completed
  • the exposure photographing operation obtains brightness of other pictures in the picture other than the to-be-processed picture
  • a superimposing module configured to superimpose the to-be-processed image to generate a target image when the to-be-processed picture is a continuously photographed picture.
  • the overlay module includes:
  • a first acquiring unit configured to: when the to-be-processed picture includes a plurality of sets of consecutively captured picture groups, acquire a first picture group in which a picture of a maximum brightness value of each of the brightness values corresponding to the picture to be processed is located;
  • a second acquiring unit configured to acquire a maximum brightness value of the second group of pictures other than the first group of pictures in the group of pictures
  • the first superimposing unit is configured to superimpose the first picture group and the maximum brightness respectively when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is less than a preset threshold
  • a second group of pictures having a luminance difference between the value and the maximum luminance value of the first group of pictures is less than a preset threshold to generate a target picture.
  • the overlay module further includes:
  • a second superimposing unit configured to superimpose the first group of pictures to generate a target when a brightness difference between a maximum brightness value of the second picture group and a maximum brightness value of the first picture group is greater than or equal to a preset threshold image.
  • the obtaining module includes:
  • a first picture obtaining unit configured to: when the exposure photographing operation is completed, obtain a picture whose brightness is greater than a preset brightness threshold value in a picture obtained by the exposure photographing operation according to a brightness of a picture obtained by the photographing operation;
  • the second picture obtaining unit is configured to obtain a to-be-processed picture in the picture whose brightness is greater than the preset brightness threshold, wherein the brightness of the to-be-processed picture is greater than the picture to be processed in the picture whose brightness is greater than the preset brightness threshold.
  • the image processing apparatus further includes:
  • a storage module configured to store a picture obtained by the exposure photographing operation and a corresponding photographing moment in real time, and calculate the number of currently stored pictures
  • the module is deleted, and when the number of currently stored pictures reaches a preset threshold, the picture with the earliest photographing time is deleted.
  • the obtaining module is configured to obtain the brightness of the image obtained based on the photographing operation by:
  • the acquiring module is configured to: obtain a red, blue, and green RBG value of the image, and calculate a brightness of the image according to the RBG value of the image:
  • the superimposing module is configured to determine that the to-be-processed picture is a continuously taken picture by:
  • the pictures obtained by photographing are numbered in chronological order, and it is determined whether the number of each picture in the to-be-processed picture is continuous.
  • the photographing module is configured to perform an exposure photographing operation at every preset time interval by:
  • the triggering manner of the photographing instruction includes:
  • the camera command is triggered by the pressure sensor.
  • an embodiment of the present invention further provides a picture processing method, where the picture processing method includes the following steps:
  • the brightness of the image acquired based on the photographing operation acquires a to-be-processed image in the image obtained by the exposure photographing operation, wherein the brightness of the to-be-processed image is greater than the exposure photographing operation to obtain a picture.
  • the picture to be processed is a continuously captured picture
  • the picture to be processed is superimposed to generate a target picture.
  • the step of superimposing the to-be-processed picture to generate a target picture includes:
  • the to-be-processed picture includes a plurality of consecutively captured picture groups, acquiring a first picture group in which the picture of the maximum brightness value of the brightness values corresponding to each picture to be processed is located;
  • the method further includes:
  • the first picture group is superimposed to generate a target picture.
  • the step of acquiring the image to be processed in the image obtained by the exposure photographing operation based on the brightness of the image acquired by the photographing operation comprises:
  • the brightness of the picture acquired based on the photographing operation acquires a picture whose brightness is greater than a preset brightness threshold value in the picture obtained by the exposure photographing operation;
  • the step of performing an exposure photographing operation at every preset time interval and the brightness of the image acquired based on the photographing operation when the exposure photographing operation is completed acquires a to-be-processed image in the image obtained by the exposure photographing operation between the steps, the method further includes:
  • the picture with the earliest photographing time is deleted.
  • obtaining the brightness of the image obtained based on the photographing operation including:
  • the red, blue, and green RBG values of the picture are obtained, and the brightness of the picture is calculated according to the RBG value of the picture, including:
  • determining that the to-be-processed picture is a continuously taken picture includes:
  • the pictures obtained by photographing are numbered in chronological order, and it is determined whether the number of each picture in the to-be-processed picture is continuous.
  • the exposure photographing operation is performed every preset time interval, including:
  • the triggering manner of the photographing instruction includes:
  • the camera command is triggered by the pressure sensor.
  • the photographing module performs the exposure photographing operation every preset time interval, and then, when the exposure photographing operation is completed, the obtaining module obtains the image to be processed in the image obtained by the exposure photographing operation based on the brightness of the image acquired by the photographing operation. Then, when the picture to be processed is a continuously photographed picture, the superimposing module superimposes the to-be-processed picture to generate a target picture, and realizes a picture in which the brightness of the picture obtained according to the exposure photographing operation is greater than the brightness of other pictures to obtain a target picture, so that the target picture instantaneously appears.
  • the scene is more clear.
  • the mobile terminal of the embodiment superimposes the picture of the scene such as lightning that is continuously photographed, and the scene of the lightning generated in the superimposed target picture is more clear. Further, the mobile terminal of the embodiment can also capture the motion trajectory of the object with a faster moving speed, thereby further enriching the photographing function of the mobile terminal.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present invention
  • FIG. 2 is a schematic diagram of functional modules of a first embodiment of a picture processing apparatus according to the present invention
  • FIG. 3 is a brightness distribution diagram of a picture according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a refinement function module of a superimposing module in a second embodiment of the image processing apparatus of the present invention.
  • FIG. 5 is a diagram showing a luminance distribution of a picture according to another embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a refinement function module of an acquisition module in a third embodiment of a picture processing apparatus according to the present invention.
  • FIG. 7 is a schematic diagram of functional modules of a fourth embodiment of a picture processing apparatus according to the present invention.
  • FIG. 8 is a schematic flowchart diagram of a first embodiment of a picture processing method according to the present invention.
  • FIG. 9 is a detailed flow of steps of superimposing a picture to be processed in a second embodiment of a picture processing method according to the present invention.
  • FIG. 10 is a schematic flowchart of a step of obtaining a picture to be processed in a third embodiment of a picture processing method according to the present invention.
  • FIG. 11 is a schematic flowchart diagram of a fourth embodiment of a picture processing method according to the present invention.
  • the mobile terminal can be implemented in various forms.
  • the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PAD Tablett
  • PMP Portable Multimedia Player
  • a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the embodiment of the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • FIG. 1 is a schematic structural diagram of hardware of a mobile terminal that implements various embodiments of the present invention.
  • the photographic lens 1211 is composed of a plurality of optical lenses provided to form a subject image, and is a single focus lens or a zoom lens.
  • the photographic lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focus position of the photographic lens 1211 in accordance with a control signal from the lens driving control circuit 1222, and can also be controlled in the case of the zoom lens. Focus distance.
  • the lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217.
  • An imaging element 1212 is disposed near the position of the subject image.
  • the imaging element 1212 is provided to image the subject image and acquire captured image data.
  • Photodiodes constituting each pixel are arranged two-dimensionally and in a matrix on the imaging element 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode.
  • a red, green, and blue RGB color filter of Bayer arrangement is disposed on the front surface of each pixel.
  • the imaging element 1212 is connected to the imaging circuit 1213.
  • the imaging circuit 1213 performs charge accumulation control and image signal readout control in the imaging element 1212, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.
  • the imaging circuit 1213 is connected to an A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.
  • A/D converter 1214 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.
  • the bus 1227 is a transmission path set to transfer various data read or generated inside the camera.
  • the A/D converter 1214 is connected to the bus 1227, and an image processor 1215, a JPEG processor 1216, a microcomputer 1217, a SDRAM (Synchronous Dynamic Random Access Memory) 1218, and a memory interface are also connected. (hereinafter referred to as memory I/F) 1219, LCD (Liquid Crystal Display) driver 1220.
  • memory I/F memory I/F
  • LCD Liquid Crystal Display
  • the image processor 1215 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 1212. deal with.
  • the JPEG processor 1216 compresses the image data read out from the SDRAM 1218 in accordance with the JPEG compression method when the image data is recorded on the recording medium 1225. Further, the JPEG processor 1216 performs decompression of JPEG image data for image reproduction display.
  • the file recorded on the recording medium 1225 is read, and after the compression processing is performed in the JPEG processor 1216, the decompressed image data is temporarily stored in the SDRAM 1218 and displayed on the LCD 1226.
  • the JPEG method is adopted as the image compression/decompression method.
  • the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.
  • the microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera.
  • the microcomputer 1217 is connected to the operation unit 1223 and the flash memory 1224.
  • the operation unit 1223 includes but is not limited to a physical button or a virtual button, and the entity or virtual button may be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button Buttons, cross keys, OK buttons, delete buttons, zoom buttons, and other input controls such as various input buttons and various input buttons detect the operation status of these operation controls.
  • the detection result is output to the microcomputer 1217. Further, a touch panel is provided on the front surface of the LCD 1226 as a display, and the touch position of the user is detected, and the touch position is output to the microcomputer 1217.
  • the microcomputer 1217 executes various processing sequences corresponding to the user's operation in accordance with the detection result from the operation position of the operation unit 1223.
  • the flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217.
  • the microcomputer 1217 performs overall control of the camera in accordance with the program. Further, the flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.
  • the SDRAM 1218 is an electrically rewritable volatile memory that is set to temporarily store image data or the like.
  • the SDRAM 1218 temporarily stores image data output from the A/D converter 1214 and image data processed in the image processor 1215, the JPEG processor 1216, and the like.
  • the memory interface 1219 is connected to the recording medium 1225, and performs control for writing image data and a file header attached to the image data to the recording medium 1225 and reading out from the recording medium 1225.
  • the recording medium 1225 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body.
  • the recording medium 1225 is not limited thereto, and may be a hard disk or the like built in the camera body.
  • the LCD driver 1210 is connected to the LCD 1226, and stores image data processed by the image processor 1215 in the SDRAM 1218.
  • the image data stored in the SDRAM 1218 is read and displayed on the LCD 1226, or the image data stored in the JPEG processor 1216 is compressed.
  • the JPEG processor 1216 reads the compressed image data of the SDRAM 1218, decompresses it, and displays the decompressed image data through the LCD 1226.
  • the LCD 1226 is configured to display an image on the back of the camera body.
  • the LCD 1226 LCD is not limited thereto, and various display panels (LCD 1226) such as an organic EL may be used.
  • LCD 1226 display panels
  • the present invention is not limited thereto, and various display panels such as an organic EL may be used.
  • Embodiments of the present invention provide a picture processing apparatus.
  • Figure 2 is a picture of the present invention.
  • the image processing apparatus includes:
  • the photographing module 10 is configured to perform an exposure photographing operation every preset time interval
  • the photographing module 10 before the photographing module 10 performs the exposure photographing operation at every preset time interval, it is necessary to configure a continuous shooting application of the camera and an automatic exposure function, for example, setting 60 pictures per second.
  • the photographing module 10 when the photographing instruction is received, the photographing module 10 performs an exposure photographing operation every preset time interval, wherein the triggering manner of the photographing instruction includes: triggering a photographing instruction based on a touch operation triggered by a preset control, for example, The camera has a photographing option in a menu of the mobile terminal, and the user can trigger the photographing instruction when clicking the photographing option in the menu; when the sliding touch operation triggered by the image processing interface is detected, the photographing instruction is triggered, for example, the mobile terminal is installed.
  • the camera application or the like corresponding to the mobile terminal of the embodiment the user can enter the photographing interface by opening the application, and then trigger the photographing instruction when detecting the sliding touch operation triggered by the image processing interface; the pressure is set in the mobile terminal
  • the photographing command can be triggered by the pressure sensor, and the pressure sensor can be disposed on the left side, the right side, the top test or the bottom side of the mobile terminal, etc., when the pressure sensor is detected to change and the change satisfies
  • the photographing instruction can be triggered, wherein,
  • the condition may be that the pressure value of the pressure sensor is greater than or equal to the preset pressure threshold, or the pressing number of the pressing operation of the pressing pressure sensor is greater than or equal to the preset number of times threshold, that is, when the pressure value of the pressure sensor is detected to be greater than or equal to the preset pressure threshold.
  • the photographing instruction may be triggered when the pressing operation is detected and the pressing number of the pressing operation is greater than or equal to the preset number of times threshold, and the preset pressure threshold and the preset number of thresholds may be determined by the user according to their own habits or preferences.
  • the preset pressure threshold and the preset number threshold may also be system default values.
  • the pressing operation of the pressure sensor may be detected, and the pressure value of the pressure sensor is greater than the first value.
  • the preset pressure threshold is two, and the pressing duration of the pressing operation is greater than or equal to the preset duration threshold, the photographing instruction is triggered.
  • the obtaining module 20 is configured to obtain a to-be-processed image in the image obtained by the exposure photographing operation, wherein the brightness of the to-be-processed image is greater than that of the image obtained by the photographing operation when the exposure photographing operation is completed.
  • the exposure photographing operation obtains brightness of other pictures in the picture other than the picture to be processed;
  • the image to be processed is the brightness of the image obtained by the exposure photographing operation is greater than the image to be processed
  • the picture of the brightness of other pictures other than the picture, that is, the minimum brightness in the picture to be processed is larger than the brightness of the picture in which the brightness in the picture is larger than the picture other than the picture to be processed.
  • the brightness of the picture and the picture time corresponding to each picture are generated according to the exposure photographing operation, and when there is a peak in the generated brightness distribution map, if the brightness of the picture corresponding to the peak is greater than the brightness distribution map If the other location corresponds to the brightness of the picture, the picture corresponding to the peak is the picture to be processed.
  • the brightness of the picture obtained by the exposure photographing operation may be calculated after the exposure photographing operation is completed, or the brightness of the image obtained by the exposure photographing operation may be calculated when each image is obtained by the exposure photographing operation; wherein the exposure photographing operation is obtained
  • the RGB values of the pictures can be first obtained, and then the brightness of each picture can be separately calculated according to the brightness value calculation formula; in another case, the RGB of each pixel point in each picture can be obtained separately.
  • the completion of the exposure photographing operation refers to the user stopping the exposure photographing operation of the mobile terminal.
  • the mobile terminal may stop when the duration of the exposure photographing operation reaches the set time or the obtained image of the exposure photographing operation reaches a preset number. The photographing operation is exposed, at which time the brightness of each picture obtained by the exposure photographing operation is separately calculated.
  • the superimposing module 30 is configured to superimpose the to-be-processed image to generate a target image when the to-be-processed picture is a continuously captured picture.
  • the mobile terminal stores the photographing time and the like together, and the superimposing module 30 determines whether the image to be processed acquired by the obtaining module 20 is a continuously photographed image, for example, determining each of the to-be-processed images. Whether the picture is a picture obtained by photographing at intervals of time-lapse photographing, or determining whether each photographing moment of the to-be-processed picture is a time interval of continuous interval timing photographing, of course, for convenience of processing, photographing may be obtained when photographing The pictures are sorted or numbered in chronological order.
  • the superimposing module 30 superimposes the to-be-processed picture to generate a target picture, wherein, when performing image superimposition, the following may be adopted.
  • Performing a weighted average superposition process on the luminance values of each picture in the picture that is, assigning a higher weight coefficient to the picture with higher luminance value in the picture to be processed, and assigning a lower picture to the picture with lower brightness value in the picture to be processed.
  • Weight coefficient may be limited. For example, when the number of pictures to be processed is greater than or equal to 5, the operation of superimposing the picture to be processed is performed, and when the number of pictures to be processed is less than 5 Then no overlay operation is performed.
  • the mobile terminal in this embodiment can be applied to a mobile terminal such as a mobile phone.
  • a mobile terminal such as a mobile phone.
  • the pictures in the to-be-processed picture are not all consecutively taken pictures, and may be superimposed separately. Continuously taken pictures in the image to be processed.
  • FIG. 3 is a brightness distribution diagram of a picture obtained by 30 time-lapse photographing operations, that is, a brightness distribution value of a picture obtained according to 30 time-lapse photographing operations and a brightness distribution map formed by photographing moments corresponding to each picture, FIG. 3
  • the preset threshold is 50, and there are consecutively captured groups of pictures whose luminance values are greater than 50. Therefore, the to-be-processed picture is superimposed by the overlay module 30 to generate a target picture.
  • the picture obtained by the timed photographing operation is a lightning strike.
  • the target image generated by superimposing the overlay module 30 can clearly reflect the shape of the lightning.
  • the mobile terminal may set one or more sets of preset brightness values, and then calculate the brightness of the picture obtained by the exposure photographing operation in real time when the photographing module 10 performs the exposure photographing operation every preset time interval;
  • the picture is taken as the picture to be processed, and then the step of calculating the brightness of the picture obtained by the exposure taking operation in real time is performed;
  • the picture to be processed is superimposed to generate Target the image and delete all the images currently available for the pending image and the exposure photo operation. That is, when the picture is obtained, the brightness of the current picture is greater than the preset brightness value.
  • the picture to be processed is updated based on the current picture, and the current picture is added to the picture to be processed. If the brightness of the current picture is less than or equal to the preset brightness value, the picture to be processed is superimposed to generate a target picture, and the picture in the picture to be processed is deleted, of course, the number of pictures to be processed is greater than 1, that is, the number of pictures to be processed When it is greater than 1, the to-be-processed picture is superimposed to generate a target picture.
  • the preset brightness value is a preset brightness of the mobile terminal.
  • different preset brightness values may be set according to different environments, such as environmental factors such as weather and time, and scenes that may take pictures. Setting a different preset brightness value; because the mobile terminal of the embodiment is used to process a picture of an object that appears in an instant of shooting, that is, an object that appears in the picture except for an instant The other scenes are unchanged or basically unchanged, so the brightness value of any picture other than the picture containing the momentarily appearing object can be taken as the preset brightness value of the current photographing environment, of course, The preset brightness value of the current photographing environment is determined by other means before photographing.
  • the photographing module 10 performs an exposure photographing operation every preset time interval, and then, when the exposure photographing operation is completed, the brightness of the image acquired by the obtaining module 20 based on the photographing operation is acquired in the image obtained by the exposure photographing operation. Processing the picture, and then, when the picture to be processed is a continuously taken picture, the superimposing module 30 superimposes the picture to be processed to generate a target picture, and realizes a picture in which the brightness of the picture obtained according to the exposure photographing operation is greater than the brightness of other pictures to obtain a target picture, so that the target is obtained.
  • the scene that appears instantaneously in the picture is more clear.
  • the mobile terminal of the embodiment superimposes the picture of the scene such as lightning that is continuously photographed, and the scene of the lightning generated in the superimposed target picture is more clear, thereby improving the user experience.
  • the mobile terminal of the embodiment can also capture the motion trajectory of the object with a faster moving speed, thereby further enriching the photographing function of the mobile terminal.
  • the overlay module 30 includes:
  • the first obtaining unit 31 is configured to: when the to-be-processed picture includes a plurality of groups of consecutively captured picture groups, acquire a first picture group in which a picture of a maximum brightness value of each of the brightness values corresponding to the picture to be processed is located;
  • the picture to be processed includes multiple groups of consecutively taken picture groups.
  • the picture group in the picture to be processed is not consistent with the picture time of other picture groups. In this case, the picture with the maximum brightness value of the brightness value corresponding to the picture to be processed is located.
  • the picture group is the first picture group.
  • the second obtaining unit 32 is configured to acquire a maximum brightness value of the second group of pictures other than the first group of pictures in the group of pictures;
  • the second picture group is a picture group other than the first picture group in the picture group of the picture to be processed.
  • the second obtaining unit 32 acquires the maximum brightness value of each second picture group.
  • the first superimposing unit 33 is configured to superimpose the first picture group and the first picture group respectively when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is less than a preset threshold A second group of pictures having a luminance difference between the maximum luminance value and the maximum luminance value of the first group of pictures is less than a preset threshold to generate a target picture.
  • the preset threshold is a preset brightness difference
  • the first picture group is superimposed by the first superimposing unit 43 and the second picture with a brightness difference between the maximum brightness value and the maximum brightness value of the first picture group is less than a preset threshold.
  • the superimposing module 30 further includes: a second superimposing unit, configured to set a brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group to be greater than or When the threshold is equal to the preset threshold, the first group of pictures is superimposed to generate a target picture.
  • a second superimposing unit configured to set a brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group to be greater than or When the threshold is equal to the preset threshold, the first group of pictures is superimposed to generate a target picture.
  • the second superimposing unit When the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group in the to-be-processed picture is greater than or equal to a preset threshold, the second superimposing unit only superimposes the first picture group to generate a target picture. In order to avoid the phenomenon that the target image generated by the camera operation and the image processing process is far away from other target images or does not include the target scene.
  • FIG. 5 is a brightness distribution diagram of a picture obtained by taking 50 timed photographs, that is, a brightness distribution value of a picture obtained according to 50 time-lapse photographs and a brightness distribution map formed by photographing moments corresponding to each picture, and FIG.
  • the threshold be 50, and there are two consecutive groups of pictures with brightness values greater than 50 in the figure.
  • the preset threshold can be set to 10.
  • the maximum brightness value of the second picture group and the maximum of the first picture group can be seen from the figure.
  • the brightness difference between the brightness values is less than the preset threshold value 10.
  • the first superimposing unit 43 respectively superimposes the two groups of picture groups to generate two target pictures, for example, when the picture obtained by timing photographing is a picture obtained by photographing lightning, After processing by the first superimposing unit 43, two different pictures containing lightning can be obtained.
  • the first acquiring unit 31 acquires the first picture group in which the picture with the highest brightness value of the brightness value corresponding to the picture to be processed is located, and then obtains the second picture group.
  • the unit 32 obtains a maximum brightness value of the second picture group except the first picture group in the picture group, and then has a maximum brightness value of the second picture group and a maximum brightness value of the first picture group.
  • the first superimposing unit 33 When the brightness difference between the two is less than the preset threshold, the first superimposing unit 33 respectively superimposes the first picture group and the brightness between the maximum brightness value and the maximum brightness value of the first picture group.
  • the second picture group whose degree difference is smaller than the preset threshold is used to generate the target picture, and the picture group continuously captured in the to-be-processed picture is superimposed according to the preset threshold, thereby ensuring the accuracy and consistency of each target picture, and avoiding the photographing operation.
  • the error of the image processing process causes the generated target image to be far from the other target images or does not include the target scene.
  • the obtaining module 20 includes:
  • the first picture obtaining unit 21 is configured to, when the exposure photographing operation is completed, obtain a picture whose brightness is greater than a preset brightness threshold value in a picture obtained by the exposure photographing operation according to a brightness of a picture acquired according to the photographing operation;
  • the preset brightness threshold is a preset brightness of the mobile terminal.
  • the preset brightness threshold is set according to the camera function of the mobile terminal.
  • the camera environment should be considered when setting the preset brightness threshold.
  • the mobile terminal can Setting different preset brightness thresholds according to different environments, for example, setting different preset brightness thresholds according to environmental factors such as weather and time, and scenes that may take pictures, and the like;
  • the picture of the object that appears, that is, the scene other than the object that appears in the picture is constant or basically unchanged, so you can take any picture other than the picture of the object that appears in an instant.
  • the brightness value is used as the preset brightness threshold of the current photographing environment.
  • the preset brightness threshold of the current photographing environment may be determined by other methods before photographing.
  • the second picture obtaining unit 22 is configured to obtain a to-be-processed picture in the picture whose brightness is greater than the preset brightness threshold, wherein the brightness of the to-be-processed picture is greater than the obtained picture in which the brightness is greater than the preset brightness threshold. The brightness of other pictures outside the picture.
  • the first picture acquiring unit 21 obtains a picture whose brightness is greater than a preset brightness threshold value in the picture obtained by the exposure photographing operation based on the brightness of the picture acquired by the photographing operation, and then The image acquisition unit 22 obtains the to-be-processed image in the obtained image with the brightness greater than the preset brightness threshold, and implements the image to be processed according to the preset brightness threshold, thereby improving the accuracy of the image to be processed, thereby ensuring the target image. accuracy.
  • a fourth embodiment of the image processing apparatus of the present invention is proposed based on the first embodiment.
  • the image processing apparatus further includes:
  • the storage module 40 is configured to store a picture obtained by the exposure photographing operation and a corresponding photographing moment in real time, and calculate the number of currently stored pictures;
  • the storage module 40 stores the image obtained by the photographing operation and the photographing moment corresponding to the image, and calculates the number of the images stored at the current time.
  • the photographing may be obtained when photographing.
  • the pictures are sequentially numbered in chronological order, and the number of pictures currently stored at the current time can be obtained according to the number of the current picture and the picture obtained by the first timed picture.
  • the deleting module 50 is configured to delete the picture with the earliest photographing time when the number of currently stored pictures reaches a preset threshold.
  • the preset threshold is a maximum value of the picture obtained by the user-set mobile terminal to store the timed photograph. For example, when the time interval of the timed photographing is 1 second, the preset threshold may be set to 180, and the mobile terminal only saves the mobile terminal.
  • the picture obtained by photographing in the last 3 minutes when the number of currently stored pictures is greater than a preset threshold, the deleting module 50 deletes the picture with the earliest picture time, so that the number of pictures stored by the mobile terminal is less than or equal to a preset threshold, thereby ensuring the movement.
  • the terminal currently has enough storage space to store subsequent pictures.
  • the picture obtained by the exposure photographing operation and the corresponding photographing time are stored in real time by the storage module 40, and the number of currently stored pictures is calculated, and then when the number of currently stored pictures reaches a preset threshold,
  • the deleting module 50 deletes the picture with the earliest photographing time, so that the number of pictures stored by the mobile terminal is less than or equal to a preset threshold, thereby ensuring that the mobile terminal currently has enough storage space to store the subsequently taken pictures.
  • FIG. 8 is a schematic flowchart diagram of a first embodiment of a picture processing method according to the present invention.
  • the image processing method includes:
  • Step S10 performing an exposure photographing operation every preset time interval
  • the mobile terminal performs an exposure photographing operation every preset time interval. Before, you need to configure the camera's continuous shooting and auto exposure functions, such as setting up 60 images per second.
  • the mobile terminal when the photographing instruction is received, the mobile terminal performs an exposure photographing operation at a preset time interval, wherein the triggering manner of the photographing instruction includes: triggering a photographing instruction based on a touch operation triggered by the preset control, for example, A photographing option is provided in a menu of the mobile terminal, and the user can trigger a photographing instruction when clicking the photographing option in the menu; and triggering a photographing instruction when detecting a sliding touch operation triggered based on the image processing interface, for example, the mobile terminal is installed with In the camera application or the like corresponding to the mobile terminal of the embodiment, the user can enter the photographing interface by opening the application, and then trigger a photographing instruction when detecting a sliding touch operation triggered by the image processing interface; and the pressure sensor is provided at the mobile terminal.
  • the pressure sensor When the camera command is triggered by the pressure sensor, the pressure sensor can be disposed on the left side, the right side, the top test or the bottom side of the mobile terminal, etc., and the change of the pressure sensor is detected and the change meets the preset.
  • the camera command can be triggered when the condition is met, wherein the preset
  • the pressure value of the pressure sensor may be greater than or equal to the preset pressure threshold, or the pressing time of pressing the pressure sensor may be greater than or equal to the preset number threshold, that is, when the pressure value of the pressure sensor is detected to be greater than or equal to the preset pressure threshold.
  • the photographing instruction may be triggered when the pressing operation is detected and the pressing number of the pressing operation is greater than or equal to the preset number of times threshold, and the preset pressure threshold and the preset number of thresholds may be determined by the user according to their own habits or preferences.
  • the preset pressure threshold and the preset number threshold may also be system default values.
  • the pressing operation of the pressure sensor may be detected, and the pressure value of the pressure sensor is greater than the first value.
  • the preset pressure threshold is two, and the pressing duration of the pressing operation is greater than or equal to the preset duration threshold, the photographing instruction is triggered.
  • step S20 when the exposure photographing operation is completed, the brightness of the image acquired based on the photographing operation acquires a to-be-processed image in the image obtained by the exposure photographing operation, wherein the brightness of the to-be-processed image is greater than the exposure photographing
  • the operation obtains the brightness of other pictures in the picture other than the picture to be processed
  • the picture to be processed is a picture in which the brightness of the picture obtained by the exposure taking operation is greater than the brightness of the picture other than the picture to be processed, that is, the minimum brightness in the picture to be processed is larger than the exposure picture operation, and the brightness in the picture is greater than the picture to be processed.
  • the brightness of the picture and the picture time corresponding to each picture are generated according to the exposure photographing operation, and the brightness of the picture corresponding to the peak is generated when there is a peak in the generated brightness distribution map. If the brightness of the picture corresponding to the other position in the brightness distribution map is greater than the picture, the picture corresponding to the peak is the picture to be processed.
  • the brightness of the picture obtained by the exposure photographing operation may be calculated after the exposure photographing operation is completed, or the brightness of the image obtained by the exposure photographing operation may be calculated when each image is obtained by the exposure photographing operation; wherein the exposure photographing operation is obtained
  • the RGB values of the pictures can be first obtained, and then the brightness of each picture can be separately calculated according to the brightness value calculation formula; in another case, the RGB of each pixel point in each picture can be obtained separately.
  • the completion of the exposure photographing operation refers to the user stopping the exposure photographing operation of the mobile terminal.
  • the mobile terminal may stop when the duration of the exposure photographing operation reaches the set time or the obtained image of the exposure photographing operation reaches a preset number. The photographing operation is exposed, at which time the brightness of each picture obtained by the exposure photographing operation is separately calculated.
  • Step S30 When the picture to be processed is a continuously captured picture, the picture to be processed is superimposed to generate a target picture.
  • the mobile terminal stores the photographing time and other information correspondingly, and determines whether the acquired image to be processed is a continuously photographed image, for example, determining whether each image in the image to be processed is photographed at intervals.
  • the time interval is taken to take a picture, or it is determined whether each picture time of the picture to be processed is a time interval of consecutive time-lapse picture taking.
  • the pictures obtained by taking pictures may be chronologically performed during photographing. Sorting or numbering in sequence, it is only necessary to determine whether each picture in the image to be processed is a continuously arranged picture or to determine whether the number of each picture in the picture to be processed is continuous.
  • the picture to be processed is superimposed to generate a target picture, wherein, when performing picture superposition, a superimposition of weighted average according to the brightness value of each picture in the picture to be processed may be adopted.
  • the processing is to assign a higher weight coefficient to the picture with higher brightness value in the picture to be processed, and assign a lower weight coefficient to the picture with lower brightness value in the picture to be processed.
  • the number of pictures to be processed may be limited. For example, when the number of pictures to be processed is greater than or equal to 5, the operation of superimposing the picture to be processed is performed, and the number of pictures to be processed is small. At 5 o'clock, no superposition operation is performed.
  • the mobile terminal in this embodiment can be applied to a mobile terminal such as a mobile phone.
  • a mobile terminal such as a mobile phone.
  • the pictures in the to-be-processed picture are not all consecutively taken pictures, and may be superimposed separately. Continuously taken pictures in the image to be processed.
  • the exposure photographing operation is performed every preset time interval, and then, when the exposure photographing operation is completed, the brightness of the image acquired based on the photographing operation acquires the to-be-processed image in the image obtained by the exposure photographing operation, and then waits
  • the picture is processed as a continuous picture
  • the image to be processed is superimposed to generate a target picture
  • the picture obtained by the exposure picture operation is brighter than the picture of other pictures, and the target picture is obtained, so that the scene appearing in the target picture is clearer.
  • the mobile terminal of the present embodiment superimposes the picture of the scene such as lightning that is continuously photographed, and the scene of the lightning generated in the superimposed target picture is more clear, thereby improving the user experience.
  • the mobile terminal of the embodiment can also capture the motion trajectory of the object with a faster moving speed, thereby further enriching the photographing function of the mobile terminal.
  • step S30 includes:
  • Step S31 When the to-be-processed picture includes multiple sets of consecutively captured picture groups, obtain a first picture group in which the picture with the highest brightness value among the brightness values corresponding to each picture to be processed is located;
  • the picture to be processed includes multiple groups of consecutively taken picture groups.
  • the picture group in the picture to be processed is not consistent with the picture time of other picture groups. In this case, the picture with the maximum brightness value of the brightness value corresponding to the picture to be processed is located.
  • the picture group is the first picture group.
  • Step S32 Acquire a maximum brightness value of the second picture group except the first picture group in the picture group.
  • the second picture group is a picture group other than the first picture group in the picture group of the picture to be processed.
  • Step S33 when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is less than a preset threshold, respectively superimposing the first picture group and the maximum brightness value and the a second picture group in which the luminance difference between the maximum luminance values of the first picture group is less than a preset threshold To generate a target image;
  • the preset threshold is a preset brightness difference
  • the target picture is generated by superimposing the first picture group and the second picture group whose luminance difference between the maximum brightness value and the maximum brightness value of the first picture group is less than a preset threshold.
  • step S30 further includes: the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is greater than or equal to a preset threshold. At the time, the first group of pictures is superimposed to generate a target picture.
  • the second superimposing unit When the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group in the to-be-processed picture is greater than or equal to a preset threshold, the second superimposing unit only superimposes the first picture group to generate a target picture. In order to avoid the phenomenon that the target image generated by the camera operation and the image processing process is far away from other target images or does not include the target scene.
  • the first picture group in which the picture with the highest brightness value of the brightness value corresponding to each picture to be processed is located is obtained, and then each picture is obtained.
  • the maximum brightness value of the second picture group except the first picture group in the group, and then the luminance difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is less than
  • the threshold image is superimposed on the consecutively captured image groups in the image to be processed, ensuring the accuracy and consistency of each target image, and avoiding the target image generated by the camera operation and the image processing process being far from the other target images or Does not include the phenomenon of the target scene.
  • step S20 includes
  • Step S21 when the exposure photographing operation is completed, the brightness of the picture acquired based on the photographing operation acquires a picture whose brightness is greater than a preset brightness threshold value in the picture obtained by the exposure photographing operation;
  • the preset brightness threshold is a preset brightness of the mobile terminal.
  • the preset brightness is The threshold is set according to the camera function of the mobile terminal.
  • the camera environment should be considered as much as possible when setting the preset brightness threshold.
  • the mobile terminal can set different preset brightness thresholds according to different environments, for example, according to environmental factors such as weather and time.
  • the preset brightness threshold may be set by factors such as the scene of the photographed picture; the mobile terminal of the embodiment is used to process the picture of the object appearing at the moment of shooting, that is, the scene other than the object that appears in the picture is not Changed or basically unchanged, so the brightness value of any picture other than the picture containing the momentarily appearing object can be taken as the preset brightness threshold of the current photographing environment, and of course, other methods can be used before photographing. Determine the preset brightness threshold of the current photo environment.
  • Step S22 Acquire a to-be-processed picture in the acquired picture whose brightness is greater than the preset brightness threshold, wherein the brightness of the to-be-processed picture is greater than the picture other than the to-be-processed picture in the picture whose brightness is greater than the preset brightness threshold. Brightness.
  • the brightness of the image acquired based on the photographing operation acquires a picture whose brightness is greater than the preset brightness threshold value in the image obtained by the exposure photographing operation, and then the acquired brightness is greater than the preset.
  • the image to be processed is obtained in the image of the brightness threshold, and the image to be processed is obtained according to the preset brightness threshold, thereby improving the accuracy of the image to be processed, thereby ensuring the accuracy of the target image.
  • a fourth embodiment of the image processing method of the present invention is proposed based on the first embodiment. Referring to FIG. 11, in the embodiment, between step S10 and step S20, the image processing method further includes:
  • Step S40 storing a picture obtained by the exposure photographing operation and a corresponding photographing moment in real time, and calculating the number of currently stored pictures;
  • the image obtained by the photographing operation and the photographing moment corresponding to the photograph are stored, and the number of the photographs stored at the current time is calculated.
  • the photographed photograph may also be photographed according to the photographing.
  • the time sequence is sequentially numbered, and the number of pictures currently stored at the current time can be obtained according to the number of the current picture and the picture obtained by the first timed picture.
  • step S50 when the number of currently stored pictures reaches a preset threshold, the picture with the earliest photographing time is deleted.
  • the preset threshold is a mobile terminal that is set by the user and stores the timed photo to obtain the most pictures.
  • a large value for example, when the time interval of the timed photo is 1 second, the preset threshold can be set to 180.
  • the mobile terminal only saves the picture obtained by taking the picture in the last 3 minutes, and the number of currently stored pictures is greater than the preset.
  • the threshold is used, the picture with the earliest photographing time is deleted, so that the number of pictures stored by the mobile terminal is less than or equal to a preset threshold, thereby ensuring that the mobile terminal currently has enough storage space to store the subsequently taken pictures.
  • the picture obtained by the exposure photographing operation and the corresponding photographing time are stored in real time, and the number of currently stored pictures is calculated, and then when the number of currently stored pictures reaches a preset threshold, the The picture of the earliest picture is taken, so that the number of pictures stored by the mobile terminal is less than or equal to a preset threshold, thereby ensuring that the mobile terminal currently has enough storage space to store the subsequently taken pictures.
  • the above technical solution makes the scene appearing in the target picture more clear, and can also capture the motion track of the object with faster moving speed, thereby making the camera function of the mobile terminal more abundant.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

L'invention concerne un dispositif de traitement d'image et un procédé, le dispositif comprenant : un module de photographie configuré pour effectuer une opération de photographie d'exposition à chaque intervalle prédéterminé ; un module d'acquisition configuré pour acquérir des images à traiter à partir des images obtenues par l'opération de photographie d'exposition en fonction de la luminosité des images obtenues, lorsque le mode de photographie d'exposition est achevé ; un module de superposition configuré pour superposer les images à traiter pour générer une image cible lorsque les images à traiter sont des images capturées en continu. La solution technique permet d'obtenir une image cible selon les images ayant une luminosité supérieure parmi des images acquises par l'opération de photographie d'exposition de façon à rendre plus claires les scènes instantanées dans l'image cible.
PCT/CN2016/103239 2015-10-30 2016-10-25 Procédé et dispositif de traitement d'image WO2017071560A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510731507.9 2015-10-30
CN201510731507.9A CN105357447B (zh) 2015-10-30 2015-10-30 图片处理方法及装置

Publications (1)

Publication Number Publication Date
WO2017071560A1 true WO2017071560A1 (fr) 2017-05-04

Family

ID=55333297

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/103239 WO2017071560A1 (fr) 2015-10-30 2016-10-25 Procédé et dispositif de traitement d'image

Country Status (2)

Country Link
CN (1) CN105357447B (fr)
WO (1) WO2017071560A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357447B (zh) * 2015-10-30 2020-03-13 努比亚技术有限公司 图片处理方法及装置
WO2019041173A1 (fr) * 2017-08-30 2019-03-07 深圳市红狐狸智能科技有限公司 Système de photographie cyclique et procédé pour celui-ci

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1481143A (zh) * 2002-09-03 2004-03-10 力捷电脑股份有限公司 识别异常图像的方法
CN1499823A (zh) * 2002-11-05 2004-05-26 奥林巴斯株式会社 照相机
CN1506686A (zh) * 2002-12-09 2004-06-23 北京中星微电子有限公司 运动图像检测方法
CN1517784A (zh) * 2003-01-17 2004-08-04 精工爱普生株式会社 图像处理系统,投影机和图像处理方法
CN105357447A (zh) * 2015-10-30 2016-02-24 努比亚技术有限公司 图片处理方法及装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6853806B2 (en) * 2002-09-13 2005-02-08 Olympus Optical Co., Ltd. Camera with an exposure control function
CN103293825B (zh) * 2013-06-26 2014-11-26 深圳市中兴移动通信有限公司 多重曝光方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1481143A (zh) * 2002-09-03 2004-03-10 力捷电脑股份有限公司 识别异常图像的方法
CN1499823A (zh) * 2002-11-05 2004-05-26 奥林巴斯株式会社 照相机
CN1506686A (zh) * 2002-12-09 2004-06-23 北京中星微电子有限公司 运动图像检测方法
CN1517784A (zh) * 2003-01-17 2004-08-04 精工爱普生株式会社 图像处理系统,投影机和图像处理方法
CN105357447A (zh) * 2015-10-30 2016-02-24 努比亚技术有限公司 图片处理方法及装置

Also Published As

Publication number Publication date
CN105357447B (zh) 2020-03-13
CN105357447A (zh) 2016-02-24

Similar Documents

Publication Publication Date Title
US10477093B2 (en) Method for capturing image and image capturing apparatus for capturing still images of an object at a desired time point
WO2016023406A1 (fr) Procédé de prise de vue pour trace de déplacement d'objet, terminal mobile et support de stockage informatique
US10419661B2 (en) Shooting method and shooting device
US9195880B1 (en) Interactive viewer for image stacks
WO2017050125A1 (fr) Procédé et dispositif d'indication d'angle de caméra, terminal, et support de stockage informatique
WO2016000515A1 (fr) Procédé et dispositif pour filmer une vidéo de traînée d'étoile, et support de stockage informatique
US9092659B2 (en) Subject determination apparatus that determines whether or not subject is specific subject
WO2016008359A1 (fr) Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique
US20170302848A1 (en) Photographing method, device and computer storage medium
WO2016011859A1 (fr) Procédé pour filmer une vidéo en peinture de lumière, terminal mobile, et support d'enregistrement
JP6652039B2 (ja) 撮像装置、撮像方法及びプログラム
US8860840B2 (en) Light source estimation device, light source estimation method, light source estimation program, and imaging apparatus
WO2016029746A1 (fr) Procédé de prise de vue, dispositif de prise de vue et support d'enregistrement informatique
WO2016011872A1 (fr) Procédé et appareil de photographie d'une image et support de stockage informatique
WO2017080348A2 (fr) Dispositif et procédé de photographie basée sur une scène, et support d'informations pour ordinateur
JP5125734B2 (ja) 撮像装置、画像選択方法及び画像選択プログラム
WO2016004819A1 (fr) Procede de prise de vue, dispositif de prise de vue et support de stockage informatique
US8295609B2 (en) Image processing apparatus, image processing method and computer readable-medium
US20140369611A1 (en) Image processing apparatus and control method thereof
WO2016000514A1 (fr) Procédé et dispositif servant à filmer une vidéo de nébuleuse et support informatique d'informations
US9986163B2 (en) Digital photographing apparatus and digital photographing method
WO2017128914A1 (fr) Procédé et dispositif de photographie
JP6230386B2 (ja) 画像処理装置、画像処理方法及び画像処理プログラム
KR102351496B1 (ko) 영상 처리 장치 및 그 동작 방법
WO2017071560A1 (fr) Procédé et dispositif de traitement d'image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16858995

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16858995

Country of ref document: EP

Kind code of ref document: A1