WO2017161496A1 - 条纹集合查找方法、装置以及系统 - Google Patents
条纹集合查找方法、装置以及系统 Download PDFInfo
- Publication number
- WO2017161496A1 WO2017161496A1 PCT/CN2016/076980 CN2016076980W WO2017161496A1 WO 2017161496 A1 WO2017161496 A1 WO 2017161496A1 CN 2016076980 W CN2016076980 W CN 2016076980W WO 2017161496 A1 WO2017161496 A1 WO 2017161496A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stripe
- connected domain
- stripe set
- image
- target connected
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10141—Special mode during image acquisition
- G06T2207/10152—Varying illumination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30204—Marker
- G06T2207/30208—Marker matrix
Definitions
- the present application relates to the field of image processing, and in particular, to a stripe set searching method, apparatus, and system.
- the prior art provides a motion tracking system capable of performing image acquisition on a light spot of a moving object by image processing to achieve tracking of the moving object.
- the striped pattern generated by the blinking light source is incomplete in the original image, which may cause interference to the image recognition.
- An object of the application of the embodiments of the present invention is to provide a method for eliminating a stripe set that is incomplete.
- the method before the acquiring the plurality of first connectivity domains in the binarized image, the method further includes: receiving a single frame original image acquired by the rolling image sensor Wherein the original image comprises a striped pattern formed by a scintillating light source; according to a binarization threshold Value, the original image is binarized to obtain a binarized image.
- the method after receiving the original image acquired by the rolling-edge image sensor, before selecting the target connected domain from the plurality of first connected domains, the method includes: The original image is processed to obtain a striped graphic template, and the target connected domain is identified according to the striped graphic template, wherein the shape of the striped graphic template is a patch shape in which the striped pattern in the original image is fused.
- the identifying the target connectivity domain according to the stripe graphics template is: determining a pixel of the first connectivity domain Whether the coordinates are all included in the set of coordinates of the pixel points of the stripe pattern template; if so, the first connected domain is determined to be the target connected domain.
- the classifying the target connected domain to obtain the multiple stripe set comprises: forming a stripe according to the target connected domain a condition of the set, determining an initial stripe set, filtering the target connected domain that is not classified into any initial stripe set; selecting the jth target connected domain from the target connected domain that is not included in any initial stripe set, where j a positive integer; a center of the centroid of the jth target connected domain, a circle of the length of the jth target connected domain as a diameter; determining whether any one of the initial connected regions in the initial stripe set is The circles intersect; if intersected, the jth target connected domain is classified into the corresponding initial stripe set, thereby obtaining a stripe set.
- the center of the striped pattern is calculated according to the target connected domain in the stripe set Specifically, the coordinate values of the center of the target connected domain in the stripe set are averaged to obtain coordinate values of the center of the stripe pattern.
- the coordinate values of the center of the target connected domain in the stripe set are averaged according to formula (1)
- the method further includes: pixel value of a pixel point in the rectangular area Q Filtering to obtain a filtered pixel value, wherein the rectangular region Q is centered on a center (u 0 , v 0 ) of the stripe pattern, and a rectangle having a width of a largest connected domain in the stripe set is a side length a region; recalculating a coordinate value of a center (u 0 , v 0 ) of the stripe pattern with a pixel value of the filtered pixel as a weight.
- the pixel value of the filtered pixel point is used as a weight to recalculate the center of the striped pattern
- the coordinate values of (u 0 , v 0 ) are specifically:
- the determining whether the stripe set is The effective stripe set specifically includes:
- R is the width of the largest connected domain in the set of stripes
- kwide is the width of the binarized image
- kheight is the height of the binarized image
- a second aspect of the present invention provides a stripe set validity determining apparatus, the apparatus comprising means capable of implementing the method of any of the above.
- a fifth aspect of the present invention provides an image processing apparatus including: a processor and a memory, wherein the processor is coupled to the memory, the memory is configured to store an instruction, and the processor is configured to execute the instruction when When the processor executes the instructions, the method of any of the above may be performed according to the instructions to perform processing on the image collected by the rolling image sensor to determine the validity of the stripe set.
- a sixth aspect of the present invention provides an image processing system including a rolling type image sensor and an image processing apparatus, the image processing apparatus being coupled to the rolling type image sensor, wherein the image processing apparatus is as described above Image processing device.
- a seventh aspect of the present invention provides a moving object tracking system including a rolling type image sensor, a controller provided with a scintillating light source, and an image processing apparatus, the image processing apparatus coupling the rolling type image sensor and the A controller, wherein the controller is mounted on a moving object, the image processing device being an image processing device as described above.
- An eighth aspect of the invention provides a computer readable storage medium storing program code for determining validity of a stripe set, the program code comprising means for performing the method of any of the above Instructions.
- FIG. 1 is a schematic structural diagram of a motion tracking system according to an embodiment of the present invention.
- FIG. 3 is a schematic diagram of an original image captured by a rolling type image sensor in an actual working environment in an exercise tracking system according to an embodiment of the present invention
- FIG. 6 is an image obtained after performing step 440 in a stripe set searching method according to an embodiment of the present invention.
- FIG. 7 is an image obtained after performing step 450 in a stripe set searching method according to an embodiment of the present invention.
- FIG. 8 is an image obtained after performing step 470 in a stripe set searching method according to an embodiment of the present invention.
- FIG. 9 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
- the rolling type image sensor 110 is an image sensor having a rolling shutter function, for example, a CMOS (Complementary Metal Oxide Semiconductor) sensor provided with an electronic rolling shutter and A CCD (Charge-coupled Device) sensor or the like provided with a rolling shutter is provided.
- the roller-type image sensor can be disposed on the image processing device or on a separate third-party device.
- the rolling type image sensor is scanned by a line scan or a column scan for an image sensor having a rolling shutter function.
- the blinking frequency of the scintillating light source is greater than the scanning frequency of the rolling image sensor 110, after the rolling image sensor 110 completes the scanning of the scintillating light source, a pattern composed of a plurality of light and dark spaced stripes appears correspondingly in the original image. .
- the spot shape formed by the fluorescent lamps 310 in the environment is inevitably present in the original image.
- the pattern and the spot-like pattern formed by the incandescent lamp 320 Therefore, after the rolling image sensor 110 acquires the original image, the original image needs to be sent to the image processing device, and the original image is image processed by the image processing device to exclude the spotted pattern and incandescence formed by the fluorescent lamp 310.
- the effect of the patch-like pattern formed by the lamp 320 recognizes the stripe pattern formed by the scintillation light sources 331 and 332 from the original image.
- the striped pattern in the original image is composed of a plurality of bright stripes or a plurality of dark stripes in the light-dark interval pattern formed by the exposure of the blinking light sources 331 and 332.
- the shape of the outline of the striped pattern in the original image is related to the shapes of the blinking light sources 331 and 332, for example, if the shapes of the blinking light sources 331 and 332 are circular, the striped pattern is composed of bright stripes of different lengths, and The outline of the striped pattern is a circle.
- the original image acquired by the receiving roller-type image sensor is specifically: since the rolling-type image sensor may be integrated in the image processing device, or may be disposed in an independent third-party device. Therefore, the original image may be obtained by the image processing device directly exposing the scintillation light source through the rolling image sensor, or may be obtained by the image processing device indirectly receiving an image of the scintillation light source that is forwarded by the third party device. .
- the terminal after receiving the original image acquired by the rolling image sensor, the terminal binarizes the image to obtain a binarized image.
- the original image it can be binarized according to the following formula:
- i is the sequence number of the pixel in the original image
- P(i) is the pixel value of the pixel i in the original image
- x is the preset binarization threshold
- P 1 is the preset first value
- P 2 is the preset second value. Since the pixel value of the scintillation light source is similar to the pixel value of the incandescent lamp and the fluorescent lamp, the pixel value of the scintillation light source is far different from the pixel value of the background.
- the binarization threshold x may be set in advance such that the pixel pattern of the stripe pattern formed by the scintillation light source and the spot pattern formed by the incandescent lamp, the fluorescent lamp, or the like is larger than the binarization threshold x, and the pixel of the background pixel point The value is less than or equal to the binarization threshold x.
- the second value is preset to “0”; when the first value is preset to “0”, the second value is preset to “1”. As shown in FIG.
- the manner of setting the binarization threshold may include: a global preset threshold method, an adaptive threshold method, a local threshold method, and the like.
- the adaptive threshold method may be implemented by determining a binarization threshold of a current frame original image according to information of a plurality of previous original images. For the current frame original image, all pixels in the original image are compared with the binarization threshold of the current frame original image to obtain a binarized image.
- the local threshold method may be implemented by sequentially scanning images from top to bottom and from left to right, and determining, for each pixel i, whether the pixel value of the pixel i is less than a preset. Threshold. If it is less than the preset threshold, it will not be processed temporarily. If it is greater than or equal to the preset threshold, the average value or the Gaussian average of the pixel values is calculated in the N ⁇ N neighborhood of the current pixel i, and the calculated average or Gaussian average is used as the binarization of the current pixel i. Threshold, where N is a positive integer greater than zero.
- the connected domain is searched for the pixel point whose pixel value is the first value in the binarized image to obtain a plurality of first connected domains. Specifically, in the binarized image, if the pixel point A is adjacent to or adjacent to the pixel point B, the pixel point A is in communication with the pixel point B.
- pixel point I (x, y) and pixel point I (x-1, y), pixel point I (x +1, y), pixel point I (x, y-1), pixel point I (x, y+1)4 adjacency; pixel point I(x,y) and pixel point I(x-1,y-1), pixel point I(x-1,y), pixel point I(x-1,y+ 1), pixel point I (x, y-1), pixel point I (x, y + 1), pixel point I (x + 1, y - 1), pixel point I (x + 1, y), pixel Point I(x+1, y+1)8 is adjacent.
- pixel points A, B, and C all belong to the same connected domain.
- searching for the connected domain by an algorithm such as the Two-Pass method or the Seed-Filling seed filling method, a plurality of first connected domains can be obtained. As shown in FIG.
- the width difference of the first connected domain corresponding to the stripe in the stripe pattern is much smaller than the width difference of the first connected domain corresponding to the fluorescent lamp and the incandescent lamp, and the width difference of the first connected domain corresponding to the stripe in the stripe pattern It is impossible to be too small, so the following connected method can be used to determine whether the first connected domain is the target connected domain.
- the stripe length direction of the preset stripe image is taken as the x-axis, and the y-axis is perpendicular to the x-axis. Navigating all the pixel points of the plurality of first connected domains to obtain a maximum column coordinate y 1 and a minimum column coordinate y 2 of the plurality of first connected domains corresponding to all the pixel points, and determining each of the first connected domains in the plurality of first connected domains
- the width difference is: the maximum column coordinate y 1 of each pixel in the first connected domain minus the minimum column coordinate y 2 of the pixel; determining whether the width difference of each first connected domain in the plurality of first connected domains is ⁇ kh 1 and ⁇ kh 2 , wherein kh 1 is a preset first boundary condition parameter, and kh 2 is a preset second boundary condition parameter.
- a shape of the plurality of second connected domains is identified, and a second connected domain that is closest to the shape of the striped pattern formed by the preset blinking light source is used as the striped graphic template.
- the second connected domain obtained by the processing includes: a second connected domain corresponding to the plaque pattern formed by the stripe pattern, wherein a stripe pattern corresponds to a second connected domain; and the spot pattern formed by the incandescent lamp corresponds to the second connected domain a second connected domain, wherein a spot pattern formed by an incandescent lamp corresponds to a second connected domain; and a second pattern corresponding to the spot pattern formed by the fluorescent lamp, wherein the spot pattern formed by a fluorescent lamp corresponds to a first Two connected domains.
- the second connected domain corresponding to the patch pattern formed by the stripe pattern, the second connected domain corresponding to the spot pattern formed by the incandescent lamp, and the second connected domain corresponding to the spot pattern formed by the fluorescent lamp are different in shape. Therefore, the shape of the plurality of second connected domains can be identified, and the second connected domain closest to the shape of the striped pattern formed by the preset blinking light source is selected as the striped graphic template. Thereafter, a set of coordinates of the pixel points in the stripe graphic template is found.
- the first connected domain is the target connected domain, and vice versa, it may be determined that the first connected domain is not Target connected domain.
- the original image includes a plurality of striped patterns formed by a plurality of scintillation light sources
- the target connected domain constitutes a stripe set
- the initial stripe set is determined, and the target connected domain that is not classified into any initial stripe set is filtered.
- the condition that the target connected domain forms the stripe set may be that a target connected domain that is not classified into any one of the stripe sets is randomly selected, and the selected target connected domain is classified into the initial stripe set, thereby obtaining an initial stripe set.
- averaging the coordinate values of the center of the target connected domain in the stripe set to obtain the coordinate value of the center of the stripe pattern may be: coordinates of the center of the target connected domain in the stripe set according to formula (1) The values are averaged to get the center of the striped pattern (u 0 , v 0 ):
- i is the sequence number of the target connected domain in the stripe set
- L i is the number of target connected domains in the stripe set. Is the minimum abscissa of the connected domain of the i-th target, It is the minimum ordinate of the i-th target connected domain, W i is the width of i target connected domains, and H i is the length of i target connected domains.
- averaging the coordinate values of the center of the target connected domain in the stripe set to obtain the coordinate value of the center of the stripe pattern may also be: first, according to formula (1), the target connected domain in the stripe set The coordinates of the center are averaged to get the center of the stripe pattern (u 0 , v 0 ):
- i is the sequence number of the target connected domain in the stripe set
- L i is the number of target connected domains in the stripe set.
- W i is the width of i target connected domains
- H i is the length of i target connected domains.
- the filtering method may be Gaussian filtering, mean filtering, or the like.
- the filtering may be performed by filtering the pixel values of the pixel points in the rectangular region Q by the filtering template according to formula (2) to obtain the filtered pixel values.
- n is the number of rows and columns of the filter template.
- kvalue is the binarization threshold.
- the coordinate value of the center (u 0 , v 0 ) of the stripe pattern is recalculated with the pixel value of the filtered pixel as the weight.
- the coordinate values of the center (u 0 , v 0 ) of the stripe pattern are recalculated according to formula (3).
- it may be determined by determining whether the stripe set is a valid stripe set, and specifically determining whether the center (u 0 , v 0 ) of the stripe pattern satisfies at least one of the following:
- R is the width of the largest connected domain in the stripe set
- kwide is the width of the binarized image
- kheight is the height of the binarized image
- the present invention further provides a terminal.
- the terminal 500 may include an RF (Radio Frequency) circuit 510, a memory 520 including one or more computer readable storage media, and an input unit 530.
- the terminal structure shown in FIG. 8 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:
- the RF circuit 510 can be used for receiving and transmitting signals during and after receiving or transmitting information, in particular, after receiving downlink information of the base station, and processing it by one or more processors 580; in addition, transmitting data related to the uplink to the base station.
- the RF circuit 510 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc.
- SIM Subscriber Identity Module
- RF circuitry 510 can also communicate with the network and other devices via wireless communication.
- the memory 520 can be used to store software programs and modules, and the processor 580 executes various functional applications and data processing by running software programs and modules stored in the memory 520.
- the memory 520 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 500 (such as audio data, phone book, etc.) and the like.
- memory 520 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 520 may also include a memory controller to provide access to memory 520 by processor 580 and input unit 530.
- Input unit 530 can be used to receive input numeric or character information, as well as to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
- input unit 530 can include touch-sensitive surface 531 as well as other input devices 532.
- a touch-sensitive surface 531 also referred to as a touch display or trackpad, can collect touch operations on or near the user (eg, the user uses a finger, stylus, etc., any suitable object or accessory on the touch-sensitive surface 531 or The operation near the touch-sensitive surface 531) and driving the corresponding connecting device according to a preset program.
- the touch-sensitive surface 531 can include two portions of a touch detection device and a touch controller.
- the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information.
- the processor 580 is provided and can receive commands from the processor 580 and execute them.
- the touch sensitive surface 531 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves.
- the input unit 530 can also include other input devices 532. Specifically, other input devices 532 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.
- the display unit 540 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal 500, which can be represented by graphics, text, icons, and views. The frequency is combined with any combination thereof.
- the display unit 540 can include a display panel 541.
- the display panel 541 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like.
- touch-sensitive surface 531 can cover the display panel 541, and when the touch-sensitive surface 531 detects a touch operation thereon or nearby, it is transmitted to the processor 580 to determine the type of the touch event, and then the processor 580 according to the touch event The type provides a corresponding visual output on display panel 541.
- touch-sensitive surface 531 and display panel 541 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 531 can be integrated with display panel 541 for input. And output function.
- Terminal 500 can also include at least one type of sensor 550, such as a light sensor, motion sensor, and other sensors.
- the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 541 according to the brightness of the ambient light, and the proximity sensor may close the display panel 541 when the terminal 500 moves to the ear. / or backlight.
- the gravity acceleration sensor can detect the magnitude of acceleration in all directions (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity.
- the terminal 500 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.
- Audio circuit 560, speaker 561, and microphone 562 can provide an audio interface between the user and terminal 500.
- the audio circuit 560 can transmit the converted electrical data of the received audio data to the speaker 561, and convert it into a sound signal output by the speaker 561.
- the microphone 562 converts the collected sound signal into an electrical signal, and the audio circuit 560 is used by the audio circuit 560. After receiving, it is converted into audio data, and then processed by the audio data output processor 580, transmitted to the terminal, for example, via the RF circuit 510, or outputted to the memory 520 for further processing.
- the audio circuit 560 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 500.
- WiFi is a short-range wireless transmission technology
- the terminal 500 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 570, which provides wireless broadband Internet access for users.
- FIG. 8 shows the WiFi module 570, it can be understood that it does not belong to the essential configuration of the terminal 500, and may be omitted as needed within the scope of not changing the essence of the invention.
- the terminal 500 also includes a power source 590 (such as a battery) that supplies power to the various components.
- a power source 590 such as a battery
- the power source can be logically coupled to the processor 580 through a power management system to manage functions such as charging, discharging, and power management through the power management system.
- Power supply 590 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
- the terminal 500 may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
- the display unit of the terminal is a touch screen display
- the terminal further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be processed by one or more The execution of one or more programs includes instructions for performing the following operations:
- the method before the acquiring the plurality of first connected domains in the binarized image, the method further includes: receiving a single frame original image acquired by the rolling image sensor, wherein the original image includes a stripe formed by the blinking light source a graph; binarizing the original image to obtain a binarized image according to a binarization threshold.
- selecting the target connected domain from the plurality of first connected domains includes: determining a width difference of each of the plurality of first connected domains, the first connected domain The width difference is compared with the preset width difference, and the first connected domain in which the condition is met is determined as the target connected domain according to the comparison result.
- determining The first connected domain that meets the condition is the target connected domain, and specifically includes: according to the imaging plane of the rolling image sensor, the stripe length direction of the preset stripe image is the x-axis, and the y-axis is perpendicular to the x-axis; traversing Determining, by the plurality of pixel points of the plurality of first connected domains, a maximum column coordinate y1 and a minimum column coordinate y2 corresponding to all the pixel points of the plurality of first connected domains, determining each of the plurality of first connected domains
- the width difference of a connected domain is: a maximum column coordinate y1 of each pixel in the first connected domain minus a minimum column coordinate y2 of the pixel; and a difference in width of each first connected domain in the plurality of first connected domains Whether ⁇ kh1 and ⁇ kh2, where kh1 is a preset first boundary condition
- the method further includes the step of deleting the first connected domain of the width difference ⁇ kh 1 or >kh 2 from the plurality of first connected domains.
- processing the original image to obtain a striped graphic template is specifically: filtering the original image according to the filtered parameter to obtain a blurred image, wherein the filtered parameter is set such that the original Each of the graphics in the image is fused into a corresponding plaque; the blurred image is binarized to obtain a binary blurred image; and the connected domain is searched for the binary image to obtain a plurality of second connected domains; Recognizing a shape of the plurality of second connected domains, and using a second connected domain that is closest to a shape of the striped pattern formed by the preset blinking light source as a striped graphic template.
- identifying the target connected domain according to the stripe pattern template is: determining whether coordinates of the pixel points of the first connected domain are all included in a set of coordinates of pixel points of the stripe pattern template; Yes, determining that the first connected domain is a target connected domain.
- the original image includes a plurality of striped patterns formed by a plurality of blinking light sources, and determining the stripe set according to the target connected domain is specifically: classifying the target connected domains to obtain a plurality of stripe sets.
- classifying the target connected domain to obtain a plurality of stripe sets comprises: determining an initial stripe set according to a condition that the target connected domain forms a stripe set, and screening the target connectivity that is not classified into any initial stripe set. Domain; the target connected domain that has never been attributed to any initial stripe set, Selecting the jth target connected domain, where j is a positive integer; taking the centroid of the jth target connected domain as a center, and taking the length of the jth target connected domain as a circle as a circle; determining the initial stripe set Whether any one of the target connected domain regions intersects the circle; if intersects, the jth target connected domain is classified into the corresponding initial stripe set, thereby obtaining a stripe set.
- the classifying the target connected domain to obtain the plurality of stripe sets further includes: determining whether the stripe set satisfies the following condition: whether the number of target connected domains in the stripe set is greater than a quantity threshold; Whether the length of the longest target connected domain in the stripe set is greater than a length threshold; if the condition is not satisfied at the same time, the stripe set is deleted.
- averaging coordinate values of a center of the target connected domain in the stripe set to obtain a coordinate value of a center of the stripe pattern is specifically:
- i is the sequence number of the target connected domain in the stripe set
- L i is the number of target connected domains in the stripe set
- Is the minimum abscissa of the connected domain of the i-th target
- It is the minimum ordinate of the i-th target connected domain
- W i is the width of i target connected domains
- H i is the length of i target connected domains.
- the pixel values of the pixel points in the rectangular area Q are filtered to obtain the filtered pixel values.
- the pixel values of the pixel points in the rectangular area Q are filtered by the filtering template according to formula (2) to obtain Filtered pixel value among them,
- n is the number of rows and columns of the filtering template,
- kvalue is the binarization threshold.
- recalculating the coordinate value of the center (u 0 , v 0 ) of the striped pattern by using the pixel value of the filtered pixel as a weight is specifically:
- (u j , v j ) is a coordinate value of a pixel point in the rectangular area Q, The pixel value filtered for the pixel (u j , v j ).
- the embodiment of the present invention further discloses another motion tracking system, which is different from the motion tracking system shown in FIG. 1 in that the rolling image sensor and the image processing device are both Integrated in the terminal.
- the terminal may be a smart phone, a notebook computer, a tablet computer, a driving recorder, a video recorder, a projector, and the like.
- the embodiment of the invention also discloses an image processing system, which is different from the motion tracking system shown in FIG. 1 in that the image processing system includes only a rolling type image sensor and an image processing device, and does not include a controller.
- the embodiment of the present invention further provides a stripe set search device, and the device includes a unit capable of implementing the method as shown in FIG. 4.
- the device includes a unit capable of implementing the method as shown in FIG. 4.
- the technical solution of the present application or the part that contributes to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions. All or part of the steps of the method of the various embodiments of the present application are performed by a computer device (which may be a personal computer, server, or network device, etc.) or a processor.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (24)
- 一种条纹集合有效性确定方法,其特征在于,包括:获取二值化图像中的多个第一连通域;从所述多个第一连通域中选择出目标连通域;根据所述目标连通域确定条纹集合,从而确定条纹图形;根据所述条纹集合中的目标连通域计算出所述条纹图形的中心;根据所述条纹图形的中心确定所述条纹集合是否为有效条纹集合。
- 根据权利要求1所述的方法,其特征在于,所述获取二值化图像中的多个第一连通域之前还包括:接收卷帘式图像传感器采集得到的单帧原始图像,其中,所述原始图像包括闪烁光源所形成的条纹图形;根据二值化阈值,对所述原始图像进行二值化以得到二值化图像。
- 根据权利要求1所述的方法,其特征在于,从所述多个第一连通域中选择出目标连通域包括:确定所述多个第一连通域中每个第一连通域的宽度差,将所述每个第一连通域的宽度差和预设的宽度差进行比较,根据比较结果确定其中符合条件的第一连通域为目标连通域。
- 根据权利要求3所述的方法,其特征在于,将所述每个第一连通域的宽度差和预设的宽度差进行比较,确定其中符合条件的第一连通域为目标连通域,具体包括:根据卷帘式图像传感器成像平面,以预设条纹图像的条纹长度方向为x轴,并令y轴垂直于所述x轴;遍历所述多个第一连通域的所有像素点以获得所述多个第一连通域对应所有像素点的最大列坐标y1和最小列坐标y2,确定所述多个第一连通域中每个第一连通域的宽度差为:每个第一连通域中的像素点最大列坐标y1减去像素点最小列坐标y2;判断所述多个第一连通域中每个第一连通域的宽度差是否≧kh1且≦kh2,其中,kh1为预设的第一边界条件参数,kh2为预设的第二边界条件参数;确定符合宽度差≧kh1且≦kh2的第一连通域为目标连通域。
- 根据权利要求4所述的方法,其特征在于,还包括以下步骤:从所述多个第一连通域中删除宽度差﹤kh1或者﹥kh2的第一连通域。
- 根据权利要求1所述的方法,其特征在于,接收卷帘式图像传感器采集得到的原始图像之后,从所述多个第一连通域中选择出目标连通域之前包括:对所述原始图像进行处理以得到条纹图形模板,并根据所述条纹图形模板识别出目标连通域,其中,所述条纹图形模板的形状为所述原始图像中的条纹图形融合而成的斑状。
- 根据权利要求6所述的方法,其特征在于,对所述原始图像进行处理以得到条纹图形模板具体为:根据所述滤波的参数对所述原始图像进行滤波以得到模糊图像,其中,所述滤波的参数设置为使得所述原始图像中的各个图形融合成各自对应的斑块;对所述模糊图像进行二值化以得到二值化模糊图像;对所述二值化模糊图像查找连通域以获得多个第二连通域;识别所述多个第二连通域的形状,并根据与预设的所述闪烁光源所形成的条纹图形形状最接近的第二连通域作为条纹图形模板。
- 根据权利要求7所述的方法,其特征在于,根据所述条纹图形模板识别出目标连通域具体为:判断所述第一连通域的像素点的坐标是否都包括在所述条纹图形模板的像素点的坐标构成的集合中;如果是,确定所述第一连通域为目标连通域。
- 根据权利要求1至8任一权利要求所述的方法,其特征在于,所述原始图像包括多个闪烁光源所形成的多个条纹图形,根据所述目标连通域确定条纹集合具体为:对所述目标连通域进行分类以获得多个条纹集合。
- 根据权利要求9所述的方法,其特征在于,对所述目标连通域进行分类以获得多个条纹集合包括:根据所述目标连通域构成条纹集合的条件,确定初始条纹集合,筛选未归 入任何初始条纹集合的所述目标连通域;从未归入任何初始条纹集合的所述目标连通域中,选取第j个目标连通域,其中j为正整数;以所述第j个目标连通域的质心为圆心,以所述第j个目标连通域的长度为直径作圆;判断所述初始条纹集合中的任意一个目标连通域区域是否与所述圆相交;如果相交,则将所述第j个目标连通域归入对应的所述初始条纹集合,从而得到条纹集合。
- 根据权利要求10所述的方法,其特征在于,对所述目标连通域进行分类以获得多个条纹集合之后还包括:判断所述条纹集合是否同时满足以下条件:所述条纹集合中的目标连通域的数量是否大于数量阈值;所述条纹集合中最长的目标连通域的长度是否大于长度阈值;如果不是同时满足所述条件,则删除所述条纹集合。
- 根据权利要求1所述的方法,其特征在于,根据所述条纹集合中的目标连通域计算出条纹图形的中心具体为:对所述条纹集合中的目标连通域的中心的坐标值求平均以得到所述条纹图形的中心的坐标值。
- 根据权利要求13所述的方法,其特征在于,根据公式(1)对所述条 纹集合中的目标连通域的中心的坐标值求平均以得到所述条纹图形的中心(u0,v0)之后,根据所述条纹图形的中心确定所述条纹集合是否为有效条纹集合之前,还包括:对矩形区域Q中的像素点的像素值进行滤波以得到滤波后的像素值,其中,所述矩形区域Q为所述条纹图形的中心(u0,v0)为中心,以所述条纹集合中最大连通域的宽度为边长的矩形区域;以所述滤波后的像素点的像素值作为权值重新计算所述条纹图形的中心(u0,v0)的坐标值。
- 一种条纹集合有效性确定装置,其特征在于,所述装置包括能够实现如权利要求1至17任一权利要求所述的方法的单元。
- 一种终端,其特征在于,包括卷帘式图像传感器、存储器以及分别与所述卷帘式图像传感器、存储器耦合的处理器,所述存储器用于存储所述卷帘式图像传感器采集到的图像以及指令,所述处理器用于执行所述指令,当所述处理器在执行所述指令时,可根据所述指令执行如权利要求1-17中任一权利要求的方法,以实现对所述卷帘式图像传感器采集到的图像进行处理以确定条纹集合的有效性。
- 一种运动物体跟踪系统,其特征在于,包括终端、设置有闪烁光源的控制器,其中,所述终端设置有卷帘式图像传感器,所述设置有闪烁光源的控制器被安装在运动物体上,所述终端为如权利要求19所述的终端。
- 一种图像处理装置,其特征在于,包括:处理器以及存储器,其中,所述处理器连接所述存储器,所述存储器用于存储指令,所述处理器用于执行所述指令,当所述处理器在执行所述指令时,可根据所述指令执行如权利要求1-17中任一权利要求的方法,以实现对所述卷帘式图像传感器采集到的图像进行处理以确定条纹集合的有效性。
- 一种图像处理系统,其特征在于,包括卷帘式图像传感器以及图像处理装置,所述图像处理装置耦合所述卷帘式图像传感器,其中,所述图像处理 装置为如权利要求21所述的图像处理装置。
- 一种运动物体跟踪系统,其特征在于,包括卷帘式图像传感器、设置有闪烁光源的控制器以及图像处理装置,所述图像处理装置分别耦合所述卷帘式图像传感器以及所述控制器,其中,所述控制器被安装在运动物体上,所述图像处理装置为如权利要求21所述的图像处理装置。
- 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储了确定条纹集合有效性的程序代码,所述程序代码包括用于执行如权利要求1-17任意一权利要求所述的方法的指令。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/076980 WO2017161496A1 (zh) | 2016-03-22 | 2016-03-22 | 条纹集合查找方法、装置以及系统 |
CN201680003225.XA CN107223265B (zh) | 2016-03-22 | 2016-03-22 | 条纹集合查找方法、装置以及系统 |
US15/578,705 US10795456B2 (en) | 2016-03-22 | 2016-03-22 | Method, device and terminal for determining effectiveness of stripe set |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/076980 WO2017161496A1 (zh) | 2016-03-22 | 2016-03-22 | 条纹集合查找方法、装置以及系统 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017161496A1 true WO2017161496A1 (zh) | 2017-09-28 |
Family
ID=59899875
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/076980 WO2017161496A1 (zh) | 2016-03-22 | 2016-03-22 | 条纹集合查找方法、装置以及系统 |
Country Status (3)
Country | Link |
---|---|
US (1) | US10795456B2 (zh) |
CN (1) | CN107223265B (zh) |
WO (1) | WO2017161496A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112085752A (zh) * | 2020-08-20 | 2020-12-15 | 浙江华睿科技有限公司 | 一种图像的处理方法、装置、设备及介质 |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107111882B (zh) * | 2016-03-22 | 2021-01-05 | 广东虚拟现实科技有限公司 | 条纹集合查找方法、装置以及系统 |
WO2018010149A1 (zh) * | 2016-07-14 | 2018-01-18 | 广东虚拟现实科技有限公司 | 闪烁光源的识别方法以及装置 |
CN109785380B (zh) * | 2018-12-29 | 2020-09-18 | 北京金山安全软件有限公司 | 一种内切圆确定方法及装置 |
CN115409825B (zh) * | 2022-09-06 | 2023-09-12 | 重庆众仁科技有限公司 | 一种基于图像识别的温湿压迹线识别方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002286411A (ja) * | 2001-03-28 | 2002-10-03 | Fuji Photo Optical Co Ltd | 縞解析方法および装置 |
CN102426480A (zh) * | 2011-11-03 | 2012-04-25 | 康佳集团股份有限公司 | 一种人机交互系统及其实时手势跟踪处理方法 |
CN102779279A (zh) * | 2012-06-14 | 2012-11-14 | 南京航空航天大学 | 搅拌摩擦焊弧形纹间距的图像识别方法 |
CN104282011A (zh) * | 2013-07-04 | 2015-01-14 | 浙江大华技术股份有限公司 | 一种检测视频图像中干扰条纹的方法及装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3927776B2 (ja) * | 2001-06-25 | 2007-06-13 | キヤノン株式会社 | 画像処理装置及びその処理方法 |
JP4335849B2 (ja) * | 2005-06-13 | 2009-09-30 | 富士通マイクロエレクトロニクス株式会社 | フリッカ検出可能な撮像装置 |
CN101692691B (zh) * | 2009-09-27 | 2012-07-04 | 上海大学 | 视频图像中条带的检测方法 |
US9723676B2 (en) * | 2011-07-26 | 2017-08-01 | Abl Ip Holding Llc | Method and system for modifying a beacon light source for use in a light based positioning system |
US8334898B1 (en) * | 2011-07-26 | 2012-12-18 | ByteLight, Inc. | Method and system for configuring an imaging device for the reception of digital pulse recognition information |
CN103886552B (zh) * | 2014-02-24 | 2017-01-11 | 深圳市安健科技股份有限公司 | 一种去除x射线影像滤线栅条纹的方法及系统 |
CN105046260B (zh) * | 2015-07-31 | 2019-01-04 | 小米科技有限责任公司 | 图像预处理方法及装置 |
-
2016
- 2016-03-22 US US15/578,705 patent/US10795456B2/en active Active
- 2016-03-22 WO PCT/CN2016/076980 patent/WO2017161496A1/zh active Application Filing
- 2016-03-22 CN CN201680003225.XA patent/CN107223265B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002286411A (ja) * | 2001-03-28 | 2002-10-03 | Fuji Photo Optical Co Ltd | 縞解析方法および装置 |
CN102426480A (zh) * | 2011-11-03 | 2012-04-25 | 康佳集团股份有限公司 | 一种人机交互系统及其实时手势跟踪处理方法 |
CN102779279A (zh) * | 2012-06-14 | 2012-11-14 | 南京航空航天大学 | 搅拌摩擦焊弧形纹间距的图像识别方法 |
CN104282011A (zh) * | 2013-07-04 | 2015-01-14 | 浙江大华技术股份有限公司 | 一种检测视频图像中干扰条纹的方法及装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112085752A (zh) * | 2020-08-20 | 2020-12-15 | 浙江华睿科技有限公司 | 一种图像的处理方法、装置、设备及介质 |
CN112085752B (zh) * | 2020-08-20 | 2024-01-30 | 浙江华睿科技股份有限公司 | 一种图像的处理方法、装置、设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
CN107223265A (zh) | 2017-09-29 |
US20180173327A1 (en) | 2018-06-21 |
CN107223265B (zh) | 2020-11-27 |
US10795456B2 (en) | 2020-10-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017161495A1 (zh) | 条纹集合查找方法、装置以及系统 | |
WO2017161496A1 (zh) | 条纹集合查找方法、装置以及系统 | |
JP6374970B2 (ja) | 画像処理方法および装置ならびにコンピュータデバイス | |
TWI658433B (zh) | 影像模糊方法、裝置、電腦可讀儲存媒體和電腦裝置 | |
US9697622B2 (en) | Interface adjustment method, apparatus, and terminal | |
CN106874906B (zh) | 一种图片的二值化方法、装置及终端 | |
CN103871051A (zh) | 图像处理方法、装置和电子设备 | |
CN106778585A (zh) | 一种人脸关键点跟踪方法和装置 | |
WO2018233438A1 (zh) | 人脸特征点跟踪方法、装置、存储介质及设备 | |
CN109391762A (zh) | 一种跟踪拍摄的方法和装置 | |
CN111476780A (zh) | 一种图像检测方法、装置、电子设备以及存储介质 | |
WO2016173350A1 (zh) | 图片处理方法及装置 | |
CN103400108A (zh) | 人脸识别方法、装置和移动终端 | |
US10922846B2 (en) | Method, device and system for identifying light spot | |
CN106296617A (zh) | 人脸图像的处理方法及装置 | |
CN108269220B (zh) | 定位数字水印的方法及装置 | |
CN106204423A (zh) | 一种基于增强现实的图片调整方法、装置及终端 | |
CN107450796B (zh) | 一种图片处理方法、移动终端和计算机可读存储介质 | |
CN104463105A (zh) | 路牌识别方法及装置 | |
CN107124556A (zh) | 对焦方法、装置、计算机可读存储介质和移动终端 | |
CN106371086A (zh) | 一种测距的方法和装置 | |
CN105513098B (zh) | 一种图像处理的方法和装置 | |
CN113421211A (zh) | 光斑虚化的方法、终端设备及存储介质 | |
CN104077129B (zh) | 图标处理方法、装置及终端设备 | |
CN109478237B (zh) | 光源识别方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 15578705 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16894851 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 1.2.19) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 16894851 Country of ref document: EP Kind code of ref document: A1 |