NL2026030B1 - A Coaching Binocular stereo Vision Device and a Method for Acquiring High-precision stereo Vision Images - Google Patents

A Coaching Binocular stereo Vision Device and a Method for Acquiring High-precision stereo Vision Images Download PDF

Info

Publication number
NL2026030B1
NL2026030B1 NL2026030A NL2026030A NL2026030B1 NL 2026030 B1 NL2026030 B1 NL 2026030B1 NL 2026030 A NL2026030 A NL 2026030A NL 2026030 A NL2026030 A NL 2026030A NL 2026030 B1 NL2026030 B1 NL 2026030B1
Authority
NL
Netherlands
Prior art keywords
images
binocular
stereovision
neural network
convolutional neural
Prior art date
Application number
NL2026030A
Other languages
Dutch (nl)
Other versions
NL2026030A (en
Inventor
He Jingze
Che Honglei
Shi Congling
Xu Yuanfei
Original Assignee
China Academy Safety Science & Technology
Beijing Hangxing Machine Mfg Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Academy Safety Science & Technology, Beijing Hangxing Machine Mfg Co Ltd filed Critical China Academy Safety Science & Technology
Publication of NL2026030A publication Critical patent/NL2026030A/en
Application granted granted Critical
Publication of NL2026030B1 publication Critical patent/NL2026030B1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G06T2207/10012—Stereo images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The present invention relates to a coaching binocular stereo vision device and a method for acquiring high-precision stereo vision images, which belong to the field of stereo vision technologies and solve a problem that existing stereo vision devices cannot meet 5 requirements for high precision and low cost at the same time. The device includes: a binocular stereo vision unit used for off-line collecting binocular sample images within a field of view and on-line collecting binocular real-time images within a measured field and used for processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images; a coaching unit used for acquiring 10 precise stereo vision images within the same field of view, and an intelligent learning unit used for training a deep convolutional neural network stored in the intelligent learning unit until the deep convolutional neural network converges according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the 15 binocular sample images and according to the precise stereo vision images, and also used for obtaining high-precision stereo vision images within the measured field based on corresponding images obtained by processing the binocular real-time images after convergence.

Description

-1- A Coaching Binocular stereo Vision Device and a Method for Acquiring High- precision stereo Vision Images Technical Field The present invention relates to a technical filed of correction of binocular vision images, in particular to a coaching binocular stereo vision device and a method for acquiring high-precision stereo vision images. Background Binocular stereo vision is an important form of machine vision, which is a method for acquiring two images of a measured object from different positions with an imaging apparatus based on a principle of parallax, and acquiring three-dimensional geometric information of the object by calculating the position deviation between corresponding points of the images. A depth measurement method based on binocular stereo vision is similar to that of human eyes. Unlike a depth camera based on principles of TOF and structured light, it does not actively project a light source to the outside but completely relies on the two captured pictures (color RGB or grayscale) to calculate a depth. Therefore, it is sometimes called a passive binocular depth camera.
In practical applications, binocular stereo vision has the following disadvantages: 1) very sensitive to ambient illumination. The binocular stereo vision method relies on natural light in the environment to collect images, and due to the influence of environmental factors such as changes in illumination angle and illumination intensity, brightness difference between the two captured pictures will be large, which will pose a great challenge to a matching algorithm; 2) not suitable for monotonous scenes that lack texture. Since the binocular stereo vision method performs image matching based on visual features, 1t will be difficult to match scenes lacking visual features (such as the sky, white walls, deserts, etc.), resulting in large matching errors and even matching failures.
A laser TOF stereo vision apparatus can effectively solve the problems of the binocular stereo vision method and has high measurement precision. However, due to its high apparatus cost, the laser TOF stereo vision apparatus is severely limited to be extensively
22. used. How to achieve high-precision and low-cost stereo vision is an urgent problem to be solved. Summary In light of the above analysis, the present invention is intended to provide a coaching binocular stereo vision device and a method for acquiring high-precision stereo vision images to solve the problem that existing stereo vision devices cannot meet the requirements for high precision and low cost.
The purpose of the present invention is mainly achieved by the following technical solutions: A coaching binocular stereo vision device includes: a binocular stereo vision unit used for off-line collecting binocular sample images within a field of view and on-line collecting binocular real-time images within a measured field; and used for processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision 1mages based on the binocular sample images or the binocular real-time images; a coaching unit used for acquiring precise stereo vision images within the same field of view as the binocular sample images; an intelligent learning unit used for training a deep convolutional neural network stored in the intelligent learning unit until the deep convolutional neural network converges according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images; and also used for obtaining high-precision stereo vision images within the measured field according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular real-time images after the training is completed.
Based on the above solution, the present invention has also made the following improvements: further, the binocular stereo vision unit includes: two visible cameras with the same parameters and one controller;
-3- the controller is used to control the two visible cameras to collect images at the same time and process the two images collected at the same time to obtain the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images. Further, the coaching unit includes an infrared laser emitter and a high frame frequency infrared camera, and 1s used to output the precise stereo vision images based on an infrared laser TOF principle. Further, before training the deep convolutional neural network, the intelligent learning unit also corrects the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images and corrects the precise stereo vision images according to transformation relationship between coordinates of the binocular stereo vision unit and the coaching unit, and unifies them into the same coordinate system; the transformation relationship is determined by: aligning the binocular stereo vision unit with the coaching unit, establishing a coordinate system by using a calibration object within the same field of view as a reference, and determining the transformation relationship between the coordinates of the binocular stereo vision unit and the coaching unit.
Further, the intelligent learning unit trains the deep convolutional neural network by performing the following operations: training the deep convolutional neural network by using the one binocular visible non- stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images after correction as three channel-alignment inputs and using the precise stereo vision images of the coaching unit after correction as positive sample images; when deviation between stereo vision images output by the trained deep convolutional neural network and the positive sample images satisfies a threshold condition, obtaining a converged deep convolutional neural network; otherwise, modifying each pixel of the positive sample images according to the following formula:
-4- CT kl + hol + Rn Ty TOT fy > Ta wherein Ts) represents a pixel value of a pixel with coordiantes (x, y ) in the stereo vision images output by the trained deep convolutional neural network; Li represents a pixel value of a pixel with coordiantes (x, y ) in the precise stereo vision images of the coaching unit after correction; Diy represents a pixel value of a pixel with coordiantes (x, y) in the binocular stereo vision images after correction; i. and Lo represent a maximum pixel value and a minimum pixel value of a pixel with coordinates (x, y ) in the stereo vision images output by the trained deep convolutional neural network, respectively; and k, k, and k, are weight coefficients corresponding to Ton Lies and Don, respectively; continuing to train the deep convolutional neural network by using the modified positive sample images; if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise, repeating the above modification process.
Further, the controller processes the two images within the measured field collected at the same time by using an SGB algorithm or a BM algorithm to obtain the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images.
The present invention also discloses a method for acquiring high-precision stereo vision images, wherein the method includes the following steps: on-line collecting binocular real-time images within a measured field, and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images based on the binocular real-time images; inputting one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular real-time images to a trained deep convolutional neural network,
-5- and using the deep convolutional neural network to process and output high-precision stereo vision images.
Based on the above solution, the present invention has also made the following improvements: further, the method also includes training the deep convolutional neural network by: off-line collecting binocular sample images within a field of view, and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images based on the binocular sample images; acquiring precise stereo vision images within the same field of view as the binocular sample images at the same time; correcting the binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images processed and obtained based on the binocular sample images, and correcting the precise stereo vision images; training the deep convolutional neural network by using the one binocular visible non- stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images after correction as three channel-alignment inputs of the deep convolutional neural network and using the precise stereo vision images after correction as positive sample images; when deviation between stereo vision images output by the trained deep convolutional neural network and the positive sample images satisfies a threshold condition, obtaining a converged deep convolutional neural network; otherwise, modifying each pixel of the positive sample images according to the following formula: M= [ Ts) Taw < Ty < Taas 6 Vl + el + Dj Te < Tor Tj > Th, Wherein Les) represents a pixel value of a pixel with coordiantes (x, y ) in the stereo vision images output by the trained deep convolutional neural network; Lies represents a pixel value of a pixel with coordiantes (x, y ) in the precise stereo vision images after correction; Di represents a pixel value of a pixel with coordiantes (x, y ) in the
-6- binocular stereo vision images after correction; T va and Ly represent a maximum pixel value and a minimum pixel value of a pixel with coordinates (x, y ) in the stereo vision images output by the trained deep convolutional neural network, respectively; and k, , k, and k, are weight coefficients corresponding to Tis , Lis) and Des ‚ respectively; continuing to train the deep convolutional neural network by using the modified positive sample images; if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise, repeating the above modification process.
Further, the correcting the binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images processed and obtained based on the binocular sample images, and correcting the precise stereo vision images includes: establishing a coordinate system by using a calibration object within the same field of view as a reference, and determining transformation relationship between the coordinates of the binocular stereo vision unit and the coaching unit; correcting the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images and correcting the precise stereo vision images according to the transformation relationship, and unifying them into the same coordinate system. Further, when a position, the field of view or an ambient light source for acquiring the binocular real-time images are significantly changed, retraining the deep convolutional neural network.
The beneficial effects of the present invention are as follows: the operation of the coaching binocular stereo vision device provided by the present invention is specifically divided into an off-line training process and an on-line use process. During off-line training, binocular vision images with relatively low precision are obtained by using a binocular stereo vision unit with low cost, precise stereo vision images are obtained by using a high-precision coaching unit; a trained deep convolutional neural network is obtained by using the deep convolutional neural
-7- network to determine their relationship; the coaching unit can be removed after the training, and high-precision stereo vision images are obtained merely by cooperation of the binocular stereo vision unit and an intelligent learning unit, thereby obtaining high- precision stereo vision images by using binocular vision components with low cost and low precision. This method is suitable for places where installation position of the binocular stereo vision unit is relatively fixed and an ambient light source changes little, such as subway stations. The method of the present invention is implemented based on the same principle with the above device and thus also has the effects that the above device can achieve.
In the present invention, the above technical solutions can also be combined with each other to achieve many more preferred combination solutions. Other features and advantages of the present invention will be described subsequently in the description, and some advantages may become apparent from the description or be understood by implementing the present invention. The objects and other advantages of the present invention can be realized and obtained through the contents particularly pointed out in the description, claims and drawings. Brief Description of the Drawings The drawings are only for the purpose of illustrating specific embodiments, and are not considered to limit the present invention. Throughout the drawings, the same reference indicates the same component. Fig. 1 is a schematic structural diagram of a coaching binocular stereo vision device during off-line training according to an embodiment of the present invention; Fig. 2 is a schematic structural diagram of a coaching binocular stereo vision device during on-line use according to an embodiment of the present invention; Fig. 3 is a flowchart of a method for acquiring high-precision stereo images according to an embodiment of the present invention.
Detailed Description Preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings, wherein the drawings constitute a part of the present application and are used to explain the principles of the present invention
-8- together with the embodiments of the present invention and are not intended to limit the scope of the present invention. Embodiment 1 A specific embodiment of the present invention discloses a coaching binocular stereo vision device, wherein the device includes: a binocular stereo vision unit used for off- line collecting binocular sample images within a field of view and on-line collecting binocular real-time images within a measured field; and used for processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images based on the binocular sample images or the binocular real-time images, a coaching unit used for acquiring precise stereo vision images within the same field of view as the binocular sample images; an intelligent learning unit used for training a deep convolutional neural network stored in the intelligent learning unit until the deep convolutional neural network converges according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images and according to the precise stereo vision images output by the coaching unit; and also used for obtaining high-precision stereo vision images within the measured field according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular real-time images after the training is completed. These high-precision vision images have characteristics of high resolution and high definition. After learning by the neural network, the binocular stereo vision device can effectively distinguish passenger flows and obtain improved precision of images and better performance before learning.
Wherein Fig. 1 is a schematic structural diagram of a coaching binocular stereo vision device during off-line training according to an embodiment of the present invention; and Fig. 2 is a schematic structural diagram of a coaching binocular stereo vision device during on-line use according to an embodiment of the present invention.
Compared with the prior art, the operation of the coaching binocular stereo vision device provided by the present invention is specifically divided into an off-line training process and an on-line use process. During off-line training, binocular vision images with relatively low precision are obtained by using a binocular stereo vision unit with low
-9- cost, precise stereo vision images are obtained by using a high-precision coaching unit; a trained deep convolutional neural network is obtained by using the deep convolutional neural network to determine their relationship; the coaching unit can be removed after the training, and high-precision stereo vision images are obtained merely by cooperation of the binocular stereo vision unit and an intelligent learning unit, thereby obtaining high-precision stereo vision images by using binocular vision components with low cost and low precision. This device is suitable for places where installation position of the binocular stereo vision unit is relatively fixed and an ambient light source changes little, such as subway stations.
Preferably, this embodiment also provides a typical method for setting the binocular stereo vision unit, wherein the unit includes: two visible cameras with the same parameters at a certain distance and one controller; wherein the controller is used to control the two visible cameras to collect images at the same time and process the two images within the measured field collected at the same time by using an SGB algorithm or a BM algorithm to obtain the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images; and may also temporarily store the above three types of image information; preferably, in order to obtain precise stereo vision images, the coaching unit of this embodiment includes an infrared laser emitter and a high frame frequency infrared camera, and is used to output the precise stereo vision images based on an infrared laser TOF principle by using the high precision of the hardware itself. Since the positions of the images captured by the binocular stereo vision unit and the coaching unit may deviate, in order to ensure more precise processing results, the intelligent learning unit also needs to correct the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images and correct the precise stereo vision images according to transformation relationship between coordinates of the binocular stereo vision unit and the coaching unit, and unifies them into the same coordinate system before training the deep convolutional neural network; this embodiment provides a method for determining the transformation relationship: aligning the binocular stereo vision unit with the coaching unit, establishing a coordinate system by using a calibration object within the
-10 - same field of view as a reference, and determining the transformation relationship between the coordinates of the binocular stereo vision unit and the coaching unit.
The deep convolutional neural network can be trained once images are corrected and unified into the coordinate system. In this embodiment, the intelligent learning unit trains the deep convolutional neural network by performing the following operations: training the deep convolutional neural network by using the one binocular visible non- stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images after correction as three channel-alignment inputs and using the precise stereo vision images of the coaching unit after correction as positive sample images; When deviation between stereo vision images output by the trained deep convolutional neural network and the positive sample images satisfies a threshold condition (the threshold is a measure of difficulty of generating positive excitation by a neuron, in memory learning, the threshold is generally set by a toolbox function that comes with it, which is generally a default value and may also be debugged based on customer requirements, determining the length of training time and training effects), obtaining a converged deep convolutional neural network; otherwise, modifying each pixel of the positive sample images according to the following formula: p=! fi Tan < To < Ta | (KT) + Heks + KD) Ty < Bat Tp 5} > Toa wherein Ties represents a pixel value of a pixel with coordiantes (x, y ) in the stereo vision images output by the trained deep convolutional neural network; Li) represents a pixel value of a pixel with coordiantes (x, y ) in the precise stereo vision images of the coaching unit after correction; Dos) represents a pixel value of a pixel with coordiantes (x, y ) in the binocular stereo vision images after correction, 1 and To represent a maximum pixel value and a minimum pixel value of a pixel with coordinates (x, y ) in the stereo vision images output by the trained deep convolutional neural network, respectively, which may be determined by: sorting pixel values of pixels within
-11 - a certain range around the coordinates (x, y ). the maximum value in the sorting results is used as Lo and the minimum value is used as Lo. k, k, and k, are weight coefficients corresponding to Tie Lis and Dos, respectively; continuing to train the deep convolutional neural network by using the modified positive sample images, the method by which the positive sample images are modified enables the learning unit to keep continual memory learning; if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise, repeating the above modification process. This modification method enables it to modify general images of the binocular unit. Once the threshold condition of modification is satisfied later, 1t means that modification ability of the method can enable the binocular unit and the learning unit to generate high-precision stereo vision images similar to that of the coaching unit. This method is a basic learning method for neural network memory learning. (The weight coefficients of the system are set by a toolbox function that comes with the program, which is generally a default value and may also be debugged based on customer requirements, determining the length of training time and training effects) Embodiment 2 Another embodiment of the present invention also discloses a method for acquiring high- precision stereo vision images, as shown in Fig. 3, the method includes the following steps: Step SI: on-line collecting binocular real-time images within a measured field, and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images based on the binocular real-time images; Step S2: inputting one binocular visible non-stereo image of the binocular visible non- stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular real-time images to a trained deep convolutional neural network, and using the deep convolutional neural network to process and output high- precision stereo vision images.
In specific implementation process, training the deep convolutional neural network by:
-12- Step S201: off-line collecting binocular sample images within a field of view, and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereo vision images based on the binocular sample images; Step S202: acquiring precise stereo vision images within the same field of view as the binocular sample images at the same time; Step S203: establishing a coordinate system by using a calibration object within the same field of view as a reference, and determining the transformation relationship between the coordinates of the binocular stereo vision unit and the coaching unit; Step S204: correcting the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular sample images and correcting the precise stereo vision images according to the transformation relationship, and unifying them into the same coordinate system; Step S205: training the deep convolutional neural network by using the one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images after correction as three channel- alignment inputs of the deep convolutional neural network and using the precise stereo vision images after correction as positive sample images; Step S2051: when deviation between stereo vision images output by the trained deep convolutional neural network and the positive sample images satisfies a threshold condition, obtaining a converged deep convolutional neural network and terminating the training; otherwise, step S2052 is performed, Step S2052: modifying each pixel of the positive sample images according to the following formula: PUT, + Rly + KD TS Dor Ty > Ty Wherein Tis represents a pixel value of a pixel with coordiantes (x, y ) in the stereo vision images output by the trained deep convolutional neural network; Lie represents a pixel value of a pixel with coordiantes (x, y ) in the precise stereo vision images after correction; Dy.) represents a pixel value of a pixel with coordiantes (x, y ) in the binocular stereo vision images after correction; Tv and Ly, represent a maximum
-13 - pixel value and a minimum pixel value of a pixel with coordinates (x, y ) in the stereo vision images output by the trained deep convolutional neural network, respectively; and k, k, and k, are weight coefficients corresponding to Ties Li and Don, respectively; Step S2053: continuing to train the deep convolutional neural network by using the modified positive sample images (i.e, skip to step S2051); if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise, repeating the above modification process.
A deep convolutional neural network can be obtained through the above process. After the training is completed, inputting one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereo vision images obtained based on the binocular real-time images to a trained deep convolutional neural network, and using the deep convolutional neural network to process and output high-precision stereo vision images. However, when a position, the field of view or an ambient light source for acquiring the binocular real-time images are significantly changed, the trained deep convolutional neural network is no longer applicable, and it is necessary to re-collect images and retrain the deep convolutional neural network based on the changed environmental information. The above method embodiments and device embodiments are based on the same principle, and their relevant points can be used for mutual reference and the same technical effects can be obtained.
It should be understood by those skilled 1n the art that all or part of the process of implementing the method in the above embodiments may be performed by a computer program instructing relevant hardwares, and the program may be stored in a computer- readable storage medium. Wherein, the computer-readable storage medium may be a magnetic disk, an optical disk, a read-only storage memory, a random storage memory or the like.
-14 - The above are only preferred specific embodiments of the present invention.
However, the scope of protection of the present invention is not limited to this.
Any variation or replacement that is easily conceivable for a person skilled in the art within the technical scope revealed by the present invention should be encompassed within the scope of protection of the present invention.

Claims (7)

-15 - Conclusies-15 - Conclusions 1. Een coaching binoculair stereovisie-apparaat, dat bestaat uit: een binoculaire stereovisie-eenheid, die wordt gebruikt voor het offline verzamelen van binoculaire monsterbeelden binnen een gezichtsveld en voor het online verzamelen van binoculaire real-time beelden binnen een gemeten veld; en wordt gebruikt voor het verwerken en verkrijgen van binoculaire zichtbare niet-stereobeelden, bijpassende kostendiagrammen en binoculaire stereovisiebeelden op basis van de binoculaire monsterbeelden of de binoculaire real-time beelden; een coachingeenheid, die wordt gebruikt voor het verkrijgen van nauwkeurige stereovisiebeelden binnen hetzelfde gezichtsveld als de binoculaire monsterbeelden; een intelligente leereenheid, die wordt gebruikt voor het trainen van een diep convolutioneel neuraal netwerk, dat is opgeslagen in de intelligente leereenheid totdat het diepe convolutionele neurale netwerk convergeert volgens één binoculair zichtbaar niet-stereobeeld uit de binoculair zichtbare niet-stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden verkregen op basis van de binoculaire monsterbeelden en volgens de precieze stereovisiebeelden uitgevoerd door de coachingeenheid; en ook gebruikt voor het verkrijgen van zeer nauwkeurige stereovisiebeelden binnen het gemeten veld volgens één binoculair zichtbaar niet- stereobeeld van de binoculair zichtbare niet-stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden, die verkregen zijn op basis van de binoculaire realtime beelden nadat de training is voltooid; waarbij de intelligente leereenheid, alvorens het diepe convolutionele neurale netwerk te trainen, ook een correctie uitvoert op de binoculaire zichtbare niet- stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden, die verkregen op basis van de binoculaire monsterbeelden; en de precieze stereovisiebeelden corrigeert volgens de transformatierelatie tussen coördinaten van de binoculaire stereovisie-eenheid en de coachingeenheid; en ze verenigt in hetzelfde coördinatensysteem; de transformatierelatie wordt bepaald door: het uitlijnen van de binoculaire stereovisie-eenheid met de coaching-eenheid; het opzetten van een coördinatensysteem met behulp van een kalibratieobject binnenA coaching binocular stereovision device, comprising: a binocular stereovision unit, which is used for collecting binocular sample images offline within a field of view and for collecting binocular real-time images online within a measured field; and is used to process and obtain binocular visible non-stereo images, matching cost diagrams and binocular stereovision images based on the binocular sample images or the binocular real-time images; a coaching unit used to obtain accurate stereovision images within the same field of view as the binocular sample images; an intelligent learning unit, which is used for training a deep convolutional neural network, which is stored in the intelligent learning unit until the deep convolutional neural network converges according to one binocular visible non-stereo image from the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images obtained on the basis of the binocular sample images and according to the precise stereovision images output by the coaching unit; and also used to obtain highly accurate stereovision images within the measured field according to one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images obtained from the binocular real-time images after the training is completed; wherein the intelligent learning unit, before training the deep convolutional neural network, also performs a correction on the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images obtained from the binocular sample images; and corrects the precise stereovision images according to the transformation relationship between coordinates of the binocular stereovision unit and the coaching unit; and they unite in the same coordinate system; the transformation relationship is determined by: aligning the binocular stereovision unit with the coaching unit; setting up a coordinate system using a calibration object within -16 - hetzelfde gezichtsveld als referentie, en het bepalen van de transformatierelatie tussen de coördinaten van de binoculaire stereovisie-eenheid en de coaching-eenheid. waarbij de intelligente leereenheid het diepe convolutionele neurale netwerk traint door de volgende bewerkingen uit te voeren:-16 - the same field of view as reference, and determining the transformation relationship between the coordinates of the binocular stereovision unit and the coaching unit. wherein the intelligent learning unit trains the deep convolutional neural network by performing the following operations: het trainen van het diepe convolutionele neurale netwerk door gebruik te maken van het ene binoculaire zichtbare niet-stereobeeld van de binoculaire zichtbare niet- stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden na correctie als drie kanaaluitlijningangen; en het gebruiken van de nauwkeurige stereovisiebeelden van de coachingeenheid na correctie als positieve monsterbeelden;training the deep convolutional neural network using the one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images after correction as three channel alignment inputs; and using the accurate stereovision images from the coaching unit after correction as positive sample images; het verkrijgen, wanneer afwijking tussen stereovisiebeelden, die worden afgegeven door het getrainde diepe convolutionele neurale netwerk en de positieve monsterbeelden voldoet aan een drempelwaarde, van een geconvergeerd diep convolutioneel neuraal netwerk;obtaining, when deviation between stereovision images output from the trained deep convolutional neural network and the positive sample images meets a threshold, a converged deep convolutional neural network; anders het wijzigen van elke pixel van de positieve monsterbeelden volgens de volgende formule: 7! — Ts) Ls < ls) < Tacx 7) bl, 5) + kyly, + kD, Is) < 73,01 Ir) > Tas CT, | »otherwise modify each pixel of the positive sample images according to the following formula: 7! — Ts) Ls < ls) < Tacx 7) bl, 5) + kyly, + kD, Is) < 73.01 Ir) > Tas CT, | » waarin “7 een pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd ( > Y ) in de stereovisiebeelden die worden uitgevoerd door hetwhere “7 represents a pixel value of a pixel of coordinates ( > Y ) in the stereovision images output by the Co | Lo, | getrainde diepe convolutionele neurale netwerk; +’ een pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd ( > Y ) in de nauwkeurige stereovisiebeeldenCo | Lo, | trained deep convolutional neural network; +' a pixel value of a pixel with coordinates is represented ( > Y ) in the accurate stereovision images | | De | van de coachingeenheid na correctie; “”’ een pixelwaarde van een pixel met Mee . X . . . ne coördinaten wordt vertegenwoordigd ( ‚y ) in de binoculaire stereovisiebeelden na IT T. . we correctie; »* en "» een maximale pixelwaarde en een minimale pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd ( > ) in de stereovisiebeelden, die respectievelijk worden afgegeven door het getrainde diepe convolutionele neurale k kk | TL, D. netwerk t, 2 en 3 overeenkomende gewichtscoëfficiënten ~ 0), Cen >), respectievelijk;| | The | from the coaching unit after correction; ""' a pixel value of a pixel with Mee . X . . . ne coordinates is represented ( y ) in the binocular stereovision images after IT T. . we correction; »* and "» a maximum pixel value and a minimum pixel value of a pixel with coordinates is represented ( > ) in the stereovision images, which are respectively delivered by the trained deep convolutional neural network k kk | TL, D. network t, 2 and 3 corresponding weight coefficients ~ 0), Cen >), respectively; -17 - het doorgaan met het trainen van het diepe convolutionele neurale netwerk met behulp van de gemodificeerde positieve monsterbeelden; als het diepe convolutionele neurale netwerk convergeert, het verkrijgen van een geconvergeerd diep convolutioneel neuraal netwerk; anders het bovenstaande wijzigingsproces herhalen.-17 - continuing to train the deep convolutional neural network using the modified positive sample images; if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise repeat the above modification process. 2. Het coaching binoculair stereovisie-apparaat volgens conclusie 1, waarbij de binoculaire stereovisie-eenheid bestaat uit: twee zichtbare camera's met dezelfde parameters en één controller; de controller wordt gebruikt om de twee zichtbare camera's te besturen om tegelijkertijd beelden te verzamelen; en de twee tegelijkertijd verzamelde beelden te verwerken om de binoculaire zichtbare niet-stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden te verkrijgen.The coaching binocular stereovision device according to claim 1, wherein the binocular stereovision unit consists of: two visible cameras with the same parameters and one controller; the controller is used to control the two visible cameras to collect images at the same time; and processing the two images collected simultaneously to obtain the binocular visible non-stereo images, the matching cost diagrams, and the binocular stereovision images. 3. Het coaching binoculair stereovisie-apparaat volgens conclusie 2, waarbij de coaching-eenheid een infrarood laserzender en een infraroodcamera met hoge framefrequentie heeft, en dit wordt gebruikt om de nauwkeurige stereovisiebeelden af te geven op basis van een infrarood laser TOF(Time-of flight = vliegtijd)-principe.The coaching binocular stereovision apparatus according to claim 2, wherein the coaching unit has an infrared laser transmitter and a high frame rate infrared camera, and it is used to output the accurate stereovision images based on an infrared laser TOF(Time-of flight = flight time) principle. 4. Het coaching binoculair stereovisie-apparaat volgens conclusie 2, waarbij de controller verwerkt de twee beelden binnen het gemeten veld die tegelijkertijd zijn verzameld met behulp van een SGB-algoritme of een BM-algoritme om de binoculaire zichtbare niet-stereobeelden, de bijbehorende kostendiagrammen en de binoculaire stereovisiebeelden te verkrijgen.The coaching binocular stereovision device according to claim 2, wherein the controller processes the two images within the measured field collected simultaneously using an SGB algorithm or a BM algorithm to produce the binocular visible non-stereo images, their associated cost diagrams. and obtain the binocular stereovision images. 5. Een methode om zeer nauwkeurige stereovisiebeelden te verkrijgen, waarbij de methode de volgende stappen omvat: het verzamelen van on-line binoculaire real-time beelden binnen een gemeten veld; en het verwerken en verkrijgen van binoculaire zichtbare niet-stereobeelden, bijpassende kostendiagrammen en binoculaire stereovisiebeelden, die gebaseerd zijn op de binoculaire real-time beelden; het invoeren van één binoculair zichtbaar niet-stereobeeld uit de binoculair zichtbare niet-stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden, die verkregen zijn op basis van de binoculaire real-time beelden voor5. A method of obtaining highly accurate stereovision images, the method comprising the steps of: collecting on-line binocular real-time images within a measured field; and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereovision images based on the binocular real-time images; inputting one binocular visible non-stereo image from the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images obtained from the binocular real-time images for -18 - een getraind diep convolutioneel neuraal netwerk; en het diepe convolutionele neurale netwerk gebruiken om uiterst nauwkeurige stereovisiebeelden te verwerken en af te geven; waarbij de methode verder bestaat uit het trainen van het diepe convolutionele neurale netwerk door: het verzamelen van on-line binoculaire real-time beelden binnen een gemeten veld; en het verwerken en verkrijgen van binoculaire zichtbare niet-stereobeelden, bijpassende kostendiagrammen en binoculaire stereovisiebeelden, die gebaseerd zijn op de binoculaire real-time beelden; het verkrijgen van nauwkeurige stereovisiebeelden binnen hetzelfde gezichtsveld en tegelijkertijd van de binoculaire monsterbeelden; het corrigeren van de binoculaire zichtbare niet-stereobeelden, bijpassende kostendiagrammen en binoculaire stereovisiebeelden verwerkt en verkregen op basis van de binoculaire monsterbeelden, en het corrigeren van de precieze stereovisiebeelden; het trainen van het diepe convolutionele neurale netwerk door gebruik te maken van het ene binoculaire zichtbare niet-stereobeeld van de binoculaire zichtbare niet- stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden na correctie als drie kanaaluitlijningangen; en het gebruiken van de nauwkeurige stereovisiebeelden van de coachingeenheid na correctie als positieve monsterbeelden; het verkrijgen, wanneer afwijking tussen stereovisiebeelden, die worden afgegeven door het getrainde diepe convolutionele neurale netwerk en de positieve monsterbeelden voldoet aan een drempelwaarde, van een geconvergeerd diep convolutioneel neuraal netwerk; anders het wijzigen van elke pixel van de positieve monsterbeelden volgens de volgende formule: T=] be be en = KT + Ly + TS Teor Ty > Tg waarin To een pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd (x, y ) in de stereovisiebeelden die worden uitgevoerd door het getrainde diepe convolutionele neurale netwerk; Lies een pixelwaarde van een pixel-18 - a trained deep convolutional neural network; and use the deep convolutional neural network to process and deliver highly accurate stereovision images; the method further comprising training the deep convolutional neural network by: collecting on-line binocular real-time images within a measured field; and processing and obtaining binocular visible non-stereo images, matching cost diagrams and binocular stereovision images based on the binocular real-time images; obtaining accurate stereovision images within the same field of view and simultaneously from the binocular sample images; correcting the binocular visible non-stereo images, matching cost diagrams and binocular stereovision images processed and acquired from the binocular sample images, and correcting the precise stereovision images; training the deep convolutional neural network using the one binocular visible non-stereo image of the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images after correction as three channel alignment inputs; and using the accurate stereovision images from the coaching unit after correction as positive sample images; obtaining, when deviation between stereovision images output from the trained deep convolutional neural network and the positive sample images meets a threshold, a converged deep convolutional neural network; otherwise modifying each pixel of the positive sample images according to the following formula: T=] be be en = KT + Ly + TS Teor Ty > Tg where To represents a pixel value of a pixel of coordinates (x, y ) in the stereovision images that are performed by the trained deep convolutional neural network; Read a pixel value of a pixel -19 - met coördinaten wordt vertegenwoordigd (x, y ) in de nauwkeurige stereovisiebeelden van de coachingeenheid na correctie; Dies) een pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd (x, y ) in de binoculaire stereovisiebeelden na correctie; Lj en Zo een maximale pixelwaarde en een minimale pixelwaarde van een pixel met coördinaten wordt vertegenwoordigd (x, y ) in de stereovisiebeelden, die respectievelijk worden afgegeven door het getrainde diepe convolutionele neurale netwerk k, k, en k, overeenkomende gewichtscoëfficiënten Tie, Les en Don, respectievelijk; het doorgaan met het trainen van het diepe convolutionele neurale netwerk met behulp van de gemodificeerde positieve monsterbeelden; als het diepe convolutionele neurale netwerk convergeert, het verkrijgen van een geconvergeerd diep convolutioneel neuraal netwerk; anders het bovenstaande wijzigingsproces herhalen.-19 - is represented by coordinates (x, y ) in the accurate stereovision images of the coaching unit after correction; Dies) a pixel value of a pixel with coordinates is represented (x,y) in the binocular stereovision images after correction; Lj and Zo a maximum pixel value and a minimum pixel value of a pixel with coordinates is represented (x, y ) in the stereovision images, which are output by the trained deep convolutional neural network k, k, and k, respectively, corresponding weight coefficients Tie, Les and Thurs, respectively; continuing to train the deep convolutional neural network using the modified positive sample images; if the deep convolutional neural network converges, obtaining a converged deep convolutional neural network; otherwise repeat the above modification process. 6. De methode om zeer nauwkeurige stereovisiebeelden te verkrijgen volgens conclusie 5, waarbij het corrigeren van de binoculaire zichtbare niet-stereobeelden, het matchen van kostendiagrammen en binoculaire stereovisiebeelden verwerkt en verkregen op basis van de binoculaire monsterbeelden, en het corrigeren van het precieze stereovisiebeeld afbeeldingen, omvat: het opzetten van een coördinatensysteem met behulp van een kalibratieobject binnen hetzelfde gezichtsveld als referentie; en het bepalen van de transformatierelatie tussen de coördinaten van de binoculaire stereovisie-eenheid en de coaching-eenheid, het corrigeren van de binoculaire zichtbare niet-stereobeelden, de bijpassende kostendiagrammen en de binoculaire stereovisiebeelden, die verkregen zijn op basis van de binoculaire monsterbeelden; en het corrigeren van de precieze stereovisiebeelden volgens de transformatierelatie, en het verenigen daarvan in hetzelfde coördinatensysteem; waarbij de binoculaire stereovisie-eenheid wordt gebruikt voor het offline verzamelen van binoculaire monsterbeelden binnen een gezichtsveld en voor het online verzamelen van binoculaire real-time beelden binnen een gemeten veld; en waarbij deThe method of obtaining high-precision stereovision images according to claim 5, wherein correcting the binocular visible non-stereo images, matching cost diagrams and binocular stereovision images processed and obtained from the binocular sample images, and correcting the precise stereovision images , includes: setting up a coordinate system using a calibration object within the same field of view as a reference; and determining the transformation relationship between the coordinates of the binocular stereovision unit and the coaching unit, correcting the binocular visible non-stereo images, the matching cost diagrams and the binocular stereovision images obtained from the binocular sample images; and correcting the precise stereovision images according to the transformation relationship, and uniting them in the same coordinate system; wherein the binocular stereovision unit is used to collect binocular sample images offline within a field of view and to collect binocular real-time images within a measured field online; and where the -20 - coachingeenheid wordt gebruikt om de nauwkeurige stereovisiebeelden te verkrijgen binnen hetzelfde gezichtsveld als het binoculaire monsterbeeld.-20 - coaching unit is used to obtain the accurate stereovision images within the same field of view as the binocular sample image. 7. De methode om eer nauwkeurige stereovisiebeelden volgens conclusie 5, waarbij wanneer een positie, het gezichtsveld of een omgevingslichtbron voor het verwerven van de binoculaire real-time beelden aanzienlijk wordt veranderd, waardoor het diepe convolutionele neurale netwerk opnieuw wordt getraind.The method of obtaining accurate stereovision images according to claim 5, wherein when a position, the field of view or an ambient light source for acquiring the binocular real-time images is changed significantly, thereby retraining the deep convolutional neural network.
NL2026030A 2019-07-26 2020-07-09 A Coaching Binocular stereo Vision Device and a Method for Acquiring High-precision stereo Vision Images NL2026030B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910680675.8A CN110400333B (en) 2019-07-26 2019-07-26 Training binocular stereoscopic vision device and high-precision stereoscopic vision image acquisition method

Publications (2)

Publication Number Publication Date
NL2026030A NL2026030A (en) 2021-02-09
NL2026030B1 true NL2026030B1 (en) 2021-09-23

Family

ID=68325076

Family Applications (1)

Application Number Title Priority Date Filing Date
NL2026030A NL2026030B1 (en) 2019-07-26 2020-07-09 A Coaching Binocular stereo Vision Device and a Method for Acquiring High-precision stereo Vision Images

Country Status (2)

Country Link
CN (1) CN110400333B (en)
NL (1) NL2026030B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111260711B (en) * 2020-01-10 2021-08-10 大连理工大学 Parallax estimation method for weakly supervised trusted cost propagation
CN111476767B (en) * 2020-04-02 2022-04-12 南昌工程学院 High-speed rail fastener defect identification method based on heterogeneous image fusion

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106156748B (en) * 2016-07-22 2019-03-29 浙江零跑科技有限公司 Traffic scene participant's recognition methods based on vehicle-mounted binocular camera
KR102541559B1 (en) * 2017-08-04 2023-06-08 삼성전자주식회사 Method and apparatus of detecting objects of interest
US10803581B2 (en) * 2017-11-06 2020-10-13 Beijing Keya Medical Technology Co., Ltd. System and method for generating and editing diagnosis reports based on medical images
CN109407697A (en) * 2018-09-20 2019-03-01 北京机械设备研究所 A kind of unmanned plane pursuit movement goal systems and method based on binocular distance measurement

Also Published As

Publication number Publication date
NL2026030A (en) 2021-02-09
CN110400333B (en) 2020-06-26
CN110400333A (en) 2019-11-01

Similar Documents

Publication Publication Date Title
CN109308693B (en) Single-binocular vision system for target detection and pose measurement constructed by one PTZ camera
US20210375036A1 (en) Three-dimensional reconstruction method, apparatus and system, model training method and storage medium
CN105758426A (en) Combined calibration method for multiple sensors of mobile robot
CN110189382A (en) A kind of more binocular cameras movement scaling method based on no zone of mutual visibility domain
NL2026030B1 (en) A Coaching Binocular stereo Vision Device and a Method for Acquiring High-precision stereo Vision Images
CN111721259B (en) Underwater robot recovery positioning method based on binocular vision
CN109859277A (en) A kind of robotic vision system scaling method based on Halcon
US20040233280A1 (en) Distance measurement apparatus, distance measurement method, and distance measurement program
CN108161931A (en) The workpiece automatic identification of view-based access control model and intelligent grabbing system
Semeniuta Analysis of camera calibration with respect to measurement accuracy
JP2022542858A (en) Deep network training methods
JPH0818848A (en) Camera system and distortion removing method
CN111998862B (en) BNN-based dense binocular SLAM method
KR101021470B1 (en) Generating method of robot motion data using image data and generating apparatus using the same
CN109807937A (en) A kind of Robotic Hand-Eye Calibration method based on natural scene
CN113160327A (en) Method and system for realizing point cloud completion
CN111524174A (en) Binocular vision three-dimensional construction method for moving target of moving platform
CN105513074B (en) A kind of scaling method of shuttlecock robot camera and vehicle body to world coordinate system
CN111583342A (en) Target rapid positioning method and device based on binocular vision
Do Application of neural networks for stereo-camera calibration
Ge et al. Multivision sensor extrinsic calibration method with non-overlapping fields of view using encoded 1D target
US20230070281A1 (en) Methods and systems of generating camera models for camera calibration
CN111709998A (en) ELM space registration model method for TOF camera depth data measurement error correction
CN110849285A (en) Welding spot depth measuring method, system and medium based on monocular camera
TW201537137A (en) Twin image guiding-tracking shooting system and method