CN111586392A - Multi-image-sensor AR acquisition display device - Google Patents

Multi-image-sensor AR acquisition display device Download PDF

Info

Publication number
CN111586392A
CN111586392A CN202010388395.2A CN202010388395A CN111586392A CN 111586392 A CN111586392 A CN 111586392A CN 202010388395 A CN202010388395 A CN 202010388395A CN 111586392 A CN111586392 A CN 111586392A
Authority
CN
China
Prior art keywords
image
visible light
display
image display
display screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010388395.2A
Other languages
Chinese (zh)
Inventor
凌昆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202010388395.2A priority Critical patent/CN111586392A/en
Publication of CN111586392A publication Critical patent/CN111586392A/en
Priority to PCT/CN2021/086473 priority patent/WO2021227734A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00—Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/04—Eye-masks ; Devices to be worn on the face, not intended for looking through; Eye-pads for sunbathing
    • A61F9/06—Masks, shields or hoods for welders
    • A61F9/064—Masks, shields or hoods for welders with two windows, one for viewing and one for use during the welding process
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00—Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/04—Eye-masks ; Devices to be worn on the face, not intended for looking through; Eye-pads for sunbathing
    • A61F9/06—Masks, shields or hoods for welders
    • A61F9/065—Masks, shields or hoods for welders use of particular optical filters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30152—Solder

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Vascular Medicine (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Ophthalmology & Optometry (AREA)
  • Data Mining & Analysis (AREA)
  • Veterinary Medicine (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Medical Informatics (AREA)
  • Computer Graphics (AREA)
  • Quality & Reliability (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Studio Devices (AREA)

Abstract

The invention relates to a multi-image sensor AR acquisition display device, which comprises an image display mechanism and an equipment fixing mechanism, wherein the image display mechanism comprises a display panel, a display panel and a display panel; the image display mechanism comprises an LED soft light sheet, an LED illuminating ring, a variable electric lens camera module, an image signal processing circuit board, a radiation-proof shielding layer, an image display screen and a display eyepiece which are arranged in sequence; the equipment fixing mechanism is of a box-shaped structure, two opposite sides of the equipment fixing mechanism are provided with opposite openings, and the image display mechanism is integrally erected between the two openings; the variable electric lens camera module is used for shooting the LED illuminating ring and the LED soft light sheet, and shot image signals are transmitted to the image signal processing circuit board and are respectively transmitted to the image display screens in corresponding directions for displaying; the human eye observes the image displayed on the image display screen through the display eyepiece. The invention can completely block harmful arc light, realize positioning, stable transition of conveying strip and accurate spot welding.

Description

Multi-image-sensor AR acquisition display device
Technical Field
The invention relates to the technical field of image processing, in particular to a multi-image-sensor AR acquisition display device.
Background
In the electric welding process, in order to avoid harmful radiation of ultraviolet rays and infrared rays generated by electric arcs and damage of welding strong light to eyes, various electric welding protective masks are produced to meet market demands, wherein the light-operated electric welding protective mask is the most advanced electric welding protective mask in the current market. However, the change of the light transmittance of the light-operated welding mask requires time, so that the action of the arc light at the moment of arc striking cannot be completely avoided, but the radiation intensity reaches a maximum value at the moment of arc striking, so that the welding arc light still causes damage to human eyes.
During welding operation, welding arc light harmful to human body is generated. The arc light mainly includes infrared ray, visible ray, ultraviolet ray and electromagnetic radiation. The infrared rays of the welding arc are primarily responsible for the thermal effects of the tissue. The eyes can feel strong burning and burning pain immediately after being subjected to strong infrared radiation, chronic injury can be caused to the eyes after long-term contact, and after the eyes absorb excessive infrared rays for a long time, the elasticity of the eyes is deteriorated, the accommodation is difficult, the vision is degraded, and retina burning can be caused. The luminosity of visible rays of the welding arc is ten thousand times greater than that of rays normally born by human eyes, the retina is burned to cause glaring retinitis, and the retina feels pain, is blurred and has a central dark spot and can be recovered after a period of time; if the medicine is repeatedly used for a long time, the vision is gradually reduced. Excessive uv exposure to the welding arc causes acute keratitis of the eye, known as electro-optic ophthalmia, a specialized occupational eye disease of the welder.
In order to avoid the harmful radiation of ultraviolet and infrared rays generated by electric arc and the damage of strong welding light to eyes, various electric welding protective masks have been developed to meet the market demand, such as a hand-held electric welding mask with patent number CN207871052U, which uses a common black glass sheet as a lens group and is low in cost, but has a series of problems. The hand-held welding mask does not have the automatic light changing function, an electric welder has to remove the welding mask to start an arc, but the eyes are easily damaged due to the fact that the electric welder touches harmful welding arc light with naked eyes, and the hand-held mask occupies one hand of the electric welder, so that when the hand is needed to fix a welding part, the operation is inconvenient. In addition, the welding mask only has one shading number and is difficult to adapt to different welding requirements. The light-controlled electric welding mask is the most advanced electric welding mask in the market, for example, an automatic light-changing electric welding mask with the patent number of CN207627484U, but the change process of the light transmittance of the light-controlled electric welding mask needs time, so the effect of arc light at the moment of arc striking can not be completely avoided, but the radiation intensity reaches the maximum value at the moment of arc striking, so the electric welding arc light still causes harm to human eyes. And a large amount of infrared, ultraviolet and electromagnetic radiation passes through the mask and the liquid crystal light-changing glass to cause damage to human eyes and skin, and the unstable intensity of arc light during arc striking and spot welding operations can cause the continuous change of the color number of the light-controlled electric welding mask, so that electric welders can not clearly observe electric welding working conditions and the eyes are damaged by electric welding arc light.
In conclusion, the existing electric welding protective mask in the market can not completely block harmful arc light, realize positioning, smooth transition of strip transportation and accurate spot welding.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a multi-image sensor AR acquisition and display device, aiming at the defects of the prior art.
The technical scheme adopted by the invention for solving the technical problems is as follows: a multi-image sensor AR acquisition display device is constructed, and the device comprises: an image display mechanism and an apparatus fixing mechanism; the image display mechanism comprises an LED soft light sheet, an LED illuminating ring, a variable electric lens camera module, an image signal processing circuit board, a radiation-proof shielding layer, an image display screen and a display eyepiece which are arranged in sequence; the equipment fixing mechanism is of a box-shaped structure, two opposite sides of the equipment fixing mechanism are provided with opposite openings, and the image display mechanism is integrally erected between the two openings; the LED soft light sheet, the LED illuminating ring and the display eyepiece are arranged in pairs and correspond to the positions of two eyes; the image signal processing circuit board is electrically connected with the variable electric lens camera module and the image display screen; the number of the image display screens is 2, and the image display screens are respectively opposite to one of the display eyepieces; the variable electric lens camera module comprises two visible light cameras corresponding to the positions of two eyes and a non-visible light camera connected between the two visible light cameras, the three cameras are used for shooting an LED lighting ring and an LED soft light sheet, shot image signals are transmitted to an image signal processing circuit board, images shot by the corresponding positions of the two eyes are subjected to fusion processing by adopting an AR imaging technology and are respectively transmitted to image display screens in corresponding directions for display; the human eyes observe the images displayed on the image display screen through the left and right eye display eyepieces.
The cameras of the variable electric lens camera module comprise electric control apertures which are used for adjusting along with the brightness change of a shooting object; in addition, the system also has the functions of electric control zooming, electric control focusing, electric control optical filter switching and electric control lens optical anti-shake.
The image display screen adopts one of LCD screen, LCOS screen, OLED screen, LCOS, micro projector and other future display technologies.
The image signal processing circuit board receives visible light image signals shot by two visible light cameras corresponding to two eyes and non-visible light image signals shot by a non-visible light camera, carries out image fusion on the non-visible light image signals and the visible light image signals shot by the two visible light cameras, and correspondingly transmits the fused images to the image display screen corresponding to the two eyes for display.
The two image display screens corresponding to the positions of the two eyes can be two independent display screens. Or the left half part and the right half part of one display screen respectively display two images. And images shot by the two visible light cameras or images formed by fusing visible light and non-visible light are displayed on the left side and the right side of the display screen in a split screen mode.
The image signal processing circuit board and the image display screen are provided with radiation-proof shielding layers of lead, steel, aluminum, copper and cadmium, and the metal layer process is electroplating, film pasting or sheet metal.
The non-visible light camera is one or more of a far infrared thermal imaging image sensor, an ultraviolet image sensor and a low-light level image sensor.
Wherein, the LED soft light piece outside sets up transparent camera lens screening glass for prevent to shoot the thing to the injury of camera, LED soft light piece and LED illumination circle.
The multi-image sensor AR acquisition display device comprises an image display mechanism and an equipment fixing mechanism; the image display mechanism comprises an LED soft light sheet, an LED illuminating ring, a variable electric lens camera module, an image signal processing circuit board, a radiation-proof shielding layer, an image display screen and a display eyepiece which are arranged in sequence; the equipment fixing mechanism is of a box-shaped structure, two opposite sides of the equipment fixing mechanism are provided with opposite openings, and the image display mechanism is integrally erected between the two openings; the variable electric lens camera module is used for shooting the LED illuminating ring and the LED soft light sheet, and shot image signals are transmitted to the image signal processing circuit board and are respectively transmitted to the image display screens in corresponding directions for displaying; the human eye observes the image displayed on the image display screen through the display eyepiece. The invention can completely block harmful arc light, realize positioning, stable transition of conveying strip and accurate spot welding.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a schematic structural diagram of a multiple image sensor AR acquisition and display device provided by the present invention.
Fig. 2 is an exploded schematic diagram of a multi-image sensor AR acquisition and display device according to the present invention.
Detailed Description
For a more clear understanding of the technical features, objects and effects of the present invention, embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
As shown in fig. 1 and 2, the present invention provides a multi-image sensor AR acquisition display device, comprising: an image display mechanism 110 and a device fixing mechanism 1; the image display mechanism 110 comprises an LED soft light sheet 3, an LED illuminating ring 2, a variable electric lens camera module, an image signal processing circuit board 8, a radiation-proof shielding layer 11, an image display screen 9 and a display eyepiece 10 which are arranged in sequence; the equipment fixing mechanism 1 is of a box-shaped structure, two opposite sides of the equipment fixing mechanism are provided with opposite openings, and the image display mechanism 110 is integrally erected between the two openings; the LED flexible light sheet 3, the LED illuminating ring 2 and the display eyepiece 10 are arranged in pairs and correspond to the positions of two eyes; the image signal processing circuit board 8 is electrically connected with the variable electric lens camera module and the image display screen 9; the number of the image display screens 9 is 2, and the image display screens are respectively opposite to one of the display eyepieces 10; the variable electric lens camera module comprises two visible light cameras 5 corresponding to the positions of two eyes and a non-visible light camera 6 connected between the two visible light cameras 5, the three cameras are used for shooting the LED illuminating ring 2 and the LED soft light sheet 3, shot image signals are transmitted to an image signal processing circuit board 8, images shot by the corresponding positions of the two eyes are subjected to fusion processing by adopting an AR imaging technology and are respectively transmitted to an image display screen 9 in the corresponding direction for display; the human eye observes the image displayed on the image display screen 9 through the display eyepiece 10.
The cameras of the variable electric lens camera module comprise electric control apertures which are used for adjusting along with the brightness change of a shooting object; in addition, the system also has the functions of electric control zooming, electric control focusing, electric control optical filter switching and electric control lens optical anti-shake.
The image display screen 9 is one of an LCD screen, an LCOS screen, an OLED screen, an LCOS, a micro projector, and other future display technologies.
The image signal processing circuit board 8 receives visible light image signals shot by two visible light cameras 5 corresponding to two eyes and non-visible light image signals shot by the non-visible light cameras 6, performs image fusion on the non-visible light image signals and the visible light image signals shot by the two visible light cameras 5, and correspondingly transmits the fused images to the image display screen 9 corresponding to the two eyes for display.
The two image display screens 9 corresponding to the positions of the two eyes are set as the same display screen, and the images which are shot by the two visible light cameras 5 and subjected to image fusion are displayed on the left side and the right side of the display screen in a split screen mode.
The radiation-proof shielding layer 11 arranged on the image signal processing circuit board 8 and the image display screen 9 is one of lead, steel, aluminum, copper and cadmium, and the metal layer process is one of electroplating, film pasting and sheet metal.
The non-visible light camera 6 is one or more of a far infrared thermal imaging image sensor, an ultraviolet image sensor and a low-light-level image sensor.
Wherein, the outer side of the LED soft light sheet 3 is provided with a transparent lens protection sheet 4 for preventing the shot objects from damaging the LED soft light sheet 3 and the LED illumination ring 2.
The electromagnetic "spectrum" includes all forms of electromagnetic radiation, from very low frequency electromagnetic radiation to very high frequency electromagnetic radiation. There are radio waves, microwaves, infrared rays, visible light, ultraviolet light, and the like between the two. The general definition of the radio frequency portion of the electromagnetic spectrum refers to radiation having a frequency of from about 3 khz to about 300 ghz. Some electromagnetic radiation has certain influence on human body, such as strong visible light (direct vision of the sun, arc light of electric welding, laser, etc.) and non-visible light (ultraviolet ray, infrared laser, ultraviolet laser). In real life, there are some cases where the light has to be directed, such as the welder.
In the invention, a visible light camera 5 in a variable electric lens camera module respectively collects two paths of visible light or near infrared image signals of a left eye and a right eye, and a path of non-visible light image sensor is added as a non-visible light camera 6, such as an infrared thermal imaging image sensor, an ultraviolet image sensor and a low-light image sensor, the collected images are transmitted to an image signal processing circuit board 8, images shot by corresponding double-eye positions are subjected to fusion processing by adopting an AR imaging technology and are respectively transmitted to an image display screen 9 in a corresponding direction for three-dimensional display. Human eyes can safely observe visible light stereoscopic images or non-visible light images (non-stereoscopic) under the condition of protecting harmful rays, and the stereoscopic visible light images are overlapped and fused with mixed images of the non-visible light images.
The display mode of the stereoscopic display includes a mode of two display screens and a single display screen, in which,
the display modes of the two display screens include:
1. one display screen displays a left visible light camera image (corresponding to left eye viewing) and the other display screen displays a right visible light camera image (corresponding to right eye viewing).
2. One display screen displays a non-visible light image and the other display screen displays a non-visible light image.
3. The left half area of the screen displays a left visible light camera image and a non-visible light fused image (corresponding to left eye observation), and the other display screen displays a right visible light camera image and a non-visible light fused image (corresponding to right eye observation).
The display modes of the single display screen comprise:
1. the left half of the screen displays the left visible camera image (corresponding to left eye viewing) and the right half of the screen displays the right visible camera image (corresponding to right eye viewing).
2. The left half of the screen displays a non-visible light image, and the right half of the screen displays a non-visible light image.
3. The left half area of the screen displays a left visible light camera image and a non-visible light fused image (corresponding to left eye observation), and the right half area of the screen displays a right visible light camera image and a non-visible light fused image (corresponding to right eye observation). The double-camera three-dimensional image acquisition and display can protect the face and eyes of the observation staff from being damaged by harmful rays.
In practical application, the device is applied to glasses, goggles, telescopes, microscopes and surveillance cameras, and the faces and eyes of observation workers are protected from being damaged by harmful rays through the three-dimensional image acquisition and display of the double cameras.
The dose of external harmful rays is greatly reduced after the external harmful rays pass through the box body outer shell layer and the radiation-proof shielding layer 11 of the equipment fixing mechanism 1, an observer is actually hidden behind the protective layer and observes images of a display screen through a lens, the harmful rays are prevented from penetrating through protective glasses and a variable-light electric welding mask to damage human eyes and skin, and the dose of harmful radiation is reduced to N orders of magnitude of the dose of the originally adopted protective glasses (such as laser goggles and electric welding masks). Occupational injury is greatly reduced.
The electromagnetic radiation protective layer comprises a box body outer shell layer and a radiation-proof shielding layer 11 of the equipment fixing mechanism 1, metal can be lead, steel, aluminum, copper, cadmium and other metals, a metal layer process can be electroplating, film pasting, sheet metal and other modes, one layer of a multi-layer PCB of the image signal processing circuit board is set to be a full copper layer, and the radiation-proof shielding layer 11 is arranged between human eyes and an image acquisition sensor of the variable electric lens camera module.
The image signal processing circuit board 8 controls an electric aperture, an image sensor gain and an image sensor electronic shutter according to the intensity of light of the visible light image sensor, automatically adjusts the exposure, prevents over exposure or under exposure and enables images on the display screen. For example, during electric welding operation, the positioning state of the welding seam without starting the arc can be clearly observed, the welding image is quickly and automatically adjusted to be observed in the non-overexposed state after the arc is started, and the welding state of the bar transporting molten pool is clearly observed. While image magnification of the observation area can be achieved by adjusting the optical or digital zoom. Finally, the eye skin is protected at a high level, the working efficiency is greatly improved, and the welding quality is improved.
In addition, in the prior art, the fusion of the invisible light and the visible light image is realized by a single visible light image sensor and a single infrared image sensor, and the display observation of the stereoscopic image cannot be realized. The structure of the invention adopts two visible light images and a non-visible light image sensor to realize the acquisition, fusion and display of a three-dimensional visible light image and a non-visible light image. The stereo visible light and infrared double-waveband image fusion technology integrates the characteristic data of two images, realizes information complementation, can be used for glasses, goggles, telescopes, microscopes and non-visible light monitoring equipment, and obtains more stereo, clear, reliable, accurate and comprehensive image information description about a target or a scene through a final composite image.
Application example: in the process of high-power optical fiber laser welding, the infrared radiation of a molten pool contains rich welding quality information. The human eyes can not observe non-visible light images, the invention can simultaneously collect visible light images and infrared laser images for observation, or transmit the fused images to automatic welding processing control equipment, and a near-infrared high-speed camera is used for acquiring dynamic thermal images of a welding pool by taking a high-power optical fiber laser butt welding 304 stainless steel plate as a test object. Defining and extracting the width of a molten pool, the area of a key hole, the perimeter of the key hole and the centroid horizontal and vertical coordinates of the key hole to serve as characteristic parameters of the molten pool, establishing a regression model of the characteristic parameters of the molten pool and the width of a weld joint by using a support vector machine, and optimizing the parameters of the support vector machine through grid optimization and a particle swarm algorithm. Tests show that the established support vector regression machine can better fuse the characteristics of the molten pool and predict the width of a weld joint, thereby greatly improving the quality of automatically monitoring the laser welding of the high-power optical fiber.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (8)

1. A multi-image sensor AR acquisition display device is characterized by comprising: an image display mechanism and an apparatus fixing mechanism; the image display mechanism comprises an LED soft light sheet, an LED illuminating ring, a variable electric lens camera module, an image signal processing circuit board, a radiation-proof shielding layer, an image display screen and a display eyepiece which are arranged in sequence; the LED soft light sheet, the LED illuminating ring and the display eyepiece are arranged in pairs and correspond to the positions of two eyes; the image signal processing circuit board is electrically connected with the variable electric lens camera module and the image display screen; the number of the image display screens is 2, and the image display screens are respectively opposite to one of the display eyepieces; the variable electric lens camera module comprises two visible light cameras corresponding to the positions of two eyes and a non-visible light camera connected between the two visible light cameras, the three cameras shoot an observed object, a shot image signal is transmitted to an image signal processing circuit board, images shot by the two corresponding eyes are subjected to fusion processing by adopting an AR imaging technology and are respectively transmitted to an image display screen in a corresponding direction to be displayed; the human eye observes the image displayed on the image display screen through the display eyepiece.
2. The multi-image sensor AR acquisition and display device of claim 1, wherein the cameras of the variable motorized lens camera module each comprise an electrically controlled aperture for adjusting with brightness changes of a subject; in addition, the system also has the functions of electric control zooming, electric control focusing, electric control optical filter switching and electric control lens optical anti-shake.
3. The multi-image sensor AR acquisition display device according to claim 1, wherein the image display screen is one of LCD screen, LCOS screen, OLED screen, LCOS, pico projector, and future other display technologies.
4. The device of claim 1, wherein the image signal processing circuit board receives visible light image signals shot by two visible light cameras corresponding to two eyes and non-visible light image signals shot by a non-visible light camera, performs image fusion on the non-visible light image signals and the visible light image signals shot by the two visible light cameras, and correspondingly transmits the fused image to the image display screen corresponding to the two eyes for display.
5. The multi-image sensor AR acquisition display device of claim 4, wherein two image display screens corresponding to the positions of both eyes, the left display screen displays the left visible camera image or the fused image of the left visible camera image plus the intermediate non-visible camera image. And the right display screen displays a right visible light camera image or a fusion image of the right visible light camera image and the middle non-visible light camera image.
6. The multi-image sensor AR acquisition and display device as claimed in claim 1, wherein the image signal processing circuit board and the image display screen are provided with radiation shielding layers of one of lead, steel, aluminum, copper and cadmium, and the metal layer process is one of electroplating, film pasting and sheet metal.
7. The multi-image sensor AR acquisition display device of claim 1, wherein the non-visible camera is one or more of a far infrared thermal imaging image sensor, an ultraviolet image sensor, and a low light level image sensor.
8. The multi-image sensor AR acquisition and display device as claimed in claim 1, wherein a transparent lens protection sheet is disposed outside the LED soft light sheet for preventing the camera, the LED soft light sheet and the LED illumination ring from being damaged by the object.
CN202010388395.2A 2020-05-09 2020-05-09 Multi-image-sensor AR acquisition display device Pending CN111586392A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202010388395.2A CN111586392A (en) 2020-05-09 2020-05-09 Multi-image-sensor AR acquisition display device
PCT/CN2021/086473 WO2021227734A1 (en) 2020-05-09 2021-04-12 Multi image sensor ar acquisition and display apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010388395.2A CN111586392A (en) 2020-05-09 2020-05-09 Multi-image-sensor AR acquisition display device

Publications (1)

Publication Number Publication Date
CN111586392A true CN111586392A (en) 2020-08-25

Family

ID=72110775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010388395.2A Pending CN111586392A (en) 2020-05-09 2020-05-09 Multi-image-sensor AR acquisition display device

Country Status (2)

Country Link
CN (1) CN111586392A (en)
WO (1) WO2021227734A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2588881A (en) * 2019-08-23 2021-05-19 Metsios Ioannis Metal clad electronic eyewear for protection against laser hazard
WO2021227734A1 (en) * 2020-05-09 2021-11-18 凌昆 Multi image sensor ar acquisition and display apparatus

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6016160A (en) * 1993-03-31 2000-01-18 Cairns & Brother Inc. Combination head-protective helmet and thermal imaging apparatus
US6230327B1 (en) * 1998-03-12 2001-05-15 La Soudure Autogene Francaise Protective mask for welding with viewing in the infrared and use of such a mask
CN2815316Y (en) * 2005-07-20 2006-09-13 李广权 Self-lighting type solder protective face mask
CN101214178A (en) * 2007-12-26 2008-07-09 北京理工大学 Video frequency reinforcing reality auxiliary operation welding protection helmet
US20160301892A1 (en) * 2013-10-15 2016-10-13 Oran Jacob Isaac-Lowry Miniature HD Camera System
CN108010128A (en) * 2017-11-23 2018-05-08 华中科技大学 The analysis method of infrared detection auxiliary welding intelligent helmet device based on AR
CN109172135A (en) * 2018-09-14 2019-01-11 华侨大学 Electric welder's helmet with dual camera and liquid crystal display
CN109276368A (en) * 2018-10-24 2019-01-29 华侨大学 Self-powered ventilating band dual camera electric welder's helmet
CN109803092A (en) * 2017-11-17 2019-05-24 林肯环球股份有限公司 High dynamic range is realized in Dual-spectrum digital imaging welding helmet
CN110989168A (en) * 2019-11-12 2020-04-10 陕西禾宁电子科技有限公司 AR fire control goggles

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001259883A (en) * 2000-03-10 2001-09-25 Minolta Co Ltd Observing device, monitoring device, welding equipment, and method of welding work
US20020053101A1 (en) * 2000-04-20 2002-05-09 Gordon Slack Helmet
US20100088793A1 (en) * 2006-06-06 2010-04-15 Livio Ghisleni Face and antiglare protection device for persons working in sites involving hazardous, damaging or disturbing radiation, especially welders
CN102397106B (en) * 2011-10-03 2013-07-10 杨晓峰 Multispectral light-splitting fused surgical operation guide system
CN109862288B (en) * 2019-03-26 2023-05-05 华侨大学 Video automatic switching circuit with double-camera welding mask and working method
CN111586392A (en) * 2020-05-09 2020-08-25 凌昆 Multi-image-sensor AR acquisition display device

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6016160A (en) * 1993-03-31 2000-01-18 Cairns & Brother Inc. Combination head-protective helmet and thermal imaging apparatus
US6230327B1 (en) * 1998-03-12 2001-05-15 La Soudure Autogene Francaise Protective mask for welding with viewing in the infrared and use of such a mask
CN2815316Y (en) * 2005-07-20 2006-09-13 李广权 Self-lighting type solder protective face mask
CN101214178A (en) * 2007-12-26 2008-07-09 北京理工大学 Video frequency reinforcing reality auxiliary operation welding protection helmet
US20160301892A1 (en) * 2013-10-15 2016-10-13 Oran Jacob Isaac-Lowry Miniature HD Camera System
CN109803092A (en) * 2017-11-17 2019-05-24 林肯环球股份有限公司 High dynamic range is realized in Dual-spectrum digital imaging welding helmet
CN108010128A (en) * 2017-11-23 2018-05-08 华中科技大学 The analysis method of infrared detection auxiliary welding intelligent helmet device based on AR
CN109172135A (en) * 2018-09-14 2019-01-11 华侨大学 Electric welder's helmet with dual camera and liquid crystal display
CN109276368A (en) * 2018-10-24 2019-01-29 华侨大学 Self-powered ventilating band dual camera electric welder's helmet
CN110989168A (en) * 2019-11-12 2020-04-10 陕西禾宁电子科技有限公司 AR fire control goggles

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2588881A (en) * 2019-08-23 2021-05-19 Metsios Ioannis Metal clad electronic eyewear for protection against laser hazard
WO2021227734A1 (en) * 2020-05-09 2021-11-18 凌昆 Multi image sensor ar acquisition and display apparatus

Also Published As

Publication number Publication date
WO2021227734A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
US6230327B1 (en) Protective mask for welding with viewing in the infrared and use of such a mask
JP2762677B2 (en) Optical device
US20120200810A1 (en) Display Method, Display Apparatus, Optical Unit, Method of Manufacturing Display Apparatus, and Electronic Equipment
CN103733117B (en) Stereo optical system
JP5151207B2 (en) Display device
WO2013013230A2 (en) Wearable display devices
CN111586392A (en) Multi-image-sensor AR acquisition display device
JPH11146387A (en) Welding state remote supervisory system and its method
US5255088A (en) System and process for video monitoring a welding operation
NL8003063A (en) VIEWFINDER FOR A TV CAMERA.
JP2007214964A (en) Video display device
CN208021323U (en) Display device, automobile for automobile A column
CN107516469B (en) Display electronic equipment and driving method thereof
JP2011145607A (en) Head mount display
CN111988519A (en) Welding guidance system for providing high-quality images
KR102254174B1 (en) A head mounted display apparatus with night vision function
JPH07218864A (en) Three-dimensional image display device
US20090231417A1 (en) Protective Glasses
JPS6326265A (en) Welding supervisory equipment
JP2011095839A (en) Method for generating corrected image data, and display device
US8334899B1 (en) Protective laser beam viewing device
US20150150725A1 (en) Device for viewing and for protection against optical radiation and solid or liquid spray
CN211528848U (en) Sound-control automatic photographing glasses
JP6544901B2 (en) Vision aid system and vision aid device
CN114002897A (en) Composite night vision device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20200825