WO2021227734A1

WO2021227734A1 - Multi image sensor ar acquisition and display apparatus

Info

Publication number: WO2021227734A1
Application number: PCT/CN2021/086473
Authority: WO
Inventors: 凌昆
Original assignee: 凌昆
Priority date: 2020-05-09
Filing date: 2021-04-12
Publication date: 2021-11-18
Also published as: CN111586392A

Abstract

The present invention relates to a multi image sensor AR acquisition and display apparatus, comprising an image display mechanism and a device fixing mechanism; the image display mechanism comprises an LED flexible light sheet, an LED lighting ring, a variable motorised lens camera module, an image signal processing circuit board, an anti-radiation shielding layer, an image display screen, and a display eyepiece arranged in sequence; the device fixing mechanism is a box-shaped structure, opposite openings being arranged on two opposite sides, and the image display mechanism being erected as a whole between the two openings; the variable motorised lens camera module photographs the LED lighting ring and the LED flexible light sheet, and the photographed image signals are transmitted to the image signal processing circuit board, and are respectively transmitted to the image display screen in the corresponding orientation for display; by means of the display eyepiece, the human eye can observe the image displayed on the image display screen. The present invention can completely block harmful arc light and achieve the smooth transition of positioning and rod movement and precise spot welding.

Description

Multi-image sensor AR acquisition and display device

Technical field

The present invention relates to the technical field of image processing, and more specifically, to a multi-image sensor AR acquisition and display device.

Background technique

In the electric welding process, in order to avoid the harmful radiation of ultraviolet and infrared rays generated by the arc and the damage to the eyes caused by the welding strong light, various electric welding protective masks have emerged to meet the market demand. Among them, the light-controlled electric welding mask is currently on the market. The most advanced welding protective mask. However, the process of changing the transmittance of the light-controlled electric welding mask takes time, so the effect of the arc at the moment of arcing cannot be completely avoided, but the radiation intensity at the moment of arcing reaches a maximum value, so the welding arc will still cause damage to the human eyes.

During welding operations, electric welding arcs that are harmful to the human body are generated. Electric welding arc mainly includes infrared, visible light, ultraviolet, and electromagnetic radiation. The main hazard to the human body caused by the infrared rays of the welding arc is the heat effect of the tissue. When the eyes are exposed to strong infrared radiation, they will immediately feel strong burns and burning pain. Long-term contact will cause chronic damage to the eyes. After the eye lens absorbs excessive infrared rays for a long time, it will make its elasticity worse, difficult to adjust, and reduce vision. It can also cause retinal burns. The luminosity of the visible light of the welding arc is 10,000 times larger than the luminosity of the light that the human eye can withstand normally. It will burn the retina and cause glare retinitis. At this time, you will feel pain in the eyes, ophthalmic film, and a central dark spot. , It can only recover after a period of time; if it is repeatedly used for a long time, it will gradually reduce vision. Excessive exposure to ultraviolet rays from the welding arc can cause acute keratitis in the eyes, called electro-optic ophthalmia, which is a special occupational eye disease of electric welders.

In order to avoid the harmful radiation of ultraviolet and infrared rays generated by the arc, and the damage to the eyes caused by the strong welding light, various welding protective masks have emerged to meet the market demand. For example, a handheld welding mask with patent number CN207871052U, handheld The welding mask uses ordinary black glass as the lens group. The price is low, but there are series of problems. The hand-held welding mask does not have the automatic dimming function. The welder must remove the welding mask to start the arc, but the naked eye contact with harmful welding arc light can easily cause eye damage, and the hand-held mask occupies one hand of the welder, so it is necessary When the welding parts are fixed by hand, it will cause inconvenience to the operation. In addition, this welding mask has only one shading number, which is difficult to adapt to different welding needs. The light-controlled electric welding mask is the most advanced welding protective mask currently on the market. For example, an automatic darkening welding mask with the patent number CN207627484U. The effect cannot be completely avoided, but the radiation intensity reaches a maximum value at the moment of arc starting, so the welding arc light will still cause damage to human eyes. In addition, a large amount of infrared, ultraviolet and electromagnetic radiation passes through the mask and the liquid crystal dimming glass, causing damage to human eyes and skin. The instability of arc intensity during arc ignition and spot welding operations will cause continuous changes in the color number of the light-controlled electric welding mask. , Resulting in welding workers unable to clearly observe the welding conditions and the eye injury by the welding arc.

To sum up, the existing electric welding protective masks in the market cannot completely block harmful arcs, realize the smooth transition of positioning and transport, and precise spot welding.

Summary of the invention

The technical problem to be solved by the present invention is to provide a multi-image sensor AR collection and display device in view of the defects of the prior art.

The technical solution adopted by the present invention to solve its technical problems is: constructing a multi-image sensor AR acquisition and display device, including: an image display mechanism and a device fixing mechanism; the image display mechanism includes LED diffusors and LED lighting arranged in sequence Ring, variable electric lens camera module, image signal processing circuit board, radiation shielding layer, image display screen and display eyepiece; Between the two openings; among them, the LED diffuser, the LED lighting ring and the display eyepiece are set in pairs, corresponding to the positions of the eyes; the image signal processing circuit board is electrically connected to the variable motorized lens camera module and the image display screen; the image display screen is set There are two, each facing one of the display eyepieces; the variable motorized lens camera module includes two visible light cameras corresponding to the positions of the eyes, and a non-visible light camera connected between the two visible light cameras, and the three are facing the LED lighting Ring and LED soft light film for shooting, the captured image signals are transmitted to the image signal processing circuit board, the images captured by the corresponding binocular positions are fused by AR imaging technology, and they are respectively transmitted to the corresponding position of the image display screen for display; The human eye displays the eyepieces through the left and right eyes, and performs stereoscopic image observation of the image displayed on the image display screen.

Among them, the camera of the variable motorized lens camera module includes an electronically controlled aperture to adjust with the brightness of the subject; in addition, it also has an electronically controlled zoom, an electronically controlled focus, an electronically controlled filter switch, and an electronically controlled lens optics. Anti-shake function.

Among them, the image display screen adopts one of LCD screen, LCOS screen, OLED screen, LCOS, micro projector, and other display technologies in the future.

Among them, the image signal processing circuit board receives the visible light image signals captured by the two visible light cameras corresponding to the eyes and the invisible light image signals captured by the invisible light cameras, and performs image fusion between the invisible light image signals and the visible light image signals captured by the two visible light cameras. , And correspondingly transmit the fused image to the image display screen of the corresponding eyes for display.

Among them, the two image display screens corresponding to the positions of the eyes may be two independent display screens. Or two images are displayed on the left and right halves of a display screen. On the left and right sides of the display screen, the images taken by the two visible light cameras or the images after the fusion of visible light and invisible light are displayed separately on the left and right sides of the display screen.

Among them, the radiation shielding layer provided on the image signal processing circuit board and the image display screen is one of lead, steel, aluminum, copper, and cadmium, and the metal layer process is one of electroplating, filming, and sheet metal.

Among them, the non-visible light camera is one or more of a far-infrared thermal imaging image sensor, an ultraviolet image sensor, and a low-light image sensor.

Among them, a transparent lens protection sheet is arranged on the outside of the LED soft light sheet to prevent damage to the camera, the LED soft light sheet and the LED lighting ring by the shooting object.

The multi-image sensor AR acquisition and display device of the present invention includes an image display mechanism and a device fixing mechanism; the image display mechanism includes an LED diffuser, an LED lighting ring, a variable motorized lens camera module, and an image signal processing circuit board arranged in sequence , Anti-radiation shielding layer, image display screen and display eyepiece; the device fixing mechanism is a box-shaped structure, two opposite sides are provided with opposite openings, and the image display mechanism is set up between the two openings; the variable motorized lens camera module is facing the LED The illuminating ring and the LED soft light film are used for shooting, and the captured image signals are transmitted to the image signal processing circuit board, and are respectively transmitted to the corresponding image display screen for display; the human eye uses the display eyepiece to perform the image display on the image display screen. observe. Through the present invention, harmful arc light can be completely blocked, smooth transition of positioning and strip transportation and precise spot welding can be realized.

Description of the drawings

The present invention will be further described below in conjunction with the accompanying drawings and embodiments. In the accompanying drawings:

FIG. 1 is a schematic structural diagram of a multi-image sensor AR acquisition and display device provided by the present invention.

Fig. 2 is a schematic diagram of an exploded structure of a multi-image sensor AR acquisition and display device provided by the present invention.

Detailed ways

In order to have a clearer understanding of the technical features, objectives and effects of the present invention, the specific embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

As shown in Figures 1 and 2, the present invention provides a multi-image sensor AR acquisition and display device, which includes: an image display mechanism 110 and an equipment fixing mechanism 1; the image display mechanism 110 includes LED diffusers 3 arranged in sequence. , LED lighting ring 2, variable motorized lens camera module, image signal processing circuit board 8, anti-radiation shielding layer 11, image display screen 9 and display eyepiece 10; equipment fixing mechanism 1 is a box-shaped structure, and two opposite sides are arranged opposite The image display mechanism 110 is set up between the two openings as a whole; among them, the LED diffuser 3, the LED illuminating ring 2 and the display eyepiece 10 are arranged in pairs, corresponding to the positions of the eyes; the image signal processing circuit board 8 and the variable motorized lens The camera module and the image display screen 9 are electrically connected; the image display screen 9 is set to two, which are respectively opposite to display one of the eyepieces 10; the variable motorized lens camera module includes two visible light cameras 5 corresponding to the positions of the eyes, and the connection The non-visible light camera 6 between the two visible light cameras 5 is photographing the LED illuminating ring 2 and the LED soft film 3, and the captured image signal is transmitted to the image signal processing circuit board 8, and the corresponding binocular position is captured. Using AR imaging technology for fusion processing, the images are respectively transmitted to the corresponding azimuth image display screen 9 for display; the human eye observes the image displayed on the image display screen 9 through the display eyepiece 10.

Among them, the image display screen 9 uses one of LCD screens, LCOS screens, OLED screens, LCOS, micro projectors, and other display technologies in the future.

Among them, the image signal processing circuit board 8 receives the visible light image signals taken by the two visible light cameras 5 corresponding to both eyes and the non-visible light image signals taken by the non-visible light camera 6, and combines the non-visible light image signals with the visible light images taken by the two visible light cameras 5 The signal is image fused, and the fused image is correspondingly transmitted to the image display screen 9 corresponding to both eyes for display.

Among them, the two image display screens 9 corresponding to the positions of the eyes are set as the same display screen, and the images taken by the two visible light cameras 5 after image fusion are displayed on the left and right sides of the display screen separately.

Among them, the radiation shielding layer 11 provided on the image signal processing circuit board 8 and the image display screen 9 is one of lead, steel, aluminum, copper, and cadmium, and the metal layer process is one of electroplating, filming, and sheet metal.

Among them, the non-visible light camera 6 is one or more of a far-infrared thermal imaging image sensor, an ultraviolet image sensor, and a low-light image sensor.

Among them, a transparent lens protection sheet 4 is arranged on the outside of the LED soft light sheet 3 to prevent damage to the LED soft light sheet 3 and the LED lighting ring 2 by the shooting object.

The electromagnetic "spectrum" includes all kinds of electromagnetic radiation, from extremely low frequency electromagnetic radiation to extremely high frequency electromagnetic radiation. There are radio waves, microwaves, infrared light, visible light and ultraviolet light in between. The general definition of the radio frequency part of the electromagnetic spectrum refers to radiation with a frequency of approximately 3 kHz to 300 GHz. Some electromagnetic radiation has a certain effect on the human body. Strong visible light (looking directly at the sun, welding arc light, laser, etc.), non-visible light (ultraviolet, infrared, infrared laser, ultraviolet laser). In real life and work, there are some situations that have to face the above-mentioned light, such as electric welders.

In the present invention, the visible light camera 5 in the variable motorized lens camera module collects two visible light or near-infrared image signals of the left eye and right eye respectively, and a non-visible light image sensor is added as the non-visible light camera 6, such as infrared thermal imaging Image sensor, ultraviolet image sensor, low-light image sensor, transfer the collected images to the image signal processing circuit board 8, and use AR imaging technology for fusion processing of the images captured by the corresponding binocular positions, and respectively transmit them to the corresponding image display screen Perform stereo display on 9. Human eyes can safely observe visible light stereoscopic images, or non-visible light images (non-stereoscopic), and the stereoscopic visible light images are superimposed and combined with mixed images of non-visible light images under the condition of protecting against harmful rays.

The display mode of stereoscopic display includes two display screens and a single display screen. Among them,

The display modes of the two displays include:

1. One display screen displays the left visible light camera image (corresponding to the left eye observation), and the other display screen displays the right visible light camera image (corresponding to the right eye observation).

2. One display screen displays a non-visible light image, and the other display screen displays a non-visible light image.

3. The left half of the screen displays the left visible light camera image plus the invisible light fusion image (corresponding to the left eye observation), and the other display screen displays the right visible light camera image plus the invisible light fusion image (corresponding to the right eye observation).

The display modes of a single display include:

1. The left half of the screen displays the left visible light camera image (corresponding to the left eye observation), and the right half of the screen displays the right visible light camera image (corresponding to the right eye observation).

2. Invisible light images are displayed on the left half of the screen, and invisible light images are displayed on the right half of the screen.

3. The left half of the screen displays the left visible light camera image plus the invisible light fusion image (corresponding to the left eye observation), and the right half of the screen displays the right visible light camera image plus the invisible light fusion image (corresponding to the right eye observation). Stereoscopic image collection and display with dual cameras protect the face and eyes of the observation staff from harmful rays to avoid damage.

In practical applications, the device of the present invention is applied to glasses, goggles, telescopes, microscopes, and surveillance cameras, and uses dual-camera stereo image collection and display to protect the faces and eyes of observation workers from harmful rays and avoid damage.

The dose of external harmful rays is greatly reduced after passing through the cabinet shell layer of the equipment fixing mechanism 1 and the radiation shielding layer 11. The observer actually hides behind the protective layer and observes the screen image through the lens to prevent harmful rays from passing through the protective glasses and dimming Electric welding masks cause damage to human eyes and skin, and the harmful radiation dose is reduced to N orders of magnitude of the original protective glasses (such as laser goggles, electric welding masks). Greatly reduce occupational injuries.

The electromagnetic radiation protection layer includes the box shell layer of the equipment fixing mechanism 1 and the radiation shielding layer 11. The metal can be lead, steel, aluminum, copper, cadmium and other metals. The metal layer process can be electroplating, filming, sheet metal, etc. , A certain layer of the multilayer PCB of the image signal processing circuit board is set as an all-copper layer, and a radiation shielding layer 11 is set between the human eye and the image acquisition sensor of the variable motorized lens camera module.

The image signal processing circuit board 8 controls the electric iris, the image sensor gain, and the image sensor electronic shutter according to the intensity of the visible light image sensor, and automatically adjusts the exposure to prevent over or underexposure and make the image on the display screen. For example, during electric welding operation, you can clearly observe the positioning state of the un-arc welding seam, and quickly and automatically adjust to the unexposed state of the welding image after the arc is started, and clearly observe the welding state of the molten pool. At the same time, the image of the observation area can be enlarged by adjusting the optical or digital zoom. Finally, a high-level protection of the eyes and skin is achieved, greatly improving work efficiency and improving welding quality.

In addition, the fusion of non-visible light and visible light images in the prior art uses a single visible light image sensor and a single infrared image sensor, which cannot realize stereoscopic image display and observation. The structure of the present invention adopts two visible light images and a non-visible light image sensor to realize the collection and fusion display of the three-dimensional visible light image and one non-visible light image. Stereo visible light and infrared dual-band image fusion technology integrates the characteristic data of the two images to achieve complementary information. It can be used in glasses, goggles, telescopes, microscopes, non-visible light monitoring equipment, and through the final composite image to obtain information about the target or scene More three-dimensional, clear, reliable, accurate, and comprehensive image information description.

Application example: In the process of high-power fiber laser welding, the infrared radiation of the molten pool contains abundant welding quality information. Human eyes cannot observe non-visible light images. The present invention can collect visible light and infrared laser images for observation at the same time, or transmit the fused image to the automatic welding processing control equipment, and use high-power fiber laser butt welding 304 stainless steel plate as the test object. The near-infrared high-speed camera acquires the dynamic thermal image of the weld pool. Define and extract the width of the molten pool, the area of the keyhole, the perimeter of the keyhole and the horizontal and vertical coordinates of the keyhole centroid, as the characteristic parameters of the molten pool, use the support vector machine to establish the regression model of the characteristic parameters of the molten pool and the width of the weld, and pass the net Lattice optimization and particle swarm optimization optimization support vector machine parameters. Experiments show that the established support vector regression machine can better integrate the characteristics of the molten pool and predict the width of the weld, thereby greatly improving the quality of automatic monitoring of high-power fiber laser welding.

The embodiments of the present invention are described above with reference to the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Those of ordinary skill in the art are Under the enlightenment of the present invention, many forms can be made without departing from the purpose of the present invention and the scope of protection of the claims, and these are all within the protection of the present invention.

Claims

A multi-image sensor AR acquisition and display device, which is characterized by comprising: an image display mechanism and a device fixing mechanism; the image display mechanism includes an LED diffuser, an LED illuminating ring, a variable motorized lens camera module, Image signal processing circuit board, anti-radiation shielding layer, image display screen and display eyepieces; among them, LED soft film, LED lighting ring and display eyepieces are set in pairs, corresponding to the positions of the eyes; image signal processing circuit board and variable motorized lens camera The module and the image display screen are electrically connected; the image display screen is set to two, and one of the eyepieces is displayed directly; the variable motorized lens camera module includes two visible light cameras corresponding to the positions of the eyes, and is connected to the two visible light cameras Between the non-visible light cameras, the three capture the observation object, and the captured image signals are transmitted to the image signal processing circuit board. The images captured by the corresponding binocular positions are fused using AR imaging technology, and they are respectively transmitted to the corresponding position image display Display on the screen; the human eye observes the image displayed on the image display screen through the display eyepiece.
The multi-image sensor AR acquisition and display device according to claim 1, wherein the cameras of the variable motorized lens camera module all include an electronically controlled aperture to adjust with the brightness of the subject; in addition, it also has an electronically controlled aperture. The functions of zoom, electronic control focus, electronic control filter switching and electronic control lens optical anti-shake function.
The multi-image sensor AR collection and display device according to claim 1, wherein the image display screen adopts one of LCD screen, LCOS screen, OLED screen, LCOS, micro projector, and other display technologies in the future.
The multi-image sensor AR acquisition and display device according to claim 1, wherein the image signal processing circuit board receives the visible light image signals taken by the two visible light cameras corresponding to the eyes and the non-visible light image signals taken by the non-visible light camera, and combines the non-visible light image signals The visible light image signal is image fused with the visible light image signals captured by the two visible light cameras, and the fused image is correspondingly transmitted to the image display screens of the corresponding eyes for display.
The multi-image sensor AR acquisition and display device according to claim 4, wherein the two image display screens corresponding to the positions of the eyes, the left display screen displays the left visible light camera image or the left visible light camera image plus the middle non-visible light camera image fusion image. The right display screen displays the right visible light camera image or the fusion image of the right visible light camera image and the middle non-visible light camera image.
The multi-image sensor AR acquisition and display device according to claim 1, wherein the radiation protection shielding layer provided on the image signal processing circuit board and the image display screen is one of lead, steel, aluminum, copper, and cadmium, The metal layer process is one of electroplating, film sticking, and sheet metal.
The multi-image sensor AR acquisition and display device according to claim 1, wherein the non-visible light camera is one or more of a far-infrared thermal imaging image sensor, an ultraviolet image sensor, and a low-light image sensor.
The multi-image sensor AR acquisition and display device according to claim 1, wherein a transparent lens protection sheet is arranged on the outside of the LED soft light sheet to prevent the camera, the LED soft light sheet and the LED lighting ring from being damaged by the photographed object.