CN108563020A - A kind of intelligent MR rescue helmets with thermal infrared imager - Google Patents
A kind of intelligent MR rescue helmets with thermal infrared imager Download PDFInfo
- Publication number
- CN108563020A CN108563020A CN201810214678.8A CN201810214678A CN108563020A CN 108563020 A CN108563020 A CN 108563020A CN 201810214678 A CN201810214678 A CN 201810214678A CN 108563020 A CN108563020 A CN 108563020A
- Authority
- CN
- China
- Prior art keywords
- image
- handheld terminal
- chips
- helmet
- thermal infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000008447 perception Effects 0.000 claims abstract description 19
- 238000001514 detection method Methods 0.000 claims abstract description 17
- 239000000523 sample Substances 0.000 claims abstract description 4
- 238000006243 chemical reaction Methods 0.000 claims description 55
- 239000011521 glass Substances 0.000 claims description 32
- 238000001931 thermography Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 12
- 230000007613 environmental effect Effects 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 6
- 230000002093 peripheral effect Effects 0.000 claims description 6
- 238000000034 method Methods 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 4
- 238000000844 transformation Methods 0.000 claims description 4
- 239000000203 mixture Substances 0.000 claims description 3
- 230000003287 optical effect Effects 0.000 claims description 3
- 230000035945 sensitivity Effects 0.000 claims description 2
- 238000003331 infrared imaging Methods 0.000 claims 1
- 230000006870 function Effects 0.000 abstract description 6
- 238000005516 engineering process Methods 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000007789 gas Substances 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- VNWKTOKETHGBQD-UHFFFAOYSA-N methane Chemical compound C VNWKTOKETHGBQD-UHFFFAOYSA-N 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 239000003345 natural gas Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
The present invention relates to images and emergency rescue technology field, the helmet is rescued more particularly to a kind of intelligent MR with thermal infrared imager, it includes the binocular camera being embedded on helmet shell, thermal infrared imager, it is placed in the image detection unit inside helmet shell, perceives unit, MR display systems, cable and handheld terminal；The binocular camera, thermal infrared imager are connected by conducting wire with image detection unit；Described image probe unit is connected by cable with handheld terminal；The perception unit is connected by cable with handheld terminal；The MR display systems are connected by cable with handheld terminal；It has the advantages such as function is strong, adaptability is good, can enhance the visibility in environment in live smog, solve the problems, such as the environment sensing of the disaster scene of rescue personnel, and then ensure life security, improve search and rescue efficiency.
Description
【Technical field】
The present invention relates to images and emergency rescue technology field, and in particular to a kind of intelligent MR rescues with thermal infrared imager
The helmet.
【Background technology】
As social cityization develops, people increasingly concentrate on life and work in city.Major part in city at present
Regional high building stands in great numbers, and public place is crowded, builds compact complexity, in addition the extensive use of the energy such as electric power, oil, natural gas and ground
Location structure change etc. so that the probability that all kinds of disaster accidents occur is continuously increased, and rescue difficulty is also growing day by day.And disaster accident
After generation, rescue personnel is needed to carry out rescue relief, so that the life of the people in disaster accident and property loss drop
To minimum.But for rescue personnel and commanding, the emergency case of disaster scene is perceived, understands the state of disaster scene
Gesture is very urgent for the life security of protecting rescue personnel and the demand for making correct decisions.The helmet is as rescue personnel's
One of necessity equipment.When in use, there are the following problems for the helmet of traditional rescue：
First is, traditional helmet only plays a part of to protect rescue personnel's body, has a single function.Without communication work(
It can so that the rescue personnel in entire disaster scene cannot form an entirety, whole orderly rescue be played, to improve rescue
Efficiency.
Second is, traditional helmet does not have positioning function so that the commander of rescue site, it cannot be according to disaster scene
The case where, scheduling is optimized, personnel are preferably directed rescue work；Under the premise of ensureing safety, it is existing that maximum possible saves disaster
, save safety of life and property.If having positioning function, environmental information and the rescue of disaster scene can be understood in real time
The location information of member can make potential danger timely reaction for rescue personnel and provide enough information.
【Invention content】
In view of the defects and deficiencies of the prior art, the present invention intends to provide a kind of intelligent MR with thermal infrared imager
The helmet is rescued, it can be provided in real time using embedded thermal infrared imager, Visible Light Camera and various kinds of sensors for wear one member
While MR is shown, it is superimposed real-time map and prompt message, and send disaster scene information and personnel state information to commander
End；It has the advantages such as function is strong, adaptability is good, can enhance the visibility in environment in live smog, solve rescue personnel's
The environment sensing problem of disaster scene, and then ensure life security, improve search and rescue efficiency；It is existing can to implement perception disaster
The case where, including heat source, smog, rescue personnel's state and position, live video etc.；Also there is information transfer capability simultaneously,
Especially in the video of complex building or image transmitting；It can be carried while protecting rescue personnel's life security
The actual effect of high rescue efficiency and floor manager.
A kind of intelligent MR with thermal infrared imager of the present invention rescues the helmet, it includes
Binocular camera, thermal infrared imager on helmet shell,
It is placed in the image detection unit inside helmet shell, perceives unit,
MR display systems,
Cable,
And handheld terminal；
The binocular camera, thermal infrared imager are connected by conducting wire with image detection unit；Described image probe unit
It is connected with handheld terminal by cable；The perception unit is connected by cable with handheld terminal；The MR display systems pass through cable
It is connected with handheld terminal.
Further, the MR display systems are by left eye MR spectacle lens, right eye MR spectacle lens, glasses driving circuit one, eye
Mirror driving circuit two, LVDS conversion chips one, LVDS conversion chips two, pilot controller composition；The pilot controller passes through
Iic bus is connected with glasses driving circuit one, glasses driving circuit two；The LVDS conversion chips one, LVDS conversion chips one
It is connected respectively with glasses driving circuit one, glasses driving circuit two by cable.
Further, the handheld terminal include arm processor, FPGA circuitry, image interface, serial ports configuration screen, LVDS turn
Change chip three, LVDS conversion chips four, 4G memory chips and peripheral circuit；The peripheral circuit include phonetic codec chip,
Hub controller；Described arm processor one end is electrically connected with FPGA circuitry, the arm processor other end respectively with voice coder solution
Code chip, 2G memory chips, hub controller electrical connection；The arm processor is electrically connected by USB interface and image interface
It connects；The arm processor is electrically connected with pilot controller, serial ports configuration screen respectively by UART interface；The FPGA circuitry is another
One end is electrically connected with LVDS conversion chips three, LVDS conversion chips four and 4G memory chips respectively；
Further, the MR display methods of MR display systems, using following steps：
S1, image detection module obtain visible light, infrared image signal and heat by the button or instruction control of handheld terminal
Imaging；Wherein, it is seen that light image uses binocular camera, thermal imaging system to use embedded micro high sensitivity thermal imaging system.Specifically,
Binocular camera uses 5,000,000 pixels, focal length 9mm, thermal imaging system to use LONG WAVE INFRARED thermal imaging camera.The present embodiment uses
LONG WAVE INFRARED thermal imaging camera have 640x512 pixels, smog, dark surrounds can be obtained with measuring temperature and thermal image
Under fire location, vital sign, escape way information；
S2, perception unit form prompt message figure after obtaining environmental information, posture and vital sign information in handheld terminal
As signal；
When it is implemented, perception unit sends the information of acquisition to handheld terminal by cable, by position after handheld terminal parsing
It sets, posture, environmental information are compiled into the text information of no background and storage.
The real-time map synthetic map information signal that S3, handheld terminal are transmitted according to the map or command terminal of storage inside；
When it is implemented, handheld terminal reduces text information, and behind additional display location with the map of storage inside or
The image superposition of image sensing cells is stored into memory to be transmitted to MR displays；
S4, the switch mode that information is shown by hand-held setting MR, display pattern can be controlled by command terminal by instructing,
Display pattern is divided into infrared mode, it is seen that optical mode, prompt message mixed mode, cartographic information mixed mode and without display mould
Formula；In this step, the image to be displayed signal stored in memory is gone out to send by the arm processor chip of handheld terminal by interface
To the fpga chip of handheld terminal, it is divided into left and right two field pictures after processing and protocol conversion is carried out by LVDS chips, be transmitted to MR
Display system, the control instruction that the display pattern of display system is sent out by the ARM of handheld terminal determine；
S5, rescue personnel can pass through the control MR display systems such as gesture, button switching, Background control and speech recognition
Pattern converts.
In this step, the arm processor chip of handheld terminal is according to the Gesture Recognition Algorithm of visible images or hand-held
Either the speech recognition algorithm of handheld terminal or the wireless communication order control MR from command system show image to the button at end
Pattern.
S6, handheld terminal are according to instructing the picture signal of arbitrary patterns by sending command terminal to, not by aobvious
Show the limitation of pattern.Rescue personnel can select opening MR to show or close display according to live situation.
Further, in the step S4, display image is obtained by FPGA processing by following steps, using following step
Suddenly：
Image to be shown is sent in fpga chip and is cached by LCD_RGB interfaces by S41, arm processor；
S42, FPGA circuitry will show that image is corrected, perspective transformations, and color transformed processing shows to meet MR
The display of system needs, and then synthesizes left-right frames image, and accelerate to frame frequency 60Hz.
The left-right frames image converted is converted into connecing for MR display systems by S43, FPGA circuitry by LVDS conversion chips 7
Mouth standard, MR display systems are transmitted to by cable.
Further, the perception unit includes 9 axis gyroscopes, vital sign sensors and gas sensor.
Further, the LVDS conversion chips one, LVDS conversion chips one are high speed LVDS chips, model
The deserializer chip of DS90UB926Q-Q1.
Further, the glasses driving circuit one is OVP0921 chips；The glasses driving circuit two is ISL97901
Chip.
Further, the arm processor is the high-new energy arm processor of 2 cores or more, and model is four core of Samsung
Cortex-A9 Exynos4412 processors.
Further, the FPGA circuitry is the high-performance low-power-consumption fpga chip that 300,000 I/O speed are more than 150MHz,
Model is the chip of XC6SLX45T.
Further, the LVDS conversion chips three, LVDS conversion chips four are high speed LVDS chips, and model is
The encoder chip of DS90UB925Q-Q1.
Further, the phonetic codec chip is WM8960 chips.
Further, the hub controller is the GL850A chips for the risc processor for having embedded 8 positions.
With the above structure, the present invention has the beneficial effect that：A kind of intelligent MR with thermal infrared imager of the present invention
The helmet is rescued, it can be provided in real time using embedded thermal infrared imager, Visible Light Camera and various kinds of sensors for wear one member
While MR is shown, it is superimposed real-time map and prompt message, and send disaster scene information and personnel state information to commander
End；It has the advantages such as function is strong, adaptability is good, can enhance the visibility in environment in live smog, solve rescue personnel's
The environment sensing problem of disaster scene, and then ensure life security, improve search and rescue efficiency；It is existing can to implement perception disaster
The case where, including heat source, smog, rescue personnel's state and position, live video etc.；Also there is information transfer capability simultaneously,
Especially in the video of complex building or image transmitting；It can be carried while protecting rescue personnel's life security
The actual effect of high rescue efficiency and floor manager.
【Description of the drawings】
Attached drawing described herein is to be used to provide further understanding of the present invention, and is constituted part of this application, but
It does not constitute improper limitations of the present invention, in the accompanying drawings：
Fig. 1 is the intelligent MR rescue helmet structure block diagrams of the present invention；
Fig. 2 is the MR display system architectures schematic diagrames in the present invention；
Fig. 3 is the structural schematic diagram of the handheld terminal in the present invention；
Fig. 4 is the flow diagram of the display methods in the present invention；
Fig. 5 is the idiographic flow schematic diagram of the step S4 in Fig. 4.
【Specific implementation mode】
Come that the present invention will be described in detail below in conjunction with attached drawing and specific embodiment, illustrative examples therein and says
It is bright to be only used for explaining the present invention but not as a limitation of the invention.
As shown in Figure 1, a kind of intelligent MR with thermal infrared imager described in present embodiment rescues the helmet, it includes
It includes handheld terminal z7, image detection unit z3, perception unit z4 and MR display system z5；Handheld terminal is for management and Perceived control
Know the various information of device；Receive command system control instruction and parsing, to the command system of the helmet transmit the image collected,
The information such as environment and sign；It is responsible for the Image Information Processing of processing MR display systems；Image detection unit includes thermal infrared imager
Z2 and Visible Light Camera, it is seen that light camera is binocular camera z1, the image for acquiring disaster scene and thermal imagery information；Perception
Unit includes 9 axis gyroscopes, vital sign sensors and gas sensor, for perceiving environmental information, posture and vital sign
Information；MR display systems provide nearly eye presentation of information for rescue personnel, can show the image of image detector, command system
Instruction, cartographic information etc..
Further, the MR display systems z5 is by left eye MR spectacle lens z511, right eye MR spectacle lens z512, glasses driving
One z521 of circuit, two z522 of glasses driving circuit, one z531, LVDS conversion chip of LVDS conversion chips, two z532, auxiliary control
Device z54 compositions；
The pilot controller z54 passes through iic bus and one z521 of glasses driving circuit, two z522 phases of glasses driving circuit
Even, the brightness of glasses, contrast are set and whether show image；
One z531, LVDS conversion chip of LVDS conversion chips, one z532 by cable Z6 respectively with glasses driving circuit
One z521, two z522 of glasses driving circuit are connected；One z531, LVDS conversion chip of LVDS conversion chips, one z532, by handheld terminal
The LVDS picture signals of transmission are converted into rgb signal and send one z521 of glasses driving circuit, two z522 of glasses driving circuit to；
One z521 of glasses driving circuit, two z522 of glasses driving circuit respectively drive left eye MR spectacle lens z511, right eye MR spectacle lens
Z512 realizes the display of image.
Further, the handheld terminal includes arm processor z71, FPGA circuitry z72, image interface z73, serial ports configuration
Shield three z75, LVDS conversion chip of z74, LVDS conversion chip, four z77,4G memory chip z76 and peripheral circuit；The periphery electricity
Road includes phonetic codec chip, hub controller；The one end the arm processor z71 is electrically connected with FPGA circuitry z72,
The arm processor z71 other ends are electrically connected with phonetic codec chip, 2G memory chips, hub controller respectively；The ARM
Processor z71 is electrically connected by USB interface with image interface z73；The arm processor z71 by UART interface respectively with it is auxiliary
Help controller Z54, the z74 electrical connections of serial ports configuration screen；The FPGA circuitry z72 other ends respectively with three z75 of LVDS conversion chips,
The four z77 and 4G memory chips z76 electrical connections of LVDS conversion chips；
Preferably, one z531, LVDS conversion chip of LVDS conversion chips, one z532 is high speed to one kind as the present invention
LVDS chips, the deserializer chip of model DS90UB926Q-Q1.
Preferably, one z521 of glasses driving circuit is OVP0921 chips to one kind as the present invention；The glasses driving
Two z522 of circuit is ISL97901 chips.
Preferably, the arm processor z71 is the high-new energy arm processor of 2 cores or more, model to one kind as the present invention
It is four core Cortex-A9 Exynos4412 processors of Samsung.
Preferably, the FPGA circuitry z72 is the high-performance that 300,000 I/O speed are more than 150MHz to one kind as the present invention
Low-power consumption FPGA chip, model are the chips of XC6SLX45T.
Preferably, three z75, LVDS conversion chip of LVDS conversion chips, four z77 is high speed to one kind as the present invention
LVDS chips, model are the encoder chips of DS90UB925Q-Q1.
Preferably, the phonetic codec chip is WM8960 chips to one kind as the present invention.
Preferably, the hub controller is the risc processor for having embedded 8 positions to one kind as the present invention
GL850A chips.
Working principle of the present invention is as follows：
As shown in Figure 1, being the intelligent MR rescue helmet structure block diagrams with thermal infrared imager；
The intelligent MR rescue helmets with thermal infrared imager of the embodiment of the present invention include the binocular on helmet shell z00
Camera z1, thermal infrared imager z2 are placed in the image detection unit z3 inside helmet shell, perception unit z4, MR display is
Unite z5, connecting cable z6 and handheld terminal z7；
Wherein, binocular camera z1, thermal infrared imager z2 are on helmet shell z00；Image detection unit z3, perception are single
First z4 is placed in inside helmet shell；Binocular camera z1, thermal infrared imager z2 pass through conducting wire and image detection unit
Z3 is connected；Described image probe unit z3 is connected by cable z6 with handheld terminal z7；The perception unit z4 by cable z6 with
Handheld terminal z7 is connected；The MR display systems z5 is connected by cable z6 with handheld terminal z7.Binocular camera z1, thermal infrared imager
The picture signal of z2 acquisitions completes adopting for image by being transmitted to handheld terminal z7 by cable z6 after image detection unit z3 synthesis
Collection；Handheld terminal z7 according to the display pattern and operating mode of setting, distinguishes the image collected by cable z6 or antenna
It is transmitted to the command terminal of MR display systems z5 and the helmet.MR display systems z5 will show as needed thermal imagery, visible images,
Figure information and prompt command information.
With continued reference to Fig. 2, in the present embodiment, the MR display systems z5 is by right and left eyes MR spectacle lens z511, z512, eye
Mirror driving circuit z521, z522, LVDS conversion chips z531, z532 and pilot controller z54 are constituted.
Wherein pilot controller z54 is connected by iic bus with glasses driving circuit z521, z522, and the bright of glasses is arranged
Whether degree contrast and shows image；The LVDS picture signals of hand-held transmission are converted by LVDS conversion chip z531, z532
Rgb signal simultaneously sends glasses driving circuit z521, z522 to, glasses driving circuit respectively drive right and left eyes MR spectacle lens z511,
Z512 realizes the display of image.
Specifically, LVDS conversion chips z531, z532 are high speed LVDS chips when specific implementation, the specific implementation moment adopts
With DS90UB926Q-Q1 deserializers chip to restore respectively to the vision signal of right and left eyes, wherein recovered per road LVDS
8 RGB datas, 3 video control signals and 4 synchronous IIS audio signals, and extracted from highspeed serial data stream
Clock signal realizes 1080p, 60 frames transmission rate per second.OVP0921 can be used in described glasses driving circuit z521, z522
And ISL97901, respectively right and left eyes MR spectacle lens z511, z512 provide vision signal and led backlight drives.
Such as Fig. 3, in the present embodiment, handheld terminal z7 by arm processor z71, serial ports configuration screen z74, LVDS conversion chip
Z75, z77, memory chip z76 and other interface circuits are constituted.
Wherein, arm processor z71 is connected by USB interface with image interface z74, and control image detection unit z3 is obtained
The image that thermal imagery and visible images obtain is connect after background separation, use processing by LCD_RGB, CMA_DCMI, UART
Mouth is controlled and is transmitted in the display storage that FPGA circuitry z72 is constituted.
Wherein：Arm processor z71 is connected by USB interface with image interface z73, and control image detection unit z3 is obtained
The image that thermal imagery and visible images obtain is connect after background separation, use processing by LCD_RGB, CMA_DCMI, UART
Mouth is controlled and is transmitted in the display storage that FPGA circuitry z72 is constituted.
Wherein：Three z75, LVDS conversion chip of FPGA circuitry z72, LVDS conversion chip, four z77, memory chip z76 are constituted
The display adapter of MR display systems z5.The picture signal of arm processor z71 transmission stores in 4G memory chips z76 first,
The image of storage is synthesized left-right frames by FPGA circuitry z72, and accelerates to frame frequency 60Hz.FPGA circuitry z72 is again by the image of synthesis
It is corrected, perspective transformations, it is color transformed to handle to meet the display needs of MR display systems z5.Last FPGA circuitry z72
The left-right frames image converted is converted into MR display systems z5's by three z75, LVDS conversion chip of LVDS conversion chips, four z77
Interface standard is transmitted to MR display systems z5 by cable z6.
Specifically, arm processor z71 is the high-new energy arm processor of 2 cores or more when specific implementation, the moment is embodied
Realize that Image Acquisition, the processing of perception cell signal, display information are folded using four core Cortex-A9Exynos4412 processors of Samsung
Add, communication control and instruction parsing, wherein 60 frames of Image Acquisition/s, perceive unit signal include environmental information, vital sign
And position and attitude, display information include map storage, calling and superposition, communication and the responsible pattern switching of instruction control and commander are controlled
System instruction parsing.The peripheral circuit stereo codecs that moment arm processor z71 is embodied use WM8960 chips, make
Stereo 24 sigma-deltas ADC and DAC are realized with low-power super-sampling digital interpolation and decimation filter；Hub controller is adopted
With the GL850A chips for the risc processor for having embedded 8 positions.
Specifically, FPGA circuitry z72 is the high-performance low-power-consumption that 300,000 I/O speed are more than 150MHz when specific implementation
Fpga chip.The moment is embodied using XC6SLX45T chips realization multivoltage, differential pair data transmission, rate 300Mb/
S, DDR3 data rate are 600Mb/s.LVDS conversion chips z75, z77 are high speed LVDS chips, and the specific implementation moment uses
DS90UB925Q-Q1 encoder chips with respectively to the vision signal of right and left eyes carry out parallel-serial conversion, by 8 RGB datas, 3
Video control signal and 4 synchronous IIS audio signals are converted into highspeed serial data stream.
It is the flow diagram of the intelligent MR rescue helmet display methods with thermal infrared imager in the present invention, MR such as Fig. 4
Display methods includes step S1- steps S6：
S1, image detection module obtain visible light, infrared image signal and heat by the button or instruction control of handheld terminal
Imaging；
Wherein, the visible images of the present embodiment use binocular camera, thermal imaging system highly sensitive using embedded micro
Thermal imaging system.Specifically, binocular camera use 5,000,000 pixels, focal length 9mm, thermal imaging system using LONG WAVE INFRARED (LWIR) heat at
As video camera.LONG WAVE INFRARED (LWIR) thermal imaging camera that the present embodiment uses has 640x512 pixels, can be with measuring temperature
And thermal image, obtain the fire location under smog, dark surrounds, vital sign, escape way information.
S2, perception unit form prompt message figure after obtaining environmental information, posture and vital sign information in handheld terminal
As signal；
When it is implemented, perception unit sends the information of acquisition to handheld terminal by cable, by position after handheld terminal parsing
It sets, posture, environmental information are compiled into the text information of no background and storage.
The real-time map synthetic map information signal that S3, handheld terminal are transmitted according to the map or command terminal of storage inside；
When it is implemented, handheld terminal reduces text information, and behind additional display location with the map of storage inside or
The image superposition of image sensing cells is stored into memory to be transmitted to MR displays.
S4, the switch mode that information is shown by hand-held setting MR, display pattern can be controlled by command terminal by instructing,
Display pattern is divided into infrared mode, it is seen that optical mode, prompt message mixed mode, cartographic information mixed mode and without display mould
Formula.In this step, the image to be displayed signal stored in memory is gone out to send by the arm processor chip of handheld terminal by interface
To the fpga chip of handheld terminal, it is divided into left and right two field pictures after processing and protocol conversion is carried out by LVDS chips, be transmitted to MR
Display system, the control instruction that the display pattern of display system is sent out by the ARM of handheld terminal determine.
In the step S4, as shown in figure 5, by following steps S41-S43, display image is obtained by FPGA processing：
Image to be shown is sent in fpga chip and is cached by LCD_RGB interfaces by S41, arm processor；
S42, FPGA circuitry will show that image is corrected, perspective transformations, and color transformed processing shows to meet MR
The display of system needs, and then synthesizes left-right frames image, and accelerate to frame frequency 60Hz.
The left-right frames image converted is converted into connecing for MR display systems by S43, FPGA circuitry by LVDS conversion chips 7
Mouth standard, MR display systems are transmitted to by cable.
S5, rescue personnel can pass through the control MR display systems such as gesture, button switching, Background control and speech recognition
Pattern converts.
In this step, the arm processor chip of handheld terminal is according to the Gesture Recognition Algorithm of visible images or hand-held
Either the speech recognition algorithm of handheld terminal or the wireless communication order control MR from command system show image to the button at end
Pattern.
S6, handheld terminal are according to instructing the picture signal of arbitrary patterns by sending command terminal to, not by aobvious
Show the limitation of pattern.Rescue personnel can select opening MR to show or close display according to live situation.
The above is only the better embodiment of the present invention, therefore all constructions according to described in present patent application range,
The equivalent change or modification that feature and principle are done, is included within the scope of present patent application.
Claims (13)
1. a kind of intelligent MR with thermal infrared imager rescues the helmet, it is characterised in that：It includes
Binocular camera, thermal infrared imager on helmet shell,
It is placed in the image detection unit inside helmet shell, perceives unit,
MR display systems,
Cable,
And handheld terminal；
The binocular camera, thermal infrared imager are connected by conducting wire with image detection unit；Described image probe unit passes through
Cable is connected with handheld terminal；The perception unit is connected by cable with handheld terminal；The MR display systems pass through cable and hand
End is held to be connected.
2. a kind of intelligent MR with thermal infrared imager according to claim 1 rescues the helmet, it is characterised in that：MR displays system
The MR display methods of system, using following steps：
S1, image detection module obtain visible light, infrared image signal and thermal imaging by the button or instruction control of handheld terminal；
Wherein, it is seen that light image uses binocular camera, thermal imaging system to use embedded micro high sensitivity thermal imaging system；Specifically, binocular
Camera uses 5,000,000 pixels, focal length 9mm, thermal imaging system to use LONG WAVE INFRARED thermal imaging camera.The length that the present embodiment uses
Wave thermal infrared imaging camera has 640x512 pixels, can be obtained under smog, dark surrounds with measuring temperature and thermal image
Fire location, vital sign, escape way information；
S2, perception unit form prompt message image letter after obtaining environmental information, posture and vital sign information in handheld terminal
Number；When it is implemented, perception unit sends the information of acquisition to handheld terminal by cable, by position, appearance after handheld terminal parsing
State, environmental information are compiled into the text information of no background and storage；
The real-time map synthetic map information signal that S3, handheld terminal are transmitted according to the map or command terminal of storage inside；Specifically
When implementation, handheld terminal reduces text information, and map or image sensing cells behind additional display location with storage inside
Image superposition, storage in memory to be transmitted to MR displays；
S4, the switch mode that information is shown by hand-held setting MR, display pattern can be controlled by command terminal by instructing, display
Pattern is divided into infrared mode, it is seen that optical mode, prompt message mixed mode, cartographic information mixed mode and without display pattern；
In the step, the image to be displayed signal stored in memory is gone out to give hand by the arm processor chip of handheld terminal by interface
The fpga chip at end is held, be divided into left and right two field pictures after processing and protocol conversion is carried out by LVDS chips, MR is transmitted to and shows
System, the control instruction that the display pattern of display system is sent out by the ARM of handheld terminal determine；
S5, rescue personnel can pass through the pattern of the control MR display systems such as gesture, button switching, Background control and speech recognition
Conversion；In this step, the arm processor chip of handheld terminal is according to the Gesture Recognition Algorithms of visible images or handheld terminal
Either the speech recognition algorithm of handheld terminal or the wireless communication order from command system control the mould that MR shows image to button
Formula；
S6, handheld terminal are according to instructing the picture signal of arbitrary patterns by sending command terminal to, not by display mould
The limitation of formula, rescue personnel can select opening MR to show or close display according to live situation.
3. a kind of intelligent MR with thermal infrared imager according to claim 2 rescues the helmet, it is characterised in that：In the step
In rapid S4, display image is obtained by FPGA processing by following steps, using following steps：
Image to be shown is sent in fpga chip and is cached by LCD_RGB interfaces by S41, arm processor；
S42, FPGA circuitry will show that image is corrected, perspective transformations, color transformed to handle to meet MR display systems
Display need, then synthesize left-right frames image, and accelerate to frame frequency 60Hz.
The left-right frames image converted is converted into the interface mark of MR display systems by S43, FPGA circuitry by LVDS conversion chips 7
Standard is transmitted to MR display systems by cable.
4. a kind of intelligent MR with thermal infrared imager according to claim 1 rescues the helmet, it is characterised in that：The MR is aobvious
Show system by left eye MR spectacle lens, right eye MR spectacle lens, glasses driving circuit one, glasses driving circuit two, LVDS conversion chips
One, LVDS conversion chips two, pilot controller composition；The pilot controller passes through iic bus and glasses driving circuit one, eye
Mirror driving circuit two is connected；The LVDS conversion chips one, LVDS conversion chips one by cable respectively with glasses driving circuit
One, glasses driving circuit two is connected.
5. a kind of intelligent MR with thermal infrared imager according to claim 1 rescues the helmet, it is characterised in that：It is described hand-held
End includes arm processor, FPGA circuitry, image interface, serial ports configuration screen, LVDS conversion chips three, LVDS conversion chips four, 4G
Memory chip and peripheral circuit；The peripheral circuit includes phonetic codec chip, hub controller；The arm processor
One end is electrically connected with FPGA circuitry, the arm processor other end respectively with phonetic codec chip, 2G memory chips, USB set line traffic control
Device electrical connection processed；The arm processor is electrically connected by USB interface with image interface；The arm processor passes through UART interface
It is electrically connected respectively with pilot controller, serial ports configuration screen；The FPGA circuitry other end respectively with LVDS conversion chips three, LVDS
Conversion chip four and the electrical connection of 4G memory chips.
6. a kind of intelligent MR with thermal infrared imager according to claim 1 rescues the helmet, it is characterised in that：The perception
Unit includes 9 axis gyroscopes, vital sign sensors and gas sensor.
7. a kind of intelligent MR with thermal infrared imager according to claim 4 rescues the helmet, it is characterised in that：The LVDS
Conversion chip one, LVDS conversion chips one are high speed LVDS chips, the deserializer chip of model DS90UB926Q-Q1.
8. a kind of intelligent MR with thermal infrared imager according to claim 4 rescues the helmet, it is characterised in that：The glasses
Driving circuit one is OVP0921 chips；The glasses driving circuit two is ISL97901 chips.
9. a kind of intelligent MR with thermal infrared imager according to claim 3 rescues the helmet, it is characterised in that：The ARM
Processor is the high-new energy arm processor of 2 cores or more, and model is four core Cortex-A9 Exynos4412 processors of Samsung.
10. a kind of intelligent MR with thermal infrared imager according to claim 5 rescues the helmet, it is characterised in that：It is described
FPGA circuitry is the high-performance low-power-consumption fpga chip that 300,000 I/O speed are more than 150MHz, and model is the core of XC6SLX45T
Piece.
11. a kind of intelligent MR with thermal infrared imager according to claim 5 rescues the helmet, it is characterised in that：It is described
LVDS conversion chips three, LVDS conversion chips four are high speed LVDS chips, and model is the encoder chip of DS90UB925Q-Q1.
12. a kind of intelligent MR with thermal infrared imager according to claim 5 rescues the helmet, it is characterised in that：Institute's predicate
Sound codec chip is WM8960 chips.
13. a kind of intelligent MR with thermal infrared imager according to claim 5 rescues the helmet, it is characterised in that：The USB
Line concentration controller is the GL850A chips for the risc processor for having embedded 8 positions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810214678.8A CN108563020A (en) | 2018-03-15 | 2018-03-15 | A kind of intelligent MR rescue helmets with thermal infrared imager |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810214678.8A CN108563020A (en) | 2018-03-15 | 2018-03-15 | A kind of intelligent MR rescue helmets with thermal infrared imager |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108563020A true CN108563020A (en) | 2018-09-21 |
Family
ID=63532757
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810214678.8A Pending CN108563020A (en) | 2018-03-15 | 2018-03-15 | A kind of intelligent MR rescue helmets with thermal infrared imager |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108563020A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672875A (en) * | 2018-11-30 | 2019-04-23 | 迅捷安消防及救援科技（深圳）有限公司 | Fire-fighting and rescue intelligent helmet, fire-fighting and rescue method and Related product |
| CN111147719A (en) * | 2019-12-26 | 2020-05-12 | 中国人民警察大学 | Wearable camera |
| CN114894253A (en) * | 2022-05-18 | 2022-08-12 | 威海众合机电科技有限公司 | Emergency visual sense intelligent enhancement method, system and equipment |
-
2018
- 2018-03-15 CN CN201810214678.8A patent/CN108563020A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109672875A (en) * | 2018-11-30 | 2019-04-23 | 迅捷安消防及救援科技（深圳）有限公司 | Fire-fighting and rescue intelligent helmet, fire-fighting and rescue method and Related product |
| CN111147719A (en) * | 2019-12-26 | 2020-05-12 | 中国人民警察大学 | Wearable camera |
| CN111147719B (en) * | 2019-12-26 | 2022-07-05 | 中国人民警察大学 | Wearable camera |
| CN114894253A (en) * | 2022-05-18 | 2022-08-12 | 威海众合机电科技有限公司 | Emergency visual sense intelligent enhancement method, system and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108957761B (en) | Display device and control method thereof, head-mounted display device and control method thereof | |
| US9245389B2 (en) | Information processing apparatus and recording medium | |
| JP6387825B2 (en) | Display system and information display method | |
| CN108563020A (en) | A kind of intelligent MR rescue helmets with thermal infrared imager | |
| US20090184889A1 (en) | Method and apparatus for displaying | |
| CN101840068A (en) | Head-worn optoelectronic automatic focusing visual aid | |
| CN207908808U (en) | A kind of intelligent MR rescue helmets with thermal infrared imager | |
| TW201119637A (en) | A head-mounted visual display device for low-vision aid and its system | |
| CN108388012A (en) | A kind of intelligent fire breathing mask glasses that Multi-information acquisition is shown | |
| CN106697231A (en) | Underwater virtual reality wearable system | |
| CN206387962U (en) | A kind of head-mounted display apparatus and portable set | |
| KR20150109205A (en) | Method for displaying visual media using projector and wearable electronic device implementing the same | |
| US20150168728A1 (en) | Head mounted display device | |
| CA2346039A1 (en) | Wireless electronic display | |
| WO2023231674A1 (en) | Driving method for liquid crystal grating, and display apparatus and display method for display apparatus | |
| CN208076833U (en) | New A R glasses and new A R glasses systems | |
| CN218045797U (en) | Smart cloud glasses and system worn by blind person | |
| CN114792448A (en) | Multifunctional attendance machine capable of automatically tracking human face | |
| CN212181167U (en) | Split type AR intelligence glasses of function enhancement mode | |
| CN111343449B (en) | Augmented reality-based display method and intelligent wearable device | |
| CN209899996U (en) | Blind guiding system based on video communication | |
| JP2000512772A (en) | Small display device and system | |
| CN213549990U (en) | Novel intelligent helmet multifunctional application system and device | |
| CN110989168A (en) | AR fire control goggles | |
| KR102549902B1 (en) | Underwater AR display device for marine safety education |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210113 Address after: Room 1111, 11 / F, block B, science and technology building, Changchun University of technology, 7089 Weixing Road, Changchun City, Jilin Province, 130022 Applicant after: Changchun United Mdt InfoTech Ltd. Address before: 430070 room 1109, Changjiang media building, 78 Luoyu Road, Hongshan District, Wuhan City, Hubei Province Applicant before: WUHAN ZHIKUI TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240712 Address after: A2-702, No. 32 Qingyan Road, Xinwu District, Wuxi City, Jiangsu Province, China 214131 Applicant after: Haolai Optoelectronics Technology (Wuxi) Co.,Ltd. Country or region after: China Address before: Room 1111, 11 / F, block B, science and technology building, Changchun University of technology, 7089 Weixing Road, Changchun City, Jilin Province, 130022 Applicant before: Changchun United Mdt InfoTech Ltd. Country or region before: China |