CN102591014B - Panoramic vision observing system and work method thereof - Google Patents
Panoramic vision observing system and work method thereof Download PDFInfo
- Publication number
- CN102591014B CN102591014B CN201110005660.5A CN201110005660A CN102591014B CN 102591014 B CN102591014 B CN 102591014B CN 201110005660 A CN201110005660 A CN 201110005660A CN 102591014 B CN102591014 B CN 102591014B
- Authority
- CN
- China
- Prior art keywords
- helmet
- sensor
- external
- wireless signal
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 16
- 230000033001 locomotion Effects 0.000 claims abstract description 24
- 230000000007 visual effect Effects 0.000 claims description 25
- 239000011521 glass Substances 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 5
- 230000002194 synthesizing effect Effects 0.000 claims description 4
- 238000011179 visual inspection Methods 0.000 claims 2
- 230000008447 perception Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000003384 imaging method Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000007789 sealing Methods 0.000 description 3
- 241000282412 Homo Species 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000003331 infrared imaging Methods 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000017525 heat dissipation Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000005272 metallurgy Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses an observing system, which comprises an external video transceiving system and an internal display transceiving system. The external video transceiving system comprises a visible light video sensor, an infrared video sensor, a sensor motion control mechanism and a sensor wireless signal transceiver. The internal display transceiving system is preferably a helmet which is provided with a wireless signal transceiver, a helmet rotation angle sensor, a microprocessor circuit and a display screen. The external video sensor sends an external picture signal to the wireless signal transceiver of the helmet through the wireless signal transceiver of the sensor. The wireless signal transceiver of the helmet transfers the external picture signal to the microprocessor circuit. The helmet rotation angle sensor arranged on the helmet monitors the rotation angles of the helmet in X, Y and Z axis in real time and transfers the rotation angle signal to the microprocessor circuit on the helmet. The microprocessor circuit synthesizes appropriate external picture or switches to appropriate external picture in real time according to the actual position (angle) of the helmet and displays the external picture on the display. Furthermore, the video sensor can be further controlled by the external video sensor motion control mechanism to rotate to needed positions in real time.
Description
Technical Field
The invention relates to a panoramic vision system, in particular to a real-time observation system which is used on mobile equipment with high maneuverability and insufficient external view and can display external scenes all around the clock and in an omnibearing way and a working method thereof.
Background
Human perception 70% of the information in the objective world is obtained visually, the eye is the most important sensory organ in humans, and image visual information is one of the main sources from which humans obtain information in the objective world. It is well known that vision is the most complex and effective means of sensing the surrounding environment. With the development of science and technology, the application range of computer vision is increasingly expanded, and the purpose is to use computer instead of human eyes and brain to sense, explain and understand the surrounding environment, for example, in military or safety vehicles, drivers usually need to observe the situations occurring around their vehicles and avoid exposing themselves to enemies as much as possible, and the computer vision is applied to the computer vision.
With the rapid development of imaging technology and image parallel processing technology, the panoramic vision system will have wide application prospects in military and civil fields such as detection and tracking of moving targets, detection and tracking of space targets, detection of external spaces, video monitoring and the like. In the field of outer space exploration, such as detection by landing mars and moon, the visual environment perception is one of the essential important technical means, and the requirement of comprehensively acquiring the visual information of the surrounding environment is not met by the traditional visual environment perception system. The traditional vision mainly depends on local information with limited visual field, has the defects of poor precision, small visual field range, short acting distance, poor real-time performance and the like, and lacks a means for acquiring global and large-scale information, so that when a visual sensor or an observed object suddenly moves, a target object can be moved out of the visual field range of the visual sensor.
Unlike the smaller visual range of conventional visual environment perception systems, panoramic imaging refers to spherical imaging with a field of view greater than a hemisphere (360 ° × 180 °). Its main function is to restore the perspective panoramic image to the unfolded image which is in accordance with the observation habit of human eyes, so as to monitor and observe conveniently. The panoramic imaging visual range is larger than a hemisphere, which is a special visual field advantage, so that the panoramic imaging visual range becomes a research hotspot in the field of visual environment perception, and has wide application prospects in the fields of military, civil use and the like. Generally, panoramic image processing uses a computer as a platform, and a complete computer image processing system generally includes a video input device, an image capture card, a computer system (including a processor, a motherboard, a memory, and a hard disk), and the like. The analog video signal generated by the camera is converted into digital image signal by the image acquisition card, and is stored in the memory of the computer, and the computer calls the real-time image processing program to process according to the instruction of the computer operator or the pre-programmed program. The processing result is stored on the hard disk of the computer in a file form or displayed on the monitor of the computer. However, such vision systems are relatively expensive, bulky, and energy-intensive, and are not suitable for use on mobile platforms or in high reliability applications.
Recently, there have been gimbaled cameras used to provide panoramic vision systems that are displayed on flat panel displays or head mounted displays. In such systems, the viewing direction can generally be adjusted by changing the viewing direction of the gimbal mounted camera. Typically, a pointing device such as a joystick or head tracker controls the viewing direction. But gimbal mounted cameras are disadvantageous because the inherent mechanical motion delay limits the speed at which the desired image can be changed. Furthermore, it is disadvantageous that it requires a large, bulky, highly complex and expensive special-purpose computer for image capture and processing.
Therefore, a multi-camera panoramic visualization system that does not require a dedicated computer and that smoothly blends the adjacent fields of view of the multiple cameras together and enables the driver to track moving objects within the panoramic viewing area would be beneficial.
In order to improve the electronic information identification capability and the overall level of informatization operation of some modern military facilities, the invention fully plays the positive roles of the modern electronic image technology in the aspects of information acquisition, transmission, feedback and recording, provides an observation system applied to mobile equipment to carry out the instant acquisition, transmission, feedback and recording of real-time scene image information and provides an intuitive basis for military decision and command coordination. The real-time observation system capable of displaying the outside scene in all directions and the working method thereof can be applied to moving equipment such as tanks, armored vehicles, airplanes, helicopters, submarines, space equipment and the like, and can stably and efficiently observe the surrounding environment and automatically track target objects. The observation system not only can reduce the number of installed cameras, effectively reduce energy consumption and weight, but also uses wireless transmission, so that key indexes such as wiring complexity, heat dissipation and the like are improved, and the observation system has greater advantages compared with the traditional method.
According to the invention, its viewing system comprises a plurality of vision sensors, each vision sensor producing image data from the field of view of its camera. In addition, the field of view of each camera overlaps an adjacent field of view. The microprocessor circuit co-edit processes image data from the overlapping fields of view to generate panoramic data.
The present invention also includes an internal display control system, preferably a helmet, on which is provided a wireless signal transceiver, a microprocessor circuit, a helmet angle sensor and a display screen. The microprocessor circuit realizes faster data updating speed and intelligent display of data information, and preferably, the helmet is also provided with a display screen rotating shaft.
The system can provide 360-degree visual situation perception capability for cooperation among drivers or members of the mobile equipment and effective attack threat target implementation, and the drivers can comprehensively know the fighting condition while driving. Another particular capability of the system is to provide a 360 ° view around the clock in all weather conditions, allowing the driver to continue fighting in extreme environments.
Preferably, an infrared video sensor is used in the present invention, which receives an infrared radiation energy distribution pattern of an object to be measured by using an infrared detector and an optical imaging objective lens, thereby forming an infrared thermographic image, which corresponds to a thermal distribution field of the surface of the object. Traditionally, thermal infrared imagers have been used to convert the invisible infrared energy emitted by an object into visible thermal images, the different colors of which represent the different temperatures of the object being measured. Since the infrared imaging technology can perform non-contact high-resolution temperature imaging, can generate high-quality images, can provide a lot of information of a measurement target, and makes up for the limitation of human eyes in the environment of insufficient light or dark night, the infrared imaging technology is widely applied to various industries such as electric power systems, civil engineering, automobiles, metallurgy, petrochemical industry, medical industry and the like, and the future development prospect is more unlimited.
Panoramic vision has become a common requirement for modern combat vehicles. On modern military supplies and equipment shows, a range of systems have gained opportunities for display. Most of the existing systems are based on comprehensive video images, and provide a chariot with the capability of browsing the surrounding environment in a panoramic way. The panoramic vision system is considered as an important component of the periphery protection and situation perception, and the operational capacity of the gun detection system and the remote control weapon station on the military weapon and other equipment is further improved.
Disclosure of Invention
As described above, the present invention provides a novel panoramic viewing system (visual electronic device) capable of displaying an external panoramic image in real time under visible light, at night and in conditions of poor visibility, and appearing in a "head-on" form.
The main technical scheme adopted by the invention for solving the related technical problems is as follows: a real-time observation system capable of displaying outside scenes in all directions is arranged or installed at relevant positions of equipment with a cockpit, such as a tank, an armored car, an airplane, a helicopter, a submarine, space equipment, a train and the like, and comprises: an external video transceiving system and an internal display control system. Wherein, external video send-receive system includes: the device comprises a visible light video sensor, an infrared video sensor, a sensor motion control mechanism and a sensor wireless signal transceiver; the internal display control system is preferably a helmet, a wireless signal transceiver, a helmet rotation angle sensor, a microprocessor circuit and a display screen are arranged on the helmet, and the display screen can also appear in the form of glasses; the visible light video sensor is used for shooting and recording external scenes in real time in the daytime or in an environment with sufficient light; the infrared video sensor is used for shooting and recording external scenes at night and in dark light in real time; the sensor motion control mechanism is used for controlling the sensor to rotate in the horizontal direction and the vertical direction; the sensor wireless signal transceiver is used for wirelessly transmitting an external image signal to the helmet and receiving a signal which is sent by an internal control system and used for controlling the rotation of the visible light video and infrared video sensor; the wireless signal transceiver arranged in the helmet is used for sending signals for controlling the movement of the visible light video sensor and the infrared video sensor to the sensor wireless signal transceiver in the external video transceiving system and receiving external image signals sent by the sensor wireless signal transceiver; the helmet rotation angle sensor is used for monitoring the rotation angles of the helmet in X, Y, Z three directions in real time; the microprocessor circuit is used for receiving signals of the helmet rotation angle sensor, synthesizing external scenes in real time according to the actual position of the helmet and displaying the external scenes on the display screen. Meanwhile, the circuit is also used for controlling the external visible light video sensor and the infrared video sensor to rotate in real time according to the position of the helmet; the display screen is used for displaying external images in real time. The helmet is also provided with a display rotating shaft. The external video transceiving system is installed outside the equipment, and the internal display control system is installed on a helmet inside the equipment.
A method for operating a panoramic vision viewing system, wherein an external video transceiver system of the system is installed at an externally associated location, and a driver wears an internal display control system of the system, preferably a helmet, while performing associated operations inside the device, the method comprising:
(a) the external video sensor sends the external scene signal to the internal wireless signal transceiver through the sensor wireless signal transceiver.
(b) The internal wireless signal transceiver transmits the outside scene signal to the microprocessor circuit.
(c) The microprocessor circuit performs mixed editing on the overlapped visual fields adjacent to the video sensor to generate a panoramic image and displays the panoramic image on a display screen.
(d) The helmet rotation angle sensor arranged on the helmet monitors the rotation angles of the helmet in X, Y, Z three axial directions in real time and transmits rotation angle signals to the microprocessor circuit.
(e) The microprocessor circuit sends the vision field position signal to the sensor control mechanism through the wireless signal receiving and sending system according to the actual position of the helmet.
(f) The sensor control mechanism controls the external video sensor to rotate in the horizontal direction and the vertical direction according to the helmet position signal.
Drawings
FIG. 1 shows an external vision sensor mounted in a relative position outside an apparatus;
FIG. 2 is a view of the external vision sensor mounted on an external mounting bracket;
FIG. 3 is a system block diagram of the panoramic vision viewing system;
fig. 4 is a schematic diagram of the position of the display and the rotation axis on a helmet.
Wherein the number of external visual sensors indicated on the drawings is for example only and not limited to the drawings.
For a better understanding of the present invention, reference will now be made to the following descriptions taken in conjunction with the accompanying drawings:
Detailed Description
Embodiment 1:
as shown in fig. 3, a panoramic visual observation system includes: an external video transceiving system and an internal display control system. Wherein, external video send-receive system includes: the device comprises a visible light video sensor 3-1, an infrared video sensor 3-2, a sensor motion control mechanism 3-3 and a sensor wireless signal transceiver 3-4; the internal display control system is preferably a helmet, and the helmet is provided with a wireless signal transceiver 3-5, a helmet rotation angle sensor 3-6, a microprocessor circuit 3-7 and a display screen 3-8; wherein,
the visible light video sensor 3-1 is used for recording external scenes in real time during the daytime or when the light is sufficient;
the infrared video sensor 3-2 is used for shooting and recording external scenes at night and in dark light in real time;
the sensor motion control mechanism 3-3 is used for controlling the rotation of the sensor in the horizontal direction and the vertical direction;
the sensor wireless signal transceiver 3-4 is used for wirelessly transmitting an external image signal to the helmet and receiving a signal which is sent by the helmet and used for controlling the movement of the visible light video sensor and the infrared video sensor;
the helmet wireless signal transceiver 3-5 is used for sending a signal for controlling the movement of the visible light video sensor 3-1 and the infrared video sensor 3-2 to the external video sensor wireless signal transceiver 3-4 and receiving an external image signal sent by the external video sensor wireless signal transceiver 3-4;
the helmet rotation angle sensor 3-6 is used for monitoring the rotation angles of the helmet in X, Y, Z three directions in real time;
the microprocessor circuit 3-7 is used for receiving signals sent by the helmet rotation angle sensor 3-6, synthesizing an outside scene in real time according to the actual position of the helmet and displaying the outside scene on the display screen 3-8, and meanwhile, the circuit also controls the external visible light video sensor 3-1 and the infrared video sensor 3-2 to rotate in real time according to the actual position of the helmet through the sensor motion control mechanism 3-3;
the display screens 3-8 are used for displaying external images in real time and can also be made into glasses for a driver to wear.
Fig. 1 shows an embodiment 1 of the present invention, in which visual sensors 1-3 to 1-7 and 1-11 are provided outside an enclosure 1-2 having a very limited field of view such as a window 1-1. The number and location of the video sensors are merely exemplary and not limiting. Wherein, the external vision sensor comprises a visible light video sensor 3-1, an infrared video sensor 3-2, a visible light video sensor and infrared video sensor motion control mechanism 3-3 and an external vision sensor wireless signal transceiver 3-4 as shown in fig. 3;
a helmet 1-10 is arranged in the sealing device 1-2, and a display screen 1-9 is arranged on the helmet 1-10. As shown in fig. 3, the helmet is provided with a helmet wireless signal transceiver 3-5, a helmet rotation angle sensor 3-6, a microprocessor circuit 3-7 and a display screen 3-8. Wherein, the display screens 3-8 can also be made into a glasses form.
As shown in fig. 4, preferably, the helmet 4-2 is further provided with a display rotation shaft 4-3, and when a driver needs to operate the inside of the enclosure or does not need to observe the outside scene, the display 4-1 can be pushed up by means of the display rotation shaft 4-3, so that the driver can operate the helmet conveniently.
A method of operating a panoramic vision viewing system, see fig. 1 and 3. Wherein, the external video transceiving system of the system is fixed at the relevant position outside the closed equipment 1-2. The driver 1-8 is inside the equipment and the internal display control system wearing the system is preferably a helmet 1-10. The working method comprises the following steps:
(a) the external video sensors 1-3 to 1-7, 1-11 transmit external scene signals to the internal wireless signal transceiver 3-5 through the sensor wireless signal transceiver 3-4.
(b) The internal wireless signal transceiver 3-5 passes the outside scene signal to the microprocessor circuit 3-7.
(c) The microprocessor circuit 3-7 performs a blending editing of the overlapping fields of view of the adjacent video sensors to generate a panoramic image and displays it on the display screen 3-8.
(d) The helmet rotation angle sensor 3-6 arranged on the helmet monitors the rotation angle of the helmet in X, Y, Z three axial directions in real time and transmits a rotation angle signal to the microprocessor circuit 3-7.
(e) The microprocessor circuit 3-7 sends the vision field position signal to the sensor control mechanism 3-3 through the wireless signal receiving and sending system 3-5 according to the actual position (angle) of the helmet.
(f) The sensor control mechanism 3-3 controls the external video sensors 1-3-1-7, 1-11 to rotate in the horizontal direction and the vertical direction according to the helmet position signal.
Embodiment 2:
as shown in fig. 3, a real-time viewing system for displaying an external scene in all directions. The method comprises the following steps: external video send-receive system and inside display control system, wherein, external video send-receive system includes: the device comprises a visible light video sensor 3-1, an infrared video sensor 3-2, a sensor motion control mechanism 3-3 and a sensor wireless signal transceiver 3-4; the internal display control system is preferably a helmet, on which a wireless signal transceiver 3-5, a helmet rotation angle sensor 3-6, a microprocessor circuit 3-7 and a display screen 3-8 are provided. Wherein,
the visible light video sensor 3-1 is used for recording external scenes in real time during the daytime or when the light is sufficient;
the infrared video sensor 3-2 is used for shooting and recording external scenes at night and in dark light in real time;
the sensor motion control mechanism 3-3 is used for controlling the sensor to rotate in the horizontal direction and the vertical direction;
the sensor wireless signal transceiver 3-4 is used for wirelessly transmitting an external image signal to the helmet and receiving a signal which is sent by the helmet and used for controlling the movement of the visible light video sensor and the infrared video sensor;
the helmet wireless signal transceiver 3-5 is used for sending a signal for controlling the visible light video sensor 3-1 and the infrared video sensor 3-2 to rotate to the external video sensor wireless signal transceiver 3-4 and receiving an external image signal sent by the external video sensor wireless signal transceiver 3-4;
the helmet rotation angle sensor 3-6 is used for monitoring the rotation angles of the helmet in X, Y, Z three directions in real time;
the microprocessor circuit 3-7 is used for receiving signals of the helmet rotation angle sensor 3-6, synthesizing external scenes in real time according to the actual position of the helmet and displaying the external scenes on the display screen 3-8, and simultaneously the circuit also controls the external visible light video sensor 3-1 and the infrared video sensor 3-2 to rotate in real time according to the actual position of the helmet through the sensor motion control mechanism 3-3;
the display screens 3-8 are used for displaying external images in real time and can also be made into glasses for a driver to wear.
Fig. 2 shows an embodiment 2 of the present invention, in which a visual sensor 2-7 is provided outside a closed equipment 2-1 having a very limited field of view such as a window 2-12 and fixed to an external holder 2-8. The external supports 2-8 are arranged in relative positions outside the closing device 2-1, the number and positions of the video sensors and external supports being given by way of example only and not being limited thereto. Wherein, the external vision sensor comprises a visible light video sensor 3-1, an infrared video sensor 3-2, a sensor motion control mechanism 3-3 and a sensor wireless signal transceiver 3-4 as shown in fig. 3.
A helmet 2-11 is arranged in the sealing device 2-1, and a display screen 2-10 is arranged on the helmet 2-11. As shown in fig. 3, the helmet is provided with a helmet wireless signal transceiver 3-5, a helmet rotation angle sensor 3-6, a microprocessor circuit 3-7 and a display screen 3-8.
As shown in fig. 4, preferably, the helmet 4-2 is further provided with a display screen rotating shaft 4-3, and when a driver needs to operate the inside of the sealing device or does not need to observe the outside scene, the display screen 4-1 can be pushed upwards by means of the display screen rotating shaft 4-3, so that the driver can conveniently operate the helmet.
A method of operating a panoramic vision viewing system, see fig. 2 and 3. Wherein the external video transceiving system of the system is mounted on an external bracket 2-8, and the external bracket 2-8 is arranged at a relevant position outside the closed equipment 2-1. The driver 2-9 is inside the equipment and the internal display control system wearing the system is preferably a helmet 2-11. The working method comprises the following steps:
(a) the external video sensor 2-7 transmits the external scene signal to the internal wireless signal transceiver 3-5 through the sensor wireless signal transceiver 3-4.
(b) The internal wireless signal transceiver 3-5 passes the outside scene signal to the microprocessor circuit 3-7.
(c) The microprocessor circuit 3-7 performs a blending editing of the overlapping fields of view of the adjacent video sensors to generate a panoramic image and displays it on the display screen 3-8.
(d) The helmet rotation angle sensor 3-6 arranged on the helmet monitors the rotation angle of the helmet in X, Y, Z three axial directions in real time and transmits a rotation angle signal to the microprocessor circuit 3-7.
(e) The microprocessor circuit 3-7 sends the vision field position signal to the sensor control mechanism 3-3 through the wireless signal receiving and sending system 3-5 according to the actual position of the helmet.
(f) The sensor control mechanism 3-3 controls the external video sensor 2-7 to rotate in the horizontal direction and the vertical direction according to the helmet position signal.
Claims (4)
1. A panoramic visual observation system comprising:
an external video transceiving system and an internal display control system; wherein,
the external video transceiving system includes: the device comprises a visible light video sensor, an infrared video sensor, a sensor motion control mechanism and a sensor wireless signal transceiver;
the internal display control system is preferably a helmet, and a wireless signal transceiver, a helmet rotation angle sensor, a microprocessor circuit and a display screen are arranged on the helmet;
wherein,
the visible light video sensor is used for shooting and recording outside scenes in real time during the daytime or when the light is sufficient;
the infrared video sensor is used for shooting and recording external scenes at night and in dark light in real time;
the sensor motion control mechanism is used for controlling the rotation of the sensor in the horizontal direction and the vertical direction;
the sensor wireless signal transceiver is used for wirelessly transmitting an external image signal to the helmet and receiving a signal which is sent by the helmet and used for controlling the movement of the visible light video sensor and the infrared video sensor;
the wireless signal transceiver arranged in the helmet is used for sending signals for controlling the movement of the visible light video sensor and the infrared video sensor to the sensor wireless signal transceiver in the external video transceiver system and receiving external image signals sent by the sensor wireless signal transceiver in the external video transceiver system;
the helmet rotation angle sensor is used for monitoring the rotation angles of the helmet in X, Y, Z three directions in real time;
the microprocessor circuit is used for receiving signals sent by the helmet rotation angle sensor, synthesizing external scenes in real time according to the actual position of the helmet and displaying the external scenes on the display screen, and meanwhile, the circuit also controls the external visible light video sensor and the infrared video sensor to move in real time according to the actual position of the helmet through the sensor movement control mechanism;
the display screen is used for displaying external images in real time and can also be made into glasses for a driver to wear.
2. The panoramic visual inspection system of claim 1, wherein: and the number of sensors in the external video transceiving system is more than or equal to 1.
3. The panoramic visual inspection system of claim 1, wherein: the helmet is also provided with a display screen rotating shaft for adjusting the position of the display screen, and the adjusting direction is vertical.
4. A method of operation for the panoramic vision system of claim 1, characterized by: the external video transceiving system of the panoramic vision observation system is installed at a relevant position outside the equipment, a driver wears the internal display control system of the panoramic vision observation system inside the equipment, the internal display control system is preferably a helmet, and the working method of the panoramic vision observation system is as follows:
(a) the external video receiving and transmitting system sends an external scene signal to the wireless signal transceiver arranged in the helmet through the sensor wireless signal transceiver;
(b) the wireless signal transceiver arranged in the helmet transmits the outside scene signal to the microprocessor circuit;
(c) the microprocessor circuit performs mixed editing on the overlapped visual fields adjacent to the visible light video sensor and the infrared video sensor to generate a panoramic image and displays the panoramic image on a display screen;
(d) a helmet rotation angle sensor arranged on the helmet monitors the rotation angles of the helmet in X, Y, Z three axial directions in real time and transmits rotation angle signals to a microprocessor circuit;
(e) the microprocessor circuit sends the vision field position signal to the sensor motion control mechanism through a wireless signal transceiver in the helmet according to the actual position of the helmet;
(f) the sensor motion control mechanism controls the visible light video sensor and the infrared video sensor to rotate in the horizontal direction and the vertical direction according to the helmet position signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110005660.5A CN102591014B (en) | 2011-01-07 | 2011-01-07 | Panoramic vision observing system and work method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110005660.5A CN102591014B (en) | 2011-01-07 | 2011-01-07 | Panoramic vision observing system and work method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102591014A CN102591014A (en) | 2012-07-18 |
| CN102591014B true CN102591014B (en) | 2015-04-08 |
Family
ID=46479903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110005660.5A Active CN102591014B (en) | 2011-01-07 | 2011-01-07 | Panoramic vision observing system and work method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102591014B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104280124A (en) * | 2013-07-09 | 2015-01-14 | 杭州美盛红外光电技术有限公司 | Helmet device |
| WO2016004554A1 (en) * | 2014-06-16 | 2016-01-14 | 华为技术有限公司 | Method and apparatus for presenting panoramic photo in mobile terminal, and mobile terminal |
| CN105405093B (en) | 2015-11-12 | 2019-03-15 | 中国商用飞机有限责任公司 | Aircraft cockpit visual field enhancement system and method |
| CN106937143A (en) * | 2015-12-31 | 2017-07-07 | 幸福在线（北京）网络技术有限公司 | The control method for playing back and device and equipment of a kind of virtual reality video |
| DE102019105855A1 (en) * | 2019-03-07 | 2020-09-10 | Deutsche Post Ag | Vehicle with display device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043617A (en) * | 2007-03-21 | 2007-09-26 | 汤一平 | Omnidirectional visual sensor based helmet |
| CN101231752A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | True three-dimensional panoramic display and interactive apparatus without calibration |
| CN201369788Y (en) * | 2009-02-23 | 2009-12-23 | 杭州开锐电子电气有限公司 | Multi-eye panorama infrared lock-tracing image-shooting system |
| CN101881580A (en) * | 2010-06-29 | 2010-11-10 | 浙江工业大学 | Quick automatic artillery aiming device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3627914B2 (en) * | 2000-05-23 | 2005-03-09 | シャープ株式会社 | Vehicle perimeter monitoring system |
| JP3841621B2 (en) * | 2000-07-13 | 2006-11-01 | シャープ株式会社 | Omnidirectional visual sensor |
-
2011
- 2011-01-07 CN CN201110005660.5A patent/CN102591014B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101043617A (en) * | 2007-03-21 | 2007-09-26 | 汤一平 | Omnidirectional visual sensor based helmet |
| CN101231752A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | True three-dimensional panoramic display and interactive apparatus without calibration |
| CN201369788Y (en) * | 2009-02-23 | 2009-12-23 | 杭州开锐电子电气有限公司 | Multi-eye panorama infrared lock-tracing image-shooting system |
| CN101881580A (en) * | 2010-06-29 | 2010-11-10 | 浙江工业大学 | Quick automatic artillery aiming device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102591014A (en) | 2012-07-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20190147619A1 (en) | Method and system for image georegistration | |
| US7180476B1 (en) | Exterior aircraft vision system using a helmet-mounted display | |
| US10084960B2 (en) | Panoramic view imaging system with drone integration | |
| CN102591014B (en) | Panoramic vision observing system and work method thereof | |
| KR101662032B1 (en) | UAV Aerial Display System for Synchronized with Operators Gaze Direction | |
| US20090195652A1 (en) | Interactive Virtual Window Vision System For Mobile Platforms | |
| JP2006503375A (en) | Method and system for enabling panoramic imaging using multiple cameras | |
| JP6132767B2 (en) | Optronic system with super hemispherical view | |
| WO2007055943A2 (en) | Multi-user stereoscopic 3-d panoramic vision system and method | |
| US20120090010A1 (en) | System and method for 360 degree situational awareness in a mobile environment | |
| NO20121477A1 (en) | System and method for monitoring at least one observation area | |
| KR102125299B1 (en) | System and method for battlefield situation recognition for combat vehicle | |
| US20190126826A1 (en) | Optronic viewing device for a land vehicle | |
| US10397474B2 (en) | System and method for remote monitoring at least one observation area | |
| CN104743128A (en) | General aircraft crew integrated warning system | |
| KR101076240B1 (en) | Device and method for an air defense situation awareness using augmented reality | |
| WO2017086771A1 (en) | A visual surveillance system with target tracking or positioning capability | |
| EP3906662B1 (en) | System and method for providing increased sensor field of view | |
| US20210035365A1 (en) | Apparatus and method for displaying an operational area | |
| EP3454015A1 (en) | Apparatus and method for displaying an operational area | |
| Lueken et al. | Virtual cockpit instrumentation using helmet mounted display technology | |
| RU2757061C1 (en) | Information overview and panoramic surveillance system | |
| Colombi et al. | Airborne navigation with onboard infraRed sensors | |
| Rose et al. | Real-time 360 imaging system for situational awareness | |
| Muellner | Multispectral target simulation dome for hardware-in-the-loop simulation of fire control and optronic seeker systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| ASS | Succession or assignment of patent right |
Owner name: BEIJING AEROSPACE WANFANG TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: LIU LIDONG Effective date: 20130621 |
|
| C10 | Entry into substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 100085 HAIDIAN, BEIJING TO: 100070 FENGTAI, BEIJING |
|
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20130621 Address after: 100070 Beijing city Fengtai District Haiying Road No. 1 Building No. 2 hospital 3 (Park) Applicant after: BEIJING AEROSPACE WANFANG TECHNOLOGY Co.,Ltd. Address before: 100085, Beijing, Haidian District, East Road, No. 5,, Mongolia hi tech 807 Applicant before: Liu Lidong |
|
| DD01 | Delivery of document by public notice |
Addressee: Liu Shouhua Document name: Notification of Passing Examination on Formalities |
|
| DD01 | Delivery of document by public notice |
Addressee: Han Dongmei Document name: Notification of Passing Examination on Formalities |
|
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: 100070 Beijing city Fengtai District Haiying Road No. 1 Building No. 2 hospital 3 layer (Park) Beijing Aerospace Wanfang Technology Co Ltd Applicant after: BEIJING AEROSPACE WANFANG TECHNOLOGY Co.,Ltd. Address before: 100070 Beijing city Fengtai District Haiying Road No. 1 Building No. 2 hospital 3 (Park) Applicant before: BEIJING AEROSPACE WANFANG TECHNOLOGY Co.,Ltd. |
|
| DD01 | Delivery of document by public notice |
Addressee: BEIJING AEROSPACE WANFANG TECHNOLOGY Co.,Ltd. Document name: Notification of Passing Examination on Formalities |
|
| DD01 | Delivery of document by public notice |
Addressee: Zhang Lanxiang Document name: Notification of Passing Examination on Formalities |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181017 Address after: 100074 West Li 1, Yungang North District, Fengtai District, Beijing Patentee after: BEIJING AUTOMATION CONTROL EQUIPMENT INSTITUTE Address before: 100070 Beijing Fengtai District Haiying Road 1 house 2 Building 3 floor (Park) Beijing space Wanfang Technology Co., Ltd. Patentee before: BEIJING AEROSPACE WANFANG TECHNOLOGY Co.,Ltd. |