CN111010548A - Feedback type multi-video stream information fusion system and working method thereof - Google Patents
Feedback type multi-video stream information fusion system and working method thereof Download PDFInfo
- Publication number
- CN111010548A CN111010548A CN201911345001.9A CN201911345001A CN111010548A CN 111010548 A CN111010548 A CN 111010548A CN 201911345001 A CN201911345001 A CN 201911345001A CN 111010548 A CN111010548 A CN 111010548A
- Authority
- CN
- China
- Prior art keywords
- target pedestrian
- processor module
- video stream
- stream information
- information fusion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention relates to the field of image processing, in particular to a feedback type multi-video stream information fusion system and a working method thereof, wherein the feedback type multi-video stream information fusion system comprises: the system comprises an upper computer, a processor module, a plurality of infrared sensors and a plurality of cameras, wherein the infrared sensors and the cameras are electrically connected with the processor module; the bottoms of the cameras are provided with rotary tables, and the rotary tables are provided with the infrared sensors; the processor module is suitable for controlling the camera to adjust the focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian; the upper computer is suitable for obtaining a complete image of a target pedestrian according to the multi-angle image of the target pedestrian and sending a turntable control signal to the processor module to control the turntable to rotate along with the target pedestrian after the target pedestrian is locked. The invention realizes the complete collection of the image.
Description
Technical Field
The invention relates to the field of image processing, in particular to a feedback type multi-video stream information fusion system and a working method thereof.
Background
At present, image processing is applied in many aspects, an acquisition device is applied to an image acquisition field to acquire images, and image acquisition faces a huge problem of image acquisition integrity, which is limited by the visual angle of the acquisition device and the size of an acquired picture and cannot acquire complete required images.
Based on the above technical problem, a new feedback type multi-video stream information fusion system needs to be designed.
Disclosure of Invention
The invention aims to provide a feedback type multi-video stream information fusion system and a working method thereof, so as to solve the technical problem of completely acquiring images.
In order to solve the above technical problem, the present invention provides a feedback type multi-video stream information fusion system, including:
the system comprises an upper computer, a processor module, a plurality of infrared sensors and a plurality of cameras, wherein the infrared sensors and the cameras are electrically connected with the processor module;
the bottoms of the cameras are provided with rotary tables, and the rotary tables are provided with the infrared sensors;
the processor module is suitable for controlling the camera to adjust the focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian;
the upper computer is suitable for obtaining a complete image of a target pedestrian according to the multi-angle image of the target pedestrian and sending a turntable control signal to the processor module to control the turntable to rotate along with the target pedestrian after the target pedestrian is locked.
Further, the feedback type multi-video stream information fusion system further includes: the illumination sensor and the lighting device are electrically connected with the processor module;
the lighting device and the illumination sensor are both arranged on the turntable;
the processor module is suitable for controlling the illumination device to work according to the illumination intensity of the shooting area detected by the illumination sensor so as to supplement light for shooting of the camera.
Further, the feedback type multi-video stream information fusion system further includes: the communication module is electrically connected with the processor module;
the communication module is suitable for sending the target pedestrian image to the upper computer and receiving the turntable control signal sent by the upper computer.
Further, the feedback type multi-video stream information fusion system further includes: the reset circuit is electrically connected with the processor module;
the reset circuit is adapted to cause the processor module to perform a reset operation.
Furthermore, the processor module is electrically connected with the clock chip and the clock generator and used for recording the time data of the shot images.
Further, the feedback type multi-video stream information fusion system further includes: electrically connected to the processor moduleUSBA chip;
the processor module is adapted to pass throughUSBChip connection externalUSBAn apparatus.
Further, the feedback type multi-video stream information fusion system further includes: the storage module is electrically connected with the processor module;
the storage module is suitable for storing image data of the target pedestrian shot by the camera.
In another aspect, the present invention further provides a feedback-type multi-video stream information fusion method, including:
multiple infrared sensors and cameras track the pedestrian for shooting, i.e.
Controlling a camera to adjust a focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian;
and acquiring a complete image of the target pedestrian according to the multi-angle image of the target pedestrian, and sending a turntable control signal to the processor module to control the turntable of the corresponding camera to rotate along with the target pedestrian after the target pedestrian is locked.
Further, acquiring a complete image of the target pedestrian according to the multi-angle image of the target pedestrian, namely
The method comprises the steps of screening out images appearing in a target pedestrian, extracting a track of the target pedestrian, and splicing the images according to the track of the target pedestrian so as to obtain a complete image of the target pedestrian.
The infrared sensor and the camera have the advantages that the infrared sensor and the camera are electrically connected with the processor module through the upper computer, the processor module and the processor module; the bottoms of the cameras are provided with rotary tables, and the rotary tables are provided with the infrared sensors; the processor module is suitable for controlling the camera to adjust the focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian; the upper computer is suitable for obtaining a complete image of a target pedestrian according to the multi-angle image of the target pedestrian, and sends a rotary table control signal to the processor module to control the rotary table to rotate along with the rotary table after the target pedestrian is locked, so that the complete image acquisition is realized.
Drawings
The invention is further illustrated with reference to the following figures and examples.
Fig. 1 is a schematic block diagram of a feedback-type multi-video stream information fusion system according to the present invention;
fig. 2 is a schematic structural diagram of a feedback-type multi-video stream information fusion system according to the present invention;
fig. 3 is a schematic diagram of a complete image of a target pedestrian according to the present invention.
In the figure: the camera 1, the infrared sensor 2, the illumination sensor 3, the lighting device 4 and the turntable 5.
Detailed Description
The present invention will now be described in further detail with reference to the accompanying drawings. These drawings are simplified schematic views illustrating only the basic structure of the present invention in a schematic manner, and thus show only the constitution related to the present invention.
Example 1
Fig. 1 is a schematic block diagram of a feedback-type multi-video stream information fusion system according to the present invention.
Fig. 2 is a schematic structural diagram of a feedback-type multi-video stream information fusion system according to the present invention.
As shown in fig. 1 and fig. 2, the present embodiment provides a feedback-type multi-video stream information fusion system including: the system comprises an upper computer (not shown in figure 2), a processor module (not shown in figure 2), a plurality of infrared sensors 2 and a plurality of cameras 1, wherein the infrared sensors 2 and the cameras are electrically connected with the processor module; the upper computer can be but is not limited to a computer, a mobile phone and the like; the processor module may, but is not limited to, employSTMA 32 series microcontroller; the camera 1 can be but is not limited to adoptOV7670 a camera; the infrared sensor 2 can be but is not limited to useT003SA pyroelectric infrared sensor; the bottom of each camera 1 is provided with a turntable 5, and each turntable 5 is provided with the infrared sensor 2; the processor module is suitable for controlling the camera 1 to adjust the focal length according to the distance between the target pedestrian in the shooting area and the camera 1, which is detected by the infrared sensor 2, so as to shoot the image of the target pedestrian; the upper computer is suitable for acquiring a complete image of a target pedestrian according to the multi-angle image of the target pedestrian and sending a control signal of the rotary table 5 to the processing unit after the target pedestrian is lockedThe device module is used for controlling the rotary table 5 to rotate along with the rotary table; target pedestrians in the shooting area can be captured more effectively through the infrared sensor 2, and adverse effects on shooting caused by other moving and static conditions (changes of fixed environments generated by environment changes, such as wind blowing and grass movement and the like) in the shooting area are eliminated effectively; the camera 1 rotates along with the target pedestrian to better obtain continuous complete images of the target pedestrian, and the target pedestrian is prevented from losing the shooting target (target pedestrian) after walking out of the shooting area; the multi-angle target pedestrian images shot by different cameras 1 are constructed into a complete target pedestrian image through the upper computer, and complete acquisition of the images is realized.
In this embodiment, the feedback-type multi-video stream information fusion system further includes: the illumination sensor 3 and the lighting device 4 are electrically connected with the processor module; the lighting device 4 and the illumination sensor 3 are both arranged on the rotary table 5; the illumination sensor 3 may, but is not limited to, employTEMT6000 ambient light sensors; the lighting device 4 may be, but is not limited to, employedLEDA lamp; the processor module is suitable for controlling the illumination device to work according to the illumination intensity of the shooting area detected by the illumination sensor 3 so as to supplement light for shooting the camera 1; under natural environment, illumination can produce the influence to target pedestrian's image shooting, is difficult to obtain clear multi-angle target pedestrian's image when illumination is not enough, and processor module can start lighting device 4 this moment and make ambient illumination satisfy clear image condition of shooing multi-angle target pedestrian.
In this embodiment, the feedback-type multi-video stream information fusion system further includes: a communication module (not shown in fig. 2) electrically connected to the processor module; the communication module can be but is not limited to adoptZigBeeA module; the communication module is suitable for sending the target pedestrian image to an upper computer and receiving a control signal of the rotary table 5 sent by the upper computer; the camera and the upper computer can be arranged in different fields through the communication module, the limitation of field conditions is overcome, and the feedback type multi-video stream information fusion system can be applied to fields with various conditions.
In this embodiment, the feedback-type multi-video stream information fusion system further includes: and a processor moduleA reset circuit (not shown in FIG. 2) electrically connected to the first circuit; the reset circuit is suitable for enabling the processor module to carry out reset operation; the reset circuit may be, but is not limited to, employingMAX811SThe reset chip consists of four pins, wherein the 1 st pin is connected with a power ground, the 2 nd pin is an output pin, the 3 rd pin is a manual reset input pin, and the 4 th pin is connected with a power voltage; the above-mentionedMAX811SThe reset chip can realize power-on reset and can also realize a manual reset function.
In this embodiment, the processor module is further electrically connected to a clock chip (not shown in fig. 2) and a clock generator (not shown in fig. 2) for recording the time data of the captured image; the clock chip can be but is not limited to adopt a high-precision clockIC－SD3078 a real-time clock chip; the clock generator may be, but is not limited to, employingSITIMEA clock generator; the shot images and the shot time are correspondingly stored through the clock chip and the clock generator, and later-period calling can be facilitated.
In this embodiment, the feedback-type multi-video stream information fusion system further includes: electrically connected to the processor moduleUSBA chip (not shown in FIG. 2); the above-mentionedUSBThe chip can be but is not limited toCH9343 model numberUSBA chip; the processor module is adapted to pass throughUSBChip connection externalUSBAn apparatus.
In this embodiment, the feedback-type multi-video stream information fusion system further includes: the storage module is electrically connected with the processor module; the memory module can be but is not limited to adoptingFM24CL16 a memory; the storage module is suitable for storing image data of a target pedestrian shot by the camera 1; the target pedestrian image data storage is favorable for later-stage calling of the target pedestrian image data.
Example 2
This embodiment 2 provides a feedback-type multi-video stream information fusion method, including:
the infrared sensors and the cameras track the pedestrians to shoot, namely, the cameras are controlled to adjust the focal length according to the distance between the target pedestrians and the cameras in the shooting area detected by the infrared sensors so as to shoot images of the target pedestrians; and acquiring a complete image of the target pedestrian according to the multi-angle image of the target pedestrian, and sending a turntable control signal to the processor module to control the turntable of the corresponding camera to rotate along with the target pedestrian after the target pedestrian is locked.
Fig. 3 is a schematic diagram of a complete image of a target pedestrian according to the present invention.
Specifically, the complete image of the target pedestrian is obtained according to the target pedestrian image of the multiple angles, namely the image of the target pedestrian is firstly screened out, the target pedestrian is extracted to carry out the track, and the image is spliced according to the track of the target pedestrian to obtain the complete image of the target pedestrian.
In fig. 3, the dotted line portrait represents the position where the target pedestrian enters the first image, the arrow represents the motion track, the solid line portrait represents the position of the image, the second image is similar, two or more images are spliced, a complete and continuous complete image of the target pedestrian can be obtained, the target pedestrian is tracked, and the target is not easy to lose.
In summary, the invention comprises an upper computer, a processor module, a plurality of infrared sensors and a plurality of cameras, wherein the infrared sensors and the cameras are electrically connected with the processor module; the bottoms of the cameras are provided with rotary tables, and the rotary tables are provided with the infrared sensors; the processor module is suitable for controlling the camera to adjust the focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian; the upper computer is suitable for obtaining a complete image of a target pedestrian according to the multi-angle image of the target pedestrian, and sends a rotary table control signal to the processor module to control the rotary table to rotate along with the rotary table after the target pedestrian is locked, so that the complete image acquisition is realized.
The illumination device can ensure that the ambient illumination meets the condition of clearly shooting the image of the pedestrian with the multi-angle target; the invention can be applied to fields with various conditions through the communication module, thereby overcoming the limitation of field conditions; the power-on reset function and the manual reset function can be realized through the reset circuit; the shot images and the shot time are correspondingly stored through the clock chip and the clock generator, so that later-stage calling can be facilitated; the storage of the target pedestrian image data through the storage module is favorable for calling the target pedestrian image data in the later period.
In light of the foregoing description of the preferred embodiment of the present invention, many modifications and variations will be apparent to those skilled in the art without departing from the spirit and scope of the invention. The technical scope of the present invention is not limited to the content of the specification, and must be determined according to the scope of the claims.
Claims (9)
1. A feedback-type multi-video stream information fusion system, comprising:
the system comprises an upper computer, a processor module, a plurality of infrared sensors and a plurality of cameras, wherein the infrared sensors and the cameras are electrically connected with the processor module;
the bottoms of the cameras are provided with rotary tables, and the rotary tables are provided with the infrared sensors;
the processor module is suitable for controlling the camera to adjust the focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian;
the upper computer is suitable for obtaining a complete image of a target pedestrian according to the multi-angle image of the target pedestrian and sending a turntable control signal to the processor module to control the turntable to rotate along with the target pedestrian after the target pedestrian is locked.
2. The feedback-type multi-video stream information fusion system of claim 1,
the feedback type multi-video stream information fusion system further comprises: the illumination sensor and the lighting device are electrically connected with the processor module;
the lighting device and the illumination sensor are both arranged on the turntable;
the processor module is suitable for controlling the illumination device to work according to the illumination intensity of the shooting area detected by the illumination sensor so as to supplement light for shooting of the camera.
3. The feedback-type multi-video stream information fusion system of claim 1,
the feedback type multi-video stream information fusion system further comprises: the communication module is electrically connected with the processor module;
the communication module is suitable for sending the target pedestrian image to the upper computer and receiving the turntable control signal sent by the upper computer.
4. The feedback-type multi-video stream information fusion system of claim 1,
the feedback type multi-video stream information fusion system further comprises: the reset circuit is electrically connected with the processor module;
the reset circuit is adapted to cause the processor module to perform a reset operation.
5. The feedback-type multi-video stream information fusion system of claim 1,
the processor module is also electrically connected with the clock chip and the clock generator and used for recording the time data of the shot images.
6. The feedback-type multi-video stream information fusion system of claim 1,
the feedback type multi-video stream information fusion system further comprises: electrically connected to the processor moduleUSBA chip;
the processor module is adapted to pass throughUSBChip connection externalUSBAn apparatus.
7. The feedback-type multi-video stream information fusion system of claim 1,
the feedback type multi-video stream information fusion system further comprises: the storage module is electrically connected with the processor module;
the storage module is suitable for storing image data of the target pedestrian shot by the camera.
8. A feedback type multi-video stream information fusion method is characterized by comprising the following steps:
multiple infrared sensors and cameras track the pedestrian for shooting, i.e.
Controlling a camera to adjust a focal length according to the distance between the target pedestrian and the camera in the shooting area detected by the infrared sensor so as to shoot the image of the target pedestrian;
and acquiring a complete image of the target pedestrian according to the multi-angle image of the target pedestrian, and sending a turntable control signal to the processor module to control the turntable of the corresponding camera to rotate along with the target pedestrian after the target pedestrian is locked.
9. The feedback-type multi-video stream information fusion method according to claim 8,
obtaining a complete image of the target pedestrian according to the multi-angle image of the target pedestrian, namely
The method comprises the steps of screening out images appearing in a target pedestrian, extracting a track of the target pedestrian, and splicing the images according to the track of the target pedestrian so as to obtain a complete image of the target pedestrian.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910178801 | 2019-03-11 | ||
| CN201910178801X | 2019-03-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111010548A true CN111010548A (en) | 2020-04-14 |
Family
ID=70116015
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911345001.9A Pending CN111010548A (en) | 2019-03-11 | 2019-12-24 | Feedback type multi-video stream information fusion system and working method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111010548A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103379307A (en) * | 2012-04-13 | 2013-10-30 | 何磊 | Video track tracking monitoring and retrieval playback system based on wireless positioning |
| CN104702904A (en) * | 2013-12-10 | 2015-06-10 | 北京铁龙恒通车辆装备有限公司 | Device and method for comprehensively and accurately positioning and monitoring railway maintenance place |
| US20150378134A1 (en) * | 2013-02-26 | 2015-12-31 | Ricoh Imaging Company, Ltd. | Zoom lens system |
| CN105306896A (en) * | 2015-10-27 | 2016-02-03 | 杭州永控科技有限公司 | Case file transferring method and system based on optical positioning |
| CN205608276U (en) * | 2016-01-18 | 2016-09-28 | 杭州瑞杰珑科技有限公司 | Foldable typoscope of focusing fast |
| CN206461725U (en) * | 2017-02-07 | 2017-09-01 | 南昌工程学院 | Multiple video strems information fuse device |
| CN109359552A (en) * | 2018-09-21 | 2019-02-19 | 中山大学 | One kind is efficiently across camera shooting head's bi-directional tracking method |
-
2019
- 2019-12-24 CN CN201911345001.9A patent/CN111010548A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103379307A (en) * | 2012-04-13 | 2013-10-30 | 何磊 | Video track tracking monitoring and retrieval playback system based on wireless positioning |
| US20150378134A1 (en) * | 2013-02-26 | 2015-12-31 | Ricoh Imaging Company, Ltd. | Zoom lens system |
| CN104702904A (en) * | 2013-12-10 | 2015-06-10 | 北京铁龙恒通车辆装备有限公司 | Device and method for comprehensively and accurately positioning and monitoring railway maintenance place |
| CN105306896A (en) * | 2015-10-27 | 2016-02-03 | 杭州永控科技有限公司 | Case file transferring method and system based on optical positioning |
| CN205608276U (en) * | 2016-01-18 | 2016-09-28 | 杭州瑞杰珑科技有限公司 | Foldable typoscope of focusing fast |
| CN206461725U (en) * | 2017-02-07 | 2017-09-01 | 南昌工程学院 | Multiple video strems information fuse device |
| CN109359552A (en) * | 2018-09-21 | 2019-02-19 | 中山大学 | One kind is efficiently across camera shooting head's bi-directional tracking method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101171833B (en) | Digital cameras with triangulation autofocus systems and related methods | |
| CN108696682B (en) | Data processing method, device, electronic equipment and computer readable storage medium | |
| CN103685921A (en) | Method and device for displaying camera preview screen in a portable terminal | |
| Sargent et al. | Timelapse GigaPan: Capturing, sharing, and exploring timelapse gigapixel imagery | |
| CN105472345A (en) | Six-way splicing type real-time panoramic imaging device | |
| US10652440B2 (en) | Hermetically sealed camera with a graphical processing unit (GPU) | |
| CN105808542B (en) | Information processing method and information processing apparatus | |
| Akin et al. | Hemispherical multiple camera system for high resolution omni-directional light field imaging | |
| KR20110006453A (en) | Method for detecting disturbance of monitoring camera | |
| CN209787325U (en) | video-networking-based amusement park sharing camera system | |
| CN111010548A (en) | Feedback type multi-video stream information fusion system and working method thereof | |
| CN109348193A (en) | A kind of video camera suitable for pinpointing monitoring | |
| CN204442567U (en) | A kind of digital picture real-time display system based on industrial computer platform | |
| CN108307155A (en) | Suitable for pinpointing the video camera of monitoring | |
| CN114827442B (en) | Method for generating image and electronic equipment | |
| CN109547689A (en) | Automatically snap control method, device and computer readable storage medium | |
| KR102146613B1 (en) | Method for monitoring material location using low-power infrared beacon and speed camera and system using the same | |
| IT201700009363A1 (en) | Automatic tracking system and method for the video recording of sporting events, in particular football matches at 5, 7 or 11. | |
| CN105872404A (en) | Digital photo taking device and control method based on dynamic exposure control | |
| Winterl et al. | micrObs–A customizable time-lapse camera for ecological studies | |
| KR102631376B1 (en) | Heterogeneous device convergence sensor device | |
| CN2824458Y (en) | Digital tracking camera controller | |
| CN109660712A (en) | Select the mthods, systems and devices of the frame of video sequence | |
| CN116887058B (en) | Image acquisition method, device, acquisition equipment and storage medium | |
| CN103702031A (en) | Large-view-field high-frame-frequency system and method for high-speed target measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200414 |