CN114040114A - Panoramic shooting and light supplementing method, system, equipment and medium - Google Patents
Panoramic shooting and light supplementing method, system, equipment and medium Download PDFInfo
- Publication number
- CN114040114A CN114040114A CN202111424636.5A CN202111424636A CN114040114A CN 114040114 A CN114040114 A CN 114040114A CN 202111424636 A CN202111424636 A CN 202111424636A CN 114040114 A CN114040114 A CN 114040114A
- Authority
- CN
- China
- Prior art keywords
- module
- target object
- light
- target
- light supplementing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001502 supplementing effect Effects 0.000 title claims abstract description 83
- 238000000034 method Methods 0.000 title claims abstract description 35
- 239000013589 supplement Substances 0.000 claims abstract description 56
- 238000001514 detection method Methods 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 9
- 230000003068 static effect Effects 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 abstract description 9
- 238000009434 installation Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005429 filling process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
The invention provides a method, a system, equipment and a medium for panoramic shooting and light supplement, which comprise the following steps: the method comprises the steps that a light supplementing module is started to carry out cruising light supplementing along each shooting angle range of a camera module, wherein the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and images acquired by the image acquisition units are spliced to obtain a panoramic image of a scene corresponding to the camera module; when a target object is detected within a certain shooting angle range of the camera module, controlling the light supplement module to track the track of the target object for directional light supplement, and rotating along the track of the target object through a preset snapshot module to obtain the snapshot image corresponding to the target object; according to the intelligent tracking light supplement monitoring system, intelligent tracking light supplement monitoring is realized through linkage of the cruise light supplement module and the camera module, operability is strong, low power consumption and low cost can be realized.
Description
Technical Field
The invention relates to the field of camera application, in particular to a panoramic camera shooting and light supplementing method, a panoramic camera shooting and light supplementing system, panoramic camera shooting and light supplementing equipment and a panoramic camera shooting and light supplementing medium.
Background
The panoramic camera generally adopts the structural design of cloud platform + panorama in the present industry, and the cloud platform generally adopts the core more than 40 times, and the cloud platform can 360 rotations, and the panorama generally adopts 4-8 camera lens integrated design, can cover 180 to 360 angles according to realizing the scene demand. However, the panoramic camera is generally higher in installation height, generally more than 20 meters, and extremely individual installation height is lower than 20 meters, and because the installation height is higher, especially at a height of 50-100 meters, ordinary white light supplementary lighting generally cannot cover, and infrared supplementary lighting with a long supplementary lighting distance cannot cover such a large area, so how to reasonably and effectively supplement light to the panoramic camera becomes a problem which needs to be solved urgently at present.
Disclosure of Invention
In view of the problems in the prior art, the invention provides a panoramic shooting and light supplementing method, a panoramic shooting and light supplementing system, panoramic shooting and light supplementing equipment and a panoramic shooting and light supplementing medium, and mainly solves the problems that an existing light supplementing scheme is poor in light supplementing effect at night and is difficult to accurately track a target.
In order to achieve the above and other objects, the present invention adopts the following technical solutions.
A panoramic shooting and light supplementing method comprises the following steps:
the method comprises the steps that a light supplementing module is started to carry out cruising light supplementing along each shooting angle range of a camera module, wherein the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and images acquired by the image acquisition units are spliced to obtain a panoramic image of a scene corresponding to the camera module;
when a target object is detected within a certain shooting angle range of the camera module, the light supplementing module is controlled to track the track of the target object to perform directional light supplementing, and a preset snapshot module rotates along the track of the target object to acquire the snapshot image corresponding to the target object.
Optionally, start the light filling module and follow the shooting angle of camera module and carry out the light filling that cruises, include:
detecting the brightness of the environment, and starting the light supplementing module if the brightness of the environment is lower than a preset brightness threshold;
and after the light supplementing module is started, the light supplementing angle is adjusted according to a preset angular speed, the scene with the corresponding angle is supplemented with light, and the cruising light supplementing of each shooting angle range of the camera module is completed.
Optionally, the camera module includes a plurality of image capturing units, each image capturing unit is responsible for different shooting angle ranges, and a panoramic image of the camera module in a corresponding scene is obtained by splicing images acquired by the plurality of image capturing units.
Optionally, before controlling the light supplement module to track the trajectory of the target object for directional light supplement, the method includes:
acquiring multi-frame images of the target object, and acquiring a track of the corresponding target object according to the multi-frame images;
judging the moving state of the corresponding target object according to the track, wherein the moving state comprises the following steps: a stationary state and a moving state;
and controlling the light supplementing module to move according to the moving state.
Optionally, controlling the movement of the light supplement module according to the movement state includes:
when the target object is in a static state, determining a rotation angle of the light supplementing module according to the position of the target object in a corresponding image, and moving the light supplementing module to supplement light towards the position of the target object according to the rotation angle;
when the target object is in a motion state, determining the moving direction and the moving speed of the corresponding target object according to the multi-frame image, adjusting the rotating direction of the light supplementing module according to the moving direction and the moving speed, and tracking the corresponding target object through the light supplementing module to supplement light to the target object.
Optionally, the determining of the target object includes:
acquiring two frames of reference images within each shooting angle range according to a preset frame interval; comparing the two frames of reference images to obtain a difference area as the target object; and/or the presence of a gas in the gas,
and acquiring a detection image in a light supplement area of the light supplement module, comparing the detection image with an image in a preset target database, and if the detection image contains an object matched with the image in the target database, taking the matched object as the target object.
Optionally, the manner of acquiring the difference region includes:
acquiring the similarity between the two reference images, if the similarity is lower than a set threshold, segmenting the two reference images according to a preset segmentation proportion, and comparing the similarity of the segmented corresponding region images to acquire one or more target regions with the similarity lower than the set threshold;
if a plurality of target areas with similarity lower than the set threshold exist, correcting the segmentation proportion according to the number of the target areas, and segmenting the two frames of reference images again to obtain a target area only containing one target area with similarity lower than the set threshold;
and continuing to segment the target area until the similarity of the areas corresponding to the two segmented reference images is lower than the set threshold and the similarity of the rest areas is higher than the set threshold, and taking the area which is finally segmented and is lower than the set threshold as the difference area.
Optionally, if there are a plurality of target regions with similarity lower than the set threshold, modifying the segmentation ratio according to the number of the target regions, including:
judging whether a plurality of target areas have a common point, if so, taking the common point as the center to make a circle containing the target areas with the common point, and dividing the circular area as the difference area;
if the common point does not exist, taking the geometric center points of all the target areas as the center, making a circle containing all the target areas, and dividing the circular area to be used as the difference area.
A panoramic shooting and light supplementing system comprises:
the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and a panoramic image under a scene corresponding to the camera module is obtained by splicing images acquired by the plurality of image acquisition units;
the light supplementing module is used for performing cruise light supplementing along with each shooting angle range of the camera module;
and the target snapshot module is used for controlling the light supplement module to track the track of the target object to perform directional light supplement when the target object is detected within a certain shooting angle range of the camera module, acquiring a snapshot image of the target object after light supplement, and rotating along the track of the target object through a preset snapshot module to acquire the snapshot image corresponding to the target object.
A panoramic photographing and light supplementing apparatus includes:
one or more processors; and
one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the panoramic photography and fill-in light method.
A machine-readable medium having stored thereon instructions, which when executed by one or more processors, cause an apparatus to perform the panoramic photography and fill-in light method.
As described above, the panoramic photography and fill-in light method, system, device and medium according to the present invention have the following advantages.
Cruise through the light filling module and carry out the light filling in turn, trail the light filling and take a candid photograph when detecting the target, effectively solve the not enough problem of traditional mode light filling area of coverage, coordinate through light filling module and camera module, quick response target tracking reduces the energy consumption simultaneously and practices thrift the cost.
Drawings
Fig. 1 is a schematic flow chart of a panoramic shooting and light supplementing method according to an embodiment of the present invention.
Fig. 2 is a schematic view of an installation structure of the camera module and the light supplement module according to an embodiment of the present invention.
Fig. 3 is a flowchart of a panoramic shooting and light supplementing method according to another embodiment of the present invention.
Fig. 4 is a block diagram of a panoramic photographing and light supplementing system according to an embodiment of the present invention.
Fig. 5 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
Referring to fig. 1, the present invention provides a panoramic photographing and light supplementing method, including the following steps.
Step S01, starting a light supplement module to perform cruise light supplement along with each shooting angle range of a camera module, wherein the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and images acquired by the image acquisition units are spliced to obtain a panoramic image of a scene corresponding to the camera module;
step S02, when a target object is detected within a certain shooting angle range of the camera module, the light supplementing module is controlled to track the track of the target object for directional light supplementing, and the preset snapshot module rotates along with the track of the target object to obtain the snapshot image corresponding to the target object.
In an embodiment, the camera module includes a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and a panoramic image in a scene corresponding to the camera module is obtained by splicing images acquired by the plurality of image acquisition units. Specifically, referring to fig. 2, the camera module may include 8 cameras, which are respectively a camera 1, a camera 2, a camera 3, a camera 4, a camera 5, a camera 6, a camera 7, and a camera 8. The 8 cameras are arranged in a ring shape, each camera is responsible for a specific shooting angle range, and a 360-degree panorama can be shot through all 8 cameras. The number and the position of the cameras and the angle range included in the panorama can be adjusted according to the actual application requirements, and the method is not limited here.
In an embodiment, start the light filling module and follow the shooting angle of camera module and carry out the light filling that cruises, include:
detecting the brightness of the environment, and starting the light supplementing module if the brightness of the environment is lower than a preset brightness threshold;
and after the light supplementing module is started, the light supplementing angle is adjusted according to a preset angular speed, the scene with the corresponding angle is supplemented with light, and the cruising light supplementing of each shooting angle range of the camera module is completed.
Specifically, the light supplement module may adopt a laser light supplement device. A photosensitive sensor can be arranged on the corresponding equipment and used for detecting the brightness of ambient light, and a processor is arranged for receiving detection signals of the photosensitive sensor and controlling the light supplementing action of the light supplementing module. An ambient light brightness threshold value can be preset in the processor, and when the ambient light brightness detected by the photosensitive sensor is lower than the set ambient light brightness threshold value, the light supplementing module can be started to start operation. The camera module does not need the light filling daytime, and the light filling module can be in the dormant state, and when the luminance darkened to a definite value evening, the light filling is carried out, and the light filling process is automatically controlled. After the light filling module starts, the light filling module can rotate according to a preset angular speed, can pause for a period of time after rotating to a specified angle, rotates next time until rotating 360 degrees and returning to an initial position, completes the light filling action of one period, and performs cruising light filling by taking the period as a unit. The settings of the rotation angular speed and the pause duration can be adjusted according to actual requirements, and are not limited herein.
In an embodiment, after the light supplement module is started, if a target object enters a certain shooting angle range, the moving state of the target object can be acquired, and the light supplement module is controlled to perform tracking light supplement on the target object according to the moving state.
In one embodiment, the determining of the target object includes:
acquiring two frames of reference images within each shooting angle range according to a preset frame interval; comparing the two frames of reference images to obtain a difference area as the target object; and/or the presence of a gas in the gas,
and acquiring a detection image in a light supplement area of the light supplement module, comparing the detection image with an image in a preset target database, and if the detection image contains an object matched with the image in the target database, taking the matched object as the target object.
In one embodiment, the manner of acquiring the difference region includes:
acquiring the similarity between the two reference images, if the similarity is lower than a set threshold, segmenting the two reference images according to a preset segmentation proportion, and comparing the similarity of the segmented corresponding region images to acquire one or more target regions with the similarity lower than the set threshold;
if a plurality of target areas with similarity lower than the set threshold exist, correcting the segmentation proportion according to the number of the target areas, and segmenting the two frames of reference images again to obtain a target area only containing one target area with similarity lower than the set threshold;
and continuing to segment the target area until the similarity of the areas corresponding to the two segmented reference images is lower than the set threshold and the similarity of the rest areas is higher than the set threshold, and taking the area which is finally segmented and is lower than the set threshold as the difference area.
In an embodiment, if there are a plurality of target regions with similarity lower than the set threshold, modifying the segmentation ratio according to the number of the target regions includes:
judging whether a plurality of target areas have a common point, if so, taking the common point as the center to make a circle containing the target areas with the common point, and dividing the circular area as the difference area;
if the common point does not exist, taking the geometric center points of all the target areas as the center, making a circle containing all the target areas, and dividing the circular area to be used as the difference area.
Specifically, two frames of images are acquired from images acquired by each camera of the camera module to perform difference comparison, and whether a difference area exists between the two corresponding frames of images is judged. And defining the difference area as the area where the target object is located. The frame interval can be set according to the requirements of practical application, for example, images of two continuous frames or 1 frame interval can be selected as reference images. The method for acquiring the difference region may include calculating similarity between two frames of images, segmenting the images if the similarity between the two frames of images is lower than a set threshold, further calculating similarity between corresponding regions of each segmented image, determining whether segmentation needs to be continued based on the similarity until the similarity between the images of the corresponding segmented regions is lower than the set threshold and other regions are higher than the set threshold, and determining the target object by using the regions with the similarity lower than the set threshold as the difference regions. The image similarity calculation mode may adopt conventional histogram statistics, structural similarity measurement, and other modes, which are not limited herein.
In another embodiment, an image database of the monitoring target may also be preset, the real-time image obtained from the light supplement region is compared with the image in the image database for similarity, whether the light supplement region includes the corresponding monitoring target is determined, and if the light supplement region includes the corresponding monitoring target, the monitoring target in the light supplement region is used as the target object.
In an embodiment, the moving track of the target object may be further detected, for example, the track of the corresponding target object may be determined according to the position of the target object in the continuous multi-frame images. Further, the moving direction of the track can be obtained according to the time sequence of the continuous frame images and the determined track. And then the light supplementing module is controlled to move according to the moving direction, track tracking is carried out, and light supplementing is carried out on the target object.
In an embodiment, when the target object is in a static state, determining a rotation angle of the light supplement module according to a position of the target object in a corresponding image, and moving the light supplement module to perform light supplement towards the position of the target object according to the rotation angle; when the target object is in a motion state, determining the moving direction and the moving speed of the corresponding target object according to the multi-frame image, adjusting the rotating direction of the light supplementing module according to the moving direction and the moving speed, and tracking the corresponding target object through the light supplementing module to supplement light to the target object.
Furthermore, the moving speed of the target object can be determined according to the time sequence of the multiple frames of images and the offset of the track in the corresponding frame of image, and the rotating speed of the light supplementing module is controlled based on the moving speed so as to supplement light along the track.
In an embodiment, as shown in fig. 2, a ball camera may be set as a capturing device to track a track of a target object, capture a detailed image of the target object, and acquire a clear detailed image of the target object through linkage of the light supplement module and the ball camera. The shooting angle of the dome camera can be adjusted through the processor, so that more images containing the detailed characteristics of the target object can be obtained.
In an embodiment, the target object may be a human, an animal, or an item. Aiming at some areas where people are not allowed to enter, when people are detected to enter at night, the personnel track is tracked, the personnel characteristics are collected, and meanwhile, an alarm is started to inform a manager. When searching for a specific target, the target image can be stored in the monitoring target image database, when the corresponding searching target is collected at night, the target track can be tracked by the light supplement module to supplement light and collect images, and meanwhile, alarm information is started, and images related to the target are pushed.
Referring to fig. 3, in another embodiment, the steps of panoramic photographing and supplementary lighting may include:
s1: the panoramic camera normally works in the daytime without starting the light supplement module, and when the photosensitive sensor of the panoramic camera detects that the ambient light brightness is insufficient, the main processor starts the light supplement module;
s2: the light supplementing module comprises a motor-driven intelligent ring and a remote illumination laser carried on the intelligent ring, and the processor issues an instruction to drive the whole light supplementing module to start cruise illumination at left and right 360 degrees so as to supplement light for each camera of the panoramic camera;
s3: the panoramic multi-view camera checks the track of the snapshotted person or other objects in a time-sharing manner within the cruising light supplementing range set by the light supplementing module, and confirms whether people or objects invade;
s4: the main processor continuously receives the information of each camera to judge whether to track and detect the personnel track information or the object track information, if no personnel track information or object track information exists in the cruise period, the cruise is continued, and if the personnel track information or the object track information is detected, the next judgment is carried out;
s5: when the main processor detects that a certain camera has the person track information or the object track information, judging whether the movement direction of the person track or the object track is left or right or not;
s6: if the person track or the object track has left and right movement directionality, the processor controls the motor to drive the intelligent ring to rotate so as to drive the light supplementing module to track and supplement light;
s7: the processor further locks the target and communicates with the linked ball machine, and sends instructions to enable the ball machine to take a snapshot of the details and give an alarm.
The panoramic network camera adopts an F1.0 aperture and a lens with a target surface of 1/1.8 ', the Sensor adopts a target surface of 1/1.8', and the optical filter adopts an ICR infrared cut-off optical filter, so that the infrared light can be received in a night mode. Panorama intelligence ring adopts two infrared laser heads, but laser head horizontal rotation and vertical angle are rotatory, and the laser that the laser head sent can cover the area of 10mX10m at least, and through the inside core zoom control of laser head, the area of covering can change. The light is supplemented to the panoramic area through the laser head, so that the moving and static of an actual scene can be observed in the panorama instead of the previous invalid image, the information in the area is processed through an algorithm by the central processing unit, whether a person passes through the panorama or not is judged, whether alarm tracking is triggered or not is judged, then the linked ball machine rotates to the picture, the area is magnified through the zooming of the machine core, and the clearer image, such as information of a human face, a vehicle license plate and the like, is grabbed. The patent provides a solution for the pain point, so that the product competitiveness is greatly improved, the cost and the power consumption of the solution are moderate, and no additional influence is caused.
Referring to fig. 4, the present embodiment provides a panoramic photographing and light supplementing system, which is used to implement the panoramic photographing and light supplementing method described in the foregoing method embodiments. Since the technical principle of the system embodiment is similar to that of the method embodiment, repeated description of the same technical details is omitted.
In one embodiment, a panoramic photography and fill-in light system includes: the camera module 10 comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and images acquired by the plurality of image acquisition units are spliced to obtain a panoramic image in a scene corresponding to the camera module; the light supplementing module 11 is used for performing cruise light supplementing along with each shooting angle range of the camera module; and the target snapshot module 12 is configured to control the light supplement module to track a track of the target object for directional light supplement when the target object is detected within a certain shooting angle range of the camera module, and rotate along the track of the target object through a preset snapshot module to obtain the snapshot image corresponding to the target object.
The embodiment of the present application further provides a panoramic shooting and light supplementing device, and the device may include: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of fig. 1. In practical applications, the device may be used as a terminal device, and may also be used as a server, where examples of the terminal device may include: the mobile terminal includes a smart phone, a tablet computer, an electronic book reader, an MP3 (Moving Picture Experts Group Audio Layer III) player, an MP4 (Moving Picture Experts Group Audio Layer IV) player, a laptop, a vehicle-mounted computer, a desktop computer, a set-top box, an intelligent television, a wearable device, and the like.
The embodiment of the present application further provides a machine-readable medium, where one or more modules (programs) are stored in the medium, and when the one or more modules are applied to a device, the device may execute instructions (instructions) included in the panoramic photography and fill-in light method in fig. 1 according to the embodiment of the present application. The machine-readable medium can be any available medium that a computer can store or a data storage device including one or more available media integrated servers, data centers, and the like. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
Referring to fig. 5, the present embodiment provides a device 80, and the device 80 may be a desktop device, a laptop computer, a smart phone, or the like. In detail, the device 80 comprises at least, connected by a bus 81: a memory 82 and a processor 83, wherein the memory 82 is used for storing computer programs, and the processor 83 is used for executing the computer programs stored in the memory 82 to execute all or part of the steps of the foregoing method embodiments.
The above-mentioned system bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The system bus may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus. The communication interface is used for realizing communication between the database access device and other equipment (such as a client, a read-write library and a read-only library). The Memory may include a Random Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In summary, the method, the system, the device and the medium for panoramic photography and light supplement provided by the invention solve the problem of low-brightness panoramic monitoring by performing cruise light supplement on an environment with low light through the light supplement module; the cruise light supplement scheme can meet the light supplement requirement and can meet the requirements of low power consumption and low cost; the light supplementing module with a limited angle is used for tracking the target, clear target images are obtained, a reliable safety early warning scheme is provided, and monitoring early warning under a low-brightness environment is automatically and intelligently completed. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. A panoramic shooting and light supplementing method is characterized by comprising the following steps:
the method comprises the steps that a light supplementing module is started to carry out cruising light supplementing along each shooting angle range of a camera module, wherein the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and images acquired by the image acquisition units are spliced to obtain a panoramic image of a scene corresponding to the camera module;
when a target object is detected within a certain shooting angle range of the camera module, the light supplementing module is controlled to track the track of the target object to perform directional light supplementing, and a preset snapshot module rotates along the track of the target object to acquire the snapshot image corresponding to the target object.
2. The panoramic photography and supplementary lighting method according to claim 1, wherein the starting of the supplementary lighting module to perform cruising supplementary lighting along with the shooting angle of the photography module comprises:
detecting the brightness of the environment, and starting the light supplementing module if the brightness of the environment is lower than a preset brightness threshold;
and after the light supplementing module is started, the light supplementing angle is adjusted according to a preset angular speed, the scene with the corresponding angle is supplemented with light, and the cruising light supplementing of each shooting angle range of the camera module is completed.
3. The panoramic shooting and light supplementing method according to claim 1, wherein before controlling the light supplementing module to track the track of the target object for directional light supplementing, the method comprises:
acquiring multi-frame images of the target object, and acquiring a track of the corresponding target object according to the multi-frame images;
judging the moving state of the corresponding target object according to the track, wherein the moving state comprises the following steps: a stationary state and a moving state;
and controlling the light supplementing module to move according to the moving state.
4. The panoramic shooting and light supplementing method according to claim 3, wherein the controlling the movement of the light supplementing module according to the movement state comprises:
when the target object is in a static state, determining a rotation angle of the light supplementing module according to the position of the target object in a corresponding image, and moving the light supplementing module to supplement light towards the position of the target object according to the rotation angle;
when the target object is in a motion state, determining the moving direction and the moving speed of the corresponding target object according to the multi-frame image, adjusting the rotating direction of the light supplementing module according to the moving direction and the moving speed, and tracking the corresponding target object through the light supplementing module to supplement light to the target object.
5. The panoramic photographing and supplementing method according to claim 1, wherein the determination of the target object comprises:
acquiring two frames of reference images within each shooting angle range according to a preset frame interval; comparing the two frames of reference images to obtain a difference area as the target object; and/or the presence of a gas in the gas,
and acquiring a detection image in a light supplement area of the light supplement module, comparing the detection image with an image in a preset target database, and if the detection image contains an object matched with the image in the target database, taking the matched object as the target object.
6. The panoramic photography and supplementary lighting method according to claim 5, wherein the manner of acquiring the disparity region comprises:
acquiring the similarity between the two reference images, if the similarity is lower than a set threshold, segmenting the two reference images according to a preset segmentation proportion, and comparing the similarity of the segmented corresponding region images to acquire one or more target regions with the similarity lower than the set threshold;
if a plurality of target areas with similarity lower than the set threshold exist, correcting the segmentation proportion according to the number of the target areas, and segmenting the two frames of reference images again to obtain a target area only containing one target area with similarity lower than the set threshold;
and continuing to segment the target area until the similarity of the areas corresponding to the two segmented reference images is lower than the set threshold and the similarity of the rest areas is higher than the set threshold, and taking the area which is finally segmented and is lower than the set threshold as the difference area.
7. The panoramic shooting and fill-in light method according to claim 6, wherein if there are a plurality of target areas with similarity lower than the set threshold, correcting the division ratio according to the number of the target areas comprises:
judging whether a plurality of target areas have a common point, if so, taking the common point as the center to make a circle containing the target areas with the common point, and dividing the circular area as the difference area;
if the common point does not exist, taking the geometric center points of all the target areas as the center, making a circle containing all the target areas, and dividing the circular area to be used as the difference area.
8. The utility model provides a panorama is made a video recording and light filling system which characterized in that includes:
the camera module comprises a plurality of image acquisition units, each image acquisition unit is responsible for different shooting angle ranges, and a panoramic image under a scene corresponding to the camera module is obtained by splicing images acquired by the plurality of image acquisition units;
the light supplementing module is used for performing cruise light supplementing along with each shooting angle range of the camera module;
and the target snapshot module is used for controlling the light supplement module to track the track of the target object to perform directional light supplement when the target object is detected within a certain shooting angle range of the camera module, and the preset snapshot module rotates along the track of the target object to acquire the snapshot image corresponding to the target object.
9. The utility model provides a panorama is made a video recording and light filling equipment which characterized in that includes:
one or more processors; and
one or more machine-readable media having instructions stored thereon that, when executed by the one or more processors, cause the apparatus to perform the method of any of claims 1-7.
10. A machine-readable medium having stored thereon instructions, which when executed by one or more processors, cause an apparatus to perform the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111424636.5A CN114040114A (en) | 2021-11-26 | 2021-11-26 | Panoramic shooting and light supplementing method, system, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111424636.5A CN114040114A (en) | 2021-11-26 | 2021-11-26 | Panoramic shooting and light supplementing method, system, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114040114A true CN114040114A (en) | 2022-02-11 |
Family
ID=80138998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111424636.5A Pending CN114040114A (en) | 2021-11-26 | 2021-11-26 | Panoramic shooting and light supplementing method, system, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114040114A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115190249A (en) * | 2022-09-13 | 2022-10-14 | 常州海图信息科技股份有限公司 | Camera infrared lamp dynamic light supplementing system and method |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120154579A1 (en) * | 2010-12-20 | 2012-06-21 | International Business Machines Corporation | Detection and Tracking of Moving Objects |
| JP2013162188A (en) * | 2012-02-02 | 2013-08-19 | Canon Inc | Camera with panorama photographing function |
| CN105809673A (en) * | 2016-03-03 | 2016-07-27 | 上海大学 | SURF (Speeded-Up Robust Features) algorithm and maximal similarity region merging based video foreground segmentation method |
| WO2017215262A1 (en) * | 2016-06-15 | 2017-12-21 | 捷开通讯(深圳)有限公司 | Photographing method and system based on supplementary screen lighting |
| CN108419014A (en) * | 2018-03-20 | 2018-08-17 | 北京天睿空间科技股份有限公司 | The method for capturing face using panoramic camera and the linkage of Duo Tai candid cameras |
| JP2018186514A (en) * | 2018-06-13 | 2018-11-22 | パナソニックＩｐマネジメント株式会社 | Image processing device, imaging system having the same and image processing method |
| CN110325446A (en) * | 2018-09-26 | 2019-10-11 | 深圳市大疆创新科技有限公司 | Filming apparatus, holder camera and unmanned plane |
| CN112399075A (en) * | 2020-10-15 | 2021-02-23 | 浙江大华技术股份有限公司 | Control method of light supplement lamp, monitoring equipment, electronic device and storage medium |
| CN113141442A (en) * | 2020-01-17 | 2021-07-20 | 华为技术有限公司 | Camera and light supplementing method thereof |
| CN113610746A (en) * | 2021-02-23 | 2021-11-05 | 腾讯科技（深圳）有限公司 | Image processing method and device, computer equipment and storage medium |
-
2021
- 2021-11-26 CN CN202111424636.5A patent/CN114040114A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120154579A1 (en) * | 2010-12-20 | 2012-06-21 | International Business Machines Corporation | Detection and Tracking of Moving Objects |
| JP2013162188A (en) * | 2012-02-02 | 2013-08-19 | Canon Inc | Camera with panorama photographing function |
| CN105809673A (en) * | 2016-03-03 | 2016-07-27 | 上海大学 | SURF (Speeded-Up Robust Features) algorithm and maximal similarity region merging based video foreground segmentation method |
| WO2017215262A1 (en) * | 2016-06-15 | 2017-12-21 | 捷开通讯(深圳)有限公司 | Photographing method and system based on supplementary screen lighting |
| CN108419014A (en) * | 2018-03-20 | 2018-08-17 | 北京天睿空间科技股份有限公司 | The method for capturing face using panoramic camera and the linkage of Duo Tai candid cameras |
| JP2018186514A (en) * | 2018-06-13 | 2018-11-22 | パナソニックＩｐマネジメント株式会社 | Image processing device, imaging system having the same and image processing method |
| CN110325446A (en) * | 2018-09-26 | 2019-10-11 | 深圳市大疆创新科技有限公司 | Filming apparatus, holder camera and unmanned plane |
| CN113141442A (en) * | 2020-01-17 | 2021-07-20 | 华为技术有限公司 | Camera and light supplementing method thereof |
| CN112399075A (en) * | 2020-10-15 | 2021-02-23 | 浙江大华技术股份有限公司 | Control method of light supplement lamp, monitoring equipment, electronic device and storage medium |
| CN113610746A (en) * | 2021-02-23 | 2021-11-05 | 腾讯科技（深圳）有限公司 | Image processing method and device, computer equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115190249A (en) * | 2022-09-13 | 2022-10-14 | 常州海图信息科技股份有限公司 | Camera infrared lamp dynamic light supplementing system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021227359A1 (en) | Unmanned aerial vehicle-based projection method and apparatus, device, and storage medium | |
| CN110866480B (en) | Object tracking method and device, storage medium and electronic device | |
| US11887318B2 (en) | Object tracking | |
| US8989506B1 (en) | Incremental image processing pipeline for matching multiple photos based on image overlap | |
| CN101640788B (en) | Method and device for controlling monitoring and monitoring system | |
| KR101530255B1 (en) | Cctv system having auto tracking function of moving target | |
| CN112207821B (en) | Target searching method of visual robot and robot | |
| WO2020057353A1 (en) | Object tracking method based on high-speed ball, monitoring server, and video monitoring system | |
| CN112689221B (en) | Recording method, recording device, electronic equipment and computer readable storage medium | |
| CN110944101A (en) | Image pickup apparatus and image recording method | |
| CN111630523A (en) | Image feature extraction method and device | |
| CN111314609A (en) | Method and device for controlling pan-tilt tracking camera shooting | |
| CN114040114A (en) | Panoramic shooting and light supplementing method, system, equipment and medium | |
| CN113949814B (en) | Gun-ball linkage snapshot method, device, equipment and medium | |
| CN111654668A (en) | Monitoring equipment synchronization method and device and computer terminal | |
| CN109841022B (en) | Target moving track detecting and alarming method, system and storage medium | |
| Premachandra et al. | A hybrid camera system for high-resolutionization of target objects in omnidirectional Images | |
| CN103327251B (en) | A kind of multimedia photographing process method, device and terminal equipment | |
| CN105467741A (en) | Panoramic shooting method and terminal | |
| CN112396634A (en) | Moving object detection method, moving object detection device, vehicle and storage medium | |
| CN113747044A (en) | Panoramic shooting method and device | |
| CN116342642A (en) | Target tracking method, device, electronic equipment and readable storage medium | |
| CN112672057B (en) | Shooting method and device | |
| US10051192B1 (en) | System and apparatus for adjusting luminance levels of multiple channels of panoramic video signals | |
| CN115471546A (en) | Target tracking method, system, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220211 |
|
| RJ01 | Rejection of invention patent application after publication |