CN113766093A - Panoramic high-definition multi-focus camera device and system - Google Patents

Abstract

The application provides a pair of many focuses of panorama high definition camera device and system is applicable to the airport, includes: the camera array is composed of a plurality of cameras with different focal lengths and is used for simultaneously acquiring high-definition image data of long distance, medium distance and short distance; each camera has a digital zooming function with a certain zooming range, and is used for providing continuous and stable high-definition image data when the image frame is stretched or zoomed excessively in a long distance, a middle distance and a short distance. The panoramic high-definition multi-focal-length camera device provides various combinations of different focal lengths and zoom lenses, various unprecedented high-definition images can be observed from a single position, all functions of lens rotation, stretching, amplification and the like are realized in a digital analog mode, a camera moving mechanism of any mechanical part is not needed, and the functions of lens rotation, stretching, amplification and the like of images shot by multiple users can be supported to be operated simultaneously.

Description

Panoramic high-definition multi-focus camera device and system

Technical Field

The application relates to the technical field of camera control, in particular to a panoramic high-definition multi-focus camera device and a panoramic high-definition multi-focus camera system.

Background

Generally, an airport tower needs to know real-time conditions of the whole take-off and landing runway and two sides of a taxiway of the airport, and generally, 20-40 cameras with relatively low cost are arranged on the airport tower or a high point so as to acquire real-time pictures of the airport in an all-around manner. However, the sensing camera acquisition cannot take into account the overall or panoramic viewing angle, and on the other hand, when a specific target object needs to be observed in detail, for example, when a mark on a flying airplane is observed, the specific target object cannot be seen clearly, and sometimes the specific target object needs to be searched across screens. Or, when a person needs to be found from the airport video, the person cannot see the clear face at all because of the long distance or the small target.

Disclosure of Invention

In view of the above-mentioned shortcomings of the prior art, it is an object of the present application to provide a panoramic high-definition multi-focus image capturing apparatus and system, which are used to solve at least one problem in the prior art.

In order to achieve the above objects and other related objects, the present application provides a panoramic high definition multi-focus camera device, suitable for use in an airport, the device comprising: the camera array is composed of a plurality of cameras with different focal lengths and is used for simultaneously acquiring high-definition image data of long distance, medium distance and short distance; and each camera can work independently at the same time; each camera has a digital zooming function with a certain zooming range, and is used for providing continuous and stable high-definition image data when the image frame is stretched or zoomed excessively in a long distance, a middle distance and a short distance.

In an embodiment of the present application, the camera array at least includes: the system comprises 1 first camera for close focusing, 2 second cameras for middle focusing and 4 third cameras for long focusing.

In an embodiment of the present application, the high-definition image data collected by the first camera is a panoramic image; the high-definition image data collected by the second camera corresponds to the middle part of the panoramic picture; the high-definition image data collected by the third camera corresponds to the upper part of the panoramic picture.

In an embodiment of the present application, the image frame of the close-range wide-angle view acquired by the first camera is a default view; when a target object in the image picture needs to be observed, the target object is selected and amplified through an external communication device, and the first camera automatically carries out digital zooming and transits to a second camera corresponding to the image picture containing the target object; and the second camera automatically carries out digital zooming and transits to a third camera corresponding to the image picture containing the target object.

In an embodiment of the present application, after a target object in the image frame is selected, the target object is tracked according to a trained target recognition model; the tracking includes: tracking and calibrating an image frame acquired by any camera through a calibration frame; or sending a lens rotation instruction to the second camera or the third camera to realize the tracking of the target object.

In an embodiment of the present application, each of the cameras is respectively provided with a memory for independently storing the high definition image data acquired by each of the cameras.

In an embodiment of the present application, each of the cameras is respectively provided with a processor and a communicator, so that each of the cameras receives and executes an external control command for lens rotation, lens stretching, and lens magnification.

In an embodiment of the present application, each camera is provided with a 396-mega-resolution lens sensor chip for obtaining a 4K ultra-high-definition image frame at a corresponding focal length.

In an embodiment of the present application, each of the cameras is integrated into a signal interface unit, and the signal interface unit includes: any one or more of a signal input port, a signal output port, an optical fiber interface, an RJ45 interface, a VGA interface, an RS485 interface and a BNC interface.

To achieve the above and other related objects, the present application provides a panoramic high definition multi-focus camera system suitable for airports, comprising: a plurality of panoramic high-definition multi-focus cameras; each panoramic high-definition multi-focus camera device is arranged on an airport high tower or high ground to correspondingly acquire different visual angles in the airport.

To sum up, the multi-focus camera device of panorama high definition and system of this application are applicable to the airport, include: the camera array is composed of a plurality of cameras with different focal lengths and is used for simultaneously acquiring high-definition image data of long distance, medium distance and short distance; and each camera can work independently at the same time; each camera has a digital zooming function with a certain zooming range, and is used for providing continuous and stable high-definition image data when the image frame is stretched or zoomed excessively in a long distance, a middle distance and a short distance.

Has the following beneficial effects:

the panoramic high-definition multi-focal-length camera device provides various combinations of different focal lengths and zoom lenses, various unprecedented high-definition images can be observed from a single position, all functions of lens rotation, stretching, amplification and the like are realized in a digital analog mode, a camera moving mechanism of any mechanical part is not needed, and the functions of lens rotation, stretching, amplification and the like of images shot by multiple users can be supported to be operated simultaneously.

Drawings

Fig. 1 is a schematic view of a scene of a panoramic high-definition multi-focus camera according to an embodiment of the present disclosure.

Fig. 2 is a schematic structural diagram of a panoramic high-definition multi-focus camera device according to an embodiment of the present disclosure.

Fig. 3 is a schematic diagram illustrating distribution of images acquired by each camera in the camera array according to an embodiment of the present disclosure.

Fig. 4 is a schematic diagram illustrating a comparison of image sharpness of an approach-status flight aircraft according to an embodiment of the present application.

Fig. 5 is a schematic structural diagram of a panoramic high-definition multi-focal-length camera system according to an embodiment of the present disclosure.

Detailed Description

The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.

It should be noted that the drawings provided in the following embodiments are only schematic and illustrate the basic idea of the present application, and although the drawings only show the components related to the present application and are not drawn according to the number, shape and size of the components in actual implementation, the type, quantity and proportion of the components in actual implementation may be changed at will, and the layout of the components may be more complex.

Based on the problem that exists in the traditional camera that is applied to the airport, this application has provided a panorama high definition multiple focal distance camera device and system, as shown in fig. 1, demonstrates this application in the scene sketch map of panorama high definition multiple focal distance camera device in an embodiment. The application panorama high definition multi-focal distance camera device mainly through a plurality of camera array 100 that have different focuses to gather remote, well distance, and closely high definition image data simultaneously. The method and the device can be suitable for the full-range accurate monitoring of an ultra-large area, and output full-range high-definition images, high-degree dynamic capture and full-depth-of-field image shooting, and the scenes of both long-range scenes and close-range scenes can have the same resolution or definition.

Fig. 2 is a schematic structural diagram of a panoramic high-definition multi-focus camera according to an embodiment of the present disclosure. As shown, the apparatus comprises: a camera array 100 composed of a plurality of cameras 110 having different focal lengths, for simultaneously acquiring high-definition image data of a long distance, a medium distance, and a short distance; and each camera 110 can work independently at the same time; each camera 110 has a digital zoom function with a certain zoom range, so as to provide continuous and stable high-definition image data when the image frame is stretched or zoomed excessively between a long distance, a middle distance and a short distance.

In an embodiment of the present application, the camera array 100 at least includes: 1 first camera 110A in close focus, 2 second cameras 110B in mid-range focus, and 4 third cameras 110C in far focus.

In one or more other embodiments, the camera array 100 described herein may also include 2 first cameras 110A, 4 or 5 second cameras 110B, and 8 to 10 third cameras 110C. That is, in the present application, the first camera 110A, the second camera 110B, and the third camera 110C are not increased by multiples, and the number of settings is determined only by the screen sizes limited by the appropriate focusing ranges corresponding to the long distance, the medium distance, and the short distance, respectively.

In some embodiments, the camera device described herein employs a camera array 100 comprising a plurality of cameras 110 with different focal lengths, so that a very wide coverage area, e.g., 42 ° vertical and 180 ° horizontal, can be achieved by the plurality of cameras 110; in addition, the camera 110 with different focal lengths can be used, so that various unprecedented high-definition images can be observed from a single position.

In this embodiment, the first camera 110A is a wide-angle camera 110, which is mainly used for capturing a panoramic scene, and the first camera 110A is mainly characterized by capturing a panoramic scene, and can clearly see a target object at a short distance, for example, a target object within 200 meters, but correspondingly sacrifices focusing at a long distance, that is, focusing on a target object at a long distance cannot be achieved or a high-definition image picture cannot be obtained.

The second camera 110B is a general camera 110 or a middle focus camera 110, and is used for capturing a middle distance scene, and it can clearly see a target object in a middle distance range, for example, the focusing range is set to be in a range of 500-1000 meters, although the focusing distance of the second camera 110B is increased, the capturing range is necessarily reduced, and therefore, at least twice the number of the first cameras 110A is needed to fill up the whole transverse scene. For example, one captures the left image and one captures the right image.

The third camera 110C is a long-focus camera 110 for capturing a long-distance scene, which can clearly see a target object in a long-distance range, for example, the focusing range is set to be more than 1000, and similar to the second camera 110B, although the focusing distance of the third camera 110C is increased, the capturing range is necessarily reduced, so that at least twice the number of the second cameras 110B is required to fill the whole lateral scene.

In an embodiment of the present application, the high-definition image data acquired by the first camera 110A is a panoramic image; the high-definition image data acquired by the second camera 110B corresponds to the middle of the panoramic picture; the high-definition image data collected by the third camera 110C corresponds to the upper portion of the panoramic image.

Referring to fig. 3, since the image captured by the first camera 110A is a panoramic image and a high-definition image of a close-range scene can be obtained, the image captured by the second camera 110B can be concentrated in the middle of the panoramic image, that is, the middle of the panoramic image corresponds to a middle distance, and the image captured by the third camera 110C can be concentrated in the upper part of the panoramic image, that is, the upper part of the panoramic image corresponds to a long distance.

The digital zoom (digital zoom) is to enlarge each pixel area in a picture by a processor 112 in a digital camera, thereby achieving the purpose of enlargement. The method is similar to the method of using image processing software to increase the area of a picture, but the program is carried out in a digital camera, a part of pixels on the original CCD image sensor are amplified by using an 'interpolation' processing means, and the pixels on the CCD image sensor are amplified to the whole picture by using an interpolation algorithm. Digital zooming does not actually change the focal length of the lens. The principle is as follows: and judging the colors of the periphery of the existing pixels by using software, and inserting the pixels added by a special algorithm according to the color condition of the periphery.

In the present application, if the short-distance image frame is switched to the middle-distance image frame, the discontinuous image frame selection condition occurs, so that each of the cameras 110 is set to have a digital zoom function with a certain zoom range, so that the image frame can be stretched or zoomed excessively at a long distance, a middle distance, and a short distance to provide continuous and stable high-definition image data.

In an embodiment of the present application, the image frame of the close-range wide-angle view acquired by the first camera 110A is a default view; when a target object in the image frame needs to be observed, the target object is selected and amplified through an external communication device (such as a server or a terminal of an airport tower), the first camera 110A automatically performs digital zooming and transits to a second camera 110B corresponding to the image frame containing the target object, specifically, the focusing distance of the first camera 110A gradually increases, and when a set limit value close to the minimum focusing of the second camera 110B is reached, the image frame acquired by the second camera 110B is automatically switched; and the second camera 110B automatically performs digital zooming and transits to the third camera 110C corresponding to the image frame including the target object, specifically, the focusing distance of the second camera 110B gradually increases, and when the set limit value close to the minimum focusing value of the third camera 110C is reached, the image frame acquired by the third camera 110C is automatically switched.

As described above, compared with the prior art, the present application can realize all the functions of lens rotation, stretching, magnification, etc. in a digital analog manner, thereby eliminating the need for any mechanical part of the camera moving mechanism.

For example, after receiving the high-definition image data collected by the camera device, the high-definition image data can be displayed to a user through the display. The default picture or the first picture on the display is displayed as a close-range wide-angle or panoramic-view image collected by the first camera 110A. When a user selects a target object, such as an airplane ready to leave the field, the distance from the field airplane or the camera 110 corresponding to the middle part of the panoramic picture is the second camera 110B, a local picture collected by the second camera 110B is displayed below the first picture, the distance from the field airplane is matched with the relative focal distance of the second camera 110B, and the local picture is displayed as a high-definition image picture which draws the field airplane closer. Therefore, the first panoramic picture and the local high-definition picture aiming at the target object can be simultaneously viewed.

For another example, if the selected target object is an airplane about to approach to the ground, the default frame or the first frame on the display is still the image frame with a close-range wide angle or a panoramic angle acquired by the first camera 110A, and the distance of the approaching airplane or the camera 110 corresponding to the upper portion of the panoramic image is the third camera 110C, a local frame acquired by the third camera 110C is displayed below the first frame, the distance of the approaching airplane is adapted to the focus distance of the third camera 110C, and the local frame is displayed as the image frame with a high resolution and a close-range airplane. Therefore, the first panoramic picture and the local high-definition picture aiming at the target object can be simultaneously viewed.

In an embodiment of the present application, after a target object in the image frame is selected, the target object is tracked according to a trained target recognition model; the tracking includes: tracking and calibrating the image frames acquired by any camera 110 through a calibration frame; or, a lens rotation instruction is sent to the second camera 110B or the third camera 110C, so as to track the target object.

In this embodiment, usually, the airport tower needs to track and observe the moving airplane, ground vehicle, and staff, and based on this requirement, this application can realize tracking the target object through the selected target object of user, and then according to the trained target recognition model based on the picture that this camera device gathered.

For example, in the training process, features of a training target object, such as the shape of an airplane, patterns or codes on a fuselage, and the like, are extracted through video recognition to serve as a tracking reference object, so that the training target object can be accurately determined in real time.

In an embodiment of the present application, each of the cameras can work independently at the same time, wherein each of the cameras 110 is provided with a memory 111 for independently storing the high definition image data acquired by each of the cameras 110.

In this embodiment, compare with prior art, this application is stretching or enlargeing the image picture of looking over by camera device collection when, can also be respectively to long distance, well distance, and closely high definition image data still save to can support the review or the video recording of arbitrary focus image picture. The method can realize real-time viewing of any operations such as stretching or amplifying, and also can perform original storage on the original image, and the functions of lens rotation, stretching, amplifying and the like can also be applied to video recording so as to perform playback analysis afterwards.

Although some imaging devices have a plurality of cameras, generally, such devices are often used for depth measurement, and most of the stored image data is raw data of one focal length or processed data after fusion, and generally, a memory is not separately provided for each camera to store data.

The Memory 111 may include a Random Access Memory (RAM), and may also include a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. The memory 111 stores an operating system and operating instructions, executable modules or data structures, or a subset thereof, or an expanded set thereof, wherein the operating instructions may include various operating instructions for performing various operations. The operating system may include various system programs for implementing various basic services and for handling hardware-based tasks.

In an embodiment of the present application, each of the cameras can work independently at the same time, wherein each of the cameras 110 is respectively provided with a processor 112 and a communicator 113, so that each of the cameras 110 receives and executes an external control command for lens rotation, lens stretching, and lens magnification.

It should be noted that, since each camera 110 in the camera array 100 described in the present application has an independent processor 112 and communicator 113, it can support multiple users to simultaneously operate the lens rotation-stretching-zooming functions of the captured images.

The Processor 112 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.

The communicator 113 is used for realizing communication connection between the database access device and other devices (such as a client, a read-write library and a read-only library). The communicator 113 may include one or more sets of modules for different communication modes, such as a CAN communication module communicatively coupled to a CAN bus. The communication connection may be one or more wired/wireless communication means and combinations thereof. The communication method comprises the following steps: any one or more of the internet, CAN, intranet, Wide Area Network (WAN), Local Area Network (LAN), wireless network, Digital Subscriber Line (DSL) network, frame relay network, Asynchronous Transfer Mode (ATM) network, Virtual Private Network (VPN), and/or any other suitable communication network. For example: any one or a plurality of combinations of WIFI, Bluetooth, NFC, GPRS, GSM and Ethernet.

In an embodiment of the present application, each of the cameras 110 is provided with a 396 mb lens sensor chip to obtain a 4K ultra high definition image.

In the embodiment, the photosensitive chip can realize full-automatic zooming, focusing and calibration and automatic sunlight/noctilucence conversion, the waterproof performance reaches IP66, the working temperature range is-40 degrees to +50 degrees, the working humidity range is 0-90 percent, and the dynamic range (UWDR) of up to 130 decibels can be realized. The dynamic range refers to a hue range in which the scanner can record an original, that is, a difference between a density (Dmax) of a darkest point of the original and a density value (Dmin) at the maximum. Whereas for film and photosensitive elements, the dynamic range represents the range from "darkest" to "brightest" contained in the image. The larger the dynamic range is, the more rich the layers can be represented, and the wider the color space is, wherein the larger the dynamic range of the digital camera is, the more rich the dark part details and the bright part details can be recorded simultaneously.

In an embodiment of the present application, each of the cameras 110 is integrated into a signal interface unit 200, and the signal interface unit 200 includes: any one or more of a signal input port, a signal output port, an optical fiber interface, an RJ45 interface, a VGA interface, an RS485 interface and a BNC interface.

In this embodiment, the signal interface unit 200 can output multiple video signals through one cable. The signal interface unit 200 is mainly used for connecting any one or more of a network video management platform, an NVR network hard disk recorder, a monitor, a storage array, a display, and an external control keyboard. For example, the VGA interface is connected to the display, and cooperates with the keyboard and the mouse to implement configuration of control parameters of the control system by the upper computer interface, real-time presentation of video signals, sensor signals and running states, and local control of the camera; when the field camera 110 needs to be remotely controlled, the local controller is connected with the remote controller through the optical fiber to transmit signals; interconnection and video resource sharing with various computer equipment are realized through an RJ45 interface; and the RS485 signal control port provides a debugging port of the network video signal control card.

For example, as shown in fig. 4, a schematic diagram of the image clarity of an approach status flight airplane according to an embodiment of the present application is shown. As shown in the figure, it demonstrates for traditional camera equipment or standard and this application camera device just gather when different distances image definition ratio to being in the incoming form flight aircraft, wherein the left side picture is the image that traditional camera equipment or standard were gathered, the right side picture is this application camera device image of gathering. The right image can be seen visually, the method still has higher resolution ratio for the collected picture of the distant view target object, and the traditional camera equipment or the standard collected picture can only see the module pixel block or the outline.

To sum up, the multi-focus camera device of panorama high definition that this application provided includes: a camera array 100 composed of a plurality of cameras 110 having different focal lengths, for simultaneously acquiring high-definition image data of a long distance, a medium distance, and a short distance; each camera 110 has a digital zoom function with a certain zoom range, so as to provide continuous and stable high-definition image data when the image frame is stretched or zoomed excessively between a long distance, a middle distance and a short distance. The panoramic high-definition multi-focal-length camera device provides various combinations of different focal lengths and zoom lenses, various unprecedented high-definition images can be observed from a single position, all functions of lens rotation, stretching, amplification and the like are realized in a digital analog mode, a camera moving mechanism of any mechanical part is not needed, and the functions of lens rotation, stretching, amplification and the like of images shot by multiple users can be supported to be operated simultaneously.

Fig. 5 is a schematic structural diagram of a panoramic high-definition multi-focal-length imaging system according to an embodiment of the present invention. As shown, the panoramic high-definition multi-focal-length camera system 500 is suitable for an airport, and the system 500 includes: a plurality of panoramic high-definition multi-focal length cameras 510 as described in fig. 1 or fig. 2; each panoramic high-definition multi-focal-length camera 510 is arranged on an airport high tower or high ground to correspondingly acquire different view angles in the airport.

For example, in general, the airport tower or the airport ground needs to fully cover the airport, and a plurality of annular capturing angles are required, so the present application further provides a camera system 500, which is composed of a plurality of panoramic high-definition multi-focus cameras 510 as shown in fig. 1 or fig. 2, which can be preferably installed around the airport tower in an annular or semicircular shape to capture different viewing angles in the airport.

To sum up, this application panorama high definition many focuses camera device and system can compatible multiple camera interface to provide camera cloud platform and turn to drive function, camera control function, light control function and auxiliary function, insert the control that corresponds the camera control card or change camera control card skill and realize corresponding camera through expanding on the interface circuit board, the demand of adaptable different occasions, the range of application is wide. In addition, this application panorama high definition many focuses camera device and system adopt modular structure design, the later maintenance of being convenient for is handled, adopts unified rearmounted side to go on, effectively changes the complicated overall arrangement of various interconnecting link in the past, improves on-the-spot factor of safety and assembly efficiency.

The application effectively overcomes various defects in the prior art and has high industrial utilization value.

The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the application. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical concepts disclosed in the present application shall be covered by the claims of the present application.

Claims (10)

1. The utility model provides a many focuses of panorama high definition camera device which characterized in that is applicable to the airport, the device includes:

the camera array is composed of a plurality of cameras with different focal lengths and is used for simultaneously acquiring high-definition image data of long distance, medium distance and short distance; and each camera can work independently at the same time;

each camera has a digital zooming function with a certain zooming range, and is used for providing continuous and stable high-definition image data when the image frame is stretched or zoomed excessively in a long distance, a middle distance and a short distance.

2. The panoramic high-definition multi-focal-length camera device according to claim 1, wherein the camera array at least comprises: the system comprises 1 first camera for close focusing, 2 second cameras for middle focusing and 4 third cameras for long focusing.

3. The panoramic high-definition multi-focal-length camera device as claimed in claim 2, wherein the high-definition image data acquired by the first camera is a panoramic picture; the high-definition image data collected by the second camera corresponds to the middle part of the panoramic picture; the high-definition image data collected by the third camera corresponds to the upper part of the panoramic picture.

4. The panoramic high-definition multi-focal-length camera device as claimed in claim 2, wherein the image frame of the close-distance wide-angle view acquired by the first camera is a default view; when a target object in the image picture needs to be observed, the target object is selected and amplified through an external communication device, and the first camera automatically carries out digital zooming and transits to a second camera corresponding to the image picture containing the target object; and the second camera automatically carries out digital zooming and transits to a third camera corresponding to the image picture containing the target object.

5. The panoramic high-definition multi-focal-length camera device as claimed in claim 4, wherein after a target object in the image frame is selected, the target object is tracked according to a trained target recognition model; the tracking includes: tracking and calibrating an image frame acquired by any camera through a calibration frame; or sending a lens rotation instruction to the second camera or the third camera to realize the tracking of the target object.

6. The panoramic high-definition multi-focal-length camera device according to any one of claim 1, wherein each camera is provided with a memory for independently storing high-definition image data acquired by each camera.

7. The panoramic high-definition multi-focal-length camera device according to any one of claim 1, wherein each camera is provided with a processor and a communicator, so that each camera can receive and execute external control commands of lens rotation, stretching and magnification.

8. The panoramic high-definition multi-focal-length camera device as claimed in claim 1, wherein each camera is provided with a 396-megaresolution lens photosensitive chip for acquiring a 4K ultra-high-definition image picture at a corresponding focal length.

9. The panoramic high-definition multi-focal-length camera device according to any one of claim 1, wherein each camera is integrated into a signal interface unit, and the signal interface unit comprises: any one or more of a signal input port, a signal output port, an optical fiber interface, an RJ45 interface, a VGA interface, an RS485 interface and a BNC interface.

10. A panoramic high-definition multi-focal-length camera system suitable for airports, comprising: a plurality of panoramic high-definition multi-focus cameras as claimed in any one of claims 1 to 9; each panoramic high-definition multi-focus camera device is arranged on an airport high tower or high ground to correspondingly acquire different visual angles in the airport.

Images