CN113497916A - System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions - Google Patents

System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions Download PDF

Info

Publication number
CN113497916A
CN113497916A CN202011034443.4A CN202011034443A CN113497916A CN 113497916 A CN113497916 A CN 113497916A CN 202011034443 A CN202011034443 A CN 202011034443A CN 113497916 A CN113497916 A CN 113497916A
Authority
CN
China
Prior art keywords
video
camera
based security
security system
cargo
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011034443.4A
Other languages
Chinese (zh)
Inventor
黄广扬
吴道宾
陈广添
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Logistics and Supply Chain Multitech R&D Centre Ltd
Original Assignee
Logistics and Supply Chain Multitech R&D Centre Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/823,579 external-priority patent/US11410513B2/en
Application filed by Logistics and Supply Chain Multitech R&D Centre Ltd filed Critical Logistics and Supply Chain Multitech R&D Centre Ltd
Publication of CN113497916A publication Critical patent/CN113497916A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00Burglar, theft or intruder alarms
    • G08B13/18Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19639Details of the system layout
    • G08B13/19645Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A video-based security system for providing viewing and control of a cargo transportation vehicle with . The security system includes a camera cradle disposed outside of a cargo storage area; a camera system mounted on the camera support for covering a top plane, a front plane, a left plane, a right plane, and a back plane of the cargo area; a master unit connected to the camera system to record event recordings.

Description

System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions
Technical Field
The present invention relates to a video-based security system and apparatus for providing control of viewing and displaying to a cargo delivery truck. In particular, the present invention relates to a video-based vehicle awareness monitoring system and apparatus for air cargo transport security under all-weather driving conditions.
Background
Air cargo security monitoring during transit between two security checkpoints is one of the weakest links in the overall security measure. Cargo nets and duffel bags are mainly used to restrain cargo in vehicles. The cargo net is made of ropes and is made into a net structure of a large square pattern. The cargo net may be constructed from woven straps that are woven together.
In use, the cargo net or bag is subjected to severe wear. The environment in which the cargo net and bag are used can cause significant wear on the net or bag structure. Exposure to extreme weather conditions, repeated installation and removal, dragging over rough surfaces and use with machinery such as cranes, etc., can seriously damage the cargo net or bag. The use of bags and nets is relatively expensive. Furthermore, the time and location of a potentially detected intrusion cannot be easily tracked. Therefore, relying on these conventional security measures is very unreliable.
Disclosure of Invention
The present invention relates to a video-based security system and apparatus for providing pay per view control to a cargo delivery truck.
A video-based security system and facility for providing viewing and control of to cargo delivery trucks is provided that is not limited by container space, size and conditions.
Other advantages will become apparent when considered in conjunction with the following description and the accompanying drawings.
Embodiments of the present invention may overcome or ameliorate at least one of the disadvantages of the prior art, or provide a useful alternative.
In a first aspect of the present disclosure, there is provided a video-based security system for providing viewing and control of visual and audio ratings to a cargo conveyance vehicle, comprising:
a camera cradle disposed outside of the cargo storage area;
a camera system attached to the camera support for covering a top plane, a front plane, a left plane, a right plane, and a rear plane of the cargo area;
a main unit connected to the camera system to record event recordings.
Preferably, the vehicle comprises a trailer vehicle towing a trailer, wherein the trailer has a cargo area adapted to transport cargo.
Preferably, the camera stand includes: a left exhaust duct on a left side of the lead vehicle for attaching a first camera of the camera system; and a right exhaust pipe on a right side of the trailer for attaching a second camera of the camera system.
Preferably, the camera stand includes: a left pole on a left side of the vehicle for attaching a first camera of the camera system; and a right pole on a right side of the vehicle for attaching a second camera of the camera system.
Preferably, the left and right rods are fixed to the front end of the trailer.
Preferably, the left and right poles are configured to provide a front gap distance of 10cm to 50cm from the cargo area.
Preferably, each of the left and right poles has an adjustable height.
Preferably, each of the left and right rods has an arm extending horizontally from the top end of the rod, wherein the arm has a length of 10cm to 50 cm.
Preferably, the arm has an adjustable length.
Preferably, each of the left and right levers is rotatable.
Preferably, the camera bracket comprises an extension for attaching a third camera of the camera system to a rear side of the vehicle.
Preferably, the camera system comprises one or more cameras with a lens having an angle of view between 110 and 220 degrees.
Preferably wherein the camera system comprises one or more cameras adapted to capture images covering a field of view of 160 to 360 degrees.
Preferably, the camera system comprises a camera having a plurality of sensors.
Preferably, the camera system communicates with a master unit for processing images captured by the camera system, wherein the master unit is adapted to communicate with the server.
Preferably, the master unit and the server are adapted to perform a process comprising the steps of:
defining a safe area for an image captured by a camera system;
detecting any object protruding into, outside or within the secure area;
the event record is recorded on a storage device of the master unit.
Preferably, the safety area is defined by identifying cargo areas on the top plane, the front plane, the left plane, the right plane and the rear plane.
Preferably, each event records a security record comprising one or more attributes of a truck ID, a time tag, a duration, a geospatial tag, continuous time tagged geospatial data, a video clip and an event description.
Preferably, the master unit is adapted to trigger a light indicator for any detected intrusion trigger.
Preferably, the master unit is adapted to communicate with the presence server to check to see all event records in the master unit to determine whether to issue an intrusive license to the master unit including the signer ID, the signature time stamp.
Preferably, the master unit is adapted to communicate with the server to send the event record in real time to alert the user via the web application or the mobile application.
Preferably, the master unit is adapted to communicate with the server to transmit the video segments in real time to check and verify the authenticity of the intrusion.
Preferably, the step of detecting any object protruding into, outside or within the security zone comprises the steps of:
storing a time series of images captured by a camera system;
performing statistical change detection to determine a change region;
performing spatial refinement to determine an object of interest; and
one or more metadata of the object of interest is calculated.
Preferably, the camera system is adapted to perform image stabilization via optical or electronic image stabilization.
Preferably, the camera system comprises one or more image sensors containing two or more types of pixels having different photosensitivities to generate a single image by combining images captured by the image sensors having different exposure times.
Preferably, the camera system is adapted to filter the background environment before processing the image captured by the camera system.
Drawings
Fig. 1 is a schematic diagram of a flatbed truck implementing a video-based security system for providing viewing and control of pay/view to cargo transport vehicles in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram of an articulated container truck implementing a video-based security system for providing viewing and control of to cargo transport vehicles in accordance with an embodiment of the present invention;
fig. 3 is a schematic diagram of a video-based security system for providing viewing and control of optical and electronic images to a cargo conveyance vehicle in accordance with one embodiment of the present invention;
fig. 4 is a schematic diagram of a process performed by the video-based security system of fig. 3; and
fig. 5 is a schematic diagram of an intrusion detection process performed by the video-based security system of fig. 3.
Detailed Description
Cargo vehicles are commonly used to transport cargo on land. There are different types of cargo vehicles, such as rigid trucks, articulated trucks, tank trucks, dump trucks, garbage trucks, etc.
The inventors, through their own research, experiments and experiments, have devised that the safety of cargo-transporting vehicles can be enhanced by mounting monitoring devices, such as cameras, microphones, global positioning devices, etc., on the vehicles. The monitoring device typically sends radio signals to a monitoring and recording device located at a remote site, such as a monitoring headquarters.
For example, a system for detecting the loading state of a semi-truck using a camera array system may be used. The system may include an array of sensors affixed to the top of the trailer to automatically determine whether the cargo area of the semi-trailer is occupied. Each camera in the set of cameras is embedded in a separate recess so that each camera in the set of cameras does not protrude from the sensor array into the cargo area. The trailer of the semi-trailer further comprises at least one light source to illuminate the cargo area. The system uses a camera array that requires a large amount of resources. Additional light sources may cause another point of failure.
In an alternative example, a semi-trailer with a hidden camera position may be used. The system appears to be a common part of a common trailer. The trailer is designed with a translucent roof portion that is transparent to light. The camera location is located within a trailer top cradle that is present in many trailers. The hidden camera can only be used in a housing with space. In many cases, the container is full and blocks the hidden camera. Other enclosures may contain hazardous materials that do not allow for the installation of electrical equipment.
In yet another example, a monitoring system assembly within a tractor-trailer may also be used. The system may include one monitor placed inside the trailer and another monitor placed outside the rear door. The monitor communicates with an application downloaded to the user's smartphone device, allowing the user to monitor the cargo. The monitors are placed in an optimal position within the semi-trailer to act as visual monitoring devices within the semi-trailer and to monitor and communicate conditions within the semi-trailer including, but not limited to, monitoring temperature, motion and light. The monitor can only be used in cabinets with space. In many cases, the container is full and blocks the monitor. Other enclosures may contain hazardous materials that do not allow for the installation of electrical equipment. The monitors within the cabinet require the use of light sources to illuminate the environment. Infrared monitors may be used but are not practical for many containers because the temperature inside many containers may be high or low and thus the infrared sensor cannot distinguish between objects and the environment.
There is a need for a monitoring system that is not limited by the container housing, including but not limited to the shape, size, condition of the cargo conveyance vehicle.
In the previous example, a video surveillance system may be installed inside the vehicle to monitor the status of the cargo. Such systems may require space to be left inside the cargo enclosure. Its definition is not suitable for flatbed trailers without enclosures. It is also not suitable for tank trucks because of the danger of installing electrical equipment in the tank. It is also not suitable for use in a trash car because trash can clog or damage the camera lens and reduce visibility.
Furthermore, the installation of cameras in enclosed spaces requires illumination. Some prior art products use electrical lighting inside the container. The extra equipment in the container means that more power is required. This would provide a more vulnerable point for system failures. Others may use infrared sensors. However, the closed container is easily overheated during transportation. In other cases, the interior of the container may freeze. Either way, the ambient temperature and the object temperature are too close to be distinguishable by the infrared sensor.
Preferably, the system or method may include detection of any intrusion using video analytics techniques with the system, in accordance with embodiments of the present invention. Intrusion detection is defined as an object entering a virtual plane from an open area to a secure area.
In the case of transport cargo security, five virtual planes (four side and top planes 42, 44, 46, 48, 50 marked with red dashed lines in the illustration of fig. 2) are established to form the boundary between the outer open area and the inner secure area. Each virtual plane is monitored by the video analysis techniques of embodiments of the present invention to detect any possible intrusion into the secure area.
When the vehicle is stowed, the protruding portion of the mirror should not exceed ten centimeters of the total width of the vehicle when the bottom of the mirror is less than two meters above the road surface.
Referring to fig. 1, there is shown an example of a video-based security system and apparatus 10 for providing control of viewing images to a cargo conveyance vehicle 12, such as a rigid truck, an articulated truck, a tanker truck, a dump truck, a garbage truck, or the like.
In one embodiment of the present invention, video-based security system and device 10 includes a camera support 20 disposed outside cargo storage area 18; a camera system 30 attached to the camera stand for covering a top plane 42, a front plane 44, a left plane 46, a right plane 48, and a rear plane 50 of the cargo area; the main unit 60 is connected to the camera system to record event recordings.
In this example, the cargo conveyance vehicle 12 includes a cabin 13 that houses a driver. In one embodiment, the engine and hood above the cabin are located on a front axis in front of the cabin. In another embodiment, the cabin 13 is located above the engine to form a flat nose cabin, with the driver sitting in front of the front axis. Some compartments have air dampers on top.
In one embodiment, the cargo conveyance vehicle 12 is a rigid truck, wherein the cabin 13 and the cargo area 18 form a single unit. Many refuse trucks, concrete trucks, cargo trucks are classified as rigid trucks.
In another embodiment, cargo conveyance vehicle 12 includes a tractor unit or trailer (prime mover)14, which tractor unit or trailer 14 is connected to a trailer (trailer)15 by a fifth wheel coupling 16. The cabin 13 is located at a trailer vehicle, wherein the trailer vehicle has a cargo area adapted to carry cargo. Some tow vehicles include ties 17.
In one embodiment, the lead vehicle has a left exhaust pipe attached around the left side of the rear region of the cabin 13 and a right exhaust pipe attached around the right side of the rear region of the passenger compartment. Typically, the rear compartment also provides power and air lines to attach to the trailer 15.
There are different types of trailers 15 for different cargo. For example, the trailer may be a box trailer, curtain trailer, dump trailer, auto transporter, flatbed trailer, refrigerated trailer, tank truck, container trailer, or the like.
In some cargo transportation vehicles 12, the cabin 13 and the front plane 42 of the cargo area have a cabin-to-body clearance.
In one embodiment of the present invention, a video-based security system has a camera mount 20, the camera mount 20 including a left exhaust pipe on the left side of the lead vehicle 14 for attaching a first camera 31 of a camera system 30, and a right exhaust pipe on the right side of the lead vehicle for mounting a second camera 32 of the camera system. For example, the exhaust pipe may be located in the region of the cabin-body gap.
However, the exhaust ducts on most cargo vehicles 12 generate heat, vibration, smoke, and dust. Attaching the camera system 30 at the exhaust duct may reduce initial configuration costs, but this adversely affects the efficiency and lifetime of the camera system.
In one embodiment of the present invention, a video-based security system 10 is provided having a camera stand 20, the camera stand 20 including a left pole 21 on the left side of a cargo conveyance vehicle 12 for attaching a first camera 31 of a camera system 30. And a right bar 22 on the right side of the cargo conveyance vehicle for attaching a second camera 32 of the camera system.
In one embodiment, left and right rods 21, 22 are attached to the trailer 14 in the area at the bed and body clearance. However, when the cargo-moving vehicle 12 performs a turn, the trailer wagon 14 will first perform an acute angle turn. The trailer 15 can still maintain its previous forward direction. Thus, a portion of the trailer 15 may fall outside the image coverage area of the camera system 30. To alleviate this problem, the camera system 30 may be rotated in the opposite direction of the trailer wagon 14 to ensure that the image remains covering the entire cargo area 18.
Preferably, the left and right rods 21, 22 are fixed to the front end of the trailer 15, instead of the trailer 14. In one embodiment, the left and right rods 21, 22 are configured to provide a front gap distance of 10cm to 50cm from the cargo area of the front plane 44. This gap distance will give the camera a viewing angle of 50 to 120 degrees, which can cover the entire height of a 3m to 6m cargo area.
In one embodiment, the left and right rods 21, 22 are configured to provide a top gap distance of 10cm to 50cm from the top plane 42 of the cargo area. This gap distance will give the camera a view angle of 110 to 180 degrees, covering the entire length of the cargo area of 6 to 20 m. In another embodiment, each of the left and right rods 21, 22 has an adjustable height. The height of the rods 21, 22 can be adjusted manually or by means of a linear actuator. The rods 21, 22 may include a top portion telescopically engaged with a bottom portion. A screw or fixed pin mechanism may be used to connect the top and bottom at an adjustable height.
The adjustable pole also makes it easier to replace the cameras connected to the poles 21, 22 by lowering the cameras to about human height. In one embodiment, the main unit 60 may detect bridge or tunnel clearance and lower the rods 21, 22 to ensure safe passage.
In one embodiment, each of the left and right rods 21, 22 has an arm 23 extending horizontally from the top end of the rod, wherein the arm is 10cm to 50cm in length. The gap distance will be such that a camera with a view angle of 110 to 180 degrees covers a side plane of the cargo area of 6 to 20 m.
Preferably, the arm 23 has an adjustable length. The length of the arm 23 can be adjusted manually or by means of a linear actuator. The arm may include a proximal portion telescopically engaged with the distal portion. A screw or fixation pin mechanism may be used to connect the proximal and distal portions at an adjustable length. In another embodiment, the camera system 30 transmits the image to the main unit 60.
In one embodiment, each of the left and right levers 21 and 22 is rotatable. The levers 21, 22 may be rotated manually or by an actuator.
One embodiment of the present invention is adapted to provide real-time on-board intrusion detection of traffic between two security points. For example, the camera system 30 transmits an image to the main unit 60. The main unit 60 is adapted to perform a real-time analysis to detect whether the camera system 30 covers the entire cargo area 18. The main unit 60 includes an actuator controller to control one or more actuators to adjust the position of the camera system 30 to ensure that the camera system 30 covers the entire cargo area 18.
In a preferred embodiment, the camera bracket 30 includes an extension for attaching the third camera 33 of the camera system 30 to the rear side of the vehicle to cover the rear plane 50 of the cargo area 18.
The camera system 30 may include different types of cameras. In one embodiment of the invention, the camera system includes one or more cameras with lenses having a viewing angle between 110 and 220 degrees or a fisheye viewing angle. In another embodiment, the camera system comprises one or more cameras adapted to capture images covering a 160 to 360 degree field of view or panorama.
In another embodiment, the camera system 30 includes a single camera unit having multiple sensors. One sensor may have one pixel sensitivity and another sensor may have a different kind of pixel sensitivity. Alternatively, one of the sensors may be an RGB color sensor and the other an infrared sensor. In yet another embodiment, both sensors are used to cover a wider viewing angle.
The camera system 30 in a preferred embodiment includes one or more image sensors containing two or more types of pixels with different photosensitivities to generate a single image by combining images captured by image sensors with different exposure times.
The camera system 30 of the embodiment of the present invention is adapted to perform image stabilization by optical image stabilization or electronic image stabilization. Preferably, this process is performed before the image is transmitted to the main unit 60. As such, the camera system 30 may include one or more memory caches for storing images and one or more digital signal processors for image stabilization. In an embodiment, the cameras of the camera system 30 include digital gyroscopes, levels, and/or accelerometers to improve the image stabilization process.
The video-based security system 10 of an embodiment of the present invention has a camera system 30 in communication with a master unit 60 to process images captured by the camera system. In one embodiment, the camera system 30 is wired directly to the main unit 60. Depending on the interface provided by the main unit 60, the wiring may be a coaxial cable or an HDMI cable. Preferably, the cameras of the camera system 30 are web cameras, including category 5 or above ethernet cables. In one embodiment, the webcam is adapted to communicate with the master unit 60 via a wireless protocol, such as Wi-Fi or Bluetooth.
In one embodiment of the present invention, the master unit 60 includes a Global Positioning System (GPS) to detect the current location of the master unit. The main unit 60 may also be associated with a mobile communication module or a satellite communication module to transmit data to the server.
The main unit 60 of an embodiment of the present invention comprises an embedded system 62 with a central processing unit and digital signal processing for processing images received from the camera system 30. However, where possible, the master unit 60 sends the video and images to the server 64 for more sophisticated video content analysis. Server 64 may be associated with a database system 66 for storing and retrieving video data. Database system 64 may be a cloud-based database, a distributed database, or a local database.
In one embodiment, video-based security system 10 has a main unit 60 and a server adapted to perform a process for detecting and recording events such as intrusions or dropped goods. The process first performs the step of defining a safe area for an image captured by the camera system.
The safety zones are defined by identifying the cargo areas on the top plane 42, the front plane 44, the left plane 46, the right plane 48, and the rear plane 50. Preferably, the master unit 60 or server will receive images of multiple cargo areas. Using the trained image pattern recognition detector through the deep learning method, the master unit 60 or server 64 will be able to generate spatial parameters for cargo areas that should be stagnant or undisturbed. In one embodiment, the spatial parameters may be sent to the camera system 30, so that the camera system is adapted to filter the background environment before processing the images captured by the camera. In this way, the image to be processed will have less noise due to the rapidly changing background of a moving vehicle.
Since the spatial parameters can be generated and regenerated at any time, the video-based security system 10 is adapted to create safe zones for different types and shapes of cargo or trailers, such as irregular cargo on a tanker or flatbed trailer. Cargo can be loaded and unloaded while on the road without affecting the performance of the video-based security system 10.
Once the spatial parameters of the safety zone are defined, the main unit 60 can focus on the variations within the safety zone to detect any object protruding into, out of or within the safety zone. In many cases, when the safety region moves with the same displacement as the camera mount 20 and camera system 30, it reflects a rather steady or stagnant state.
The master unit 60 of embodiments of the present invention may use a method 120 to detect any object protruding into, outside or within a security zone, the method comprising the steps of: in step 122, a time series of images captured by the camera system is stored therein. In one embodiment, the master unit includes a buffer memory array for storing time series images for processing. The digital signal processor may then perform statistical change detection on the safety region in step 124 to determine a change region.
In one embodiment, the statistical change detection algorithm performs a thresholding operation on the simple difference image to simply extract moving objects. The algorithm may comprise the steps of: the statistical behavior of a small neighborhood of each pixel location within the parameters of the safety region is compared to a noise model expected to affect the squared error image. The comparison may simply be a process of calculating a difference between the values of the pixels or performing a statistical significance test to determine whether the pixels belong to a changed region or a noisy region in the image according to a threshold value.
The pre-processing of the image, such as the definition of spatial parameters of the safety zone, makes it more efficient and accurate in detecting changes in the safety zone. Depending on the statistical change detection algorithm, the object detection process may be cost effective, thereby enabling real-time execution by the main unit 60.
Once the object of interest is detected, the main unit 60 may perform a spatial refinement algorithm in step 126 to determine the object of interest. A spatial refinement algorithm is applied to remove shadows and other high-level noise on the image. In one embodiment, a multi-feature clustering algorithm to detect those regions that are uniform with respect to a selected feature. A multi-feature clustering algorithm may generate the local segmentation. The local segmentation is then integrated into the whole image. The local comparison between the background and the adjacent regions belonging to the modified region is used as an image optimization process to eliminate shadows and other high-level noise.
Once the object of interest is detected, the main unit 60 may also calculate one or more metadata of the object of interest in step 128. High-level semantic metadata may include the entry or exit point of an object, object speed, trajectory direction and location, object duration, and the like. In one embodiment, the metadata is processed and computed by the server 64. The event record may then be recorded in step 130.
In one embodiment, the master unit 60 is adapted to transmit the event records and video clips to the server 64 for more detailed video content analysis. The server 64 may include pattern or object recognition software to identify particular objects of interest. In one embodiment, pattern or object recognition software is adapted to identify a human intruder and perform facial recognition to identify whether the intruder is an authorized person. Thus, the monitoring personnel at the headquarters need not remember all the faces of the ground crew. Pattern or object recognition software may be capable of detecting smoke, flames or fire.
When the main unit 60 detects that any object protrudes into, out of or within the secure area of the main unit 60, the main unit records the event record on a storage device 61 attached thereto. Each event record may be a security record including one or more attributes of a truck ID, a time tag, a duration, a geospatial tag, continuous time-tagged geospatial data, a video clip, and an event description.
In one embodiment, the record is protected by an encryption or hashing algorithm using a public key provided by the server 64 or stored locally in the master unit. The encryption or hashing algorithm preferably uses a secure key having 2048 bits or more. In one embodiment, the security records are forwarded to the server 64 or proxy for storing the security records to the distributed ledger 68. This may allow recording and storing with video clips (truck ID, time tag, duration, geospatial tag).
In one embodiment of the invention, the main unit 60 has a light controller associated with the light indicator. The light indicator may generate a light signal of one or more colors, such as yellow, red, green, etc. The light controller is adapted to trigger the light indicator, such as to turn green to yellow, when the main unit 60 detects an intrusion or a dropped cargo. In this case, the driver may notice that the event record has been recorded, but the event may be a false positive or not involve any security breach.
In another embodiment, the event record is sent to the server 64 to validate the event in the headquarters 63. The master unit is adapted to communicate with the server 64 to transmit the video segments in real time to check and verify the authenticity of the intrusion. If the head office sends a permission rejection to the master unit 60, the master unit may turn the light indicator signal to red. A light indicator may be mounted on the dashboard or front panel of the cab 13 so that the driver will notice that a permission denial has been issued and that the cargo vehicle 12 is denied access to the safe area of the transportation hub.
In an embodiment of the present invention, the master unit 60 is adapted to communicate with a presence server 64 to view all event records stored in the master unit to decide whether to issue a non-intrusive license to the master unit including a signer ID, a timestamp signature.
In one embodiment, the master unit 60 is adapted to communicate with the server 64 to transmit the event record in real time to alert the user through a web application or a mobile application. The server 64 may store the event records received from the cargo conveyance vehicle 12 in a secure database or a distributed ledger.
In a preferred embodiment of the present invention, a flatbed truck for transporting one or more cargo items is provided as shown in FIG. 1. The flatbed truck includes four sides and a top that may be open. Using the video analysis techniques of embodiments of the present invention, the open area (top and four sides) of the flatbed trailer can be monitored during the entire transport between two security checkpoints.
A flatbed truck of an embodiment of the present invention may have a video analysis apparatus 10 that is capable of providing stable full coverage of all open areas for intrusion detection that is securely mounted on the truck. The video analysis device 10 comprises a plurality of cameras attached to the main unit 60 to perform on-board real-time intrusion detection and to pass through intrusion events. The video clips are recorded by the video analysis device 10 and sent to the monitoring server for verification by multiple authorized parties. Server 64 may then finalize the non-intrusive approval of the airport's air cargo approach and issue it to the flat-bed truck.
The video analysis apparatus 10 of an embodiment of the present invention is adapted to provide full viewing coverage of all five open sides of the flatbed truck 10, including two front-top camera units, each covering 3 sides. The two front top cameras may include a left front top camera unit: left, front and top sides, and a right front top camera unit covering the right, front and top sides. There is also a rear bottom camera unit covering the rear side.
When the vehicle is stowed, the bottom of the mirror should not protrude more than ten centimeters above the total width of the vehicle when it is less than two meters above the road surface. When the vehicle is stowed, the bottom of the mirror should not protrude more than ten centimeters above the total width of the vehicle when it is less than two meters above the road surface.
The present invention may also be mounted on marine cargo transport vehicles such as container ships and cargo carriers.
Advantageously, systems according to embodiments of the present invention may be used for cargo transportation, including but not limited to rigid trucks, semi-trailers, articulated trucks, and the like. The end product of the present invention can use video surveillance for cargo transportation safety.
It will also be appreciated that any suitable computing system architecture may be utilized where the method and system of the present invention are implemented, in whole or in part, by a computing system. This would include stand-alone computers, network computers and dedicated hardware devices. Where the terms "computing system" and "computing device" are used, these terms are intended to cover any suitable arrangement of computer hardware capable of implementing the described functionality.
It will be appreciated by persons skilled in the art that numerous variations and/or modifications may be made to the invention as shown in the specific embodiments without departing from the spirit or scope of the invention as broadly described. The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.
Any reference to prior art contained herein is not to be taken as an admission that the information is common general knowledge, unless otherwise indicated.

Claims (26)

1. A video-based security system for providing viewing and control of pay/view to a cargo conveyance vehicle, comprising:
a camera cradle disposed outside of the cargo storage area;
a camera system attached to the camera support for covering a top plane, a front plane, a left plane, a right plane, and a rear plane of a cargo area;
a main unit connected to the camera system to record event recordings.
2. The video-based security system of claim 2, wherein the vehicle comprises a trailer vehicle towing a trailer, wherein the trailer has a cargo area adapted to transport cargo.
3. The video-based security system of claim 2, wherein the camera cradle comprises: a left exhaust duct on a left side of the trailer for attaching a first camera of the camera system; and a right exhaust duct on a right side of the trailer for attaching a second camera of the camera system.
4. The video-based security system of claim 2, wherein the camera cradle comprises: a left pole on a left side of the vehicle for attaching a first camera of the camera system; and a right pole on a right side of the vehicle for attaching a second camera of the camera system.
5. The video-based security system of claim 4, wherein the left and right poles are fixed to a front end of the trailer.
6. The video-based security system of claims 4 and 5, wherein the left and right poles are configured to provide a front gap distance of 10cm to 50cm from the cargo area.
7. The video-based security system of claim 6, wherein each of the left and right poles has an adjustable height.
8. The video-based security system of claim 4, wherein each of the left and right rods has an arm extending horizontally from a top end of the rod, wherein the arm is 10cm to 50cm in length.
9. The video-based security system of claim 8, wherein the arm has an adjustable length.
10. The video-based security system of claim 4, wherein each of the left and right levers is rotatable.
11. The video-based security system of claim 2, wherein the camera bracket comprises an extension for attaching a third camera of the camera system to a rear side of the vehicle.
12. The video-based security system of claim 2, wherein the camera system comprises one or more cameras having lenses with a view angle between 110 and 220 degrees.
13. The video-based security system of claim 2, wherein the camera system comprises one or more cameras adapted to capture images covering a field of view of 160 to 360 degrees.
14. The video-based security system of claim 2, wherein the camera system comprises a camera having a plurality of sensors.
15. The video-based security system of claim 2, wherein the camera system communicates with a master unit for processing images captured by the camera system, wherein the master unit is adapted to communicate with a server.
16. The video-based security system of claim 2, wherein the master unit and the server are adapted to perform a process comprising:
defining a safe area for an image captured by a camera system;
detecting any object protruding into, outside or within the secure area;
recording event records on a storage device of the master unit.
17. The video-based security system of claim 16, wherein the security zone is defined by identifying cargo areas on a top plane, a front plane, a left plane, a right plane, and a rear plane.
18. The video-based security system of claim 1, wherein each event records a security record comprising one or more attributes of a truck ID, a time tag, a duration, a geospatial tag, continuous time-tagged geospatial data, a video clip, and an event description.
19. The video-based security system of claim 1, wherein the master unit is adapted to trigger a light indicator for any detected intrusion triggers.
20. The video-based security system of claim 1, wherein the master unit is adapted to communicate with a presence server to view all event records stored in the master unit to determine whether to issue a no-intrusion license to the master unit including a signer ID, a signature time stamp.
21. The video-based security system according to claim 1, wherein said master unit is adapted to communicate with a server to transmit event records in real time to alert a user through a web application or a mobile application.
22. The video-based security system according to claim 21, wherein said master unit is adapted to communicate with a server to transmit video clips in real time to check and verify authenticity of an intrusion.
23. The video-based security system of claim 16, wherein the step of detecting any object protruding into, outside or within the secure area comprises the steps of:
storing a time series of images captured by the camera system;
performing statistical change detection to determine a change region;
performing spatial refinement to determine an object of interest; and
one or more metadata of the object of interest is calculated.
24. The video-based security system of claim 1, wherein the camera system is adapted to perform image stabilization via optical or electronic image stabilization.
25. The video-based security system of claim 1, wherein the camera system comprises one or more image sensors containing two or more types of pixels having different photosensitivities to generate a single image by combining images captured by the image sensors having different exposure times.
26. The video-based security system of claim 1, wherein the camera system is adapted to filter background environment prior to processing images captured by the camera system.
CN202011034443.4A 2020-03-19 2020-09-27 System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions Pending CN113497916A (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US16/823,579 US11410513B2 (en) 2020-03-19 2020-03-19 System and device for video-based vehicle surrounding awareness monitoring for air cargo transit security under all-weather driving conditions
US16/823,579 2020-03-19
HK32020004572 2020-03-19
HK32020004572.4 2020-03-19

Publications (1)

Publication Number Publication Date
CN113497916A true CN113497916A (en) 2021-10-12

Family

ID=77998199

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011034443.4A Pending CN113497916A (en) 2020-03-19 2020-09-27 System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions

Country Status (1)

Country Link
CN (1) CN113497916A (en)

Similar Documents

Publication Publication Date Title
US20040233284A1 (en) Apparatus and methods for providing surveillance data concerning a scene of interest to a user located at a remote location
US8836784B2 (en) Automotive imaging system for recording exception events
US8379924B2 (en) Real time environment model generation system
AU2015217518C1 (en) Imaging system and method
US10796510B2 (en) Apparatus, systems and methods for monitoring vehicular activity
US7812711B2 (en) Passenger vehicle safety and monitoring system and method
US9852636B2 (en) Traffic event data source identification, data collection and data storage
CN104442924A (en) All-weather high speed railway vehicle-mounted obstacle detection system and method
SE1650327A1 (en) Method and system for theft detection in a vehicle
US20180086307A1 (en) Device and method for monitoring a vehicle, particularly for the management of loss events
WO2019143754A1 (en) Devices, systems, and methods for under vehicle surveillance
US11770677B1 (en) Enhanced safety systems and method for transportation vehicles
US11410513B2 (en) System and device for video-based vehicle surrounding awareness monitoring for air cargo transit security under all-weather driving conditions
KR101205365B1 (en) System and method for acquiring information of passenger for the car
CN201111178Y (en) Vehicle mounted intelligent monitoring apparatus
US20150199300A1 (en) Jolt and Jar Recorder System
EP2676252A1 (en) Method and system for intrusion monitoring of a motor vehicle
WO2013032371A1 (en) Vehicle security system and method for using the same
CN113497916A (en) System and apparatus for video-based vehicle awareness monitoring for air cargo transport security under all-weather driving conditions
US20200320309A1 (en) Camera system to detect unusual activities
CN115862167A (en) Gateway control method and device, computer equipment and storage medium
US20090066792A1 (en) Automotive, cargo, and homeland security camera system
CN206171304U (en) Driving auxiliary system is got a bird's eye view to panorama
RU2748780C1 (en) Method and system for detecting alarm events occurring on vehicle during cargo transportation in real time
AU2021102368A4 (en) A Sensor Device for Vehicles

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination