WO2019080055A1 - 运输车辆的车厢状态检测方法、车厢状态检测装置及终端 - Google Patents

运输车辆的车厢状态检测方法、车厢状态检测装置及终端

Info

Publication number
WO2019080055A1
WO2019080055A1 PCT/CN2017/107855 CN2017107855W WO2019080055A1 WO 2019080055 A1 WO2019080055 A1 WO 2019080055A1 CN 2017107855 W CN2017107855 W CN 2017107855W WO 2019080055 A1 WO2019080055 A1 WO 2019080055A1
Authority
WO
WIPO (PCT)
Prior art keywords
state
image
vehicle
compartment
detection result
Prior art date
Application number
PCT/CN2017/107855
Other languages
English (en)
French (fr)
Inventor
高毅鹏
马志伟
黄凯明
Original Assignee
深圳市锐明技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市锐明技术股份有限公司 filed Critical 深圳市锐明技术股份有限公司
Priority to CN201780001336.1A priority Critical patent/CN109416250B/zh
Priority to PCT/CN2017/107855 priority patent/WO2019080055A1/zh
Publication of WO2019080055A1 publication Critical patent/WO2019080055A1/zh

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C11/00Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
    • G01C11/02Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/08Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups for incorporation in vehicles
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Definitions

  • the present application relates to the field of transportation vehicles, and in particular, to a cabin state detection method for a transportation vehicle, a cabin state detecting device, a terminal, and a computer readable storage medium.
  • one way is to visually check the state of the transportation vehicle by the driver or the transportation vehicle management personnel, which lacks an objective detection basis and relies heavily on the driver or the transportation vehicle management personnel. Consciousness and responsibility.
  • Another way is to sense the contact state of the top cover or the cover of the transport vehicle with the baffle around the compartment through a contact sensor mounted on the baffle around the compartment to determine the snoring or closing state of the compartment, however, In practical applications, it is found that due to the working characteristics of the transport vehicle, the frequency of the top cover or the cover of the car is relatively high, and the damage rate of the contact sensor is very high, which often needs to be replaced, which causes the transport vehicle to consume more in the state detection of the car. Maintenance costs.
  • the present application provides a cabin state detecting method for a transportation vehicle, a cabin state detecting device, a terminal, and a computer readable storage medium, which can reduce the maintenance of the transport vehicle in the cabin state detection.
  • a first aspect of the embodiments of the present application provides a vehicle compartment state detecting method for a transportation vehicle, where the transportation vehicle is provided with an image capturing module for capturing an image of the entire vehicle compartment of the transportation vehicle;
  • the above car state detection method includes:
  • a second aspect of the embodiments of the present application provides a cabin state detecting device for a transport vehicle, wherein the transport vehicle is provided with an image capturing module for capturing an image of a full view of the transport vehicle;
  • the above car state detecting device includes:
  • a triggering module configured to trigger the camera module to capture an image of a full view of the transportation vehicle
  • a first detecting module configured to detect, according to the photographed full-view image of the vehicle, whether the compartment of the transportation vehicle is in a closed state or a snoring state, and obtain a first detection result
  • a storage module configured to store the entire car image and the first detection result.
  • a third aspect of the embodiments of the present application provides a terminal, including a memory, a processor, and a computer program stored in the foregoing memory and operable on the processor, where the processor executes the computer program to implement the foregoing The steps of any of the compartment state detecting methods provided by the first aspect of the present application.
  • a fourth aspect of the embodiments of the present application provides a computer readable storage medium, where the computer readable storage medium stores a computer program, where the computer program is executed by a processor to implement the first aspect of the present application.
  • the step of any car state detection method is provided.
  • the present application provides a camera module for capturing an image of a full view of the transport vehicle of the transport vehicle on the transport vehicle.
  • a camera module for capturing an image of a full view of the transport vehicle of the transport vehicle on the transport vehicle.
  • Detecting whether the compartment of the transportation vehicle is in a closed state or a snoring state can automatically detect the state of the compartment, and the stored image of the cabin and the detection result can be used as an objective basis for managing the transportation vehicle, and is also convenient for the transportation vehicle management personnel to check and Supervise, thereby improving The objectivity and convenience of managing transportation vehicles.
  • the installation position of the camera module is generally kept at a certain distance from the car. Therefore, the camera module is not easily damaged by the car closing and loading and unloading, thereby reducing the maintenance of the camera module.
  • the cost reduces the maintenance cost of the transport vehicle in the state of the cabin.
  • FIG. 1 is a schematic flow chart of an embodiment of a method for detecting a state of a car of a transport vehicle provided by the present application;
  • FIG. 2 is a flow chart showing an implementation of an embodiment of step 102 in the embodiment of FIG. 1 provided by the present application;
  • FIG. 3 is a schematic structural diagram of an embodiment of a vehicle compartment state detecting device for a transportation vehicle provided by the present application
  • FIG. 4 is a schematic structural diagram of an embodiment of a terminal provided by the present application.
  • FIG. 1 is a schematic flow chart of an embodiment of a method for detecting a car state of a transportation vehicle provided by the present application, which is described in detail as follows:
  • a camera module for photographing a full view of the car of the above-described transport vehicle is provided on the transport vehicle, for example
  • the camera module is placed near the center of the top of the baffle on the side of the transport vehicle compartment near the cab
  • the camera module may further include a fill light module, natural light in the current environment. After the conditions are not good, the fill light module is activated to improve the lighting conditions, so that the camera module can capture a better overall image of the car.
  • a fill light module natural light in the current environment. After the conditions are not good, the fill light module is activated to improve the lighting conditions, so that the camera module can capture a better overall image of the car.
  • the car state detection method in the embodiment of the present application includes:
  • step 101 the camera module is triggered to capture a full image of the cabin of the transportation vehicle
  • the camera module is triggered to capture an image of the entire vehicle compartment of the transportation vehicle.
  • the camera module may be triggered to capture an image of the entire vehicle compartment of the transportation vehicle according to the driving state change of the vehicle, or may be connected to the camera module.
  • the terminal sends a trigger command to trigger the camera module to take a picture of the full view of the transport vehicle.
  • a person in the transportation vehicle management center wants to detect the state of the transportation vehicle A, and may send a shooting instruction through a terminal (server) located in the transportation vehicle management center, and trigger the camera module to photograph the transportation vehicle.
  • the car is full-view image, so that the car state of the transport vehicle A can be known according to the photographed car full-view image, wherein the terminal located in the transport vehicle management center and the camera module of the transport vehicle A can be connected through a wireless communication network.
  • step 101 is specifically:
  • the camera module is triggered to capture the cabin image of the transport vehicle.
  • the state of the cabin (whether the cover or the cover of the roof of the transport vehicle is closed) generally does not change, and the change of the state of the cabin generally occurs in the transport compartment.
  • Parking ⁇ therefore, when the transport vehicle changes from the parking state to the driving state ⁇ , the camera module is triggered to take a picture of the full view of the transport vehicle, thereby detecting the state of the transport vehicle, and when the state of the passenger compartment is snoring, a warning signal may be issued. The driver of the transport vehicle is reminded to perform the operation of parking and closing the car.
  • step 102 based on the photographed full-view image of the vehicle, it is detected whether the compartment of the transport vehicle is in a closed state or a snoring state, and a first detection result is obtained.
  • the image of the full view of the car photographed by the camera module is obtained in step 101, the image of the car is recognized, the texture features of the image of the car are extracted, and the extracted texture features are respectively associated with the preset car.
  • the texture features of the full-image image are matched to detect whether the carriage of the transport vehicle is in a closed state or a snoring state, wherein the preset vehicle full-view image includes the compartment of the transport vehicle being closed.
  • the overall image of the carriage, as well as the carriage of the transport vehicle is an image of the full view of the compartment.
  • the identification of the image of the vehicle interior in the embodiment of the present application may be only for the preset.
  • the area of interest is carried out.
  • the region of interest is a fixed position of the carriage of the transport vehicle on the overall image of the cabin captured by the camera module.
  • step 103 the car interior image and the first detection result are stored.
  • the image of the full view of the car photographed in step 101 and the first detection result obtained from the image of the full view of the car are stored, so as to be an objective basis for managing the transport vehicle.
  • the above-mentioned image of the entire car and the result of the detection may be stored on the terminal connected to the camera module, and the terminal may be an in-vehicle terminal disposed on the transportation vehicle, and the terminal may also be disposed in the transportation vehicle.
  • the server of the Management Center may be stored on the terminal connected to the camera module, and the terminal may be an in-vehicle terminal disposed on the transportation vehicle, and the terminal may also be disposed in the transportation vehicle.
  • the car state detection method of the embodiment of the present application further includes:
  • Step A If the first detection result is that the compartment of the transportation vehicle is in a snoring state, detecting whether the transportation vehicle is in a loaded state or a non-loading state based on the acquired vehicle full-view image, and obtaining a second detection result;
  • Step B storing the second detection result
  • Step C In the second detection result, the transportation vehicle is in a loading state, and a warning signal is output.
  • the transport vehicle since the transport vehicle is in a non-loaded state, that is, the empty state of the vehicle is not loaded, if the cover or the cover of the top of the compartment is not closed, the transport vehicle or the road surface is generally not Traffic has an adverse effect. Therefore, in the first detection result, the compartment of the transport vehicle is in a snoring state, and further detecting whether the transport vehicle is in a loaded state or a non-loaded state, a second detection result is obtained. Since the transport vehicle is in a state of being loaded, and the compartment is in a snoring state, it is prone to incidents such as spills and leaks.
  • the transport vehicle is in the state of loading, and a warning signal is output to remind the transportation.
  • the driver of the vehicle performs the operation of closing the top baffle or the shed of the car to avoid spillage of the transported goods (such as materials such as soil or sand).
  • detecting whether the transportation vehicle is in a loaded state or a non-loading state may be specifically implemented by the following steps:
  • Step A1 Extract a direction gradient histogram of two or more preset regions on the entire image of the car.
  • the above-mentioned directional gradient histogram can express the cabin shape information and the image texture change information of the overall image of the car, and the directional gradient histogram of the two or more preset regions can form a rich image feature set, which is beneficial to improve the overall image of the car. The accuracy of the test results.
  • the main detection area is a texture feature of an image corresponding to the upper surface of the floor of the transportation vehicle compartment.
  • the image texture feature corresponding to the upper surface of the compartment floor is the loaded goods.
  • the texture feature (the upper surface of the car floor is covered by the cargo)
  • the corresponding image texture feature on the upper surface of the car floor is the texture feature of the upper surface of the car floor.
  • residues may be present on the upper surface of the car's floor even in non-loaded conditions (such as residual sand or gravel). These residues are easy to interfere with the detection result. Therefore, the present embodiment uses the direction gradient histogram feature based on two or more preset regions as a reference for detection, which can avoid the interior of the vehicle compared to the detection method using specific pixel point features. Residue interference improves detection efficiency and detection accuracy.
  • the region of interest where the car is located on the image is determined.
  • two or more preset regions are preset. The recognition and detection of the state of the car is performed based on the image feature set of the two or more preset areas.
  • Step A2 combining the extracted direction gradient histograms of the preset regions to obtain a direction gradient histogram feature of the entire vehicle image
  • Step A3 input the directional gradient histogram feature into the second discriminant classifier, and output the second detection result by the second discriminating classifier.
  • the direction gradients of two or more preset regions on the image of the entire car are respectively extracted.
  • HOG HOG
  • the compartment image of the cargo state and the non-loading state can be better distinguished by identifying the local texture features of the image of the overall image of the compartment.
  • Car image The present application can improve the accuracy of the detection result according to the multi-scale local binary value of the plurality of preset positions by setting a plurality of preset positions on the entire image of the cabin, and obtains a better recognition effect in practical applications.
  • a high-dimensional feature is obtained by combining local features of each preset region, and the recognition of the car state based on the high-dimensional feature can have strong generalization performance for the difference of different vehicle installations.
  • the present application provides a camera module for capturing an image of the entire vehicle compartment of the transportation vehicle on the transportation vehicle, and on the other hand, capturing the vehicle interior image of the transportation vehicle by triggering the camera module, and acquiring the vehicle based on the above
  • the overall image of the carriage, detecting whether the compartment of the transport vehicle is in a closed state or a snoring state, can automatically detect the state of the compartment, and the stored image of the cabin and the detection result can be used as an objective basis for managing the transport vehicle, and is also convenient for transporting vehicle management personnel. Inspection and supervision
  • the installation position of the camera module is generally kept at a certain distance from the car. Therefore, the camera module is not easily damaged by the car closing and loading and unloading, thereby reducing the maintenance of the camera module. The cost, in turn, reduces the maintenance cost of the transport vehicle in the state of the cabin.
  • FIG. 2 is a schematic flowchart showing an implementation of step 102 in the embodiment of FIG. 1 provided by the present application, which is described in detail as follows:
  • step 201 multi-scale local binary features of pixel points of two or more preset positions on the car interior image are respectively extracted.
  • the cover of the car top or the cover of the car has a fixed texture feature in the closed image, and it is better to extract the local binary feature of the pixel points at the preset positions on the image of the car.
  • the binary feature forms a rich image feature set, which can improve the accuracy of the detection result of the entire image of the car.
  • the detection area on the current car interior image is actually an image inside the cabin, and when the cabin is in a closed state, the detection area on the current cabin image is actually the roof of the cabin. Or an image of the shed.
  • the texture characteristics of the image of the roof or awning of the car are generally constant or less variable for each transport vehicle. Therefore, in this embodiment, the corresponding local binary feature based on the pixel points of two or more preset positions is used as a reference for detecting, and the local binary feature of the position of the specific pixel on the image is identified, which can be better. Identification accuracy.
  • the region of interest where the car is located on the image is determined.
  • the region of interest is determined on the area of interest.
  • the image feature is extracted based on the pixel points of the two or more preset positions to identify and detect the state of the car.
  • step 202 the multi-scale local binary features of the extracted pixels are respectively subjected to histogram statistics, and combined to obtain high-dimensional local binary histogram features of the entire vehicle image;
  • step 203 the high-dimensional local binary histogram feature is input to the first discriminant classifier, and the first discriminant classifier outputs the first detection result.
  • the multi-scale local binary feature of the pixel points of the two or more preset positions on the current image of the entire car is respectively extracted, and specifically, the pixel point of a preset position is taken as a center, and the The pixel is a circular area of a plurality of different radii of the center of the circle. According to whether the pixel in the circular area is larger or smaller than the brightness of the central pixel, the pixels in the circular area are binarized to a circle of each radius. The region acts as a local binary feature of a scale. Thereby, multi-scale local binary features corresponding to the pixel points of the preset positions can be obtained.
  • the multi-scale local binary features are respectively subjected to histogram statistics, and the high-dimensional local binary histogram features of the current car full-view image are combined.
  • the high-dimensional local binary histogram feature is input to the first discriminant classifier, and the first discriminant classifier outputs a first detection result, that is, whether the current car of the transport vehicle is in a dozing state or a closed state.
  • the first discriminant classifier is trained based on a high-dimensional local binary histogram feature of the first sample image and the second sample image of the transport vehicle, wherein the first sample image is that the compartment of the transport vehicle is closed.
  • the second sample image is a sample image of the compartment of the transportation vehicle in a snoring state.
  • the present application sets a plurality of preset positions on the full image of the car, according to the multi-scale local two of the plurality of preset positions.
  • the value feature can better detect and determine the state of the car, and achieves a better recognition effect in practical applications.
  • the present application provides a camera module for capturing an image of the entire vehicle compartment of the transportation vehicle on the transportation vehicle, and on the other hand, capturing the vehicle interior image of the transportation vehicle by triggering the camera module, and acquiring the vehicle based on the above
  • the overall image of the carriage, detecting whether the compartment of the transport vehicle is in a closed state or a snoring state, can automatically detect the state of the compartment, and the stored image of the cabin and the detection result can be used as an objective basis for managing the transport vehicle, and is also convenient for transporting vehicle management personnel. Inspection and supervision
  • the installation position of the camera module is generally kept at a certain distance from the car. Therefore, the camera module is not easily damaged by the car closing and loading and unloading, thereby reducing the maintenance of the camera module. The cost, in turn, reduces the maintenance cost of the transport vehicle in the state of the cabin.
  • FIG. 3 is a schematic structural diagram of an embodiment of a cabin state detecting device for a transportation vehicle provided by the present application. For convenience of description, only parts related to the embodiment of the present application are shown, which are described in detail below. :
  • a cabin state detecting device 3 for a transportation vehicle includes a trigger module 31, a first detecting module 32, and a storage module 33.
  • a triggering module 31 configured to trigger the camera module to capture a full-size image of the transportation vehicle
  • the first detecting module 32 is configured to detect, according to the captured overall image of the vehicle, whether the compartment of the transportation vehicle is in a closed state or a snoring state, to obtain a first detection result;
  • the storage module 33 is configured to store the full view image of the car and the first detection result.
  • the foregoing car state detecting device further includes:
  • a second detecting module configured to: before the storage module stores the image of the entire car and the detection result, If the first detection result is that the compartment of the transportation vehicle is in a snoring state, detecting whether the transportation vehicle is in a loaded state or a non-loading state based on the acquired vehicle full-view image, and obtaining a second detection result;
  • the output module is configured to output an alert signal when the second detection result is that the transportation vehicle is in a loading state.
  • the storage module is further configured to store the second detection result.
  • the foregoing second detection module includes:
  • an extracting unit configured to respectively extract a direction gradient histogram of two or more preset regions on the entire image of the car
  • a combining unit configured to combine the direction gradient histograms of the preset regions extracted by the extracting unit to obtain a directional gradient histogram feature of the overall image of the car;
  • an output unit configured to input the directional gradient histogram feature obtained by the combining unit to the second discriminant classifier, and output the second detection result by the second discriminant classifier, wherein the second discriminant classifier is The training is based on the directional gradient histogram features of the sample images of the non-loaded state and the loaded state, respectively.
  • the present application provides a camera module for capturing an image of the entire vehicle compartment of the transportation vehicle on the transportation vehicle, and on the other hand, capturing the overall image of the transportation vehicle by triggering the camera module, and acquiring the image based on the above-mentioned vehicle
  • the overall image of the carriage detecting whether the compartment of the transport vehicle is in a closed state or a snoring state, can automatically detect the state of the compartment, and the stored image of the cabin and the detection result can be used as an objective basis for managing the transport vehicle, and is also convenient for transporting vehicle management personnel. Inspection and supervision
  • the installation position of the camera module is generally kept at a certain distance from the car. Therefore, the camera module is not easily damaged by the car closing and loading and unloading, thereby reducing the maintenance of the camera module. The cost, in turn, reduces the maintenance cost of the transport vehicle in the state of the cabin.
  • FIG. 4 is a schematic structural diagram of an embodiment of a terminal provided by the present application.
  • the terminal 4 of this embodiment includes: a processor 40, a memory 41, and a computer program 42 stored in the above-described memory 41 and operable on the processor 40.
  • the processor 40 executes the above-described computer program 42 to implement the steps in the above embodiments of the respective car state detecting methods, such as step 101 to step 1 shown in FIG. 03.
  • the processor 40 executes the above-described computer program 42 to implement the functions of the modules/units in the above-described respective device embodiments, such as the functions of the modules 31 to 33 shown in FIG.
  • the above computer program 42 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 41 and executed by the processor 40 to complete the present.
  • the one or more modules/units described above may be a series of computer program instruction segments capable of performing a particular function, the instruction segments being used to describe the execution of the computer program 42 described above in the terminal 4.
  • the computer program 42 may be divided into a trigger module, a first detection module, and a storage module, and the specific functions of each unit are as follows:
  • a triggering module configured to trigger the camera module to capture an image of a full view of the transportation vehicle
  • a first detecting module configured to detect, according to the photographed full-view image of the vehicle, whether the compartment of the transportation vehicle is in a closed state or a snoring state, and obtain a first detection result
  • a storage module configured to store the entire car image and the first detection result.
  • the terminal 4 may be a computing device such as a desktop computer, a notebook, a palmtop computer, or a cloud server.
  • the above terminals may include, but are not limited to, the processor 40 and the memory 41. It will be understood by those skilled in the art that FIG. 4 is merely an example of the terminal 4 and does not constitute a limitation of the terminal 4, and may include more or less components than those illustrated, or some components may be combined, or different components, such as
  • the above terminal may also include an input/output device, a network access device, a bus, and the like.
  • the processor 40 may be a central processing unit (CPU), or may be another general-purpose processor, a digital signal processor (DSP), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), field programmable gate array
  • CPU central processing unit
  • DSP digital signal processor
  • ASIC Application Specific Integrated Circuit
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 41 may be an internal storage unit of the terminal 4, such as a hard disk or a memory of the terminal 4.
  • the memory 41 may also be an external storage device of the terminal 4, such as a plug-in hard disk provided on the terminal 4, a smart memory card (SMC), a Secure Digital (SD) card, and a flash memory card ( Flash Card) and so on.
  • the above-mentioned memory 41 may also include both the internal storage unit of the above terminal 4 and an external storage device.
  • the above memory 41 is used to store the above computer program Order and other programs and data required by the above terminal.
  • the above memory 41 can also be used to temporarily store data that has been output or is about to be output.
  • each functional unit and module described above is exemplified. In practical applications, the above functions may be assigned differently according to needs.
  • the functional unit and the module are completed, that is, the internal structure of the above device is divided into different functional units or modules to complete all or part of the functions described above.
  • Each functional unit and module in the embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit, and the integrated unit may be implemented by hardware.
  • Formal implementation can also be implemented in the form of software functional units.
  • the disclosed apparatus/terminal and method may be implemented in other manners.
  • the device/terminal embodiment described above is merely illustrative.
  • the division of the above module or unit is only a logical function division, and the actual implementation may have another division manner, such as multiple units or components. It can be combined or integrated into another system, or some features can be ignored, or not executed.
  • the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in electrical, mechanical or other form.
  • the unit described above as a separate component may or may not be physically distributed.
  • the component displayed as a unit may or may not be a physical unit, that is, may be located in one place, or may be located in one place. Distributed to multiple network elements. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the above-described integrated modules/units if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the present application implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware.
  • the computer program may be stored in a computer readable storage medium, the computer program After being executed by the processor, the steps of the various method embodiments described above can be implemented.
  • the computer program includes computer program code, and the computer program code may be in the form of a source code, an object code, an executable file, or some intermediate form.
  • the computer readable medium may include: any entity or device capable of carrying the above computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-Only Memory (ROM), a random Access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media.
  • ROM Read-Only Memory
  • RAM Random Access Memory
  • electrical carrier signals telecommunications signals
  • software distribution media software distribution media. It should be noted that the content of the above computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not It includes electrical carrier signals and telecommunication signals.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Traffic Control Systems (AREA)

Abstract

一种运输车辆的车厢状态检测方法、车厢状态检测装置、终端及计算机可读存储介质,所述运输车辆上设置有用于拍摄所述运输车辆的车厢全貌图像的摄像模块,所述车厢状态检测方法包括:触发所述摄像模块拍摄所述运输车辆的车厢全貌图像;基于所述拍摄的车厢全貌图像,检测所述运输车辆的车厢是闭合状态还是打开状态,得到第一检测结果;存储所述车厢全貌图像及所述第一检测结果。本申请能够降低运输车辆在车厢状态检测上的维护成本。

Description

运输车辆的车厢状态检测方法、 车厢状态检测装置及终 端
技术领域
[0001] 本申请属于运输车辆技术领域, 尤其涉及一种运输车辆的车厢状态检测方法、 车厢状态检测装置、 终端及计算机可读存储介质。
背景技术
[0002] 目前, 许多城市中, 各种工程建设方兴未艾, 例如, 兴建地铁、 立交桥等交通 设施的工程建设项目。 在这些工程的实施过程中, 经常需要通过运输车辆运送 大量澄土或砂石等材料, 这些运输车辆的车厢顶部一般都配备有盖板或罩棚等 防护设施, 在运输车辆上路行驶吋, 若未将车厢顶部的盖板或罩棚闭合, 即车 厢为打幵状态, 容易使澄土或砂石抛洒泄漏在城市的路面上, 既污染环境, 又 影响正常的城市交通。 因此, 需要检测运输车辆的车厢状态, 以更好的实现对 运输车辆的管理。
[0003] 现有技术中, 一种方式是通过司机或运输车辆管理人员以目测的方式现场检査 运输车辆的车厢状态, 既缺乏客观的检测依据, 又严重依赖于司机或运输车辆 管理人员的自觉性和责任心。 另一种方式是通过安装在车厢四周挡板上的接触 感应器, 感应所述运输车辆车厢顶部盖板或罩棚与车厢四周挡板的接触状态, 来判断车厢的打幵或闭合状态, 然而, 实际应用中发现, 由于运输车辆的工作 特点, 车厢顶部盖板或罩棚的幵关频次较高, 接触感应器的损坏率很高, 经常 需要更换, 导致运输车辆在车厢状态检测上需耗费较多的维护成本。
技术问题
[0004] 有鉴于此, 本申请提供一种运输车辆的车厢状态检测方法、 车厢状态检测装置 、 终端及计算机可读存储介质, 能够降低运输车辆在车厢状态检测上的维护成 技术解决方案
[0005] 本申请实施例的第一方面, 提供一种运输车辆的车厢状态检测方法, 该运输车 辆上设置有用于拍摄上述运输车辆的车厢全貌图像的摄像模块;
[0006] 上述车厢状态检测方法包括:
[0007] 触发上述摄像模块拍摄上述运输车辆的车厢全貌图像;
[0008] 基于上述拍摄的车厢全貌图像, 检测上述运输车辆的车厢是闭合状态还是打幵 状态, 得到第一检测结果;
[0009] 存储上述车厢全貌图像及上述第一检测结果。
[0010] 本申请实施例的第二方面, 提供一种运输车辆的车厢状态检测装置, 上述运输 车辆上设置有用于拍摄上述运输车辆的车厢全貌图像的摄像模块;
[0011] 上述车厢状态检测装置包括:
[0012] 触发模块, 用于触发上述摄像模块拍摄上述运输车辆的车厢全貌图像;
[0013] 第一检测模块, 用于基于上述拍摄的车厢全貌图像, 检测上述运输车辆的车厢 是闭合状态还是打幵状态, 得到第一检测结果;
[0014] 存储模块, 用于存储上述车厢全貌图像及上述第一检测结果。
[0015] 本申请实施例的第三方面, 提供一种终端, 包括存储器、 处理器以及存储在上 述存储器中并可在上述处理器上运行的计算机程序, 上述处理器执行上述计算 机程序吋实现上述本申请的第一方面提供的任一项车厢状态检测方法的步骤。
[0016] 本申请实施例的第四方面, 提供一种计算机可读存储介质, 上述计算机可读存 储介质存储有计算机程序, 上述计算机程序被处理器执行吋实现上述本申请的 第一方面提供的任一项车厢状态检测方法的步骤。
发明的有益效果
有益效果
[0017] 本申请在运输车辆上设置用于拍摄上述运输车辆的车厢全貌图像的摄像模块, 一方面, 通过触发上述摄像模块拍摄上述运输车辆的车厢全貌图像, 并基于上 述获取的车厢全貌图像, 检测上述运输车辆的车厢为闭合状态还是打幵状态, 能够实现车厢状态的自动检测, 而存储的车厢全貌图像及检测结果可以作为管 理运输车辆的客观依据, 也便于运输车辆管理人员进行检査和监督, 从而提高 了管理运输车辆的客观性和便捷性。 另一方面, 由于要拍摄车厢全貌图像, 摄 像模块的安装位置一般会距车厢保持一定的距离, 因此, 摄像模块不易受到车 厢幵闭及进行装卸的影响而损坏, 从而可降低对摄像模块的维修成本, 进而降 低运输车辆在车厢状态检测上的维护成本。
对附图的简要说明
附图说明
[0018] 为了更清楚地说明本申请实施例中的技术方案, 下面将对实施例或现有技术描 述中所需要使用的附图作简单地介绍, 显而易见地, 下面描述中的附图仅仅是 本申请的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性劳动性 的前提下, 还可以根据这些附图获得其他的附图。
[0019] 图 1是本申请提供的运输车辆的车厢状态检测方法一个实施例流程示意图; [0020] 图 2是本申请提供的图 1实施例中步骤 102的一个实施例实现流程示意图;
[0021] 图 3是本申请提供的运输车辆的车厢状态检测装置的一个实施例结构示意图; [0022] 图 4是本申请提供的终端的一个实施例结构示意图。
本发明的实施方式
[0023] 以下描述中, 为了说明而不是为了限定, 提出了诸如特定系统结构、 技术之类 的具体细节, 以便透彻理解本申请实施例。 然而, 本领域的技术人员应当清楚 , 在没有这些具体细节的其它实施例中也可以实现本申请。 在其它情况中, 省 略对众所周知的系统、 装置、 电路以及方法的详细说明, 以免不必要的细节妨 碍本申请的描述。
[0024] 为了说明本申请上述的技术方案, 下面通过具体实施例来进行说明。
[0025] 实施例一: 图 1示出了本申请提供的运输车辆的车厢状态检测方法一个实施例 流程示意图, 详述如下:
[0026] 在运输车辆上设置有用于拍摄上述运输车辆的车厢全貌图像的摄像模块, 例如
, 将摄像模块设置在运输车辆车厢靠近驾驶室一侧的挡板顶部中央附近的位置
[0027] 作为进一步的实施例, 该摄像模块还可以包括补光模块, 在当前环境的自然光 照条件不佳吋, 触发补光模块工作, 以改善光照条件, 使摄像模块拍摄到较佳 的车厢全貌图像。
[0028] 本申请实施例中的车厢状态检测方法包括:
[0029] 在步骤 101中, 触发摄像模块拍摄运输车辆的车厢全貌图像;
[0030] 在本申请实施例中, 触发摄像模块拍摄运输车辆的车厢全貌图像, 具体的, 可 以根据车辆的行驶状态变化触发摄像模块拍摄运输车辆的车厢全貌图像, 也可 以通过与摄像模块连接的终端发送触发指令触发摄像模块拍摄运输车辆的车厢 全貌图像。
[0031] 在一种应用场景下, 运输车辆管理中心的人员想要检测运输车辆 A的车厢状态 , 可以通过位于运输车辆管理中心的终端 (服务器) 下发拍摄指令, 触发摄像 模块拍摄运输车辆的车厢全貌图像, 从而可以根据拍摄的车厢全貌图像了解运 输车辆 A的车厢状态, 其中, 位于运输车辆管理中心的终端与运输车辆 A的摄像 模块可以通过无线通信网络连接。
[0032] 可选的, 作为进一步的实施例, 上述步骤 101具体为:
[0033] 在运输车辆由停车状态变为行驶状态吋, 触发摄像模块拍摄运输车辆的车厢全 貌图像。
[0034] 在本实施例中, 由于运输车辆在行驶吋, 其车厢状态 (运输车辆的车厢顶部的 盖板或罩棚是否闭合) 一般是不会发生变化的, 车厢状态的变化一般发生在运 输车厢停车吋, 因此, 在运输车辆由停车状态变为行驶状态吋, 触发摄像模块 拍摄运输车辆的车厢全貌图像, 从而检测运输车辆的车厢状态, 在车厢状态为 打幵状态吋, 可以发出提示信号以提醒该运输车辆的司机进行停车和闭合车厢 的操作。
[0035] 在步骤 102中, 基于上述拍摄的车厢全貌图像, 检测上述运输车辆的车厢是闭 合状态还是打幵状态, 得到第一检测结果。
[0036] 在本申请实施例中, 获取在步骤 101中摄像模块拍摄的车厢全貌图像, 对所述 车厢全貌图像进行识别, 提取车厢全貌图像的纹理特征, 将提取的纹理特征分 别与预设车厢全貌图像的纹理特征进行匹配, 以检测运输车辆的车厢是闭合状 态还是打幵状态, 其中, 预设车厢全貌图像包括运输车辆的车厢是闭合状态的 车厢全貌图像, 以及运输车辆的车厢是打幵状态的车厢全貌图像。
[0037] 需要说明的是, 虽然通过人眼也可以直接看出车厢全貌图像上的车厢状态, 但 是, 一方面, 由于人眼观看存在一定的主观性和局限性, 没有客观的判定标准 , 难以得到客观的判定结果; 另一方面, 车辆运输管理中心的人员监管着相当 数量的运输车辆, 通过人眼进行观看不够便捷, 效率不高; 因此, 本申请通过 对车厢全貌图像的纹理特征进行检测和识别, 能够方便快捷并且客观高效的判 定车厢状态。
[0038] 需要说明的是, 考虑到一台运输车辆上摄像模块安装好后, 其拍摄场景是不变 的, 因此, 本申请实施例中的对车厢全貌图像的识别可以仅针对预先设定的感 兴趣区域进行。 该感兴趣区域即为运输车辆的车厢在上述摄像模块拍摄的车厢 全貌图像上的固定位置。
[0039] 在步骤 103中, 存储上述车厢全貌图像及上述第一检测结果。
[0040] 在本申请实施例中, 将步骤 101中拍摄的车厢全貌图像及根据该车厢全貌图像 得到的第一检测结果进行存储, 从而可以作为管理运输车辆的客观依据。
[0041] 需要说明的是, 可以将上述车厢全貌图像及检测的结果存储在与摄像模块连接 的终端上, 该终端可以是设置在运输车辆上的车载终端, 该终端也可以是设置 在运输车辆管理中心的服务器。
[0042] 可选的, 在步骤 102之后, 本申请实施例的车厢状态检测方法还包括:
[0043] 步骤 A、 若第一检测结果为运输车辆的车厢是打幵状态, 则基于获取的车厢全 貌图像, 检测运输车辆是载货状态还是非载货状态, 得到第二检测结果;
[0044] 步骤 B、 存储所述第二检测结果;
[0045] 步骤 C、 在第二检测结果为运输车辆是载货状态吋, 输出警示信号。
[0046] 在本申请实施例中, 由于在运输车辆为非载货状态吋, 即车厢未装载货物的空 车状态, 若车厢顶部的盖板或罩棚未闭合, 一般不会对运输车辆或路面交通产 生不良影响。 因此, 在第一检测结果为运输车辆的车厢是打幵状态吋, 进一步 的检测运输车辆是载货状态还是非载货状态, 得到第二检测结果。 由于只有在 运输车辆为载货状态, 且, 车厢为打幵状态吋, 才容易发生抛洒泄露等事件。 因此, 在第二检测结果为运输车辆是载货状态吋, 输出警示信号, 以提醒运输 车辆的司机进行闭合车厢顶部挡板或罩棚的操作, 避免运输的货物 (例如澄土 或砂石等材料) 发生抛洒泄漏。
[0047] 可选的, 作为进一步的实施例, 上述步骤 A中, 检测运输车辆为载货状态还是 非载货状态, 具体可以通过以下步骤实现:
[0048] 步骤 Al、 分别提取上述车厢全貌图像上两个以上预设区域的方向梯度直方图。
[0049] 上述方向梯度直方图可以表达车厢全貌图像的车厢外形信息及图像纹理变化信 息, 通过两个以上预设区域的方向梯度直方图能够形成丰富的图像特征集, 有 利于提高对车厢全貌图像的检测结果的准确性。
[0050] 需要说明的是, 本实施例主要检测区域为运输车辆车厢的底板上表面对应的图 像的纹理特征, 例如, 在载货状态吋, 车厢底板上表面对应的图像纹理特征为 所装载货物的纹理特征 (车厢底板上表面被货物所覆盖) , 在非载货状态吋, 车厢底板上表面对应的图像纹理特征为车厢底板上表面本身的纹理特征。 在实 际应用中, 即便在非载货状态, 车厢底板上表面可能也会存在残留物 (例如残 留的砂石或澄土) 。 这些残留物容易对检测结果造成干扰, 因此, 本实施例采 用了基于两个以上的预设区域的方向梯度直方图特征为参考进行检测, 相比采 用具体像素点特征的检测方法能够避免车厢内残留物的干扰, 提高检测效率和 检测准确性。
[0051] 需要说明的是, 根据预先拍摄的车厢全貌图像 (样本图像, 包括运输车辆为载 货状态吋的样本图像和非载货状态吋的样本图像) , 确定图像上车厢所在的感 兴趣区域, 在所述感兴趣区域上, 预先设置两个以上的预设区域。 基于所述两 个以上的预设区域的图像特征集进行车厢状态的识别和检测。
[0052] 步骤 A2、 将上述提取的各预设区域的方向梯度直方图进行组合, 得到上述车厢 全貌图像的方向梯度直方图特征;
[0053] 步骤 A3、 将上述方向梯度直方图特征输入第二判别分类器, 由上述第二判别分 类器输出上述第二检测结果。
[0054] 本申请实施例中, 分别提取上述车厢全貌图像上两个以上预设区域的方向梯度
Figure imgf000008_0001
HOG) 特征。 将提取的各预设区域的 HOG特征进行组合, 形成一个高维特征, 即当前车厢全貌图像的方向梯度直方图特征, 将当前车厢全貌图像的方向梯度 直方图特征输入第二判别分类器, 得到第二判别分类器输出的第二检测结果, 即车辆为载货状态还是非载货状态。 其中, 上述第二判别分类器为基于上述运 输车辆分别为非载货状态和载货状态的样本图像的方向梯度直方图特征训练得 到。
[0055] 需要说明的是, 在运输车辆为非载货状态吋, 由于车厢为空车厢, 通过识别车 厢全貌图像的局部纹理特征可以较好的区分载货状态的车厢图像和非载货状态 的车厢图像。 本申请通过在车厢全貌图像上设置多个预设位置, 根据该多个预 设位置的多尺度局部二值特征, 能够提高检测结果的准确性, 并且在实际应用 中取得了较好的识别效果。 另外, 本申请实施例中通过将各预设区域的局部特 征进行组合, 得到一个高维特征, 基于高维特征进行车厢状态的识别能够对不 同车辆安装的差异性具有较强的泛化性能。
[0056] 由上可知, 本申请在运输车辆上设置用于拍摄上述运输车辆的车厢全貌图像的 摄像模块, 一方面, 通过触发上述摄像模块拍摄上述运输车辆的车厢全貌图像 , 并基于上述获取的车厢全貌图像, 检测上述运输车辆的车厢为闭合状态还是 打幵状态, 能够实现车厢状态的自动检测, 而存储的车厢全貌图像及检测结果 可以作为管理运输车辆的客观依据, 也便于运输车辆管理人员进行检査和监督
, 从而提高了管理运输车辆的客观性和便捷性。 另一方面, 由于要拍摄车厢全 貌图像, 摄像模块的安装位置一般会距车厢保持一定的距离, 因此, 摄像模块 不易受到车厢幵闭及进行装卸的影响而损坏, 从而可降低对摄像模块的维修成 本, 进而降低运输车辆在车厢状态检测上的维护成本。
[0057] 实施例二: 图 2示出了本申请提供的图 1实施例中步骤 102的一个实施例实现流 程示意图, 详述如下:
[0058] 在步骤 201中, 分别提取车厢全貌图像上两个以上预设位置的像素点的多尺度 局部二值特征。
[0059] 在实际应用中, 车厢顶部的盖板或罩棚在闭合吋的图像具有固定不变的纹理特 征, 通过提取对车厢全貌图像上各预设位置的像素点的局部二值特征可以较好 的反应该车厢全貌图像的纹理变化, 而各预设位置的像素点对应的多尺度局部 二值特征形成了丰富的图像特征集, 能够提高对车厢全貌图像的检测结果的准 确性。
[0060] 需要说明的是, 在车厢为打幵状态吋, 当前车厢全貌图像上的检测区域实际为 车厢内部的图像, 在车厢为闭合状态吋, 当前车厢全貌图像上的检测区域实际 为车厢顶板或罩棚的图像。 在实际应用中, 对于每一辆运输车辆, 车厢顶板或 罩棚的图像的纹理特征一般是不变的或者变化较小的。 因此, 本实施例采用了 基于两个以上的预设位置的像素点的相应的局部二值特征为参考进行检测, 针 对图像上具体像素点所在位置的局部二值特征进行识别, 可以得到较好的识别 准确性。
[0061] 需要说明的是, 根据预先拍摄的车厢全貌图像 (样本图像, 包括车厢为打幵状 态吋的样本图像和闭合状态吋的样本图像) , 确定图像上车厢所在的感兴趣区 域, 在所述感兴趣区域上, 设置两个以上的预设位置。 基于所述两个以上的预 设位置的像素点提取图像特征进行车厢状态的识别和检测。
[0062] 在步骤 202中, 将上述提取的各像素点的多尺度局部二值特征分别进行直方图 统计, 并组合得到上述车厢全貌图像的高维局部二值直方图特征;
[0063] 在步骤 203中, 将上述高维局部二值直方图特征输入第一判别分类器, 由上述 第一判别分类器输出第一检测结果。
[0064] 本申请实施例中, 分别提取当前车厢全貌图像上两个以上预设位置的像素点的 多尺度局部二值特征, 具体的, 以一个预设位置的像素点为圆心, 确定以该像 素点为圆心的多个不同半径的圆形区域, 根据圆形区域内的像素比圆心像素的 亮度大还是小, 将所述圆形区域内的像素二值化, 以每一个半径的圆形区域作 为一个尺度的局部二值特征。 从而可以得到对应于所述各预设位置的像素点的 多尺度局部二值特征。 将所述多尺度局部二值特征分别进行直方图统计, 并组 合得到当前车厢全貌图像的高维局部二值直方图特征。 将上述高维局部二值直 方图特征输入第一判别分类器, 由上述第一判别分类器输出第一检测结果, 即 运输车辆的当前车厢为打幵状态还是闭合状态。 其中, 上述第一判别分类器为 基于上述运输车辆的第一样本图像和第二样本图像的高维局部二值直方图特征 训练得到, 上述第一样本图像为上述运输车辆的车厢为闭合状态吋的样本图像 , 上述第二样本图像为上述运输车辆的车厢为打幵状态吋的样本图像。
[0065] 需要说明的是, 由于车厢顶部挡板或罩棚具有固定不变的纹理特征, 本申请通 过在车厢全貌图像上设置多个预设位置, 根据该多个预设位置的多尺度局部二 值特征, 可以更好的检测并确定车厢状态, 并且在实际应用中取得了较好的识 别效果。
[0066] 由上可知, 本申请在运输车辆上设置用于拍摄上述运输车辆的车厢全貌图像的 摄像模块, 一方面, 通过触发上述摄像模块拍摄上述运输车辆的车厢全貌图像 , 并基于上述获取的车厢全貌图像, 检测上述运输车辆的车厢为闭合状态还是 打幵状态, 能够实现车厢状态的自动检测, 而存储的车厢全貌图像及检测结果 可以作为管理运输车辆的客观依据, 也便于运输车辆管理人员进行检査和监督
, 从而提高了管理运输车辆的客观性和便捷性。 另一方面, 由于要拍摄车厢全 貌图像, 摄像模块的安装位置一般会距车厢保持一定的距离, 因此, 摄像模块 不易受到车厢幵闭及进行装卸的影响而损坏, 从而可降低对摄像模块的维修成 本, 进而降低运输车辆在车厢状态检测上的维护成本。
[0067] 应理解, 上述实施例中各步骤的序号的大小并不意味着执行顺序的先后, 各过 程的执行顺序应以其功能和内在逻辑确定, 而不应对本申请实施例的实施过程 构成任何限定。
[0068] 实施例三: 图 3示出了本申请提供的运输车辆的车厢状态检测装置的一个实施 例结构示意图, 为了便于说明, 仅示出了与本申请实施例相关的部分, 详述如 下:
[0069] 如图 3所示, 一种运输车辆的车厢状态检测装置 3, 包括触发模块 31、 第一检测 模块 32和存储模块 33。
[0070] 触发模块 31, 用于触发摄像模块拍摄运输车辆的车厢全貌图像;
[0071] 第一检测模块 32, 用于基于拍摄的车厢全貌图像, 检测运输车辆的车厢是闭合 状态还是打幵状态, 得到第一检测结果;
[0072] 存储模块 33, 用于上述存储车厢全貌图像及上述第一检测结果。
[0073] 可选的, 上述车厢状态检测装置还包括:
[0074] 第二检测模块, 用于在上述存储模块存储上述车厢全貌图像及检测结果之前, 若上述第一检测结果为上述运输车辆的车厢是打幵状态, 则基于上述获取的车 厢全貌图像, 检测上述运输车辆是载货状态还是非载货状态, 得到第二检测结 果;
[0075] 输出模块, 用于在上述第二检测结果为上述运输车辆是载货状态吋, 输出警示 信号。
[0076] 所述存储模块还用于, 存储上述第二检测结果。
[0077] 可选的, 上述第二检测模块包括:
[0078] 提取单元, 用于分别提取上述车厢全貌图像上两个以上预设区域的方向梯度直 方图;
[0079] 组合单元, 用于将上述提取单元提取的各预设区域的方向梯度直方图进行组合 , 得到上述车厢全貌图像的方向梯度直方图特征;
[0080] 输出单元, 用于将上述组合单元得到的上述方向梯度直方图特征输入第二判别 分类器, 由上述第二判别分类器输出上述第二检测结果, 其中, 上述第二判别 分类器为基于上述运输车辆分别为非载货状态和载货状态的样本图像的方向梯 度直方图特征训练得到。
[0081] 由上可知, 本申请在运输车辆上设置用于拍摄上述运输车辆的车厢全貌图像的 摄像模块, 一方面, 通过触发上述摄像模块拍摄上述运输车辆的车厢全貌图像 , 并基于上述获取的车厢全貌图像, 检测上述运输车辆的车厢为闭合状态还是 打幵状态, 能够实现车厢状态的自动检测, 而存储的车厢全貌图像及检测结果 可以作为管理运输车辆的客观依据, 也便于运输车辆管理人员进行检査和监督
, 从而提高了管理运输车辆的客观性和便捷性。 另一方面, 由于要拍摄车厢全 貌图像, 摄像模块的安装位置一般会距车厢保持一定的距离, 因此, 摄像模块 不易受到车厢幵闭及进行装卸的影响而损坏, 从而可降低对摄像模块的维修成 本, 进而降低运输车辆在车厢状态检测上的维护成本。
[0082] 实施例四: 图 4是本申请提供的终端的一个实施例结构示意图。 如图 4所示, 该 实施例的终端 4包括: 处理器 40、 存储器 41以及存储在上述存储器 41中并可在上 述处理器 40上运行的计算机程序 42。 上述处理器 40执行上述计算机程序 42吋实 现上述各个车厢状态检测方法实施例中的步骤, 例如图 1所示的步骤 101至步骤 1 03。 或者, 上述处理器 40执行上述计算机程序 42吋实现上述各装置实施例中各 模块 /单元的功能, 例如图 3所示模块 31至 33的功能。
[0083] 示例性的, 上述计算机程序 42可以被分割成一个或多个模块 /单元, 上述一个 或者多个模块 /单元被存储在上述存储器 41中, 并由上述处理器 40执行, 以完成 本申请。 上述一个或多个模块 /单元可以是能够完成特定功能的一系列计算机程 序指令段, 该指令段用于描述上述计算机程序 42在上述终端 4中的执行过程。 例 如, 上述计算机程序 42可以被分割成触发模块、 第一检测模块和存储模块, 各 单元具体功能如下:
[0084] 触发模块, 用于触发上述摄像模块拍摄上述运输车辆的车厢全貌图像;
[0085] 第一检测模块, 用于基于上述拍摄的车厢全貌图像, 检测上述运输车辆的车厢 是闭合状态还是打幵状态, 得到第一检测结果;
[0086] 存储模块, 用于存储上述车厢全貌图像及上述第一检测结果。
[0087] 上述终端 4可以是桌上型计算机、 笔记本、 掌上电脑及云端服务器等计算设备 。 上述终端可包括, 但不仅限于, 处理器 40、 存储器 41。 本领域技术人员可以 理解, 图 4仅仅是终端 4的示例, 并不构成对终端 4的限定, 可以包括比图示更多 或更少的部件, 或者组合某些部件, 或者不同的部件, 例如上述终端还可以包 括输入输出设备、 网络接入设备、 总线等。
[0088] 所称处理器 40可以是中央处理单元 (Central Processing Unit, CPU) , 还可以是其 他通用处理器、 数字信号处理器(Digital Signal Processor, DSP)、 专用集成电路 (Application Specific Integrated Circuit, ASIC)、 现场可编程门阵列
(Field-Programmable Gate Array , FPGA)或者其他可编程逻辑器件、 分立门或者 晶体管逻辑器件、 分立硬件组件等。 通用处理器可以是微处理器或者该处理器 也可以是任何常规的处理器等。
[0089] 上述存储器 41可以是上述终端 4的内部存储单元, 例如终端 4的硬盘或内存。 上 述存储器 41也可以是上述终端 4的外部存储设备, 例如上述终端 4上配备的插接 式硬盘, 智能存储卡 (Smart Media Card, SMC) , 安全数字 (Secure Digital, SD ) 卡, 闪存卡 (Flash Card) 等。 进一步地, 上述存储器 41还可以既包括上述终 端 4的内部存储单元也包括外部存储设备。 上述存储器 41用于存储上述计算机程 序以及上述终端所需的其他程序和数据。 上述存储器 41还可以用于暂吋地存储 已经输出或者将要输出的数据。
[0090] 所属领域的技术人员可以清楚地了解到, 为了描述的方便和简洁, 仅以上述各 功能单元、 模块的划分进行举例说明, 实际应用中, 可以根据需要而将上述功 能分配由不同的功能单元、 模块完成, 即将上述装置的内部结构划分成不同的 功能单元或模块, 以完成以上描述的全部或者部分功能。 实施例中的各功能单 元、 模块可以集成在一个处理单元中, 也可以是各个单元单独物理存在, 也可 以两个或两个以上单元集成在一个单元中, 上述集成的单元既可以采用硬件的 形式实现, 也可以采用软件功能单元的形式实现。 另外, 各功能单元、 模块的 具体名称也只是为了便于相互区分, 并不用于限制本申请的保护范围。 上述系 统中单元、 模块的具体工作过程, 可以参考前述方法实施例中的对应过程, 在 此不再赘述。
[0091] 在上述实施例中, 对各个实施例的描述都各有侧重, 某个实施例中没有详述或 记载的部分, 可以参见其它实施例的相关描述。
[0092] 本领域普通技术人员可以意识到, 结合本文中所公幵的实施例描述的各示例的 单元及算法步骤, 能够以电子硬件、 或者计算机软件和电子硬件的结合来实现 。 这些功能究竟以硬件还是软件方式来执行, 取决于技术方案的特定应用和设 计约束条件。 专业技术人员可以对每个特定的应用来使用不同方法来实现所描 述的功能, 但是这种实现不应认为超出本申请的范围。
[0093] 在本申请所提供的实施例中, 应该理解到, 所揭露的装置 /终端和方法, 可以 通过其它的方式实现。 例如, 以上所描述的装置 /终端实施例仅仅是示意性的, 例如, 上述模块或单元的划分, 仅仅为一种逻辑功能划分, 实际实现吋可以有 另外的划分方式, 例如多个单元或组件可以结合或者可以集成到另一个系统, 或一些特征可以忽略, 或不执行。 另一点, 所显示或讨论的相互之间的耦合或 直接耦合或通讯连接可以是通过一些接口, 装置或单元的间接耦合或通讯连接 , 可以是电性, 机械或其它的形式。
[0094] 上述作为分离部件说明的单元可以是或者也可以不是物理上分幵的, 作为单元 显示的部件可以是或者也可以不是物理单元, 即可以位于一个地方, 或者也可 以分布到多个网络单元上。 可以根据实际的需要选择其中的部分或者全部单元 来实现本实施例方案的目的。
[0095] 另外, 在本申请各个实施例中的各功能单元可以集成在一个处理单元中, 也可 以是各个单元单独物理存在, 也可以两个或两个以上单元集成在一个单元中。 上述集成的单元既可以采用硬件的形式实现, 也可以采用软件功能单元的形式 实现。
[0096] 上述集成的模块 /单元如果以软件功能单元的形式实现并作为独立的产品销售 或使用吋, 可以存储在一个计算机可读取存储介质中。 基于这样的理解, 本申 请实现上述实施例方法中的全部或部分流程, 也可以通过计算机程序来指令相 关的硬件来完成, 上述的计算机程序可存储于一计算机可读存储介质中, 该计 算机程序在被处理器执行吋, 可实现上述各个方法实施例的步骤。 其中, 上述 计算机程序包括计算机程序代码, 上述计算机程序代码可以为源代码形式、 对 象代码形式、 可执行文件或某些中间形式等。 上述计算机可读介质可以包括: 能够携带上述计算机程序代码的任何实体或装置、 记录介质、 U盘、 移动硬盘、 磁碟、 光盘、 计算机存储器、 只读存储器 (ROM, Read-Only Memory) 、 随机 存取存储器 (RAM, Random Access Memory) 、 电载波信号、 电信信号以及软 件分发介质等。 需要说明的是, 上述计算机可读介质包含的内容可以根据司法 管辖区内立法和专利实践的要求进行适当的增减, 例如在某些司法管辖区, 根 据立法和专利实践, 计算机可读介质不包括是电载波信号和电信信号。
[0097] 以上所述实施例仅用以说明本申请的技术方案, 而非对其限制; 尽管参照前述 实施例对本申请进行了详细的说明, 本领域的普通技术人员应当理解: 其依然 可以对前述各实施例所记载的技术方案进行修改, 或者对其中部分技术特征进 行等同替换; 而这些修改或者替换, 并不使相应技术方案的本质脱离本申请各 实施例技术方案的精神和范围, 均应包含在本申请的保护范围之内。

Claims

权利要求书
[权利要求 1] 一种运输车辆的车厢状态检测方法, 其特征在于, 所述运输车辆上设 置有用于拍摄所述运输车辆的车厢全貌图像的摄像模块;
所述车厢状态检测方法包括:
触发所述摄像模块拍摄所述运输车辆的车厢全貌图像;
基于所述拍摄的车厢全貌图像, 检测所述运输车辆的车厢是闭合状态 还是打幵状态, 得到第一检测结果;
存储所述车厢全貌图像及所述第一检测结果。
[权利要求 2] 根据权利要求 1所述的车厢状态检测方法, 其特征在于, 所述检测所 述运输车辆的车厢是闭合状态还是打幵状态之后, 所述车厢状态检测 方法还包括:
若所述第一检测结果为所述运输车辆的车厢是打幵状态, 则基于所述 获取的车厢全貌图像, 检测所述运输车辆是载货状态还是非载货状态 , 得到第二检测结果;
存储所述第二检测结果;
在所述第二检测结果为所述运输车辆是载货状态吋, 输出警示信号。
[权利要求 3] 根据权利要求 2所述的车厢状态检测方法, 其特征在于, 所述检测所 述运输车辆为载货状态还是非载货状态, 包括: 分别提取所述车厢全貌图像上两个以上预设区域的方向梯度直方图; 将所述提取的各预设区域的方向梯度直方图进行组合, 得到所述车厢 全貌图像的方向梯度直方图特征;
将所述方向梯度直方图特征输入第二判别分类器, 由所述第二判别分 类器输出所述第二检测结果, 其中, 所述第二判别分类器为基于所述 运输车辆分别为非载货状态和载货状态的样本图像的方向梯度直方图 特征训练得到。
[权利要求 4] 根据权利要求 1至 3任一项所述的车厢状态检测方法, 其特征在于, 所 述检测所述运输车辆的车厢为闭合状态还是打幵状态, 包括: 分别提取所述车厢全貌图像上两个以上预设位置的像素点的多尺度局 部二值特征;
将所述提取的各像素点的多尺度局部二值特征分别进行直方图统计, 并组合得到所述车厢全貌图像的高维局部二值直方图特征; 将所述高维局部二值直方图特征输入第一判别分类器, 由所述第一判 别分类器输出所述第一检测结果, 其中, 所述第一判别分类器为基于 所述运输车辆的第一样本图像和第二样本图像的高维局部二值直方图 特征训练得到, 所述第一样本图像为所述运输车辆的车厢为闭合状态 吋的样本图像, 所述第二样本图像为所述运输车辆的车厢为打幵状态 吋的样本图像。
[权利要求 5] 根据权利要求 1至 3任一项所述的车厢状态检测方法, 其特征在于, 所 述触发所述摄像模块拍摄所述运输车辆的车厢全貌图像, 包括: 在所述运输车辆由停车状态变为行驶状态吋, 触发所述摄像模块拍摄 所述运输车辆的车厢全貌图像。
[权利要求 6] —种运输车辆的车厢状态检测装置, 其特征在于, 所述运输车辆上设 置有用于拍摄所述运输车辆的车厢全貌图像的摄像模块;
所述车厢状态检测装置包括:
触发模块, 用于触发所述摄像模块拍摄所述运输车辆的车厢全貌图像
第一检测模块, 用于基于所述拍摄的车厢全貌图像, 检测所述运输车 辆的车厢是闭合状态还是打幵状态, 得到第一检测结果;
存储模块, 用于存储所述车厢全貌图像及所述第一检测结果。
[权利要求 7] 根据权利要求 6所述的车厢状态检测装置, 其特征在于, 所述车厢状 态检测装置还包括:
第二检测模块, 用于在所述第一检测模块检测所述运输车辆的车厢是 闭合状态还是打幵状态之后, 若所述第一检测结果为所述运输车辆的 车厢是打幵状态, 则基于所述获取的车厢全貌图像, 检测所述运输车 辆是载货状态还是非载货状态, 得到第二检测结果;
输出模块, 用于在所述第二检测结果为所述运输车辆是载货状态吋, 输出警示信号;
所述存储模块还用于, 存储所述第二检测结果。
[权利要求 8] 根据权利要求 7所述的车厢状态检测装置, 其特征在于, 所述第二检 测模块包括:
提取单元, 用于分别提取所述车厢全貌图像上两个以上预设区域的方 向梯度直方图;
组合单元, 用于将所述提取单元提取的各预设区域的方向梯度直方图 进行组合, 得到所述车厢全貌图像的方向梯度直方图特征; 输出单元, 用于将所述组合单元得到的所述方向梯度直方图特征输入 第二判别分类器, 由所述第二判别分类器输出所述第二检测结果, 其 中, 所述第二判别分类器为基于所述运输车辆分别为非载货状态和载 货状态的样本图像的方向梯度直方图特征训练得到。
[权利要求 9] 一种终端, 包括存储器、 处理器以及存储在所述存储器中并可在所述 处理器上运行的计算机程序, 其特征在于, 所述处理器执行所述计算 机程序吋实现如权利要求 1至 5任一项所述方法的步骤。
[权利要求 10] —种计算机可读存储介质, 所述计算机可读存储介质存储有计算机程 序, 其特征在于, 所述计算机程序被处理器执行吋实现如权利要求 1 至 5任一项所述方法的步骤。
PCT/CN2017/107855 2017-10-26 2017-10-26 运输车辆的车厢状态检测方法、车厢状态检测装置及终端 WO2019080055A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780001336.1A CN109416250B (zh) 2017-10-26 2017-10-26 运输车辆的车厢状态检测方法、车厢状态检测装置及终端
PCT/CN2017/107855 WO2019080055A1 (zh) 2017-10-26 2017-10-26 运输车辆的车厢状态检测方法、车厢状态检测装置及终端

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/107855 WO2019080055A1 (zh) 2017-10-26 2017-10-26 运输车辆的车厢状态检测方法、车厢状态检测装置及终端

Publications (1)

Publication Number Publication Date
WO2019080055A1 true WO2019080055A1 (zh) 2019-05-02

Family

ID=65462799

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/107855 WO2019080055A1 (zh) 2017-10-26 2017-10-26 运输车辆的车厢状态检测方法、车厢状态检测装置及终端

Country Status (2)

Country Link
CN (1) CN109416250B (zh)
WO (1) WO2019080055A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111460911A (zh) * 2020-03-12 2020-07-28 陕西天诚软件有限公司 一种物料装车方法、物料装车装置、服务器及介质
CN112508034A (zh) * 2020-11-03 2021-03-16 精英数智科技股份有限公司 货运列车故障检测方法、装置及电子设备
CN112633165A (zh) * 2020-12-23 2021-04-09 远光软件股份有限公司 基于车辆车厢的采样监督方法、系统、存储介质及电子设备
CN114954565A (zh) * 2022-05-20 2022-08-30 上海阿尔斯通交通电气有限公司 一种地铁牵引控制方法、系统、存储介质及智能终端

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111723601A (zh) * 2019-03-19 2020-09-29 杭州海康威视数字技术股份有限公司 一种图像处理的方法及装置
CN110533098B (zh) * 2019-08-28 2022-03-29 长安大学 一种基于卷积神经网络识别绿通车车厢装载类型的方法
CN111332199A (zh) * 2020-02-20 2020-06-26 广州小鹏汽车科技有限公司 一种车辆能源箱盖的关闭提醒方法和装置
CN111385537B (zh) * 2020-03-17 2021-03-26 杭州鸿泉物联网技术股份有限公司 渣土车顶盖密闭识别的方法、装置、系统和电子设备
CN112287882A (zh) * 2020-11-18 2021-01-29 成都佳华物链云科技有限公司 渣土车属性识别方法、装置、电子设备及存储介质
CN112432654B (zh) * 2020-11-20 2023-04-07 浙江华锐捷技术有限公司 一种渣土车的状态分析方法和装置及存储介质
CN113569925B (zh) * 2021-07-09 2024-04-09 惠州市云鼎科技有限公司 基于广角摄像头的工程车辆安全监控方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050175427A1 (en) * 2004-02-05 2005-08-11 Matthew Bullock Cargo restraint torque apparatus
CN104925005A (zh) * 2015-05-19 2015-09-23 首都信息科技发展有限公司 一种车辆监控方法及装置
CN104986129A (zh) * 2015-06-19 2015-10-21 长沙致天信息科技有限责任公司 专用车作业状态的监测系统及其方法
CN106791453A (zh) * 2017-03-14 2017-05-31 南京云趟信息技术有限公司 一种用于工程车的自动触发摄像装置
CN106791723A (zh) * 2017-03-08 2017-05-31 南京云趟信息技术有限公司 一种工程车的空/重车判断系统及方法
CN106781528A (zh) * 2017-03-22 2017-05-31 南京云趟信息技术有限公司 一种用于工程车的密闭状态识别系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN204633935U (zh) * 2015-05-21 2015-09-09 青岛港国际股份有限公司 一种车箱查验系统
CN104931985A (zh) * 2015-05-25 2015-09-23 北京物通时空网络科技开发有限公司 智能判定车辆负载状态与配货定位系统
KR101823655B1 (ko) * 2016-03-18 2018-01-30 한국오므론전장 주식회사 영상을 이용한 차량 침입 검출 시스템 및 방법

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050175427A1 (en) * 2004-02-05 2005-08-11 Matthew Bullock Cargo restraint torque apparatus
CN104925005A (zh) * 2015-05-19 2015-09-23 首都信息科技发展有限公司 一种车辆监控方法及装置
CN104986129A (zh) * 2015-06-19 2015-10-21 长沙致天信息科技有限责任公司 专用车作业状态的监测系统及其方法
CN106791723A (zh) * 2017-03-08 2017-05-31 南京云趟信息技术有限公司 一种工程车的空/重车判断系统及方法
CN106791453A (zh) * 2017-03-14 2017-05-31 南京云趟信息技术有限公司 一种用于工程车的自动触发摄像装置
CN106781528A (zh) * 2017-03-22 2017-05-31 南京云趟信息技术有限公司 一种用于工程车的密闭状态识别系统

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111460911A (zh) * 2020-03-12 2020-07-28 陕西天诚软件有限公司 一种物料装车方法、物料装车装置、服务器及介质
CN111460911B (zh) * 2020-03-12 2023-04-28 陕西天诚软件有限公司 一种物料装车方法、物料装车装置、服务器及介质
CN112508034A (zh) * 2020-11-03 2021-03-16 精英数智科技股份有限公司 货运列车故障检测方法、装置及电子设备
CN112508034B (zh) * 2020-11-03 2024-04-30 精英数智科技股份有限公司 货运列车故障检测方法、装置及电子设备
CN112633165A (zh) * 2020-12-23 2021-04-09 远光软件股份有限公司 基于车辆车厢的采样监督方法、系统、存储介质及电子设备
CN114954565A (zh) * 2022-05-20 2022-08-30 上海阿尔斯通交通电气有限公司 一种地铁牵引控制方法、系统、存储介质及智能终端
CN114954565B (zh) * 2022-05-20 2023-08-08 上海阿尔斯通交通电气有限公司 一种地铁牵引控制方法、系统、存储介质及智能终端

Also Published As

Publication number Publication date
CN109416250B (zh) 2021-08-13
CN109416250A (zh) 2019-03-01

Similar Documents

Publication Publication Date Title
WO2019080055A1 (zh) 运输车辆的车厢状态检测方法、车厢状态检测装置及终端
Zheng et al. A novel vehicle detection method with high resolution highway aerial image
US20150042808A1 (en) Vehicle vision system with image classification
CN110738150B (zh) 相机联动抓拍方法、装置以及计算机存储介质
CN112329881B (zh) 车牌识别模型训练方法、车牌识别方法及装置
CN111368612B (zh) 超员检测系统、人员检测方法及电子设备
WO2018068312A1 (zh) 交通异常事件检测装置及方法
CN110544211A (zh) 一种镜头付着物的检测方法、系统、终端和存储介质
CN112287875B (zh) 异常车牌识别方法、装置、设备及可读存储介质
JP2011076214A (ja) 障害物検出装置
CN112749622B (zh) 应急车道占用识别方法和装置
CN111967396A (zh) 障碍物检测的处理方法、装置、设备及存储介质
CN105718864B (zh) 一种机动车驾乘人员在途未系安全带的检测方法
CN108694387B (zh) 一种虚假车牌过滤方法及装置
CN115761668A (zh) 摄像头的污渍识别方法、装置、车辆及存储介质
CN103021179A (zh) 基于实时监控视频中的安全带检测方法
US20190340785A1 (en) Image processing for object detection
WO2018076281A1 (zh) 停车位状态的检测方法、检测装置和电子设备
CN110929606A (zh) 车辆盲区行人监控方法和装置
CN114141022B (zh) 应急车道占用行为检测方法、装置、电子设备及存储介质
CN110796099A (zh) 一种车辆超限检测方法及装置
JP2007164375A (ja) 三次元対象物の検出装置、検出方法、コンピュータ可読媒体及び三次元対象物の管理システム
CN115546746A (zh) 一种高速行驶轨道车辆裂纹检测方法及装置
CN112329729B (zh) 小目标船只检测方法、装置及电子设备
JP7043910B2 (ja) 画像処理装置、撮像装置、機器制御システム、移動体、画像処理方法、プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17929724

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17929724

Country of ref document: EP

Kind code of ref document: A1