CN111626081B

CN111626081B - Method and device for determining state of loading and unloading port and storage medium

Info

Publication number: CN111626081B
Application number: CN201910147770.1A
Authority: CN
Inventors: 杨小平
Original assignee: SF Technology Co Ltd
Current assignee: SF Technology Co Ltd
Priority date: 2019-02-27
Filing date: 2019-02-27
Publication date: 2024-03-26
Anticipated expiration: 2039-02-27
Also published as: CN111626081A

Abstract

The embodiment of the invention discloses a method, a device and a storage medium for determining the state of a loading and unloading port, and the method, the device and the storage medium acquire the video of the loading and unloading port; if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in the first detection period, and the vehicle moving state of the target loading and unloading port is determined according to the loading and unloading port video in the continuous N detection periods, determining the state of the target loading and unloading port according to the loading and unloading port video in the first detection period; if the target loading and unloading port is detected to be in a vehicle state according to the loading and unloading port video in the second detection period, and the vehicle moving state of the target loading and unloading port is determined according to the loading and unloading port video in the continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period. The scheme combines a plurality of continuous states of the loading and unloading ports to judge the states of the loading and unloading ports, and can automatically and timely determine whether the loading and unloading ports are in a state of having vehicles or not.

Description

Method and device for determining state of loading and unloading port and storage medium

Technical Field

The present invention relates to the field of image recognition, and in particular, to a method and apparatus for determining a state of a loading/unloading port, and a storage medium.

Background

With the development of the logistics industry, the concentrated integration and then the concentrated distribution of goods become an indispensable process for improving the transportation efficiency. The goods are integrated in a centralized way, so that the operation efficiency of the loading and unloading port of the transfer field is improved, the state of the loading and unloading port is monitored, the state of the loading and unloading port is counted automatically, and whether the loading and unloading port is idle or not can assist in vehicle dispatching.

However, it is difficult to automatically determine the state of the loading/unloading port.

Disclosure of Invention

The embodiment of the invention provides a method and a device for determining the state of a loading port and a storage medium, which can automatically determine the state of the loading port.

In one aspect, the present application provides a method for determining a status of a loading port, the method comprising:

acquiring a loading and unloading port video, wherein the loading and unloading port video is a monitoring video corresponding to a target loading and unloading port;

if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in a first detection period, and a vehicle moving state of the target loading and unloading port is determined to exist in the continuous N detection periods according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in a first detection period, N is an integer greater than 1, the first detection period is the previous detection period of the N periods, and the first detection period is a detection period after the N detection periods;

If the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in a second detection period, and the vehicle movement state of the target loading and unloading port is determined to be in a vehicle-mounted state according to the loading and unloading port video in a continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in a second detection period, M is an integer greater than 1, the second detection period is the previous detection period of the M detection periods, and the second detection period is the detection period after the M detection periods.

Optionally, in some embodiments, determining the status of the target dock from the dock video during a first detection period includes:

if the target loading and unloading port is determined to be in a working state according to the loading and unloading port video in the later detection period of the N detection periods, determining that the target loading and unloading port is in a car-on state, and determining the time corresponding to the last detection period for detecting the moving state of the vehicle as the arrival time of the vehicle.

if the continuous P detection periods after the N detection periods determine that the target loading and unloading port is in a rest state according to the loading and unloading port video, determining that the target loading and unloading port is in a car-on state, and determining the time corresponding to the last detection period for detecting the moving state of the vehicle as the arrival time of the vehicle, wherein P is an integer larger than 1.

Optionally, in some embodiments, after the acquiring the loading dock video, the method further includes:

if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in a third detection period, and the target loading and unloading port is determined to be in a working state according to the loading and unloading port video in Q continuous detection periods, the target loading and unloading port is determined to be in a vehicle-in state, the time corresponding to the Q-th detection period for detecting the target loading and unloading port to be in the working state is determined to be the vehicle arrival time, Q is an integer larger than 1, and the third detection period is the previous detection period of the Q detection periods.

Optionally, in some embodiments, determining the status of the target dock from the dock video during a second detection period includes:

and if the continuous R detection periods after the M periods determine that the target loading and unloading port is in a vehicle-free state according to the loading and unloading port video, determining that the target loading and unloading port is in the vehicle-free state, and determining the time corresponding to the detection period for detecting the vehicle moving state first as the vehicle departure time, wherein R is an integer larger than 1.

And if the continuous S detection periods after the M periods determine that the vehicle movement state exists in the target loading and unloading port according to the loading and unloading port video, determining that the target loading and unloading port is in a vehicle-free state, and determining the time corresponding to the detection period for detecting the vehicle movement state first as the vehicle departure time, wherein S is an integer greater than 1.

detecting the duty ratio of a carriage in a video picture in the loading and unloading port video;

determining the state of the target loading port according to the loading port video in a first detection period, wherein the method comprises the following steps: and determining the state of the target loading port according to the loading port video and the duty ratio in a first detection period.

Determining the state of the target loading port according to the loading port video in a second detection period, wherein the method comprises the following steps: and determining the state of the target loading port according to the loading port video and the duty ratio in a second detection period.

Correspondingly, the embodiment of the invention also provides a device for determining the state of the loading and unloading port, which comprises the following steps:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a loading and unloading port video, and the loading and unloading port video is a monitoring video corresponding to a target loading and unloading port;

A first determining unit, configured to determine, when it is detected that the target loading/unloading port is in a vehicle-free state according to the loading/unloading port video in a first detection period and a vehicle moving state of the target loading/unloading port is determined according to the loading/unloading port video in a continuous N detection periods, the state of the target loading/unloading port according to the loading/unloading port video in the first detection period, where N is an integer greater than 1, the first detection period is a detection period preceding the N detection periods, and the first detection period is a detection period following the N detection periods

And the second determining unit is used for determining the state of the target loading and unloading port according to the loading and unloading port video in a second detection period when the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video and the vehicle moving state of the target loading and unloading port is determined according to the loading and unloading port video in a continuous M detection periods, wherein M is an integer greater than 1 in the second detection period, the second detection period is the previous detection period of the M detection periods, and the second detection period is the detection period after the M detection periods.

Optionally, in some embodiments, the first determining unit is specifically configured to:

Optionally, in some embodiments, the apparatus further comprises:

and the third determining unit is used for determining that the target loading and unloading port is in a vehicle-on state when the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in a third detection period, and determining that the target loading and unloading port is in a vehicle-on state according to the loading and unloading port video in Q continuous detection periods, and determining the time corresponding to the detection period when the Q-th detection period detects that the target loading and unloading port is in the working state as the vehicle arrival time, wherein Q is an integer larger than 1, and the third detection period is the previous detection period of the Q detection periods.

Optionally, in some embodiments, the second determining unit is specifically configured to:

Optionally, in some embodiments, the second determining unit is further specifically configured to:

Optionally, in some embodiments, the apparatus further comprises:

the detection unit is used for detecting the duty ratio of the carriage in the video picture in the loading and unloading port video;

the first determining unit is specifically configured to: and determining the state of the target loading port according to the loading port video and the duty ratio in a first detection period.

The second determining unit is specifically configured to: and determining the state of the target loading port according to the loading port video and the duty ratio in a second detection period.

Yet another aspect of the present application provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the above aspects.

In addition, the embodiment of the application further provides a storage medium, wherein the storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in any of the method for determining the state of the loading port provided by the embodiment of the application.

In the embodiment of the invention, a loading and unloading port state determining device acquires loading and unloading port videos, wherein the loading and unloading port videos are monitoring videos corresponding to target loading and unloading ports; if the first detection period detects that the target loading and unloading port is in a vehicle-free state according to the loading and unloading port video, and N continuous detection periods determine that the target loading and unloading port has a vehicle moving state according to the loading and unloading port video, determining the state of the target loading and unloading port according to the loading and unloading port video in the first detection period, wherein N is an integer greater than 1, the first detection period is the previous detection period of the N periods, and the first detection period is the detection period after the N detection periods; if the second detection period detects that the target loading and unloading port is in a vehicle-mounted state according to the loading and unloading port video, and M continuous detection periods determine that the target loading and unloading port is in a vehicle moving state according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period, M is an integer greater than 1, the first detection period is the previous detection period of the M periods, and the second detection period is the detection period after the M detection periods. The scheme combines a plurality of continuous states of the loading and unloading ports to judge the states of the loading and unloading ports, and can automatically and timely determine whether the loading and unloading ports are in a state of having vehicles or not.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1a is a schematic flow chart of a method for determining the status of a loading port according to an embodiment of the present disclosure;

FIG. 1b is a schematic illustration of a center position of a car provided in an embodiment of the present application;

FIG. 2 is a schematic flow chart of another method for determining the status of a loading port according to an embodiment of the present disclosure;

FIG. 3a is a schematic structural view of a status determining device for a loading port according to an embodiment of the present disclosure;

FIG. 3b is a schematic view of another configuration of a status determining device for a loading port according to an embodiment of the present disclosure;

FIG. 3c is a schematic view of another configuration of a status determining device for a loading port according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.

In the following description, specific embodiments of the present application will be described with reference to steps and symbols performed by one or more computers, unless otherwise indicated. Thus, these steps and operations will be referred to in several instances as being performed by a computer, which as referred to herein performs operations that include processing units by the computer that represent electronic signals that represent data in a structured form. This operation transforms the data or maintains it in place in the computer's memory system, which may reconfigure or otherwise alter the computer's operation in a manner well known to those skilled in the art. The data structure maintained by the data is the physical location of the memory, which has specific characteristics defined by the data format. However, the principles of the present application are described in the foregoing text and are not meant to be limiting, and one skilled in the art will recognize that various steps and operations described below may also be implemented in hardware.

The principles of the present application operate using many other general purpose or special purpose operations, communication environments, or configurations. Examples of well known computing systems, environments, and configurations that may be suitable for use with the application include, but are not limited to, hand-held telephones, personal computers, servers, multiprocessor systems, microcomputer-based systems, mainframe computers, and distributed computing environments that include any of the above systems or devices.

The terms "first," "second," and "third," etc. in this application are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion.

The embodiment of the invention provides a method and a device for determining the state of a loading and unloading port and a storage medium.

The embodiment of the invention adopts a method of image processing based on deep learning to analyze each frame of image in a loading and unloading port video, determines the current state of the loading and unloading port (namely, classifies the state of the loading and unloading port), wherein the image in the loading and unloading port video comprises a three-primary-color (RGB) image and an optical flow image, and the invention needs to combine the RGB image and the optical flow image to classify the state of the instantaneous state of the loading and unloading port corresponding to the loading and unloading port video, wherein the state of the loading and unloading port comprises a no-vehicle state, a working state, a resting state, a vehicle moving state and the like, the working state comprises a loading state and a unloading state, and the vehicle moving state comprises a vehicle arrival state and a vehicle departure state.

In some embodiments, classifying the transient state of the dock corresponding to the dock video by combining the RGB diagram and the optical flow diagram specifically includes: converting the RGB image into a gray image, then carrying out channel superposition on the light flow graph and the gray image to form a three-channel image, finally forming a graph by the three-channel image, and finally classifying the image by using a neural network.

The loading port state determining device of the invention can be integrated in a server, and the loading port state determining device of the invention is used for determining the loading port state, so that the loading port can be automatically and timely determined to be in a state of being in a vehicle or not, wherein the loading port state determining method comprises the following steps:

acquiring a loading and unloading port video, wherein the loading and unloading port video is a monitoring video corresponding to a target loading and unloading port; if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in a first detection period, and a vehicle moving state of the target loading and unloading port is determined to exist in the continuous N detection periods according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in a first detection period, N is an integer greater than 1, the first detection period is the previous detection period of the N periods, and the first detection period is a detection period after the N detection periods; if the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in a second detection period, and the vehicle movement state of the target loading and unloading port is determined to be in a vehicle-mounted state according to the loading and unloading port video in a continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in a second detection period, M is an integer greater than 1, the second detection period is the previous detection period of the M detection periods, and the second detection period is the detection period after the M detection periods.

Referring to fig. 1a, fig. 1a is a schematic flow chart of a method for determining a status of a loading/unloading port according to an embodiment of the present application. The specific flow of the method can be as follows:

101. and acquiring a loading and unloading port video.

The camera may be installed directly in front of the target loading port, which is a monitoring video corresponding to the target loading port, to acquire the monitoring video of the loading port, and may be included in or out of the state determining device of the loading port.

The monitoring video comprises real-time video or historical video corresponding to the target loading and unloading port.

102. If the target loading port is detected to be in a vehicle-free state according to the loading port video in the first detection period, and the vehicle moving state of the target loading port is determined according to the loading port video in the continuous N detection periods, the state of the target loading port is determined according to the loading port video in the first detection period.

Wherein N is an integer greater than 1, the first detection period is a preceding detection period of the N periods, the first detection period is a detection period after the N detection periods, the first detection period includes one or more detection periods;

That is, if the target loading port is detected to be in a vehicle-free state according to the loading port video in the previous detection period, and the vehicle movement state of the target loading port is determined according to the loading port video in all of the continuous N detection periods, the state of the target loading port is determined according to the loading port video in the next detection period.

The duration of each frame of image may be one detection period, and N in the embodiment of the present application may be 3, or an integer greater than 3.

In some embodiments, determining the status of the target dock from the dock video includes:

if the target loading and unloading port is determined to be in a working state according to the loading and unloading port video in the later detection period of the N detection periods, determining that the target loading and unloading port is in a vehicle-in state (namely, a vehicle arrives at a port), and determining the time corresponding to the last detection period for detecting the vehicle movement state as the vehicle arrival time.

The method comprises the steps of,

if the continuous P detection periods after the N detection periods determine that the target loading and unloading port is in a rest state according to the loading and unloading port video, determining that the target loading and unloading port is in a car-on state, and determining the time corresponding to the last detection period for detecting the moving state of the vehicle as the arrival time of the vehicle, wherein P is an integer greater than 1, and P can be 5.

In addition, when the vehicle moving state cannot be detected due to, for example, shielding of the cargo on the vehicle, in response to an abnormal event, at this time, if the target loading port is detected to be in the no-vehicle state based on the loading port video in the third detection period and the target loading port is determined to be in the operating state based on the loading port video in the continuous Q detection periods, it is possible to determine that the target loading port has a vehicle arrival time, and determine the time corresponding to the Q-th detection period in which the target loading port is detected to be in the operating state as the vehicle arrival time, where Q is an integer greater than 1, and Q is preferably 10, wherein the third detection period is the detection period preceding the Q detection periods.

In some embodiments, if the target loading port is detected to be in a no-vehicle state according to the loading port video, and the target loading port is determined to be in a vehicle moving state according to the loading port video in N continuous detection periods, but if the target loading port is detected to be in a vehicle moving state in three continuous detection periods, the vehicle moving state needs to be detected again, and the loading port is unchanged in state.

In some embodiments, when the target dock is determined to be in a powered state, the state needs to be sent to a control center, which is used to schedule the vehicle for transit.

In some embodiments, after the acquiring the dock video, the method further comprises: and detecting the duty ratio of the carriage in the video picture in the loading and unloading port video.

At this time, determining the state of the target dock according to the dock video in the first detection period includes: and determining the state of the target loading port according to the loading port video and the duty ratio in a first detection period.

Specifically, if it is determined that the target loading/unloading port is in a vehicle-on state (i.e., a vehicle arrives at a port) according to the loading/unloading port video in the first detection period, and the duty ratio of the carriage is greater than the first threshold, then it is finally determined that the target loading/unloading port is in the vehicle-on state.

Wherein the first threshold may be 70%.

The embodiment of the invention can also combine the duty ratio of the carriage in the video picture to judge the arrival of the vehicle, thereby improving the accuracy of the arrival judgment of the vehicle.

In some embodiments, in addition to the ratio of the vehicle cabin, the coordinates of the center position of the vehicle cabin need to be combined to determine the status of the loading/unloading port, where the range corresponding to the coordinates of the center position of the vehicle cabin needs to be within the preset range, and the ratio of the vehicle cabin is greater than the first threshold, it is determined that there is a vehicle arriving at the port, as shown in fig. 1b, and the center position of the vehicle cabin needs to fall within the range a.

103. If the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in the second detection period, and the vehicle moving state of the target loading and unloading port is determined to be in a vehicle-mounted state according to the loading and unloading port video in the continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period.

If the target loading and unloading port is detected to be in a vehicle state according to the loading and unloading port video in the previous detection period (namely, the second detection period), and the vehicle moving state of the target loading and unloading port is determined according to the loading and unloading port video in the continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period.

In the embodiment of the present invention, M is an integer greater than 1, and preferably 3, or an integer greater than 3, the second detection period is a detection period preceding the M periods, and the second detection period is a detection period following the M detection periods, where the second detection period includes one or more detection periods.

In some embodiments, determining the status of the target dock from the dock video for the second detection period specifically includes:

if the target loading and unloading port is determined to be in a vehicle-free state according to the loading and unloading port video in the continuous R detection periods after the M periods, determining that the target loading and unloading port is in the vehicle-free state (namely, a vehicle is away from a port), and determining the time corresponding to the first detection period for detecting the vehicle moving state as the vehicle departure time, wherein R is an integer greater than 1, and R is preferably 3 or an integer greater than 3.

The method comprises the steps of,

if the continuous S detection periods after the M periods determine that the target loading port has a vehicle moving state according to the loading port video, determining that the target loading port is in a vehicle-free state, and determining the time corresponding to the detection period for detecting the vehicle moving state first as the vehicle departure time, wherein S is an integer greater than 1, and S is preferably 57.

If the target loading and unloading port is detected to be in a vehicle state according to the loading and unloading port video in the previous detection period, and the vehicle moving state of the target loading and unloading port is determined to exist in the continuous M detection periods according to the loading and unloading port video, but the target loading and unloading port is detected to be in a working state or a rest state later, the state of the target loading and unloading port is continuously detected according to the loading and unloading port video at the moment.

In some embodiments, when it is determined that the target dock leveled as a no-vehicle condition, the condition needs to be sent to the control center.

At this time, determining the state of the target dock according to the dock video in the second detection period includes: and determining the state of the target loading port according to the loading port video and the duty ratio in the second detection period.

Specifically, if it is determined that the target loading/unloading port is in the no-vehicle state (i.e., there is a departure of the vehicle) according to the loading/unloading port video in the second detection period, and the duty ratio of the vehicle cabin is smaller than the second threshold, then it is finally determined that the target loading/unloading port is in the no-vehicle state.

Wherein the second threshold may be 20%.

That is, the embodiment of the invention can also combine the duty ratio of the carriage in the video picture to judge the departure of the vehicle, and improve the accuracy of the judgment of the departure of the vehicle.

In some embodiments, in addition to the ratio of the vehicle cabin, the coordinates of the center position of the vehicle cabin need to be combined to determine the status of the loading/unloading port, where the range corresponding to the coordinates of the center position of the vehicle cabin need to be within the preset range, and the ratio of the vehicle cabin is smaller than the second threshold, it is determined that the vehicle leaves the port, as shown in fig. 1b, the center position of the vehicle cabin needs to fall within the range a.

In some embodiments, after acquiring the dock video, the method further comprises: the state of the loading and unloading port is determined through the loading and unloading port video, when the loading and unloading port has a vehicle to the port, but does not enter the working state after a plurality of detection periods, a reminding message is required to be sent to the control center, so that a manager can send personnel to the loading and unloading port to execute loading and unloading actions or monitor personnel in the loading and unloading port to work, and the energy efficiency of the personnel is improved.

The invention can automatically judge the state of the loading and unloading port, so the cost of manual monitoring can be reduced, and the judgment of the vehicle to the departure can be assisted by combining the carriage detection result, so the accuracy of the state judgment of the loading and unloading port can be further improved.

Referring to fig. 2, fig. 2 is another flow chart of a method for determining a status of a loading port according to an embodiment of the present application. The specific flow of the method can be as follows:

201. and acquiring a loading and unloading port video.

202. And detecting the duty ratio of the carriage in the video picture in the loading and unloading port video.

203. If the target loading port is detected to be in a vehicle-free state according to the loading port video in the first detection period, and the vehicle moving state of the target loading port is determined according to the loading port video in the continuous N detection periods, the state of the target loading port is determined according to the loading port video in the first detection period.

Wherein N is an integer greater than 1, the first detection period is a detection period preceding the N periods, and the first detection period is a detection period following the N detection periods;

if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in the previous detection period, and the vehicle moving state of the target loading and unloading port is determined according to the loading and unloading port video in N continuous periods, the state of the target loading and unloading port is determined according to the loading and unloading port video.

In this embodiment, N is an integer greater than 1, and N is preferably 3, or an integer greater than 3.

The method comprises the steps of,

In addition, when the vehicle moving state cannot be detected due to, for example, shielding of the cargo on the vehicle, in this case, after the pickup port video is acquired, if the target pickup port is detected to be in the no-vehicle state based on the pickup port video in the third detection period and the target pickup port is determined to be in the operating state based on the pickup port video in the continuous Q detection periods, it is possible to determine that the target pickup port has a vehicle arrival time, and determine the time corresponding to the detection period in which the Q-th detection period detects that the target pickup port is in the operating state as the vehicle arrival time, where Q is an integer greater than 1, and Q is preferably 10, and the third detection period is the preceding detection period of the Q detection periods.

204. And determining the state of the target loading port according to the loading port video and the duty ratio in the first detection period.

In some embodiments, when the target loading port is determined to be in a vehicle-on state (i.e. a vehicle arrives at the port) according to the loading port video in the first detection period, and the duty ratio is greater than the first threshold value, the loading port is actually confirmed to be in the vehicle-on state, and when the target loading port is determined to be in the vehicle-on state, the state needs to be sent to a control center, and the control center is used for arranging the vehicle for transit.

Wherein the first threshold may be 70%.

That is, at this time, it is necessary to determine whether or not there is a vehicle arrival by combining the behavior state of the vehicle in the loading/unloading port, the ratio of the vehicle cabin, and the center position of the vehicle cabin, that is, whether or not the target loading/unloading port is changed from the no-vehicle state to the vehicle-present state.

205. If the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in the second detection period, and the vehicle moving state of the target loading and unloading port is determined to be in a vehicle-mounted state according to the loading and unloading port video in the continuous M detection periods, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period.

If the loading and unloading port video detects that the target loading and unloading port is in a car-on state, and M continuous detection periods determine that the target loading and unloading port has a car moving state according to the loading and unloading port video, determining the state of the target loading and unloading port according to the loading and unloading port video.

If the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in the previous detection period (namely, the second detection period), and the continuous M detection periods determine that the target loading and unloading port has a vehicle moving state according to the loading and unloading port video, determining whether the target loading and unloading port has a vehicle off duty according to the loading and unloading port video in the second detection period.

In this embodiment, M is an integer greater than 1, and preferably 3, or an integer greater than 3, where the second detection period is a detection period preceding the M periods, and the second detection period is a detection period following the M detection periods.

In some embodiments, determining the status of the target dock from the dock video specifically includes:

if the target loading port is determined to be in a vehicle-free state according to the loading port video in the continuous R detection periods after the M periods, determining whether the target loading port is in a vehicle-free state (namely, whether the vehicle is away from the port) or not, and determining the time corresponding to the first detection period for detecting the vehicle moving state as the vehicle departure time, wherein R is an integer greater than 1, and R is preferably 3 or an integer greater than 3.

The method comprises the steps of,

if the continuous S detection periods after the M periods determine that the target loading port has a vehicle moving state according to the loading port video, determining that the target loading port has a vehicle departure, and determining the time corresponding to the first detection period for detecting the vehicle moving state as the vehicle departure time, wherein S is an integer greater than 1, and S is preferably 57.

206. And determining the state of the target loading port according to the loading port video and the duty ratio in the second detection period. .

Wherein the second threshold may be 20%.

In some embodiments, in addition to the ratio of the vehicle cabin, a state that is determined by combining the coordinates of the center position of the vehicle cabin is required, where the range corresponding to the coordinates of the center position of the vehicle cabin is required to be within a preset range, and the ratio of the vehicle cabin is smaller than the second threshold, it is determined that there is a vehicle departure, as shown in fig. 1b, the center position of the vehicle cabin is required to fall within the range a.

In order to better implement the method for determining the state of the loading and unloading port provided by the embodiment of the application, the embodiment of the application also provides a device for determining the state of the loading and unloading port, and the device for determining the state of the loading and unloading port can be integrated in a server. The meaning of the noun is the same as that in the method for determining the state of the loading port, and specific implementation details can be referred to the description in the method embodiment.

Referring to fig. 3a, fig. 3a is a schematic structural diagram of a status determining device for a loading port according to an embodiment of the present application, where the status determining device for a loading port includes: the acquisition unit 301, the first determination unit 302, and the second determination unit 303 are as follows:

an acquiring unit 301, configured to acquire a loading/unloading port video, where the loading/unloading port video is a monitoring video corresponding to a target loading/unloading port;

a first determining unit 302, configured to determine, when the target loading port is detected to be in a vehicle-free state according to the loading port video in a first detection period and a vehicle moving state of the target loading port is determined to be present in the loading port video according to the loading port video in a continuous N detection periods, the state of the target loading port according to the loading port video in a first detection period, where N is an integer greater than 1, the first detection period is a detection period preceding the N detection periods, and the first detection period is a detection period following the N detection periods

And a second determining unit 303, configured to determine, when it is detected that the target loading and unloading port is in a vehicle-mounted state according to the loading and unloading port video in a second detection period, and when it is determined that the target loading and unloading port is in a vehicle moving state according to the loading and unloading port video in M consecutive detection periods, determine, in a second detection period, the state of the target loading and unloading port according to the loading and unloading port video, where M is an integer greater than 1, the second detection period is a detection period preceding the M detection periods, and the second detection period is a detection period following the M detection periods.

In some embodiments, the first determining unit 302 is specifically configured to:

Referring to fig. 3b, in some embodiments, the apparatus further comprises:

and a third determining unit 304, configured to determine that, when the target loading and unloading port is detected to be in a no-vehicle state according to the loading and unloading port video in a third detection period and the target loading and unloading port is determined to be in a working state according to the loading and unloading port video in consecutive Q detection periods, determine that the target loading and unloading port is in a vehicle-on state, and determine, as a vehicle arrival time, a time corresponding to a detection period when the Q-th detection period detects that the target loading and unloading port is in the working state, where Q is an integer greater than 1, and the third detection period is a detection period preceding the Q detection periods.

In some embodiments, the second determining unit 303 is specifically configured to:

In some embodiments, the second determining unit 303 is further specifically configured to:

In some embodiments, as shown in fig. 3c, the apparatus further comprises:

a detecting unit 305, configured to detect a duty ratio of a carriage in the video frame in the loading/unloading port video;

the first determining unit 302 is specifically configured to: and determining the state of the target loading port according to the loading port video and the duty ratio in a first detection period.

The second determining unit 303 is specifically configured to: and determining the state of the target loading port according to the loading port video and the duty ratio in a second detection period.

In the embodiment of the present invention, the acquiring unit 301 acquires a loading and unloading port video, where the loading and unloading port video is a monitoring video corresponding to a target loading and unloading port; if the target loading/unloading port is detected to be in the no-vehicle state according to the loading/unloading port video in the first detection period, and the continuous N detection periods determine that the target loading/unloading port has the vehicle moving state according to the loading/unloading port video, the first determining unit 302 determines the state of the target loading/unloading port according to the loading/unloading port video in the first detection period, N is an integer greater than 1, the first detection period is a previous detection period of the N periods, and the first detection period is a detection period after the N detection periods; if the target loading/unloading port is detected to be in the vehicle-mounted state according to the loading/unloading port video in the second detection period, and the vehicle movement state of the target loading/unloading port is determined to be in the vehicle-mounted state according to the loading/unloading port video in the continuous M detection periods, the second determining unit 303 determines the state of the target loading/unloading port according to the loading/unloading port video in the second detection period, M is an integer greater than 1, the first detection period is a preceding detection period of the M periods, and the second detection period is a detection period after the M detection periods. The scheme combines a plurality of continuous states of the loading and unloading ports to judge the states of the loading and unloading ports, and can automatically and timely determine whether the loading and unloading ports are in a state of having vehicles or not.

Referring to fig. 4, an embodiment of the present invention provides a server 400 that may include one or more processors 401 of a processing core, one or more memories 402 of a computer readable storage medium, radio Frequency (RF) circuits 403, a power supply 404, an input unit 405, and a display unit 406. Those skilled in the art will appreciate that the server architecture shown in fig. 4 is not limiting of the server and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. Wherein:

the processor 401 is a control center of the server, connects respective portions of the entire server using various interfaces and lines, and performs various functions of the server and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the server. Optionally, processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, etc., and the modem processor mainly processes wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 401.

The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402.

The RF circuit 403 may be used for receiving and transmitting signals during the process of transmitting and receiving information.

The server also includes a power supply 404 (e.g., a battery) for powering the various components, which may be logically connected to the processor 401 via a power management system, such as a power management system that performs functions such as charge, discharge, and power consumption management.

The server may further comprise an input unit 405, which input unit 405 may be used for receiving input numeric or character information and generating keyboard, mouse, joystick, optical or trackball signal inputs in connection with user settings and function control.

The server may also include a display unit 406, which display unit 406 may be used to display information entered by or provided to a user as well as various graphical user interfaces of the server, which may be composed of graphics, text, icons, video, and any combination thereof. In this embodiment, the processor 401 in the server loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement various functions as follows:

From the above, the embodiment of the invention obtains the loading and unloading port video, wherein the loading and unloading port video is the monitoring video corresponding to the target loading and unloading port; if the first detection period detects that the target loading and unloading port is in a vehicle-free state according to the loading and unloading port video, and N continuous detection periods determine that the target loading and unloading port has a vehicle moving state according to the loading and unloading port video, determining the state of the target loading and unloading port according to the loading and unloading port video in the first detection period, wherein N is an integer greater than 1, the first detection period is the previous detection period of the N periods, and the first detection period is the detection period after the N detection periods; if the second detection period detects that the target loading and unloading port is in a vehicle-mounted state according to the loading and unloading port video, and M continuous detection periods determine that the target loading and unloading port is in a vehicle moving state according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in the second detection period, M is an integer greater than 1, the first detection period is the previous detection period of the M periods, and the second detection period is the detection period after the M detection periods. The scheme combines a plurality of continuous states of the loading and unloading ports to judge the states of the loading and unloading ports, and can automatically and timely determine whether the loading and unloading ports are in a state of having vehicles or not.

Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.

To this end, an embodiment of the present invention provides a storage medium in which a plurality of instructions are stored, where the instructions can be loaded by a processor to perform steps in any of the face image processing methods provided in the embodiments of the present invention. For example, the instructions may perform the steps of:

The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.

Wherein the storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.

The instructions stored in the storage medium can execute the steps in any method for determining the status of the loading and unloading port provided by the embodiment of the present invention, so that the beneficial effects that can be achieved by any method for determining the status of the loading and unloading port provided by the embodiment of the present invention can be achieved, which are detailed in the previous embodiments and are not described herein.

The method, the device and the storage medium for determining the state of the loading and unloading port provided by the embodiment of the invention are described in detail, and specific examples are applied to the description of the principle and the implementation mode of the invention, and the description of the above examples is only used for helping to understand the method and the core idea of the invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present invention, the present description should not be construed as limiting the present invention.

Claims

1. A method for determining the status of a loading/unloading port, comprising:

if the target loading and unloading port is detected to be in a vehicle-free state according to the loading and unloading port video in a first detection period, and a vehicle moving state of the target loading and unloading port is determined to exist in the continuous N detection periods according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in a first detection period, N is an integer greater than 1, the first detection period is a detection period before the N detection periods, and the first detection period is a detection period after the N detection periods;

if the target loading and unloading port is detected to be in a vehicle-mounted state according to the loading and unloading port video in a second detection period, and a vehicle moving state of the target loading and unloading port is determined to exist in the continuous M detection periods according to the loading and unloading port video, the state of the target loading and unloading port is determined according to the loading and unloading port video in a second detection period, M is an integer greater than 1, the second detection period is a detection period before the M detection periods, and the second detection period is a detection period after the M detection periods;

The determining the state of the target loading port according to the loading port video in the first detection period comprises the following steps:

if the target loading and unloading port is determined to be in a working state according to the loading and unloading port video in the latter detection period of the N detection periods, determining that the target loading and unloading port is in a vehicle-in state, and determining the time corresponding to the last detection period for detecting the vehicle movement state as the vehicle arrival time, and/or if the target loading and unloading port is determined to be in a rest state according to the loading and unloading port video in the continuous P detection periods after the N detection periods, determining that the target loading and unloading port is in a vehicle-in state, and determining the time corresponding to the last detection period for detecting the vehicle movement state as the vehicle arrival time, wherein P is an integer greater than 1;

the determining the state of the target loading port according to the loading port video in the second detection period comprises the following steps:

and if the continuous R detection periods after the M detection periods determine that the target loading and unloading port is in a vehicle-free state according to the loading and unloading port video, determining that the target loading and unloading port is in the vehicle-free state, determining the time corresponding to the detection period of the first detected vehicle movement state as the vehicle departure time, wherein R is an integer greater than 1, and/or if the continuous S detection periods after the M detection periods determine that the target loading and unloading port is in the vehicle movement state according to the loading and unloading port video, determining that the target loading and unloading port is in the vehicle-free state, determining the time corresponding to the detection period of the first detected vehicle movement state as the vehicle departure time, and determining that S is an integer greater than 1.

2. The method of claim 1, wherein after the acquiring the dock video, the method further comprises:

3. The method of any one of claims 1 to 2, wherein after the acquiring the dock video, the method further comprises:

determining the state of the target loading port according to the loading port video in a first detection period, wherein the method comprises the following steps: determining the state of the target loading and unloading port according to the loading and unloading port video and the duty ratio in the first detection period;

determining the state of the target loading port according to the loading port video in a second detection period, wherein the method comprises the following steps: and determining the state of the target loading and unloading port according to the loading and unloading port video and the duty ratio in the second detection period.

4. A state determining apparatus for a loading/unloading port, comprising:

a first determining unit, configured to determine, when it is detected that the target loading and unloading port is in a vehicle-free state according to the loading and unloading port video in a first detection period and a vehicle movement state of the target loading and unloading port is determined according to the loading and unloading port video in N continuous detection periods, the state of the target loading and unloading port according to the loading and unloading port video in a first detection period, where N is an integer greater than 1, the first detection period is a detection period preceding the N detection periods, and the first detection period is a detection period following the N detection periods;

a second determining unit, configured to determine, when it is detected that the target loading and unloading port is in a vehicle-mounted state according to the loading and unloading port video in a second detection period and a vehicle movement state of the target loading and unloading port is determined by continuous M detection periods according to the loading and unloading port video in a second detection period, the state of the target loading and unloading port according to the loading and unloading port video, M being an integer greater than 1, the second detection period being a detection period preceding the M detection periods, the second detection period being a detection period following the M detection periods;

5. A storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the method of determining the status of a loading dock of any one of claims 1 to 3.