CN111967321B - Video data processing method, device, electronic equipment and storage medium - Google Patents

Video data processing method, device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111967321B
CN111967321B CN202010683224.2A CN202010683224A CN111967321B CN 111967321 B CN111967321 B CN 111967321B CN 202010683224 A CN202010683224 A CN 202010683224A CN 111967321 B CN111967321 B CN 111967321B
Authority
CN
China
Prior art keywords
video data
user
information
logistics
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010683224.2A
Other languages
Chinese (zh)
Other versions
CN111967321A (en
Inventor
王莹
赖珑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cainiao Smart Logistics Holding Ltd
Original Assignee
Cainiao Smart Logistics Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cainiao Smart Logistics Holding Ltd filed Critical Cainiao Smart Logistics Holding Ltd
Priority to CN202010683224.2A priority Critical patent/CN111967321B/en
Publication of CN111967321A publication Critical patent/CN111967321A/en
Application granted granted Critical
Publication of CN111967321B publication Critical patent/CN111967321B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Economics (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • Operations Research (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Psychiatry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Social Psychology (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the application provides a video data processing method, a video data processing device, electronic equipment and a storage medium, so that processing efficiency is improved. The method comprises the following steps: acquiring video data to be analyzed; identifying a logistic object to be checked and a first user in the video data; determining behavior information of the first user aiming at the logistics object in the video data; analyzing the behavior information of the first user on the logistics object to determine an analysis result; and under the condition that the analysis result comprises the risk behaviors, sending out corresponding prompt information. The logistics efficiency can be improved.

Description

Video data processing method, device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of computer technology, and in particular, to a video data processing method, a video data processing apparatus, an electronic device, and a storage medium.
Background
With the development of logistics express industry, logistics express provides efficient and convenient logistics transportation service for users.
Currently, in the process of posting, a logistics staff who receives a logistics object requires checking the logistics object before packaging the logistics object to determine whether the logistics object includes an offending object. However, with the increasing number of logistics sites, there may be some illegal operations, such as not checking some logistics objects, when logistics personnel at some sites receive and send the logistics objects.
In order to ensure that a logistics person checks a logistics object, usually when the logistics person accepts the logistics object, a photo needs to be checked, the photo is sent and stored to a server, and a monitoring person at the server can extract part of the photo to check so as to determine the checking condition of the logistics person on the logistics object.
However, by adopting the method, logistics personnel also need to pick up a mobile phone to take a photo in the checking process and transmit the photo to a server, so that the operation is very inconvenient.
Disclosure of Invention
The embodiment of the application provides a video data processing method for improving processing efficiency.
Correspondingly, the embodiment of the application also provides a video data processing device, electronic equipment and a storage medium, which are used for guaranteeing the realization and the application of the system.
To solve the above problems, an embodiment of the present application discloses a video data processing method, including: acquiring video data to be analyzed; identifying a logistic object to be checked and a first user in the video data; determining behavior information of the first user aiming at the logistics object in the video data; analyzing the behavior information of the first user on the logistics object to determine an analysis result; and under the condition that the analysis result comprises the risk behaviors, sending out corresponding prompt information.
The embodiment of the application also discloses a video data processing method, which comprises the following steps: determining an analysis period before the face sheet printing according to the face sheet printing information; acquiring video data shot by a shooting component in the analysis period; and sending the video data to determine the behavior information of the first user on the logistics object in the video data.
The embodiment of the application also discloses a video data processing method, which comprises the following steps: determining an analysis period before picking up the part according to the part picking-up information; acquiring video data shot by a shooting component in the analysis period; and sending the video data to determine the behavior information of a third user in the video data on the logistics object.
The embodiment of the application also discloses a video data processing device, which comprises: the video data determining module is used for acquiring video data to be analyzed; the video data identification module is used for identifying the logistic object to be checked and the first user in the video data; the behavior information determining module is used for determining behavior information of the first user aiming at the logistics object in the video data; the behavior information analysis module is used for analyzing the behavior information of the first user on the logistics object and determining an analysis result; the risk prompting module is used for sending out corresponding prompting information under the condition that the analysis result comprises risk behaviors.
The embodiment of the application also discloses a video data processing device, which comprises: the analysis period acquisition module is used for determining an analysis period before the face sheet printing according to the face sheet printing information; the video data acquisition module is used for acquiring video data shot by the shooting component in the analysis period; and the video data transmitting module is used for transmitting the video data to determine the behavior information of the first user in the video data on the logistics object.
The embodiment of the application also discloses a video data processing device, which comprises: the analysis period determining module is used for determining an analysis period before picking up the part according to the picking-up information; the video data intercepting module is used for acquiring video data shot by the shooting component in the analysis period; and the video data output module is used for sending the video data to determine the behavior information of a third user in the video data on the logistics object.
The embodiment of the application also discloses electronic equipment, which comprises: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments herein.
One or more machine-readable media having stored thereon executable code that, when executed, causes a processor to perform a method as described in one or more of the embodiments of the present application are also disclosed.
Compared with the prior art, the embodiment of the application has the following advantages:
in the embodiment of the application, the logistic object and the first user in the video data can be determined according to the video data to be analyzed, and then the behavior of the first user in the video data for the logistic object is determined to determine the behavior information. And analyzing the behavior information to determine a corresponding analysis result, and sending out corresponding prompt information under the condition that the analysis result comprises risk behaviors. According to the embodiment of the application, the behavior of the first user on the logistics object is determined by identifying the video data, so that the logistics efficiency is improved.
Drawings
FIG. 1 is a schematic diagram of an embodiment of a video data processing system of the present application;
FIG. 2 is a flow chart of steps of an embodiment of a video data processing method of the present application;
FIG. 3 is a flowchart illustrating steps of another embodiment of a video data processing method of the present application;
FIG. 4 is a flowchart illustrating steps of yet another embodiment of a video data processing method of the present application;
FIG. 5 is a flowchart illustrating steps of yet another embodiment of a video data processing method of the present application;
FIG. 6 is a block diagram of an embodiment of a video data processing apparatus of the present application;
FIG. 7 is a block diagram of another embodiment of a video data processing apparatus of the present application;
FIG. 8 is a block diagram of still another embodiment of a video data processing apparatus of the present application;
fig. 9 is a schematic structural view of an exemplary apparatus provided in an embodiment of the present application.
Detailed Description
In order that the above-recited objects, features and advantages of the present application will become more readily apparent, a more particular description of the invention briefly described above will be rendered by reference to specific embodiments that are illustrated in the appended drawings.
The embodiment of the application can be applied to the field of logistics, and logistics is a process of organically combining functions of transportation, storage, loading, unloading, carrying, packaging, circulation processing, distribution, information processing and the like according to actual needs in the process of enabling objects to flow from a supply place to a receiving place. The logistic object refers to an object of logistic processing such as unpackaged articles and the like that need to be transported.
The embodiment of the application can be applied to scenes such as mail sending, mail taking and the like in the logistics field, and a plurality of users can be involved in the scenes, and for convenience of distinguishing, the users can comprise a first user, a second user and a third user, wherein the first user is a user for providing logistics service, such as a dispatcher, an administrator of a logistics site and the like; the second user is a user for carrying out logistics service management, such as a supervisor; the third user is a user using a logistics service, such as a sender, a recipient, etc.
The embodiment of the application discloses a video data processing system, as shown in fig. 1, the data processing system may include a camera and a processing end, and may further include a printer and other devices. The camera is used for shooting video data of a designated place, such as monitoring video data of a logistics site; the printer is used for printing logistics data, such as a printed logistics menu; the processing end is used for acquiring video data shot by the camera and analyzing the video data to determine behavior information of the first user on the logistics object, such as analyzing whether the behavior of the user has risks or not. The processing end can be a terminal or a server, for example, the monitoring video data can be analyzed in real time through a terminal such as a computer of a logistics site, so that a first user is prompted when risk behaviors occur; for example, the video data is transmitted to the server for analysis, and the risk behaviors of the first user in a certain logistics site in a period of time can be summarized, so that the logistics site and the first user are managed.
The system can be applied to logistics scenes such as mail sending, mail receiving and the like, and the third user is a sender in the example of the mail sending scene. The camera is used for shooting video data of a process that the first user receives a logistic object to be sent by the third user; the printer is used for printing the menu corresponding to the logistics object according to the printing request of the first user; the processing end is used for analyzing the video data shot by the camera to determine the behavior information of the first user on the logistics object. In the mail scene, the video data shot by the camera can be processed in real time, and the video data of the camera in a period of time can be processed uniformly. In the case that the processing end is a server, the server is used for receiving video data and analyzing the video data; and the server is used for receiving the analysis result of the terminal under the condition that the processing terminal is the terminal.
In a mail scene, an operation area can be defined in advance, a first user of a logistics site (or a post site or a site) can check a logistics object in the operation area, a camera is used for shooting video data of the operation area, the first user can package the logistics object after finishing checking the logistics object, a menu corresponding to the logistics object is printed through a printer, and then the menu is pasted. In one example, the terminal may capture video data of the operation area through a camera, and intercept video data within a preset duration before the face sheet printing and send the video data to the server. In other examples, the camera may be a web camera, connected to a service through a network such as the internet, so that captured video data can be transmitted to a server through the network. The server side can identify and analyze the video data to determine the behavior information of the first user on the logistics object, and analyze the behavior information to obtain an analysis result so as to determine whether the first user checks the logistics object. In addition, under the condition that the first user does not check the logistic object, the server side can also issue a corresponding processing mode to the terminal so as to punish the first user of the terminal and standardize the behavior of the first user. The terminal in the embodiment of the application refers to a device for recording video and transmitting video, and may include, for example, a computer, a network video recorder (Network Video Recorder, NVR), and the like.
In the mail sending scene, the corresponding video data can be automatically intercepted according to the operation of the first user for printing the bill, the video data is sent to the server, and the server can analyze the behavior of the first user on the logistics object to determine whether the first user checks the logistics object. In the process, the first user does not need to shoot a picture in checking, so that the efficiency of sending the mail can be improved; and the behavior of the first user is analyzed through the server, so that a larger amount of data can be analyzed to more accurately determine the behavior of the first user. In addition, according to the method, dynamic videos can be analyzed, and whether the checking behavior of the user is accurate or not can be determined compared with the method of analyzing by using static photos.
The following describes embodiments of the present application by taking an example of application of the embodiments of the present application in a mailing scenario. Specifically, the embodiment of the application discloses a video data processing method, which can be executed by a server, and the method can be executed by a terminal in addition to the processing performed by the server, where the processing performed by the server is taken as an example, as shown in fig. 2, and the method specifically includes:
Step 202, obtaining video data to be analyzed.
In one example, the terminal may transmit video data captured by the camera to the server, or the camera may transmit video data to the server through a network, and the server may receive the video data for analysis. In another example, the terminal may extract video data of the camera within a preset period before printing the face sheet according to the face sheet printing information made by the user to the printer, analyze the video data, send the analysis result to the server, or transmit the extracted video data to the server for analysis.
In an alternative embodiment, the acquiring the video data to be analyzed includes: video data is received during an analysis period, the analysis period being determined from the facial mask printing information. The face sheet printing information comprises face sheet printing time, the face sheet printing information can be obtained, a corresponding analysis period is determined according to the face sheet printing time in the face sheet printing information, and then video data shot by a camera in the analysis period are obtained.
For example, the processing side may determine video data within one minute (or half minute, two minutes, etc.) prior to the face sheet printing based on the face sheet printing information. Further, the analysis period may also include a period after the sheet printing. According to the embodiment of the application, the video data can be intercepted at the terminal, so that the amount of the video data analyzed by the server is reduced, and the processing pressure of the server is reduced. In another example, the server intercepts video data according to the face sheet printing information to analyze the intercepted video data, and specifically, the obtaining the video data to be analyzed includes: receiving a video data stream; and determining a corresponding analysis period according to the face sheet printing information of the logistics object, and acquiring a video data stream in the analysis period as video data. And the server intercepts the video data stream in the analysis period according to the sheet printing time in the sheet printing information and analyzes the video data stream as video data. In the embodiment of the application, the server can determine the analysis period and intercept the video data stream in the analysis period for analysis, so that the amount of video data analyzed by the server is reduced, and the processing pressure of the server is reduced.
In other embodiments, a camera may also be determined based on the analysis scene of the video and the video data captured by the camera may be retrieved. The obtaining the video data to be analyzed includes: selecting at least one camera according to the analysis target; and acquiring video data shot by the at least one camera. The analysis target refers to content to be analyzed, for example, for a warehouse scene, if the analysis target is a warehouse entry condition, at least one camera corresponding to the warehouse entry scene, for example, a warehouse entrance, a camera in a warehouse and a camera at a warehouse entry operation desk lamp position can be determined, and video data shot by the at least one camera can be acquired. For example, taking a mail inspection scene as an example, analyzing the inspection behavior of the object as a logistics object, so that at least one camera corresponding to an operation panel of a mail area can be determined, and video data shot by the at least one camera can be acquired. Therefore, an analysis target can be determined based on the application scene, and at least one camera is selected to acquire video data based on the analysis target so as to facilitate subsequent analysis.
Step 204, identifying the logistic object to be checked in the video data and the first user. After receiving the video data, the server may identify a plurality of logistic objects and a plurality of users in the video data, and further determine a first user of the plurality of users and a logistic object to be checked among the plurality of logistic objects. Specifically, at the logistics site, the operation platform, the operation area on the operation platform and the camera can be set according to a standard operation program (Standard Operating Procedure, SOP), the first user can check the logistics object in the operation area, and the camera is used for shooting checked video data. The server may first identify an operation area in the video data, and determine a logistic object and a first user in the operation area, and specifically, as an optional embodiment, the identifying the logistic object and the first user to be checked in the video data includes: determining an operation region in the video data; identifying a logistic object in the operation area; a first user in the operating region is identified. In one example, the site may set a corresponding identifier for the operation area, for example, a frame with a color is attached around the operation area, and the server may identify the operation area according to the frame with the color.
In the third user posting process, there may be a third user and a first user in the operating area, in which case the first user may be determined by facial recognition of the first user or identification of the first user (e.g., a tablet, clothing identification, etc.), specifically, in an alternative embodiment, the identifying the first user in the operating area includes: identifying a user in the operating region; and carrying out feature recognition on the user, and determining a first user according to feature information, wherein the feature information comprises at least one of facial feature information, clothing feature information and other feature information. Other characteristic information may include sign characteristic information, user location characteristic information in the operating area, and the like. After the service end determines the user in the operation area, the face of the user can be identified according to the facial feature information, the clothing of the user can be identified according to the clothing feature information, the work card of the user can be identified according to the work card feature information, and the user can be identified according to the position feature information of the user, so that the first user working at the site can be determined.
In an alternative embodiment, the logistic object may be determined according to the contact object of the first user, and after the first user is determined, the palm of the first user may be identified, and the object contacted by the palm of the first user in the video data may be determined as the logistic object. In another alternative embodiment, the video data may include a period after the face sheet is printed, and the server may determine the paste object of the face sheet by identifying a face sheet identifier (such as a two-dimensional code) of the face sheet in the video data after the face sheet is printed, so as to determine the corresponding logistic object.
After determining the first user and the logistic object, the server may determine behavior information of the first user for the logistic object in the video data in step 206. After determining the first user, the server may determine behavior information of the first user on the logistic object. Specifically, the server may identify the actions (motion trajectories) of the arm, palm, finger, and leg of the first user in the video data, so as to determine the behavior information of the user on the logistic object. And in step 208, the behavior information of the first user on the logistic object is analyzed to determine the analysis result.
The server side can acquire at least one of first limb change information of the first user, state change information of the logistics object, first distance information of the first user and the logistics object, second limb change information of the third user, second distance information between the first user and the third user and the like to determine behavior information of the first user on the logistics object. Specifically, the server may identify the actions (motion trajectories) of the arm, palm, finger, and leg of the first user, and combine the changes of the logistic objects to determine whether the first user has the actions of opening the package (unpacking), taking out the logistic objects (taking out), and viewing the logistic objects (checking). In addition, the embodiment of the application can also combine the behaviors of the third user to determine the behaviors of the first user, for example, according to the behaviors that the third user completes the unpacking, the taking out and the displaying to the first user, the behaviors that the first user performs the unpacking, the taking out and the checking are determined. After determining the behavior of the first user, the corresponding analysis result may be determined in combination with the behavior included in the behavior information of the first user.
For example, a box for wrapping a physical distribution object may be determined, based on the actions of the arm, finger, and the like of the target user (first user and/or third user), in combination with whether the lid of the box is opened (which may be determined based on a change in the shape of the box or separation of the box from the lid), whether the target user has an action of opening the box; according to the actions of the arms, palms and legs of the target user, whether the target user has the action of extracting the logistics object from the box or putting the logistics object into the box or not can be determined, and whether the target user takes out the logistics object or not is determined; a motion profile of at least one finger of the target user may be determined to determine whether the target user has an action of wrist flipping to determine whether the first user is checking the logistic object.
The analysis results may be classified according to levels, and for behavior information including different behaviors, the analysis results may be determined as analysis results of different behavior levels, for example, for behavior information including unpacking, taking out, and checking behaviors, the analysis results may be determined as analysis results of a first level; for behavior information including unpacking and taking out behaviors, determining the behavior information as a second-level analysis result; for behavior information including unpacking behavior, the third-level analysis result can be determined; for behavior information that does not include unpacking, retrieving, and checking behavior, the fourth level of analysis results may be determined.
In addition, the actions of unpacking, taking out and checking of the first user can be collected in the server side to train the behavior information identifier, and whether the behavior information of the user on the logistic object comprises unpacking, taking out and checking can be identified by inputting the behavior information of the user into the behavior information identifier. To determine the corresponding analysis result.
When the video data is analyzed, the analysis algorithm can be determined based on the logistics object, and after the logistics object is identified in the video data, the analysis algorithm can be determined based on the packaging style of the logistics object, wherein the packaging style can comprise: cartons, bags, letter bags, foam boxes, etc., different types of logistic objects are typically packaged in different styles of packaging, and therefore different algorithms may be used to identify different types of logistic objects. For example, in the ex-warehouse and warehouse-in scenes, the ex-warehouse and warehouse-in operations of different packaging objects may be different, for example, letter bags may be transported together, and cartons, bags, foam boxes and the like may be transported separately or adjusted according to the size, and the foam boxes may be generally used for cold chain transportation or fragile product transportation, so that the corresponding ex-warehouse and warehouse-in operations require certain behavior standards and the like, and accordingly, identification may be performed based on different algorithms to determine whether the behavior information of the user has risks and the like. In addition, the packaging style may also be combined with a type analysis of the logistic object, such as determining the type of the logistic object based on the object identification of the logistic object, which may be understood as removing the packaged content, such as documents, foods, cosmetics, etc., so as to perform the analysis in combination with the packaging style and type determining algorithm.
As another example, in a case open checking scenario, the checking step may be determined based on the type of the logistic object, for example, a file checking algorithm may be selected for the logistic object such as a file, thereby determining whether to perform the behavior required for file checking, such as determining the number of files, etc., and a cold chain checking algorithm may be selected for the cold chain object, thereby determining whether to perform the behavior required for cold chain checking, such as determining whether the article is spoiled, whether there is a cold chain package such as an ice bag, etc., and an article checking algorithm may be selected for cosmetics, electronic products, etc., thereby determining whether to perform the behavior required for file articles, such as whether the package is complete, the number of contents, etc. In addition, the first user can check whether the packaging action is carried out on the logistic objects, whether the correct packaging material is selected or not, and the like. And the analysis of the logistics process is more accurate and rapid.
Step 210, sending out corresponding prompt information under the condition that the analysis result includes risk behaviors. In the server, an analysis result including risk behavior may be defined, for example, an analysis result lower than the target level may be determined as an analysis result including risk behavior. Wherein the target level may be one of a second level, a third level, and a fourth level. For the analysis result containing the risk behaviors, corresponding prompt information can be sent out. In an alternative embodiment, a prompt may be transmitted to the terminal to prompt the first user of the terminal to review the logistic object and normalize the behavior. In another alternative embodiment, the prompt message may be transmitted to the supervising user, and the secondary identification is performed manually by the supervising user to more accurately determine whether the video data includes risk behaviors. Specifically, outputting the prompt information to a second user; and receiving feedback information of the second user to determine risk behaviors of the first user for the logistic objects. The second user can be understood as a supervisory user, the server side can send prompt information to the second user, and the second user invokes corresponding video data to determine whether the behavior of the first user comprises risk behavior.
For a first user of a post site, if a logistic object that is not checked by the first user exceeds a preset value, the first user needs to be penalized or the post is closed. Specifically, in an optional embodiment, the server may determine the number information of risk behaviors related to the site in a preset period; and determining the processing grade corresponding to the station according to the quantity information so as to determine the processing mode corresponding to the station. The preset threshold value can be divided into a plurality of threshold values, and the processing grade corresponding to the site is determined through the plurality of threshold values. For example, a first threshold, a second threshold, a third threshold, etc. may be preset, and the first threshold is met and determined as the first level; determining that the second threshold is met as a second level; the third threshold is met and a third level is determined. The server side can acquire the number of risk behaviors of the staff of the site, compare the number with a preset threshold value to determine the corresponding processing grade of the site, and determine the corresponding processing mode of the site according to the processing grade. For example, the number of risk actions that occur in a day (e.g., 6 times) may be collected and compared to a preset threshold (e.g., a first threshold below 5, a second threshold between 5 and 10, and a third threshold above 10) to determine a corresponding treatment level (second level) to send a corresponding treatment regimen to the station.
In the embodiment of the application, the logistic object and the first user in the video data can be determined according to the video data to be analyzed, and then the behavior of the first user in the video data for the logistic object is determined to determine the behavior information. And analyzing the behavior information to determine a corresponding analysis result, and sending out corresponding prompt information under the condition that the analysis result comprises risk behaviors. According to the method and the device for identifying the video data, the behavior of the first user on the logistics object is determined, the checking condition of the logistics object is not required to be determined in the mode that the first user shoots the checking photo, the first user receiving operation can be facilitated, the video data are identified through the server, and the workload of monitoring personnel of the server can be reduced.
According to the embodiment of the application, the checking behavior can be checked based on the consignment scene. The volume of the logistics object can be calculated by combining video data shot by the camera, so that the logistics cost of the logistics object can be calculated based on the weight, the type and other information of the logistics object, and the logistics object is convenient to send and check. Thus, volume information of the logistic object can be determined according to the video data; acquiring weight information and other information of the logistics object; and calculating the logistics cost of the logistics object according to the volume information, the weight information and other information. The physical distribution object can be identified based on the video data shot by the camera, the volume information of the physical distribution object can be determined based on the reference object, for example, in a mail sending scene, the physical distribution object can be placed on an operation table in a mail sending area, the size of the operation table can be determined, in other scenes, the operation table is provided with identification information, the size of the identification information is also determined, so that the size of the reference object can be determined, the size information of the physical distribution object can be determined based on the size of the reference object, and the physical distribution object is the physical distribution object which is packaged and can be transported after the packaging is completed. Weight information of the logistic object may then be determined, for example, weight information may be determined based on the logistic object information of the logistic object, and other information may be obtained, for example, the type of the logistic object, warranty information, and the like, so that the logistic cost of the logistic object is calculated by integrating the volume information, the weight information, and the other information.
On the basis of the above embodiment, the present application further provides a video data processing method, as shown in fig. 3, including:
step 302, receiving video data in an analysis period, wherein the analysis period is determined according to the face sheet printing information. In the terminal, according to the face sheet printing information of the first user printing face sheet, determining a corresponding analysis period, intercepting video data corresponding to the analysis period and sending the video data to the server. The server receives the video data for corresponding analysis.
Step 304, determining an operation area in the video data.
Step 306, identifying the logistic object in the operation area.
Step 308, identify the user in the operation area.
Step 310, performing feature recognition on the user, and determining the first user according to feature information, wherein the feature information comprises at least one of facial feature information, clothing feature information and other feature information.
Step 312, determining behavior information of the first user on the logistic object in the video data.
Step 314, analyzing the behavior information of the first user on the logistics object to determine an analysis result.
Step 316, sending out corresponding prompt information under the condition that the analysis result includes risk behaviors. In this example, the prompt may be output to the second user. In other alternative embodiments, the prompt may also be output to the first user to prompt the first user to modify the behavior.
Step 318, receiving feedback information of the second user to determine risk behavior of the first user with respect to the logistic object.
Step 320, determining the number information of the risk behaviors related to the site in the preset time period.
Step 322, determining a processing grade corresponding to the site according to the quantity information, so as to determine a processing mode corresponding to the site.
In this embodiment of the present application, the terminal may determine a corresponding analysis period according to the sheet printing time in the sheet printing information, intercept video data in the analysis period, send the video data to the server, and after the server receives the video data to be analyzed, analyze the video data to determine an operation area in the video data, identify a logistic object and a user in the operation area, and then according to the identification information, select a first user from the users.
After determining the logistic object and the first user, behavior information of the first user on the logistic object in the video data can be determined, and the behavior information is analyzed to determine a corresponding analysis result according to whether the behavior information comprises actions of unpacking, taking out and checking. And sending corresponding prompt information to a second user under the condition that the analysis result contains the risk behaviors, and carrying out secondary identification on the video data by the second user so as to determine whether the first user has the risk behaviors. And then the number of the risk behaviors related to the site in the preset period can be synthesized to determine the corresponding processing mode, and the site is processed. According to the method and the device for identifying the video data, the behavior of the first user on the logistics object is determined, the checking condition of the logistics object is not required to be determined in the mode that the first user shoots the checking photo, the first user receiving operation can be facilitated, the video data are identified through the server, and the workload of monitoring personnel of the server can be reduced.
The embodiment of the application can also be applied to scenes such as evidence collection, security and the like aiming at the logistics process of the logistics object. For example, after the third user collects the logistics object, the feedback logistics object is lost, or the contents of the logistics object package are wrong, and the like, the logistics nodes can be determined based on specific error conditions, and videos of the corresponding logistics nodes are searched for evidence collection analysis. If the video data corresponding to the mailpiece is extracted as evidence, whether the mailpiece is proved to be visually, the content of the checked logistics object and the like can be determined, and accordingly the content of the logistics object package can be determined as evidence. And video data corresponding to the received object can be determined, and whether the package of the logistics object is complete or not when the third user receives the logistics object is determined, so that the video data is used as corresponding evidence. The above process can therefore be applied to various forensic scenarios related to logistic objects, analyzing the behavior of logistic objects and related users as evidence in combination with video data of the corresponding logistic nodes.
For security scenarios, security measures required for the logistics process for the logistics objects may be determined based on the video data analysis of the logistics objects and the behavior of the relevant users. For example, in connection with a physical distribution object analyzed by video, the transportation mode of the physical distribution object is determined, for example, for a physical distribution object containing liquid, only a transportation mode of land transportation can be adopted, etc.
According to the embodiment of the application, video data are shot through monitoring equipment such as a camera in the logistics process, so that the logistics process is convenient to record, the state of a logistics object in the logistics process, the behavior of a relevant user and the like can be detected and checked, and the video data are used in the processes of follow-up evidence collection, security and the like. In a scenario related to a third user, such as a recipient, a sender, etc., if video data is captured, the third user is informed that the process will be recorded so that the correlation will be detected and forensic, and the privacy security of the user will be ensured.
In this embodiment of the present application, the camera for capturing video data is monitoring equipment for a logistics site, and other image capturing equipment may be used as monitoring equipment in actual processing. The monitoring device may also include voice input/output functionality so that voice data may be collected for ease of interaction. For example, when detecting that the user has the illegal action, the method can alarm in a voice mode, such as sending out prompt information in a voice mode, so as to prompt the user of the illegal action.
In this embodiment of the present application, after the security of the logistic object is analyzed through the above process, when the logistic sheet is printed, the mark may be set in a form of a watermark, etc., so as to mark that the logistic object has executed a corresponding verification operation, such as mailing inspection, etc.
In other alternative embodiments of the present application, the behavior of the logistic object and the associated user may be analyzed based on the video data, and thus the logistic object identification of the logistic object may also be queried based on the video data. For example, in some scenarios where the identification of a logistic object cannot be determined, if the node time of the logistic object associated logistic node is determined, video data may be queried based on the node time, and then the identification of the logistic object may be identified based on the video data. For example, in a scenario that a third user such as a sender, a receiver and the like cannot determine the logistics object identification, if the third user can determine the node time of the sender node and the receiver node, the video data of the camera corresponding to the node time can be called, the logistics object on the logistics object is determined based on the video data, then the logistics object identification is identified based on the logistics object, for example, information on the logistics object is identified based on an optical character recognition (Optical Character Recognition, OCR) technology, and thus the logistics object identification is determined.
In other scenarios, the relevant information of the logistic object, the information spoken by the relevant user, etc. may be identified based on the video data, and the identification may be combined with OCR technology, natural language processing (Natural Language Processing, NLP) technology to identify various information as needed.
On the basis of the above embodiment, the present application further provides a video data processing method, which may be applied to a terminal, and may monitor whether a first user performs inspection on a logistic object in a posting process, specifically, as shown in fig. 4, including:
step 402, determining an analysis period before the face sheet printing according to the face sheet printing information;
step 404, obtaining video data shot by a shooting component in an analysis period;
step 406, transmitting the video data to determine behavior information of the first user on the logistic object in the video data.
In this embodiment of the application, the camera assembly may be understood as a camera, and the terminal may capture video data through the camera. The terminal can determine a corresponding analysis period according to the face sheet printing information, intercept video data in the analysis period and send the video data to the server, and the server can analyze the video data to determine a logistics object and a first user after receiving the video data to be analyzed. And determining behavior information of the first user on the logistic object. According to the embodiment of the application, the video data can be intercepted at the terminal, so that the amount of the video data analyzed by the server is reduced, and the processing pressure of the server is reduced.
The embodiment of the application can be applied to a mail scene and a mail taking scene. In this scenario, the third user is a pickup user, the site of the post station may further set a scanning device for scanning the logistics object information (such as a two-dimensional code) of the logistics object extracted by the third user, after the third user receives the logistics object, the third user may open and check the logistics object in the operation area to check the integrity of the logistics object, and after the integrity of the logistics object is confirmed, the third user (or the site staff) may scan the logistics object information (such as the two-dimensional code of the bill) through the scanning device to extract information. In the system of the embodiment of the application, the terminal may shoot the video data of the operation area through the camera, intercept the video data of the preset time period before the physical distribution object information is scanned (or the video data of the time period after the physical distribution object information is scanned is included) and send the video data to the server, and the server may identify and analyze the video data sent by the terminal to determine the behavior information of the physical distribution object by the third user, so as to determine whether the third user performs inspection on the physical distribution object and whether the inspection behavior has risks.
On the basis of the above embodiment, the present application further provides a video data processing method, which may be applied to a terminal, and may monitor and record inspection of a logistics object by a pickup user in a pickup process, and specifically, as shown in fig. 5, the method includes:
step 502, determining an analysis period before picking up the part according to the picking-up information.
Step 504, obtaining video data shot by the shooting component in an analysis period.
Step 506, transmitting the video data to determine behavior information of the third user on the logistic object in the video data.
In this embodiment of the application, the camera assembly may be understood as a camera, and the terminal may capture video data through the camera. In the case of taking a piece, the third user may be a piece taking user, the terminal may determine a corresponding analysis period according to the piece taking information, intercept video data in the analysis period, send the video data to the server, and after the server receives the video data to be analyzed, analyze the video data to determine the third user and the logistic object. And determining behavior information of the third user on the logistic object. In this embodiment of the present invention, the server may analyze the behavior information of the third user to determine whether the operation of the checked logistics object of the third user meets the requirements, for example, determine whether the operation of damaging the logistics object exists for the third user, so as to determine the corresponding analysis result. In the embodiment of the application, the server can determine the analysis period and intercept the video data stream in the analysis period for analysis, so that the amount of video data analyzed by the server is reduced, and the processing pressure of the server is reduced.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments and that the acts referred to are not necessarily required by the embodiments of the present application.
On the basis of the foregoing embodiment, this embodiment further provides a video data processing apparatus, and referring to fig. 6, the video data processing apparatus may specifically include the following modules:
the video data determining module 602 is configured to obtain video data to be analyzed.
The video data identifying module 604 is configured to identify the logistic object to be checked and the first user in the video data.
A behavior information determining module 606, configured to determine behavior information of the first user on the logistic object in the video data.
And the behavior information analysis module 608 is configured to analyze the behavior information of the first user on the logistic object, and determine an analysis result.
The risk prompting module 610 is configured to send out corresponding prompting information when the analysis result includes risk behaviors.
In summary, in the embodiment of the present application, according to video data to be analyzed, a logistic object and a first user in the video data can be determined, and then, a behavior of the first user in the video data for the logistic object is determined, so as to determine behavior information. And analyzing the behavior information to determine a corresponding analysis result, and sending out corresponding prompt information under the condition that the analysis result comprises risk behaviors. According to the method and the device for identifying the video data, the behavior of the first user on the logistics object is determined, the checking condition of the logistics object is not required to be determined in the mode that the first user shoots the checking photo, the first user receiving operation can be facilitated, the video data are identified through the server, and the workload of monitoring personnel of the server can be reduced.
On the basis of the above embodiment, the present embodiment further provides a video data processing apparatus, which may specifically include the following modules:
and the video data receiving module is used for receiving video data in an analysis period, and the analysis period is determined according to the face sheet printing information. In the terminal, according to the face sheet printing information of the first user printing face sheet, determining a corresponding analysis period, intercepting video data corresponding to the analysis period and sending the video data to the server. The server receives the video data for corresponding analysis.
And the operation area identification module is used for determining an operation area in the video data.
And the logistics object identification module is used for identifying the logistics objects in the operation area.
And the target user identification module is used for identifying the user in the operation area.
The first user identification module is used for carrying out feature identification on the user, and determining the first user according to the feature information, wherein the feature information comprises at least one of facial feature information, clothing feature information and other information.
And the behavior information obtaining module is used for determining behavior information of the first user aiming at the logistics object in the video data.
The analysis result obtaining module is used for analyzing the behavior information of the first user on the logistics object and determining an analysis result.
The prompt information output module is used for sending out corresponding prompt information under the condition that the analysis result comprises the risk behaviors. In this example, the prompt may be output to the second user. In other alternative embodiments, the prompt may also be output to the first user to prompt the first user to modify the behavior.
And the feedback information determining module is used for receiving feedback information of the second user so as to determine risk behaviors of the first user on the logistics object.
And the quantity information determining module is used for determining quantity information of the risk behaviors related to the site in a preset period.
And the processing mode determining module is used for determining the processing grade corresponding to the site according to the quantity information so as to determine the processing mode corresponding to the site.
The video data determining module is used for selecting at least one camera according to the analysis target; and acquiring video data shot by the at least one camera.
The charge calculation module is used for determining the volume information of the logistics object according to the video data; acquiring weight information and other information of the logistics object; and calculating the logistics cost of the logistics object according to the volume information, the weight information and other information.
In the embodiment of the application, the terminal may determine a corresponding analysis period according to the sheet printing time in the sheet printing information, intercept video data in the analysis period, send the video data to the server, and after the server receives the video data to be analyzed, analyze the video data to determine an operation area in the video data, identify a logistic object and a user in the operation area, and then determine the first user from the users according to the feature information.
After determining the logistic object and the first user, behavior information of the first user on the logistic object in the video data can be determined, and the behavior information is analyzed to determine a corresponding analysis result according to whether the behavior information comprises actions of unpacking, taking out and checking. And sending corresponding prompt information to a second user under the condition that the analysis result contains the risk behaviors, and carrying out secondary identification on the video data by the second user so as to determine whether the first user has the risk behaviors. And then the number of the risk behaviors related to the site in the preset period can be synthesized to determine the corresponding processing mode, and the site is processed. According to the method and the device for identifying the video data, the behavior of the first user on the logistics object is determined, the checking condition of the logistics object is not required to be determined in the mode that the first user shoots the checking photo, the first user receiving operation can be facilitated, the video data are identified through the server, and the workload of monitoring personnel of the server can be reduced.
On the basis of the above embodiment, this embodiment further provides a video data processing device, which can monitor whether a first user checks a logistic object in a sender sending process, and referring to fig. 7, the video data processing device specifically may include the following modules:
An analysis period acquisition module 702 is configured to determine an analysis period before the sheet printing according to the sheet printing information.
And the video data acquisition module 704 is used for acquiring video data shot by the camera shooting assembly in the analysis period.
And the video data sending module 706 is configured to send the video data to determine behavior information of the first user on the logistic object in the video data.
In summary, in the embodiment of the present application, the camera assembly may be understood as a camera, and the terminal may capture video data through the camera. The terminal can determine a corresponding analysis period according to the face sheet printing information, intercept video data in the analysis period and send the video data to the server, and the server can analyze the video data to determine a logistics object and a first user after receiving the video data to be analyzed. And determining behavior information of the first user on the logistic object. According to the embodiment of the application, the video data can be intercepted at the terminal, so that the amount of the video data analyzed by the server is reduced, and the processing pressure of the server is reduced.
On the basis of the above embodiment, the present embodiment further provides a video data processing device, which can monitor and record inspection of a logistics object by a receiving user in a receiving process, and referring to fig. 8, the video data processing device specifically may include the following modules:
The analysis period determining module 802 is configured to determine an analysis period before picking up a piece according to the picking up information.
The video data intercepting module 804 is configured to acquire video data captured by the camera component during the analysis period.
And a video data output module 806, configured to send the video data to determine behavior information of a third user in the video data on the logistic object.
In summary, in the embodiment of the present application, the camera assembly may be understood as a camera, and the terminal may capture video data through the camera. The terminal can determine a corresponding analysis period according to the piece taking information, intercept video data in the analysis period and send the video data to the server, and the server can analyze the video data to determine a third user and a logistics object after receiving the video data to be analyzed. And determining behavior information of the first user on the logistic object. In this embodiment of the present invention, the server may analyze the behavior information of the third user to determine whether the operation of the checked logistics object of the third user meets the requirements, for example, determine whether the operation of damaging the logistics object exists for the third user, so as to determine the corresponding analysis result. In the embodiment of the application, the server can determine the analysis period and intercept the video data stream in the analysis period for analysis, so that the amount of video data analyzed by the server is reduced, and the processing pressure of the server is reduced.
The embodiment of the application also provides a non-volatile readable storage medium, where one or more modules (programs) are stored, where the one or more modules are applied to a device, and the device may be caused to execute instructions (instractions) of each method step in the embodiment of the application.
Embodiments of the present application provide one or more machine-readable media having instructions stored thereon that, when executed by one or more processors, cause an electronic device to perform a method as described in one or more of the above embodiments. In this embodiment of the present application, the electronic device includes a server, a terminal device, and other devices.
Embodiments of the present disclosure may be implemented as an apparatus for performing a desired configuration using any suitable hardware, firmware, software, or any combination thereof, which may include a server (cluster), terminal, or the like. Fig. 9 schematically illustrates an example apparatus 900 that may be used to implement various embodiments described herein.
For one embodiment, fig. 9 illustrates an example apparatus 900 having one or more processors 902, a control module (chipset) 904 coupled to at least one of the processor(s) 902, a memory 906 coupled to the control module 904, a non-volatile memory (NVM)/storage 908 coupled to the control module 904, one or more input/output devices 910 coupled to the control module 904, and a network interface 912 coupled to the control module 904.
The processor 902 may include one or more single-core or multi-core processors, and the processor 902 may include any combination of general-purpose or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the apparatus 900 can be used as a server, a terminal, or the like in the embodiments of the present application.
In some embodiments, apparatus 900 can include one or more computer-readable media (e.g., memory 906 or NVM/storage 908) with instructions 914 and one or more processors 902 combined with the one or more computer-readable media configured to execute instructions 914 to implement modules to perform the actions described in this disclosure.
For one embodiment, the control module 904 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 902 and/or any suitable device or component in communication with the control module 904.
The control module 904 may include a memory controller module to provide an interface to the memory 906. The memory controller modules may be hardware modules, software modules, and/or firmware modules.
Memory 906 may be used to load and store data and/or instructions 914 for device 900, for example. For one embodiment, memory 906 may include any suitable volatile memory, such as, for example, a suitable DRAM. In some embodiments, the memory 906 may comprise a double data rate type four synchronous dynamic random access memory (DDR 4 SDRAM).
For one embodiment, the control module 904 can include one or more input/output controllers to provide an interface to the NVM/storage 908 and the input/output device(s) 910.
For example, NVM/storage 908 may be used to store data and/or instructions 914. NVM/storage 908 may include any suitable nonvolatile memory (e.g., flash memory) and/or may include any suitable nonvolatile storage device(s) (e.g., one or more Hard Disk Drives (HDDs), one or more Compact Disc (CD) drives, and/or one or more Digital Versatile Disc (DVD) drives).
NVM/storage 908 may include a storage resource as part of a device on which apparatus 900 is installed or may be accessible by the device without necessarily being part of the device. For example, NVM/storage 908 may be accessed over a network via input/output device(s) 910.
Input/output device(s) 910 may provide an interface for apparatus 900 to communicate with any other suitable device, input/output device 910 may include a communication component, an audio component, a sensor component, and the like. Network interface 912 may provide an interface for device 900 to communicate over one or more networks, and device 900 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols, such as accessing a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof.
For one embodiment, at least one of the processor(s) 902 may be packaged together with logic of one or more controllers (e.g., memory controller modules) of the control module 904. For one embodiment, at least one of the processor(s) 902 may be packaged together with logic of one or more controllers of the control module 904 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 902 may be integrated on the same die as logic of one or more controllers of the control module 904. For one embodiment, at least one of the processor(s) 902 may be integrated on the same die with logic of one or more controllers of the control module 904 to form a system on chip (SoC).
In various embodiments, apparatus 900 may be, but is not limited to being: a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.), among other terminal devices. In various embodiments, device 900 may have more or fewer components and/or different architectures. For example, in some embodiments, apparatus 900 includes one or more cameras, keyboards, liquid Crystal Display (LCD) screens (including touch screen displays), non-volatile memory ports, multiple antennas, graphics chips, application Specific Integrated Circuits (ASICs), and speakers.
The detection device can adopt a main control chip as a processor or a control module, sensor data, position information and the like are stored in a memory or an NVM/storage device, a sensor group can be used as an input/output device, and a communication interface can comprise a network interface.
The embodiment of the application also provides electronic equipment, which comprises: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments herein.
Embodiments also provide one or more machine-readable media having executable code stored thereon that, when executed, cause a processor to perform a method as described in one or more of the embodiments of the present application.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present embodiments have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the present application.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action zone without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail a video data processing method, a video data processing apparatus, an electronic device and a storage medium provided by the present application, and specific examples have been applied to illustrate the principles and embodiments of the present application, and the above examples are only used to help understand the method and core idea of the present application; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims (18)

1. A method of video data processing, the method comprising:
acquiring video data to be analyzed, wherein the video data is monitoring video data of a logistics site;
identifying a logistics object to be checked in the video data and a first user, wherein the first user is a user providing logistics service in a logistics site;
determining behavior information of the first user aiming at the logistics object in the video data, wherein the behavior information comprises behavior information of the following behaviors: opening the box, taking out and checking;
analyzing the behavior information of the first user on the logistics object to determine an analysis result;
And sending out corresponding prompt information under the condition that the analysis result lower than the target level is determined to be the analysis result containing the risk behaviors.
2. The method of claim 1, wherein the identifying the logistic object to be inspected and the first user in the video data comprises:
determining an operation region in the video data;
identifying a logistic object in the operation area;
a first user in the operating region is identified.
3. The method of claim 2, wherein the identifying the first user in the operation region comprises:
identifying a user in the operating region;
and carrying out feature recognition on the user, and determining a first user according to feature information, wherein the feature information comprises at least one of facial feature information, clothing feature information and other feature information.
4. The method of claim 1, wherein the issuing the corresponding hint information comprises:
outputting the prompt information to a second user;
and receiving feedback information of the second user to determine risk behaviors of the first user for the logistic objects.
5. The method as recited in claim 1, further comprising:
Determining the quantity information of risk behaviors related to the site in a preset period;
and determining the processing grade corresponding to the station according to the quantity information so as to determine the processing mode corresponding to the station.
6. The method of claim 1, wherein the acquiring video data to be analyzed comprises:
video data is received during an analysis period, the analysis period being determined from the facial mask printing information.
7. The method of claim 1, wherein the acquiring video data to be analyzed comprises:
receiving a video data stream;
and determining a corresponding analysis period according to the face sheet printing information of the logistics object, and acquiring a video data stream in the analysis period as video data.
8. The method of claim 1, wherein the acquiring video data to be analyzed comprises:
selecting at least one camera according to the analysis target;
and acquiring video data shot by the at least one camera.
9. The method as recited in claim 1, further comprising:
determining volume information of the logistics object according to the video data;
acquiring weight information and other information of the logistics object;
And calculating the logistics cost of the logistics object according to the volume information, the weight information and other information.
10. A method of video data processing, comprising:
determining an analysis period before the face sheet printing according to the face sheet printing information;
acquiring video data shot by a shooting assembly in the analysis period, wherein the video data is monitoring video data of a logistics site;
transmitting the video data to determine and analyze behavior information of a first user on a logistics object in the video data, determining an analysis result, and transmitting corresponding prompt information under the condition that the analysis result lower than a target level is determined to be an analysis result containing risk behaviors, wherein the behavior information comprises behavior information of the following behaviors: and opening the box, taking out and checking, wherein the first user is a user providing logistics service in the logistics site.
11. A method of video data processing, comprising:
determining an analysis period before picking up the part according to the part picking-up information;
acquiring video data shot by a shooting assembly in the analysis period, wherein the video data is monitoring video data of a logistics site;
transmitting the video data to determine behavior information of a third user on the logistic object in the video data and analyzing the behavior information to determine whether the operation of the logistic object checked by the third user meets the requirements, wherein the behavior information comprises the following behavior information: and opening the box, taking out and checking, wherein the third user is a user using logistics service in the logistics site.
12. A video data processing apparatus, said apparatus comprising:
the video data determining module is used for acquiring video data to be analyzed, wherein the video data is monitoring video data of a logistics site;
the video data identification module is used for identifying a logistics object to be checked in the video data and a first user, wherein the first user is a user providing logistics service in a logistics site;
the behavior information determining module is used for determining behavior information of the first user aiming at the logistics object in the video data, wherein the behavior information comprises the following behavior information: opening the box, taking out and checking;
the behavior information analysis module is used for analyzing the behavior information of the first user on the logistics object and determining an analysis result;
and the risk prompting module is used for sending corresponding prompting information under the condition that the analysis result lower than the target level is determined to be the analysis result containing the risk behavior.
13. A video data processing apparatus, said apparatus comprising:
the analysis period acquisition module is used for determining an analysis period before the face sheet printing according to the face sheet printing information;
The video data acquisition module is used for acquiring video data shot by the shooting assembly in the analysis period, wherein the video data is monitoring video data of the logistics site;
the video data sending module is used for sending the video data to determine and analyze behavior information of a first user on a logistics object in the video data, determining an analysis result, and sending corresponding prompt information when the analysis result lower than a target level is determined to be an analysis result containing risk behaviors, wherein the behavior information comprises the following behavior information: and opening the box, taking out and checking, wherein the first user is a user providing logistics service in the logistics site.
14. A video data processing apparatus, said apparatus comprising:
the analysis period determining module is used for determining an analysis period before picking up the part according to the picking-up information;
the video data intercepting module is used for acquiring video data shot by the shooting component in the analysis period, wherein the video data is monitoring video data of the logistics site;
the video data output module is used for sending the video data to determine the behavior information of the third user on the logistic object in the video data and analyzing the behavior information to determine whether the operation of the logistic object checked by the third user meets the requirements or not, wherein the behavior information comprises the following behavior information: and opening the box, taking out and checking, wherein the third user is a user using logistics service in the logistics site.
15. An electronic device, comprising: processor and method for controlling the same
A memory having executable code stored thereon that, when executed, causes the processor to perform the method of any of claims 1-9.
16. One or more machine readable media having executable code stored thereon that, when executed, causes a processor to perform the method of any of claims 1-9.
17. An electronic device, comprising: processor and method for controlling the same
A memory having executable code stored thereon that, when executed, causes the processor to perform the method of claim 10 or 11.
18. One or more machine readable media having executable code stored thereon that, when executed, causes a processor to perform the method of claim 10 or 11.
CN202010683224.2A 2020-07-15 2020-07-15 Video data processing method, device, electronic equipment and storage medium Active CN111967321B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010683224.2A CN111967321B (en) 2020-07-15 2020-07-15 Video data processing method, device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010683224.2A CN111967321B (en) 2020-07-15 2020-07-15 Video data processing method, device, electronic equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111967321A CN111967321A (en) 2020-11-20
CN111967321B true CN111967321B (en) 2024-04-05

Family

ID=73360816

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010683224.2A Active CN111967321B (en) 2020-07-15 2020-07-15 Video data processing method, device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111967321B (en)

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6678413B1 (en) * 2000-11-24 2004-01-13 Yiqing Liang System and method for object identification and behavior characterization using video analysis
WO2016047949A1 (en) * 2014-09-24 2016-03-31 삼성에스디에스 주식회사 Method and apparatus for logistics risk prediction
CN107909742A (en) * 2017-11-15 2018-04-13 蒋新军 A kind of autonomous method and apparatus for posting part
CN109902195A (en) * 2019-01-31 2019-06-18 深圳市丰巢科技有限公司 Monitoring image querying method, device, equipment and medium
CN110060432A (en) * 2015-08-03 2019-07-26 天使游戏纸牌股份有限公司 The cheating detection system of amusement park
CN110309801A (en) * 2019-07-05 2019-10-08 名创优品（横琴）企业管理有限公司 A kind of video analysis method, apparatus, system, storage medium and computer equipment
CN110310007A (en) * 2019-05-22 2019-10-08 菜鸟智能物流控股有限公司 Risk Identification Method, device, equipment and storage medium
CN110472870A (en) * 2019-08-15 2019-11-19 成都睿晓科技有限公司 A kind of cashier service regulation detection system based on artificial intelligence
CN110543803A (en) * 2018-05-29 2019-12-06 菜鸟智能物流控股有限公司 Monitoring method, device, server and storage medium
CN110866429A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Missed scanning identification method and device, self-service cash register terminal and system
CN110876038A (en) * 2018-09-03 2020-03-10 陆洪瑞 Traceable video monitoring system and method for trading place
CN110895746A (en) * 2018-09-12 2020-03-20 菜鸟智能物流控股有限公司 Logistics object management method, device, equipment and storage medium
CN111191523A (en) * 2019-12-11 2020-05-22 秒针信息技术有限公司 Information display method and device, storage medium and electronic device
CN111222825A (en) * 2020-01-14 2020-06-02 深圳壹账通智能科技有限公司 Double-recording method, device, terminal and storage medium based on goods signing
CN111382944A (en) * 2020-03-11 2020-07-07 江苏苏宁物流有限公司 Job behavior risk identification method and device, computer equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8804997B2 (en) * 2007-07-16 2014-08-12 Checkvideo Llc Apparatus and methods for video alarm verification

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6678413B1 (en) * 2000-11-24 2004-01-13 Yiqing Liang System and method for object identification and behavior characterization using video analysis
WO2016047949A1 (en) * 2014-09-24 2016-03-31 삼성에스디에스 주식회사 Method and apparatus for logistics risk prediction
CN110060432A (en) * 2015-08-03 2019-07-26 天使游戏纸牌股份有限公司 The cheating detection system of amusement park
CN107909742A (en) * 2017-11-15 2018-04-13 蒋新军 A kind of autonomous method and apparatus for posting part
CN110543803A (en) * 2018-05-29 2019-12-06 菜鸟智能物流控股有限公司 Monitoring method, device, server and storage medium
CN110866429A (en) * 2018-08-28 2020-03-06 阿里巴巴集团控股有限公司 Missed scanning identification method and device, self-service cash register terminal and system
CN110876038A (en) * 2018-09-03 2020-03-10 陆洪瑞 Traceable video monitoring system and method for trading place
CN110895746A (en) * 2018-09-12 2020-03-20 菜鸟智能物流控股有限公司 Logistics object management method, device, equipment and storage medium
CN109902195A (en) * 2019-01-31 2019-06-18 深圳市丰巢科技有限公司 Monitoring image querying method, device, equipment and medium
CN110310007A (en) * 2019-05-22 2019-10-08 菜鸟智能物流控股有限公司 Risk Identification Method, device, equipment and storage medium
CN110309801A (en) * 2019-07-05 2019-10-08 名创优品（横琴）企业管理有限公司 A kind of video analysis method, apparatus, system, storage medium and computer equipment
CN110472870A (en) * 2019-08-15 2019-11-19 成都睿晓科技有限公司 A kind of cashier service regulation detection system based on artificial intelligence
CN111191523A (en) * 2019-12-11 2020-05-22 秒针信息技术有限公司 Information display method and device, storage medium and electronic device
CN111222825A (en) * 2020-01-14 2020-06-02 深圳壹账通智能科技有限公司 Double-recording method, device, terminal and storage medium based on goods signing
CN111382944A (en) * 2020-03-11 2020-07-07 江苏苏宁物流有限公司 Job behavior risk identification method and device, computer equipment and storage medium

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
Ubiquitous system to monitor transport and logistics;Caballero-Gil Pino;《Proceedings of the 15th ACM International Symposium on Performance Evaluation of Wireless Ad Hoc, Sensor, & Ubiquitous Networks》;71-75 *
基于RFID的货物行为姿态检测方法;王绍丹 等;《微型机与应用》;第36卷(第16期);11-14+18 *
基于深度学习的异常行为检测技术及其应用;赵鹏飞;《中国优秀硕士学位论文全文数据库 (信息科技辑)》(第03期);I138-1032 *
小型超市收银台视频监控系统;孙妍妍;《中国优秀硕士学位论文全文数据库 (信息科技辑)》(第09期);I140-505 *
智能交通中私揽规范行为自动检测;张若杨 等;《中国高科技产业化研究会智能信息处理产业化分会.第十二届全国信号和智能信息处理与应用学术会议论文集》;321-326 *

Also Published As

Publication number Publication date
CN111967321A (en) 2020-11-20

Similar Documents

Publication Publication Date Title
CN111967322B (en) Data processing method, device, electronic equipment and storage medium
CN106339880A (en) Product production method and system for users to trace and examine filling process easily
US8805123B2 (en) System and method for video recognition based on visual image matching
CN110598008B (en) Method and device for detecting quality of recorded data and storage medium
WO2021164448A1 (en) Quality abnormity recording method and apparatus, and augmented reality device, system and medium
CN107818434B (en) Pickup verification method, server, pickup verification device and pickup verification system
CN108064394A (en) Method and device for detecting security check article and electronic equipment
CN112788269B (en) Video processing method, device, server and storage medium
CN112100431A (en) Evaluation method, device and equipment of OCR system and readable storage medium
CN109784958A (en) Tealeaves is traced to the source method for anti-counterfeit, device, storage medium and server
CN109495723A (en) A kind of domestic intelligent monitoring system calculated based on mist
CN111666816A (en) Method, device and equipment for detecting state of logistics piece
CN113568934B (en) Data query method and device, electronic equipment and storage medium
CN111914649A (en) Face recognition method and device, electronic equipment and storage medium
CN111523348B (en) Information generation method and device and equipment for man-machine interaction
CN113414136B (en) Storage medium destroying method, device and system and storage medium
US20210279372A1 (en) Fabric detecting and recording method and apparatus
CN111985326B (en) Data processing method, device, electronic equipment and storage medium
CN111967321B (en) Video data processing method, device, electronic equipment and storage medium
CN112419257A (en) Method and device for detecting definition of text recorded video, computer equipment and storage medium
CN107734120A (en) The fluency method for testing performance of terminal device
CN111626369B (en) Face recognition algorithm effect evaluation method and device, machine readable medium and equipment
CN107707610A (en) A kind of data Right protection method and system based on cloud platform
CN113252678A (en) Appearance quality inspection method and equipment for mobile terminal
CN111768563A (en) Article storage method and device, computer-readable storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant