WO2022160678A1 - 轨交驾驶员的动作检测方法及装置、设备、介质及工具 - Google Patents

轨交驾驶员的动作检测方法及装置、设备、介质及工具 Download PDF

Info

Publication number
WO2022160678A1
WO2022160678A1 PCT/CN2021/113544 CN2021113544W WO2022160678A1 WO 2022160678 A1 WO2022160678 A1 WO 2022160678A1 CN 2021113544 W CN2021113544 W CN 2021113544W WO 2022160678 A1 WO2022160678 A1 WO 2022160678A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
driver
rail vehicle
action information
predetermined standard
Prior art date
Application number
PCT/CN2021/113544
Other languages
English (en)
French (fr)
Inventor
何裕康
梁冠华
毛宁元
许亮
Original Assignee
上海商汤临港智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海商汤临港智能科技有限公司 filed Critical 上海商汤临港智能科技有限公司
Publication of WO2022160678A1 publication Critical patent/WO2022160678A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Definitions

  • the present disclosure relates to the technical field of rail transit, and in particular, to a method and device for motion detection of rail transit drivers, electronic equipment, storage media and rail vehicles.
  • the present disclosure provides a technical solution for motion detection of rail transit drivers.
  • a motion detection method for a rail transit driver including:
  • the driver's action information is sent to a preset driver management device.
  • the method further includes: acquiring traffic signal information in front of the rail vehicle;
  • the predetermined standard action information is determined according to the traffic signal information in front of the rail vehicle.
  • determining the predetermined standard action information according to the traffic signal information in front of the rail vehicle includes:
  • predetermined standard action information is determined according to the acquired traffic signal information in front of the rail vehicle.
  • the acquiring the traffic signal information in front of the rail vehicle includes: performing traffic signal analysis on the second video stream in front of the rail vehicle to obtain the traffic signal in front of the rail vehicle information.
  • the traffic signal information in front of the rail vehicle includes at least one of the following: information on traffic lights in front of the rail vehicle, information on gesture traffic guidance signals in front of the rail vehicle , the information of the protective signal in front of the rail vehicle.
  • the acquiring the traffic signal information in front of the rail vehicle includes:
  • the matching of the driver's action information with predetermined standard action information includes:
  • the driver's action information is matched with predetermined standard action information corresponding to a preset non-signal-triggered operation.
  • the method further includes:
  • the video clip corresponding to the driver's action information In the first video stream, the video clip corresponding to the driver's action information
  • the relevant data of the driver's action information further includes at least one of the following: the predetermined standard action information, the traffic signal information in front of the rail vehicle corresponding to the driver's action information , the position information of the rail vehicle corresponding to the action information of the driver.
  • the method further includes:
  • At least one of the following is performed:
  • the first prompt information and the second prompt information are used to prompt that the action information of the driver does not match the predetermined standard action information.
  • a motion detection device for a rail transit driver including:
  • a first acquisition module used for acquiring the first video stream of the driving area of the rail vehicle
  • a detection module configured to detect the motion information of the driver of the rail vehicle according to the first video stream
  • a matching module for matching the driver's action information with predetermined standard action information
  • a first sending module configured to send the action information of the driver to a preset driver management device in response to the successful matching of the action information of the driver with the predetermined standard action information.
  • the apparatus further includes:
  • the second acquisition module acquires the traffic signal information in front of the rail vehicle
  • the determining module is configured to determine the predetermined standard action information according to the traffic signal information in front of the rail vehicle before matching the driver's action information with the predetermined standard action information.
  • the determining module is used for:
  • predetermined standard action information is determined according to the acquired traffic signal information in front of the rail vehicle.
  • the second acquisition module is configured to: perform traffic signal analysis on the second video stream in front of the rail vehicle to obtain traffic signal information in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle includes at least one of the following: information on traffic lights in front of the rail vehicle, information on gesture traffic guidance signals in front of the rail vehicle , the information of the protective signal in front of the rail vehicle.
  • the second obtaining module is used for:
  • the matching module is used to:
  • the driver's action information is matched with predetermined standard action information corresponding to a preset non-signal-triggered operation.
  • the apparatus further includes:
  • a second sending module configured to send the relevant data of the driver's action information to the preset driver management device in response to the successful matching between the driver's action information and the predetermined standard action information, wherein, The relevant data includes:
  • the video clip corresponding to the driver's action information In the first video stream, the video clip corresponding to the driver's action information
  • the relevant data of the driver's action information further includes at least one of the following: the predetermined standard action information, the traffic signal information in front of the rail vehicle corresponding to the driver's action information , the position information of the rail vehicle corresponding to the action information of the driver.
  • the apparatus further includes:
  • a matching failure operation module configured to perform at least one of the following in response to the failure to match the driver's action information with the predetermined standard action information:
  • the first prompt information and the second prompt information are used to prompt that the action information of the driver does not match the predetermined standard action information.
  • a rail vehicle comprising:
  • a first camera for collecting a first video stream of the driving area of the rail vehicle
  • the intelligent analysis device is used to obtain the first video stream from the first camera, detect the motion information of the driver of the rail vehicle according to the first video stream, and compare the motion information of the driver with the predetermined The standard action information is matched, and in response to the successful matching between the driver's action information and the predetermined standard action information, the driver's action information is sent to a preset driver management device.
  • the rail vehicle further includes: a second camera for capturing a second video stream in front of the rail vehicle;
  • the intelligent analysis device is further configured to: acquire a second video stream in front of the rail vehicle from the second camera, perform traffic signal analysis on the second video stream, and obtain a traffic signal in front of the rail vehicle information, and determine predetermined standard action information according to the traffic signal information in front of the rail vehicle.
  • the rail vehicle further includes: train control on-board equipment for acquiring the information of the speed limit signal in front of the rail vehicle;
  • the intelligent analysis device is further configured to: obtain information of the speed limit signal in front of the rail vehicle from the train control vehicle device, and determine predetermined standard action information according to the information of the speed limit signal in front of the rail vehicle .
  • the intelligent analysis device is further used for:
  • the video clip corresponding to the driver's action information In the first video stream, the video clip corresponding to the driver's action information
  • the intelligent analysis device is further configured to: if the driver's action information fails to match the predetermined standard action information, perform at least one of the following: send first prompt information to the preset driver management device; control setting The information output device in the rail vehicle sends out second prompt information; wherein the first prompt information and the second prompt information are used to prompt that the driver's action information is different from the predetermined standard action information match;
  • the rail vehicle further includes: the information output device, configured to issue the second prompt information.
  • an electronic device comprising: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke the memory storage executable instructions to perform the above method.
  • a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions implementing the above method when executed by a processor.
  • a computer program product comprising computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code, when the computer-readable code is stored in an electronic device When running, the processor in the electronic device executes the above method.
  • the first video stream of the driving area of the rail vehicle is acquired, the motion information of the driver of the rail vehicle is detected according to the first video stream, and the motion information of the driver is compared with the driver's motion information.
  • Predetermined standard action information is matched, and in response to the successful matching between the driver's action information and the predetermined standard action information, the driver's action information is sent to a preset driver management device, so that the driver's action information can be based on the
  • the video stream of the driving area of the rail vehicle performs high-precision, low-cost, and non-perceptual analysis of the actions of the rail transit drivers, which helps to manage the driving behavior of the rail transit drivers and helps to improve the rail transit driver's behavior. safety.
  • FIG. 1 shows a flowchart of a method for detecting motion of a rail transit driver provided by an embodiment of the present disclosure.
  • Figure 2 shows a schematic diagram of the predetermined standard action information corresponding to the traffic signal information in front of the rail vehicle, "extend the index finger and the middle finger of the right hand together, and the center of the fist is to the left, pointing to the confirmation object".
  • Fig. 3 is a schematic diagram showing the predetermined standard action information "extend the right hand flat, raise the fist with the thumb upright, and the heart of the fist to the left" corresponding to the traffic signal information in front of the rail vehicle.
  • Fig. 4 shows a schematic diagram of the predetermined standard action information "extend the right hand flatly, raise the thumb and little finger with the fist together, and turn the heart of the fist to the left" corresponding to the traffic signal information in front of the rail vehicle.
  • Figure 5 shows a schematic diagram of the predetermined standard action information corresponding to the traffic signal information in front of the rail vehicle, "Right arm clenched fist, fist raised to eyebrow level, fist heart to the left, forearm shaking up and down 3 times".
  • FIG. 6 shows a schematic diagram of the predetermined standard action information corresponding to the preset non-signal-triggered operation “right arm clenched fist, upper and lower arms at 90°, raised fist aligned with eyebrows, and fist heart to the left”.
  • FIG. 7 is a schematic diagram showing the predetermined standard action information corresponding to the preset non-signal-triggered operation "the five fingers of the right hand are stretched together and pointed to the relevant confirmation device in sequence from left to right".
  • FIG. 8 shows a block diagram of a motion detection device for a rail transit driver provided by an embodiment of the present disclosure.
  • FIG. 9 shows an exemplary block diagram of a rail vehicle provided by an embodiment of the present disclosure.
  • FIG. 10 shows another exemplary block diagram of a rail vehicle provided by an embodiment of the present disclosure.
  • FIG. 11 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
  • FIG. 12 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
  • the first video stream of the driving area of the rail vehicle is acquired, the motion information of the driver of the rail vehicle is detected according to the first video stream, and the motion information of the driver is compared with the driver's motion information.
  • Predetermined standard action information is matched, and in response to the successful matching between the driver's action information and the predetermined standard action information, the driver's action information is sent to a preset driver management device, so that the driver's action information can be based on the
  • the video stream of the driving area of the rail vehicle performs high-precision, low-cost, and non-perceptual analysis of the actions of the rail transit drivers, which helps to manage the driving behavior of the rail transit drivers and helps to improve the rail transit driver's behavior. safety.
  • FIG. 1 shows a flowchart of a method for detecting motion of a rail transit driver provided by an embodiment of the present disclosure.
  • the motion detection method of the rail transit driver may be executed by a terminal device or a server or other processing device.
  • the terminal equipment can be installed on the rail vehicle.
  • the terminal device may be an intelligent analysis device (such as an intelligent analysis box), a vehicle-mounted device, a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device Or wearable devices, etc.
  • the intelligent analysis device can be installed in any position of the rail vehicle.
  • the intelligent analysis device may be installed in the cockpit of the rail vehicle.
  • the intelligent analysis device may be installed in the chassis of the rail vehicle.
  • the method for detecting the motion of the rail transit driver may be implemented by the processor calling computer-readable instructions stored in the memory.
  • the motion detection method of the rail transit driver can be applied to rail vehicles. As shown in FIG. 1 , the motion detection method of the rail transit driver includes steps S11 to S14.
  • step S11 a first video stream of the driving area of the rail vehicle is acquired.
  • step S12 the motion information of the driver of the rail vehicle is detected according to the first video stream.
  • step S13 the driver's action information is matched with predetermined standard action information.
  • step S14 in response to the successful matching of the driver's action information with the predetermined standard action information, the driver's action information is sent to a preset driver management device.
  • a rail vehicle may represent a vehicle that needs to travel on a specific track.
  • the rail vehicles may be trains, subways, trams, maglev trains, and the like.
  • the first video stream represents a video stream of a driving area of the rail vehicle.
  • the first video stream may include image information of the driver of the rail vehicle.
  • the first video stream may further include image information of the driving console of the rail vehicle.
  • the driving console may include a display screen and/or an instrument and the like.
  • at least one first camera may be installed on the rail vehicle, and the first camera may be used to capture the first video stream.
  • the first camera may be installed in the cockpit of the rail vehicle, and may be installed toward the driver.
  • At least one type of motion detection may be performed on the driver of the rail vehicle according to the first video stream to obtain motion information of the driver, wherein the driver's motion information is
  • the action information may include at least one type of action information.
  • at least one of gesture detection, arm motion detection, head motion detection, mouth motion detection, line of sight detection, etc. may be performed on the driver according to the first video stream.
  • the driver's motion information may include at least one of gesture information, arm motion information, head motion information, mouth motion information, line of sight information, and the like.
  • the predetermined standard motion information may include at least one of predetermined standard gesture information, predetermined arm standard motion information, predetermined head standard motion information, predetermined mouth standard motion information, predetermined sight line standard information, and the like. Thereby, at least one of gestures, arm movements, head movements, mouth movements, sight lines, etc. of the driver of the rail vehicle can be detected and managed.
  • a first neural network for motion detection of drivers may be pre-trained, and the first video stream of the driving area of the rail vehicle is input into the first neural network, and the The first neural network detects the motion of the driver of the rail vehicle according to the first video stream detection, and obtains motion information of the driver.
  • different types of action detection may be performed by different neural networks, or may be performed by the same neural network, which is not limited here.
  • a function for performing motion detection on images and/or videos may also be pre-designed, and motion detection is performed on the first video stream of the driving area of the rail vehicle through the first function, The driver's action information is obtained.
  • the predetermined standard action information may represent information of predetermined standard actions. That is, the predetermined standard action information may embody a predetermined standard action.
  • the predetermined standard action information may include at least one of the type, sequence, number of times, duration and the like of the predetermined standard action.
  • the predetermined standard action information may be determined according to the action specification and/or the mouth call specification in the "finger mouth call" specification. In one example, if the driver's action information is successfully matched with the predetermined standard action information, it may be determined that the driver meets the "finger-to-mouth" specification.
  • the successful matching between the driver's action information and the predetermined standard action information may indicate that the difference between the driver's action information and the predetermined standard action information is within a preset allowable range
  • the failure to match the driver's action information with the predetermined standard action information may indicate that the difference between the driver's action information and the predetermined standard action information exceeds a preset allowable range.
  • the predetermined standard action information may include predetermined standard gesture information.
  • the predetermined standard gesture information may represent information of predetermined standard gestures. That is, the predetermined standard gesture information may embody the predetermined standard gesture.
  • the predetermined standard gesture information may include at least one of the type, sequence, and number of predetermined standard gestures.
  • the predetermined standard motion information may include predetermined arm standard motion information.
  • the predetermined arm standard action information may represent information of predetermined arm standard actions. That is, the predetermined arm standard action information may reflect the predetermined arm standard action.
  • the arm standard action represents the standard arm action.
  • the predetermined arm standard motion information may include at least one of the type, sequence, and number of predetermined arm standard motions.
  • the predetermined standard action information may include predetermined header standard action information.
  • the predetermined head standard action information may represent information of predetermined head standard actions. That is, the predetermined head standard motion information may embody the predetermined head standard motion.
  • the standard head action refers to the standard head action.
  • the predetermined head standard motion information may include at least one of the type, sequence, and number of predetermined head standard motions.
  • the predetermined standard motion information may include predetermined mouth standard motion information.
  • the predetermined standard mouth movement information may represent information of predetermined standard mouth movements. That is, the predetermined standard mouth movement information may reflect the predetermined standard mouth movement.
  • the standard mouth movement refers to the standard mouth movement.
  • the predetermined standard mouth movement information may include at least one of the type, sequence, number, duration, and the like of the predetermined standard mouth movements.
  • the type of predetermined mouth standard motion includes opening the mouth.
  • the predetermined standard action information may include predetermined line of sight standard information.
  • the predetermined standard line-of-sight information may represent information of a predetermined line-of-sight standard. That is, the predetermined standard line-of-sight information may embody a predetermined line-of-sight standard.
  • the predetermined standard line of sight information may include at least one of the direction, sequence, number of times, duration of stay or gaze, and the like of the predetermined standard line of sight.
  • the predetermined standard action information may include predetermined standard action information corresponding to a signal-triggered operation and/or predetermined standard action information corresponding to a non-signal-triggered operation.
  • the predetermined standard action information corresponding to the signal triggering operation may represent predetermined standard action information determined according to the triggering of a traffic signal or other signal (eg, a signal from a cloud device, etc.) in front of the rail vehicle.
  • the predetermined standard action information corresponding to the non-signal-triggered operation may represent predetermined standard action information that does not need to be triggered by a traffic signal or other signal in front of the rail vehicle.
  • the preset driver management device may represent a preset device for driver management.
  • the preset number of driver management devices may be one or more.
  • the preset driver management device may include a cloud device (for example, a server of a cloud platform).
  • the preset driver management device may include a terminal device of an operator of the rail vehicle.
  • the first video stream of the driving area of the rail vehicle is acquired, the motion information of the driver of the rail vehicle is detected according to the first video stream, and the motion information of the driver is compared with the driver's motion information.
  • Predetermined standard action information is matched, and in response to the successful matching between the driver's action information and the predetermined standard action information, the driver's action information is sent to a preset driver management device, so that the driver's action information can be based on the
  • the video stream of the driving area of the rail vehicle performs high-precision, low-cost, and non-perceptual analysis of the actions of the rail transit drivers, which helps to manage the driving behavior of the rail transit drivers and helps to improve the rail transit driver's behavior. safety.
  • the method further includes: acquiring traffic signal information in front of the rail vehicle; before matching the driver's action information with predetermined standard action information, The traffic signal information in front of the tool determines the predetermined standard action information.
  • the traffic signal information in front of the rail vehicle may represent the information of the traffic signal in front of the rail vehicle. That is, the traffic signal information in front of the rail vehicle may reflect the traffic signal in front of the rail vehicle.
  • the corresponding relationship between the traffic signal information and the predetermined standard action information can be determined according to the "finger mouth call" specification. Of course, the corresponding relationship between the traffic signal information and the predetermined standard action information can also be flexibly set according to the actual application scenario requirements.
  • the relationship between the traffic signal information and the predetermined standard action information may be one-to-one, one-to-many, or many-to-one, which is not limited herein.
  • the predetermined standard action information corresponding to the traffic signal information in front of the rail vehicle can be determined.
  • the process of driving the rail vehicle can be achieved.
  • the corresponding predetermined standard action information is accurately determined based on the traffic signal information in front of the rail vehicle, thereby contributing to more accurate driver behavior management.
  • the determining the predetermined standard action information according to the traffic signal information in front of the rail vehicle includes: when the traffic signal information in front of the rail vehicle is acquired within a predetermined time range , and determine predetermined standard action information according to the acquired traffic signal information in front of the rail vehicle.
  • the predetermined time range may be 5 seconds, 10 seconds, etc., which can be flexibly set by those skilled in the art according to actual application scenarios (eg, the running speed of the rail vehicle, etc.). If the traffic signal information in front of the rail vehicle is acquired within a predetermined time range, it can be determined according to the correspondence between the traffic signal information and the predetermined standard action information that is currently used for matching with the driver's action information The predetermined standard action information.
  • the predetermined standard action information is determined according to the acquired traffic signal information in front of the rail vehicle, thereby The predetermined standard action information can be determined based on the real-time traffic signal information in front of the rail vehicle, thereby contributing to more accurate driver behavior management.
  • the acquiring the traffic signal information in front of the rail vehicle includes: performing traffic signal analysis on the second video stream in front of the rail vehicle to obtain the traffic signal information in front of the rail vehicle.
  • the second video stream represents the video stream in front of the rail vehicle.
  • at least one second camera is further installed on the rail vehicle, and the second camera is used to capture a second video stream in front of the rail vehicle.
  • the second camera may be installed towards the front of the rail vehicle, for example, the second camera may be installed towards the rail to capture a second video stream in front of the rail vehicle.
  • the second camera can be installed in the cockpit of the rail vehicle, or can be installed outside the cockpit of the rail vehicle.
  • the second video stream may include image information of the track in front of the rail vehicle, and/or the second video stream may include image information above the track in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle can be obtained, so that the visual information in front of the rail vehicle can be accurately and accurately determined according to the visual information in front of the rail vehicle.
  • the traffic signal information ahead of the rail vehicle is determined in a timely manner.
  • a second neural network for analyzing traffic signals may be pre-trained, a second video stream in front of the rail vehicle is input into the second neural network, and the track is output via the second neural network Traffic signal information ahead of the vehicle.
  • a second function for performing traffic signal analysis on images and/or videos may also be pre-designed, and traffic signal analysis is performed on the second video stream in front of the rail vehicle through the second function. to obtain the traffic signal information in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle includes at least one of the following: information on traffic lights in front of the rail vehicle, information on gesture traffic guidance signals in front of the rail vehicle, Information on the guard signal in front of the rail vehicle.
  • the information of the traffic light in front of the rail vehicle may represent the status of the traffic light in front of the rail vehicle.
  • the information of the traffic light in front of the rail vehicle may include: a traffic light appears in front of the rail vehicle, and the traffic light is displayed as green light, yellow light, red light, green and yellow light, double yellow light, or yellow flashing yellow light Wait.
  • the information of the traffic light in front of the rail vehicle may be any one of the following: a traffic light appears in front of the rail vehicle, and the traffic light displays a green light or a green-yellow light; a traffic light appears in front of the rail vehicle, And the traffic light shows a yellow light; a traffic light appears in front of the rail vehicle, and the traffic light shows double yellow lights or yellow flashing yellow light; a traffic light appears in front of the rail vehicle, and the traffic light shows a red light; and so on.
  • the gesture traffic guidance signal refers to a railway movement signal, which is various commands issued by people directly waving signal flags and signal lights.
  • the gesture traffic guidance signal is also called a hand signal.
  • the information of the gesture traffic guidance signal in front of the rail vehicle may include the type of the gesture traffic guidance signal in front of the rail vehicle.
  • the information of the gesture traffic guidance signal in front of the rail vehicle may include that the gesture traffic guidance signal in front of the rail vehicle is a stop signal, a deceleration signal, a departure signal, a pass signal, or a guidance signal, and the like.
  • the protective signal refers to the signal that ensures the safety of traffic at the intersection of railway lines in the section.
  • the information of the guard signal in front of the rail vehicle may indicate the status of the guard signal in front of the rail vehicle.
  • Predetermined standard action information is determined based on at least one of the information of the traffic lights in front of the rail vehicle, the information of the gesture traffic guidance signal in front of the rail vehicle, and the information of the guard signal in front of the rail vehicle , which in turn contributes to accurate analysis of the driver's movements.
  • the traffic signal information in front of the rail vehicle includes "a traffic signal appears, and the traffic signal is displayed as a green light or a green-yellow light", and the traffic signal information in front of the rail vehicle "a traffic signal appears, and the traffic signal is displayed as
  • the predetermined standard action information corresponding to the green light or green-yellow light includes “the right hand stretches out the index finger and the middle finger together, and the fist is to the left, pointing at the traffic light”.
  • the traffic signal light appears, and the traffic signal light is displayed as green light or green-yellow light may indicate that the traffic signal light in front of the rail vehicle shows that it is required to pass.
  • Figure 2 shows a schematic diagram of the predetermined standard action information corresponding to the traffic signal information in front of the rail vehicle, "extend the index finger and the middle finger of the right hand together, and the center of the fist is to the left, pointing to the confirmation object".
  • the traffic signal information in front of the rail vehicle includes the information of the gesture traffic guidance signal
  • the predetermined standard action information corresponding to the information of the gesture traffic guidance signal includes "the right hand stretches out the index finger and the middle finger together, the fist is to the left, and the pointing gesture. "traffic guidance signal” or “extend the index finger and middle finger of the left hand together, fist to the right, pointing to the gesture traffic guidance signal”.
  • the traffic signal information in front of the rail vehicle includes information of a protective signal (such as a derailment device), and the predetermined standard action information corresponding to the information of the protective signal includes "the right hand stretches out the index finger and the middle finger together, and the fist is turned to the left. , point to the protective signal” or “extend the index finger and middle finger of the left hand together, and the center of the fist is to the right, pointing to the protective signal".
  • a protective signal such as a derailment device
  • the traffic signal information in front of the rail vehicle includes "traffic lights appear, and the traffic lights are displayed as yellow lights", and the traffic signal information in front of the rail vehicles "traffic lights appear, and the traffic lights are displayed as yellow lights”
  • the corresponding predetermined standard action information includes “extend the right hand flat, fold the fist and extend the thumb upright, the heart of the fist to the left” or “extend the left hand flatly, fold the fist and extend the thumb upright, the heart of the fist to the right”.
  • "a traffic signal light appears and the traffic signal light is displayed as a yellow light” may indicate that the traffic signal light in front of the rail vehicle indicates that a forward path is required to prepare for parking.
  • Fig. 3 is a schematic diagram showing the predetermined standard action information "extend the right hand flat, raise the fist with the thumb upright, and the heart of the fist to the left” corresponding to the traffic signal information in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle includes "traffic lights appear, and the traffic lights are displayed as double yellow lights or yellow flashing yellow", and the traffic signal information in front of the rail vehicles "traffic lights appear, and traffic lights appear.
  • the predetermined standard action information corresponding to the signal light is displayed as double yellow lights or yellow flashing yellow” includes “extend the right hand, raise the thumb and little finger, and turn the heart of the fist to the left”.
  • the traffic signal light appears, and the traffic signal light is displayed as double yellow light or yellow flashing yellow” may indicate that the traffic signal light in front of the rail vehicle shows that the lateral path operation is required.
  • Fig. 4 shows a schematic diagram of the predetermined standard action information "extend the right hand flatly, raise the thumb and little finger with the fist together, and turn the heart of the fist to the left” corresponding to the traffic signal information in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle includes "a traffic signal appears, and the traffic signal is displayed as a red light", and the traffic signal information in front of the rail vehicle "a traffic signal appears, and the traffic signal is displayed as a red light.”
  • the corresponding predetermined standard action information includes "right arm clenched fist, raised fist with eyebrows, fist heart to the left, forearm shaking up and down 3 times”.
  • the red light can be a permanent red light or a temporary red light.
  • the traffic light appears and the traffic light is red may mean that the traffic light in front of the rail vehicle indicates that parking is required.
  • Figure 5 shows a schematic diagram of the predetermined standard action information corresponding to the traffic signal information in front of the rail vehicle, "Right arm clenched fist, fist raised to eyebrow level, fist heart to the left, forearm shaking up and down 3 times".
  • the acquiring the traffic signal information in front of the rail vehicle includes: acquiring the information of the speed limit signal in front of the rail vehicle collected by the train control vehicle-mounted device.
  • the traffic signal information in front of the rail vehicle may include information on a speed limit signal in front of the rail vehicle.
  • a train control vehicle-mounted device (LKJ) may also be provided on the rail vehicle.
  • the train control on-board device may send a speed limit signal in front of the rail vehicle to a motion detection device (such as an intelligent analysis device) of the rail vehicle driver in response to a change in the speed limit in front of the rail vehicle. information.
  • the on-board train control device can transmit the information of the speed limit signal in front of the rail vehicle to the intelligent analysis device through the signal line, so that the intelligent analysis device can obtain the information of the speed limit signal in front of the rail vehicle.
  • the information of the speed limit signal in front of the rail vehicle may include numerical information of the speed limit in front of the rail vehicle and/or difference information between the speed limit in front of the rail vehicle and the current speed limit.
  • by acquiring the information of the speed limit signal in front of the rail vehicle collected by the train control on-board equipment, and determining the predetermined standard action information based on the information of the speed limit signal in front of the rail vehicle it is helpful to Accurately analyzes the driver's movements.
  • the traffic signal information in front of the rail vehicle includes information about the speed limit signal in front of the rail vehicle obtained from the train control on-board device, and the information on the speed limit signal in front of the rail vehicle corresponds to a predetermined
  • the standard action information includes "extending the index finger and middle finger of the right hand together, with the heart of the fist to the left, and pointing to the display screen of the train control vehicle equipment".
  • the matching the driver's action information with predetermined standard action information includes: matching the driver's action information with a predetermined standard action corresponding to a preset non-signal-triggered operation or, in the case where the traffic signal information in front of the rail vehicle is not obtained within a predetermined period of time, match the driver's action information with the predetermined standard action information corresponding to the preset non-signal-triggered operation to match.
  • the predetermined standard action information corresponding to the preset non-signal-triggered operation may represent the preset predetermined standard action information that does not need to be triggered by a traffic signal or other signal in front of the rail vehicle.
  • the predetermined standard action information corresponding to the preset non-signal-triggered operation includes "punch the right arm, the upper and lower arms are at 90°, the fist is raised with the eyebrows, and the heart of the fist is to the left".
  • the predetermined standard action information corresponding to the preset non-signal-triggered operation may indicate that a vigilant operation is currently required.
  • Fig. 6 shows the schematic diagram of the predetermined standard action information corresponding to the preset non-signal trigger operation "the right arm is closed, the upper and lower arms are at 90°, the fist is raised with the eyebrows, and the heart of the fist is to the left".
  • the predetermined standard action information corresponding to the preset non-signal-triggered operation includes "the five fingers of the right hand are stretched together and pointed to the relevant confirmation device in sequence from left to right".
  • the predetermined standard action information corresponding to the preset non-signal-triggered operation may indicate that the driver is confirming the relevant confirmation device.
  • the relevant confirmation device may be a display screen, a meter, and the like.
  • FIG. 7 is a schematic diagram showing the predetermined standard action information corresponding to the preset non-signal-triggered operation "the five fingers of the right hand are stretched together and pointed to the relevant confirmation device in sequence from left to right”.
  • the driver's action information is matched with the predetermined standard action information corresponding to the preset non-signal-triggered operation, or the traffic in front of the rail vehicle is not acquired within a predetermined period of time.
  • the driver's action information is matched with the predetermined standard action information corresponding to the preset non-signal-triggered operation, and in response to the driver's action information corresponding to the preset non-signal-triggered operation If the predetermined standard action information is successfully matched, the action information of the driver is sent to the preset driver management device, which can facilitate relevant personnel to query or manage the driving behavior of rail transit drivers, thereby helping to improve rail transit. traffic safety.
  • the method further includes: in response to the driver's action information being successfully matched with the predetermined standard action information, sending the driver's action information to the preset driver management device
  • the relevant data of the action information wherein the relevant data includes: in the first video stream, the video clip corresponding to the action information of the driver, or, in the first video stream, the action of the driver The video clip corresponding to the information, and the video clip corresponding to the driver's action information in the second video stream in front of the rail vehicle.
  • the data related to the driver's action information may represent any type of data related to the driver's action information.
  • the related data includes: in the first video stream, a video clip corresponding to the driver's action information.
  • the related data includes: in the first video stream, video clips corresponding to the driver's action information, and in the second video stream in front of the rail vehicle, all The video clip corresponding to the driver's action information.
  • the video clip corresponding to the driver's action information in the first video stream may represent a video clip in the first video stream that is related to the detected driver's action information.
  • the video clip corresponding to the driver's action information in the second video stream in front of the rail vehicle may represent the video related to the detected driver's action information in the second video stream Fragment.
  • the video clips corresponding to the driver's action information in the first video stream may include video clips in the first video stream that are used to detect and obtain the driver's action information. That is, the video clip corresponding to the driver's action information in the first video stream may represent the video clip in the first video stream that determines the detection result of the driver's action information.
  • the video clip corresponding to the driver's action information in the second video stream in front of the rail vehicle may include the second video stream for detecting the driver's action A video clip of the traffic signal information in front of the rail vehicle corresponding to the information. That is, the video clip corresponding to the driver's action information in the second video stream may include a predetermined standard action corresponding to the driver's action information in the second video stream in front of the rail vehicle. Video clips of information.
  • the video clip corresponding to the driver's action information in the second video stream in front of the rail vehicle may include the second video stream that is the same as the video clip in the first video stream. video clips with the same time range as the video clips corresponding to the driver's action information. That is, in this example, the video clip corresponding to the driver's action information in the second video stream may be the same time as the video clip corresponding to the driver's action information in the first video stream. The range is the same.
  • the relevant data of the driver's action information is sent to the preset driver management device, thereby It is convenient for relevant personnel to inquire or manage the driving actions of rail transit drivers.
  • the data related to the driver's action information further includes at least one of the following: the predetermined standard action information, the traffic signal information in front of the rail vehicle corresponding to the driver's action information, The position information of the rail vehicle corresponding to the action information of the driver.
  • the predetermined standard motion information by combining the predetermined standard motion information, the traffic signal information in front of the rail vehicle corresponding to the driver's motion information, and the position information of the rail vehicle corresponding to the driver's motion information into At least one of the driver management devices is sent to the preset driver management device, thereby assisting relevant personnel to query or manage the driving behavior of rail transit drivers, thereby helping to improve the safety of rail transit.
  • the relevant data of the driver's action information may further include one or more video frames corresponding to the driver's action information in the first video stream, or the first video stream.
  • the method further includes: in response to the driver's action information failing to match the predetermined standard action information, performing at least one of the following: reporting to the preset driver management device Sending first prompt information; controlling the information output device arranged in the rail vehicle to send out second prompt information; wherein the first prompt information and the second prompt information are used to prompt the driver's action information Does not match the predetermined standard action information.
  • the preset driver management device includes a cloud device and/or a terminal device of the operator of the rail vehicle, and may respond to the failure to match the driver's action information with the predetermined standard action information The cloud device and/or the terminal device of the operator of the rail vehicle sends the first prompt information.
  • the cloud device may store the first prompt information so that relevant personnel can query.
  • the first prompt information may be sent to the terminal device of the operator by means of an application (Application, App), a short message, or the like.
  • the terminal device of the operator may be a terminal device (for example, a mobile phone) of an administrator of the operator, and the like.
  • the information output device provided in the rail vehicle may be controlled to issue an action for prompting the driver The second prompt information whose information does not match the predetermined standard action information.
  • the information output device may include at least one of a speaker, a display screen, a buzzer, and an LED (Light Emitting Diode, light-emitting diode).
  • the second prompt information in the form of voice may be played through the speaker.
  • the second prompt information in the form of text may be displayed on the display screen.
  • the first prompt information in response to the failure to match the driver's action information with the predetermined standard action information, is sent to the preset driver management device, thereby making it convenient for relevant personnel to query the track A history of non-compliant drivers of vehicles.
  • the operator can receive the prompt information in time, thereby It can effectively manage the driving behavior of rail transit drivers.
  • the information output device provided in the rail vehicle sends out second prompt information, thereby enabling the rail transit driver to obtain prompts in time , which can help the driver to correct driving behavior in time.
  • the method may further include: detecting the driver's voice information according to the first video stream; matching the driver's voice information with predetermined standard voice information; responding to The driver's voice information is successfully matched with the predetermined standard voice information, and the driver's voice information is sent to a preset driver management device.
  • the predetermined standard voice information may represent information of a predetermined voice standard. That is, the predetermined standard voice information may embody a predetermined voice standard.
  • the predetermined standard speech information may include at least one of content, volume, speech rate, and the like of speech.
  • the content of the voice in the predetermined standard voice information may be determined according to the "mouth call" specification in the "finger mouth call” specification.
  • the predetermined standard voice information corresponding to the traffic signal information in front of the rail vehicle "traffic lights appear, and the traffic lights are displayed as double amber lights or yellow flashing yellow" includes a call signal display and a call for a lateral speed limit value.
  • the method further includes: performing face recognition according to the first video stream to obtain the driver's identity information; in response to the driver's identity information not being the track
  • the legal driver of the vehicle performs at least one of the following: sending third prompt information to a preset driver management device, sending fourth prompt information through an information output device set in the rail vehicle, wherein the The third prompt information and the fourth prompt information are used to prompt that the driver is not a legal driver of the rail vehicle; and/or, in response to the driver's identity information not being the rail vehicle
  • the currently scheduled driver performs at least one of the following: sending fifth prompt information to a preset driver management device, sending sixth prompt information through an information output device set in the rail vehicle, wherein all The fifth prompt information and the sixth prompt information are used to prompt the driver not to be the driver currently scheduled for the rail vehicle.
  • the legal driver of the rail vehicle may refer to a driver registered with the management device.
  • the identity information of the driver is not the legal driver of the rail vehicle, which may refer to the driver who is not registered in the management device, that is, the driver does not belong to the driver who has been registered in the management device. member.
  • the driver of the current shift of the rail vehicle may indicate that the driver has been registered with the management device and belongs to the current shift of the rail vehicle.
  • the management device can record the information that does not belong to the legal driver. Information about personnel entering the cockpit of the rail vehicle, so that it is convenient for relevant personnel to inquire about the historical record of personnel who are not legal drivers entering the cockpit of the rail vehicle.
  • the operator can receive the prompt information in time , so that it is convenient for the operator to manage the intrusion of illegal drivers in a timely manner.
  • the fourth prompt information is sent through the information output device provided in the rail vehicle, thereby alerting illegal drivers. effect.
  • the information of the rail transit driver on duty can be recorded through the cloud device, thereby It can facilitate relevant personnel to inquire about the on-duty records of rail transit drivers.
  • the operator can timely receive To the prompt information, it is convenient for the operator to manage the on-duty situation of rail transit drivers in a timely manner.
  • the sixth prompt information is sent through the information output device provided in the rail vehicle, thereby prompting driving in time information about the staff's current shift.
  • the method for detecting the motion of a rail transit driver does not require human intervention, can improve the operation efficiency of the operator of the rail vehicle, and can improve the driving safety of the rail vehicle.
  • the writing order of each step does not mean a strict execution order but constitutes any limitation on the implementation process, and the specific execution order of each step should be based on its function and possible Internal logic is determined.
  • the present disclosure also provides a motion detection device for rail transit drivers, rail vehicles, electronic equipment, computer-readable storage media, and programs, all of which can be used to implement any type of rail transit driver motion detection provided by the present disclosure.
  • a motion detection device for rail transit drivers, rail vehicles, electronic equipment, computer-readable storage media, and programs, all of which can be used to implement any type of rail transit driver motion detection provided by the present disclosure.
  • FIG. 8 shows a block diagram of a motion detection device for a rail transit driver provided by an embodiment of the present disclosure.
  • the motion detection device of the rail transit driver includes:
  • the first acquisition module 21 is used to acquire the first video stream of the driving area of the rail vehicle;
  • a detection module 22 configured to detect the motion information of the driver of the rail vehicle according to the first video stream
  • a matching module 23 configured to match the driver's action information with predetermined standard action information
  • the first sending module 24 is configured to send the action information of the driver to a preset driver management device in response to the successful matching between the action information of the driver and the predetermined standard action information.
  • the apparatus further includes:
  • the second acquisition module acquires the traffic signal information in front of the rail vehicle
  • the determining module is configured to determine the predetermined standard action information according to the traffic signal information in front of the rail vehicle before matching the driver's action information with the predetermined standard action information.
  • the determining module is used for:
  • predetermined standard action information is determined according to the acquired traffic signal information in front of the rail vehicle.
  • the second acquisition module is configured to: perform traffic signal analysis on the second video stream in front of the rail vehicle to obtain traffic signal information in front of the rail vehicle.
  • the traffic signal information in front of the rail vehicle includes at least one of the following: information on traffic lights in front of the rail vehicle, information on gesture traffic guidance signals in front of the rail vehicle , the information of the protective signal in front of the rail vehicle.
  • the second obtaining module is used for:
  • the matching module 23 is used for:
  • the driver's action information is matched with predetermined standard action information corresponding to a preset non-signal-triggered operation.
  • the apparatus further includes:
  • a second sending module configured to send the relevant data of the driver's action information to the preset driver management device in response to the successful matching between the driver's action information and the predetermined standard action information, wherein, The relevant data includes:
  • the video clip corresponding to the driver's action information In the first video stream, the video clip corresponding to the driver's action information
  • the relevant data of the driver's action information further includes at least one of the following: the predetermined standard action information, the traffic signal information in front of the rail vehicle corresponding to the driver's action information , the position information of the rail vehicle corresponding to the action information of the driver.
  • the apparatus further includes:
  • a matching failure operation module configured to perform at least one of the following in response to the failure to match the driver's action information with the predetermined standard action information:
  • the first prompt information and the second prompt information are used to prompt that the action information of the driver does not match the predetermined standard action information.
  • the first video stream of the driving area of the rail vehicle is acquired, the motion information of the driver of the rail vehicle is detected according to the first video stream, and the motion information of the driver is compared with the driver's motion information.
  • Predetermined standard action information is matched, and in response to the successful matching between the driver's action information and the predetermined standard action information, the driver's action information is sent to a preset driver management device, so that the driver's action information can be based on the
  • the video stream of the driving area of the rail vehicle performs high-precision, low-cost, and non-perceptual analysis of the actions of the rail transit drivers, which helps to manage the driving behavior of the rail transit drivers and helps to improve the rail transit driver's behavior. safety.
  • FIG. 9 shows an exemplary block diagram of a rail vehicle provided by an embodiment of the present disclosure.
  • the rail vehicle includes: a first camera 31 for collecting a first video stream of the driving area of the rail vehicle; an intelligent analysis device 32 for acquiring data from the first camera 31 The first video stream, detecting the motion information of the driver of the rail vehicle according to the first video stream, matching the driver's motion information with predetermined standard motion information, and responding to the driver's motion information. If the action information is successfully matched with the predetermined standard action information, the action information of the driver is sent to a preset driver management device.
  • At least one first camera may be installed on the rail vehicle.
  • the first camera may be mounted in the cockpit of the rail vehicle and may be mounted towards the driver.
  • the intelligent analysis device can be installed in any position of the rail vehicle.
  • the intelligent analysis device may be installed in the cockpit of the rail vehicle.
  • the intelligent analysis device may be installed in the chassis of the rail vehicle.
  • the rail vehicle further includes: a second camera for collecting a second video stream in front of the rail vehicle; the intelligent analysis device 32 is further used for: from the first camera The two cameras acquire the second video stream in front of the rail vehicle, perform traffic signal analysis on the second video stream, obtain the traffic signal information in front of the rail vehicle, and obtain the traffic signal information in front of the rail vehicle according to the traffic signal in front of the rail vehicle. information to determine predetermined standard action information.
  • At least one second camera is also installed on the rail vehicle.
  • the second camera may be installed toward the front of the rail vehicle, for example, the second camera may be installed toward the rail to capture a second video stream in front of the rail vehicle.
  • the second camera can be installed in the cockpit of the rail vehicle, or can be installed outside the cockpit of the rail vehicle.
  • the rail vehicle further includes: a train control vehicle-mounted device for acquiring information on the speed limit signal in front of the rail vehicle; the intelligent analysis device 32 is further configured to: The train control vehicle-mounted device acquires the information of the speed limit signal in front of the rail vehicle, and determines predetermined standard action information according to the information of the speed limit signal in front of the rail vehicle.
  • the train control on-board equipment may be installed in the cockpit of the rail vehicle.
  • the train control on-board equipment is installed on the driving console.
  • the intelligent analysis device 32 is further configured to: in response to the successful matching between the driver's action information and the predetermined standard action information, send the information to the preset driver management device The relevant data of the driver's action information, wherein the relevant data includes: in the first video stream, the video clip corresponding to the driver's action information, or, in the first video stream, the The video clip corresponding to the driver's action information, and the video clip corresponding to the driver's action information in the second video stream in front of the rail vehicle.
  • the intelligent analysis device 32 is further configured to: fail to match the action information of the driver with the predetermined standard action information, and perform at least one of the following: to the preset driver
  • the management device sends first prompt information; controls the information output device arranged in the rail vehicle to send out second prompt information; wherein the first prompt information and the second prompt information are used to prompt the driver's
  • the action information does not match the predetermined standard action information; the rail vehicle further includes: the information output device, configured to issue the second prompt information.
  • the information output device may be arranged in the cockpit of the rail vehicle.
  • FIG. 10 shows another exemplary block diagram of a rail vehicle provided by an embodiment of the present disclosure.
  • the rail vehicle includes a first camera 31 , an intelligent analysis device 32 , a second camera 33 , a train control vehicle-mounted device 34 and an information output device 35 .
  • the first camera 31 , the second camera 33 , the train control vehicle-mounted device 34 and the information output device 35 are respectively connected to the intelligent analysis device 32 .
  • the first video stream of the driving area of the rail vehicle is collected by the first camera, and the intelligent analysis device acquires the first video stream of the driving area of the rail vehicle from the first camera, according to the first video stream of the driving area of the rail vehicle.
  • a video stream detects motion information of the driver of the rail vehicle, matches the driver's motion information with predetermined standard motion information, and matches the driver's motion information with the predetermined standard motion information in response to the driver's motion information If successful, the action information of the driver is sent to the preset driver management device, so that the action of the rail transit driver can be performed with high precision, low cost, and no perception based on the video stream of the driving area of the rail vehicle. It is helpful to manage the driving behavior of rail transit drivers and improve the safety of rail transit.
  • the functions or modules included in the apparatus provided in the embodiments of the present disclosure may be used to execute the methods described in the above method embodiments, and the specific implementation and technical effects may refer to the above method embodiments. It is concise and will not be repeated here.
  • Embodiments of the present disclosure further provide a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the foregoing method is implemented.
  • the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.
  • Embodiments of the present disclosure further provide a computer program, including computer-readable codes, when the computer-readable codes are executed in an electronic device, the processor in the electronic device executes the above method.
  • Embodiments of the present disclosure further provide a computer program product, including computer-readable codes, or a non-volatile computer-readable storage medium carrying computer-readable codes, when the computer-readable codes are executed in an electronic device, A processor in the electronic device executes the above method.
  • Embodiments of the present disclosure further provide an electronic device, including: one or more processors; a memory for storing executable instructions; wherein the one or more processors are configured to invoke executable instructions stored in the memory instruction to execute the above method.
  • the electronic device may be provided as a terminal, server or other form of device.
  • the electronic device may be an intelligent analysis device, a vehicle-mounted device, and the like.
  • FIG. 11 shows a block diagram of an electronic device 800 provided by an embodiment of the present disclosure.
  • electronic device 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, etc. terminal.
  • an electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814 , and the communication component 816 .
  • the processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations.
  • the processing component 802 can include one or more processors 820 to execute instructions to perform all or some of the steps of the methods described above.
  • processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components.
  • processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
  • Memory 804 is configured to store various types of data to support operation at electronic device 800 . Examples of such data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, and the like. Memory 804 may be implemented by any type of volatile or nonvolatile storage device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk Magnetic Disk
  • Power supply assembly 806 provides power to various components of electronic device 800 .
  • Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800 .
  • Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
  • the touch panel includes one or more touch sensors to sense touch, swipe, and gestures on the touch panel. The touch sensor may not only sense the boundaries of a touch or swipe action, but also detect the duration and pressure associated with the touch or swipe action.
  • the multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each of the front and rear cameras can be a fixed optical lens system or have focal length and optical zoom capability.
  • Audio component 810 is configured to output and/or input audio signals.
  • audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when electronic device 800 is in operating modes, such as calling mode, recording mode, and voice recognition mode.
  • the received audio signal may be further stored in memory 804 or transmitted via communication component 816 .
  • audio component 810 also includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to: home button, volume buttons, start button, and lock button.
  • Sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of electronic device 800 .
  • the sensor assembly 814 can detect the on/off state of the electronic device 800, the relative positioning of the components, such as the display and the keypad of the electronic device 800, the sensor assembly 814 can also detect the electronic device 800 or one of the electronic device 800 Changes in the position of components, presence or absence of user contact with the electronic device 800 , orientation or acceleration/deceleration of the electronic device 800 and changes in the temperature of the electronic device 800 .
  • Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
  • Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices.
  • the electronic device 800 may access wireless networks based on communication standards, such as Wi-Fi, 2G, 3G, 4G/LTE, 5G, or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module may be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • electronic device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmed gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A programmed gate array
  • controller microcontroller, microprocessor or other electronic component implementation is used to perform the above method.
  • a non-volatile computer-readable storage medium such as a memory 804 comprising computer program instructions executable by the processor 820 of the electronic device 800 to perform the above method is also provided.
  • FIG. 12 shows a block diagram of an electronic device 1900 provided by an embodiment of the present disclosure.
  • the electronic device 1900 may be provided as a server. 12
  • electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource, represented by memory 1932, for storing instructions executable by processing component 1922, such as applications.
  • An application program stored in memory 1932 may include one or more modules, each corresponding to a set of instructions.
  • the processing component 1922 is configured to execute instructions to perform the above-described methods.
  • the electronic device 1900 may also include a power supply assembly 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 .
  • Electronic device 1900 may operate based on an operating system stored in memory 1932, such as Windows Mac OS or similar.
  • a non-volatile computer-readable storage medium such as memory 1932 comprising computer program instructions executable by processing component 1922 of electronic device 1900 to perform the above-described method.
  • the present disclosure may be a system, method and/or computer program product.
  • the computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of the present disclosure.
  • a computer-readable storage medium may be a tangible device that can hold and store instructions for use by the instruction execution device.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
  • Non-exhaustive list of computer readable storage media include: portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM) or flash memory), static random access memory (SRAM), portable compact disk read only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically coded devices, such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • RAM random access memory
  • ROM read only memory
  • EPROM erasable programmable read only memory
  • flash memory static random access memory
  • SRAM static random access memory
  • CD-ROM compact disk read only memory
  • DVD digital versatile disk
  • memory sticks floppy disks
  • mechanically coded devices such as printers with instructions stored thereon Hole cards or raised structures in grooves, and any suitable combination of the above.
  • Computer-readable storage media are not to be construed as transient signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (eg, light pulses through fiber optic cables), or through electrical wires transmitted electrical signals.
  • the computer readable program instructions described herein may be downloaded to various computing/processing devices from a computer readable storage medium, or to an external computer or external storage device over a network such as the Internet, a local area network, a wide area network and/or a wireless network.
  • the network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers.
  • a network adapter card or network interface in each computing/processing device receives computer-readable program instructions from a network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing/processing device .
  • Computer program instructions for carrying out operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or instructions in one or more programming languages.
  • Source or object code written in any combination including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as the "C" language or similar programming languages.
  • the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server implement.
  • the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through the Internet connect).
  • LAN local area network
  • WAN wide area network
  • custom electronic circuits such as programmable logic circuits, field programmable gate arrays (FPGAs), or programmable logic arrays (PLAs) can be personalized by utilizing state information of computer readable program instructions.
  • Computer readable program instructions are executed to implement various aspects of the present disclosure.
  • These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus to produce a machine that causes the instructions when executed by the processor of the computer or other programmable data processing apparatus , resulting in means for implementing the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • These computer readable program instructions can also be stored in a computer readable storage medium, these instructions cause a computer, programmable data processing apparatus and/or other equipment to operate in a specific manner, so that the computer readable medium on which the instructions are stored includes An article of manufacture comprising instructions for implementing various aspects of the functions/acts specified in one or more blocks of the flowchart and/or block diagrams.
  • Computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other equipment to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other equipment to produce a computer-implemented process , thereby causing instructions executing on a computer, other programmable data processing apparatus, or other device to implement the functions/acts specified in one or more blocks of the flowcharts and/or block diagrams.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more functions for implementing the specified logical function(s) executable instructions.
  • the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations can be implemented in dedicated hardware-based systems that perform the specified functions or actions , or can be implemented in a combination of dedicated hardware and computer instructions.
  • the computer program product can be specifically implemented by hardware, software or a combination thereof.
  • the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (Software Development Kit, SDK), etc. Wait.
  • a software development kit Software Development Kit, SDK

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Train Traffic Observation, Control, And Security (AREA)
  • Image Analysis (AREA)

Abstract

本公开涉及一种轨交驾驶员的动作检测方法及装置、设备、介质及工具。所述方法包括: 获取轨道交通工具的驾驶区域的第一视频流; 根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息; 将所述驾驶员的动作信息与预定标准动作信息进行匹配; 响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。

Description

轨交驾驶员的动作检测方法及装置、设备、介质及工具
本申请要求在2021年1月28日提交中国专利局、申请号为202110120985.1、申请名称为“轨交驾驶员的动作检测方法及装置、设备、介质及工具”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本公开涉及轨道交通技术领域，尤其涉及一种轨道交通驾驶员的动作检测方法及装置、电子设备、存储介质及轨道交通工具。
背景技术
在轨道交通行业中，驾驶员在驾驶的过程中看到特定的交通信号灯或者行驶到特定的路段时，需要做“手指口呼”规范中规定的相应动作。正确执行“手指口呼”规范对于轨道交通的行驶安全具有重要意义。
发明内容
本公开提供了一种轨道交通驾驶员的动作检测技术方案。
根据本公开的一方面，提供了一种轨道交通驾驶员的动作检测方法，包括：
获取轨道交通工具的驾驶区域的第一视频流；
根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息；
将所述驾驶员的动作信息与预定标准动作信息进行匹配；
响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在一种可能的实现方式中，
所述方法还包括：获取所述轨道交通工具前方的交通信号信息；
在将所述驾驶员的动作信息与预定标准动作信息进行匹配之前，根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息，包括：
在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述获取轨道交通工具前方的交通信号信息，包括：对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。
在一种可能的实现方式中，所述轨道交通工具前方的交通信号信息包括以下至少之一：所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息。
在一种可能的实现方式中，所述获取所述轨道交通工具前方的交通信号信息，包括：
获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息。
在一种可能的实现方式中，所述将所述驾驶员的动作信息与预定标准动作信息进行匹配，包括：
将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配；或者
在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配。
在一种可能的实现方式中，所述方法还包括：
响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
或者，
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在一种可能的实现方式中，所述驾驶员的动作信息的相关数据还包括以下至少之一：所述预定标准动作信息、所述驾驶员的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息。
在一种可能的实现方式中，所述方法还包括：
响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：
向所述预设的驾驶员管理设备发送第一提示信息；
控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；
其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配。
根据本公开的一方面，提供了一种轨道交通驾驶员的动作检测装置，包括：
第一获取模块，用于获取轨道交通工具的驾驶区域的第一视频流；
检测模块，用于根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息；
匹配模块，用于将所述驾驶员的动作信息与预定标准动作信息进行匹配；
第一发送模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在一种可能的实现方式中，所述装置还包括：
第二获取模块，获取所述轨道交通工具前方的交通信号信息；
确定模块，用于在将所述驾驶员的动作信息与预定标准动作信息进行匹配之前，根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述确定模块用于：
在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述第二获取模块用于：对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。
在一种可能的实现方式中，所述轨道交通工具前方的交通信号信息包括以下至少之一：所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息。
在一种可能的实现方式中，所述第二获取模块用于：
获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息。
在一种可能的实现方式中，所述匹配模块用于：
将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配；或者
在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配。
在一种可能的实现方式中，所述装置还包括：
第二发送模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预 设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
或者，
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在一种可能的实现方式中，所述驾驶员的动作信息的相关数据还包括以下至少之一：所述预定标准动作信息、所述驾驶员的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息。
在一种可能的实现方式中，所述装置还包括：
匹配失败操作模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：
向所述预设的驾驶员管理设备发送第一提示信息；
控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；
其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配。
根据本公开的一方面，提供了一种轨道交通工具，包括：
第一摄像头，用于采集轨道交通工具的驾驶区域的第一视频流；
智能分析设备，用于从所述第一摄像头获取所述第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在一种可能的实现方式中，
所述轨道交通工具还包括：第二摄像头，用于采集所述轨道交通工具前方的第二视频流；
所述智能分析设备还用于：从所述第二摄像头获取所述轨道交通工具前方的第二视频流，对所述第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息，并根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，
所述轨道交通工具还包括：列控车载设备，用于获取所述轨道交通工具前方的限速信号的信息；
所述智能分析设备还用于：从所述列控车载设备获取所述轨道交通工具前方的限速信号的信息，并根据所述轨道交通工具前方的限速信号的信息，确定预定标准动作信息。
在一种可能的实现方式中，所述智能分析设备还用于：
响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
或者，
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在一种可能的实现方式中，
所述智能分析设备还用于：所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：向所述预设的驾驶员管理设备发送第一提示信息；控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配；
所述轨道交通工具还包括：所述信息输出设备，用于发出所述第二提示信息。
根据本公开的一方面，提供了一种电子设备，包括：一个或多个处理器；用于存储可执行指令的存储器；其中，所述一个或多个处理器被配置为调用所述存储器存储的可执行指令，以执行上述方法。
根据本公开的一方面，提供了一种计算机可读存储介质，其上存储有计算机程序指令，所述计算机程序指令被处理器执行时实现上述方法。
根据本公开的一方面，提供了一种计算机程序产品，包括计算机可读代码，或者承载有计算机可读代码的非易失性计算机可读存储介质，当所述计算机可读代码在电子设备中运行时，所述电子设备中的处理器执行上述方法。
在本公开实施例中，通过获取轨道交通工具的驾驶区域的第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够基于所述轨道交通工具的驾驶区域的视频流对轨道交通驾驶员的动作进行高精度、低成本、无感知的分析，从而有助于对轨道交通驾驶员的驾驶行为进行管理，有助于提高轨道交通的安全性。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，而非限制本公开。
根据下面参考附图对示例性实施例的详细说明，本公开的其它特征及方面将变得清楚。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，这些附图示出了符合本公开的实施例，并与说明书一起用于说明本公开的技术方案。
图1示出本公开实施例提供的轨道交通驾驶员的动作检测方法的流程图。
图2示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手伸出食指和中指并拢，拳心向左，指向确认对象”的示意图。
图3示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手平伸，拢拳伸拇指直立，拳心向左”的示意图。
图4示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手平伸，拢拳伸拇指和小指，拳心向左”的示意图。
图5示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右臂拢拳，举拳与眉齐，拳心向左，小臂上下摇动3次”的示意图。
图6示出预设的非信号触发操作对应的预定标准动作信息“右臂拢拳，大小臂成90°，举拳与眉齐，拳心向左”的示意图。
图7示出预设的非信号触发操作对应的预定标准动作信息“右手五指并拢伸直，从左至右依次指向相关确认设备”的示意图。
图8示出本公开实施例提供的轨道交通驾驶员的动作检测装置的框图。
图9示出本公开实施例提供的轨道交通工具的一示例性的框图。
图10示出本公开实施例提供的轨道交通工具的另一示例性的框图。
图11示出本公开实施例提供的一种电子设备800的框图。
图12示出本公开实施例提供的一种电子设备1900的框图。
具体实施方式
以下将参考附图详细说明本公开的各种示例性实施例、特征和方面。附图中相同的附图标记表示功能相同或相似的元件。尽管在附图中示出了实施例的各种方面，但是除非特别指出，不必按比例绘 制附图。
在这里专用的词“示例性”意为“用作例子、实施例或说明性”。这里作为“示例性”所说明的任何实施例不必解释为优于或好于其它实施例。
本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中术语“至少一种”表示多种中的任意一种或多种中的至少两种的任意组合，例如，包括A、B、C中的至少一种，可以表示包括从A、B和C构成的集合中选择的任意一个或多个元素。
另外，为了更好地说明本公开，在下文的具体实施方式中给出了众多的具体细节。本领域技术人员应当理解，没有某些具体细节，本公开同样可以实施。在一些实例中，对于本领域技术人员熟知的方法、手段、元件和电路未作详细描述，以便于凸显本公开的主旨。
在本公开实施例中，通过获取轨道交通工具的驾驶区域的第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够基于所述轨道交通工具的驾驶区域的视频流对轨道交通驾驶员的动作进行高精度、低成本、无感知的分析，从而有助于对轨道交通驾驶员的驾驶行为进行管理，有助于提高轨道交通的安全性。
图1示出本公开实施例提供的轨道交通驾驶员的动作检测方法的流程图。所述轨道交通驾驶员的动作检测方法可以由终端设备或服务器或其它处理设备执行。其中，终端设备可以安装在所述轨道交通工具上。终端设备可以是智能分析设备(例如智能分析盒)、车载设备、用户设备(User Equipment，UE)、移动设备、用户终端、终端、个人数字助理(Personal Digital Assistant，PDA)、手持设备、计算设备或者可穿戴设备等。其中，所述智能分析设备可以安装在所述轨道交通工具的任意位置。例如，所述智能分析设备可以安装在所述轨道交通工具的驾驶舱内。又如，所述智能分析设备可以安装在所述轨道交通工具的机箱内。在一些可能的实现方式中，所述轨道交通驾驶员的动作检测方法可以通过处理器调用存储器中存储的计算机可读指令的方式来实现。所述轨道交通驾驶员的动作检测方法可以应用于轨道交通工具。如图1所示，所述轨道交通驾驶员的动作检测方法包括步骤S11至步骤S14。
在步骤S11中，获取轨道交通工具的驾驶区域的第一视频流。
在步骤S12中，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息。
在步骤S13中，将所述驾驶员的动作信息与预定标准动作信息进行匹配。
在步骤S14中，响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在本公开实施例中，轨道交通工具可以表示需要在特定轨道上行驶的交通工具。例如，所述轨道交通工具可以是火车、地铁、有轨电车、磁悬浮列车等。所述第一视频流表示所述轨道交通工具的驾驶区域的视频流。所述第一视频流可以包括所述轨道交通工具的驾驶员的影像信息。在一种可能的实现方式中，所述第一视频流还可以包括所述轨道交通工具的驾驶操作台的影像信息。其中，所述驾驶操作台可以包括显示屏和/或仪表等。在一种可能的实现方式中，所述轨道交通工具上可以安装有至少一个第一摄像头，所述第一摄像头可以用于采集第一视频流。其中，所述第一摄像头可以安装在所述轨道交通工具的驾驶舱内，且可以朝向驾驶员安装。
在本公开实施例中，可以根据所述第一视频流，对所述轨道交通工具的驾驶员进行至少一种类型的动作检测，得到所述驾驶员的动作信息，其中，所述驾驶员的动作信息可以包括至少一种类型的动作信息。例如，可以根据所述第一视频流，对所述驾驶员进行手势检测、手臂动作检测、头部动作检测、嘴部动作检测、视线检测等中的至少之一。相应地，所述驾驶员的动作信息可以包括手势信息、手臂动作信息、头部动作信息、嘴部动作信息、视线信息等中的至少之一。相应地，预定标准动作信 息可以包括预定的标准手势信息、预定的手臂标准动作信息、预定的头部标准动作信息、预定的嘴部标准动作信息、预定的视线标准信息等中的至少之一。由此，能够对所述轨道交通工具的驾驶员的手势、手臂动作、头部动作、嘴部动作、视线等中的至少之一进行检测和管理。
在一种可能的实现方式中，可以预先训练用于对驾驶员进行动作检测的第一神经网络，将所述轨道交通工具的驾驶区域的第一视频流输入所述第一神经网络，经由所述第一神经网络根据所述第一视频流检测对所述轨道交通工具的驾驶员进行动作检测，得到所述驾驶员的动作信息。其中，不同类型的动作检测可以通过不同的神经网络执行，也可以通过同一个神经网络执行，在此不作限定。当然，在其他实现方式中，也可以预先设计用于对图像和/或视频进行动作检测的函数，通过所述第一函数对所述轨道交通工具的驾驶区域的第一视频流进行动作检测，得到所述驾驶员的动作信息。
在本公开实施例中，所述预定标准动作信息可以表示预定的标准动作的信息。即，所述预定标准动作信息可以体现预定的标准动作。例如，所述预定标准动作信息可以包括预定的标准动作的类型、顺序、次数、时长等中的至少之一。例如，可以根据“手指口呼”规范中的动作规范和/或口呼规范，确定所述预定标准动作信息。在一个例子中，若所述驾驶员的动作信息与所述预定标准动作信息匹配成功，则可以确定驾驶员符合“手指口呼”规范。在本公开实施例中，所述驾驶员的动作信息与所述预定标准动作信息匹配成功，可以表示所述驾驶员的动作信息与所述预定标准动作信息之间的差异在预设的允许范围内；所述驾驶员的动作信息与所述预定标准动作信息匹配失败，可以表示所述驾驶员的动作信息与所述预定标准动作信息之间的差异超出预设的允许范围。
在一种可能的实现方式中，所述预定标准动作信息可以包括预定的标准手势信息。在该实现方式中，所述预定的标准手势信息可以表示预定的标准手势的信息。即，所述预定的标准手势信息可以体现预定的标准手势。例如，所述预定的标准手势信息可以包括预定的标准手势的类型、顺序、次数等中的至少之一。
在一种可能的实现方式中，所述预定标准动作信息可以包括预定的手臂标准动作信息。在该实现方式中，所述预定的手臂标准动作信息可以表示预定的手臂标准动作的信息。即，所述预定的手臂标准动作信息可以体现预定的手臂标准动作。其中，手臂标准动作表示标准的手臂动作。例如，所述预定的手臂标准动作信息可以包括预定的手臂标准动作的类型、顺序、次数等中的至少之一。
在一种可能的实现方式中，所述预定标准动作信息可以包括预定的头部标准动作信息。在该实现方式中，所述预定的头部标准动作信息可以表示预定的头部标准动作的信息。即，所述预定的头部标准动作信息可以体现预定的头部标准动作。其中，头部标准动作表示标准的头部动作。例如，所述预定的头部标准动作信息可以包括预定的头部标准动作的类型、顺序、次数等中的至少之一。
在一种可能的实现方式中，所述预定标准动作信息可以包括预定的嘴部标准动作信息。在该实现方式中，所述预定的嘴部标准动作信息可以表示预定的嘴部标准动作的信息。即，所述预定的嘴部标准动作信息可以体现预定的嘴部标准动作。其中，嘴部标准动作表示标准的嘴部动作。例如，所述预定的嘴部标准动作信息可以包括预定的嘴部标准动作的类型、顺序、次数、时长等中的至少之一。例如，预定的嘴部标准动作的类型包括张嘴。
在一种可能的实现方式中，所述预定标准动作信息可以包括预定的视线标准信息。在该实现方式中，所述预定的标准视线信息可以表示预定的视线标准的信息。即，所述预定的标准视线信息可以体现预定的视线标准。例如，所述预定的标准视线信息可以包括预定的标准视线的方向、顺序、次数、停留或注视的时长等中的至少之一。
在本公开实施例中，所述预定标准动作信息可以包括信号触发操作对应的预定标准动作信息和/或非信号触发操作对应的预定标准动作信息。其中，信号触发操作对应的预定标准动作信息可以表示根据所述轨道交通工具前方的交通信号或者其他信号(例如来自于云端设备的信号等)的触发所确定的预定标准动作信息。非信号触发操作对应的预定标准动作信息可以表示无需根据所述轨道交通工具 前方的交通信号或者其他信号的触发的预定标准动作信息。
在本公开实施例中，所述预设的驾驶员管理设备可以表示预先设置的用于进行驾驶员管理的设备。其中，所述预设的驾驶员管理设备的数量可以为一个或多个。在一种可能的实现方式中，所述预设的驾驶员管理设备可以包括云端设备(例如云平台的服务器)。在另一种可能的实现方式中，所述预设的驾驶员管理设备可以包括所述轨道交通工具的运营方的终端设备。
在本公开实施例中，通过获取轨道交通工具的驾驶区域的第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够基于所述轨道交通工具的驾驶区域的视频流对轨道交通驾驶员的动作进行高精度、低成本、无感知的分析，从而有助于对轨道交通驾驶员的驾驶行为进行管理，有助于提高轨道交通的安全性。
在一种可能的实现方式中，所述方法还包括：获取所述轨道交通工具前方的交通信号信息；在将所述驾驶员的动作信息与预定标准动作信息进行匹配之前，根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。在该实现方式中，所述轨道交通工具前方的交通信号信息，可以表示所述轨道交通工具前方的交通信号的信息。即，所述轨道交通工具前方的交通信号信息可以体现所述轨道交通工具前方的交通信号。在该实现方式中，可以根据“手指口呼”规范，确定交通信号信息与预定标准动作信息之间的对应关系。当然，也可以根据实际应用场景需求，灵活设置交通信号信息与预定标准动作信息之间的对应关系。交通信号信息与预定标准动作信息之间可以是一对一、一对多或者多对一的关系，在此不作限定。根据交通信号信息与预定标准动作信息之间的对应关系，以及所述轨道交通工具前方的交通信号信息，可以确定与所述轨道交通工具前方的交通信号信息对应的预定标准动作信息。在该实现方式中，通过获取所述轨道交通工具前方的交通信号信息，并根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息，由此能够在所述轨道交通工具行驶的过程中，基于所述轨道交通工具前方的交通信号信息准确地确定相应的预定标准动作信息，从而有助于进行更准确的驾驶员行为管理。
作为该实现方式的一个示例，所述根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息，包括：在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。在该示例中，预定时间范围可以是5秒、10秒等等，本领域技术人员可以根据实际应用场景(例如所述轨道交通工具的行驶速度等)灵活设置。若在预定时间范围内获取到所述轨道交通工具前方的交通信号信息，则可以根据交通信号信息与预定标准动作信息之间的对应关系，确定当前用于与所述驾驶员的动作信息进行匹配的预定标准动作信息。在预定时间范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，可以确定当前不存在与交通信号信息对应的预定标准动作信息。在该示例中，通过在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息，由此能够基于述轨道交通工具前方的实时的交通信号信息进行预定标准动作信息的确定，从而有助于进行更准确的驾驶员行为管理。
在一个示例中，所述获取轨道交通工具前方的交通信号信息，包括：对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。在该示例，所述第二视频流表示所述轨道交通工具前方的视频流。在一个例子中，所述轨道交通工具上还安装有至少一个第二摄像头，所述第二摄像头用于采集所述轨道交通工具前方的第二视频流。在该示例中，所述第二摄像头可以朝向所述轨道交通工具的前方安装，例如，所述第二摄像头可以朝向轨道安装，以采集所述轨道交通工具前方的第二视频流。所述第二摄像头可以安装在轨道交通工具的驾驶舱内，也可以安装在轨道交通工具的驾驶舱外。所述第二视频流可以包括所述轨道交通工具前方的轨道的影像信息，和 /或，所述第二视频流可以包括所述轨道交通工具前方的轨道上方的影像信息。在该示例中，通过对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息，由此能够根据所述轨道交通工具前方的视觉信息准确、及时地确定所述轨道交通工具前方的交通信号信息。
在一个例子中，可以预先训练用于分析交通信号的第二神经网络，将所述轨道交通工具前方的第二视频流输入所述第二神经网络，经由所述第二神经网络输出所述轨道交通工具前方的交通信号信息。当然，在其他例子中，也可以预先设计用于对图像和/或视频进行交通信号分析的第二函数，通过所述第二函数对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。
作为该实现方式的一个示例，所述轨道交通工具前方的交通信号信息包括以下至少之一：所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息。
在该示例中，所述轨道交通工具前方的交通信号灯的信息可以表示所述轨道交通工具前方的交通信号灯的状态。例如，所述轨道交通工具前方的交通信号灯的信息可以包括：所述轨道交通工具前方出现交通信号灯，且交通信号灯显示为绿灯、黄灯、红灯、绿黄灯、双黄灯或者黄闪黄等。例如，所述轨道交通工具前方的交通信号灯的信息可以是以下任意一项：所述轨道交通工具前方出现交通信号灯，且交通信号灯显示绿灯或者绿黄灯；所述轨道交通工具前方出现交通信号灯，且交通信号灯显示黄灯；所述轨道交通工具前方出现交通信号灯，且交通信号灯显示双黄灯或者黄闪黄灯；所述轨道交通工具前方出现交通信号灯，且交通信号灯显示红灯；等等。
在该示例中，手势交通指引信号是指一种铁路移动信号，是由人直接挥动信号旗和信号灯来下达的各种命令。在一些应用场景中，所述手势交通指引信号也被称为手信号。所述轨道交通工具前方的手势交通指引信号的信息可以包括所述轨道交通工具前方的手势交通指引信号的种类。例如，所述轨道交通工具前方的手势交通指引信号的信息可以包括，所述轨道交通工具前方的手势交通指引信号为停车信号、减速信号、发车信号、通过信号或者引导信号等。
在该示例中，防护信号机是指保证区间内铁路线路平面交叉处行车安全的信号机。所述轨道交通工具前方的防护信号机的信息可以表示所述轨道交通工具前方的防护信号机的状态。
该示例通过获取所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息中的至少之一，由此基于所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息中的至少之一，确定预定标准动作信息，进而有助于准确地进行驾驶员的动作分析。
例如，所述轨道交通工具前方的交通信号信息包括“出现交通信号灯，且交通信号灯显示为绿灯或绿黄灯”，所述轨道交通工具前方的交通信号信息“出现交通信号灯，且交通信号灯显示为绿灯或绿黄灯”对应的预定标准动作信息包括“右手伸出食指和中指并拢，拳心向左，指向交通信号灯”。其中，“出现交通信号灯，且交通信号灯显示为绿灯或绿黄灯”可以表示所述轨道交通工具前方的交通信号灯显示要求通过。图2示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手伸出食指和中指并拢，拳心向左，指向确认对象”的示意图。
又如，所述轨道交通工具前方的交通信号信息包括手势交通指引信号的信息，手势交通指引信号的信息对应的预定标准动作信息包括“右手伸出食指和中指并拢，拳心向左，指向手势交通指引信号”或者“左手伸出食指和中指并拢，拳心向右，指向手势交通指引信号”。
又如，所述轨道交通工具前方的交通信号信息包括防护信号机(例如脱轨器)的信息，防护信号机的信息对应的预定标准动作信息包括“右手伸出食指和中指并拢，拳心向左，指向防护信号机”或者 “左手伸出食指和中指并拢，拳心向右，指向防护信号机”。
又如，所述轨道交通工具前方的交通信号信息包括“出现交通信号灯，且交通信号灯显示为黄灯”，所述轨道交通工具前方的交通信号信息“出现交通信号灯，且交通信号灯显示为黄灯”对应的预定标准动作信息包括“右手平伸，拢拳伸拇指直立，拳心向左”或者“左手平伸，拢拳伸拇指直立，拳心向右”。其中，“出现交通信号灯，且交通信号灯显示为黄灯”可以表示所述轨道交通工具前方的交通信号灯显示要求正向径路准备停车。图3示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手平伸，拢拳伸拇指直立，拳心向左”的示意图。
又如，所述轨道交通工具前方的交通信号信息包括“出现交通信号灯，且交通信号灯显示为双黄灯或者黄闪黄”，所述轨道交通工具前方的交通信号信息“出现交通信号灯，且交通信号灯显示为双黄灯或者黄闪黄”对应的预定标准动作信息包括“右手平伸，拢拳伸拇指和小指，拳心向左”。其中，“出现交通信号灯，且交通信号灯显示为双黄灯或者黄闪黄”可以表示所述轨道交通工具前方的交通信号灯显示要求侧向径路运行。图4示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右手平伸，拢拳伸拇指和小指，拳心向左”的示意图。
又如，所述轨道交通工具前方的交通信号信息包括“出现交通信号灯，且交通信号灯显示为红灯”，所述轨道交通工具前方的交通信号信息“出现交通信号灯，且交通信号灯显示为红灯”对应的预定标准动作信息包括“右臂拢拳，举拳与眉齐，拳心向左，小臂上下摇动3次”。在这个例子中，红灯可以是固定的红灯或者临时的红灯。“出现交通信号灯，且交通信号灯显示为红灯”可以表示所述轨道交通工具前方的交通信号灯显示要求停车。图5示出所述轨道交通工具前方的交通信号信息对应的预定标准动作信息“右臂拢拳，举拳与眉齐，拳心向左，小臂上下摇动3次”的示意图。
作为该实现方式的一个示例，所述获取所述轨道交通工具前方的交通信号信息，包括：获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息。在该示例中，所述轨道交通工具前方的交通信号信息可以包括所述轨道交通工具前方的限速信号的信息。在该示例中，所述轨道交通工具上还可以设置有列控车载设备(LKJ)。例如，所述列控车载设备可以响应于所述轨道交通工具前方的限制速度发生变化，向轨道交通驾驶员的动作检测装置(例如智能分析设备)发送所述轨道交通工具前方的限速信号的信息。例如，所述列控车载设备可以通过信号线传输所述轨道交通工具前方的限速信号的信息至智能分析设备，以使智能分析设备获取所述轨道交通工具前方的限速信号的信息。所述轨道交通工具前方的限速信号的信息，可以包括所述轨道交通工具前方的限制速度的数值信息和/或所述轨道交通工具前方的限制速度与当前的限制速度之间的差异信息。在该示例中，通过获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息，并基于所述轨道交通工具前方的限速信号的信息确定预定标准动作信息，进而有助于准确地进行驾驶员的动作分析。
例如，所述轨道交通工具前方的交通信号信息包括从所述列控车载设备获取的所述轨道交通工具前方的限速信号的信息，所述轨道交通工具前方的限速信号的信息对应的预定标准动作信息包括“右手伸出食指和中指并拢，拳心向左，指向列控车载设备的显示屏”。
在一种可能的实现方式中，所述将所述驾驶员的动作信息与预定标准动作信息进行匹配，包括：将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配；或者，在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配。在该实现方式中，预设的非信号触发操作对应的预定标准动作信息，可以表示预设的无需根据所述轨道交通工具前方的交通信号或者其他信号的触发的预定标准动作信息。
例如，预设的非信号触发操作对应的预定标准动作信息包括“右臂拢拳，大小臂成90°，举拳与眉齐，拳心向左”。该预设的非信号触发操作对应的预定标准动作信息可以表示当前需要警惕运行。图6示出预设的非信号触发操作对应的预定标准动作信息“右臂拢拳，大小臂成90°，举拳与眉齐，拳心向 左”的示意图。
又如，预设的非信号触发操作对应的预定标准动作信息包括“右手五指并拢伸直，从左至右依次指向相关确认设备”。该预设的非信号触发操作对应的预定标准动作信息可以表示驾驶员正在确认所述相关确认设备。其中，所述相关确认设备可以为显示屏、仪表等。图7示出预设的非信号触发操作对应的预定标准动作信息“右手五指并拢伸直，从左至右依次指向相关确认设备”的示意图。
在该实现方式中，通过将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配，或者，在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够便于相关人员对轨道交通驾驶员的驾驶行为进行查询或管理，从而有助于提高轨道交通的安全性。
在一种可能的实现方式中，所述方法还包括：响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：所述第一视频流中、所述驾驶员的动作信息对应的视频片段，或者，所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在该实现方式中，所述驾驶员的动作信息的相关数据可以表示与所述驾驶员的动作信息相关的任意类型的数据。作为该实现方式的一个示例，所述相关数据包括：所述第一视频流中、所述驾驶员的动作信息对应的视频片段。作为该实现方式的另一个示例，所述相关数据包括：所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在该实现方式中，所述第一视频流中、所述驾驶员的动作信息对应的视频片段，可以表示所述第一视频流中、与所检测到的所述驾驶员的动作信息相关的视频片段。所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段，可以表示所述第二视频流中、与所检测到的所述驾驶员的动作信息相关的视频片段。其中，所述第一视频流中、所述驾驶员的动作信息对应的视频片段，可以包括所述第一视频流中、用于检测得到所述驾驶员的动作信息的视频片段。即，所述第一视频流中、所述驾驶员的动作信息对应的视频片段，可以表示所述第一视频流中、决定所述驾驶员的动作信息的检测结果的视频片段。在一个例子中，所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段，可以包括所述第二视频流中、用于检测得到所述驾驶员的动作信息对应的所述轨道交通工具前方的交通信号信息的视频片段。即，所述第二视频流中、所述驾驶员的动作信息对应的视频片段，可以包括所述轨道交通工具前方的第二视频流中、决定所述驾驶员的动作信息对应的预定标准动作信息的视频片段。在另一个例子中，所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段，可以包括所述第二视频流中、与所述第一视频流中所述驾驶员的动作信息对应的视频片段的时间范围相同的视频片段。即，在这个例子中，所述第二视频流中、所述驾驶员的动作信息对应的视频片段，可以与所述第一视频流中、所述驾驶员的动作信息对应的视频片段的时间范围相同。
在该实现方式中，通过响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，由此能够便于相关人员对轨道交通驾驶员的驾驶动作进行查询或管理。
作为该实现方式的一个示例，所述驾驶员的动作信息的相关数据还包括以下至少之一：所述预定标准动作信息、所述驾驶员的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息。在该示例中，通过将所述预定标准动作信息、所述驾驶员 的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息中的至少之一发送至所述预设的驾驶员管理设备，由此能够辅助相关人员对轨道交通驾驶员的驾驶行为进行查询或管理，从而有助于提高轨道交通的安全性。
在其他可能的实现方式中，所述驾驶员的动作信息的相关数据还可以包括所述第一视频流中、所述驾驶员的动作信息对应的一个或多个视频帧，或者，所述第一视频流中、所述驾驶员的动作信息对应的一个或多个视频帧，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的一个或多个视频帧。
在一种可能的实现方式中，所述方法还包括：响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：向所述预设的驾驶员管理设备发送第一提示信息；控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配。例如，所述预设的驾驶员管理设备包括云端设备和/或所述轨道交通工具的运营方的终端设备，可以响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，向云端设备和/或所述轨道交通工具的运营方的终端设备发送第一提示信息。在一个例子中，向云端设备发送第一提示信息之后，所述云端设备可以存储第一提示信息，以便相关人员查询。在一个例子中，可以通过应用(Application，App)、短信等方式，向所述运营方的终端设备发送第一提示信息。其中，所述运营方的终端设备可以是所述运营方的管理员的终端设备(例如手机)等。在该实现方式中，还可以响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，控制设置在所述轨道交通工具中的信息输出设备发出用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配的第二提示信息。在该实现方式中，所述信息输出设备可以包括扬声器、显示屏、蜂鸣器、LED(Light Emitting Diode，发光二极管)中的至少之一。例如，可以通过扬声器播放语音形式的第二提示信息。又如，可以通过显示屏显示文字形式的第二提示信息。
在该实现方式中，通过响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，向所述预设的驾驶员管理设备发送第一提示信息，由此能够方便相关人员查询轨道交通工具的驾驶员不合规范的历史记录。通过响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，向所述轨道交通工具的运营方的终端设备发送第一提示信息，由此运营方能够及时收到提示信息，从而能够有效管理轨道交通驾驶员的驾驶行为。通过响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，通过设置在所述轨道交通工具中的信息输出设备发出第二提示信息，由此能够使轨道交通驾驶员及时获得提示，从而能够帮助驾驶员及时纠正驾驶行为。
在一种可能的实现方式中，所述方法还可以包括：根据所述第一视频流检测所述驾驶员的语音信息；将所述驾驶员的语音信息与预定标准语音信息进行匹配；响应于所述驾驶员的语音信息与预定标准语音信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的语音信息。在该实现方式中，所述预定标准语音信息可以表示预定的语音标准的信息。即，所述预定标准语音信息可以体现预定的语音标准。例如，所述预定标准语音信息可以包括语音的内容、音量、语速等中的至少之一。例如，可以根据“手指口呼”规范中的“口呼”规范，确定所述预定标准语音信息中语音的内容。例如，所述轨道交通工具前方的交通信号信息“出现交通信号灯，且交通信号灯显示为双黄灯或者黄闪黄”对应的预定标准语音信息包括呼唤信号显示和呼唤侧向限速值。
在一种可能的实现方式中，所述方法还包括：根据所述第一视频流进行人脸识别，得到所述驾驶员的身份信息；响应于所述驾驶员的身份信息不为所述轨道交通工具的合法驾驶员，执行以下至少之一：向预设的驾驶员管理设备发送第三提示信息、通过设置在所述轨道交通工具中的信息输出设备发出第四提示信息，其中，所述第三提示信息和所述第四提示信息用于提示所述驾驶员不为所述轨道交通工具的合法驾驶员；和/或，响应于所述驾驶员的身份信息不为所述轨道交通工具的当前排班的驾驶员，执行以下至少之一：向预设的驾驶员管理设备发送第五提示信息、通过设置在所述轨道交通工 具中的信息输出设备发出第六提示信息，其中，所述第五提示信息和所述第六提示信息用于提示所述驾驶员不为所述轨道交通工具的当前排班的驾驶员。
在该实现方式中，所述轨道交通工具的合法驾驶员，可以指已在管理设备注册的驾驶员。所述驾驶员的身份信息不为所述轨道交通工具的合法驾驶员，可以指所述驾驶员为未在管理设备注册的驾驶员，即，所述驾驶员不属于已在管理设备注册的驾驶员。所述轨道交通工具的当前排班的驾驶员，可以表示已在管理设备注册，且属于所述轨道交通工具的当前排班的驾驶员。
在该实现方式中，通过响应于所述驾驶员的身份信息不为所述轨道交通工具的合法驾驶员，向管理设备发送第三提示信息，由此能够通过管理设备记录不属于合法驾驶员的人员进入所述轨道交通工具的驾驶舱的信息，从而能够方便相关人员查询不属于合法驾驶员的人员进入所述轨道交通工具的驾驶舱的历史记录。通过响应于所述驾驶员的身份信息不为所述轨道交通工具的合法驾驶员，向所述轨道交通工具的运营方的终端设备发送第三提示信息，由此运营方能够及时收到提示信息，从而能够方便运营方及时对非法驾驶员入侵的情况进行管理。通过响应于所述驾驶员的身份信息不为所述轨道交通工具的合法驾驶员，通过设置在所述轨道交通工具中的信息输出设备发出第四提示信息，由此能够起到警示非法驾驶员的作用。通过响应于所述驾驶员的身份信息不为所述轨道交通工具的当前排班的驾驶员，向云端设备发送第五提示信息，由此能够通过云端设备记录轨道交通驾驶员当班的信息，从而能够方便相关人员查询轨道交通驾驶员的当班记录。通过响应于所述驾驶员的身份信息不为所述轨道交通工具的当前排班的驾驶员，向所述轨道交通工具的运营方的终端设备发送第五提示信息，由此运营方能够及时收到提示信息，从而能够方便运营方及时对轨道交通驾驶员的当班情况进行管理。通过响应于所述驾驶员的身份信息不为所述轨道交通工具的当前排班的驾驶员，通过设置在所述轨道交通工具中的信息输出设备发出第六提示信息，由此能够及时提示驾驶员当前排班的信息。
本公开实施例提供的轨道交通驾驶员的动作检测方法无需人为干预，能够提高轨道交通工具的运营方的运营效率，且能够提高轨道交通工具的行驶安全。
可以理解，本公开提及的上述各个方法实施例，在不违背原理逻辑的情况下，均可以彼此相互结合形成结合后的实施例，限于篇幅，本公开不再赘述。
本领域技术人员可以理解，在具体实施方式的上述方法中，各步骤的撰写顺序并不意味着严格的执行顺序而对实施过程构成任何限定，各步骤的具体执行顺序应当以其功能和可能的内在逻辑确定。
此外，本公开还提供了轨道交通驾驶员的动作检测装置、轨道交通工具、电子设备、计算机可读存储介质、程序，上述均可用来实现本公开提供的任一种轨道交通驾驶员的动作检测方法，相应技术方案和技术效果可参见方法部分的相应记载，不再赘述。
图8示出本公开实施例提供的轨道交通驾驶员的动作检测装置的框图。如图8所示，所述轨道交通驾驶员的动作检测装置包括：
第一获取模块21，用于获取轨道交通工具的驾驶区域的第一视频流；
检测模块22，用于根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息；
匹配模块23，用于将所述驾驶员的动作信息与预定标准动作信息进行匹配；
第一发送模块24，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在一种可能的实现方式中，所述装置还包括：
第二获取模块，获取所述轨道交通工具前方的交通信号信息；
确定模块，用于在将所述驾驶员的动作信息与预定标准动作信息进行匹配之前，根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述确定模块用于：
在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在一种可能的实现方式中，所述第二获取模块用于：对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。
在一种可能的实现方式中，所述轨道交通工具前方的交通信号信息包括以下至少之一：所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息。
在一种可能的实现方式中，所述第二获取模块用于：
获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息。
在一种可能的实现方式中，所述匹配模块23用于：
将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配；或者
在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配。
在一种可能的实现方式中，所述装置还包括：
第二发送模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
或者，
所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在一种可能的实现方式中，所述驾驶员的动作信息的相关数据还包括以下至少之一：所述预定标准动作信息、所述驾驶员的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息。
在一种可能的实现方式中，所述装置还包括：
匹配失败操作模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：
向所述预设的驾驶员管理设备发送第一提示信息；
控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；
其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配。
在本公开实施例中，通过获取轨道交通工具的驾驶区域的第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够基于所述轨道交通工具的驾驶区域的视频流对轨道交通驾驶员的动作进行高精度、低成本、无感知的分析，从而有助于对轨道交通驾驶员的驾驶行为进行管理，有助于提高轨道交通的安全性。
图9示出本公开实施例提供的轨道交通工具的一示例性的框图。如图9所示，所述轨道交通工具，包括：第一摄像头31，用于采集轨道交通工具的驾驶区域的第一视频流；智能分析设备32，用于从所述第一摄像头31获取所述第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
在本公开实施例中，所述轨道交通工具上可以安装有至少一个第一摄像头。所述第一摄像头可 以安装在所述轨道交通工具的驾驶舱内，且可以朝向驾驶员安装。所述智能分析设备可以安装在所述轨道交通工具的任意位置。例如，所述智能分析设备可以安装在所述轨道交通工具的驾驶舱内。又如，所述智能分析设备可以安装在所述轨道交通工具的机箱内。
在一种可能的实现方式中，所述轨道交通工具还包括：第二摄像头，用于采集所述轨道交通工具前方的第二视频流；所述智能分析设备32还用于：从所述第二摄像头获取所述轨道交通工具前方的第二视频流，对所述第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息，并根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
在该实现方式中，所述轨道交通工具上还安装有至少一个第二摄像头。所述第二摄像头可以朝向所述轨道交通工具的前方安装，例如，所述第二摄像头可以朝向轨道安装，以采集所述轨道交通工具前方的第二视频流。所述第二摄像头可以安装在轨道交通工具的驾驶舱内，也可以安装在轨道交通工具的驾驶舱外。
在一种可能的实现方式中，所述轨道交通工具还包括：列控车载设备，用于获取所述轨道交通工具前方的限速信号的信息；所述智能分析设备32还用于：从所述列控车载设备获取所述轨道交通工具前方的限速信号的信息，并根据所述轨道交通工具前方的限速信号的信息，确定预定标准动作信息。
在该实现方式中，所述列控车载设备可以安装在所述轨道交通工具的驾驶舱内。例如，所述列控车载设备安装在驾驶操作台上。
在一种可能的实现方式中，所述智能分析设备32还用于：响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：所述第一视频流中、所述驾驶员的动作信息对应的视频片段，或者，所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
在一种可能的实现方式中，所述智能分析设备32还用于：所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：向所述预设的驾驶员管理设备发送第一提示信息；控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配；所述轨道交通工具还包括：所述信息输出设备，用于发出所述第二提示信息。
在该实现方式中，所述信息输出设备可以设置于所述轨道交通工具的驾驶舱内。
图10示出本公开实施例提供的轨道交通工具的另一示例性的框图。在图10所示的示例中，所述轨道交通工具包括第一摄像头31、智能分析设备32、第二摄像头33、列控车载设备34和信息输出设备35。其中，第一摄像头31、第二摄像头33、列控车载设备34和信息输出设备35分别与智能分析设备32连接。
在本公开实施例中，通过第一摄像头采集轨道交通工具的驾驶区域的第一视频流，智能分析设备从所述第一摄像头获取轨道交通工具的驾驶区域的第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息，由此能够基于所述轨道交通工具的驾驶区域的视频流对轨道交通驾驶员的动作进行高精度、低成本、无感知的分析，从而有助于对轨道交通驾驶员的驾驶行为进行管理，有助于提高轨道交通的安全性。
在一些实施例中，本公开实施例提供的装置具有的功能或包含的模块可以用于执行上文方法实施例描述的方法，其具体实现和技术效果可以参照上文方法实施例的描述，为了简洁，这里不再赘述。
本公开实施例还提供一种计算机可读存储介质，其上存储有计算机程序指令，所述计算机程序指令被处理器执行时实现上述方法。其中，所述计算机可读存储介质可以是非易失性计算机可读存储介质，或者可以是易失性计算机可读存储介质。
本公开实施例还提出一种计算机程序，包括计算机可读代码，当所述计算机可读代码在电子设备中运行时，所述电子设备中的处理器执行用于实现上述方法。
本公开实施例还提出一种计算机程序产品，包括计算机可读代码，或者承载有计算机可读代码的非易失性计算机可读存储介质，当所述计算机可读代码在电子设备中运行时，所述电子设备中的处理器执行上述方法。
本公开实施例还提供一种电子设备，包括：一个或多个处理器；用于存储可执行指令的存储器；其中，所述一个或多个处理器被配置为调用所述存储器存储的可执行指令，以执行上述方法。
电子设备可以被提供为终端、服务器或其它形态的设备。例如，所述电子设备可以是智能分析设备、车载设备等等。
图11示出本公开实施例提供的一种电子设备800的框图。例如，电子设备800可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等终端。
参照图11，电子设备800可以包括以下一个或多个组件：处理组件802，存储器804，电源组件806，多媒体组件808，音频组件810，输入/输出(I/O)的接口812，传感器组件814，以及通信组件816。
处理组件802通常控制电子设备800的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理组件802可以包括一个或多个处理器820来执行指令，以完成上述的方法的全部或部分步骤。此外，处理组件802可以包括一个或多个模块，便于处理组件802和其他组件之间的交互。例如，处理组件802可以包括多媒体模块，以方便多媒体组件808和处理组件802之间的交互。
存储器804被配置为存储各种类型的数据以支持在电子设备800的操作。这些数据的示例包括用于在电子设备800上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件806为电子设备800的各种组件提供电力。电源组件806可以包括电源管理系统，一个或多个电源，及其他与为电子设备800生成、管理和分配电力相关联的组件。
多媒体组件808包括在所述电子设备800和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件808包括一个前置摄像头和/或后置摄像头。当电子设备800处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件810被配置为输出和/或输入音频信号。例如，音频组件810包括一个麦克风(MIC)，当电子设备800处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804或经由通信组件816发送。在一些实施例中，音频组件810还包括一个扬声器，用于输出音频信号。
I/O接口812为处理组件802和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件814包括一个或多个传感器，用于为电子设备800提供各个方面的状态评估。例如，传感器组件814可以检测到电子设备800的打开/关闭状态，组件的相对定位，例如所述组件为电子设备800的显示器和小键盘，传感器组件814还可以检测电子设备800或电子设备800一个组件的位置改变，用户与电子设备800接触的存在或不存在，电子设备800方位或加速/减速和电子设备800的温度变化。传感器组件814可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件814还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温度传感器。
通信组件816被配置为便于电子设备800和其他设备之间有线或无线方式的通信。电子设备800可以接入基于通信标准的无线网络，如Wi-Fi、2G、3G、4G/LTE、5G或它们的组合。在一个示例性实施例中，通信组件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信组件816还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，电子设备800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。
在示例性实施例中，还提供了一种非易失性计算机可读存储介质，例如包括计算机程序指令的存储器804，上述计算机程序指令可由电子设备800的处理器820执行以完成上述方法。
图12示出本公开实施例提供的一种电子设备1900的框图。例如，电子设备1900可以被提供为一服务器。参照图12，电子设备1900包括处理组件1922，其进一步包括一个或多个处理器，以及由存储器1932所代表的存储器资源，用于存储可由处理组件1922的执行的指令，例如应用程序。存储器1932中存储的应用程序可以包括一个或一个以上的每一个对应于一组指令的模块。此外，处理组件1922被配置为执行指令，以执行上述方法。
电子设备1900还可以包括一个电源组件1926被配置为执行电子设备1900的电源管理，一个有线或无线网络接口1950被配置为将电子设备1900连接到网络，和一个输入输出(I/O)接口1958。电子设备1900可以操作基于存储在存储器1932的操作系统，例如Windows
Figure PCTCN2021113544-appb-000001
Mac OS
Figure PCTCN2021113544-appb-000002
Figure PCTCN2021113544-appb-000003
或类似。
在示例性实施例中，还提供了一种非易失性计算机可读存储介质，例如包括计算机程序指令的存储器1932，上述计算机程序指令可由电子设备1900的处理组件1922执行以完成上述方法。
本公开可以是系统、方法和/或计算机程序产品。计算机程序产品可以包括计算机可读存储介质，其上载有用于使处理器实现本公开的各个方面的计算机可读程序指令。
计算机可读存储介质可以是可以保持和存储由指令执行设备使用的指令的有形设备。计算机可读存储介质例如可以是――但不限于――电存储设备、磁存储设备、光存储设备、电磁存储设备、半导体存储设备或者上述的任意合适的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、静态随机存取存储器(SRAM)、便携式压缩盘只读存储器(CD-ROM)、数字多功能盘(DVD)、记忆棒、软盘、机械编码设备、例如其上存储有指令的打孔卡或凹槽内凸起结构、以及上述的任意合适的组合。这里所使用的计算机可读存储介质不被解释为瞬时信号本身，诸如无线电波或者其他自由传播的电磁波、通过波导或其他传输媒介传播的电磁波(例如，通过光纤电缆的光脉冲)、或者通过电线传输的电信号。
这里所描述的计算机可读程序指令可以从计算机可读存储介质下载到各个计算/处理设备，或者 通过网络、例如因特网、局域网、广域网和/或无线网下载到外部计算机或外部存储设备。网络可以包括铜传输电缆、光纤传输、无线传输、路由器、防火墙、交换机、网关计算机和/或边缘服务器。每个计算/处理设备中的网络适配卡或者网络接口从网络接收计算机可读程序指令，并转发该计算机可读程序指令，以供存储在各个计算/处理设备中的计算机可读存储介质中。
用于执行本公开操作的计算机程序指令可以是汇编指令、指令集架构(ISA)指令、机器指令、机器相关指令、微代码、固件指令、状态设置数据、或者以一种或多种编程语言的任意组合编写的源代码或目标代码，所述编程语言包括面向对象的编程语言—诸如Smalltalk、C++等，以及常规的过程式编程语言—诸如“C”语言或类似的编程语言。计算机可读程序指令可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络—包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。在一些实施例中，通过利用计算机可读程序指令的状态信息来个性化定制电子电路，例如可编程逻辑电路、现场可编程门阵列(FPGA)或可编程逻辑阵列(PLA)，该电子电路可以执行计算机可读程序指令，从而实现本公开的各个方面。
这里参照根据本公开实施例的方法、装置(系统)和计算机程序产品的流程图和/或框图描述了本公开的各个方面。应当理解，流程图和/或框图的每个方框以及流程图和/或框图中各方框的组合，都可以由计算机可读程序指令实现。
这些计算机可读程序指令可以提供给通用计算机、专用计算机或其它可编程数据处理装置的处理器，从而生产出一种机器，使得这些指令在通过计算机或其它可编程数据处理装置的处理器执行时，产生了实现流程图和/或框图中的一个或多个方框中规定的功能/动作的装置。也可以把这些计算机可读程序指令存储在计算机可读存储介质中，这些指令使得计算机、可编程数据处理装置和/或其他设备以特定方式工作，从而，存储有指令的计算机可读介质则包括一个制造品，其包括实现流程图和/或框图中的一个或多个方框中规定的功能/动作的各个方面的指令。
也可以把计算机可读程序指令加载到计算机、其它可编程数据处理装置、或其它设备上，使得在计算机、其它可编程数据处理装置或其它设备上执行一系列操作步骤，以产生计算机实现的过程，从而使得在计算机、其它可编程数据处理装置、或其它设备上执行的指令实现流程图和/或框图中的一个或多个方框中规定的功能/动作。
附图中的流程图和框图显示了根据本公开的多个实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或指令的一部分，所述模块、程序段或指令的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。
该计算机程序产品可以具体通过硬件、软件或其结合的方式实现。在一个可选实施例中，所述计算机程序产品具体体现为计算机存储介质，在另一个可选实施例中，计算机程序产品具体体现为软件产品，例如软件开发包(Software Development Kit，SDK)等等。
以上已经描述了本公开的各实施例，上述说明是示例性的，并非穷尽性的，并且也不限于所披露的各实施例。在不偏离所说明的各实施例的范围和精神的情况下，对于本技术领域的普通技术人员来说许多修改和变更都是显而易见的。本文中所用术语的选择，旨在最好地解释各实施例的原理、实际应用或对市场中的技术的改进，或者使本技术领域的其它普通技术人员能理解本文披露的各实施例。

Claims (19)

  1. 一种轨道交通驾驶员的动作检测方法，其特征在于，包括：
    获取轨道交通工具的驾驶区域的第一视频流；
    根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息；
    将所述驾驶员的动作信息与预定标准动作信息进行匹配；
    响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
  2. 根据权利要求1所述的方法，其特征在于，
    所述方法还包括：获取所述轨道交通工具前方的交通信号信息；
    在将所述驾驶员的动作信息与预定标准动作信息进行匹配之前，根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
  3. 根据权利要求2所述的方法，其特征在于，所述根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息，包括：
    在预定时间范围内获取到所述轨道交通工具前方的交通信号信息的情况下，根据获取到的所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
  4. 根据权利要求3所述的方法，其特征在于，所述获取轨道交通工具前方的交通信号信息，包括：对所述轨道交通工具前方的第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息。
  5. 根据权利要求2至4中任一项所述的方法，其特征在于，所述轨道交通工具前方的交通信号信息包括以下至少之一：所述轨道交通工具前方的交通信号灯的信息、所述轨道交通工具前方的手势交通指引信号的信息、所述轨道交通工具前方的防护信号机的信息。
  6. 根据权利要求2至5中任意一项所述的方法，其特征在于，所述获取所述轨道交通工具前方的交通信号信息，包括：
    获取列控车载设备采集的所述轨道交通工具前方的限速信号的信息。
  7. 根据权利要求1至6中任意一项所述的方法，其特征在于，所述将所述驾驶员的动作信息与预定标准动作信息进行匹配，包括：
    将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配；或者
    在预定时长范围内未获取到所述轨道交通工具前方的交通信号信息的情况下，将所述驾驶员的动作信息与预设的非信号触发操作对应的预定标准动作信息进行匹配。
  8. 根据权利要求1至7中任意一项所述的方法，其特征在于，所述方法还包括：
    响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
    所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
    或者，
    所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
  9. 根据权利要求8所述的方法，其特征在于，所述驾驶员的动作信息的相关数据还包括以下至少之一：所述预定标准动作信息、所述驾驶员的动作信息对应的轨道交通工具前方的交通信号信息、所述驾驶员的动作信息对应的所述轨道交通工具的位置信息。
  10. 根据权利要求1至9中任意一项所述的方法，其特征在于，所述方法还包括：
    响应于所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：
    向所述预设的驾驶员管理设备发送第一提示信息；
    控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；
    其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动作信息与所述预定标准动作信息不匹配。
  11. 一种轨道交通驾驶员的动作检测装置，其特征在于，包括：
    第一获取模块，用于获取轨道交通工具的驾驶区域的第一视频流；
    检测模块，用于根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息；
    匹配模块，用于将所述驾驶员的动作信息与预定标准动作信息进行匹配；
    第一发送模块，用于响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
  12. 一种电子设备，其特征在于，包括：
    一个或多个处理器；
    用于存储可执行指令的存储器；
    其中，所述一个或多个处理器被配置为调用所述存储器存储的可执行指令，以执行权利要求1至10中任意一项所述的方法。
  13. 一种计算机可读存储介质，其上存储有计算机程序指令，其特征在于，所述计算机程序指令被处理器执行时实现权利要求1至10中任意一项所述的方法。
  14. 一种轨道交通工具，其特征在于，包括：
    第一摄像头，用于采集轨道交通工具的驾驶区域的第一视频流；
    智能分析设备，用于从所述第一摄像头获取所述第一视频流，根据所述第一视频流检测所述轨道交通工具的驾驶员的动作信息，将所述驾驶员的动作信息与预定标准动作信息进行匹配，并响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向预设的驾驶员管理设备发送所述驾驶员的动作信息。
  15. 根据权利要求14所述的轨道交通工具，其特征在于，
    所述轨道交通工具还包括：第二摄像头，用于采集所述轨道交通工具前方的第二视频流；
    所述智能分析设备还用于：从所述第二摄像头获取所述轨道交通工具前方的第二视频流，对所述第二视频流进行交通信号分析，得到所述轨道交通工具前方的交通信号信息，并根据所述轨道交通工具前方的交通信号信息，确定预定标准动作信息。
  16. 根据权利要求14或15所述的轨道交通工具，其特征在于，
    所述轨道交通工具还包括：列控车载设备，用于获取所述轨道交通工具前方的限速信号的信息；
    所述智能分析设备还用于：从所述列控车载设备获取所述轨道交通工具前方的限速信号的信息，并根据所述轨道交通工具前方的限速信号的信息，确定预定标准动作信息。
  17. 根据权利要求14至16中任意一项所述的轨道交通工具，其特征在于，所述智能分析设备还用于：
    响应于所述驾驶员的动作信息与所述预定标准动作信息匹配成功，向所述预设的驾驶员管理设备发送所述驾驶员的动作信息的相关数据，其中，所述相关数据包括：
    所述第一视频流中、所述驾驶员的动作信息对应的视频片段，
    或者，
    所述第一视频流中、所述驾驶员的动作信息对应的视频片段，以及所述轨道交通工具前方的第二视频流中、所述驾驶员的动作信息对应的视频片段。
  18. 根据权利要求14至17中任意一项所述的轨道交通工具，其特征在于，
    所述智能分析设备还用于：所述驾驶员的动作信息与所述预定标准动作信息匹配失败，执行以下至少之一：向所述预设的驾驶员管理设备发送第一提示信息；控制设置在所述轨道交通工具中的信息输出设备发出第二提示信息；其中，所述第一提示信息和所述第二提示信息用于提示所述驾驶员的动 作信息与所述预定标准动作信息不匹配；
    所述轨道交通工具还包括：所述信息输出设备，用于发出所述第二提示信息。
  19. 一种计算机程序产品，其特征在于，包括计算机可读代码，或者承载有计算机可读代码的非易失性计算机可读存储介质，当所述计算机可读代码在电子设备中运行时，所述电子设备中的处理器执行权利要求1至10中任意一项所述的方法。
PCT/CN2021/113544 2021-01-28 2021-08-19 轨交驾驶员的动作检测方法及装置、设备、介质及工具 WO2022160678A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110120985.1 2021-01-28
CN202110120985.1A CN112861677A (zh) 2021-01-28 2021-01-28 轨交驾驶员的动作检测方法及装置、设备、介质及工具

Publications (1)

Publication Number Publication Date
WO2022160678A1 true WO2022160678A1 (zh) 2022-08-04

Family

ID=75987829

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/113544 WO2022160678A1 (zh) 2021-01-28 2021-08-19 轨交驾驶员的动作检测方法及装置、设备、介质及工具

Country Status (2)

Country Link
CN (1) CN112861677A (zh)
WO (1) WO2022160678A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112660204A (zh) * 2020-12-31 2021-04-16 上海商汤临港智能科技有限公司 驾驶员检测方法、装置、设备、车辆、介质及产品
CN112861677A (zh) * 2021-01-28 2021-05-28 上海商汤临港智能科技有限公司 轨交驾驶员的动作检测方法及装置、设备、介质及工具
CN114582090A (zh) * 2022-02-27 2022-06-03 武汉铁路职业技术学院 一种轨道车辆驾驶监测预警系统

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170124868A1 (en) * 2015-10-30 2017-05-04 International Business Machines Corporation Using automobile driver attention focus area to share traffic intersection status
CN110525337A (zh) * 2019-09-11 2019-12-03 北京经纬恒润科技有限公司 车辆安全控制装置及方法
CN110543848A (zh) * 2019-08-29 2019-12-06 交控科技股份有限公司 一种基于三维卷积神经网络的驾驶员动作识别方法及装置
CN110588512A (zh) * 2019-09-25 2019-12-20 武汉极目智能技术有限公司 一种危险驾驶识别与预警装置、方法及系统
CN112141119A (zh) * 2020-09-23 2020-12-29 上海商汤临港智能科技有限公司 智能驾驶控制方法及装置、车辆、电子设备和存储介质
CN112861677A (zh) * 2021-01-28 2021-05-28 上海商汤临港智能科技有限公司 轨交驾驶员的动作检测方法及装置、设备、介质及工具

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105527710B (zh) * 2016-01-08 2018-11-20 北京乐驾科技有限公司 一种智能抬头显示系统
CN107126224B (zh) * 2017-06-20 2018-02-06 中南大学 一种基于Kinect的轨道列车驾驶员状态的实时监测预警方法与系统
CN107918764A (zh) * 2017-11-16 2018-04-17 百度在线网络技术（北京）有限公司 信息输出方法和装置
CN109002757A (zh) * 2018-06-04 2018-12-14 上海商汤智能科技有限公司 驾驶管理方法和系统、车载智能系统、电子设备、介质
CN108960067B (zh) * 2018-06-05 2021-04-13 北京华纵科技有限公司 基于深度学习的实时的列车驾驶员动作识别系统和方法
CN110745141A (zh) * 2019-10-28 2020-02-04 上海博泰悦臻网络技术服务有限公司 一种驾驶辅助方法及装置
CN112009389A (zh) * 2020-09-09 2020-12-01 上海商汤临港智能科技有限公司 车载视觉处理设备、系统、安装方法、处理方法及车辆
CN112224237A (zh) * 2020-10-21 2021-01-15 南京派光智慧感知信息技术有限公司 一种列车驾驶辅助系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170124868A1 (en) * 2015-10-30 2017-05-04 International Business Machines Corporation Using automobile driver attention focus area to share traffic intersection status
CN110543848A (zh) * 2019-08-29 2019-12-06 交控科技股份有限公司 一种基于三维卷积神经网络的驾驶员动作识别方法及装置
CN110525337A (zh) * 2019-09-11 2019-12-03 北京经纬恒润科技有限公司 车辆安全控制装置及方法
CN110588512A (zh) * 2019-09-25 2019-12-20 武汉极目智能技术有限公司 一种危险驾驶识别与预警装置、方法及系统
CN112141119A (zh) * 2020-09-23 2020-12-29 上海商汤临港智能科技有限公司 智能驾驶控制方法及装置、车辆、电子设备和存储介质
CN112861677A (zh) * 2021-01-28 2021-05-28 上海商汤临港智能科技有限公司 轨交驾驶员的动作检测方法及装置、设备、介质及工具

Also Published As

Publication number Publication date
CN112861677A (zh) 2021-05-28

Similar Documents

Publication Publication Date Title
WO2022160678A1 (zh) 轨交驾驶员的动作检测方法及装置、设备、介质及工具
WO2021159630A1 (zh) 交通工具通勤控制方法及装置、电子设备、介质和车辆
US20200317190A1 (en) Collision Control Method, Electronic Device and Storage Medium
WO2019206270A1 (zh) 测距方法、智能控制方法及装置、电子设备和存储介质
AU2019232950A1 (en) Autonomous vehicle notification system
CN104537860B (zh) 行车安全提示方法及装置
CN106004883A (zh) 车辆违规提醒的方法及装置
WO2022041671A1 (zh) 方向盘脱手检测方法及装置、电子设备和存储介质
CN112124073B (zh) 基于酒精检测的智能驾驶控制方法及装置
US20210192239A1 (en) Method for recognizing indication information of an indicator light, electronic apparatus and storage medium
EP3648076B1 (en) Method and apparatus for interacting traffic information, and computer storage medium
CN105488957A (zh) 疲劳驾驶检测方法及装置
TW201742028A (zh) 路況預警方法、設備、伺服器、控制設備及操作系統
US11180082B2 (en) Warning output device, warning output method, and warning output system
WO2021258664A1 (zh) 交通工具的控制方法及装置、电子设备和存储介质
US10821886B1 (en) Sensor-based acknowledgments between road traffic participants
WO2021057244A1 (zh) 光强调节方法及装置、电子设备和存储介质
WO2022183663A1 (zh) 事件检测方法、装置、电子设备、存储介质及程序产品
WO2022267279A1 (zh) 一种数据标注方法及装置、电子设备和存储介质
WO2022142331A1 (zh) 车载显示屏的控制方法及装置、电子设备和存储介质
WO2022052451A1 (zh) 一种影像信息的处理方法及装置、电子设备和存储介质
CN107316484A (zh) 行驶提示方法和装置、电子设备及计算机可读存储介质
US20220242430A1 (en) Vehicle information display system, vehicle information display device, and vehicle control system
CN106529411A (zh) 车辆提示方法及装置
WO2019154029A1 (zh) 找寻目标物的方法、装置及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21922273

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21922273

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18/12/2023)