CN110287810A - Car door motion detection method, device and computer readable storage medium - Google Patents

Car door motion detection method, device and computer readable storage medium Download PDF

Info

Publication number
CN110287810A
CN110287810A CN201910479309.6A CN201910479309A CN110287810A CN 110287810 A CN110287810 A CN 110287810A CN 201910479309 A CN201910479309 A CN 201910479309A CN 110287810 A CN110287810 A CN 110287810A
Authority
CN
China
Prior art keywords
video image
target video
car door
state
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910479309.6A
Other languages
Chinese (zh)
Other versions
CN110287810B (en
Inventor
朱延东
白戈
王长虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Douyin Vision Co Ltd
Douyin Vision Beijing Co Ltd
Original Assignee
Beijing ByteDance Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing ByteDance Network Technology Co Ltd filed Critical Beijing ByteDance Network Technology Co Ltd
Priority to CN201910479309.6A priority Critical patent/CN110287810B/en
Publication of CN110287810A publication Critical patent/CN110287810A/en
Application granted granted Critical
Publication of CN110287810B publication Critical patent/CN110287810B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

A kind of car door motion detection method of the disclosure, device, electronic equipment and computer readable storage medium.Wherein, which includes: to carry out door identification to the every frame video image for including in input video, determines at least frame target video image comprising the car door;Vehicle door status identification is carried out to an at least frame target video image respectively, obtains the vehicle door status in every frame target video image;Determine that car door acts according to the vehicle door status of an at least frame target video image.The embodiment of the present disclosure is by carrying out door identification to the every frame video image for including in input video, determine at least frame target video image comprising the car door, vehicle door status identification is carried out to an at least frame target video image respectively, obtain the vehicle door status in every frame target video image, it determines that car door acts according to the vehicle door status of an at least frame target video image, car door action recognition efficiency and recognition accuracy can be improved.

Description

Car door motion detection method, device and computer readable storage medium
Technical field
This disclosure relates to a kind of technical field of information processing, more particularly to a kind of car door motion detection method, device and Computer readable storage medium.
Background technique
In the prior art, action recognition usually passes through the certain specific features of manual designs, concentrates to data specific Movement is identified;However, conventional method is often difficult the knowledge obtained when in face of many and close reality scene situations Other effect.
And car door motion detection mainly for detection of open car door movement or closed door movement, according to existing skill Action recognition in art, then be likely to result in that recognition efficiency is low, or it is possible that identification mistake situation.
Summary of the invention
The technical issues of disclosure solves is to provide a kind of car door motion detection method, at least to be partially solved existing skill Action recognition low efficiency and there is technical issues that in art.In addition, also providing a kind of car door action detection device, car door Motion detection hardware device, computer readable storage medium and car door motion detection terminal.
To achieve the goals above, according to one aspect of the disclosure, the following technical schemes are provided:
A kind of car door motion detection method, comprising:
Door identification is carried out to the every frame video image for including in input video, determines at least frame comprising the car door Target video image;
Vehicle door status identification is carried out to an at least frame target video image respectively, is obtained in every frame target video image Vehicle door status;
Determine that car door acts according to the vehicle door status of an at least frame target video image.
Further, the vehicle door status of an at least frame target video image according to determines that car door acts, comprising:
Shape is formed according to the timing of at least vehicle door status of a frame target video image and corresponding target video image State time series;
Determine that car door acts according to the state for time sequence.
It is further, described to determine that car door acts according to the state for time sequence, comprising:
For each state assignment for including in the state for time sequence;Wherein, open state is corresponding different from off status Numerical value;
Detect the numerical value jump in the state for time sequence;
It is jumped according to the numerical value and determines car door movement.
Further, described jumped according to the numerical value determines car door movement, comprising:
Determine the corresponding first object video image of the first numerical value trip point and corresponding second mesh of second value trip point Mark video image;Wherein, the first numerical value trip point and the second value trip point are continuous trip point;
Determine the target video image frame number of the first object video image and second target video image interval;
Determine whether vehicle door status changes according to the target video image frame number;
Determine that car door acts according to the variation of the vehicle door status.
It is further, described to determine whether vehicle door status changes according to the target video image frame number, comprising:
If the target video image frame number is less than default frame number, it is determined that the vehicle door status does not change;Or
If the target video image frame number is greater than or equal to the default frame number, it is determined that the vehicle door status changes Become.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of car door action detection device, comprising:
Door identification module, for carrying out door identification to the every frame video image for including in input video, determination includes An at least frame target video image for the car door;
State recognition module is obtained for carrying out vehicle door status identification to an at least frame target video image respectively Vehicle door status in every frame target video image;
Determining module is acted, for determining that car door acts according to the vehicle door status of an at least frame target video image.
Further, the movement determining module includes:
Sequence forms unit, for according at least vehicle door status of a frame target video image and corresponding target video The timing of image forms state for time sequence;
Determination unit is acted, for determining that car door acts according to the state for time sequence.
Further, the movement determination unit is specifically used for: for each state for including in the state for time sequence Assignment;Wherein, open state and the corresponding different numerical value of off status;Detect the numerical value jump in the state for time sequence;According to The numerical value, which jumps, determines car door movement.
Further, the movement determination unit is specifically used for: determining the corresponding first object view of the first numerical value trip point Frequency image and corresponding second target video image of second value trip point;Wherein, the first numerical value trip point and described Two numerical value trip points are continuous trip point;Determine the first object video image and second target video image interval Target video image frame number;Determine whether vehicle door status changes according to the target video image frame number;According to the vehicle The variation of door state determines that car door acts.
Further, the movement determination unit is specifically used for: if the target video image frame number is less than default frame number, Then determine that the vehicle door status does not change;If or the target video image frame number be greater than or equal to the default frame number, Then determine that the vehicle door status changes.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of electronic equipment, comprising:
Memory, for storing non-transitory computer-readable instruction;And
Processor, for running the computer-readable instruction, so that the processor realizes any of the above-described vehicle when executing The step of described in door motion detection method technical solution.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory When computer-readable instruction is executed by computer, so that the computer executes any of the above-described car door motion detection method technical side The step of described in case.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of car door motion detection terminal, including any of the above-described car door action detection device.
The embodiment of the present disclosure determines to include institute by carrying out door identification to the every frame video image for including in input video An at least frame target video image for car door is stated, vehicle door status identification is carried out to an at least frame target video image respectively, The vehicle door status in every frame target video image is obtained, vehicle is determined according to the vehicle door status of an at least frame target video image Door movement, can be improved car door action recognition efficiency and recognition accuracy.
Above description is only the general introduction of disclosed technique scheme, in order to better understand the technological means of the disclosure, and It can be implemented in accordance with the contents of the specification, and to allow the above and other objects, features and advantages of the disclosure can be brighter Show understandable, it is special below to lift preferred embodiment, and cooperate attached drawing, detailed description are as follows.
Detailed description of the invention
Fig. 1 is the flow diagram according to the car door motion detection method of an embodiment of the present disclosure;
Fig. 2 is the structural schematic diagram according to the device of the car door motion detection of an embodiment of the present disclosure;
Fig. 3 is the structural schematic diagram according to the electronic equipment of an embodiment of the present disclosure.
Specific embodiment
Illustrate embodiment of the present disclosure below by way of specific specific example, those skilled in the art can be by this specification Disclosed content understands other advantages and effect of the disclosure easily.Obviously, described embodiment is only the disclosure A part of the embodiment, instead of all the embodiments.The disclosure can also be subject to reality by way of a different and different embodiment It applies or applies, the various details in this specification can also be based on different viewpoints and application, in the spirit without departing from the disclosure Lower carry out various modifications or alterations.It should be noted that in the absence of conflict, the feature in following embodiment and embodiment can To be combined with each other.Based on the embodiment in the disclosure, those of ordinary skill in the art are without making creative work Every other embodiment obtained belongs to the range of disclosure protection.
It should be noted that the various aspects of embodiment within the scope of the appended claims are described below.Ying Xian And be clear to, aspect described herein can be embodied in extensive diversified forms, and any specific structure described herein And/or function is only illustrative.Based on the disclosure, it will be understood by one of ordinary skill in the art that one described herein Aspect can be independently implemented with any other aspect, and can combine the two or both in these aspects or more in various ways. For example, carry out facilities and equipments in terms of any number set forth herein can be used and/or practice method.In addition, can make With other than one or more of aspect set forth herein other structures and/or it is functional implement this equipment and/or Practice the method.
It should also be noted that, diagram provided in following embodiment only illustrates the basic structure of the disclosure in a schematic way Think, component count, shape and the size when only display is with component related in the disclosure rather than according to actual implementation in schema are drawn System, when actual implementation kenel, quantity and the ratio of each component can arbitrarily change for one kind, and its assembly layout kenel can also It can be increasingly complex.
In addition, in the following description, specific details are provided for a thorough understanding of the examples.However, fields The skilled person will understand that the aspect can be practiced without these specific details.
In order to solve action recognition low efficiency in the prior art and there is technical issues that, the embodiment of the present disclosure is mentioned For a kind of car door motion detection method.As shown in Figure 1, the car door motion detection method mainly includes the following steps S1 to step S3.Wherein:
Step S1: door identification is carried out to the every frame video image for including in input video, is determined comprising the car door An at least frame target video image.
Wherein, input video can be stored in advance in local video, or real-time input video.
Specifically, car door detection can be carried out using object recognition algorithm in the prior art, include to determine in video The image of car door, such as adoptable algorithm include object recognition algorithm, SSD (Single Shoot based on deep learning Detectors) algorithm of target detection etc..
Step S2: carrying out vehicle door status identification to an at least frame target video image respectively, obtains every frame target view Vehicle door status in frequency image.
Wherein, vehicle door status includes on-state and off-state.
Step S3: determine that car door acts according to the vehicle door status of an at least frame target video image.
Wherein, car door movement includes the movement for opening car door and the movement of closed door.
Specifically, in two continuous frames target video image, if the state of car door is off status by open state variation, really The movement that car door movement is closed door is determined, if the state of car door is open state by off status variation, it is determined that car door, which acts, is Open the movement of car door.
The present embodiment determines to include the vehicle by carrying out door identification to the every frame video image for including in input video An at least frame target video image for door carries out vehicle door status identification to an at least frame target video image respectively, obtains Vehicle door status in every frame target video image determines that car door is dynamic according to the vehicle door status of an at least frame target video image Make, car door action recognition efficiency and recognition accuracy can be improved.
In an alternative embodiment, step S3 is specifically included:
Step S31: according at least vehicle door status of a frame target video image and corresponding target video image when Sequence forms state for time sequence.
Wherein, state for time sequence is made of the vehicle door status in each frame target video image, can use one-dimensional vector table Show.
Step S32: determine that car door acts according to the state for time sequence.
In an alternative embodiment, step S32 is specifically included:
Step S321: for each state assignment for including in the state for time sequence;Wherein, open state and off status pair Answer different numerical value.
Specifically, open state can be assigned a value of to 1, off status is assigned a value of 0, or open state is assigned a value of 0, and off status is assigned Value is 1, or other numerical value.
Step S322: the numerical value jump in the state for time sequence is detected.
Specifically, off status is assigned a value of 0 if open state is assigned a value of 1, obtaining state for time sequence is [0 0001 1], when detecting that numerical value becomes 1 from 0, then it is assumed that numerical value jump has occurred.
Step S323: it is jumped according to the numerical value and determines car door movement.
Specifically, if detecting, numerical value becomes 1 from 0 referring to the example in above-mentioned steps S322, can determine car door by Off status becomes open state, it is determined that car door movement is to open the movement of car door.
Further, step S323 is specifically included:
Determine the corresponding first object video image of the first numerical value trip point and corresponding second mesh of second value trip point Mark video image;Wherein, the first numerical value trip point and the second value trip point are continuous trip point;
Determine the target video image frame number of the first object video image and second target video image interval;
Determine whether vehicle door status changes according to the target video image frame number;
Determine that car door acts according to the variation of the vehicle door status.
It is further, described to determine whether vehicle door status changes according to the target video image frame number, comprising:
If the target video image frame number is less than default frame number, it is determined that the vehicle door status does not change;Or
If the target video image frame number is greater than or equal to the default frame number, it is determined that the vehicle door status changes Become.
Wherein, default frame number customized can be arranged.
Specifically, jumped in case of default frame number is not reached after jump again, then it is assumed that vehicle door status does not have It changes, only when jump continue for being more than that jump is just identified as vehicle door status and changes by default frame number, in this way It can be further improved car door action recognition efficiency.
Those skilled in the art will be understood that on the basis of above-mentioned each embodiment, can also carry out obvious variant (example Such as, cited mode is combined) or equivalent replacement.
Hereinbefore, although describing each step in car door motion detection method embodiment according to above-mentioned sequence, It will be apparent to one skilled in the art that the step in the embodiment of the present disclosure not necessarily executes in the order described above, can also fall Other sequences such as sequence, parallel, intersection execute, moreover, those skilled in the art can also add on the basis of above-mentioned steps The mode of other steps, these obvious variants or equivalent replacement should also be included within the protection scope of the disclosure, herein no longer It repeats.
It is below embodiment of the present disclosure, embodiment of the present disclosure can be used for executing embodiments of the present disclosure realization The step of, for ease of description, part relevant to the embodiment of the present disclosure is illustrated only, it is disclosed by specific technical details, it asks Referring to embodiments of the present disclosure.
In order to solve to carry out the technical issues of triggering be easy to cause erroneous judgement, this public affairs by eyes while blink in the prior art It opens embodiment and a kind of car door action detection device is provided.The device can execute in above-mentioned car door motion detection method embodiment Step.As shown in Fig. 2, the device mainly includes: door identification module 21, state recognition module 22 and movement determining module 23; Wherein,
Door identification module 21 is used to carry out door identification to the every frame video image for including in input video, and determination includes An at least frame target video image for the car door;
State recognition module 22 is obtained for carrying out vehicle door status identification to an at least frame target video image respectively Vehicle door status in every frame target video image;
Movement determining module 23 is used to determine that car door is acted according to the vehicle door status of an at least frame target video image.
Further, the movement determining module 23 includes: that sequence forms unit 231 and movement determination unit 232;Its In,
Sequence forms unit 231 and is used for according at least vehicle door status of a frame target video image and corresponding target view The timing of frequency image forms state for time sequence;
Movement determination unit 232 is used to determine that car door is acted according to the state for time sequence.
Further, the movement determination unit 232 is specifically used for: for each shape for including in the state for time sequence State assignment;Wherein, open state and the corresponding different numerical value of off status;Detect the numerical value jump in the state for time sequence;Root It is jumped according to the numerical value and determines car door movement.
Further, the movement determination unit 232 is specifically used for: determining the corresponding first object of the first numerical value trip point Video image and corresponding second target video image of second value trip point;Wherein, the first numerical value trip point and described Second value trip point is continuous trip point;Determine the first object video image and second target video image interval Target video image frame number;Determine whether vehicle door status changes according to the target video image frame number;According to described The variation of vehicle door status determines that car door acts.
Further, the movement determination unit 232 is specifically used for: if the target video image frame number is less than default frame Number, it is determined that the vehicle door status does not change;If or the target video image frame number is greater than or equal to the default frame Number, it is determined that the vehicle door status changes.
The detailed descriptions such as the technical effect of working principle, realization in relation to car door action detection device embodiment can refer to Related description in aforementioned car door motion detection method embodiment, details are not described herein.
Below with reference to Fig. 3, it illustrates the structural schematic diagrams for the electronic equipment for being suitable for being used to realize the embodiment of the present disclosure.This Electronic equipment in open embodiment can include but is not limited to such as mobile phone, laptop, digit broadcasting receiver, PDA (personal digital assistant), PAD (tablet computer), PMP (portable media player), car-mounted terminal (such as vehicle mounted guidance Terminal) etc. mobile terminal and such as number TV, desktop computer etc. fixed terminal.Electronic equipment shown in Fig. 3 An only example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
As shown in figure 3, electronic equipment may include processing unit (such as central processing unit, graphics processor etc.) 301, Random access storage device can be loaded into according to the program being stored in read-only memory (ROM) 302 or from storage device 308 (RAM) program in 303 and execute various movements appropriate and processing.In RAM 303, it is also stored with electronic device institute The various programs and data needed.Processing unit 301, ROM 302 and RAM 303 are connected with each other by bus 304.Input/defeated (I/O) interface 305 is also connected to bus 304 out.
In general, following device can connect to I/O interface 305: including such as touch screen, touch tablet, keyboard, mouse, figure As the input unit 306 of sensor, microphone, accelerometer, gyroscope etc.;Including such as liquid crystal display (LCD), loudspeaking The output device 307 of device, vibrator etc.;Storage device 308 including such as tape, hard disk etc.;And communication device 309.It is logical T unit 309 can permit electronic equipment and wirelessly or non-wirelessly be communicated with other equipment to exchange data.Although Fig. 3 is shown Electronic equipment with various devices, it should be understood that being not required for implementing or having all devices shown.It can replace Implement or have more or fewer devices in generation ground.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium On computer program, which includes the program code for method shown in execution flow chart.In such reality It applies in example, which can be downloaded and installed from network by communication device 309, or from storage device 308 It is mounted, or is mounted from ROM 302.When the computer program is executed by processing unit 301, the embodiment of the present disclosure is executed Method in the above-mentioned function that limits.
It should be noted that the above-mentioned computer-readable medium of the disclosure can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated, In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable and deposit Any computer-readable medium other than storage media, the computer-readable signal media can send, propagate or transmit and be used for By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium Program code can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (radio frequency) etc. are above-mentioned Any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment;It is also possible to individualism, and not It is fitted into the electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by the electricity When sub- equipment executes, so that the electronic equipment: carrying out door identification to the every frame video image for including in input video, determine packet An at least frame target video image containing the car door;Vehicle door status knowledge is carried out to an at least frame target video image respectively Not, the vehicle door status in every frame target video image is obtained;Vehicle door status according to an at least frame target video image is true Determine car door movement.
Alternatively, above-mentioned computer-readable medium carries one or more program, when said one or multiple programs When being executed by the electronic equipment, so that the electronic equipment: door identification is carried out to the every frame video image for including in input video, Determine at least frame target video image comprising the car door;Car door is carried out to an at least frame target video image respectively State recognition obtains the vehicle door status in every frame target video image;According to the car door of an at least frame target video image State determines that car door acts.
The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof Machine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C+ +, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package, Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part. In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN) Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service Provider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction Combination realize.
Being described in unit involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard The mode of part is realized.Wherein, the title of unit does not constitute the restriction to the unit itself under certain conditions, for example, the One acquiring unit is also described as " obtaining the unit of at least two internet protocol addresses ".
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that the open scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from design disclosed above, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (12)

1. a kind of car door motion detection method characterized by comprising
Door identification is carried out to the every frame video image for including in input video, determines at least frame target comprising the car door Video image;
Vehicle door status identification is carried out to an at least frame target video image respectively, obtains the vehicle in every frame target video image Door state;
Determine that car door acts according to the vehicle door status of an at least frame target video image.
2. the method according to claim 1, wherein at least vehicle of a frame target video image according to Door state determines that car door acts, comprising:
When forming state according to the timing of at least vehicle door status of a frame target video image and corresponding target video image Between sequence;
Determine that car door acts according to the state for time sequence.
3. according to the method described in claim 2, it is characterized in that, described determine that car door is dynamic according to the state for time sequence Make, comprising:
For each state assignment for including in the state for time sequence;Wherein, open state and the corresponding different numerical value of off status;
Detect the numerical value jump in the state for time sequence;
It is jumped according to the numerical value and determines car door movement.
4. according to the method described in claim 3, it is characterized in that, described jumped according to the numerical value determines car door movement, packet It includes:
Determine the corresponding first object video image of the first numerical value trip point and the corresponding second target view of second value trip point Frequency image;Wherein, the first numerical value trip point and the second value trip point are continuous trip point;
Determine the target video image frame number of the first object video image and second target video image interval;
Determine whether vehicle door status changes according to the target video image frame number;
Determine that car door acts according to the variation of the vehicle door status.
5. according to the method described in claim 4, it is characterized in that, described determine car door according to the target video image frame number Whether state changes, comprising:
If the target video image frame number is less than default frame number, it is determined that the vehicle door status does not change;Or
If the target video image frame number is greater than or equal to the default frame number, it is determined that the vehicle door status changes.
6. a kind of car door action detection device characterized by comprising
Door identification module is determined for carrying out door identification to the every frame video image for including in input video comprising described An at least frame target video image for car door;
State recognition module obtains every frame for carrying out vehicle door status identification to an at least frame target video image respectively Vehicle door status in target video image;
Determining module is acted, for determining that car door acts according to the vehicle door status of an at least frame target video image.
7. device according to claim 6, which is characterized in that the movement determining module includes:
Sequence forms unit, for according at least vehicle door status of a frame target video image and corresponding target video image Timing formed state for time sequence;
Determination unit is acted, for determining that car door acts according to the state for time sequence.
8. device according to claim 7, which is characterized in that the movement determination unit is specifically used for: for the state The each state assignment for including in time series;Wherein, open state and the corresponding different numerical value of off status;When detecting the state Between numerical value jump in sequence;It is jumped according to the numerical value and determines car door movement.
9. device according to claim 8, which is characterized in that the movement determination unit is specifically used for: determining the first number It is worth the corresponding first object video image of trip point and corresponding second target video image of second value trip point;Wherein, institute It states the first numerical value trip point and the second value trip point is continuous trip point;Determine the first object video image and institute State the target video image frame number at the second target video image interval;Vehicle door status is determined according to the target video image frame number Whether change;Determine that car door acts according to the variation of the vehicle door status.
10. device according to claim 9, which is characterized in that the movement determination unit is specifically used for: if the target Video image frame number is less than default frame number, it is determined that the vehicle door status does not change;If or the target video image frame Number is greater than or equal to the default frame number, it is determined that the vehicle door status changes.
11. a kind of electronic equipment, comprising:
Memory, for storing non-transitory computer-readable instruction;And
Processor, for running the computer-readable instruction, so that realizing according to claim 1-5 when the processor executes Any one of described in car door motion detection method.
12. a kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory meter When calculation machine readable instruction is executed by computer, so that the computer perform claim requires car door described in any one of 1-5 Motion detection method.
CN201910479309.6A 2019-06-04 2019-06-04 Vehicle door motion detection method, device and computer readable storage medium Active CN110287810B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910479309.6A CN110287810B (en) 2019-06-04 2019-06-04 Vehicle door motion detection method, device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910479309.6A CN110287810B (en) 2019-06-04 2019-06-04 Vehicle door motion detection method, device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN110287810A true CN110287810A (en) 2019-09-27
CN110287810B CN110287810B (en) 2021-05-25

Family

ID=68003053

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910479309.6A Active CN110287810B (en) 2019-06-04 2019-06-04 Vehicle door motion detection method, device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN110287810B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111160213A (en) * 2019-12-25 2020-05-15 广州方纬智慧大脑研究开发有限公司 Illegal boarding and alighting detection method and system based on deep learning and storage medium
CN111931667A (en) * 2020-07-15 2020-11-13 南京翱翔信息物理融合创新研究院有限公司 Method and system for detecting contact conversion fault, imaging device and device
CN113075212A (en) * 2019-12-24 2021-07-06 北京嘀嘀无限科技发展有限公司 Vehicle verification method and device
CN113279652A (en) * 2021-05-31 2021-08-20 的卢技术有限公司 Vehicle door anti-pinch control method and device, electronic equipment and readable storage medium
CN113657299A (en) * 2021-08-20 2021-11-16 青岛海信网络科技股份有限公司 Traffic accident determination method and electronic equipment

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1128600A (en) * 1994-03-29 1996-08-07 株式会社东芝 Device for confirmation of rear view of vehicle
US20060215884A1 (en) * 2005-03-22 2006-09-28 Omron Corporation Apparatus for authenticating vehicle driver
US20110156865A1 (en) * 2009-12-29 2011-06-30 Dong-A University Research Foundation For Industry-Academy Cooperation Wireless control system and method using multiple fingerprint recognition
CN103095407A (en) * 2012-12-28 2013-05-08 广州中大微电子有限公司 Digital coding device of reader-writer chip and coding method applying the same
CN103926999A (en) * 2013-01-16 2014-07-16 株式会社理光 Palm opening and closing gesture recognition method and device and man-machine interaction method and device
CN104766038A (en) * 2014-01-02 2015-07-08 株式会社理光 Palm opening and closing action recognition method and device
CN105909116A (en) * 2016-04-28 2016-08-31 百度在线网络技术(北京)有限公司 Vehicle door control method, device and system
CN106897658A (en) * 2015-12-18 2017-06-27 腾讯科技(深圳)有限公司 The discrimination method and device of face live body
CN107743205A (en) * 2017-09-11 2018-02-27 广东欧珀移动通信有限公司 Image processing method and device, electronic installation and computer-readable recording medium
CN108520531A (en) * 2018-05-23 2018-09-11 安徽富煌科技股份有限公司 A kind of vehicle door status self-adapting detecting system based on video analysis
CN109033993A (en) * 2018-06-29 2018-12-18 南京行者易智能交通科技有限公司 A kind of method and device of image recognition detection switch door
CN109086873A (en) * 2018-08-01 2018-12-25 北京旷视科技有限公司 Training method, recognition methods, device and the processing equipment of recurrent neural network
CN109409235A (en) * 2018-09-27 2019-03-01 Oppo广东移动通信有限公司 Image-recognizing method and device, electronic equipment, computer readable storage medium

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1128600A (en) * 1994-03-29 1996-08-07 株式会社东芝 Device for confirmation of rear view of vehicle
US20060215884A1 (en) * 2005-03-22 2006-09-28 Omron Corporation Apparatus for authenticating vehicle driver
US20110156865A1 (en) * 2009-12-29 2011-06-30 Dong-A University Research Foundation For Industry-Academy Cooperation Wireless control system and method using multiple fingerprint recognition
CN103095407A (en) * 2012-12-28 2013-05-08 广州中大微电子有限公司 Digital coding device of reader-writer chip and coding method applying the same
CN103926999A (en) * 2013-01-16 2014-07-16 株式会社理光 Palm opening and closing gesture recognition method and device and man-machine interaction method and device
CN104766038A (en) * 2014-01-02 2015-07-08 株式会社理光 Palm opening and closing action recognition method and device
CN106897658A (en) * 2015-12-18 2017-06-27 腾讯科技(深圳)有限公司 The discrimination method and device of face live body
CN105909116A (en) * 2016-04-28 2016-08-31 百度在线网络技术(北京)有限公司 Vehicle door control method, device and system
CN107743205A (en) * 2017-09-11 2018-02-27 广东欧珀移动通信有限公司 Image processing method and device, electronic installation and computer-readable recording medium
CN108520531A (en) * 2018-05-23 2018-09-11 安徽富煌科技股份有限公司 A kind of vehicle door status self-adapting detecting system based on video analysis
CN109033993A (en) * 2018-06-29 2018-12-18 南京行者易智能交通科技有限公司 A kind of method and device of image recognition detection switch door
CN109086873A (en) * 2018-08-01 2018-12-25 北京旷视科技有限公司 Training method, recognition methods, device and the processing equipment of recurrent neural network
CN109409235A (en) * 2018-09-27 2019-03-01 Oppo广东移动通信有限公司 Image-recognizing method and device, electronic equipment, computer readable storage medium

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113075212A (en) * 2019-12-24 2021-07-06 北京嘀嘀无限科技发展有限公司 Vehicle verification method and device
CN111160213A (en) * 2019-12-25 2020-05-15 广州方纬智慧大脑研究开发有限公司 Illegal boarding and alighting detection method and system based on deep learning and storage medium
CN111931667A (en) * 2020-07-15 2020-11-13 南京翱翔信息物理融合创新研究院有限公司 Method and system for detecting contact conversion fault, imaging device and device
WO2022011774A1 (en) * 2020-07-15 2022-01-20 南京翱翔信息物理融合创新研究院有限公司 Method, system, imaging device, and apparatus for detecting contact switching fault
CN113279652A (en) * 2021-05-31 2021-08-20 的卢技术有限公司 Vehicle door anti-pinch control method and device, electronic equipment and readable storage medium
CN113657299A (en) * 2021-08-20 2021-11-16 青岛海信网络科技股份有限公司 Traffic accident determination method and electronic equipment

Also Published As

Publication number Publication date
CN110287810B (en) 2021-05-25

Similar Documents

Publication Publication Date Title
CN110287810A (en) Car door motion detection method, device and computer readable storage medium
CN110381368A (en) Video cover generation method, device and electronic equipment
CN110362225B (en) Touch screen sampling frequency control method and device, medium and electronic equipment
CN110399848A (en) Video cover generation method, device and electronic equipment
CN110276346A (en) Target area identification model training method, device and computer readable storage medium
CN110287816A (en) Car door motion detection method, device and computer readable storage medium
CN109299348A (en) A kind of data query method, apparatus, electronic equipment and storage medium
CN109976620A (en) List items show determination method, apparatus, equipment and the storage medium of attribute information
EP4161065A1 (en) Video call interface display control method and apparatus, storage medium, and device
CN110070063A (en) Action identification method, device and the electronic equipment of target object
CN110415276A (en) Motion information calculation method, device and electronic equipment
CN109697010A (en) A kind of suspended window position control method, terminal and computer readable storage medium
CN110287891A (en) Gestural control method, device and electronic equipment based on human body key point
CN110389796A (en) Edit operation processing method, device and electronic equipment
CN110191356A (en) Video reviewing method, device and electronic equipment
CN110287950A (en) Target detection and the training method of target detection model, device and electronic equipment
CN110177295A (en) Processing method, device and the electronic equipment that subtitle crosses the border
CN110287954A (en) Target area determines training method, device and the computer readable storage medium of model
CN110287817A (en) Target identification and the training method of Model of Target Recognition, device and electronic equipment
CN110069997A (en) Scene classification method, device and electronic equipment
CN109582442A (en) Processing method, electronic equipment and the computer storage medium of memory spilling OOM
CN110059064A (en) Journal file processing method, device and computer readable storage medium
EP4109229A1 (en) Notification message processing method and apparatus, and electronic device, and storage medium
CN109981989A (en) Render method, apparatus, electronic equipment and the computer readable storage medium of image
CN109460543A (en) A kind of input method of logical expression, device, electronic equipment and readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing.

Patentee after: Tiktok vision (Beijing) Co.,Ltd.

Address before: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing.

Patentee before: BEIJING BYTEDANCE NETWORK TECHNOLOGY Co.,Ltd.

Address after: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing.

Patentee after: Douyin Vision Co.,Ltd.

Address before: 100041 B-0035, 2 floor, 3 building, 30 Shixing street, Shijingshan District, Beijing.

Patentee before: Tiktok vision (Beijing) Co.,Ltd.

CP01 Change in the name or title of a patent holder