Summary of the invention
The technical issues of disclosure solves is to provide a kind of car door motion detection method, at least to be partially solved existing skill
Action recognition low efficiency and there is technical issues that in art.In addition, also providing a kind of car door action detection device, car door
Motion detection hardware device, computer readable storage medium and car door motion detection terminal.
To achieve the goals above, according to one aspect of the disclosure, the following technical schemes are provided:
A kind of car door motion detection method, comprising:
Door identification is carried out to the every frame video image for including in input video, determines at least frame comprising the car door
Target video image;
Vehicle door status identification is carried out to an at least frame target video image respectively, is obtained in every frame target video image
Vehicle door status;
Determine that car door acts according to the vehicle door status of an at least frame target video image.
Further, the vehicle door status of an at least frame target video image according to determines that car door acts, comprising:
Shape is formed according to the timing of at least vehicle door status of a frame target video image and corresponding target video image
State time series;
Determine that car door acts according to the state for time sequence.
It is further, described to determine that car door acts according to the state for time sequence, comprising:
For each state assignment for including in the state for time sequence;Wherein, open state is corresponding different from off status
Numerical value;
Detect the numerical value jump in the state for time sequence;
It is jumped according to the numerical value and determines car door movement.
Further, described jumped according to the numerical value determines car door movement, comprising:
Determine the corresponding first object video image of the first numerical value trip point and corresponding second mesh of second value trip point
Mark video image;Wherein, the first numerical value trip point and the second value trip point are continuous trip point;
Determine the target video image frame number of the first object video image and second target video image interval;
Determine whether vehicle door status changes according to the target video image frame number;
Determine that car door acts according to the variation of the vehicle door status.
It is further, described to determine whether vehicle door status changes according to the target video image frame number, comprising:
If the target video image frame number is less than default frame number, it is determined that the vehicle door status does not change;Or
If the target video image frame number is greater than or equal to the default frame number, it is determined that the vehicle door status changes
Become.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of car door action detection device, comprising:
Door identification module, for carrying out door identification to the every frame video image for including in input video, determination includes
An at least frame target video image for the car door;
State recognition module is obtained for carrying out vehicle door status identification to an at least frame target video image respectively
Vehicle door status in every frame target video image;
Determining module is acted, for determining that car door acts according to the vehicle door status of an at least frame target video image.
Further, the movement determining module includes:
Sequence forms unit, for according at least vehicle door status of a frame target video image and corresponding target video
The timing of image forms state for time sequence;
Determination unit is acted, for determining that car door acts according to the state for time sequence.
Further, the movement determination unit is specifically used for: for each state for including in the state for time sequence
Assignment;Wherein, open state and the corresponding different numerical value of off status;Detect the numerical value jump in the state for time sequence;According to
The numerical value, which jumps, determines car door movement.
Further, the movement determination unit is specifically used for: determining the corresponding first object view of the first numerical value trip point
Frequency image and corresponding second target video image of second value trip point;Wherein, the first numerical value trip point and described
Two numerical value trip points are continuous trip point;Determine the first object video image and second target video image interval
Target video image frame number;Determine whether vehicle door status changes according to the target video image frame number;According to the vehicle
The variation of door state determines that car door acts.
Further, the movement determination unit is specifically used for: if the target video image frame number is less than default frame number,
Then determine that the vehicle door status does not change;If or the target video image frame number be greater than or equal to the default frame number,
Then determine that the vehicle door status changes.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of electronic equipment, comprising:
Memory, for storing non-transitory computer-readable instruction;And
Processor, for running the computer-readable instruction, so that the processor realizes any of the above-described vehicle when executing
The step of described in door motion detection method technical solution.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of computer readable storage medium, for storing non-transitory computer-readable instruction, when the non-transitory
When computer-readable instruction is executed by computer, so that the computer executes any of the above-described car door motion detection method technical side
The step of described in case.
To achieve the goals above, according to the another aspect of the disclosure, and also the following technical schemes are provided:
A kind of car door motion detection terminal, including any of the above-described car door action detection device.
The embodiment of the present disclosure determines to include institute by carrying out door identification to the every frame video image for including in input video
An at least frame target video image for car door is stated, vehicle door status identification is carried out to an at least frame target video image respectively,
The vehicle door status in every frame target video image is obtained, vehicle is determined according to the vehicle door status of an at least frame target video image
Door movement, can be improved car door action recognition efficiency and recognition accuracy.
Above description is only the general introduction of disclosed technique scheme, in order to better understand the technological means of the disclosure, and
It can be implemented in accordance with the contents of the specification, and to allow the above and other objects, features and advantages of the disclosure can be brighter
Show understandable, it is special below to lift preferred embodiment, and cooperate attached drawing, detailed description are as follows.
Specific embodiment
Illustrate embodiment of the present disclosure below by way of specific specific example, those skilled in the art can be by this specification
Disclosed content understands other advantages and effect of the disclosure easily.Obviously, described embodiment is only the disclosure
A part of the embodiment, instead of all the embodiments.The disclosure can also be subject to reality by way of a different and different embodiment
It applies or applies, the various details in this specification can also be based on different viewpoints and application, in the spirit without departing from the disclosure
Lower carry out various modifications or alterations.It should be noted that in the absence of conflict, the feature in following embodiment and embodiment can
To be combined with each other.Based on the embodiment in the disclosure, those of ordinary skill in the art are without making creative work
Every other embodiment obtained belongs to the range of disclosure protection.
It should be noted that the various aspects of embodiment within the scope of the appended claims are described below.Ying Xian
And be clear to, aspect described herein can be embodied in extensive diversified forms, and any specific structure described herein
And/or function is only illustrative.Based on the disclosure, it will be understood by one of ordinary skill in the art that one described herein
Aspect can be independently implemented with any other aspect, and can combine the two or both in these aspects or more in various ways.
For example, carry out facilities and equipments in terms of any number set forth herein can be used and/or practice method.In addition, can make
With other than one or more of aspect set forth herein other structures and/or it is functional implement this equipment and/or
Practice the method.
It should also be noted that, diagram provided in following embodiment only illustrates the basic structure of the disclosure in a schematic way
Think, component count, shape and the size when only display is with component related in the disclosure rather than according to actual implementation in schema are drawn
System, when actual implementation kenel, quantity and the ratio of each component can arbitrarily change for one kind, and its assembly layout kenel can also
It can be increasingly complex.
In addition, in the following description, specific details are provided for a thorough understanding of the examples.However, fields
The skilled person will understand that the aspect can be practiced without these specific details.
In order to solve action recognition low efficiency in the prior art and there is technical issues that, the embodiment of the present disclosure is mentioned
For a kind of car door motion detection method.As shown in Figure 1, the car door motion detection method mainly includes the following steps S1 to step
S3.Wherein:
Step S1: door identification is carried out to the every frame video image for including in input video, is determined comprising the car door
An at least frame target video image.
Wherein, input video can be stored in advance in local video, or real-time input video.
Specifically, car door detection can be carried out using object recognition algorithm in the prior art, include to determine in video
The image of car door, such as adoptable algorithm include object recognition algorithm, SSD (Single Shoot based on deep learning
Detectors) algorithm of target detection etc..
Step S2: carrying out vehicle door status identification to an at least frame target video image respectively, obtains every frame target view
Vehicle door status in frequency image.
Wherein, vehicle door status includes on-state and off-state.
Step S3: determine that car door acts according to the vehicle door status of an at least frame target video image.
Wherein, car door movement includes the movement for opening car door and the movement of closed door.
Specifically, in two continuous frames target video image, if the state of car door is off status by open state variation, really
The movement that car door movement is closed door is determined, if the state of car door is open state by off status variation, it is determined that car door, which acts, is
Open the movement of car door.
The present embodiment determines to include the vehicle by carrying out door identification to the every frame video image for including in input video
An at least frame target video image for door carries out vehicle door status identification to an at least frame target video image respectively, obtains
Vehicle door status in every frame target video image determines that car door is dynamic according to the vehicle door status of an at least frame target video image
Make, car door action recognition efficiency and recognition accuracy can be improved.
In an alternative embodiment, step S3 is specifically included:
Step S31: according at least vehicle door status of a frame target video image and corresponding target video image when
Sequence forms state for time sequence.
Wherein, state for time sequence is made of the vehicle door status in each frame target video image, can use one-dimensional vector table
Show.
Step S32: determine that car door acts according to the state for time sequence.
In an alternative embodiment, step S32 is specifically included:
Step S321: for each state assignment for including in the state for time sequence;Wherein, open state and off status pair
Answer different numerical value.
Specifically, open state can be assigned a value of to 1, off status is assigned a value of 0, or open state is assigned a value of 0, and off status is assigned
Value is 1, or other numerical value.
Step S322: the numerical value jump in the state for time sequence is detected.
Specifically, off status is assigned a value of 0 if open state is assigned a value of 1, obtaining state for time sequence is [0 0001
1], when detecting that numerical value becomes 1 from 0, then it is assumed that numerical value jump has occurred.
Step S323: it is jumped according to the numerical value and determines car door movement.
Specifically, if detecting, numerical value becomes 1 from 0 referring to the example in above-mentioned steps S322, can determine car door by
Off status becomes open state, it is determined that car door movement is to open the movement of car door.
Further, step S323 is specifically included:
Determine the corresponding first object video image of the first numerical value trip point and corresponding second mesh of second value trip point
Mark video image;Wherein, the first numerical value trip point and the second value trip point are continuous trip point;
Determine the target video image frame number of the first object video image and second target video image interval;
Determine whether vehicle door status changes according to the target video image frame number;
Determine that car door acts according to the variation of the vehicle door status.
It is further, described to determine whether vehicle door status changes according to the target video image frame number, comprising:
If the target video image frame number is less than default frame number, it is determined that the vehicle door status does not change;Or
If the target video image frame number is greater than or equal to the default frame number, it is determined that the vehicle door status changes
Become.
Wherein, default frame number customized can be arranged.
Specifically, jumped in case of default frame number is not reached after jump again, then it is assumed that vehicle door status does not have
It changes, only when jump continue for being more than that jump is just identified as vehicle door status and changes by default frame number, in this way
It can be further improved car door action recognition efficiency.
Those skilled in the art will be understood that on the basis of above-mentioned each embodiment, can also carry out obvious variant (example
Such as, cited mode is combined) or equivalent replacement.
Hereinbefore, although describing each step in car door motion detection method embodiment according to above-mentioned sequence,
It will be apparent to one skilled in the art that the step in the embodiment of the present disclosure not necessarily executes in the order described above, can also fall
Other sequences such as sequence, parallel, intersection execute, moreover, those skilled in the art can also add on the basis of above-mentioned steps
The mode of other steps, these obvious variants or equivalent replacement should also be included within the protection scope of the disclosure, herein no longer
It repeats.
It is below embodiment of the present disclosure, embodiment of the present disclosure can be used for executing embodiments of the present disclosure realization
The step of, for ease of description, part relevant to the embodiment of the present disclosure is illustrated only, it is disclosed by specific technical details, it asks
Referring to embodiments of the present disclosure.
In order to solve to carry out the technical issues of triggering be easy to cause erroneous judgement, this public affairs by eyes while blink in the prior art
It opens embodiment and a kind of car door action detection device is provided.The device can execute in above-mentioned car door motion detection method embodiment
Step.As shown in Fig. 2, the device mainly includes: door identification module 21, state recognition module 22 and movement determining module 23;
Wherein,
Door identification module 21 is used to carry out door identification to the every frame video image for including in input video, and determination includes
An at least frame target video image for the car door;
State recognition module 22 is obtained for carrying out vehicle door status identification to an at least frame target video image respectively
Vehicle door status in every frame target video image;
Movement determining module 23 is used to determine that car door is acted according to the vehicle door status of an at least frame target video image.
Further, the movement determining module 23 includes: that sequence forms unit 231 and movement determination unit 232;Its
In,
Sequence forms unit 231 and is used for according at least vehicle door status of a frame target video image and corresponding target view
The timing of frequency image forms state for time sequence;
Movement determination unit 232 is used to determine that car door is acted according to the state for time sequence.
Further, the movement determination unit 232 is specifically used for: for each shape for including in the state for time sequence
State assignment;Wherein, open state and the corresponding different numerical value of off status;Detect the numerical value jump in the state for time sequence;Root
It is jumped according to the numerical value and determines car door movement.
Further, the movement determination unit 232 is specifically used for: determining the corresponding first object of the first numerical value trip point
Video image and corresponding second target video image of second value trip point;Wherein, the first numerical value trip point and described
Second value trip point is continuous trip point;Determine the first object video image and second target video image interval
Target video image frame number;Determine whether vehicle door status changes according to the target video image frame number;According to described
The variation of vehicle door status determines that car door acts.
Further, the movement determination unit 232 is specifically used for: if the target video image frame number is less than default frame
Number, it is determined that the vehicle door status does not change;If or the target video image frame number is greater than or equal to the default frame
Number, it is determined that the vehicle door status changes.
The detailed descriptions such as the technical effect of working principle, realization in relation to car door action detection device embodiment can refer to
Related description in aforementioned car door motion detection method embodiment, details are not described herein.
Below with reference to Fig. 3, it illustrates the structural schematic diagrams for the electronic equipment for being suitable for being used to realize the embodiment of the present disclosure.This
Electronic equipment in open embodiment can include but is not limited to such as mobile phone, laptop, digit broadcasting receiver,
PDA (personal digital assistant), PAD (tablet computer), PMP (portable media player), car-mounted terminal (such as vehicle mounted guidance
Terminal) etc. mobile terminal and such as number TV, desktop computer etc. fixed terminal.Electronic equipment shown in Fig. 3
An only example, should not function to the embodiment of the present disclosure and use scope bring any restrictions.
As shown in figure 3, electronic equipment may include processing unit (such as central processing unit, graphics processor etc.) 301,
Random access storage device can be loaded into according to the program being stored in read-only memory (ROM) 302 or from storage device 308
(RAM) program in 303 and execute various movements appropriate and processing.In RAM 303, it is also stored with electronic device institute
The various programs and data needed.Processing unit 301, ROM 302 and RAM 303 are connected with each other by bus 304.Input/defeated
(I/O) interface 305 is also connected to bus 304 out.
In general, following device can connect to I/O interface 305: including such as touch screen, touch tablet, keyboard, mouse, figure
As the input unit 306 of sensor, microphone, accelerometer, gyroscope etc.;Including such as liquid crystal display (LCD), loudspeaking
The output device 307 of device, vibrator etc.;Storage device 308 including such as tape, hard disk etc.;And communication device 309.It is logical
T unit 309 can permit electronic equipment and wirelessly or non-wirelessly be communicated with other equipment to exchange data.Although Fig. 3 is shown
Electronic equipment with various devices, it should be understood that being not required for implementing or having all devices shown.It can replace
Implement or have more or fewer devices in generation ground.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description
Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium
On computer program, which includes the program code for method shown in execution flow chart.In such reality
It applies in example, which can be downloaded and installed from network by communication device 309, or from storage device 308
It is mounted, or is mounted from ROM 302.When the computer program is executed by processing unit 301, the embodiment of the present disclosure is executed
Method in the above-mentioned function that limits.
It should be noted that the above-mentioned computer-readable medium of the disclosure can be computer-readable signal media or meter
Calculation machine readable storage medium storing program for executing either the two any combination.Computer readable storage medium for example can be --- but not
Be limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor system, device or device, or any above combination.Meter
The more specific example of calculation machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, just of one or more conducting wires
Taking formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type may be programmed read-only storage
Device (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device,
Or above-mentioned any appropriate combination.In the disclosure, computer readable storage medium can be it is any include or storage journey
The tangible medium of sequence, the program can be commanded execution system, device or device use or in connection.And at this
In open, computer-readable signal media may include in a base band or as the data-signal that carrier wave a part is propagated,
In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to
Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable and deposit
Any computer-readable medium other than storage media, the computer-readable signal media can send, propagate or transmit and be used for
By the use of instruction execution system, device or device or program in connection.Include on computer-readable medium
Program code can transmit with any suitable medium, including but not limited to: electric wire, optical cable, RF (radio frequency) etc. are above-mentioned
Any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment;It is also possible to individualism, and not
It is fitted into the electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when said one or multiple programs are by the electricity
When sub- equipment executes, so that the electronic equipment: carrying out door identification to the every frame video image for including in input video, determine packet
An at least frame target video image containing the car door;Vehicle door status knowledge is carried out to an at least frame target video image respectively
Not, the vehicle door status in every frame target video image is obtained;Vehicle door status according to an at least frame target video image is true
Determine car door movement.
Alternatively, above-mentioned computer-readable medium carries one or more program, when said one or multiple programs
When being executed by the electronic equipment, so that the electronic equipment: door identification is carried out to the every frame video image for including in input video,
Determine at least frame target video image comprising the car door;Car door is carried out to an at least frame target video image respectively
State recognition obtains the vehicle door status in every frame target video image;According to the car door of an at least frame target video image
State determines that car door acts.
The calculating of the operation for executing the disclosure can be write with one or more programming languages or combinations thereof
Machine program code, above procedure design language include object oriented program language-such as Java, Smalltalk, C+
+, it further include conventional procedural programming language-such as " C " language or similar programming language.Program code can
Fully to execute, partly execute on the user computer on the user computer, be executed as an independent software package,
Part executes on the remote computer or executes on a remote computer or server completely on the user computer for part.
In situations involving remote computers, remote computer can pass through the network of any kind --- including local area network (LAN)
Or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as utilize Internet service
Provider is connected by internet).
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of the module, program segment or code include one or more use
The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box
The function of note can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are actually
It can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it to infuse
Meaning, the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart can be with holding
The dedicated hardware based system of functions or operations as defined in row is realized, or can use specialized hardware and computer instruction
Combination realize.
Being described in unit involved in the embodiment of the present disclosure can be realized by way of software, can also be by hard
The mode of part is realized.Wherein, the title of unit does not constitute the restriction to the unit itself under certain conditions, for example, the
One acquiring unit is also described as " obtaining the unit of at least two internet protocol addresses ".
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art
Member is it should be appreciated that the open scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from design disclosed above, it is carried out by above-mentioned technical characteristic or its equivalent feature
Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure
Can technical characteristic replaced mutually and the technical solution that is formed.