CN108121446A - Exchange method and system - Google Patents
Exchange method and system Download PDFInfo
- Publication number
- CN108121446A CN108121446A CN201711424281.3A CN201711424281A CN108121446A CN 108121446 A CN108121446 A CN 108121446A CN 201711424281 A CN201711424281 A CN 201711424281A CN 108121446 A CN108121446 A CN 108121446A
- Authority
- CN
- China
- Prior art keywords
- target person
- feature
- gait
- predeterminable area
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
- G06V40/25—Recognition of walking or running movements, e.g. gait recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of exchange method and systems.The described method includes：Target person gait and the video data of action in predeterminable area are obtained, according to the video data of target person gait in the video data, obtains the gait feature of target person in predeterminable area；After the synthesis gait feature of gait feature library inquiry to target person, the video data acted according to target person in video data obtains the motion characteristic into predeterminable area target person, query actions feature database, obtain the corresponding signature of combined action feature, the correspondence of combined action feature and signature is stored in motion characteristic storehouse, machine instruction corresponding with signature is obtained, is interacted according to machine instruction.The gait feature storehouse and motion characteristic storehouse established by deep learning, so as to improve convenience, security and the accuracy of present invention interaction.
Description
Technical field
The present invention relates to interaction technique field, more particularly to a kind of exchange method and a kind of interactive system.
Background technology
With the development of technology, interaction technique is used among every field, and by taking gesture interaction as an example, gesture interaction is
People makes a series of action by hand, and when allowing machine that can identify the intention of people, however carrying out gesture interaction, interaction personnel must
Palpus close to gestures harvester, then makes the gesture of standard, and gesture identifying device identifies the gesture that interactive personnel make, holds
The corresponding interaction of row, it is this to interact method using gesture, it is only applicable to personnel and collector is man-to-man is used cooperatively, one
A collector can not be carried out with being interacted while more people, and be must move to and done hand in the very near prescribed limit of collector
Gesture acts, and also results in interactive inconvenience.In addition, being interacted using gesture, it can not also meet wanting for specific occasion security
It asks.In order to solve interactive security, occurs the scheme interacted using voice in the prior art, however interactive voice can be by
To the influence of environment, ambient noise, which crosses senior general, influences the accuracy of interaction.
The content of the invention
Based on this, it is necessary to for existing interactive mode it is not convenient, dangerous and inaccurate the problem of, a kind of friendship is provided
Mutual method and system.
A kind of exchange method, including：
Obtain target person gait and the video data of action in predeterminable area；
According to the video data of target person gait in the video data, target person is real-time in acquisition predeterminable area
Gait feature；
The synthesis gait feature of the real-time gait feature and target person in gait feature storehouse is compared, comparison passes through it
Afterwards, the video data acted according to target person in the video data is obtained into the dynamic in real time of predeterminable area target person
Make feature；Wherein, the comprehensive gait feature in the gait feature storehouse is to each time of target person in history video data
Real-time gait feature carries out what deep learning obtained；
By the combined action aspect ratio pair of target person in the real-time action feature and motion characteristic storehouse, comparison passes through it
Afterwards, query actions feature database obtains the corresponding signature of the combined action feature, wherein, motion characteristic is stored in storehouse
The correspondence of combined action feature and signature；Combined action is characterized in history video data in the motion characteristic storehouse
Middle each secondary real-time action feature of target person carries out what deep learning obtained；
Machine instruction corresponding with the signature is obtained, is interacted according to the machine instruction.
A kind of interactive system, including：
Video acquisition module, for obtaining target person gait and the video data of action in predeterminable area；
Gait analysis module for the video data according to target person gait in the video data, obtains preset areas
The real-time gait feature of target person in domain；
Motion analysis module, for the synthesis gait of target person in the real-time gait feature and gait feature storehouse is special
Sign compares, and after comparison passes through, according to the video data that target person in the video data acts, obtains into predeterminable area
The real-time action feature of target person；Wherein, the comprehensive gait feature in the gait feature storehouse is to history video counts
Carry out what deep learning obtained according to each secondary real-time gait feature of middle target person；
Enquiry module, for by the combined action aspect ratio of target person in the real-time action feature and motion characteristic storehouse
Right, after comparison passes through, query actions feature database obtains the corresponding signature of the combined action feature, wherein, action is special
The correspondence of combined action feature and signature is stored in sign storehouse；Combined action is characterized in pair in the motion characteristic storehouse
Each secondary real-time action feature of target person carries out what deep learning obtained in history video data；
Interactive module for obtaining machine instruction corresponding with the signature, is handed over according to the machine instruction
Mutually.
A kind of computer equipment including memory, processor and is stored on the memory and can be in the processing
The computer program run on device, the processor realize above-mentioned exchange method when performing the computer program.
Modules in above system can only select arbitrary group of part of module therein according to concrete application demand
Close application；It can be configured in distributed system locally or remotely and work.
Above-mentioned exchange method and system by deep learning, according to each secondary real-time gait feature of target person, obtain the mesh
Mark personnel integrate gait feature, establish gait feature storehouse, when carrying out Gait Recognition, more can fast and accurately identify target
Whether the real-time gait feature of personnel is consistent with the synthesis gait feature in gait feature storehouse, equally, for the dynamic of target person
Make the identification of feature and by deep learning, according to each secondary real-time action feature of target person, obtain combined action feature,
Motion characteristic storehouse is established, when carrying out real-time action feature recognition, can also quick and precisely identify the dynamic in real time of target person
Make feature corresponding to the combined action feature in motion characteristic storehouse.In addition, using acquisition in any position people in setting regions
The gait and limbs/body movement video data of member interacts, and personnel without going to the regulation near collector one by one
In the range of make required movement, make interaction more convenient, by identifying the gait feature and motion characteristic of target person, both carried
The convenience of height interaction, accuracy, while also improve interactive security.
Description of the drawings
Fig. 1 is the schematic flow chart of exchange method in an embodiment；
Fig. 2 is the schematic diagram of interactive system in an embodiment.
Specific embodiment
It is below in conjunction with the accompanying drawings and preferably real further to illustrate the effect of the technological means of the invention taken and acquirement
Example is applied, to the technical solution of the embodiment of the present invention, carries out clear and complete description.
Fig. 1 is the schematic flow chart of exchange method in an embodiment, as shown in Figure 1, the step of the method includes：
S101 obtains target person gait and the video data of action in predeterminable area.
In this step, predeterminable area can be the open spaces such as the closed areas such as household rooms or square.Video
Data can be gathered by video acquisition device, specifically, a video acquisition device can be installed in predeterminable area for adopting
Collect the video data of target person gait and action.
S102 according to the video data of target person gait in the video data, obtains target person in predeterminable area
Real-time gait feature.
In this step, the video data into each target person gait in predeterminable area can be gathered, according to default
Deep learning algorithm the video data of its gait is handled, obtain the real-time gait of each target person in predeterminable area
Feature.
S103 compares the synthesis gait feature of the real-time gait feature and target person in gait feature storehouse, compares
By afterwards, according to the video data that target person in the video data acts, obtaining into predeterminable area target person
Real-time action feature；Wherein, the comprehensive gait feature in the gait feature storehouse is to target person in history video data
Each secondary real-time gait feature of member carries out what deep learning obtained.
In this step, there are the synthesis gait feature corresponding to each target person, comprehensive gait in gait feature storehouse
It is characterized in that secondary real-time gait feature each to target person in history video data carries out what deep learning obtained, is interacting
When, it is compared by real-time gait feature and comprehensive gait feature, can quickly identify target person.With drilling for usage time
Into, comprehensive gait feature is constantly updated with deep learning, and more comprehensively obtains the personal unique feature of the target person, with
This can preferably identify the identity of target person.
Optionally, the depth based on CNN (Convolutional neural network, convolutional neural networks) can be selected
Learning algorithm or DBNs (Deep neural networks, depth confidence network) are spent, it can also be in deep learning
Using based on capsule network model, with representing for the detail analysis relation of preferably simulative neural network external knowledge, in addition, value
Must illustrate, select other models and the deep learning performed or other video data algorithms obtain comprehensive gait feature and
Combined action feature, within protection scope of the present invention.
For the deep learning of gait feature, when being on the one hand that target person is taken action every time in acquisition video data, row
Walk the side such as the distance between path and collector, angle etc. difference and individual sports speed, acceleration, movement posture
On the other hand the difference in face is the growth for gathering target person physiological age, physical function variation causes gait difference, in this step
Suddenly, these differences of deep learning can more comprehensively grasp the target person and walk about the inherent law of behavior, continuous updating synthesis step
State feature so that when all kinds of complicated/empty condition under, can more fast and accurately identify the real-time gait of target person
Feature.
S104, by the combined action aspect ratio pair of target person in real-time action feature and motion characteristic storehouse, comparison passes through
Afterwards, query actions feature database obtains the corresponding signature of the combined action feature, wherein, motion characteristic stores in storehouse
There is the correspondence of combined action feature and signature；Combined action is characterized in history video counts in the motion characteristic storehouse
Carry out what deep learning obtained according to each secondary real-time action feature of middle target person.
With the gait feature same principle in gait feature storehouse in S103 steps, motion characteristic library storage different target personnel
Combined action feature, when interacting, can fast and accurately identify the real-time action feature of target person.Action is special
The identification of sign is also required to through continuing after a while for different acquisition angle and the depth acted every time for target person
It practises, continuous updating combined action feature, with the evolution of usage time, this discrimination can be more quick, accurate, can be more with this
The interaction intention of good identification target person.
In addition, in this step, signature is a kind of special mark, a signature uniquely corresponds to a machine
Instruction, in motion characteristic storehouse, signature is pre-set, and be can be fixed order or is met a set pattern
Rule.
In one embodiment, the step of motion characteristic establishes correspondence with signature can be：In motion characteristic storehouse
Signature arrange in advance, in typing motion characteristic, target person make in a predetermined sequence it is a series of have refer to
The action of meaning is made, after collecting a series of action video data with instruction meaning of target person, is obtained through deep learning
To corresponding combined action feature, be entered into successively in motion characteristic storehouse, and in order successively it is corresponding with signature foundation close
System, improves the convenience used, needs exist for explanation, and each target person, can be according to certainly in typing instruction action
Body needs, and makes customized instruction action, without defining a set of unified instruction action.Alternatively, it is also possible to being fixed in advance
The a set of unified instruction action of justice, target person is according to as defined in the instruction action of unified definition is made before video acquisition device
Action, then action pre-selection that can be by definition when establishing the correspondence of motion characteristic and signature and signature
Establish correspondence.
S105 obtains machine instruction corresponding with the signature, is interacted according to the machine instruction.
In this step, the relation of signature and machine instruction can pre-establish, inquire signature
Afterwards, directly corresponding machine instruction can be sent to corresponding machine.
Optionally, signature can be represented with binary field, for example, in the server in advance by binary field
0010 is corresponding with opening air-conditioning instruction, then in interaction, collects the corresponding motion characteristic of 0010 field, just output is opened empty
The instruction of tune.
The technical solution of this implementation can set identity label for target person, pass through depth under the conditions of human intervention
Study, according to target person in history video data each secondary real-time gait feature, obtain target person synthesis gait feature, build
Vertical gait feature storehouse, when carrying out Gait Recognition, can fast and accurately identify target person real-time gait feature whether with
Synthesis gait feature in gait feature storehouse is consistent, and equally, identification for the motion characteristic of target person and is directed to mesh
Each secondary real-time action depths of features study in mark personnel's history video data, obtains its combined action feature, foundation action is special
Storehouse is levied, when carrying out real-time action feature recognition, can also quick and precisely identify that the real-time action feature of target person corresponds to
Combined action feature in motion characteristic storehouse.In addition, using acquisition in the setting regions gait of any position personnel and
Limbs/body movement video data interacts, and personnel make finger without going to one by one in the prescribed limit near away from collector
Fixed action makes interaction more convenient, by identifying the gait feature and motion characteristic of target person, had both improved interactive facility
Property, accuracy, while also improve interactive security.
In addition, in the present embodiment, in " preparation stage ", video-unit gathers each target person away from collector respectively
The video data of repeated walking process and the target person are away from collector in defined distance, defined route
The video data for making limbs/body movement corresponding to specific instruction is repeated several times in defined distance, defined position, from
It is middle to obtain the synthesis gait feature of target person and combined action feature respectively, and be stored in respectively foundation gait feature storehouse and
Among motion characteristic storehouse；In " application stage ", a video-unit can be gathered and judged, what is occurred simultaneously in video data is more
The real-time gait feature of a target person and real-time action feature.Through application after a while, target person in database
Comprehensive gait feature and combined action feature experienced after continuous updating, it might even be possible to from a video-unit acquisition, tool
In the video data for there are magnanimity personnel, while judge identity and the action of multiple target persons.
In one embodiment, in acquisition predeterminable area this video is obtained after the real-time gait feature of target person
The real-time gait feature of target person and the different information of comprehensive gait feature in data, according to different information update
Synthesis gait feature in gait feature storehouse；Or, obtain the real-time action feature and synthesis of target person in this video data
The different information of motion characteristic updates the combined action feature in the motion characteristic storehouse according to the different information.
The technical solution of the present embodiment is divided from the target person gait and the video data of action gathered during each interaction
The real-time gait feature and real-time action feature of this interaction of target person are indescribably taken, it can be as the synthesis in gait feature storehouse
Gait feature carries out the object that combined action depths of features learns in deep learning and motion characteristic storehouse, according to this real-time step
State feature and the different information of the synthesis gait feature in gait data storehouse, update the synthesis gait feature in gait feature storehouse,
Equally, the difference of the combined action feature in this real-time action feature and action database, update action feature database
In combined action feature.The present embodiment have real-time update synthesis gait feature and combined action feature ability, with when
Between evolution, the information content for the relevant action process that deep learning obtains is made to enrich constantly, the technical solution of the present embodiment makes
It is more accurate, more quick to obtain subsequent interaction.
In addition, for above-mentioned different information, identification accuracy effect can be updated by different information
The combined action feature in synthesis gait feature and motion characteristic storehouse in gait feature storehouse.The present embodiment is substantially to hand over every time
It mutually can promote the accuracy of comprehensive gait feature and identification next time of combined action feature.
In one embodiment, obtain in predeterminable area after the real-time gait feature of target person, it can also be according in step
Whether with the difference of the real-time gait feature of target person synthesis gait feature within a preset range is inquired in state feature database,
Determine whether the target person has the permission into predeterminable area；If it is not, then export warning message.
It, can be by whether there is the real-time step into the target person of predeterminable area in gait feature storehouse in the present embodiment
State feature, if existing standard is the real-time gait feature and comprehensive gait spy in gait data storehouse extracted from video data
Whether the difference of sign is within the scope of default, if so, determining that the target person can enter predeterminable area.
Optionally, for predeterminable area, the target person of typing synthesis gait feature not in gait feature storehouse
Be the equal of " stranger ", then when detecting that " stranger " enters the predeterminable area, export warning message.Specifically, alarm signal
Breath can be a kind of alarm for embodying danger signal or a kind of trigger the server sends signal of preset instructions etc.
Deng.
Further, if there is the synthesis gait feature into the target person of predeterminable area in gait feature storehouse, that
Explanation, which can enter predeterminable area, specifically, the permission into predeterminable area further includes：Lack of competence, part
Permission and complete permission, wherein, lack of competence expression does not possess the permission into predeterminable area, and part permission represents preset time period
Possesses the permission into predeterminable area, complete permission represents the full-time permission possessed into predeterminable area；If it is determined that the mesh
Mark personnel have the permission into the predeterminable area, and then the permission into predeterminable area of the target person is detected,
If it is that lack of competence target person or part permission personnel are default in the entrance of non-default period to detect the target person
Region then exports warning message, the alarm of the target person of the permission different from not entering into predeterminable area, in the present embodiment
Alarm can send suggestive sound and/or trigger the server sends the signal of preset instructions.
Optionally, the synthesis gait feature that can pre-set each target person in gait feature storehouse corresponds to its entrance
The permission of predeterminable area when getting the synthesis gait feature of certain target person, can correspond to obtain target person correspondence
The permission into predeterminable area.
Optionally, can also include accompanying permission into the permission of predeterminable area, lack of competence target person appears in default
During region, then warning message is exported, current slot has permission and/or the company into predeterminable area if also detecting at this time
The target person of permission then stops exporting warning message.
For example the synthesis gait feature of the members (guest including allowing access into family) of one family is complete
Into the operation in typing gait feature storehouse, these target persons are imparted phase respectively in initial acquisition gait feature
The permission answered：Wherein host and hostess are respectively provided with the complete permission into family's all areas；Nurse have into parlor, dining room,
The complete permission in the regions such as kitchen, my bedroom, child room, has the part permission into master bedroom；Children's lack of competence into
Enter kitchen, Ke Renfang, bathroom, laundry, but have accompanied with the male/female owner or nurse for accompanying permission under can be into
Enter bathroom；Guest has the complete permission into regions such as parlor, dining room, guest bedrooms, and lack of competence enters master bedroom, children
The regions such as bedroom, nurse bedroom, laundry；For sharing bathroom, sharing the regions such as toilet, initially entered when there is target person
Afterwards, other target person lacks of competence enter, etc..
Outside family's members without typing synthesis gait feature personnel, be exactly for this region of family
Stranger is " invader "；Once it was found that " invader " must send out the alarm of highest level.
Above-described embodiment has further refined the permission that target person enters predeterminable area, so as to further improve this
The accuracy of technical solution in embodiment, in some scenarios, such as have may in kitchen, laundry, bathroom in family etc.
The space of risk factor when the target person (children) for collecting no permission enters kitchen, can send alarm signal (report
It is alert), but at this time if there is into kitchen permission and with accompanying the target person (parent or nurse) of permission into fashionable,
Meeting stop alarm, so as to effectively carry out safety management to target person (children).
It, in one embodiment, can also be described in target person entrance in order to further realize interactive security
After predeterminable area, the movement track of target person is also detected, by default action in the movement track and movement track storehouse
Track compares；Wherein, the corresponding movement track of target person is pre-set in the action storehouse；If the two error is in default model
Enclose outer, output alarm signal.
In the present embodiment, the movement track of each target person, target person can be pre-established in movement track storehouse
Member is into predeterminable area, and when taking action in predeterminable area, if movement track deviates the action rail stored in movement track storehouse
Mark, then output alarm signal immediately, to remind target person walking in its defined movement track.Furthermore it is possible to it sets in advance
Certain trajector deviation is put, by the movement track of real time contrast's target person and default movement track in movement track storehouse,
If the trajector deviation of the two is more than default trajector deviation, judge the two error outside preset range.
Further, movement track can also be the regional extent in predeterminable area, realization principle and movement track power
Limit similar, which is not described herein again.
In another embodiment, residence time of the target person in the predeterminable area is also detected, if during the stop
Between be more than the default residence time, then export the alarm signal.
In some cases, may be and its important safely, using the interaction schemes of the present embodiment, by setting target
Movement track of the personnel in predeterminable area and the residence time in predeterminable area, the safety in the region greatly ensured.
For example nurse enters master bedroom and does cleaning, can specify that its cleaning order to master bedroom：Use rag
Clean path of passing through；With the path of dust catcher/mop cleaning；And it provides to complete clean whole time (specific implementation：
By video acquisition device acquisition hostess explanation and the video overall process of the lower nurse's corresponding operating of guidance, as setting this permission
Basis；It after doing " putting wide range regulation " to path and time again, is stored in movement track storehouse)；If during actual cleaning,
It was found that nurse, which is longer than movement track storehouse the residence time near the desk/cabinet for putting casket, is expected regulation, then by servicing
Device sends default prompting, and the hostess is prompted, and relevant valuables are being checked in time afterwards, are being checked；If
It finds not being inconsistent in verification, nurse's details of associated video during cleaning can be had access to and screened.
In addition, the permission of interactive instruction is also and its important, carried out in the permission for entering predeterminable area to target person
After verification, it is also necessary to verify the permission of the machine instruction of target person.It is included specifically, inquiring in the motion characteristic storehouse
During the combined action feature of target person, the corresponding signature of the combined action feature is obtained.For example, children do not enter into
The right in kitchen is not turned on right with regulating gas stove, when finding that it enters kitchen, can open live signal language
Sound, it is desirable that it leaves, but if it find that its not only without departing from, send the increased instruction of the gas furnace intensity of a fire instead, then can be with
Field alert is sent, simultaneously closes off fuel gas supply valve；Server can be simultaneously emitted by corresponding predetermined warning.
Optionally, if the permission of the not no corresponding machine instruction of the motion characteristic of target person, can export alarm command,
It is alarmed according to alarm command.For uniform machinery, different people possesses different operating rights, therefore, is corresponding with difference
Machine instruction permission, by setting the permission of corresponding machine instruction to each target person, so as to ensure target person
Its instruction having permission can only be exercised, so as to improve the security of the present embodiment exchange method.
In one embodiment, multiple target persons are may be simultaneously present in predeterminable area, if multiple target persons are done simultaneously
Go out the action for instructing meaning identical, then system can extract multiple real-time action features, and these real-time action features are equal
During the adjusting of corresponding uniform machinery, machine can only respond one of instruction, in order to solve this problem, specifically, can be with
Each target person is set there are multiple targets in the predeterminable area for the precedence information of the machine instruction of uniform machinery
When personnel, two of which or the above persons are operated simultaneously for uniform machinery, only in response to the dynamic of highest priority personnel
It instructs.
Multiple target persons are existed simultaneously in the present embodiment, in predeterminable area, priority is only extracted from video data
Highest corresponds to the real-time action feature of target person, therefore, excellent for other to respond the instruction of highest priority target person
The relatively low target person of first grade does not extract it and instructs real-time action feature, so as to reduce the probability of " non-productive work " appearance；Separately
Outside, for the unconscious limbs/body movement made of some target persons for not possessing permission, machine will not also be known
Not, so as to avoiding meaningless task.
For the deep learning part in the present invention, in concrete operations, target person is often in following different shape
State：The conditions such as the distance between motion path and collector, angle and displacement dynamics/speed, athletic posture etc. can
If difference without deep learning, when above-mentioned action difference occurs in target person, cannot be identified accurately,
The present invention uses deep learning, finds the inherent law of target person gait feature difference, and comprehensive gait feature is adjusted,
The accuracy of identification is promoted, when interacting next time, can be identified there are above-mentioned the difference even gait of other differences, so as to carry
The accuracy and foresight of height interaction.
Deep learning can also be according to the rule of the action disparity range of real-time action feature during each interaction, to comprehensive dynamic
Adjusted as feature, when interacting next time, even if the action of target person be not standard with it is consistent, as long as according to action
The rule of disparity range can identify above-mentioned inconsistent, non-type action, so as to interact.
In addition, the variation with the target person age, in fact it could happen that action difference physiologically is understood by deep learning
The rule of its change of divergence can accurately predict target person and be likely to occur the combined action feature of variation and comprehensive gait
Feature.
In an optional embodiment, deep learning can obtain target person with the combined action feature after change of age
And the rule of comprehensive gait feature, within certain period after target person is wandered away, the system can pass through deep learning
Inference is inferred to synthesis gait feature of the target person after the period, so as to still find lost target people
Member.
In another embodiment, several interactive information in the historical data are obtained, wherein every interactive information is extremely
Include less：Comprehensive gait feature, combined action feature, the corresponding machine instruction of combined action feature, spatial information, time letter
The information such as breath, environmental factor information, manipulation result；Above- mentioned information carries out big data analysis in being interacted for history, obtains target
The operation preference information of personnel；By the synthesis gait feature ratio of target person in the real-time gait feature and gait feature storehouse
It is right, after comparison passes through, further include：According to the corresponding machine instruction of operation preference information of the target person, transfer in advance
Machine instruction interacts.
The technical solution of the present embodiment, time, the environment occurred by big data analysis each usage record etc. is all kinds of
Relevant information, so as to obtain the operation preference information of target person, operation preference information represents, when target person is in certain environment
When certain time appears in target area, the combined action feature of target person most probable execution is certainly, inclined in order to improve operation
The accuracy of good information prediction, can be with the difference of the real-time action feature of every usage record of Accurate Analysis, so as to based on this
A little differences and difference, the accurate action predicted target person and may performed, further optimize exchange method, improve this implementation
The accuracy and foresight of example exchange method.
Hereinafter, with reference to a specific embodiment, the technical solution further illustrated the present invention.
By taking specific family as an example, kinsfolk includes two parents, a child and a nurse, the electric appliance of the family
Including water heater, television set, refrigerator, computer, sleeping indoor lamp etc..There are 3 bedrooms, 1 kitchen, 1 parlor, 2 bathrooms, 2
A toilet is independent predeterminable area respectively.
The video data of two parent's gaits of acquisition, and the video data of acquisition instructions action in advance first, respectively obtains
The synthesis gait feature and combined action feature of two parents, two parents possess whole interaction permissions, therefore, two parents
Have the operational order that combined action feature corresponds to all electric appliances.
Followed by child, for child, water heater is there may be potential dangerous, if opening accidentally,
Unfavorable consequence may be brought, therefore, child is not turned on the permission of water heater.It is long for that can operate for the child of computer
Time also brings along certain harm using computer, therefore the computation permission of child is only arranged to the several small of specified time period
When.Tv volume can generate other spaces of family noise effect, generate damage to the hearing of Field Force, and child is to TV
The adjusting permission of machine volume is provided with the upper limit, and (after upper limit volume is reached, the instruction action that volume is promoted to it is no longer rung
Should).The unlatching of other electric appliances or the adjusting of parameter can also set corresponding permission to child.
For nurse, the different rights mainly into 3 bedrooms, nurse has disengaging child room and oneself room
Between permission, but for the room of parent, the permission of corresponding period is set, i.e., can enter householder's room in the corresponding period
Between, in addition, also setting up movement track and residence time of the nurse between householder's room, before the deadline, nurse enters house
Clean-up operation is simultaneously completed in long room according to pre-set movement track, is left in the defined time, if finding with regulation not
When according with plot, then server alarm is carried out in time.
After above-mentioned permission is set, a special scenes is selected to be described as follows：Child enters bathroom, it is intended to open
Water heater at this point, detecting child's not permission, and passes through the identification of child's identity, alarms, one side server carries
Wake up parent or nurse, and on the other hand warning child in scene leaves, if nurse or parent enter bathroom at this time, stops report at this time
It is alert.Child attempted to open computer in the non-permission time, by being child to the verification of identity, and detects current slot child and does not have
There is out the permission of computer, computer is not responding to the operational order of child.
Application for big data, male owner is after next go back home, and convention can change one's clothes, have a bath, through after a while
It is instructed for it after light, air conditioner, water heater adjust the big data analysis of design parameter, when again identifying that under male owner
After class's time goes home, the air conditioner of master bedroom automatically turns on, and temperature is consistent with the requirement that male owner is usual；Bedroom and Bathroom
Light automatically turned on when male owner enters relevant range, and lamp illuminance and tone comply fully with male owner usually will
It asks；The water temperature of water heater is consistent with the water temperature that male owner is usually adjusted etc..
Based on the thought identical with the exchange method in above-described embodiment, the present invention also provides interactive systems, which can
For performing above-mentioned exchange method.For convenience of description, in the structure diagram of interactive system embodiment, illustrate only and this
The relevant part of inventive embodiments, can be with it will be understood by those skilled in the art that the restriction of schematic structure not structure paired systems
Including either combining some components or different components arrangement than illustrating more or fewer components.
Fig. 2 is the schematic diagram of interactive system in an embodiment, as shown in Fig. 2, the system comprises：
Video acquisition module 201, for obtaining target person gait and the video data of action in predeterminable area.
Gait analysis module 202 for the video data according to target person gait in the video data, obtains default
The real-time gait feature of target person in region.
Motion analysis module 203, for the comprehensive of target person in the real-time gait feature and gait feature storehouse to be walked
State aspect ratio pair after comparison passes through, according to the video data that target person in the video data acts, is obtained into default
The real-time action feature of regional aim personnel；Wherein, the comprehensive gait feature in the gait feature storehouse is that history is regarded
Each secondary real-time gait feature of frequency target person in carries out what deep learning obtained.
Enquiry module 204, for the combined action of target person in the real-time action feature and motion characteristic storehouse is special
Sign compares, and after comparison passes through, query actions feature database obtains the corresponding signature of the combined action feature, wherein, it moves
Make to be stored with the correspondence of combined action feature and signature in feature database；Combined action feature in the motion characteristic storehouse
Secondary real-time action feature each to target person in history video data carries out deep learning and obtains.
Interactive module 205 for obtaining machine instruction corresponding with the signature, is carried out according to the machine instruction
Interaction.
The embodiment of above-mentioned interactive system, above-mentioned exchange method and system, by deep learning, according to target person history
Each secondary real-time gait feature in video data obtains target person synthesis gait feature, establishes gait feature storehouse, carrying out gait
During identification, it more can fast and accurately identify whether the real-time gait feature of target person walks with the synthesis in gait feature storehouse
State feature is consistent, and equally, identification for the motion characteristic of target person and by deep learning is gone through according to target person
Each secondary real-time action feature, obtains combined action feature, establishes motion characteristic storehouse in history video data, special carrying out real-time action
During sign identification, it can also quick and precisely identify that the synthesis that the real-time action feature of target person corresponds in motion characteristic storehouse is moved
Make feature.In addition, using acquisition in the setting regions gait of any position personnel and limbs/body movement video data into
Row interaction, personnel make required movement without going to one by one in the prescribed limit near away from collector, make interaction more convenient, lead to
The gait feature and motion characteristic of identification target person are crossed, interactive convenience, accuracy had both been improved, while has also improved friendship
Mutual security.
In one embodiment, update module is further included, obtains the real-time gait feature of target person in this video data
With the different information of comprehensive gait feature, updated according to the result to the different information deep learning in the gait feature storehouse
Synthesis gait feature；It is additionally operable to obtain the real-time action feature of target person in this video data and combined action feature
Different information updates the combined action feature in the motion characteristic storehouse according to the result to the different information deep learning.
In one embodiment, authority management module is further included, for according to whether being inquired in gait feature storehouse and mesh
The synthesis gait feature of the difference of the real-time gait feature of mark personnel within a preset range, determines whether the target person has
Into the permission of predeterminable area；If it is not, then export warning message.
Optionally, the permission into predeterminable area further includes：Lack of competence, part permission and complete permission, wherein, nothing
Permission expression does not possess the permission into predeterminable area, and part permission represents that preset time period possesses the power into predeterminable area
Limit, complete permission represent the full-time permission possessed into predeterminable area；Enquiry module 203 is additionally operable to obtain into predeterminable area
The permission into predeterminable area of target person；Detect that the lack of competence target person enters predeterminable area or detection
To part permission personnel when the non-default period entering predeterminable area, warning message is exported.
Specifically, if enquiry module 203 is additionally operable to also detect that current slot has into the permission of predeterminable area
Target person then stops exporting warning message.
In one embodiment, movement track contrast module is further included, the movement track contrast module is used in the mesh
Mark personnel enter after the predeterminable area, the movement track of target person are also detected, by the movement track and movement track
Default movement track comparison in storehouse；Wherein, the corresponding movement track of target person is pre-set in the action storehouse；If two
Person's error is outside preset range, output alarm signal.
In another embodiment, time contrast module is further included, for detecting target person in the predeterminable area
Residence time if the residence time is more than the default residence time, exports the alarm signal.
In another optional embodiment, the enquiry module is additionally operable to inquire in the motion characteristic storehouse comprising described
During combined action feature, the corresponding signature of the combined action feature is obtained.
In one embodiment, interaction habits prediction module is further included, the interaction habits prediction module is described for obtaining
Several interactive information in historical data, wherein every interactive information includes at least：Comprehensive gait feature, combined action are special
Sign, the corresponding machine instruction of combined action feature, spatial information, temporal information and environmental factor information；According to every interaction
The spatial information that is recorded in information, temporal information, environmental factor to this interactive information and history mutual information count greatly
According to analysis, the operation preference information of target person is obtained；Interaction habits prediction module is additionally operable to the behaviour according to the target person
Make the corresponding machine instruction of preference information, transfer machine instruction in advance and interact..
Optionally, priority block is further included, the priority block is used to detect target person in the predeterminable area
Precedence information, the machine instruction of the high target person of preferential answering priority；Wherein, each target person pin is pre-set
To the precedence information of the machine instruction of uniform machinery.
Modules in above system can only select arbitrary group of part of module therein according to concrete application demand
Close application；It can be configured in distributed system locally or remotely and work.
It will appreciated by the skilled person that realizing all or part of flow in above-described embodiment method, being can
To be completed by the relevant hardware of computer program instructions, each generic module can be respective independent or whole
Combination or part are composed, and according to concrete application demand can only select which part application and can be in any combination
Hardware；The program can be stored in computer read/write memory medium, be independent production marketing or use.The journey
Sequence upon execution, can perform all or part of step of the embodiment such as above-mentioned each method.Wherein, the storage medium can be
Magnetic disc, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to make description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example and its corresponding application is all described, as long as however, these technologies
Contradiction is not present in the combination of feature, is all considered to be the scope of this specification record.
Embodiment described above only expresses the several embodiments of the present invention, and description is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that come for those of ordinary skill in the art
It says, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the protection of the present invention
Scope.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (12)
1. a kind of exchange method, which is characterized in that including：
Obtain target person gait and the video data of action in predeterminable area；
According to the video data of target person gait in the video data, the real-time gait of target person in predeterminable area is obtained
Feature；
The synthesis gait feature of the real-time gait feature and target person in gait feature storehouse is compared, after comparison passes through,
According to the video data that target person in the video data acts, the real-time action spy into predeterminable area target person is obtained
Sign；Wherein, the comprehensive gait feature in the gait feature storehouse be to each time of target person in history video data in real time
Gait feature carries out what deep learning obtained；
The combined action aspect ratio pair of target person in the real-time action feature and motion characteristic storehouse is compared after passing through,
Query actions feature database obtains the corresponding signature of the combined action feature, wherein, motion characteristic is stored with synthesis in storehouse
The correspondence of motion characteristic and signature；Combined action is characterized in mesh in history video data in the motion characteristic storehouse
Each secondary real-time action feature of mark personnel carries out what deep learning obtained；
Machine instruction corresponding with the signature is obtained, is interacted according to the machine instruction.
2. exchange method according to claim 1, which is characterized in that obtain the real-time gait of target person in predeterminable area
The step of after feature, including：
The real-time gait feature of target person in this video data and the different information of comprehensive gait feature are obtained, according to described
Different information updates the synthesis gait feature in the gait feature storehouse；
Or, obtain after the corresponding signature of the combined action feature the step of, further include：
The real-time action feature of target person in this video data and the different information of combined action feature are obtained, according to described
Different information updates the combined action feature in the motion characteristic storehouse.
3. exchange method according to claim 1, which is characterized in that obtain the real-time gait of target person in predeterminable area
The step of after feature, further includes：
According to whether being inquired in gait feature storehouse with the difference of the real-time gait feature of target person within a preset range
Comprehensive gait feature, determines whether the target person has the permission into predeterminable area；
If it is not, then export warning message.
4. exchange method according to claim 3, which is characterized in that the permission into predeterminable area includes：Have no right
Limit, part permission, and/or complete permission, wherein, lack of competence expression does not possess the permission into predeterminable area, part authority list
Show that preset time period possesses the permission into predeterminable area, complete permission represents the full-time permission possessed into predeterminable area；
Determining the step of target person is with entering after the permission of predeterminable area, including：
Obtain the Permission Levels into predeterminable area of target person in predeterminable area；
Detect the lack of competence target person enter predeterminable area or detect part permission personnel the non-default period into
When entering predeterminable area, warning message is exported.
5. exchange method according to claim 4, which is characterized in that the permission into predeterminable area further includes：It accompanies
It is described that permission is accompanied to represent the permission for entering predeterminable area simultaneously with other target persons with permission；
Detect that the lack of competence target person enters predeterminable area or detects part permission personnel when non-default described
Between section when entering predeterminable area, the step of generation after alarm command, further include：
If also detect current slot with into predeterminable area permission and/or with it is described accompany permission target person,
Then stop exporting warning message.
6. exchange method according to claim 1, which is characterized in that further include：
After the target person enters the predeterminable area, the movement track of target person is also detected, by the action rail
Mark is compared with default movement track in movement track storehouse；Wherein, the action of target person is pre-set in the action storehouse
Track；
If the two error outside preset range, exports warning message.
7. exchange method according to claim 6, which is characterized in that further include：
Residence time of the target person in the predeterminable area is detected, if the residence time is more than the default residence time,
Then export the alarm signal.
8. exchange method according to claim 1, which is characterized in that the default motion characteristic storehouse of inquiry obtains institute
The step of stating motion characteristic corresponding signature, including：
When inquiring in the motion characteristic storehouse comprising the combined action feature, the corresponding spy of the combined action feature is obtained
Sign mark.
9. according to claim 1-8 any one of them exchange methods, which is characterized in that further include：
The history mutual information in historical data is obtained, wherein the interactive information includes at least：Comprehensive gait feature, synthesis are dynamic
Make feature, the corresponding machine instruction of combined action feature, spatial information, temporal information and environmental factor information；
According to recorded in every interactive information spatial information, temporal information, environmental factor, to this interactive information and history
Interactive information carries out big data analysis, obtains the operation preference information of target person；
It is compared by the synthesis gait feature of the real-time gait feature and target person in gait feature storehouse, comparison passes through it
Afterwards, further include：
According to the corresponding machine instruction of operation preference information of the target person, machine instruction is transferred in advance and is interacted.
10. according to claim 1-8 any one of them exchange methods, which is characterized in that further include：
The precedence information of target person in the predeterminable area is detected, the machine for responding the target person of highest priority refers to
Order；Wherein, precedence information of each target person for the machine instruction of uniform machinery is pre-set.
11. a kind of interactive system, which is characterized in that including：
Video acquisition module, for obtaining target person gait and the video data of action in predeterminable area；
Gait analysis module for the video data according to target person gait in the video data, is obtained in predeterminable area
The real-time gait feature of target person；
Motion analysis module, for by the synthesis gait feature ratio of target person in the real-time gait feature and gait feature storehouse
It is right, after comparison passes through, according to the video data that target person in the video data acts, obtain into predeterminable area target
The real-time action feature of personnel；Wherein, the comprehensive gait feature in the gait feature storehouse is in history video data
Each secondary real-time gait feature of target person carries out what deep learning obtained；
Enquiry module, for by the combined action aspect ratio pair of target person in the real-time action feature and motion characteristic storehouse,
After comparison passes through, query actions feature database obtains the corresponding signature of the combined action feature, wherein, motion characteristic
The correspondence of combined action feature and signature is stored in storehouse；Combined action is characterized in going through in the motion characteristic storehouse
Each secondary real-time action feature of target person carries out what deep learning obtained in history video data；
Interactive module for obtaining machine instruction corresponding with the signature, is interacted according to the machine instruction.
12. a kind of computer equipment, including memory, processor and it is stored on the memory and can be in the processor
The computer program of upper operation, which is characterized in that the processor realized when performing the computer program as claim 1 to
Exchange method described in 10 any one.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711424281.3A CN108121446B (en) | 2017-12-25 | 2017-12-25 | Exchange method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711424281.3A CN108121446B (en) | 2017-12-25 | 2017-12-25 | Exchange method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108121446A true CN108121446A (en) | 2018-06-05 |
| CN108121446B CN108121446B (en) | 2018-11-30 |
Family
ID=62231502
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711424281.3A Active CN108121446B (en) | 2017-12-25 | 2017-12-25 | Exchange method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108121446B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921106A (en) * | 2018-07-06 | 2018-11-30 | 重庆大学 | A kind of face identification method based on capsule |
| WO2020063524A1 (en) * | 2018-09-30 | 2020-04-02 | 北京国双科技有限公司 | Method and system for determining legal instrument |
| CN113297954A (en) * | 2021-05-21 | 2021-08-24 | 中铁第四勘察设计院集团有限公司 | Ticket checking method and system for tramcar, computer equipment and readable medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251894A (en) * | 2008-01-28 | 2008-08-27 | 天津大学 | Gait recognizing method and gait feature abstracting method based on infrared thermal imaging |
| CN103035115A (en) * | 2012-12-10 | 2013-04-10 | Tcl通力电子（惠州）有限公司 | System and method for controlling household equipment based on intelligent terminal gesture recognition |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
| US20160320852A1 (en) * | 2015-04-30 | 2016-11-03 | Google Inc. | Wide-Field Radar-Based Gesture Recognition |
-
2017
- 2017-12-25 CN CN201711424281.3A patent/CN108121446B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101251894A (en) * | 2008-01-28 | 2008-08-27 | 天津大学 | Gait recognizing method and gait feature abstracting method based on infrared thermal imaging |
| CN103035115A (en) * | 2012-12-10 | 2013-04-10 | Tcl通力电子（惠州）有限公司 | System and method for controlling household equipment based on intelligent terminal gesture recognition |
| US20160320852A1 (en) * | 2015-04-30 | 2016-11-03 | Google Inc. | Wide-Field Radar-Based Gesture Recognition |
| CN105677031A (en) * | 2016-01-04 | 2016-06-15 | 广州华欣电子科技有限公司 | Control method and device based on gesture track recognition |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108921106A (en) * | 2018-07-06 | 2018-11-30 | 重庆大学 | A kind of face identification method based on capsule |
| CN108921106B (en) * | 2018-07-06 | 2021-07-06 | 重庆大学 | Capsule-based face recognition method |
| WO2020063524A1 (en) * | 2018-09-30 | 2020-04-02 | 北京国双科技有限公司 | Method and system for determining legal instrument |
| CN113297954A (en) * | 2021-05-21 | 2021-08-24 | 中铁第四勘察设计院集团有限公司 | Ticket checking method and system for tramcar, computer equipment and readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108121446B (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10991236B2 (en) | Detecting of patterns of activity based on identified presence detection | |
| US10535349B2 (en) | Controlling connected devices using a relationship graph | |
| US20210160326A1 (en) | Utilizing context information of environment component regions for event/activity prediction | |
| US20210288832A1 (en) | Automatically learning and controlling connected devices | |
| US20200167834A1 (en) | Intelligent identification and provisioning of devices and services for a smart home environment | |
| US10682097B2 (en) | People monitoring and personal assistance system, in particular for elderly and people with special and cognitive needs | |
| US11243502B2 (en) | Interactive environmental controller | |
| US9869484B2 (en) | Predictively controlling an environmental control system | |
| CN108983625B (en) | Intelligent household system and service generation method | |
| US20200028703A1 (en) | Intelligent Environment Control Systems And Methods | |
| US20160201933A1 (en) | Predictively controlling an environmental control system | |
| CN108121446B (en) | Exchange method and system | |
| CN107431649B (en) | The method and system realized for resident's strategy in intelligent household's environment | |
| US9613514B2 (en) | Systems and methods for providing a smart notifications system | |
| CN105182772A (en) | Household intelligent service method based on wireless sensor | |
| Pazhoumand-Dar et al. | Detecting deviations from activities of daily living routines using kinect depth maps and power consumption data | |
| Oriwoh et al. | Presence detection from smart home motion sensor datasets: a model | |
| KR101955939B1 (en) | Method and apparatus for recognizing activities through spatial filtering and machine learning | |
| Lim et al. | Information processing and knowledge discovery framework for sustainable building environment using multiple sensor network | |
| Akhlaghinia | Occupancy monitoring and prediction in ambient intelligent environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |