CN106464848A - Motion event recognition and video synchronization system and method - Google Patents
Motion event recognition and video synchronization system and method Download PDFInfo
- Publication number
- CN106464848A CN106464848A CN201580033463.0A CN201580033463A CN106464848A CN 106464848 A CN106464848 A CN 106464848A CN 201580033463 A CN201580033463 A CN 201580033463A CN 106464848 A CN106464848 A CN 106464848A
- Authority
- CN
- China
- Prior art keywords
- event
- data
- video
- user
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
Abstract
The invention enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. It may use integrated camera or external cameras with respect to mobile device to automatically generate generally smaller event videos of the event on the mobile device or server. It also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users. The invention provides low memory and power utilization and greatly reduces storage for video data that corresponds to events such as a shot, move or swing of a player, a concussion of a player, or other medical related events or events, such as the first steps of a child, or falling events.
Description
Technical field
One or more embodiments be related to motion capture data analysis field, and be based in motion capture data or
Person with the event for picking out in user or the motion analysiss data that be associated of equipment and/or based on from the user or
The previous movement analytical data of other (multidigit) users of person and/or equipment carrys out display information.More particularly (but not limit
Make), one or more embodiments achieve a kind of motion event identification for allowing the event in identification exercise data and video is same
Step system and method, the event includes athletic batting, movement or hits, athlete, boxer, the brain of jockey or driver
Concussion, or heatstroke, hypothermia, disease burst, asthma attack, epilepsy, or including walking and falling down including times
The event of what his physical culture or body kinematicses correlation.Can motion event and (several) image or video carry out related and/
Or synchronize by other means, this can be when event occurs or in position sometime based on event later
And/or time or all the two is for example carried out on mobile device or remote server, and be capture from (multiple stage) internal/
External camera or nurse's photographic head, the first time for example to allow the video of preservation event, such as child walks, and acutely trembles
Dynamic event, physical culture, military affairs or including other motion events including cerebral concussion, or be associated with old people fall down thing
Part, and the video data of non-event correlation is for example abandoned, so as to greatly reduce the storage demand for event video.
Background technology
Existing motion capture system is processed and potentially stores the mass data with regard to actual events of interest.Citing
For, it is known that system acquisition from the accelerometer data for being coupled to user or equipment, and analyze or monitor movement.At this
In a little situations, thousands of or millions of capturing movement sample to static in or not related in mobile user
Connection, the particular event that its mode is try to analyze with existing system is relevant.For example, if monitoring rugby fortune
Mobilize, then a large amount of exercise datas are unrelated with cerebral concussion event, for baby, a large amount of exercise datas generally with shake event or example
Non-athletic event as sudden infant death syndrome (SIDS) etc is unrelated, for golfer, by being placed in athletic height
The acceleration value of a large amount of exercise datas of the sensor capture in golf club is relatively low, that is to say, that for example stand with athlete
Or wait another one athlete or not do not move according to mode interested in other respects or acceleration is associated.Therefore,
Capture, transmission and storage for the data of non-event correlation increased the demand for electric power, bandwidth and memorizer.
Additionally, even more substantial data are potentially included for the Video Capture for implementing certain type of motion, therein
The actual event of many hitting with such as baseball bat or hommer etc is unrelated.Do not have known system prune automatically to regard
Frequently, for example preserve the video of event correlation and the video of non-event correlation is abandoned, to generate corresponding to occurring in video
And for example by the less video segment of the detected event of the analysis of motion capture data.
Some systems relevant with monitoring collision are absorbed in the collision of linear acceleration correlation.These systems cannot monitor rotation
Rotational acceleration or speed, and therefore cannot detect the certain types of event that may produce cerebral concussion.Additionally, for low-power
Consider with durability, the system of these types many does not produce the connectionless information of event correlation.Therefore, these systems are based on
Which lacks robust property and is restricted in its use.
Known system is not susceptible in exercise data carry out the data mining with regard to event yet, so as to based on formerly
The function of the event for picking out in the exercise data of front storage forms the expression of specific movement, such as ordinary movement person or common duty
The hitting of industry athlete grade or any athlete's grade.Therefore, find, prune and specify the event of special exercise correlation
So as to example as used in being very difficult and time consuming in virtual reality, and hand labor is needed.Therefore, current system is no
Method easily allows specific user with the previously stored motion of same subscriber or other users and such as historical movement person
Event is played for opponent.Furthermore it is known that system do not account for the collision that accumulates, and for example for having with cerebral concussion
The information of the data mining of pass come determine a series of collision brain function whether may be caused impaired over time.
Other kinds of motion capture system is included for analysis and the video of teaching body ins and outs (mechanics)
System.These systems be based on carrying out videograph to athlete and the athletic video to being recorded is analyzed.This
There is restriction in the technology of kind, including the subjective analysis accurate and not the same not to the utmost for example based on video.Another kind of skill
Art includes motion analysiss, wherein for example captures the three-dimensional point of the movement being associated with athlete using at least two cameras.
Known implementation utilizes static many camera chains, and the system is not portable enough and therefore cannot be in the installation of system
Be utilized outside environment, for example golf tournaments, rugby compete etc sport event during be utilized or
It is utilized to monitor child or old people.In general, the system based on video is also unfavorable with from experiencing the right of motion
As the digital moving of upper sensor captures data, this is because being to regard for obtaining and analyzing to have based on the system of video
Feel image rather than the electronic sensor of labelling.Additionally, these devices that fixes are also prohibitively expensive.Such prior art exists
The U.S. Patents Serial numbers 7 that on January 26th, 2006 submits to, are summarized in 264,554, and which requires that on January 26th, 2005 carries
The rights and interests of the U.S. Provisional Patent Application Serial No. 60/645,751 of friendship, the description of the two all merged heres are by reference.
Whole two disclosures belong to the identical inventor of the subject content of the application.
Regardless of the motion capture data for being obtained, generally in per user or on the basis of hitting every time, data are entered
Row analysis, wherein the process not being susceptible on mobile phone, and therefore user can only buy fortune for existing mobile phone
Dynamic capture sensor and " application (app) ".Additionally, existing solution is not susceptible to mobile use, analysis and message passing
Send and/or compare, or use from the user or the previously stored motion capture data of other users, or motion is caught
The large data set for obtaining data carries out data mining, for example to obtain or to create the capturing movement being associated with one group of user
Data, the such as athlete of directly golfer, tennis player, basket baller or any other sports, from
And the event that common with " professional grade " or outstanding virtual reality opponent is associated is provided.Sum it up, motion capture data is logical
It is commonly used for at-once monitor or sports performance feedback, and generally has in other areas and be restricted and/or original
Use.
Known motion capture system is generally passively or actively labelling or several sensors using several.Do not have known
System can utilize as little as one visual indicia or sensor and execution for example on the mobile device that user has had
Apply to analyze and show the motion capture data being associated with user and/or equipment.The data are typically in the lab
And analyzed on the basis of hitting in per user or every time, and the motion analysiss except the specific user or motion table
Any other purpose is not applied to outside showing, and is usually not subject to data mining.
Do not have known system allow capturing movement element and the user of such as wireless senser etc or footwear, glove,
Shirt, trousers, belt or other equipment (such as baseball bat, tennis racket, golf clubs, boxer, rugby or English foots
The athletic facing of ball, or the protectiveness facing for being utilized in any other contact sports) Seamless integration- or
Couple by other means, to carry out local analytics or later analysis in very little form, so that user does not know
Sensor described in road is placed among or on these projects.Do not have the known system being capable of such as joining in golf clubs
In weight portion (weight port) or seamless placing device being provided at the end shaft of handle, is being configured to provide
Become the wireless golf clubs of capture movement data.The data for deriving from existing sensor are not maintained in corresponding to a large amount of things
In the data base of part, and do not made with respect to any other item in addition to the collected performance of motion capture data
With.
Additionally, for using equipment and ball sports, do not have known portable system allow user obtain with regard to
The flying distance of ball, speed of hitting, (the namely collision of ball is in equipment for the intermediate degree of hit efficiency or the impact bead of equipment
The position of upper generation) instant visual feedback.These systems do not allow user and collection from other users or historical movement person or
Person gathers and plays from the motion capture data of the prior behavior of its own.Known system is not allowed to from hitting in a large number
Motion capture data carry out data mining and so as to suggestion or allow the more preferable or optimum equipment of search to mate the fortune of user
Dynamic capture data, and do not allow original equipment manufacturer (OEM) to make commercial decision, for example, improve its product, by its product
It is compared from other manufacturers, excess promotional product or contacts the use for being likely to purchase the more products of different or profit
Family.
Additionally, do not have known system to excavate to carry out equipment debugging using motion capture data, and with regard to purchasing at once
Buy the follow-up sales point decision-making of suitable athletic equipment.Additionally, do not have known system to allow custom order to fulfil, than
The Assemble to Order (ATO) that such as fulfils for the custom order of physical education facilities, such as according to based on motion capture data excavation
Customer specifications set up and for example match or virtual reality match during be shipped to customer with complete point of sale process
Equipment.
Additionally, there is no known system for passive compliance and monitoring application using mobile device and RFID label tag.
Known system is not had to allow to enter line number for a large number of users with regard to its motion or the motion of associated equipment
According to excavating to find the pattern in data, so as to allow based on up to the present still the undiscovered pattern relevant with motion come
Determine business strategy.Known system is not had to allow to obtain from OEM, medical professional, game company or other terminal temperature differences
Payment is to allow to carry out data mining to exercise data.At least for previously described restriction, a kind of motion event identification is needed
With video synchronizing system and method.
Content of the invention
Embodiments of the invention achieve a kind of identification of motion event and video synchronizing system and method, and which is provided for fortune
The INTELLIGENT IDENTIFICATION of the event in dynamic data, including but not limited to from such as visual indicia and sensor, RFID tags
And the motion capture data that the portable mobile wireless capturing movement element of mobile device computer system etc is obtained, or described
Motion capture data is calculated based on the movement by analysis being associated with same subscriber, or with the user or
Other users, historic user or groups of users are compared.Detected to correspond to by pruning exercise data and video
Event, it is allowed to which the low memory for event data and video data is utilized.This can be on mobile device or remote server
Implement, and be the position based on event and/or time and the position based on video and/or time, and can be alternatively
Pointing to limit the video for potentially including motion event further including camera.Some embodiments are allowed based on event
Viewing and low power event transmission and with execute application on the mobile apparatus and/or the communication with external camera, so as to
Specify the window in order to define event.Image or the identification of the motion event in video and event is allowed to specify, such as athletic
Batting, mobile or hit, athlete, boxer, the cerebral concussion of jockey or driver, or heatstroke, hypothermia, disease burst,
Asthma attack, epilepsy, or including walk with fall down including any other physical culture or the related event of body kinematicses.Can
With event and the width or more multiple image or video for capturing from one or more inner/outer camera or nurse's photographic head
Correlation is carried out, the first time for example to allow the video of preservation event, such as child walks, and acutely event is shaken, including brain
Concussion is in interior sport event, or the fall events being associated with old people.Can be with linear acceleration rate threshold and/or mould
Formula and rotary acceleration and threshold speed and/or pattern monitoring cerebral concussion dependent event and other events, and/or
On the basis of event, which is preserved and/or by light-type connectionless protocol, which is transmitted, or aforementioned items
Combination in any.
Embodiments of the invention allow user to buy application or " app " and capturing movement element, and immediately by the system
System is used together with its existing mobile computer (such as mobile phone).Embodiments of the invention can to monitoring user or
The user being associated with capturing movement element or equipment shows movable information.Some embodiments be also based on a certain user or
Equip associated previously stored motion capture data or motion analysiss data or be associated with least one other users
Previously stored motion capture data or motion analysiss data (function of being compared etc by such as (and being not limited to)) showing
Show the information based on the motion analysiss data being associated with the user or equipment.This allow for precision monitoring, compliance and
The motion capture data for obtaining from (multidigit) other users or the interaction of pattern, for example to utilize the true fortune for obtaining from user
Dynamic data carrying out virtual race, and based on this using previously from the user or from other users (or equipment)
Real motion data capture generate response.This ability provides the match with historical movement person as opponent, such as virtual net
Ball is competed, or the match with " common " professional sportses athlete as opponent, and be in the art until the present moment not
Know.
For example, one or more embodiments include at least one capturing movement element, and which is configured to and user, dress
Mobile device that is standby or being coupled with user is coupled, and wherein at least one capturing movement element includes:Memorizer;Joined
It is set to capture related to the sensing of at least one capturing movement element, position, speed, acceleration (linear and/or rotation)
The sensor of the combination in any of the numerical value of connection;Radio device;And it is micro- with what memorizer, sensor and radio device were coupled
Controller.The microcontroller is configured to collect the data including the sensor values from sensor, stores data in
In memorizer, data are analyzed and pick out with the event in data to determine event data, and pass through radio
The event data that device transmission is associated with event.The embodiment of the system can also include to be configured on the mobile apparatus
The application of execution, wherein mobile device include computer, are configured to communicate to obtain and event with radio device
The wireless communication interface of associated event data.The computer is coupled with wireless communication interface, and its Computer is executed should
With or " app " to configure the computer:From wireless communication interface receiving event data, event data is analyzed to form motion point
Analysis data, storage event data or motion analysiss data or event data and motion analysiss data all the two, and aobvious
Show on device and show and include the event data that is associated with least one user or motion analysiss data or whole information of the two.
One or more embodiments include at least one capturing movement sensor, and which is configured to be placed on the head of user
Near, wherein the microcontroller is further configured to calculate the impingement position in user's head.At least one capturing movement
The embodiment of sensor be configured to any kind of placement, encapsulation or coupling mechanism and be coupling in medicated cap or ball
On cap, it is coupling in protectiveness facing.One or more embodiments of at least one capturing movement sensor can be joined
It is set to and couples with the helmet in user's head, and the calculating wherein with regard to the impingement position in user's head is to be based on to use account
Portion and/or the physical geometry of the helmet.Some embodiments can include for example with least one capturing movement sensor
Or the temperature sensor for coupling with microcontroller.
Embodiments of the invention can also be using the isolator being configured to around at least one capturing movement element
So as to the physics acceleration damping of the cerebrospinal fluid approximately about user's brain, so as to minimize the linear acceleration of event data
With the conversion of rotary acceleration, the observation linear acceleration so as to acquisition user's brain and observation rotary acceleration.Therefore, some
Embodiment can be eliminated in order to the power from the acceleration based on the helmet or acceleration value or any other numerical transformation
To the brain acceleration value for being observed.Therefore, some embodiments are provided specific to thing using less electric power and storage
The data of part, so as to minimize the quantity of data transfer again, so as to cause lower through-put power to utilize and even lower
General power is utilized.Based on the type of the inherent liner in the helmet, in rugby/athletic helmet of ice hockey/lacrosse
On can utilize different isolators.Do not wear the helmet wherein or wear its that utilized in the sports of the helmet once in a while
His embodiment can also utilize at least one capturing movement sensing of (on the medicated cap of such as baseball player) on ball cap or medicated cap
Device, together with least one sensor being placed on batting helmet.Sports (the such as English foot of ball cap is not utilized wherein
Ball) in can also utilize headband placing device equally determining cerebral concussion.In one or more embodiments, using on the helmet
Isolator can remain attached to the helmet in a package, and sensor can be removed and be placed on not and utilize coupling to use
On another equipment of the isolator of the damping of family brain liquid.Some embodiments can be based on certain types of equipment (namely
Surfboard is compared to baseball bat) associated characterizable motion pattern automatic detection type of sports, and determine that capturing movement is sensed
The type of the current accompanying equipment for arriving of device.
Embodiments of the invention may be configured to obtain/calculate linear acceleration numerical value or rotary acceleration numerical value or
Both all.This allows for monitoring rotational event for cerebral concussion and linear acceleration.Other events can using linear and/
Or rotary acceleration and/or speed, for example it is compared with pattern or template, so as to not only switching sensor during event
Property dynamically to change capture characteristic, but also characterize the equipment for utilizing together with current capturing movement sensor
Type.This allows for buying by the single motion capture element of user and causing more than one piece equipment or medicated clothing tool, and this is logical
Cross allow sensor based on the motion for being captured by the sensor and characterizable motion pattern or template relatively automatically determine the sensing
Equipment or the type of medicated clothing that device is coupled to.
Embodiments of the invention can utilize connectionless broadcast message to transmit the event data being associated with event.One
In individual or more embodiments, depending on the radio communication for being adopted, broadcast can include the data with limited quantity
Payload, which can be utilized to avoid shaking hands and expense based on the agreement for connecting.In other embodiments, can pass through
Combination in any is come using connectionless or based on connection agreement.
In one or more embodiments, computer can access the previously stored event being associated with user or equipment
Data or motion analysiss data, so as to for example determine cerebral concussion fall down or other hit or any other motion event number
Mesh.Some embodiments can also assume the event data being associated with least one user over the display, this be based on
The associated event data of the user or equipment or motion analysiss data and with the user or equipment or with least one
The associated previously stored event data of position other users or other equipments or motion analysiss data.This allow in number or
In terms of quantitative value, motion event is compared, such as by the user or other users in particular game or in history
On the maximum rotary acceleration that observes.Additionally, definition corresponding to typical event project equipment characterizable motion pattern or
Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments
In dynamicallyd update in capturing movement sensor by wave point.This allows for sensor to improve over time.
Embodiments of the invention can for example by radio and television or the Internet transmit information so as to computer or remote
Shown on the visual displayss of journey computer coupling.The embodiment of the display can be configured to receive subevent
Time location, to provide the discrete rolling of the timeline along whole event.For example, golf is hit can include
The sub- thing of for example aim at (address), brandishing, brandish forward, impact, keeping posture (follow through) etc backward
Part.System can show the time location corresponding to subevent and receive the user input near the position, to determine
Video should start at the time point or stop, or is for example rolled to or returns to the time point to be easy to watch sub- thing
Part.
Embodiments of the invention can also include to couple with least one capturing movement sensor or user or equipment
Identifier.In one or more embodiments, the identifier can include team and team uniform number or student identifier
Number or passport NO. or any other identifier, which allows relative uniquely identifying from the specific of specific user or equipment
Event.This allows for application (app) the mark tool with regard to being configured to receive the data being associated with special exercise person or user
There are team sport motion or the position of multidigit athlete or user.One or more embodiments receive identifier, such as with motion
Member or the passive RFID identifier that is associated of user or MAC Address or other sequences number, and identifier and event data and
Motion analysiss data are associated.
One or more embodiments of at least one capturing movement sensor can also include to be configured in event
The light-emitting component of output light in the case of generation.This can be utilized to show potential, slight or weight in the Outboard Sections of the helmet
Degree cerebral concussion, and without the need for any communication for example for any external equipment.Different colors or flash of light interval can also be utilized
To pass on the information relevant with event.Alternatively or in combination, at least one capturing movement element can also be wrapped
Audio output element is included, which is configured in the case of an incident or at least one capturing movement sensor
Sound is exported in the case of outside the scope of computer, or wherein the computer is configured at least one fortune
Display alarm in the case of capture sensor being moved outside the scope of computer, or aforementioned every combination in any.Sensing
The embodiment of device can also utilize LCD, and which exports the volume of current event for example in quick response (QR) code or bar code
Code division is analysed, and so as to for example allow referee locally to obtain the snapshot of code analysis on the mobile apparatus, and causes event
Will not be watched with readable form on a sensor or be wirelessly communicated and intercepted by all other men.
In one or more embodiments, at least one capturing movement element also includes the position for coupling with microcontroller
Put determination element.This can for example include GPS (global positioning system) equipment.Alternatively or in combination, the calculating
Machine can cooperate with another computer to carry out triangle polyester fibre to position, or obtain from the receptor of any other triangle polyester fibre type
Position, or based on by couple with the computer and image that the known camera for pointing to specific direction is captured is counting
Position is calculated, the wherein computer for example calculates the skew with mobile device based on the direction of the object in image and size
Amount.
In one or more embodiments, the computer is further configured to please from least one camera of proximal event
Ask at least piece image comprising event or video.This can include from specific neighbouring camera or point to event direction
The broadcast of camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour
Nearly event or be directed to viewing event camera position request, and optionally for holding around events of interest
The available camera of continuous time showing or the video at this.In one or more embodiments, the computer also by
The list of one or more times of display event generation is configured to, desired so as to allow user to obtain by the computer
Event video, and/or independently ask video from the third party with desired event time.
In one or more embodiments, at least one capturing movement sensor is coupled with mobile device, and example
The internal motion sensor that mobile device in or with mobile device couple such as is used in.This allows for using generally existing
The hardware of minimum level carrying out capturing movement and event recognition, such as using the mobile device with built-in accelerometer.?
In one or more embodiments, the first mobile device can with record exercise data user couple, the second mobile device then by
Using the video to record motion.In one or more embodiments, the user for experiencing motion can provide gesture, for example
N times are tapped on the mobile apparatus, the mobile device so as to show second user should start recording video or stop recording video.
Can transmit, using any other gesture, the instruction that event is related or motion is related between mobile device.
The embodiment of at least one capturing movement sensor can include temperature sensor, or the microcontroller
Can couple with temperature sensor by other means.In these embodiments, microcontroller is configured to transmission and is derived from temperature
The temperature of sensor is spent using as temperature event, such as heatstroke or the potential instruction of hypothermia.
Therefore, embodiments of the invention can recognize any kind of motion event, including with user, equipment or shifting
The associated relevant event of moving of at least one capturing movement sensor that the combination in any of dynamic equipment is coupled, Huo Zheyu
Show to stand, walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or not having
The relevant event of breathing or the motion of its combination in any, or any other class for the persistent period for moving with period
The event of type.
Embodiments of the invention can utilize motion capture data on data mining come obtain corresponding to user, equipment
Pattern, or in certain embodiments of the invention using the motion capture data or event of given user or other users.Number
It is related to find new pattern in large database according to excavating, wherein the pattern is that previously institute was ignorant.Can be to data
Wherein should for example include statistical analysiss, neutral net and artificial intelligence in many ways to find new pattern.Due to depositing
In substantial amounts of data, therefore can be by the computer-implemented automatic data mining of or more multiple stage to find in data not
The pattern that knows.Unknown pattern can include dependency between the packet of related data, the abnormal, data element in data,
Classification data being modeled with minimum error and the unknown pattern of function or any other type.Data mining results
Display can include to summarize new discovery according to the mode that user is easier to understand compared with a large amount of purely undressed data
Pattern display.The one of which result that data mining is processed is improved market intelligence, product improvement, consumption prospecting
(lead generation) and targeted are sold.As a rule, must quilt by any kind of data for being subject to data mining
Cleaning (cleanse), data mining, and its result are generally verified.Enterprise can be with additional income by using data mining.
The example of the benefit of embodiments of the invention includes that the customer based on the pattern for finding in data for height target individual is closed
System's management.Additionally, market basket analysis data mining allows identification by the personal product that buys or have of identical, which can be sharp
It is used for having a product but the user for not having another product generally being had by other users promotes the sale of products.
The other field of data mining includes to be analyzed the large-scale exercise data set from different user, so as to base
In the performance data suggestion from other users in order to improve the exercise of performance.For example, if a user is compared to general
Buttocks rotation of the general family during hitting is less, then can be by system recommendations in order to improve the exercise of pliability or strength.?
In golf course embodiment, which ball golf course designer can determine by a large number of users on golf course
The length or difficulty in hole should be adjusted to obtain the more discrete numerical value of the average bar number corresponding to each match play, or
Person is used for determining time quantum between golfer, for example specific in the daytime when or the golfer corresponding to given age
Time quantum.Additionally, the physical culture of data mining and medical applications include to determine user's performance morphologic change over time, for example
Change compared to recipe or exercise most for the improvement of performance what to determine, or for example what in the daytime when, temperature or its
The event of hitting produced by his condition can cause farthest service or minimum fraction.By for specific user or with regard to which
His user allows health care compliance using motion capture data, so as to for example guarantee to suffer from person with diabetes in the middle of one day
Mobile specific quantity, and also allow for how motion or range of movement of the morphological analyses to determine user change over time.
Can be played using motion capture data, so as to allow to carry out with historical greatness athlete or other users as opponent
Virtual reality is competed.For example, someone can play for the prior behavior of same people, or can be directed to friend's
Motion capture data plays.This allows for being compared in history stadium or place of the user in reality environment
Match, but motion capture data is, for example, previously to gather from the user or other users.Military planning person can be using motion
Capture data to determine which soldier is the most suitable and is therefore eligible for particular action or which soldier should be retired,
Or by the cerebral concussion event that for example stood and its seriousness is trained based on athlete determine when athlete should rest,
And it is potentially based upon wherein other users and improves time period that is excavated of performance after cerebral concussion dependent event and makes
Determine.
The embodiment of the system implements capturing movement and/or aobvious by for example executing application on the mobile apparatus
Show, the mobile device can include visual displayss and optional camera, and can be from such as visual indicia and/or nothing
At least one capturing movement element of line sensor etc obtains data.The system can also be with free-standing camera or many
Camera on platform mobile device is integrated.The system also allows for user in several ways analyzing and show motion
Capture data, so as to provide the graphical information instant and easy to understand being associated with motion capture data.In the system
It is relevant that middle utilized capturing movement element intelligently stores for example associated with batting, skiing revolution, jump etc. event
Data, and eliminate error event, use and minimize storage demand so as to significantly improve memorizer.Additionally, for example may be used
Repeatedly swung or corresponding with for the more than one event data storage being associated with physical education facilities, such as if necessary storing
In the data of whole wheel golf range game, till being downloaded to mobile device or the Internet at least up to data.Can also utilize
For the data compression of captured data, to store more motion capture datas in the memorizer of given quantity.Described
The capturing movement element for being utilized in system is can be configured to intelligently by some part power-off of its circuit to save
Electric power, such as by transceiver power-off till detecting certain types of motion.Embodiments of the invention can also be using spirit
Battery connector living can utilize system so as to increase concurrently to couple two pieces or more polylith battery before battery is changed
Time.Motion capture data is typically stored within the memorizer of such as local data base etc or is stored in network can
In the data base of access, any one therein all allows data mining described above.Permissible using embodiments of the invention
Implement the data mining of any other type, change with the time of one or the more relevant data of multidigit user including search
Become, or simply search for the data relevant with specific user or equipment.
Other embodiment can show such as the selection of music or the music list that will play based on motion-dependent data
Etc information.This for example allows the performance by performance with another one user to be compared and select another one user to be played
Music type, or compare performance with respect to threshold value, the threshold value determines will advise or show what type of music
Select.
Embodiments of the invention for sports for example allow for RFID or passive RFID label tag to be placed on user institute
On mobile article, the embodiment pursuit movement of the wherein system.For example, by passive RFID label tag is placed on spy
The fixed helmet or ball cap or for boxing, the protectiveness facing of rugby, Association football or other contact sports
Upper and be especially located on the dumbbell in gymnasium, and by wear such as glove etc capturing movement element and
Using for exampleEtc existing mobile device, The embodiment provides automatic safe compliance or
Fitness and/or health care compliance.This is to track user by pursuit movement and by RIFD or passive RFID
The weight lifted and realize.Therefore, embodiments of the invention can be multiplied by by each RFID label tag institute plus number of repetition
The weight for showing, so as to calculate the calory count burnt by user.In another example, RFID label tag and stationary bicycle coupling
Close, or wherein stationary bicycle can simulate identifier and/or radio communication so as to offer performance data, and wherein
Mobile computer includes RFID reader, and the number of revolutions of user leg can be counted.For RFID or passive
Any other of RFID is using the spirit for all meeting the present invention.This allows for doctor remotely to determine whether user defers to its medical treatment and build
View, or beyond for example showing the linear or rotary acceleration of cerebral concussion.Some embodiments therefore can be true using coming by user
Compliance is protected, and is utilized to reduce its malpractice liability insurance rate by doctor, this is because doctor is guaranteeing that its patient abides by
From its recommendation, despite by remote mode.Embodiments of the invention are not required for RFID label tag for medical compliance, but
RFID label tag can be utilized.For golf embodiments of the invention also allow for by using on each ball bar for example
RFID label tag etc identifier (or alternately through being associated with the capturing movement electronic installation on golf clubs or
The identifier for remotely being obtained by radio device) and each ball bar for being associated with golfer of mobile computer pair
Golf driving counted, the mobile computer be, for example, equipped with RFID readerIts
The process for counting for golf driving is concentrated on mobile computer rather than on each golf clubs.The present invention's
Embodiment can also allow for referring to measure using Inertial Measurement Unit or accelerometer and/or magnetometer and/or gyroscope
To (north south, and/or two trunnion axis and vertical axises).Golf driving is counted this point is not required for, but
By vibration analysis, one or more embodiments for example can determine when golf clubs hits golf, and then to
Golfer asks whether to count batting.This function for example can be with speed or acceleration rate threshold or range detection mutually group
Close, to determine that whether golf clubs is advanced in acceptable speed or scope, or whether be in corresponding to should count
In the acceleration of the hit of number or scope.Small echo can also be utilized be compared with signature of effectively hitting, so as to for example disappear
Mistake impact is batted or is eliminated except counting.The scope can be different between different clubs, for example, open club velocity
Scope can be " higher than 30mph ", and push rod velocity interval can be " less than 20mph " then, can be according to the phase for any club
Hope and any scope is utilized, or can for example ignore the velocity interval.Alternatively or in combination, mobile computer can
With only when golfer is not shifted laterally (be namely in golf cart or walking) just to Gao Er
Husband player asks whether to count batting, and/or wherein golfer may carry out rotating or being batted, just
As determined by the sensing that couples with mobile computer or gyro sensor.Ground that for example can be on mobile computer
The position of batting is shown on figure.Furthermore, it is possible to the gps receiver with radio device is placed in ball seat labelling and hole
(cup) to provide the daily renewal with regard to distance in, and for example help read push rod and greens.Golfer is acceptable
Virtual glasses are worn, which allows golfer to see golf course map, current location, arrive the distance of match play, work as forecourt
The number of strokes in hole, batting sum and any other desired measure.If for example by like that, using determined by GPS
Family moves specific range without counting batting from batting, and system can prompt the user whether to count batting.The system
Do not need user to start the switch on club to count batting, and do not need LED on each ball bar or active or electric
Battery-powered electronic installation is counting batting.Mobile computer can also receive gesture from user to count batting or not
Batting is counted, therefore golfer need not remove any glove to operate mobile computer.For using position/sensing sensing
The embodiment of device, system can only club in be perpendicularly oriented to when and for example when shock is detected just count bat.
Described device can also include the identifier for allowing mark specific device.The identifier can be for example serial number.The mark
Know the RFID label tag that symbol can be for example derived from each golf clubs, or can alternatively include and golf clubs
The associated serial number of associated capturing movement element or other identifiers.The specific height of mark is allowed by using the device
Golf ball handss, specific club, and also allow for carrying out together with the system of TV and/or mobile device is included capturing movement and/
Or show, the wherein mobile device has visual displayss and an optional camera, and can from such as visual indicia and/
Or at least one capturing movement element of wireless senser etc obtains data.The system can also with free-standing camera or
Camera on person's multiple stage mobile device is integrated.The system also allows for user in several ways analyzing and show
Motion capture data, so as to provide the graphical information instant and easy to understand being associated with motion capture data.The dress
Put the system that also allows for and determine " placed in the middle " degree for clashing into regard to ball and equipping (such as golf clubs).The system also allows for bag
The debugging of the equipments such as footwear, club is included, even and if equipping needs the customization Assemble to Order request from retailer also to permit
Equipment is bought perhaps at once.Once motion capture data, video or image and batting counting indicator are obtained by the system, can
With by its for example locally stored in the local database, or for example remote data base is sent to by phone or wave point.
Once in data base, various elements (such as age, sex, height, the body of any data including being associated with user
Weight, address, income or any other relevant information) just can be used in embodiments of the invention and/or be subject to
Data mining.One or more embodiments allow the access of user or OEM for example for the data mining ability of the system to enter
Row is paid.
For example, the data for being obtained from described device using the embodiment permission analysis of capturing movement element, and permit
Perhaps the exclusive display (such as 3D superposition) being associated with user is presented on the image of user's body, will pass through visual manner
Describe captured exercise data.Additionally, these embodiments can also utilize the scope for up to 50 meters to use for exampleThe active wireless technology of low energy etc, is led to so as to the mobile computer with golfer
Letter.For example as receiving the result of golf clubs ID (for example by RFID reader or alternatively by for example usingLow energy or the radio communication of IEEE 802.11), embodiments of the invention also allow for display and are directed to
Count the inquiry of batting.By usingLow energy chip allows club using the coin unit of standard
Battery is up to 3 years in sleep pattern, so as to the maintenance needed for reducing.One or more embodiments of the present invention are for example permissible
More than one radio device using more than one technology.This allows for improving a certain degree of redundancy of system robustness
Property.For example, if a radio device (for exampleRadio device) no longer work, then
802.11 radio device of IEEE can be utilized to transmission data and alert one of them wireless Denso to golfer
Put and no longer work, while still allowing for golfer's record exercise data and carrying out for the associated batting of specific club
Count.Enforcement for the present invention using the mobile device (or being more than a mobile device) without (multiple stage) camera
Example, it is possible to use sensing data generates the display of captured exercise data, at the same the mobile device can alternatively from
Other cameras or other mobile devices with camera obtain image.For example, it is possible to use or do not utilize use
The display type of the image at family can include evaluation, the data for being calculated and timeline data.Can also by have or not
The form of numeral or graph data with user images displays to the user that the evaluation being associated with the motion for being captured, for example
" efficiency " is evaluated.Other evaluations can include linear acceleration and/or the rotation for being for example used for determining cerebral concussion and other events
Acceleration value.Can be calculated in the case of the image with or without user's body on the mobile apparatus and show institute
The data of calculating, such as predict ball flight path data.Can also show in the case of the image with or without user
Describe data on the time line, for example to show the relative velocity peak of the various pieces corresponding to equipment or user's body
Value.From multiple stage camera (including multiple stage mobile device) and be, for example, can be by group from the image of golf fan colony
Close BULLETIn visual effect, the visual effect be by enclosing under normal speed and under all angles
The slow motion hit around the golf shown in golfer is characterizing.The data that is all analyzed locally can shown
Show, or count together with motion capture data, image/video, batting and position data is uploaded to data base and can
To experience data mining process wherein, the wherein system can for example be directed to the access collection of charges of result.
In one or more embodiments, user for example can play ball on a certain golf course or play tennis or
Simply hit so that motion capture data is generated, and the change of another one user is seen when virtual reality glasses are worn
Body, no matter it is the true incarnation in virtual or augmented reality environment.In other embodiments, user's movement and any physical culture
Equipment or simply move the user body of oneself for coupling with capturing movement sensor that motion is associated, and watch
Show the movement of the user in virtual reality glasses or the reality environment of the movement of the equipment of such tool.Replace
Ground or in combination, it is possible to use virtual reality room or other environment carry out projected virtual reality incarnation and exercise data.
Therefore, the embodiment of the system can allow the user on real golf ball field with various location not in reality
The another one user of batting plays, and moves the analyzed historical movement person of data or based on one or more
Do more physical exercises capture data sequence data mining construction user play, and by the system one embodiment utilize
To project the incarnation of historical movement person.Each in the middle of three athletes can be competed successively, be in phase just as which
Same place is the same.
Motion capture data and/or event can be shown in many ways, such as during or after capturing movement
Sending out text is pushed away to social networkies.For example, if having carried out certain amount of exercise or motion or having consumed certain amount of
Calorie, or obtaining new sports Capability index maximum, then the system can be sent out new information automatically and push away
Text arrives social network sites, such that it is able to notify to be connected to the Internet anyone.Upload to the Internet (namely remote data base or
Remote server or the storage away from system) data can by obtain for data access any computer viewing,
Analyze or carry out data mining.This allows for long-range compliance to push away text and sends (tweeting) and/or compliance and/or original dress
What standby manufacturer determines for the equipment of compliance or the body of the embodiment for sports correlation for given user
Educate armament-related work obtain best, and/or will advise what equipment.Data mining is also allowed for based on the number being associated with user
According to and/or metadata suggestion user improve the planning of its compliance and/or sports place (including golf course), such as
Age or any other demographic information that can be imported in system.The long-range storage of data also allows for medical treatment should
With such as morphological analyses, range of movement over time and diabetes control, and foregoing exercise monitoring and compliance
Application.Other application also allows for playing (example using the real motion capture data from other users or historical movement person
Such as after the athletic video of analysis of history, no matter whether the historical movement person is alive).Virtual reality and enhancing are virtual existing
Real application can also utilize motion capture data or historical movement data.The army personnel of such as commanding officer and/or doctor etc
What kind of gravity can be experienced using motion and/or image to determine under blast of the people near improvised explosive devices,
And automatically the medical rescue of optimal type is arranged into the position of capturing movement sensor.One or more realities of the system
Apply example and for example its higher level can be relayed to the motion capture data beyond gravity or threshold speed by wireless communication link and refer to
Wave at official or nearest healthcare givers.Or, embodiments of the invention can to any mobile device that is intercepting (for example
The mobile phone of referee) the connectionless cerebral concussion related news of broadcast light-type, to help succour injured swimmer,
Wherein the light-type message includes optional team/team uniform number and acceleration correlated digital, such as potentially/possible
Cerebral concussion warning or index.
In one or more embodiments of the present invention, such as tennis tour, rugby match, baseball game, vapour
Fixing camera at car or motorcycle race, golf tournaments or other sport events can be located at motion
Wave point near the athlete/equipment of capture element is utilized together, to obtain, to analyze and show motion capture
According to.In this embodiment it is possible to show the exercise data of real-time or near real-time for strengthening video playback on video.Cause
This, by shown with visual manner be equipped in batting during mobile how soon must having and cause the lifting of amusement degree, for example surround
Athletic buttocks and shoulder draw circle.Embodiments of the invention are also allowed on the mobile device relevant with another one user
Using the athletic image from other with mobile device or video, so that user need not for example exchange mobile electricity
Words.In one embodiment, when by first user for second user not with the mobile phone with outfit video cameras
When physical education facilities in associated motion obtain video, the video can be automatically transferred to first user, to utilize
The motion capture data being associated with first user is shown.Video and image can be uploaded in data base and pass through
Graphical analyses are by data mining, so that the type/color of the medicated clothing that for example determination user is dressing or footwear.
Based on the display of data, user can determine optimal equipment, and buy equipment by mobile device at once.
For example, when making decision between two secondary sleds, user can be tried out by the complete of capturing movement element tools
The secondary sled in portion two, wherein is analyzed to determine which secondary sled allows more efficient movement to motion capture data.Right
In golf embodiment, when making decision between two golf clubs, user can be entered using different clubs
Row is hit, and quantitatively determines that the performance of which ball bar is more preferable based on the analysis of the exercise data to being captured.Can lead to
Customization equipment is ordered at the interface that crosses on mobile device from retailer, and retailer can be equipped and example with Assemble to Order customization
Such as equipment is checked at user.For example can based on user carries out push rod using the shaft of adjustable length when captured
Exercise data, for specific user customization for example have full-length push rod shaft length.For example it is based on and motion is caught
Obtain the data mining of data and batting enumeration data and distance, it is allowed to the user with similar characteristic of hitting and active user
It is compared, wherein for example can advises for user or search for the given speed of hitting for the user with specific stature and age
Degree provides the equipment of longer batting, to improve performance.For given speed of hitting, OEM is it may also be determined which kind of plate
Optimal aggregate performance is provided with the club of model.It would be recognized by those skilled in the art that this is applicable to all of motion
Activity and be not only golf.
The embodiment of the system can utilize multiple sensors type.In one or more embodiments of the present invention,
Active sensor can with allow using together with being passively or actively the system integration of visual indicia, so as to capture user's body or
The motion of the specified point on equipment.This simply can be implemented according to two-dimensional approach, or if mobile device is configured with two
Platform or more multiple stage camera, or if multiple stage camera or mobile device are utilized to capture images (such as video) and are total to
Described image is enjoyed to create the three-dimensional motion data of triangle polyester fibre from the set of the two dimensional image for being derived from each camera,
Then can also implement according to three dimensional constitution.An alternative embodiment of the invention can utilize Inertial Measurement Unit (IMU) or
Any other sensor of the combination in any of sensing, position, speed and/or acceleration information can be produced for mobile device.Cause
This, the data that the sensor can be obtained can include and point to (vertical or north south or all both), position (by complete
Ball alignment system (namely " GPS ") or pass through triangle polyester fibre), speed (in whole three axles), acceleration (whole three axles
In) combination in any of associated one or more numerical value.The all motion capture datas for obtaining from various sensor types are all
Can be stored in data base for analysis, monitoring, compliance, match or other purposes and/or data mining, and
Regardless of sensor type.
In one or more embodiments of the present invention, it is possible to use include passive marker on the outer surface of sensor
Or the sensor of active flag, so that sensor can also be utilized and visual tracking (two dimension or three-dimensional) and for referring to
To, position, speed, acceleration or any other physical quantity for being produced by sensor.The vision of (multiple) capturing movement element
Labelling embodiment can be passive or active, it means that itself or can have can be by the vision portion of visual tracking
Point, or the light-emitting component that can include to allow to carry out image trace in low light conditions, such as light emitting diode (LED).This
The figure of the opposed ends of the shaft end near handle or the golf clubs at club head can for example be passed through
Symbol or coloured label are implementing.The image of labelling or video locally analyzed, or can be stored in data base simultaneously
And analyze, and subsequently it is used in data mining.Additionally, for the embodiment of cerebral concussion correlation, visual indicia can be sent out
Go out to show the light of cerebral concussion, for example the yellow flash corresponding to moderate cerebral concussion or the quick redness corresponding to severe cerebral concussion
Flash of light, or any other vision or optional audio event index or all the two.As previously discussed, LCD
Local vision encoded messages can be exported, so which will not be equipped to read the local of the code by not having
Anyone of mobile device is intercepted or is read by other means.For example for the event that cerebral concussion or paralysis are related, this is just
Allow only to read sensitive Medical News by referee or local healthcare givers.
The embodiment of capturing movement sensor can generally be placed in of physical education facilities (such as golf clubs)
Or on more ends or opposing end portions or its any position (measuring for EI) nearby and/or therebetween, and can be with
The other sensors for being coupled to equipment are integrated, such as weapon, medical equipment, wrist strap, footwear, trousers, shirt, glove,
Club, bat, racket, ball, the helmet, ball cap, facing etc., and/or use can be attached to by any possible mode
With family.For example be attached on rifle, so as to determine when recoil is detected by capturing movement sensor rifle positive sense what
Place.The data can for example utilize mobile computer (such as mobile phone) or other equipment be sent to central server and
Analyzed, put into practice for military exercises.Additionally, one or more embodiments of the sensor can be assembled to golf
In the counterweight part of bar and/or it is assemblied in the handle end of golf clubs.Other embodiment can for example be assembled to net
In the handle or end of racket or baseball bat.The embodiment relevant with safety or health monitoring can be with ball cap, the helmet and/or tooth
Set coupling, or in the encapsulation of any other type.One or more embodiments of the present invention can also be utilized and are integrated with
The ball of sensor is operated.One or more embodiments of mobile device can lay computer including small-sized, such asOrIt can with or without integrated display, and
And be small enough on the shaft for be placed in physical education facilities and do not interfere with hitting for user.Or, the system can be calculated
The virtual flight path of the ball for coming in contact with the equipment for being moved by athlete.For example for baseball bat or tennis racket or Gao Er
Husband's club, wherein golf clubs have the biography in the counterweight part of the another part for the end for being integrated into club impact golf
Sensor, and with for wearing at the handle tip of golf clubs or by athlete or more glove
Second sensor, can calculate projected angle of impact for club.By knowing the angle of inclination (loft) of club striking surface, can be right
Flight angle is calculated in golf.Additionally, by with sufficiently high speed the sensor of club end is sampled with
Just determine and show that golf wherein hits the vibration of the striking surface of club, it may be determined that the quality of shock.These types
Measurement and its analysis help athlete to make improvements, and allow athlete to buy at once suitable dress for debugging purposes
Standby.(centering) data can be uploaded to data base and by data mining between two parties, so as to for example on the basis of manufacturer
On find and have the relevant pattern of the bat of optimal average placed in the middle or minimum torque numerical value, racket or club, for product
Improve.Any other unknown pattern found in data can also be presented or advise to user or carried out by user
Search, or for example paid by manufacturer or user.
One or more embodiments of sensor can include such as mechanical eccentric counterweight etc charging feature, as
As being utilized in some wrist-watches for being referred to as " automatic " or " self wind " wrist-watch, wherein alternatively include small power generation
Machine or the inductive charging coil of the Indirect Electro mechanical charge for sensor power device.Other embodiment can be utilized to be used for
The plug of the direct charging of sensor power device or based on electromechanical or micro electronmechanical charge member.One in the present invention
Or can be using the micro- acquisition technique of the electric power of any other type in more embodiments.One or more embodiments of sensor can
To utilize power saving feature, including the gesture for causing sensor energising or power-off.Such gesture can include motion,
Physical switch with the contact of sensor, for example go to the wireless life of sensor from the mobile device being associated with particular sensor
Order.The other elements that can couple with sensor for example include battery, low power microcontroller, antenna and radio device, heat
Synchronous (heat sync), recharger and overcharge electric transducer.Additionally, embodiments of the invention are allowed one of system
Divide or all components power-off, such as till determining that club is moved from the electronic signal of accelerometer or mechanical switch.
One or more embodiments of the present invention for example allow physical education facilities and the even elastic lag of body or EI to survey
Amount.The embodiment of sensor along the shaft of golf clubs, tennis racket, baseball bat, ice stick, footwear, the arm of people or
And the placement of any other non-fully hard article is allowed at the point between point or sensor residing for measurement sensor
The quantity of flexing.Each sensor angle difference over time not only allows for calculating flexing distribution, and also allows for calculating
Flexing depending on time or power is distributed.For example, it is known that EI machine determined using the static counterweight between the strong point
EI is distributed.Therefore these machines cannot detect that EI distribution is depending on the time that applied power is also depending on applying power, example
If EI distribution can be nonlinear with regard to power or time.There is the exemplary materials bag of different physical attributes known about the time
Include Maxwell's material and non-Newtonian fluid.
User can also graphically watch captured exercise data on the display of the mobile device, or for example
Watch on a pair of glasses comprising video display unitss.From the exercise data for being captured that the embodiment of capturing movement element is obtained
The virtual reality for user that can also be utilized to strengthen in virtual environment shows.Looked in data base by data mining
To the virtual reality of pattern or augmented reality view also comply with the spirit of the present invention.User is it can also be seen that for example aim at auxiliary
Or aim at the enhancement information of guiding etc, its for example based on existing wind condition or consider dangerous (for example keep off for
The tree of the desired destination of ball (such as hole) midway) show and should attempt wherein batting.
One or more embodiments of the present invention include motion event identification and video synchronizing system, and which includes to be configured to
At least one capturing movement element that the mobile device for coupling with user or equipment or with user is coupled.Described at least one
Capturing movement element can include:Memorizer;Sensing, the position being configured to capture with least one capturing movement element
Put, the sensor of the combination in any of numerical value that speed and acceleration are associated;Radio device;With memorizer, sensor and nothing
The microcontroller of line electric installation coupling.The microcontroller may be configured to collect the sensor values including from sensor
Data, store data in memorizer, data be analyzed and pick out with event in data so as to determination event
Data, the event data being associated with event by radio device transmission.The system can also include mobile device, described
Mobile device includes computer, is configured to communicate to, with radio device, the event data that acquisition is associated with event
Wireless communication interface, the wherein computer coupled with wireless communication interface, and wherein the computer is configured to from wireless
Communication interface receiving event data.The computer can also analyze event data to form motion analysiss data, store event
Data or motion analysiss data or event data and motion analysiss data all the two, from event obtain event initial time and
Event dwell time, includes at least from event initial time to during the time span of event dwell time from camera request
The view data of the video for being captured, and show event video over the display, including all following two:It is being engaged in
Part initial time to event dwell time time span during institute's event data, motion analysiss data or which is any
Combination;And from event initial time to the video for being captured during the time span of event dwell time.
The clock that some embodiments can be come in synchronization system using any kind of synchronous method, and at one or more
In many embodiments, the computer on mobile device is further configured to determine the clock difference between capturing movement element and mobile device
Different, and motion analysiss data and audio video synchronization.For example, one or more embodiments of the present invention are provided for causing
The code of the information of multiple stage recording equipment synchronous time, position or sensing with regard to each equipment, such that it is able to combine from
Distinct device with regard to event recorded data.Such recording equipment can be embedded type sensor, with camera or
The mobile phone of mike, or be more generally to record any equipment to movable related data interested.
In one or more embodiments, this is synchronously realized by exchanging information between devices, so that each sets
Standby can reach an agreement in terms of the common measurement for time, position or sensing.For example, mobile phone and embedded biography
Sensor can exchange the message of the current time stamp with its internal clocking;These message allow to consult, wherein two
Equipment is reached an agreement in terms of common time.Such message periodically can be exchanged as required, so that before solving once
The clock drift of the equipment after synchronization or motion.In other embodiments, multiple stage recording equipment can use common service
Device or server set are to obtain the normalization measurement of time, position or sensing.For example, equipment can use GPS system
To obtain the absolute location information corresponding to each equipment.GPS system can be utilized to obtain normalized temporal.NTP (net
Network time protocol) server is also used as normalized temporal server.Individual device is allowed altogether by using server
Reach an agreement in terms of with measurement, without being always configured to communicate with one another.
In one or more embodiments of the present invention, some of them recording equipment is configured to detect various things interested
The generation of part.Some such events may occur in particular moment;Other such events may occur in interval of time,
Wherein the detection includes the starting of detecting event and the end of event.These equipment are configured to using described above right
Should be in the synchro measure of time, position and sensing basis to the combination in any of the time, position or sensing of recording equipment together with thing
Number of packages evidence is recorded.
The embodiment of the computer on mobile device can be configured to discarding and fall in event initial time stop to event
At least a portion video outside only.For example, in one or more embodiments of the present invention, some of them recording equipment
Constantly data capture to memorizer while detecting event is waited.In order to save memorizer, some equipment can be joined
It is set to and just locally deposits more permanent for data Cun Chudao only when data are in time adjacent to detected event
Storage media or storage are to server.For example in the case of event is not detected by, the data of new record finally can deposited
The data of precedence record are override in reservoir.Cyclic buffer can be used as one kind of such overriding scheme in certain embodiments
Typical realisation.When event detection occurs, in addition to the data for capturing during the event of being stored in itself, recording equipment can
A certain configured data volume after being terminated with a certain the configured data volume before the starting of storage event and event.Appoint
Where front or posterior time interval is considered as a part for event initial time and event dwell time, so that for example
The situation of event is shown in video.
The embodiment of the system can also include the server computer away from mobile device, wherein server computer
It is configured to abandon at least a portion video outside event initial time to event stopping, and from event starting
Time to event dwell time time span during the video that captured return to the computer in mobile device.
The embodiment of at least one capturing movement element is may be configured to event transmission at least another fortune
Dynamic capture sensor or at least another mobile device or its combination in any, and wherein described at least another motion is caught
Obtain sensor or at least another mobile device or its combination in any is configured to preserve the data being associated with the event.
For example have and meanwhile operation multiple stage recording equipment embodiment in, this kind equipment can detect event, and to
Other recording equipments send the message for showing that such event detection has occurred and that.The message can include event starting and/
Or the time labelling for stopping, wherein lock in time basis is used for the clock of individual device.Receiving device (such as other motions
Capture sensor and/or camera) can be using event detection message non-volatile for data Cun Chudao being associated with event
Storage device or storage are to server.In addition to the data being directly associated with event, the equipment may be configured to
Storage event starting before certain data volume and event terminate after certain data volume.In this way, Suo Youshe
Standby while record data, but can be initiated for from multiple using the event from an only wherein equipment
The preservation of the distributed event data in source.
The embodiment of computer can be configured to preserve from event initial time to the video of event dwell time with
And the motion analysiss data for occurring from event initial time to event dwell time, or can be preserved using remote server
Video.In one or more embodiments of the present invention, some of them recording equipment wherein may generation event time period
Interior possibly all cannot be directly communicated with each other all the time.In these cases, equipment may be configured to all numbers for having recorded which
According to complete documentation be saved in permanent storage device or be saved in server.Only preserve the data being associated with event to exist
Possibly cannot accomplish in the case of these, this is because some equipment possibly cannot receive event-triggered message.In these situations
Under, can be processing to the data for being preserved afterwards, to extract and event phase detected by one or more
Association is only related part.For example, multiple stage mobile device may record the video of athlete or performing artist, and
Constantly the video is uploaded onto the server to be stored.The athlete or performing artist may individually be equipped with detection
The embedded type sensor of the event of such as special exercise or action etc.Embedded type sensor data can by constantly or
Later sometime upload to identical server.Due to including all including video flowing and embedded type sensor data
Data are generally all added with time labelling, and the video being therefore associated with the event for being detected by embedded type sensor can be in clothes
It is extracted on business device and combines.
The embodiment of server or computer is can be configured to when at least one capturing movement sensor and shifting
When communication linkage between dynamic equipment is opened, abandon at least a portion outside event initial time to event stopping and regard
Frequently, and preserve from event initial time to the video of event dwell time and from event initial time to event dwell time
The motion analysiss data of generation.Or, if communication linkage is not opened, the embodiment of the computer can be configured to protect
Video is deposited, and after event being received after communication linkage is opened, subsequently abandons to fall to stopping to event in event initial time
At least a portion video outside only, and preserve from event initial time to the video of event dwell time and from event
The motion analysiss data that time beginning occurs to event dwell time.For example in some embodiments of the invention, data can be as
Front be uploaded to server describedly, and the position that is associated with the data flow of each equipment and point to data can by with
To extract the data for detected event correlation.For example, a larger mobile device set can be used to
Video is recorded at each position during whole golf tournaments.The video data can be by constantly or touring
Upload onto the server after match.After tour, the sensing data with event detection can also be uploaded to identical
Server.For these various data flows post processing can identify institute's event be physically adjacent to place and meanwhile record
Particular video stream.Additional filter can select wherein camera positive sense to be correctly oriented the video with the event of observing
Stream.These streams selected can be combined with sensing data, so as to form multiple video angles with the event that illustrates
Aggregate data flow.
The system can be separated from the camera for being coupled with mobile device or with mobile device or by its other party
Formula obtains video away from any camera of mobile device.In one or more embodiments, from the service away from mobile device
Device obtains video, such as obtain after the inquiry of the video at for a certain position and time interval.
The embodiment of server or computer is may be configured to by the graphical analyses synchronously video and the event
Data or the motion analysiss data, so as to more accurately determine in the video with the event initial time or institute
State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this
In one or more embodiments of invention, the clock between recording equipment can be synchronously approximate.May want to based on viewing
Improve, from the event of each equipment, the accuracy that the synchronous data from multiple stage recording equipment feed.In one or more realities
Apply in example, the process for multiple data flows is used to the signature of the event that observes in different streams, to help fine granularity same
Step.For example, can be embedded type sensor and the mobile device synchronization for including video cameras, but time synchronized may
Only it is accurate within 100 milliseconds.If video cameras are with 30 frame recording video per second, corresponding on embedded type sensor
The frame of video of event detection be based solely within lock in time labelling can only be defined in 3 frames.A reality in the equipment
Apply in example, it is possible to use video frame images process to determine the accurate frame for being most closely correspond to detected event.Citing
For, can the skis for being detected by inertial sensor hit the vibrations on ground and the wherein geometrical boundary of skis and
The frame correlation that ground comes in contact.Other image processing techniquess that other embodiment can be signed using detecting event or method are come
Improve the synchronization of multiple data feeding.
The embodiment of at least one capturing movement element can include that coupled with microcontroller is configured to determine
The position of position determines element, and wherein microcontroller is configured to the computer transmission position on mobile device.At one or
In more embodiments, the system also includes server, and wherein microcontroller is configured to directly or by mobile device to clothes
Business device transmits position, and its Computer or server are configured to stop based on position and event initial time and event
Time forms event video from the various pieces of video.For example, in one or more embodiments, can be event video
The event of length-specific is trimmed to, and any video quality is transcoded onto, and be superimposed with motion point in any manner
Analyse data or event data (such as speed or acceleration information) or integrate therewith by other means.Video can according to
It is locally stored with any resolution of storage video, depth or picture quality or compression type or any other technology,
To maximize memory capacity or frame per second, or using any compression type to minimize storage, but regardless of mobile device, extremely
Whether few communication linkage between a capturing movement sensor and/or server opens.In one or more embodiments, speed
Degree or other motion analysiss data can for example be applied or be combined by other means in certain part below video,
Including event starting and dwell time, before event starting and dwell time can include actual event and/or it
Any number of seconds afterwards, for example to provide the video that hits before batting event.In one or more embodiments, described extremely
A few capturing movement sensor and/or (multiple stage) mobile device can be sent to server event and video, wherein service
Device can determine that particular video frequency and sensing data occur in ad-hoc location and special time, and from several videos and several biographies
Sensor event tectonic event video.Sensor Events for example can be from the sensor for coupling with user and/or equipment
Or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, deposit so as to for example greatly reduce video
Storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or
The microcontroller and computer are configured to determine the position of event and carry out correlation to position, and this is e.g. by para-position
Putting carries out correlation or the average central point to provide event, and/or can minimize from initialization GPS sensor
Erroneous position data.In this way, one group of user with mobile device can generate the video that golfer kicks off,
The event location of an at least capturing movement equipment can be wherein utilized, and wherein server can obtain video from spectators
And the event video that hits and bat of professional golfers is generated, wherein event video can be utilized from different photographies
Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one
Or multiple videos can be trimmed to the persistent period of event, such as from event initial time to event dwell time, and/or
Person have around any in front or posterior scheduled time numerical value of event, so that it is guaranteed that capture including corresponding to hit or its
Any time of his event and any holding posture time are in interior whole event.
In one or more embodiments, the computer on mobile device can be from least one camera of proximal event
At least piece image or video of the request bag containing event, this is directed to by any camera in the region by directly broadcast
The request of any video for shooting, its can alternatively include whether to be not only located at event nearby with regard to the camera but also
Point to or by other means towards the directional information of event.In other embodiments, can be by the calculating on mobile device
Machine asks video from remote server.In this case, any position being associated with event and/or time can be utilized
To return image near event and/or video or the image for shooting in the time of the event that is close to and/or video or all
The two.In one or more embodiments, computer or server can prune video to correspond to incident duration, and
The various pieces of the further synchronous event of image processing techniquess, such as hitting with the respective frame in video can similarly be utilized
Ball, which is matched with the acceleration information of the batting for corresponding on equipment.
The embodiment of the computer on mobile device or server may be configured to show that a certain event occurs or which
In the list of one or more times that occurs of one or more events.In this way, user can be found from list
Event is so as to rapidly Access Events video.
Embodiments of the invention can include at least one capturing movement sensing for physically coupling with the mobile device
Device.These embodiments allow any kind of mobile phone with integrated sensor or camera chain (such as any types
The camera laid of the helmet or including the whole any placing device of the two of camera and capturing movement sensor) generate thing
Number of packages evidence and video data.
Description of the drawings
By the more specific description for being given later in connection with accompanying drawing, the idea passed on by present disclosure aforementioned
Will become apparent from other aspects, features and advantages, wherein:
Fig. 1 shows one embodiment of motion event identification and video synchronizing system.
Figure 1A shows the logic hardware block chart of one embodiment of computer.
Figure 1B shows the Organization Chart of the one embodiment for the data base for being utilized in an embodiment of the present invention.
Fig. 1 C shows the one of the process that the embodiment corresponding to the computer in the system shown in Fig. 1 and 1A is implemented
The flow chart of individual embodiment.
Fig. 1 D shows the data flow diagram of the one embodiment corresponding to the system.
Fig. 2A shows the placing device based on the helmet around user's head, wherein the placing device based on the helmet
Fixing capturing movement sensor.Fig. 2 B shows the placing device based on neck insert (neck insert), and which allows using fortune
Dynamic capture sensor is reequiped to the existing helmet.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, illustrated therein is the outside of capturing movement sensor and the helmet
Isolator between part.
Fig. 4 A shows the top-sectional view of the helmet, liner, skull and user's brain.Fig. 4 B is shown corresponding in Fig. 4 A
The rotation cerebral concussion event of each shown element.
Fig. 5 shows input power (G1) for the helmet with respect to observing in brain and by being placed in isolator
The power that observes of sensor.
Fig. 6 shows the rotary acceleration numerical value of 3 axles together with total rotating vector quantity, together with obtaining from camera and
The video of the cerebral concussion event for showing together with motion event data.
Fig. 7 shows that the timeline of user shows the peak along timeline together with the event being shown as along timeline
Value and minimum angular velocity.Additionally, the curve shown in showing in bottom illustrates the lead and lag of golf clubs
(lead and lag) determines high together with the sagging of golf clubs and drift (droop and drift), wherein these numerical value
Degree of crook of the shaft of golf club in two axles that marks and draws with respect to the time.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, its allow with will be rolled to, be played to or from
The input near start stop time point that the subevent that plays at this is associated, so as to easily allow to watch subevent.
Fig. 9 show each subevent start along the time and the relative position that stops and with starting and dwell time phase
The gravitation of association, which allows the user input near these points to be attracted to starting and dwell time.
Figure 10 is shown by the use of a mobile device as capturing movement element and another mobile device as reception
The motion event data of first user event and one embodiment of the computer of video.
Figure 11 shows the one embodiment for being utilized to the memorizer for storing the data relevant with potential event.
Figure 12 shows and is especially programmed in microcontroller to determine whether there occurs the one of the function of expected event
The flow chart of individual embodiment.
Figure 13 shows typical Event Signing or template, and which is compared to eliminate mistake with motion capture data
Positive events.
Figure 14 shows one embodiment of capturing movement element, and which is configured with locally displayed and viewing event phase
The optional LED visual detector of pass information, and the word that is display configured to be associated with event or encoded messages can
Select LCD.
Figure 15 shows the template properties of the motion event being associated with different types of equipment and/or tool medicated clothing
One embodiment, can change more accurately or more efficiently to capture together with wherein capturing movement sensor individual character
The region of the data being associated with special time period and/or subevent.
Figure 16 shows the front view of one embodiment of protectiveness facing and shows top view in the bottom of in figure,
Which is for example worn in any contact sports, such as (and being not limited to) Association football, boxing, rugby, wrestling
Or any other sports.
Figure 17 shows the one embodiment for the algorithm for being utilized by any computer in Fig. 1, and which is configured in combination
Show moving image and motion capture data in form.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the present invention.
Figure 19 shows and detects event by one of capturing movement sensor, and event detection is sent to other motions
Capture sensor and/or camera, preserve event motion data, and prune video to correspond to event.
Specific embodiment
A kind of identification of motion event and video synchronizing system and method will now be described.Explain in exemplary description below
Many details are stated, to provide the more thorough explanation with regard to idea described in this specification.But this
Skilled person will be recognized that, can put into practice in the case of it need not merge all aspects of detail as described herein
The embodiment of idea as described herein.Additionally, particular aspects well-known to those skilled in the art are not described in detail, with
Exempt to obscure present disclosure.Reader should note that, although elaborate the example of inventive concept in this disclosure, but
The present invention is limited by the complete scope of claims and any equivalents.
Fig. 1 shows one embodiment of motion event identification and video synchronizing system 100.Some embodiments allow to be based on
The viewing of event and low power event transmission and with execute application on the mobile apparatus and/or logical with external camera
Letter, to specify the window in order to define event.Allow image or the identification of the motion event in video and event to specify, such as transport
The batting of mobilization, movement or hit, athlete, boxer, the cerebral concussion of jockey or driver, or heatstroke, hypothermia, disease
Burst, asthma attack, epilepsy, or including walk with fall down including any other physical culture or the related thing of body kinematicses
Part.Can be event and the width or more multiple image that capture from one or more inner/outer camera or nurse's photographic head
Or video carries out correlation, the first time for example to allow the video of preservation event, such as child walks, and acutely shakes event,
Including the sport event including cerebral concussion, or the fall events being associated with old people.As illustrated, the enforcement of the system
Example generally includes the application thereon of mobile device 101 and execution, and which includes that being shown positioned movement as dotted outline sets
Computer 160 (that is referring further to the function view of the computer 160 of Figure 1A) inside standby 101, it is coupled to computer 160
Display 120 and the wireless communication interface that couples with computer (which is generally in the inside of mobile device, referring in Figure 1A
Element 164).As the mobile phone with mobile computer is generally existing, therefore the user of the system can purchase
One or more capturing movement elements and application (i.e. " app ") is bought, and to implement institute on its existing phone
State one embodiment of system.Therefore, capturing movement ability is by affordable price for having had mobile phone, in terms of flat board
Any user of calculation machine, music player etc. can use, and this is always impossible in the past.
Each mobile device 101,102,102a, 102b can alternatively include internal identifier reader 190 (for example
RFID reader), or can be coupled with identifier reader or RFID reader (referring to mobile device 102) to obtain mark
Symbol 191.Or, embodiments of the invention can be set to system transmission mark using any wireless technology in any equipment
Standby 110 identifier.Embodiments of the invention can also include and at least one capturing movement sensor or user or equipment
The identifier of any other type of coupling.In one or more embodiments, the identifier can include team and team uniform
Number or student identification symbolic code or passport NO. or any other identifier, which allows relative uniquely identifying from spy
Determine the particular event of user or equipment.This is allowed for regard to being configured to receive the data being associated with special exercise person or user
Application (app) identify with multidigit athlete or user team sport motion or position.One or more embodiments are received
Identifier, the passive RFID identifier being for example associated with athlete or user or MAC Address or other sequences number, and mark
Know symbol to be associated with event data and motion analysiss data.
The system generally includes at least one capturing movement element 111, by placing device 192 and user 150 or dress
Standby 110 coupling, for example, be coupled to golf clubs, baseball bat, tennis racket, ice stick, weapon, club, daggers and swords or for appointing
Any other equipment of what sports, or such as footwear, belt, glove, glasses, medicated cap etc other physical education facilities or
Any other article of person.At least one capturing movement element 111 can be placed on one end of equipment 110, both end
Or any position between two ends or any position with user 150, for example it is placed on ball cap, headband, the helmet, facing
Or in its combination in any, and also the EI measurement of any article can be used in.The capturing movement element can be optional
Ground includes visual indicia (being passively or actively) and/or can include wireless senser, for example, can provide and capturing movement
The associated one or more numerical value of the sensing (north south and/or up/down) of element, position, speed and/or acceleration any
Any sensor of combination.The computer may be configured to for example by visual manner or wireless mode from club 110
The RFID of coupling obtains the identifier exclusive with each 110 (such as medicated clothing, bat etc.) of equipment (namely identifier
191) data for being associated and being alternatively associated with least one capturing movement element, analyze the data to be formed
Motion analysiss data, and show motion analysiss data on the display 120 of mobile device 101.Capturing movement element 111 can
To be placed in by capturing movement placing device 192, equipment is upper or which nearby or is placed in user or near which.
The capturing movement element 111 being for example placed on the helmet can include isolator, and the isolator includes to be configured to around fortune
Dynamic capture element so as to approximately about user's brain cerebrospinal fluid physics acceleration damping material, so as to minimize event
The conversion of the linear acceleration and rotary acceleration of data, to obtain observation linear acceleration and the observation rotation of user's brain
Acceleration.Process demand capturing movement element microcontroller on, and base for event data are so for example just reduced
Transmission in event allows low memory to utilize and low-power requirements.From capturing movement element 111 motion capture data and
The associated any data (such as identifier 191) of equipment 110 and with user 150 or any number of such user 150
(such as second user 152) associated any data can be stored locally in memorizer, or are stored in computer
In local data base, or it is stored in remote data base, for example can be with the data base 172 of Coupled processors.For example
When from capturing movement element 111 to mobile device 101 and from mobile device 101 to network 170 or the Internet 171 and to number
When having network or telephony network links available according to storehouse 172, the data from each user 150,152 can be stored in data
In storehouse 172.Subsequently with any number of user and its concrete property and show the large data collection that parameter is associated and close reality
Apply data mining.For example in the golf embodiment of the present invention, club ID is obtained from golf clubs, and by motion
Capture element detection batting.Mobile computer 101 stores the image/video of user, receives corresponding to event/hit/bat/transport
The motion capture data of event location and follow-up batting on dynamic and court, and determine the parameter corresponding to each event
(distance when such as event occurs or speed), and subsequently implement any local analytics, and show table on the mobile apparatus
Existing data.When the network connection of from mobile device to network 170 or the Internet 171 is available, or for example golf is taken turns one
After ball match, described image/video, motion capture data and performance data are uploaded to data base 172, for entering later
Row analysis and/or display and/or data mining.In one or more embodiments, user 151 (such as original equipment manufacturer)
Access for data base is paid, and this is, for example, the calculating by such as computer 105 or mobile computer 101 etc
Machine, or from for example can pass through network 170, the Internet 171 or by website 173 communicated with data base 172 appoint
What his computer, or form the part of data base 172 or server coupled thereto.Data mining can counted
Execute according on storehouse 172, wherein can for example include local server computer, or can set in computer 105 or movement
For operation on 101,102,102a or 102b, and for example access the free-standing embodiment of data base 172.Data mining results can
With in mobile device 101, computer 105, television broadcasting or from camera 130,130a and 103b or 104 web video
Upper display, or accessed by website 173, or its combination in any.
One or more embodiments of at least one capturing movement element can also include to be configured to send out in event
The light-emitting component of output light in the case of life.This can be utilized to show potential, slight or weight on the Outboard Sections of the helmet
Degree cerebral concussion, and without the need for any communication for example for any external equipment.Different colors or flash of light interval can also be utilized
To pass on the information relevant with event.Alternatively or in combination, at least one capturing movement element can also be wrapped
Audio output element is included, which is configured in the case of an incident or at least one capturing movement sensor
Sound is exported in the case of outside the scope of computer, or wherein the computer is configured at least one fortune
Display alarm in the case of capture sensor being moved outside the scope of computer, or aforementioned every combination in any.Sensing
The embodiment of device can also utilize LCD, and which exports the volume of current event for example in quick response (QR) code or bar code
Code division is analysed, and so as to for example allow referee locally to obtain the snapshot of code analysis on the mobile apparatus, and causes event
Will not be watched with readable form on a sensor or be wirelessly communicated and intercepted by all other men.
One or more embodiments of the system can be using the mobile device for including an at least camera 130, institute
State the computer that camera is for example coupled in mobile device.This allows for the computer command camera in mobile device 101
The 130 one or more images for for example obtaining user during physical culture movement.(several) image of user with showing and can be commented
Fixed superposition, so as to for example cause motion analysiss data to be more appreciated that for the mankind.Or, the detailed data without user images
Show and can also be shown on display 120, or on display of the example as shown in computer 105.In this manner it is achieved that
Allow two dimensional image and follow-up display.If mobile device 101 includes two cameras, take the photograph as shown in mobile device 102
Shadow machine 130a and 130b, then the camera can be utilized to three-dimensional by for example creating for the graphical analyses of visual indicia
Data acquisition system.So allow for determining and analyzing distance and the position of visual indicia.In any embodiment of the invention, come
From the image of any camera and/or video can be stored on the data base 172 being for example associated with user 150 for
Data mining purpose.In one or more embodiments of the present invention, graphical analyses can be implemented on image and/or video,
So as to for example according to age of user 150 or match in the daytime when determine the board of utilized equipment, medicated clothing, footwear etc.
Son/model, or find any other pattern in data.
Or, for the embodiment only with the mobile device of a camera, it is possible to use multiple stage mobile device is to scheme
The form of picture obtains 2-D data, and carries out triangle polyester fibre to determine the position of visual indicia to which.In the system one
In individual or more embodiments, mobile device 101 and mobile device 102a share the view data of user 150 to create three maintenance and operations
Dynamic analytical data.It would be recognized by those skilled in the art that by determining the position of mobile device 101 and 102 (by such as equipment
In the position of common GPS chip etc determine element or by cell tower triangle polyester fibre, its for clarity not by
Illustrate but generally positioned at the inside of mobile device as computer 160), and by obtaining from capturing movement element 111
Data (location of pixels in the residing image in every piece image of such as visual indicia), it is easy to obtain distance and so as to
Obtain speed.
Camera 103 can also be used in rest image, or be used in video as present institute is common.?
In embodiment using the system of external camera, any method for obtaining data from external camera all meets the system
Spirit, including the Wireless transceiver of data, or passes through wire communication for example when camera 103 is docked with computer 105,
Which subsequently can be data transfer to mobile device 101.
In one or more embodiments of the system, it is not necessary to show the mobile device of motion analysiss data thereon
With camera, that is to say, that mobile device 102b can also video data although being configured without camera.Therefore, mobile device
102b can be from mobile device 101,102,102a camera, any group of camera 103 and/or television camera 104
Close and image is obtained, as long as any external camera can be to mobile device 102b transmitted image.Or, completely without taking the photograph
Shadow machine comes using the system.For example referring further to Figure 17.
For the data that television broadcasting, 111 Wireless transceiver of capturing movement element are received by antenna 106.So from
The wireless sensor data that capturing movement element 111 is obtained is combined with the image for being derived from television camera 104, so as to produce
Display with enhanced motion analysiss data, its can be broadcast to TV, computer (such as computer 105), movement set
Standby 101,102,102a, 102b or be display configured to any other equipment of image.For example by knowing the position of camera
(such as by GPS information) and direction and/or sensing by knowing camera institute direction is put, motion analysiss data can be by
Position on display 120, as long as sensing data includes position data (such as GPS information).In other embodiments,
Visual indicia or image procossing can be utilized to a motion analysiss data interlock to image, for example, can track height in the picture
Golf club head, and corresponding high, the neutralization lower position of club can be utilized to determination user 150 for camera
130 or 104 or 103 sensing, so as to for example on the image for correctly marking and drawing user 150 through enhanced data.Pass through
Labelling between the image added-time and labelling between the motion capture data added-time, such as the intervalometer in microcontroller and movement
After timer synchronization and subsequent scanogram on equipment is to find visual indicia or the physical education facilities at each position, can
So that the motion capture data through simplifying is added on image.Handle can be utilized in one or more embodiments of the present invention
From any other method that the image of camera is combined with motion capture data.Spirit according to the present invention, it is possible to use
Motion analysiss are properly located with regard to user on display 120 (or any other display on such as computer 105)
Any other algorithm of data.For example, when event or event group is obtained by sensor, in application, event is received
And/or in order to obtain the time range of image after, application can be from its local storage, any other mobile device, permissible
The camera request of any other type for communicating is from the view data of the time span, and/or puts up event
Position/time, so that can provide corresponding to (multiple) event in the local external camera system of (multiple) event
Time view data.
Can generate on mobile device 101 and show one such show include using from mobile device 101,102,
Two or the more multiple stage for selecting in the middle of 102a, camera 103 and/or television camera 104 or any other external camera
The BULLET of cameraView.In the embodiment of the system, the computer is configured to obtain user
150 two width or more multiple image and with least one capturing movement element (no matter being visual indicia or wireless senser)
Associated data, wherein two width or more multiple image are obtained from two or more multiple stage camera, and wherein institute
State computer and be configured to generate and show, there is shown with normal speed and around the use shown in user under all angles
The slow motion at family 150.Such embodiment for example allows one group of football fan to create the professional golfers of their own in tour
In BULLETFilm.The film can be sent to computer 105, can implement to appoint on computer 105
What the image procossing needed for and for example broadcast to televiewer.In the other embodiment of the system, various mobile devices
Users to share their own image collection, and/or for example by its uploading films to website for watching later.The present invention
Embodiment also allow for using the athlete from other with mobile device on the mobile device relevant with another one user
Image or video so that user need not for example exchange mobile phone.In one embodiment, when by first user pin
When obtaining video to the physical education facilities in the motion that is not associated with the second user with video cameras mobile phone, permissible
The video is automatically transferred to first user, to be shown using the motion capture data being associated with first user.
Or, the mobile phone of first user can be utilized as motion sensor to substitute or supplement capturing movement element 111, and
And the mobile phone of second user can be utilized to capture the video of first user at the volley.First user can be alternatively
Make on phone gesture, tap/shake etc., with show the second mobile phone should for example start/stop motion capture.
Figure 1A shows one embodiment of computer 160.Include to execute the processor of software module in computer 160
161, the software module is generally also referred to as applied, and is stored in main storage usually as computer program instructions
In 162.Display interface 163 drives the display 120 of mobile device as shown in Figure 1 101.Optional sensing/position module
167 can include north south or up/down point to chip or all the two.In one or more embodiments, the sensing/position
Module can include that the position for coupling with microcontroller determines element.This can for example include GPS device.Alternatively or therewith
Combined, the computer can cooperate with another computer to carry out triangle polyester fibre to position, or fixed from any other triangle
The receptor of position type obtains position, or based on by couple with the computer and known sensing specific direction photography
The image of machine capture calculating position, wherein the computer for example calculated based on the direction of the object in image and size with
The side-play amount of mobile device.Optional temperature sensor can be coupled with processor 161 by wired or wireless link, and example
Such as can by individually with the index as hypothermia or heatstroke, or with for example may indicate that shake or lose appointing for consciousness
What detected motion is combined.Communication interface 164 can include wirelessly or non-wirelessly communication hardware protocol chip and/or RFID
Reader, or RFID reader can be externally coupled to computer 160 or be for example coupled to by any other mode
Computer 160.In one or more embodiments of the system, communication interface can include that phone and/or data communication are hard
Part.In one or more embodiments, communication interface 164 can include Wi-Fi TM or 802.11 equipment of other IEEE and/orWireless communication interface orWireless device, or any other wireless technology.1st classEquipment has approximate 100 meters of scope, and the 2nd kind equipment has approximate 10 meters of scope.Low-power equipment has approximate 50 meters of scope.Can use in the embodiment of the system and appoint
What wireless network protocol or type, as long as mobile device 101 and capturing movement element 111 can communicate with one another.Processor
161st, main storage 162, display interface 163, communication interface 164 and sensing/position module 167 can be by being commonly referred to as
The communications infrastructure 165 of " bus " communicates with one another.Communication path 166 can include that permission is wired with other by network 170
Or the wired or wireless medium communicated by wireless device.Network 170 can be communicated with the Internet 171 and/or data base 172.
Data base 172 can be utilized to preserve or fetch image or the video of user, or motion analysiss data, or according to certain
The user that form is shown together with motion analysiss data.Upload to the Internet (namely remote data base or remote server or
Person is away from the storage of system) data can by the viewing of any computer of the access for obtaining for data, analyze or enter line number
According to excavation.This allows for original equipment manufacturer to determine that what physical education facilities works preferably for given user, and/or
Any equipment will be advised.Data mining also allows for planning golf based on the data being associated with user and/or metadata
Court, such as age or any other demographic information that can be imported in system.The long-range storage of data is also permitted
Perhaps medical applications, such as morphological analyses, range of movement over time and diabetes control and exercise monitoring and compliance should
With.Also allowed for using from other users, one or more previous performance of same subscriber based on the application of data mining
Or historical movement person (for example after the athletic motion picture of analysis of history or video, no matter the historical movement person is
No alive) real motion capture data play.Virtual reality and enhancing virtual reality applications can also be caught using motion
Obtain data or historical movement data.The system also allows for the event that performance is related and/or motion capture data uploads to number
According to storehouse 172, which for example may be implemented such that social network sites.This allows for user to send with regard to high score during or after match
" push away literary (tweet) ", to notify the new event to everyone on the Internet.For example, one or more enforcements
Example includes at least one capturing movement element 111, and which is configured to the mobile device for coupling with user or equipment or with user
It is coupled, wherein at least one capturing movement element includes:Memorizer;It is configured to capture and at least one motion
The sensor of the combination in any of the associated numerical value of the sensing of capture element, position, speed, acceleration;Radio device;And
The microcontroller for coupling with memorizer, sensor and radio device.The microcontroller is configured to collection to be included to carry out autobiography
The data of the sensor values of sensor, store data in memorizer, data are analyzed and are picked out in data
Event is to determine event data, and the event data being associated by radio device transmission with event.The system
Embodiment can also include the application for being configured to execute on the mobile apparatus, and wherein mobile device includes computer, is configured
Become to communicate to obtain the wireless communication interface of the event data being associated with event with radio device.The computer
Couple with wireless communication interface, its Computer executes application or " app " to configure the computer:Connect from wireless communication interface
Event data is received, analysis event data is to form motion analysiss data, storage event data or motion analysiss data or event
Both data and motion analysiss data are whole, and display includes and the event number that at least a user is associated over the display
According to or motion analysiss data or whole information of the two.
Figure 1B shows the Organization Chart of the one embodiment for the data base 172 for being utilized in the embodiment of the system.
As illustrated, table 180-186 include with regard to N position user, per user M part equipment, per user or per part equip P pass
Sensor, the S item sensing data of each sensor, the T kind pattern, D position data user and the V video that find in other tables
Information.The all tables for illustrating in Figure 1B be all exemplary, and according to for specific implementation mode is desired can
To include more or less of information.Specifically, table 180 includes the information with regard to user 150, can wherein include and user
Relevant data, such as age, height, body weight, sex, address or any other data.Table 181 includes to equip 110 with M part
Relevant information, the type of the manufacturer that for example equips, the model of equipment and equipment, the equipment can include club, ball
Bat, bat, shirt, trousers, footwear, glove, the helmet etc..For example in golf embodiment, at one of the present invention or
In more embodiments, manufacturer can be the title of manufacturer, and model can be title or model number, and type can be
Club numbers (such as No. 9 irons), and equipment ID can be identifier 191.Table 182 can be included with regard to user 150 or equipment 110
Or the information of the P sensor 111 on mobile computer 101.The sensor being associated with user 150 can include medicated clothing, ball
Bar, the helmet, ball cap, headband, facing etc., the sensor being associated with equipment 110 can be for example motion capture data sensing
Device, and the sensor being associated with mobile computer 101 can for example include for position/sensing sensor 167 and for
The sensor 130 of image/video.Table 183 can include the information of the S item sensing data that equips with regard to per user per part,
Wherein the table can include time and position or any other metadata relevant with sensing data of sensing data, than
Temperature sensor as shown in pass through in Figure 1A is obtained or by radio communication or for example by any other side local
The temperature of formula acquisition, weather, humidity, or sensing data can be including the information or its combination in any.The table is acceptable
Comprising many other fields, such as ball type, that is to say, that in golf embodiment, the type of the golf for being utilized
Can be saved and later data mining carried out to which to find out ball type for putting up the best performance etc..The table can also be wrapped
The event type in local computing is included, for example potential cerebral concussion event.Table 184 can be included with regard to for example at data mining
The information of the T kind pattern for finding in reason.This can include to have passed through the field that ad hoc inquiry searched in each table and
Any obtained correlated results.In one or more embodiments of the present invention, can be according to for specific implementation mode institute
Using any data mining results table type as expecting.This can include any kind of Search Results, including
Can on a computer 160 local computing EI measurement, or from simply inquire complex patterns search any other search
Numerical value.Table 185 can include the information with regard to D position data mining user 151 and can include its access type, that is, complete
Full database or pattern table, or particular manufacturer etc. is limited to, the table can also for example include to dig corresponding to data
Pick user has paid or the paying requirement of usage type agreeing to pay and/or receipt, and looks into any
The relevant any search of inquiry or the pattern for being found or suggestion.Including allowing to sensing data (including motion capture data)
The OODB Object Oriented Data Base relation of data mining or the data structure based on memorizer are carried out in any other interior scheme
All meet the spirit of the present invention.Although give the exemplary embodiment corresponding to specific activities, those skilled in the art
It will be recognized that, such as by using capturing movement element and operate in the existing cell phone 101,102 of user or other meters
Application on calculation machine 105, the embodiment of the system can be captured and analyze any kind of based drive activity.Data
The embodiment in storehouse can include the V video 179 being stored in table 186, wherein for example include to generate user, the video counts of video
According to, time of video and position.The field is optional, and in one or more embodiments, video can be stored
On any mobile device in systems or the combination in any of mobile device server/DB 172.In one or more realities
Apply in example, video can be broken down into the video subset being associated with " time " field of sensing data table 183, wherein described
Time field can include event initial time and event dwell time.In this case, larger video can be trimmed to about
Become corresponding to one of generally less time window (which is associated with the event of the event type being stored in table 183) or more
Much less event videos, so as to significantly reduce the video storage demand of the system.
Many applications are had to benefit from the embodiment of the system and realize by the embodiment of the system, its offer
Watch on mobile computer or server/database and analysis motion capture data, so as to for example by user 151 to data base
172 carry out data mining.For example, user 151 can include compliance human observer, wherein for example include the head of a family, Er Tonghuo
Old people, manager, doctor, insurance company, police, any other entity of army or such as equipment manufacturing business etc, its
Data mining can be carried out for product improvement.By search corresponding to specific stature or age for example in tennis embodiment
User highest serve speed, or by based in the sensing data field in table 183 in golf embodiment
Speed of hitting carry out detection range (the namely difference between the ordinal position in table 183), so that it is determined which manufacturer has
Optimal club or the optimal club of the age according to per user or height or body weight, or many other patterns.It is related to
The other embodiment of compliance is allowed in the case of the threshold value (height or zero or any other grade) corresponding to gravity is met
Generate from mobile computer 101 or the message from server/database, in order to it is sent to compliance human observer, management
Person, doctor, insurance company etc., as already described above.User 151 can include marketing personnel, its determination
Specific user has the article which correlation which equipment and other similar users may have, to be directed to specific user
Sold.User 151 can include healthcare givers, its can determine for example with the footwear of Children with Diabetes (that is certain
The equipment of type) sensor that couples carry out how many movements, and the mobile phase common non-diabetic child is had many
Few, wherein can include to provide excitation for carrying out more exercises etc. for Children with Diabetes according to the suggestion of table 185, so that should
Child is consistent with healthy children.Sports doctor, physiologist or Physical Therapist can utilize the data of per user, or
Person scans in the middle of a large number of users and for example the specific movement of a certain user or range of movement is carried out with other users
Relatively, can be improved in which field by stretching or exercise to determine given user, and which range of movement neck
Domain changes over time according to user or according to colony, and for example user can using what type of equipment come tackle with
The change (or even before these changes occur) of time.By to motion capture data and the view data related to motion
Carrying out data mining unique advantage is provided for user 151.Number can be implemented in the flexing parameter for measuring by sensor
According to excavation, so as to determine the pliability of physical education facilities, footwear, human body or any other article whether over time or
Change or determine its combination in any between equipment manufacturing business.
During in order to ensure capturing movement, the analysis of user 150 is included that be associated relative with horizontal line (does not namely have
Have inclination) image, the system can for example include on the computer 160 in mobile device 101 execute sensing module.
The computer is configured to the sensing Notes of Key Data user based on the sensing hardware being derived from mobile device 101 along level
Planar alignment camera.It would be recognized by those skilled in the art that it is common on the mobile apparatus to point to hardware.This allow for as
The image of this capture keeps maintaining an equal level relatively with regard to horizontal plane.The sensing module can also point out user towards or away from the use
Family travelling shot machine, or for user further focal length or zoom out focal length so as to user be placed on figure " debugging frame (fit
Box in) ", so as to the size of the user that standardization will be captured to a certain extent.Image can also be utilized to prove by user
Which has for example been deferred to for the doctor's advice for meeting special exercise requirement.
The embodiment of the system is further configured to recognize at least one motion being associated with user 150 or equipment 110
Capture element, and related for position specified by least one capturing movement element 111 and user 150 or equipment 110
Connection.For example, user can shake specific capturing movement element in the computer prompted being subject in mobile device 101,
The identity of which capturing movement element asked by computer for confirmation.Or, can divide when known activity is implemented
The position of analysis motion sensor data and/or speed and/or acceleration, and the riding position with regard to capturing movement element is automatic
Being classified, or assumed position is confirmed by pointing out user.Sensor can be for example by team's title and team uniform number
Code is associated with special exercise person, and is stored in the memorizer of capturing movement sensor for event transmission.In Fig. 1
Any computer for illustrating can be utilized to the identifier associated for special exercise capture sensor and be programmed, so as to
Meet the spirit of the present invention.
One or more embodiments of the computer in mobile device 101 are configured to obtain an at least width of user 150
Image, and three-dimensional coating is shown at least piece image of user 150, wherein the three-dimensional coating and motion analysiss number
According to associated.Various displays can be shown on display 120.The display of motion analysiss data can include and motion analysiss number
According to associated evaluation, and/or the display of the ball flight path for being calculated being associated with motion analysiss data, and/
Or show along time shafts the time point that the peak value being associated with motion analysiss data is occurred timeline aobvious
Show, and/or in order to help user to improve the suggestion training course of the ins and outs of the user.These are through filtering or analyzing
Data pick-up result can be stored in data base 172, be for example stored in table 183, or can be on the database
(or the server being associated with data base, or any other computer for example in the system shown in figure 1 or its combination
In) undressed data are analyzed, and subsequently show on mobile device 101 or website 173, or for example pass through
Television broadcasting from camera 104.In any manner data mining results can be shown phase with the unique of the system
Combination, and also can be illustrated in any desired manner.
The embodiment of the system can also assume an interface, to allow 150 by mobile device 101 by no
Line interface buying equipment 110, such as by the Internet or the computer by may be implemented such that the server of retailer
105 are bought.Additionally, for customization debugging equipment, such as putter shaft length or any kind of equipment any its
He customizes size determination, and the embodiment of the system can assume an interface to allow user 150 by mobile device 101
Wave point come order customization debugging equipment.Embodiments of the invention also allow for mobile device 101 to 150 suggestiveness of user
Can preferably equip, or allowing user 150 to be searched through, performance determined by data mining to be carried out to data base 172 more preferable
Equipment, wherein for the golf of every ball bar of the user of the speed of hitting in the predefined scope having in user 150
Ball hitting distance carries out data mining.This allows for for example digging real-life performance data by user 151 (such as OEM)
Dig and utilize to equip to the suggestion of user 150, and charged for this, this e.g. passes through to be directed to appointing as shown in Fig. 1
The access pay of the data mining results for showing in what computer or pass through website 173.In the one or more of the present invention
In embodiment, data base 172 tracks OEM data mining, and is configured to for example for each user 151 in given note
The quantity of the access that buys and/or use in the account period is charged to user 151.For example, see Figure 1B.
The embodiment of the system is configured to analyze the data for obtaining from least one capturing movement element, and is based on
The intermediate degree for vibrating to determine the collision between ball and equipment of at least one capturing movement element for coupling with equipment, and
Based on motion analysiss data display impingement position.The performance data are also stored in data base 172, and for example with
The data mining that carried out in a large amount of collisions and by OEM or coach using advising the ball with higher hit probability placed in the middle
Bar.
Although Figure 1A depicts physical equipment, the scope of system and method set forth herein can also cover specifically
Virtual unit of the realization in one or more computer programs, virtual machine or simulator, the wherein computer program is held
Row is on computer or computer system, and serves as or provide compatible with the method for implementing disclosed concept and process
Computing system environments.Virtual machine, process, equipment etc. and the system physical computer system substantially similarly
In the case of running, such virtual platform will also fall in the range of the system of present disclosure, although as described herein
Physical system as shown in figure ia.
Fig. 1 C shows and corresponds to the pass the place for being implemented and allowed using the embodiment of computer in the system
The flow chart of one embodiment of reason.In one or more embodiments of the system, at 301, alternatively calibrate multiple fortune
Dynamic capture element.In certain embodiments, it means that the multiple sensors with calibration user or on equipment, to guarantee to pass
Sensor is aligned and/or is configured to have same speed or acceleration value for given input motion.At this
In the other embodiment of invention, it means that multiple capturing movement sensors are placed in calibration object, the calibration object
Mobile and while calibration sensing, position, speed, acceleration or its combination in any.The step for generally include provide motion catch
Obtain element and optional placing device (or alternatively allowing using the mobile device with capturing movement sensing function), and example
Allow the user with existing mobile phone or computer utilize as described in system embodiment obtaining motion capture data simultaneously
And potentially analysis based on this and/or the application of transmission message.In one or more embodiments, user simply can purchase
Capturing movement element and application is bought, and begins to use at once the system.The system utilizes (multiple) capturing movement at 302
Element carrys out capture movement data, for example, be in motion capture data 303 and pick out any event, that is, beyond show brain shake
The linear and/or rotary acceleration of the threshold value that swings, and at 304 for example motion capture data be sent to mobile computer 101,
102 or 105, can wherein include
Phone or user can be utilized come the computer in any other type for being collected locally data.In one or more embodiments
In, sensor can transmit event to any other capturing movement sensor, to start event for example in other sensors
Data storage processing.In other embodiments, sensor can transmit event to other mobile devices, to show for example should
The video corresponding to event is preserved in the case of unwanted video section is abandoned, so as to permission or the time point in event
Nearby or in sometime pruning to video later.In one or more embodiments, the system is minimized and is passed
The complexity of sensor, and for example process is unloaded to the ability for being found in existing mobile phone and other electronic equipments
Be enough to competent computing element.From capturing movement element to the computer of user transmission data can may when occur, the cycle
Property ground occur, occur on the basis of event, occur when polled or occur in any other manner, as will be at this
In each chapters and sections described in as.This is two sides compared with the known system for continuously sending undressed data
Face saves a large amount of electric power, can send data first in the time window for surrounding special exercise event in event packets,
So as to a significant small subset data compaction to total unprocessed data, and secondly can be according to less than continuous
The frequency of transmission or data are sent in the defined time or when data are solicited, to limit the total degree of transmission.
In one or more embodiments, the LED for glistening on capturing movement sensor 111 can be for example utilized at 305 local
Display event, such as yellow slow flash correspond to potential cerebral concussion, or red quick flashing is corresponding to the very high cerebral concussion of probability.
Alternatively or in combination, can for example transmit and any other shown in FIG computer or mobile device on
Display alarm or event.
Main intelligence in the system is typically found in mobile computer or server, can wherein utilize more many places
Reason ability, and for example so as to the communication capacity using generally existing in existing mobile computer.In the system one
In individual or more embodiments, mobile computer alternatively can obtain identifier, or the mark from user or equipment at 306
Symbol can be transmitted as a part for step 305, such as passive RFID or active RFID or such as team/team uniform number or
Other identifiers of other athlete ID etc, which can be utilized which to determine based on the identifier of equipment by mobile computer
Position user is just potentially injured, or what weight user is lifting, or user is wearing that what footwear is run, Huo Zheyong
Family is currently in use any weapon, or user is currently in use what kind of activity.Mobile computer can locally divide at 307
Analysis motion capture data, and for example when threshold value is observed in data show (namely illustrating) or send for example message it
The information of class, such as when athlete, soldier or racing driver stand excessive gravity, or when not there is enough motions
(at that time or based on the data pattern in data base, the user is for example based on as discussed hereafter
Typical movement pattern or other users motor pattern).In other embodiments, once user implement certain amount of
Motion, can send a message to store or show by other means to (multidigit) safety or compliance human observer at 307
Registration evidence, wherein for example include referee, the head of a family, child or old people, manager, doctor, insurance company, police, army or
Any other entity of person such as equipment manufacturing business etc.The message can be SMS message, Email, push away text or appoint
What other kinds of electronic communication.If specific embodiment is configured for remote analysis or is used only for remote analysis,
Then at 308, motion capture data can be sent to server/database.If implementation is not using teledata
Storehouse, then the analysis on mobile computer is local.If implementation includes remote data base, can move at 309
Dynamic computer or server/database or all the two upper enforcement analyses.Once data base obtains motion capture data, subsequently
Data can be analyzed, and desirably can send to compliance personnel or commercial entity from server/database
Message, so as to individually show at 310 event or with the preceding events data being associated of the user or other users mutually group
Close or show event with regard to the preceding events data.
Embodiments of the invention are used for the data from mobile computer and/or server to play, form compares, defer to
Property, track burnt calorie, the work that is implemented, based on motion or in daytime and night different previous movement
Pattern monitoring child or old people, when gravity stops beyond threshold value or motion for athlete, the safety monitoring of army, example
As the honeycomb in the virtual reality applications for including the current and/or past data using user or the data from other users
On phone, running, jump, throwing are captured to the local use of data, or implementing or entering line number based on user
Music is played according to the type of the motion that excavates or select playlist.For example, if motion similar in data base
Know athlete, then the playlist of the user can be sent to the mobile computer 101 of the user.The process can be
Local enforcement, so as to play quick music if motion is very fast, and can play sound at a slow speed if motion is relatively slow
Happy.Any other algorithm for music being played based on the motion of user all meets the spirit of the present invention.For from capturing movement element
It is any using the spirit for all meeting the present invention with the motion capture data of the application acquisition on the existing mobile computer of user,
Including exercise data used in reality environment, so as to using from the prior behavior of the user or from another
The actual motion data of one user's (for example including historical movement person) illustrate the relative motion of the athletic incarnation of another one.Letter
The display of breath is implemented typically by three kinds of situations, wherein display information be motion analysiss data based on user or
Equipment and previous data with regard to user, wherein previous data can be from identical user/equipment or one or
More multidigit other users/equipment.In this case, the elder generation being associated of current motion analysiss data and the user/equipment
The comparison of front data is allowed using the extremely cost-effective system with capturing movement sensor and application come analytical model.?
Under another kind of situation, the display of information is the performance according to active user, so that from the user or another user/equipment
The past data of selection is the performance based on active user.This allows for the match of high realism, such as with historical movement person
For the virtual tennis tournament of opponent, wherein actually by the capture movement from historical movement person, hitting for user is made back
Should.Brought using this verity match of real data (current and previously stored data all the two) as true as possible
Real match, such as user is played with the average mode of 10 tennis player before ranking as opponent, that is, service speed
The speed and angle of the return of serve that degree, the given input for user are batted.For example television image can be analyzed to really
Fixed by may alive historical movement person has not got batting hit speed and type, so as to be used with great master as opponent's test
The skill at family, still alive and as currently just playing with user just as great master.Can be real in the third situation
Compliance and the monitoring of the user or different user is applied, and need not be with the past data of the user or the elder generation of other users
Front data are compared, and wherein the different user does not have for example with the access for mobile computer or movement
Computer.In other words, mobile phone is associated with just monitored user, and different users is obtaining and for example wearing
The relevant information of the current performance of the user (such as baby or diabeticss) for wearing capturing movement element.
Fig. 1 D shows the data flow diagram of the one embodiment corresponding to the system.As illustrated, from many inhomogeneities
Multi-motion capture element 111 on the equipment 110 of type or being associated with user 150 sends motion capture data, its example
Medicated clothing, the helmet, headband, ball cap, any other position for facing on or with user coupling such as are in.Equipment or user can
Selection of land has identifier 191, its allow system numerical value with motion be associated, that is, lifting weight, be currently in use
The type of racket, the type (namely game console) of electronic equipment being currently in use or other objects, such as with
The associated baby's nightwear of two users 152 (such as baby).In one or more embodiments, capturing movement element can be used
111 substitute or strengthen the element 191 of in figure, as those skilled in the art will appreciate.One in the system
Or in more embodiments, mobile computer 101 is for example with event form and for example on the basis of event or by moving
Motion capture data is received during the request of computer 101, this is, for example, have data and reception in the statement of capturing movement element 111
Device opens set time amount with after replying and asking so as to avoid wasting electric power, without request is received, then connecing
Receive device and close a period of time.Once data are in mobile computer 101, then data are analyzed, for example to obtain not
Treated or based on event motion capture data, and for example determine easily according to simple and clear mode and understood by people
The project such as such as average speed.The data can be stored (illustrating on the right side of mobile computer 101), and subsequently may be used
In the form of for example according to human observer or compliance word or Email or with mobile computer 101 or computer 105
To user 150 or 151 video datas on associated display.This just potentially allows for not being associated simultaneously with capturing movement element
And alternatively the user that is not even associated with mobile computer obtains human observer message (for example baby slowly breathes), or
Person for example watches virtual reality match or performs, and can wherein include currently providing the user of motion capture data, have
The user of previously stored data, or after the motion in the video of (many) tour performance to the past is analyzed
Also include historical movement person (such as famous golfer) etc..Currently for example obtain from user 150 or equipment 110 wherein
In the game scenario of data, such as the data display on virtual reality glasses can be utilized from the user/equipment or another
The past data of one user/equipment, to respond to the current motion data of user, that is to say, that according to the input of user
Respond.Previous data can be stored at any position in system, for example, be stored in mobile computer 101, meter
In calculation machine 105 or it is stored on server or data base 172 (referring to Fig. 1).Previous data can for example be utilized to
User 151 shows that user 150 has gone through certain number of potential cerebral concussion event, it is therefore necessary to treat special time amount
Can have a return match.Insurance company can for example require such compliance to reduce medical expense.Can be from mobile computer
101st, computer 105 or on the server or store and take in the data base for coupling with server 172 as shown in fig. 1
Video is returned so as to event video is formed, the event video for example includes over the display while the event data that illustrates and event
Video, which is generally for example applied or shows in the separate part of the display of mobile computer 101 or computer 105
Go out.
Fig. 2A shows the placing device based on helmet 110a of the head 150a around user, the wherein peace based on the helmet
Put device to be fixed on the rear section of the helmet capturing movement sensor 111 as shown in figure.Fig. 2 B is shown in the helmet
The bottom rear placing device based on neck insert shown partially, its permission is reequiped existing using capturing movement sensor 111
The helmet.Attached including to be configured to couple with the head 150a of user or being worn on user's head 150a by other means
In the embodiment of at least one near capturing movement sensor, the microcontroller can be configured to calculate in user's head
Impingement position.The calculating of the impingement position in user's head be based on user's head and/or helmet physical geometry.Citing
For, if capturing movement element 111 shows the backward acceleration (as shown in the right side) without rotation, can lead to
Cross tracking acceleration vector return to the circumference of the helmet or user's head outside direction calculating impingement position.This is non-rotating
Calculate and actually show that the line of force, near the center of gravity of user's head/helmet or its, otherwise can be observed by capturing movement element 111
To revolving force.If observing lateral vector at capturing movement element 111, rum point is calculated as being in the helmet/head
Side and through center of gravity.Thus, for example at least within the time period near acceleration peak value or in any other time
Any other shock for not applying rotary acceleration to capturing movement sensor during section can be considered as being applied in
On the direction for going to the helmet/head of center of gravity.Therefore, the calculating of rum point is calculated as detecting to the vector of power
The intersection point of the outer perimeter of the helmet/head, and rum point is extended through by calculating the distance that goes back from center of gravity and angle to returning.
For example, if acceleration does not rotate in 45 degree and not, rum point be from the center of gravity of the helmet/head to returning 45
Degree, therefore (radius (or 5 inches) of the helmet is multiplied by approximate 0.7) to the sine of calculating 45, so as to obtain apart from helmet front about
3.5 inches of shock.Or, impingement position can be maintained in angle form, so as to show shock be in apart from the helmet/
45 degree of head front.If conversely, observing the rotary acceleration without linear acceleration, the helmet/head surrounds sensor
Rotation.In this case, the power needed for rotation brain in front of the center of gravity through and generally be defined as through center of gravity and
The line of sensor is orthogonal (such as side impact), will otherwise observe linear conversion acceleration.In this case, position is clashed into
It is placed in the side relative with acceleration direction for being at the helmet/head.Therefore, for the both calculating of impingement position being can
The example of the simplified calculation method to be utilized, but can also utilize in view of the quality of head/helmet and head/helmet
Any other vector based method of size.A kind of such algorithm can utilize any mathematical equation, such as F=m*a,
It is exactly that power is multiplied by acceleration, and moment of torsion=rXF equal to quality, wherein r is the position arrow of the lateral part office of head/helmet
Amount, X are cross products and F is force vector, to calculate force vector, and are transformed back to the outer of the helmet/head if desired
Circumference is to calculate the force vector being applied at the position.Although it is described with regard to the helmet, at least one motion
The other embodiment of capture sensor is configured to any kind of placing device, encapsulation or coupling mechanism and medicated cap
Or ball cap is coupled, is coupling in protectiveness facing.Can be for medicated cap/ball cap/facing using similar calculating, so as to from for example
May indicate that the acceleration of cerebral concussion dependent event or any other quantity to determine the position/orientation of shock, linear or rotation
Turn power.Some embodiments can include with least one capturing movement sensor or with the microcontroller for for example illustrating in figure ia
The temperature sensor of device coupling.Temperature sensor can by individually with or with capturing movement elements combine, so as to for example
Determine whether body or head shake, that is, show hypothermia, or determine whether movement is not detected by, and
For example show body or brain higher than showing wirelessly or by the temperature of the temperature sensor measurement based on line
The threshold value of heatstroke.
Embodiments of the invention can also using the isolator being configured to around at least one capturing movement element so as to
Approximately about the physics acceleration damping of the cerebrospinal fluid of user's brain, so as to minimize linear acceleration and the rotation of event data
The conversion of rotational acceleration, to obtain observation linear acceleration and the observation rotary acceleration of user's brain.Therefore, some enforcements
Example need not be the power from the acceleration based on the helmet or acceleration value or any other numerical transformation to being observed
Brain acceleration value, therefore embodiments of the invention are using less electric power and storage providing the data specific to event,
So as to minimize the quantity of data transfer again, so as to cause lower delivering power to utilize.Based on the inherent liner in the helmet
Type, can utilize different isolators on rugby/athletic helmet of ice hockey/lacrosse.Do not wear wherein
The other embodiment for being utilized in the sports for helmeting or wearing once in a while the helmet can also utilize (example on ball cap or medicated cap
As baseball player medicated cap on) at least one capturing movement sensor, together with least one for being placed on batting helmet
Sensor.Not utilized in the sports (such as Association football) of ball cap wherein headband placing device can also be utilized come same
Determine cerebral concussion.In one or more embodiments, head can be remained attached in a package using the isolator on the helmet
Helmet, and sensor can be removed and be placed on another of isolator equipment of the damping for not utilizing coupling user's brain liquid
On.Some embodiments can be based on the characteristic fortune being associated with certain types of equipment (namely surfboard is compared to baseball bat)
Dynamic model formula automatic detection type of sports, and determine the type of the current accompanying equipment for arriving of capturing movement sensor.At one
Or in more embodiments, a kind of algorithm that can be utilized to calculate the physical characteristics of isolator can include a motion to catch
Obtain sensor to be placed on the helmet, and a capturing movement sensor is placed in the head dummy in crash tests manikin head
In, the capturing movement sensor in its mesocrania is encapsulated in isolator.By applying linear and rotary acceleration to the helmet,
And for example obtained by helmet sensor and by head dummy to observe with regard to the sensor in the corpse head that is placed in the helmet
In the numerical value that observes of sensor in difference, it is possible to obtain be most closely matched mankind's brain damping with most
The separator materials of good coupling damping values.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, illustrated therein is the outside of capturing movement sensor and the helmet
Isolator between part.Embodiments of the invention may be configured to obtain/calculate linear acceleration numerical value or spin up
Number of degrees value or all the two.This allows for monitoring rotational event for cerebral concussion and linear acceleration.As illustrated, outer
Portion acceleration G1 can apply the lower acceleration that acceleration is more associated for being observed with mankind's brain, that is, pass through
Using the G2 on the sensor 111 of the isolator 111c in sensor placing device 111b.This allow for for cerebral concussion and
Linear acceleration is monitoring rotational event.Other events can using linear and/or rotary acceleration and/or speed, for example with
Pattern or template are compared, so as to not only switch sensor individual character during event dynamically to change capture characteristic, and
And also characterize the type of the equipment for utilizing together with current capturing movement sensor.This allows for the single by user
Capturing movement element is bought and causes more than one piece equipment or medicated clothing tool, and this is caught by the sensor by allowing sensor to be based on
The comparison of the motion for obtaining and characterizable motion pattern or template automatically determines the type of the equipment is coupled to by the sensor or medicated clothing.
Fig. 4 A shows the top-sectional view of the capturing movement element 111 being placed on helmet 110a, the helmet 110a
Have around the skull 401 of user and the liner 110a1 of brain 402.Fig. 4 B is shown corresponding to each element for illustrating in Fig. 4
Rotation cerebral concussion event.As illustrated, different acceleration value may be applied in center of gravity 403 and by the helmet
On the mankind's brain 402 and skull 401 that liner 110a1 in 110a is surrounded.As illustrated, in order to move in unit interval
Dynamic, the front portion of brain must with speed G2a acceleration, speed G2a higher than the rear lateral portion office of brain speed G2c or
Speed G2b of person center of gravity.Therefore, for given rotary acceleration numerical value, the zones of different of brain may be subject to different
Impact.Therefore, one or more embodiments of the present invention can be transmitted not only relevant with linear acceleration but also be added with rotation
The relevant information of speed.
Fig. 5 shows input power G1 (as shown being 500g) for the helmet with respect to the power for observing in brain
G2, which is observed and be confirmed using known head dummy acceleration measurement system by the sensor being placed in isolator.
Top-right curve illustrates head dummy system known to two kinds and confirms is caught based on the motion of isolator by illustrated in Fig. 4 A
The acceleration value observed by the accelerometer that element 111 lays is obtained with regard to head dummy.
Fig. 6 shows the rotary acceleration numerical value of 3 axles together with total rotating vector quantity, together with obtaining from camera and
The video of the cerebral concussion event for showing together with motion event data.In one or more embodiments, can for rotation (such as
Figure shown in) or linear numerical shows the acceleration value from given sensor, this be, for example, by twice percussion mobile device
Screen or by any other mode.Embodiments of the invention can utilize connectionless broadcast message to transmit and event phase
The event data of association.In one or more embodiments, depending on the radio communication for being adopted, broadcast can include tool
There is the payload of the data of limited quantity, which can be utilized to avoid shaking hands and expense based on the agreement for connecting.At which
In his embodiment, can be according to combination in any come using connectionless or based on connection agreement.In this way, referee can
To obtain the close instant reading of potential cerebral concussion dependent event on the mobile apparatus, so as to allow referee quickly to obtain
Medical assist.
In one or more embodiments, computer can access the previously stored event being associated with user or equipment
Data or motion analysiss data, so as to for example determine cerebral concussion fall down or other hit or any other motion event number
Mesh.Some embodiments can also assume the event data being associated with least one user over the display, this be based on
The associated event data of the user or equipment or motion analysiss data and with the user or equipment or with least one
The associated previously stored event data of position other users or other equipments or motion analysiss data.This allow in number or
In terms of quantitative value, motion event is compared, such as by the user or other users in particular game or in history
On the maximum rotary acceleration that observes.Additionally, definition corresponding to typical event project equipment characterizable motion pattern or
Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments
In dynamicallyd update in capturing movement sensor by wave point.This allows for sensor to improve over time.Therefore, scheme
Display shown in 6 could also indicate that the number of the cerebral concussion for being stored previously for given boxer/athlete, and permit
Perhaps referee/doctor is maked decision with regard to whether the athlete can keep the field.
Embodiments of the invention can for example by radio and television or the Internet transmit information so as to computer or remote
Shown on the visual displayss of journey computer coupling.Therefore, the display in Fig. 6 can also be for example to the spectators for watching
Illustrate, to show to be applied to the quantity of the power with boxer/athlete/jockey etc..
Fig. 7 shows that the timeline of user shows 2601 together with the event being shown as along timeline along timeline
Peak value and minimum angular velocity.Additionally, the curve shown in showing in bottom illustrates the advanced of golf clubs 2602
With delayed (lead and lag) together with the sagging of golf clubs and drift (droop and drift), wherein these numerical value
Determine degree of crook of the shaft of golf clubs in two axles that marks and draws with respect to the time.Figure 8 illustrates one to show
Show embodiment, on described display, be wherein labelled with timeline and the motion-related event (maximal rate that hits) of simplification.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, its allow with will be rolled to, be played to or from
The associated start stop time point 802a-d in the subevent played at this (the meta during subevent for namely illustrating in Fig. 7
Put) neighbouring input, so as to easily allow to watch subevent.For example, golf is hit can include for example to take aim at
Accurate (address), the subevent brandishing backward, brandish forward, impact, keeping posture (follow through) etc.Described
System can show the time location corresponding to subevent 802a-d and receive the user input near the position, so as to sound
Photopic vision frequency should start at the time point or stop, or is for example rolled to or returns to the time point to be easy to watch sub- thing
Part.User input unit 801 can be utilized to the time be drawn near subevent, so as to for example video location in institute
Desired time point.Another subevent time of such as statement alternatively or in combination, when video is played
The user input of the finger pressing near point may indicate that video should stop at next subevent time point.User interface
Control-towing point can also be utilized to, so as to video be more exactly synchronous to wherein to occur specific subevent or
The frame of event.For example, user can pin control key and point 802b is pulled to the left or to the right, so as to frame of video
The speed for being fitted on club head is zero point actual time, for example video to be closely synchronized to shown reality
Motion analysiss data, here hit speed in terms of miles per hour.In the case of the spirit of the present invention is met, Ke Yili
With any other user gesture user's frame synchronization to motion analysiss data, such as Voice command, arrow key etc..
Fig. 9 show subevent 802a and 802b start along timeline and the relative position that stops and with starting and stop
The gravitation that only time correlation joins, which allows the user input near these points to be attracted to starting and dwell time.For example,
When along timeline or so towing user interface elements 801, the user interface elements can be shown as towards potential trap
802a and 802b movement, so that user interface elements are easier to move to the start stop point of subevent.
In one or more embodiments, the computer is further configured to please from least one camera of proximal event
Ask at least piece image comprising event or video.This can include from specific neighbouring camera or point to event direction
The broadcast of camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour
Nearly event or be directed to viewing event camera position request, and optionally for holding around events of interest
The available camera of continuous time showing or the video at this.In one or more embodiments, the computer also by
The list of one or more times of display event generation is configured to, desired so as to allow user to obtain by the computer
Event video, and/or independently ask video from the third party with desired event time.The computer is also
Video can be obtained from server 172, and locally video is being trimmed to desired event.This can be utilized to obtain
Third party's video and the video from the system that still can not communicate with server 172 with the computer direct interface.
Figure 10 is shown by the use of a mobile device 102b as capturing movement element 111a and another mobile device
102a is used as the reception motion event data of first user event and one embodiment of the computer of video.From mobile device
The view of 102a is illustrated in the upper left of the figure.In one or more embodiments, at least one capturing movement sensing
Device is coupled with mobile device, and the internal motion sensor for being for example used in coupling in mobile device or with mobile device
111a.This allows for minimum level hardware using generally existing to carry out capturing movement and event recognition, such as using having
The mobile device of built-in accelerometer.In one or more embodiments, the first mobile device 102b can be with record motion number
According to user couple (which is shown here as carrying out Halfpipe), the second mobile device 102a be then utilized to record
The video of motion.In one or more embodiments, the user for experiencing motion can provide gesture, such as in mobile device
Upper percussion n times, the mobile device so as to show second user should start recording video or stop recording video.Can utilize and appoint
What his gesture transmits the instruction that event is related or motion is related between mobile device.
Therefore, embodiments of the invention can recognize any kind of motion event, including with show to stand, OK
Walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or breathing no more or which
The relevant event of moving of combination in any, or the event of any other type of the persistent period for moving with period.
Event can also for example include with known signature or mate any kind of mould by other means with any granularity
Plate or the subevent of pattern, including the amplitude in the linear or specific collection of rotary shaft and/or time threshold.Citing comes
Say, show that slide plate is released a series of event of (push-off) or promotions and can be grouped into the son for for example " preparing manipulation " etc
In event, and the rotary shaft in X then for example may indicate that " slide plate is turned over/rolled ".In one or more embodiments, event can be by
Packet and storage/transmission.
Figure 11 shows the one embodiment for the memorizer for being utilized to data storage.Memorizer 4601 can for example be collected
Become the microcontroller in capturing movement element 111, or can be for example as single memory chip and microcontroller coupling
Close.Memorizer 4601 as depicted may be configured to include one or more storage buffers 4610,4611 and respectively
4620、4621.The one embodiment for the storage buffer that can be utilized is circular buffer.Circular buffer can be by reality
Apply into and repeatedly override, till event occurs.The length of circular buffer can be from 0 to N number of memory cell.For example
There can be M circular buffer, for example, correspond to M impact event.Digital M may be greater than zero any numeral.At one
Or in more embodiments, digital M can be equal to or more than the number of expected event, such as number of hits, or take turns corresponding to one high
The batting number of golf ball match, or allow all motion capture datas to be stored on capturing movement element until at one or
Any other number of mobile computer or the Internet is downloaded to after more events.In one embodiment, for example claimed
Make the head of the pointers track buffer of head pointer (HEAD).As data are recorded in a buffer, head pointer is by reach
Dynamic appropriate quantity, so as to point to next free storage unit.When the buffers get full, pointer unrolls opening to buffer
Head, and override when previous numerical value is run into.Although data are written, but are depending on size and the record of buffer
Speed, at any time (t) have from the time (t) to return record sensing data.As sensor is remembered in a buffer
Record data, " event " in one or more embodiments stops overriding buffer with new data.When event is detected, sensing
Device can continue record data in the second buffer 4611, for example to record special time amount under specific capture speed
Event after data, so as to complete the record of expected film.Storage buffer 4610 includes now from event to the institute's phase that returns
The data record of the time quantum (this is depending on size and the capture speed of buffer) of prestige, together with event posterior bumper 4611
Data after event.For example, see Figure 19, video can also be stored in a comparable manner and is trimmed to about later.
For example in golf is hit, event can be club head and ball impact.Or, event can be club head
Portion makes impact with the ground, consequently, it is possible to causing error event.In other embodiments, event can be shown that cerebral concussion event
User's head acceleration, or from weapon-shooting, or ball impact baseball bat, or when user moves to highest weight
When putting and put down carrying out another repetition.Event anterior bumper stores the sensing data till crash, thing
Sensing data after part posterior bumper storage crash.One or more embodiments of microcontroller are configured to analysis
Event, and determine that event repeats, shoots or the event of such as impact or mistake impact etc.If event is according to pattern
Or signature or template are considered validity event (referring to Figure 13 and 15) rather than error event, then by another storage buffer
4620 are used for motion capture data, till it there is second event.After the event occurs, captured data are utilized
Filling event posterior bumper 4621.
Specifically, capturing movement element 111 may be implemented such that one or more MEMs sensors.The sensor can
To be command by collecting data with specified time interval.In each interval, data are read from various MEMs equipment and store
In circular buffer.The number value set for reading from MEMs sensor is considered a frame (FRAME) data.Depending on just by
The type of the data being collected and stored in buffer, frame data can be 0,1 or multiple memory cells.One
Frame data are also associated with a time interval.Therefore, based on the capture speed from sensor, each frame also with time quantum phase
Association.For example, if with each frame of 2ms interval filling, 1000 frames will include the data (2 seconds) of 2000ms.General next
Say, frame need not be joined with time correlation.
Data constantly can be stored in circular buffer, and for example in specified event, time or when logical
Cross radio device/antenna go to mobile device or any other computer or memorizer communication available when or work as example
As by when mobile device order (namely " poll ") or in any other desired event, data are written out to non-
Volatile memory, or by wirelessly or non-wirelessly linking or being sent to remote memory by radio device/antenna
Or equipment.
Figure 12 shows especially to be programmed in microcontroller and will transmit for application-specific to determine whether there occurs
Event function one embodiment flow chart, the event is, for example, expected event or is, for example, the thing that has occurred and that
Part.Motion, acceleration or the shock wave for occurring from the shock for physical education facilities is sent to the sensing capturing movement element
Device, the sensor records motion capture data as described in Figure 11 above.The microcontroller is configured
Become with event described in post analysis, and determine the event whether expected event.
The a type of event for being occurred is acceleration, or the sensor based on the head/helmet/ball cap/toilet article is super
Go out the linear or rotation numerical that specifies, or shock of the face when golf is clashed into.Using ball and impact tool
Application identical analysis in other sports, but the analysis is adjusted to specific sports and physical education facilities.?
In tennis, it is contemplated that impact can be for example that racket is hit a ball, rather than racket is rotated before receiving.In such as running shoes etc
Other application in, clash into detection algorithm can detect that when someone runs footwear hit ground.In exercise, which can be
The special exercise that is reaching, this is with regard to for example allowing in weight lifting or number of repetition being counted while ride stationary bicycle
Number.
In one or more embodiments of the present invention, process and start from 4701.At 4702, microcontroller is specific
In collision time framework, the motion capture data in memorizer 4610 is compared with the linear speed for exceeding specific threshold, and
And wherein there is the discontinuity threshold value higher than the suddenly change in the speed of specific threshold or acceleration in search at 4703.Such as
There is no speed or the discontinuity in such as acceleration in fruit in defined time window, then process and continue at 4702
Continuous.If discontinuity occurs really, at 4704, expected shock is preserved in memory, and data after clashing into are protected
Deposit given time P.For example, if clashing into threshold value to be set to 12G, discontinuity threshold value is set to 6G, and hits
It is 10 frames to hit time frame, then the 12G acceleration at least one axle for detecting 10 frame ins or all axles and subsequent
After the discontinuity of 6G, the signal of microcontroller 3802 shows to clash into.In typical event, acceleration sets up characteristic acceleration
Write music line.Clash into the quick change being expressed as in acceleration/speed.These changes are typically different than passing by specific non-event
The smoothed curve created by increasing or decline curve.For the event based on cerebral concussion, the linear or rotation in one or more axles
Acceleration exceeds certain threshold value.For the event of golf correlation, if accelerating curve is hit with regard to golf,
Specific axle has a specific acceleration for meeting signature, template or other patterns, and hit that ball causes to show to hit larger
Acceleration spike.If the given template of Data Matching, which is saved, and continues if it does not match, processing and returning at 4702.
If determining at 4705 to preserve data outside, that is to say, that there is the communication linkage for going to mobile device, and for example
Mobile device just in poll or has requested that shock data when that occurs, then at 4706, event transmission is deposited to outside
Reservoir or mobile device or will be stored in outside which at any other position, and process and continue at 4702 again, wherein
Microcontroller is for the collected motion capture data of successor analysis.If data will not be preserved outside, process
Continue at 4702, and be held locally within data are clashed in memorizer 4601.If being sent to outside, other motions are caught
The equipment of obtaining can also preserve its exercise data for the event for being detected by another sensor.This for example allows for more smart
The other sensors that thin resolution or the sensor alert that more does more physical exercises are associated with user or equipment preserve event, even if fortune
Dynamic capture data do not reach specific threshold or pattern (for example, see Figure 15).Such process provides more robust
Event detection, this is because multiple sensors can be utilized detecting certain types of event, and notify for various originals
Because the other sensors of event schema may be mismatched.Additionally, camera can be informed that and prune or by its other party
Formula abandons unwanted video and preserves the video of event correlation, such that it is able to reduce the event of being not only and also video
Memorizer is utilized.In one or more embodiments of the present invention, noise can be filtered from motion capture data before transmitting,
And sample rate can be changed based on the value data for being obtained, to maximize accuracy.For example, some sensors exist
Inaccurate data are exported under high sampling rate and high gravity.Therefore, by declining low sampling rate in high gravity, accuracy is protected
Hold.In one or more embodiments of the present invention, the microcontroller being associated with capturing movement element 111 can sense Gao Chong
Power and the sample rate that automatically switches.In one or more embodiments, replace using with 6G/12G/24 scope or 2G/4G/
The accelerometer of 8G/16G scope, it is possible to use the accelerometer with 2 scopes (such as 2G and 24G) is to simplify at each
The logic for switching between scope.
One or more embodiments of the present invention can be event transmission to mobile device, and/or for example for one
Take turns golf range game or continue event to store in memory till realizing mobile device communication link.
For example for the sensor being placed in specific placing device, typical Event Signing is figure 13 illustrates,
Additionally referring to by two kinds of characteristics shown by for example associated from different equipments or medicated clothing pattern or template in Figure 15
The comparison of type of sports.In one or more embodiments, microcontroller is configured to execution pattern matching algorithm to follow
Corresponding to the curve of each axle, and using 1 or more multiaxis fragment come determine linear or rotary acceleration or its
Whether there occurs in combination in any that characteristic is hit.If the motion capture data in memorizer 4601 be in shown in Figure 13
In the close enough scope of numerical value that typical case hits, then move consistent with event.Therefore, characterize first mobile angle and/
Or after linear speed signature, and usually determine whether to there occurs the class corresponding to future event followed by the unit of the signature
Like signing, embodiments of the invention reduce the number of the false positive in event detection.
Capturing movement element is from each sensor collection data.Data capture speed can be higher, and if so
If, then to capture mass data.Depending on concrete application, embodiments of the invention can use lossless and Lossy Compression Algorithm
The data that comes on storage sensor.Compression algorithm allows capturing movement element in given resource IT more data.Transmission
To (multiple stage) remote computer is also compressed data.The transmission of compressed data is faster.Compressed data is also stored on
In " high in the clouds " in the Internet, or it is stored on data base, so as to locally take less space.
Figure 14 shows one embodiment of capturing movement element 111, and which is configured with locally displayed and viewing thing
The optional LED visual detector 1401 of part relevant information, and the word or encoded for being display configured to be associated with event
The optional LCD 1402 of message.In one or more embodiments, the LED visual detector can be for the brain of moderate type
Concussion slow flash yellow, and the cerebral concussion quick flashing redness for severe form, so as in the case of without the need for any radio communication
Provide the quick overview with regard to event.Additionally, LED can show some flashes of light or other colors, to show any temperature phase
Pass event or other events.One or more embodiments can also adopt LCD 1402, and which can for example illustrate word or replace
Can show that the encoded messages corresponding to sensitive health related information, referee or medical professional are for example permissible with changing
Using the appropriate reader application on mobile device, which is read out and decodes.In the lower right-most portion of the figure, LCD shows
Device can produce the encoded of statement " 1500 degree/s/s of potential cerebral concussion rotational event detection-alert medical professional immediately "
Message.The message of other paralysis diagnostic messages or any other possibly sensitive type can be encoded and locally be shown
Showing, user/athlete/boxer is succoured without disappearing due to diagnosis so as to for example allow medical professional to immediately begin to
Breath startles other athletes, or without the need for wirelessly transmitting the message in the air to avoid intercepting.
Figure 15 shows the template properties of the motion event being associated with different types of equipment and/or tool medicated clothing
One embodiment, can change more accurately or more efficiently to capture together with wherein capturing movement sensor individual character
The region of the data being associated with special time period and/or subevent.As illustrated, showing in acceleration plots 1501
Characteristic corresponding to slide plate releases (push off), shows X, Y and z axis in the curve chart 6 timelines up
Property acceleration and rotary acceleration numerical value, the wherein time goes forward one by one to the right.As illustrated, when user promotes slide plate by each step
When, the discrete positive x-axis acceleration for being captured is shown at 1502 and 1503, is followed by promoting it each time with tail skid
Between slack-off negative acceleration.Additionally, each time promote during y-axis swing also be captured to, and slide plate release or drive
Change without z-axis linear acceleration in the specific template or pattern and without rotary acceleration.Or, the pattern is permissible
Including one group of threshold acceleration in the x at predefined time window and corresponding to other threshold values or not right for swinging
Wherein for example the data for being captured should be compared therewith in the threshold value for swinging, to automatically determine capturing movement element quilt
The type of the equipment that equipment that be placed to or known is currently experiencing.This for example allow based on event data preserve and
Transmission.
But pattern or template in curve chart 1511 show running event, wherein user during running event slightly
Accelerate up and down.Due to the speed relative constancy of user, in x, acceleration is therefore relatively free of, and as user does not turn,
Therefore in y, (left/right) is relatively free of acceleration.The pattern can for example be utilized to carry out in the range of corresponding to running
Relatively, wherein the pattern includes the z-axis acceleration in time predefined window.Therefore, top in the middle of curve chart 1511
Three curve charts can be utilized as the pattern in order to labelling running event.Three curve charts of lower section can be in 1514 Hes
Illustrate at 1515 and show when capturing movement element is placed in the helmet and/or facing user to being captured of watching of both sides
Data, and the data 1516 for being captured then may indicate that and be observed by the rotary motion of per square of second sufficiently high angle number
Moderate or severe cerebral concussion.Furthermore, it is possible to sensor individual character is dynamically changed at 1516 or at any other threshold value,
For example to change capture speed or the capture bit size of capturing movement sensor, so as to more accurate in amplitude or in terms of the time
True ground capturing events.This allows for dynamically changing capture quality for the period interested and/or dynamically changes work(
Rate is utilized, and this is unknown in the art.In one or more embodiments, for example, the helmet, facing is placed in for utilizing
The embodiments of the invention of the temperature sensor in interior or any other equipment or in user's body, can also record temperature
Timeline.
Figure 16 shows the front view of one embodiment of protectiveness facing 1601 and shows top in the bottom of in figure
View, which is for example worn in any contact sports, such as (and being not limited to) Association football, boxing, rugby,
Wrestling or any other sports.The embodiment of facing can be worn to supplement with or without capturing movement element
Any other head wear, to increase the motion capture data that is associated with user, and being worn from user
The exercise data of any or all capturing movement element and/or event are carried out correlation or are combined by any other mode
Or compare.The embodiment of facing and/or the helmet in shown in Fig. 2A-B or any other equipment can also for example be wrapped
Temperature sensor is included, as previously discussed.
Figure 17 shows the one embodiment for the algorithm for being utilized by any computer in Fig. 1, and which is configured in combination
Show moving image and motion capture data in form.In one or more embodiments, motion capture data and anything
The start stop time of part correlation can be stored on capturing movement element 111.One or more embodiment bags of the present invention
A kind of identification of motion event and video synchronizing system is included, which includes the shifting for being configured to couple with user or equipment or with user
At least one capturing movement element that dynamic equipment is coupled.At least one capturing movement element can include:Memorizer;Quilt
Be configured to capture the numerical value that be associated with the sensing of at least one capturing movement element, position, speed and acceleration times
The sensor of meaning combination;Radio device;The microcontroller for coupling with memorizer, sensor and radio device.The micro-control
Device processed may be configured to collect the data including the sensor values from sensor, store data in memorizer, right
Data are analyzed and pick out the event in data to determine event data, by radio device transmission and event phase
The event data of association.The system can also include mobile device, and the mobile device includes computer, is configured to and nothing
Line electric installation communicates to obtain the wireless communication interface of event data being associated with event, wherein the computer and
Wireless communication interface is coupled, and wherein the computer is configured to from wireless communication interface receiving event data.The computer
Event data can also be analyzed to form motion analysiss data, storage event data or motion analysiss data or event data and
Motion analysiss data all the two, obtain event initial time and event dwell time from event, from camera request include to
Few from event initial time to the view data of the video for being captured during the time span of event dwell time, and aobvious
Show on device and show event video, including all following two:From event initial time to the time of event dwell time
Institute's event data, motion analysiss data or its combination in any during span;And from event initial time to thing
The video for being captured during the time span of part dwell time.
When communication channel is available, start stop time of motion capture data and any event correlation is at 1701
Be pushed to any computer (such as 101,102,102a, 102b, 105), or obtained by any computer or by its
He receives mode.The timing differential between the clock on sensor and/or in the motion capture data time can also be obtained.This can
With by the current time stamp in reading incoming message and the incoming message time is current with the clock of local computer
Time is compared to implement, for synchronous more details for example referring further to Figure 18.From sensor and the clock of computer
In difference can be utilized at 1702 from any local or for consider any timing differential and through overregulating
Time points to the camera request view data of event location.For example, computer can be by inquiring about all cameras
103rd, 104 or equipment 101,102 and/or the camera on 102a asking the image for shooting at the time/position, its
In any or all described equipment have the image (such as based on GPS location or wireless range) for nearby shooting and/or
Point to the event for being derived from capturing movement element 111.If equipment is not located at nearby but is directed to the position of event, join as working as
Pass through when having magnetometer determined by its position and sensing like that, then which can also be by the figure corresponding to the time range
As responding.Be able to can be queried by any kind of camera for electronically being communicated, including
Nurse's photographic head etc..For example, the thing from capturing movement sensor 111 can received by mobile computer 101
Message is sent after part, and the wherein message can be sent to for instance in appointing in the wireless range of mobile computer 101
What camera.Alternatively or in combination, mobile computer 101 can send solicit in event location predefined away from
From interior any photography identity, even if or inquiry sensing event direction any camera being not relatively close to.?
Receive potential camera list when, mobile device 101 can for example to its inquiry around event predefined window in
Any image for obtaining.At 1703, computer can receive view data, or if computer is coupled with camera
Then local, image can be searched.In one or more embodiments, server 172 can with iteration through video and event so as to
Determine any correlation video and event, and automatically prune video so as to corresponding to event starting and dwell time lasting when
Between.Although radio communication can be utilized, the view data transmission of any other form also complies with the spirit of the present invention.No matter
It is in numeral or figure coating form or can including the data from event in any other form of word
Be illustrated together with the respective image corresponding to the time, or the respective image corresponding to the time is added at 1704
On.This is illustrated by graphics mode at time 1710 (i.e. current time) place, and which is for the capturing movement for illustrating with superposition
The image 1711 of one frame of the motion event of data 1712 is e.g. rotatable.For data that are combination or being no superimposed simultaneously
For example, see Fig. 6.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the present invention.One
The clock that a little embodiments can be come in synchronization system using any kind of synchronous method, and in one or more embodiments
In, the computer 160 on mobile device 101 is further configured to determine the clock between capturing movement element 111 and mobile device
Difference, and motion analysiss data and audio video synchronization.For example, one or more embodiments of the present invention are provided for making
The code of the information of multiple stage recording equipment synchronous time, position or sensing with regard to each equipment is obtained, is come such that it is able to combine
From distinct device with regard to event recorded data.Such recording equipment can be embedded type sensor, with camera
Or the mobile phone of mike, or more generally it is can to record to set to movable related any of data interested
Standby.In one or more embodiments, this is synchronously realized by exchanging information between devices, so that each
Equipment can be reached an agreement in terms of the common measurement for time, position or sensing.For example, mobile phone and embedded
Sensor for example can wirelessly exchange the message of the current time stamp with its internal clocking across link 1802;
These message allow to consult, and wherein two equipment are reached an agreement in terms of common time.Such message can be according to need
Periodically to exchange, so as to solve previous subsynchronous after the clock drift of equipment or motion.In other embodiments, many
Platform recording equipment can obtain the standardization degree of time, position or sensing using common server or server set 1801
Amount.For example, equipment can obtain the absolute location information corresponding to each equipment using GPS system.GPS system is also
Can be used to obtain normalized temporal.NTP (NTP) server is also used as normalized temporal server.
Individual device is allowed to reach an agreement in terms of common measurement by using server, without being always configured to communicate with one another.
Figure 19 shows and detects event by one of capturing movement sensor 111, transmission event detection (here by
It is shown as other capturing movement sensings for sending from centrally located sensor 111 and going to such as mobile device 101
Device 111 and/or the arrow of camera), event motion data are preserved, and video are pruned to correspond to event.The present invention's
In one or more embodiments, some of them recording equipment is configured to detect the generation of various events of interest.Some are such
Event may occur in particular moment;Other such events may occur in interval of time, and the wherein detection includes
The starting of detecting event and the end of event.These equipment be configured to using described above corresponding to the time, position and
The synchro measure basis of sensing is recorded to the combination in any of the time, position or sensing of recording equipment, and which is for example together with thing
Number of packages evidence is included together in storage buffer 4610, or in any other data structure.
The embodiment of the computer on mobile device can be configured to discarding and fall in event initial time stop to event
At least a portion video outside only, for example event or with predefined front and rear interval 1902 and 1903 event
Before and after part 1910 and 1911.For example, in one or more embodiments of the present invention, some of them are recorded
Equipment is constantly data capture to memorizer while detecting event is waited.In order to save memorizer, some equipment are permissible
It is configured to just more permanent for data Cun Chudao only when data are in time adjacent to detected event
Ground storage medium or storage are to server 172.For example in the case of event is not detected by, the data of new record can be most
The data of precedence record are override eventually in memory, and this is depending on each equipment for recording exercise data or video data
In memorizer quantity.One kind typical case of the cyclic buffer as such overriding scheme can be realized in certain embodiments
Mode.When event detection occurs, in addition to the data for capturing during the event of being stored in itself (i.e. 1901), recording equipment can
It is terminated with a certain the configured data volume (being close to the starting in space before 1902) before the starting of storage event and event
A certain configured data volume (being close to 1903) afterwards.Any event initial time is considered as in front or posterior time interval
With a part for event dwell time so that for example illustrating the situation of event in video.This just gives feelings for event
Border, for example, can be set in the quantity of front time interval according to sports, so as to the preparation for allowing golf to hit
(setup) become a part for event video, although which occurred before the actual event of impact golf.Can also basis
It is the interval quantity record holding posture in rear interval distribution.
The embodiment of the system can also include the server computer away from mobile device, wherein server computer
It is configured to abandon at least a portion video outside event initial time to event stopping, and from event starting
Time to event dwell time time span during the video that captured return to the computer in mobile device.Server or
Mobile device can be motion analysiss data or event data (such as speed or undressed acceleration information) and video phase
To form event video 1900 in combination or the video that is added to, such that it is able to the quantity of the video storage needed for greatly reducing,
This is because the time span of part 1910 and 1911 generally may be more much bigger than event.
The embodiment of at least one capturing movement element is may be configured to event transmission at least another fortune
Dynamic capture sensor or at least another mobile device or its combination in any, and wherein described at least another motion is caught
Obtain sensor or at least another mobile device or its combination in any is configured to preserve the data being associated with the event.
For example have and meanwhile operation multiple stage recording equipment embodiment in, this kind equipment can detect event, and to
Other recording equipments send the message for showing that such event detection has occurred and that.The message can include event starting and/
Or the time labelling for stopping, wherein lock in time basis is used for the clock of individual device.Receiving device (such as other motions
Capture sensor and/or camera) can use event detection message data Cun Chudao being associated with event for instance in
Capturing movement element 111 or mobile device 101 or the Nonvolatile memory devices in server 172.Except straight with event 1901
Connect outside associated data, the equipment may be configured to the certain data volume before the starting of storage event and event knot
Certain data volume (being 1902 and 1903 respectively) after bundle.In this way, all devices can while record data, but
It is to be initiated for the distributed event data from multiple sources using the event from an only wherein equipment
Preserve.
The embodiment of the computer can be configured to preserve regarding from event initial time to event dwell time
Frequency and the motion analysiss data that occur from event initial time to event dwell time, or can using remote server come
Preserve video.In one or more embodiments of the present invention, some of them recording equipment wherein may generation event when
Between possibly all cannot directly communicate with each other all the time in section.In these cases, equipment may be configured to the institute for having recorded which
The complete documentation for having data is saved in permanent storage device or is saved in server.The number that with event be associated only is preserved
According to possibly accomplishing in these cases, this is because some equipment possibly cannot receive event-triggered message.At these
In the case of, can be processing to the data for being preserved afterwards, to extract and one or more detected events
Associated is only related part.For example, multiple stage mobile device may record the video of athlete or performing artist, and
And constantly the video is uploaded onto the server 172 to be stored.The athlete or performing artist may be individually equipped with energy
The embedded type sensor of the event of enough detection such as special exercise or action etc.Embedded type sensor data can be by constantly
Or later sometime upload to identical server.Due to including including video flowing and embedded type sensor data
All data generally all added with time labelling, the video being therefore associated with the event for being detected by embedded type sensor can
To be extracted on the server and combine.The embodiment of server or computer is can be configured to when at least one fortune
When communication linkage between dynamic capture sensor and mobile device is opened, abandon outside event initial time to event stopping
At least a portion video, and preserve from event initial time to the video of event dwell time and from event initial time
To the motion analysiss data that event dwell time occurs.Or, if communication linkage is not opened, the embodiment of the computer is also
May be configured to video is preserved, and after event being received after communication linkage is opened, subsequently abandon to fall to rising in event
Time beginning is at least a portion video outside event stopping, and preserves regarding from event initial time to event dwell time
Frequency and the motion analysiss data for occurring from event initial time to event dwell time.For example in some embodiments of the present invention
In, data can be uploaded as previously described server, and the position that is associated with the data flow of each equipment and refer to
Can be used to extract the data for detected event correlation to data.For example, a larger mobile device
Set can be used to record video at each position during whole golf tournaments.The video data can be held
Upload onto the server continuously or after tour.After tour, the sensing data with event detection can also
It is uploaded to identical server.Post processing for these various data flows can identify the physics in institute's event
Adjacent place is while the particular video stream of record.Additional filter can select wherein camera positive sense to be correctly oriented to see
Examine the video flowing of event.These streams selected can be combined with sensing data, illustrates many of event so as to be formed to have
The aggregate data flow of individual video angle.
The system can be separated from the camera for being coupled with mobile device or with mobile device or by its other party
Formula obtains video away from any camera of mobile device.In one or more embodiments, from the service away from mobile device
Device obtains video, such as obtain after the inquiry of the video at for a certain position and time interval.
The embodiment of server or computer is may be configured to by the graphical analyses synchronously video and the event
Data or the motion analysiss data, so as to more accurately determine in the video with the event initial time or institute
State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this
In one or more embodiments of invention, the clock between recording equipment can be synchronously approximate.May want to based on viewing
Improve, from the event of each equipment, the accuracy that the synchronous data from multiple stage recording equipment feed.In one or more realities
Apply in example, the process for multiple data flows is used to the signature of the event that observes in different streams, to help fine granularity same
Step.For example, can be embedded type sensor and the mobile device synchronization for including video cameras, but time synchronized may
Only it is accurate within 100 milliseconds.If video cameras are with 30 frame recording video per second, corresponding on embedded type sensor
The frame of video of event detection be based solely within lock in time labelling can only be defined in 3 frames.A reality in the equipment
Apply in example, it is possible to use video frame images process to determine the accurate frame for being most closely correspond to detected event.For
More details are referring to Fig. 8 and its description.For example, can be the cunning as shown in Figure 17 for being detected by inertial sensor
The vibrations that snow slab hits ground are related to the frame that the geometrical boundary of wherein skis and ground come in contact.Other embodiment is permissible
Other image processing techniquess for being signed using detecting event or additive method are improving the synchronization of multiple data feeding.
The embodiment of at least one capturing movement element can include that coupled with microcontroller is configured to determine
The position of position determines element, and wherein microcontroller is configured to the computer transmission position on mobile device.At one or
In more embodiments, the system also includes server, and wherein microcontroller is configured to directly or by mobile device to clothes
Business device transmits position, and its Computer or server are configured to stop based on position and event initial time and event
Time forms event video from the various pieces of video.For example, in one or more embodiments, for example can move
On any other computer for coupling on equipment 101 or on server 172 or in computer 105 or with system, event is regarded
Frequency is trimmed to the event of length-specific, and is transcoded onto any video quality, and in any manner with motion analysiss
Data or event data (such as speed or acceleration information) are superimposed or integrate therewith by other means.Video can be according to
Any resolution, depth or picture quality or compression type or any other technology in order to store video are locally deposited
Storage, to maximize memory capacity or frame per second, or using any compression type to minimize storage, but regardless of movement sets
Whether the communication linkage between standby, at least one capturing movement sensor and/or server opens.In one or more embodiments
In, speed or other motion analysiss data can for example be applied or combine a certain portion below the video by other means
On point, including event starting and dwell time, before event starting and dwell time can include actual event and/
Or any number of seconds afterwards, for example to provide the video that hits before batting event.In one or more embodiments, institute
State at least one capturing movement sensor and/or (multiple stage) mobile device can be sent to server event and video, wherein
Server can determine that particular video frequency and sensing data occur in ad-hoc location and special time, and from several videos and several
Individual Sensor Events tectonic event video.Sensor Events for example can be from the biography for coupling with user and/or equipment
Sensor or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, regard so as to for example greatly reduce
Frequency storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or
The microcontroller and computer are configured to determine the position of event and carry out correlation to position, and this is e.g. by para-position
Putting carries out correlation or the average central point to provide event, and/or can minimize from initialization GPS sensor
Erroneous position data.In this way, one group of user with mobile device can generate the video that golfer kicks off,
The event location of an at least capturing movement equipment can be wherein utilized, and wherein server can obtain video from spectators
And the event video that hits and bat of professional golfers is generated, wherein event video can be utilized from different photographies
Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one
Individual or multiple videos can be trimmed to the persistent period of event, such as from event initial time to event dwell time, and/
Or with any in front or posterior scheduled time numerical value around event, so that it is guaranteed that capture including corresponding to hitting or
Any time of other events and any holding posture time are in interior whole event.
In one or more embodiments, the computer on mobile device can be from least one camera of proximal event
At least piece image or video of the request bag containing event, this is directed to by any camera in the region by directly broadcast
The request of any video for shooting, its can alternatively include whether to be not only located at event nearby with regard to the camera but also
Point to or by other means towards the directional information of event.In other embodiments, can be by the calculating on mobile device
Machine asks video from remote server.In this case, any position being associated with event and/or time can be utilized
Come return image that is near event or shooting in the time of the event that is close to and/or video or all the two.At one or
In more embodiments, computer or server can prune video to correspond to incident duration, and similarly can profit
With the various pieces of the further synchronous event of image processing techniquess, the batting of the respective frame such as having in video, its for example with
Acceleration information corresponding to the batting on equipment matches.
The embodiment of the computer on mobile device or server may be configured to show occurred a certain event or
Wherein there is the list of one or more times of one or more events.In this way, user can be from list
Event is found so as to rapidly Access Events video.
Embodiments of the invention can include at least one capturing movement sensing for physically coupling with the mobile device
Device.These embodiments allow any kind of mobile phone with integrated sensor or camera chain (such as any types
The camera laid of the helmet or including the whole any placing device of the two of camera and capturing movement sensor) generate thing
Number of packages evidence and video data.
Although idea disclosed herein is described by specific embodiment and its application, without departing substantially from claim
In the case of the scope of the present invention for being illustrated in book, those skilled in the art can many modifications may be made and change.
Claims (31)
1. a kind of motion event is recognized and video synchronizing system, and which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to,
Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration
The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt
It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole
The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time
The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time
Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time;
And
Wherein the computer is further configured to abandon outside the event initial time to the event dwell time
The video at least partially, and store not and have outside the event initial time to the event dwell time
The event video of the part of the video.
2. the system of claim 1, wherein, the computer be further configured to determine at least one capturing movement element with
Timing differential between the mobile device, and the motion analysiss data and the audio video synchronization.
3. the system of claim 1, wherein, the computer is further configured to from the event initial time to the event
The video of dwell time and the motion analysiss for occurring to the event dwell time from the event initial time
Data are saved in the server computer outside the computer together, without falling in the event initial time to the thing
The part of the video outside part dwell time.
4. the system of claim 1, wherein, the system also includes the server computer away from the mobile device, and
Wherein the server computer is configured to from the event initial time to the video of the event dwell time
Preserve together with the motion analysiss data for occurring to the event dwell time from the event initial time, and handle
Returning from the event initial time to the video for being captured during the time span of the event dwell time
The computer in the mobile device.
5. the system of claim 1, wherein, the computer is further configured to when at least one capturing movement element and institute
When stating the communication linkage opening between mobile device, abandon outside the event initial time to the event dwell time
At least a portion video, and from the event initial time to the video of the event dwell time with from
The motion analysiss data that the event initial time occurs to the event dwell time are preserved together.
6. the system of claim 1, wherein, the computer is further configured to when at least one capturing movement element and institute
State and the video when communication linkage between mobile device is not opened, is preserved, and receive after the communication linkage is opened
After the event, subsequently abandon at least a portion institute outside the event initial time to the event dwell time
State video, and from the event initial time to the video of the event dwell time with from the event starting when
Between to the event dwell time occur the motion analysiss data preserve together.
7. the system of claim 1, wherein, the video is obtained from the camera for coupling with the mobile device.
8. the system of claim 1, wherein, the video is obtained from the camera away from the mobile device.
9. the system of claim 1, wherein, the video is obtained from the server computer away from the mobile device.
10. the system of claim 1, wherein, at least one capturing movement element is further configured to be worn on user's head
Near, and the event in the identification data includes the impingement position in calculating user's head.
The system of 11. claim 1, wherein, at least one capturing movement element be further configured to the helmet or medicated cap or
Ball cap or facing coupling.
The system of 12. claim 1, wherein, at least one capturing movement element is further configured to couple with the helmet, and
The event for recognizing in the data includes that the physical geometry based on the helmet calculates the shock position in user's head
Put.
The system of 13. claim 1, which also includes to be configured to the isolator around at least one capturing movement element,
So as to the physics acceleration damping of the cerebrospinal fluid of the brain approximately about the user, so as to minimize the event data
Linear acceleration and the conversion of rotary acceleration, the observation linear acceleration and observation to obtain user's brain spins up
Degree.
The system of 14. claim 1, wherein, the computer is further configured to by the graphical analyses synchronously video and institute
State event data or the motion analysiss data, so as to more accurately determine in the video with the event starting when
Between or the event dwell time or all the two most closely related initiation event frame or stopping event frame or whole two
Person.
The system of 15. claim 1, wherein, the system also includes server computer, wherein the server computer quilt
It is configured to by the graphical analyses synchronously video and the event data or the motion analysiss data, so as to more accurate
Ground determine in the video with the event initial time or the event dwell time or all the two is most closely related
The initiation event frame of connection or stopping event frame or all the two.
The system of 16. claim 1, wherein, the computer is further configured to:
Access the previously stored event data or motion analysiss data being associated with the user or equipment;
Wherein, the display event video is also included to be presented based on the following over the display and is associated with the user
The event data:
The event data being associated with the user or equipment or motion analysiss data;And
The described previously stored event data being associated with the user or equipment or motion analysiss data;Or
The described previously stored event data being associated with least one other users or other equipments or motion analysiss data.
The system of 17. claim 1, wherein, the microcontroller at least one capturing movement element is also configured
Become the event transmission at least another capturing movement element or at least another mobile device or its combination in any,
And wherein described at least another capturing movement element or at least another mobile device or its combination in any are joined
Being set to, the data being associated with the event are preserved based on the event initial time and the event dwell time.
The system of 18. claim 1, which also includes:
The identifier for coupling with least one capturing movement element or the user or the equipment;
Wherein, the computer is further configured to:
Receive the identifier;And
The identifier is associated with the event data and the motion analysiss data.
19. the system of claim 1, wherein, at least one capturing movement element also includes to be configured in the event
The light-emitting component of output light in the case of generation.
The system of 20. claim 1, wherein, at least one capturing movement element also includes audio output element, and which is joined
The scope being set in the case that the event occurs or at least one capturing movement element in the computer
Outside in the case of export sound, or wherein the computer is configured to be at least one capturing movement element
Display alarm in the case of outside the scope of the computer, or aforementioned every combination in any.
The system of 21. claim 1, wherein, at least one capturing movement element also includes to couple with the microcontroller
The position for being configured to determine position determine element, and wherein the microcontroller is further configured to pass to the computer
The position is sent, or wherein the system also includes server computer, and wherein the microcontroller is further configured to
The position is transmitted to the server computer, and wherein the computer or server computer are further configured to be based on
The position and the event initial time and the event dwell time from the various pieces of at least one video formed to
A few event video.
The system of 22. claim 1, wherein, the microcontroller or the computer are further configured to determine the event
Position, or wherein the microcontroller and the computer are further configured to determine the position of the event and enter position
Row is related.
The system of 23. claim 1, wherein, the computer is further configured at least one photography from the neighbouring event
Machine or from server computer request bag containing at least piece image of the event or video.
The system of 24. claim 1, wherein, the computer is further configured to broadcast and for the neighbouring event or is referred to
Always the request of the camera position of the event is watched.
The system of 25. claim 1, wherein, the computer is further configured to show that the event has occurred or wherein one
The list of one or more times that individual or more events has occurred.
The system of 26. claim 1, wherein, at least one capturing movement element is physically coupled with the mobile device.
The system of 27. claim 1, wherein, the microcontroller is coupled with temperature sensor, and the wherein microcontroller
It is further configured to transmit the temperature for being derived from temperature sensor using as temperature event.
The system of 28. claim 1, wherein, the event data includes:
The exercise data being associated with least one capturing movement element, the wherein at least one capturing movement element with
The combination in any of the user or the equipment or the mobile device is coupled;Or
Show to stand, walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or
The exercise data for breathing no more;Or
Its combination in any.
A kind of 29. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to,
Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration
The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt
It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole
The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time
The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time
Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time;
And
Away from the server computer of the mobile device, wherein, the server computer is configured to:
Obtain the part fall without the video outside the event initial time to the event dwell time
The event video, wherein do not have outside the event initial time to the event dwell time at least one
Divide the video;And
From the event initial time to regarding described in being captured during the time span of the event dwell time
Frequency returns to the computer in the mobile device.
A kind of 30. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to,
Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration
The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt
It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole
The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time
The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time
Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time;
And
When the communication linkage between at least one capturing movement element and the mobile device is opened, abandon described
Event initial time at least a portion outside event dwell time video, and from the event starting when
Between to the event dwell time the video and the institute that occurs to the event dwell time from the event initial time
State motion analysiss data to preserve together.
A kind of 31. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to,
Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration
The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt
It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole
The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time
The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time
Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time;
And
Regard described in preserving when the communication linkage between at least one capturing movement element and the mobile device is not opened
Frequently, after and receiving the event after the communication linkage is opened, subsequently abandon in the event initial time
At least a portion to outside event dwell time video, and from the event initial time to the event
The video of dwell time and the motion analysiss number for occurring to the event dwell time from the event initial time
According to preserving together.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/257,959 | 2014-04-21 | ||
US14/257,959 US9076041B2 (en) | 2010-08-26 | 2014-04-21 | Motion event recognition and video synchronization system and method |
PCT/US2015/026896 WO2015164389A1 (en) | 2014-04-21 | 2015-04-21 | Motion event recognition and video synchronization system and method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106464848A true CN106464848A (en) | 2017-02-22 |
CN106464848B CN106464848B (en) | 2019-07-02 |
Family
ID=54333090
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201580033463.0A Active CN106464848B (en) | 2014-04-21 | 2015-04-21 | Motion event identification and video synchronizing system and method |
Country Status (6)
Country | Link |
---|---|
EP (1) | EP3017598A4 (en) |
JP (1) | JP2017521017A (en) |
CN (1) | CN106464848B (en) |
AU (1) | AU2015249884B2 (en) |
CA (1) | CA2917542C (en) |
WO (1) | WO2015164389A1 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107016686A (en) * | 2017-04-05 | 2017-08-04 | 江苏德长医疗科技有限公司 | Three-dimensional gait and motion analysis system |
CN108307175A (en) * | 2018-02-08 | 2018-07-20 | 华南理工大学 | Dancing dynamic image based on flexible sensor captures and goes back original system and control method |
CN109247909A (en) * | 2017-07-12 | 2019-01-22 | 台湾安莉莎医疗器材科技股份有限公司 | Physiological monitoring system |
CN110190959A (en) * | 2019-06-28 | 2019-08-30 | 中南大学 | Encipher-decipher method based on continuous variable quantum nerve network |
CN110543861A (en) * | 2019-09-05 | 2019-12-06 | 深圳前海达闼云端智能科技有限公司 | early warning method, server and early warning system |
CN110639197A (en) * | 2019-09-27 | 2020-01-03 | 上海淡竹体育科技有限公司 | Sports test method, device and system |
CN112752100A (en) * | 2020-12-28 | 2021-05-04 | 杭州海康威视系统技术有限公司 | Method and device for determining video integrity and readable storage medium |
CN113326828A (en) * | 2021-08-03 | 2021-08-31 | 湖南涉外经济学院 | Sports tactics identification method and system |
CN113542774A (en) * | 2021-06-04 | 2021-10-22 | 北京格灵深瞳信息技术股份有限公司 | Video synchronization method and device, electronic equipment and storage medium |
US11504581B2 (en) | 2019-09-06 | 2022-11-22 | Taylor Made Golf Company, Inc. | Systems and methods for integrating measurements captured during a golf swing |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6761765B2 (en) * | 2017-02-20 | 2020-09-30 | 株式会社プロップ | Heat stroke prevention device |
EP3672233A1 (en) * | 2018-12-21 | 2020-06-24 | Axis AB | Method for carrying out a health check of cameras and a camera system |
JP7169213B2 (en) * | 2019-02-05 | 2022-11-10 | 株式会社日立製作所 | Physical health video analysis device, method and system |
US11789843B1 (en) | 2019-07-05 | 2023-10-17 | Cornerstone Research Group, Inc. | Event detection sensor and recording system |
KR102100675B1 (en) * | 2019-12-06 | 2020-05-15 | 주식회사 대산테크디자인 | Method for manufacturing golf shoe insole |
CN112291520B (en) * | 2020-10-26 | 2022-12-06 | 浙江大华技术股份有限公司 | Abnormal event identification method and device, storage medium and electronic device |
WO2023097304A1 (en) * | 2021-11-24 | 2023-06-01 | Dreamsports Technology Development (Beijing) Co., Ltd. | System and method for measuring activity performance |
CN114554114B (en) * | 2022-04-24 | 2022-08-16 | 浙江华眼视觉科技有限公司 | Express item code recognition machine pickup evidence persistence method and device |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050021292A1 (en) * | 1996-12-12 | 2005-01-27 | Vock Curtis A. | Systems and methods for determining performance data |
CN103026345A (en) * | 2010-06-02 | 2013-04-03 | 惠普发展公司,有限责任合伙企业 | Dynamic multidimensional schemas for event monitoring priority |
CN103533235A (en) * | 2013-09-17 | 2014-01-22 | 北京航空航天大学 | Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene |
CN103717994A (en) * | 2011-06-20 | 2014-04-09 | 因文森斯公司 | Motion determination |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8886298B2 (en) * | 2004-03-01 | 2014-11-11 | Microsoft Corporation | Recall device |
US20070150138A1 (en) * | 2005-12-08 | 2007-06-28 | James Plante | Memory management in event recording systems |
US8702516B2 (en) * | 2010-08-26 | 2014-04-22 | Blast Motion Inc. | Motion event recognition system and method |
WO2013184832A2 (en) * | 2012-06-07 | 2013-12-12 | Zoll Medical Corporation | Systems and methods for video capture, user feedback, reporting, adaptive parameters, and remote data access in vehicle safety monitoring |
-
2015
- 2015-04-21 CN CN201580033463.0A patent/CN106464848B/en active Active
- 2015-04-21 EP EP15782633.0A patent/EP3017598A4/en not_active Ceased
- 2015-04-21 WO PCT/US2015/026896 patent/WO2015164389A1/en active Application Filing
- 2015-04-21 AU AU2015249884A patent/AU2015249884B2/en active Active
- 2015-04-21 CA CA2917542A patent/CA2917542C/en active Active
- 2015-04-21 JP JP2017507907A patent/JP2017521017A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050021292A1 (en) * | 1996-12-12 | 2005-01-27 | Vock Curtis A. | Systems and methods for determining performance data |
CN103026345A (en) * | 2010-06-02 | 2013-04-03 | 惠普发展公司,有限责任合伙企业 | Dynamic multidimensional schemas for event monitoring priority |
CN103717994A (en) * | 2011-06-20 | 2014-04-09 | 因文森斯公司 | Motion determination |
CN103533235A (en) * | 2013-09-17 | 2014-01-22 | 北京航空航天大学 | Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107016686A (en) * | 2017-04-05 | 2017-08-04 | 江苏德长医疗科技有限公司 | Three-dimensional gait and motion analysis system |
CN109247909A (en) * | 2017-07-12 | 2019-01-22 | 台湾安莉莎医疗器材科技股份有限公司 | Physiological monitoring system |
CN108307175B (en) * | 2018-02-08 | 2020-01-14 | 华南理工大学 | Dance dynamic image capturing and restoring system based on flexible sensor and control method |
CN108307175A (en) * | 2018-02-08 | 2018-07-20 | 华南理工大学 | Dancing dynamic image based on flexible sensor captures and goes back original system and control method |
CN110190959A (en) * | 2019-06-28 | 2019-08-30 | 中南大学 | Encipher-decipher method based on continuous variable quantum nerve network |
CN110190959B (en) * | 2019-06-28 | 2021-05-07 | 中南大学 | Encryption and decryption method based on continuous variable quantum neural network |
US11251948B2 (en) | 2019-06-28 | 2022-02-15 | Central South University | Encryption and decryption method and system with continuous-variable quantum neural network |
CN110543861A (en) * | 2019-09-05 | 2019-12-06 | 深圳前海达闼云端智能科技有限公司 | early warning method, server and early warning system |
US11504581B2 (en) | 2019-09-06 | 2022-11-22 | Taylor Made Golf Company, Inc. | Systems and methods for integrating measurements captured during a golf swing |
US11583729B2 (en) | 2019-09-06 | 2023-02-21 | Taylor Made Golf Company, Inc. | Systems and methods for integrating measurements captured during a golf swing |
CN110639197A (en) * | 2019-09-27 | 2020-01-03 | 上海淡竹体育科技有限公司 | Sports test method, device and system |
CN112752100A (en) * | 2020-12-28 | 2021-05-04 | 杭州海康威视系统技术有限公司 | Method and device for determining video integrity and readable storage medium |
CN113542774A (en) * | 2021-06-04 | 2021-10-22 | 北京格灵深瞳信息技术股份有限公司 | Video synchronization method and device, electronic equipment and storage medium |
CN113542774B (en) * | 2021-06-04 | 2023-10-20 | 北京格灵深瞳信息技术股份有限公司 | Video synchronization method, device, electronic equipment and storage medium |
CN113326828A (en) * | 2021-08-03 | 2021-08-31 | 湖南涉外经济学院 | Sports tactics identification method and system |
Also Published As
Publication number | Publication date |
---|---|
WO2015164389A1 (en) | 2015-10-29 |
CA2917542A1 (en) | 2015-10-29 |
AU2015249884B2 (en) | 2019-07-18 |
EP3017598A4 (en) | 2017-06-07 |
CN106464848B (en) | 2019-07-02 |
AU2015249884A1 (en) | 2016-01-28 |
CA2917542C (en) | 2022-08-16 |
EP3017598A1 (en) | 2016-05-11 |
JP2017521017A (en) | 2017-07-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106464848B (en) | Motion event identification and video synchronizing system and method | |
US11311775B2 (en) | Motion capture data fitting system | |
CN108028902A (en) | Integrated sensor and video motion analysis method | |
CN107211109B (en) | video and motion event integrated system | |
US9866827B2 (en) | Intelligent motion capture element | |
US9361522B2 (en) | Motion event recognition and video synchronization system and method | |
US8702516B2 (en) | Motion event recognition system and method | |
US8903521B2 (en) | Motion capture element | |
US8905855B2 (en) | System and method for utilizing motion capture data | |
US8827824B2 (en) | Broadcasting system for broadcasting images with augmented motion data | |
CN108369646A (en) | Multisensor event detection and tagging system | |
US20150324636A1 (en) | Integrated sensor and video motion analysis method | |
US20140378194A1 (en) | Broadcasting method for broadcasting images with augmented motion data | |
EP2804678B1 (en) | Intelligent motion capture element |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |