CN106464848A - Motion event recognition and video synchronization system and method - Google Patents

Motion event recognition and video synchronization system and method Download PDF

Info

Publication number
CN106464848A
CN106464848A CN201580033463.0A CN201580033463A CN106464848A CN 106464848 A CN106464848 A CN 106464848A CN 201580033463 A CN201580033463 A CN 201580033463A CN 106464848 A CN106464848 A CN 106464848A
Authority
CN
China
Prior art keywords
event
data
video
user
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201580033463.0A
Other languages
Chinese (zh)
Other versions
CN106464848B (en
Inventor
迈克尔·本特利
瑞安·卡普斯
巴斯卡·博斯
希恩·阿拉姆
迈克尔·吉利安
马赞·阿比戴尔-拉赫曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bolasite Motor Co Ltd
Blast Motion Inc
Original Assignee
Bolasite Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/257,959 external-priority patent/US9076041B2/en
Application filed by Bolasite Motor Co Ltd filed Critical Bolasite Motor Co Ltd
Publication of CN106464848A publication Critical patent/CN106464848A/en
Application granted granted Critical
Publication of CN106464848B publication Critical patent/CN106464848B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/23Recognition of whole body movements, e.g. for sport training

Abstract

The invention enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. It may use integrated camera or external cameras with respect to mobile device to automatically generate generally smaller event videos of the event on the mobile device or server. It also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users. The invention provides low memory and power utilization and greatly reduces storage for video data that corresponds to events such as a shot, move or swing of a player, a concussion of a player, or other medical related events or events, such as the first steps of a child, or falling events.

Description

Motion event identification and video synchronizing system and method
Technical field
One or more embodiments be related to motion capture data analysis field, and be based in motion capture data or Person with the event for picking out in user or the motion analysiss data that be associated of equipment and/or based on from the user or The previous movement analytical data of other (multidigit) users of person and/or equipment carrys out display information.More particularly (but not limit Make), one or more embodiments achieve a kind of motion event identification for allowing the event in identification exercise data and video is same Step system and method, the event includes athletic batting, movement or hits, athlete, boxer, the brain of jockey or driver Concussion, or heatstroke, hypothermia, disease burst, asthma attack, epilepsy, or including walking and falling down including times The event of what his physical culture or body kinematicses correlation.Can motion event and (several) image or video carry out related and/ Or synchronize by other means, this can be when event occurs or in position sometime based on event later And/or time or all the two is for example carried out on mobile device or remote server, and be capture from (multiple stage) internal/ External camera or nurse's photographic head, the first time for example to allow the video of preservation event, such as child walks, and acutely trembles Dynamic event, physical culture, military affairs or including other motion events including cerebral concussion, or be associated with old people fall down thing Part, and the video data of non-event correlation is for example abandoned, so as to greatly reduce the storage demand for event video.
Background technology
Existing motion capture system is processed and potentially stores the mass data with regard to actual events of interest.Citing For, it is known that system acquisition from the accelerometer data for being coupled to user or equipment, and analyze or monitor movement.At this In a little situations, thousands of or millions of capturing movement sample to static in or not related in mobile user Connection, the particular event that its mode is try to analyze with existing system is relevant.For example, if monitoring rugby fortune Mobilize, then a large amount of exercise datas are unrelated with cerebral concussion event, for baby, a large amount of exercise datas generally with shake event or example Non-athletic event as sudden infant death syndrome (SIDS) etc is unrelated, for golfer, by being placed in athletic height The acceleration value of a large amount of exercise datas of the sensor capture in golf club is relatively low, that is to say, that for example stand with athlete Or wait another one athlete or not do not move according to mode interested in other respects or acceleration is associated.Therefore, Capture, transmission and storage for the data of non-event correlation increased the demand for electric power, bandwidth and memorizer.
Additionally, even more substantial data are potentially included for the Video Capture for implementing certain type of motion, therein The actual event of many hitting with such as baseball bat or hommer etc is unrelated.Do not have known system prune automatically to regard Frequently, for example preserve the video of event correlation and the video of non-event correlation is abandoned, to generate corresponding to occurring in video And for example by the less video segment of the detected event of the analysis of motion capture data.
Some systems relevant with monitoring collision are absorbed in the collision of linear acceleration correlation.These systems cannot monitor rotation Rotational acceleration or speed, and therefore cannot detect the certain types of event that may produce cerebral concussion.Additionally, for low-power Consider with durability, the system of these types many does not produce the connectionless information of event correlation.Therefore, these systems are based on Which lacks robust property and is restricted in its use.
Known system is not susceptible in exercise data carry out the data mining with regard to event yet, so as to based on formerly The function of the event for picking out in the exercise data of front storage forms the expression of specific movement, such as ordinary movement person or common duty The hitting of industry athlete grade or any athlete's grade.Therefore, find, prune and specify the event of special exercise correlation So as to example as used in being very difficult and time consuming in virtual reality, and hand labor is needed.Therefore, current system is no Method easily allows specific user with the previously stored motion of same subscriber or other users and such as historical movement person Event is played for opponent.Furthermore it is known that system do not account for the collision that accumulates, and for example for having with cerebral concussion The information of the data mining of pass come determine a series of collision brain function whether may be caused impaired over time.
Other kinds of motion capture system is included for analysis and the video of teaching body ins and outs (mechanics) System.These systems be based on carrying out videograph to athlete and the athletic video to being recorded is analyzed.This There is restriction in the technology of kind, including the subjective analysis accurate and not the same not to the utmost for example based on video.Another kind of skill Art includes motion analysiss, wherein for example captures the three-dimensional point of the movement being associated with athlete using at least two cameras. Known implementation utilizes static many camera chains, and the system is not portable enough and therefore cannot be in the installation of system Be utilized outside environment, for example golf tournaments, rugby compete etc sport event during be utilized or It is utilized to monitor child or old people.In general, the system based on video is also unfavorable with from experiencing the right of motion As the digital moving of upper sensor captures data, this is because being to regard for obtaining and analyzing to have based on the system of video Feel image rather than the electronic sensor of labelling.Additionally, these devices that fixes are also prohibitively expensive.Such prior art exists The U.S. Patents Serial numbers 7 that on January 26th, 2006 submits to, are summarized in 264,554, and which requires that on January 26th, 2005 carries The rights and interests of the U.S. Provisional Patent Application Serial No. 60/645,751 of friendship, the description of the two all merged heres are by reference. Whole two disclosures belong to the identical inventor of the subject content of the application.
Regardless of the motion capture data for being obtained, generally in per user or on the basis of hitting every time, data are entered Row analysis, wherein the process not being susceptible on mobile phone, and therefore user can only buy fortune for existing mobile phone Dynamic capture sensor and " application (app) ".Additionally, existing solution is not susceptible to mobile use, analysis and message passing Send and/or compare, or use from the user or the previously stored motion capture data of other users, or motion is caught The large data set for obtaining data carries out data mining, for example to obtain or to create the capturing movement being associated with one group of user Data, the such as athlete of directly golfer, tennis player, basket baller or any other sports, from And the event that common with " professional grade " or outstanding virtual reality opponent is associated is provided.Sum it up, motion capture data is logical It is commonly used for at-once monitor or sports performance feedback, and generally has in other areas and be restricted and/or original Use.
Known motion capture system is generally passively or actively labelling or several sensors using several.Do not have known System can utilize as little as one visual indicia or sensor and execution for example on the mobile device that user has had Apply to analyze and show the motion capture data being associated with user and/or equipment.The data are typically in the lab And analyzed on the basis of hitting in per user or every time, and the motion analysiss except the specific user or motion table Any other purpose is not applied to outside showing, and is usually not subject to data mining.
Do not have known system allow capturing movement element and the user of such as wireless senser etc or footwear, glove, Shirt, trousers, belt or other equipment (such as baseball bat, tennis racket, golf clubs, boxer, rugby or English foots The athletic facing of ball, or the protectiveness facing for being utilized in any other contact sports) Seamless integration- or Couple by other means, to carry out local analytics or later analysis in very little form, so that user does not know Sensor described in road is placed among or on these projects.Do not have the known system being capable of such as joining in golf clubs In weight portion (weight port) or seamless placing device being provided at the end shaft of handle, is being configured to provide Become the wireless golf clubs of capture movement data.The data for deriving from existing sensor are not maintained in corresponding to a large amount of things In the data base of part, and do not made with respect to any other item in addition to the collected performance of motion capture data With.
Additionally, for using equipment and ball sports, do not have known portable system allow user obtain with regard to The flying distance of ball, speed of hitting, (the namely collision of ball is in equipment for the intermediate degree of hit efficiency or the impact bead of equipment The position of upper generation) instant visual feedback.These systems do not allow user and collection from other users or historical movement person or Person gathers and plays from the motion capture data of the prior behavior of its own.Known system is not allowed to from hitting in a large number Motion capture data carry out data mining and so as to suggestion or allow the more preferable or optimum equipment of search to mate the fortune of user Dynamic capture data, and do not allow original equipment manufacturer (OEM) to make commercial decision, for example, improve its product, by its product It is compared from other manufacturers, excess promotional product or contacts the use for being likely to purchase the more products of different or profit Family.
Additionally, do not have known system to excavate to carry out equipment debugging using motion capture data, and with regard to purchasing at once Buy the follow-up sales point decision-making of suitable athletic equipment.Additionally, do not have known system to allow custom order to fulfil, than The Assemble to Order (ATO) that such as fulfils for the custom order of physical education facilities, such as according to based on motion capture data excavation Customer specifications set up and for example match or virtual reality match during be shipped to customer with complete point of sale process Equipment.
Additionally, there is no known system for passive compliance and monitoring application using mobile device and RFID label tag.
Known system is not had to allow to enter line number for a large number of users with regard to its motion or the motion of associated equipment According to excavating to find the pattern in data, so as to allow based on up to the present still the undiscovered pattern relevant with motion come Determine business strategy.Known system is not had to allow to obtain from OEM, medical professional, game company or other terminal temperature differences Payment is to allow to carry out data mining to exercise data.At least for previously described restriction, a kind of motion event identification is needed With video synchronizing system and method.
Content of the invention
Embodiments of the invention achieve a kind of identification of motion event and video synchronizing system and method, and which is provided for fortune The INTELLIGENT IDENTIFICATION of the event in dynamic data, including but not limited to from such as visual indicia and sensor, RFID tags And the motion capture data that the portable mobile wireless capturing movement element of mobile device computer system etc is obtained, or described Motion capture data is calculated based on the movement by analysis being associated with same subscriber, or with the user or Other users, historic user or groups of users are compared.Detected to correspond to by pruning exercise data and video Event, it is allowed to which the low memory for event data and video data is utilized.This can be on mobile device or remote server Implement, and be the position based on event and/or time and the position based on video and/or time, and can be alternatively Pointing to limit the video for potentially including motion event further including camera.Some embodiments are allowed based on event Viewing and low power event transmission and with execute application on the mobile apparatus and/or the communication with external camera, so as to Specify the window in order to define event.Image or the identification of the motion event in video and event is allowed to specify, such as athletic Batting, mobile or hit, athlete, boxer, the cerebral concussion of jockey or driver, or heatstroke, hypothermia, disease burst, Asthma attack, epilepsy, or including walk with fall down including any other physical culture or the related event of body kinematicses.Can With event and the width or more multiple image or video for capturing from one or more inner/outer camera or nurse's photographic head Correlation is carried out, the first time for example to allow the video of preservation event, such as child walks, and acutely event is shaken, including brain Concussion is in interior sport event, or the fall events being associated with old people.Can be with linear acceleration rate threshold and/or mould Formula and rotary acceleration and threshold speed and/or pattern monitoring cerebral concussion dependent event and other events, and/or On the basis of event, which is preserved and/or by light-type connectionless protocol, which is transmitted, or aforementioned items Combination in any.
Embodiments of the invention allow user to buy application or " app " and capturing movement element, and immediately by the system System is used together with its existing mobile computer (such as mobile phone).Embodiments of the invention can to monitoring user or The user being associated with capturing movement element or equipment shows movable information.Some embodiments be also based on a certain user or Equip associated previously stored motion capture data or motion analysiss data or be associated with least one other users Previously stored motion capture data or motion analysiss data (function of being compared etc by such as (and being not limited to)) showing Show the information based on the motion analysiss data being associated with the user or equipment.This allow for precision monitoring, compliance and The motion capture data for obtaining from (multidigit) other users or the interaction of pattern, for example to utilize the true fortune for obtaining from user Dynamic data carrying out virtual race, and based on this using previously from the user or from other users (or equipment) Real motion data capture generate response.This ability provides the match with historical movement person as opponent, such as virtual net Ball is competed, or the match with " common " professional sportses athlete as opponent, and be in the art until the present moment not Know.
For example, one or more embodiments include at least one capturing movement element, and which is configured to and user, dress Mobile device that is standby or being coupled with user is coupled, and wherein at least one capturing movement element includes:Memorizer;Joined It is set to capture related to the sensing of at least one capturing movement element, position, speed, acceleration (linear and/or rotation) The sensor of the combination in any of the numerical value of connection;Radio device;And it is micro- with what memorizer, sensor and radio device were coupled Controller.The microcontroller is configured to collect the data including the sensor values from sensor, stores data in In memorizer, data are analyzed and pick out with the event in data to determine event data, and pass through radio The event data that device transmission is associated with event.The embodiment of the system can also include to be configured on the mobile apparatus The application of execution, wherein mobile device include computer, are configured to communicate to obtain and event with radio device The wireless communication interface of associated event data.The computer is coupled with wireless communication interface, and its Computer is executed should With or " app " to configure the computer:From wireless communication interface receiving event data, event data is analyzed to form motion point Analysis data, storage event data or motion analysiss data or event data and motion analysiss data all the two, and aobvious Show on device and show and include the event data that is associated with least one user or motion analysiss data or whole information of the two.
One or more embodiments include at least one capturing movement sensor, and which is configured to be placed on the head of user Near, wherein the microcontroller is further configured to calculate the impingement position in user's head.At least one capturing movement The embodiment of sensor be configured to any kind of placement, encapsulation or coupling mechanism and be coupling in medicated cap or ball On cap, it is coupling in protectiveness facing.One or more embodiments of at least one capturing movement sensor can be joined It is set to and couples with the helmet in user's head, and the calculating wherein with regard to the impingement position in user's head is to be based on to use account Portion and/or the physical geometry of the helmet.Some embodiments can include for example with least one capturing movement sensor Or the temperature sensor for coupling with microcontroller.
Embodiments of the invention can also be using the isolator being configured to around at least one capturing movement element So as to the physics acceleration damping of the cerebrospinal fluid approximately about user's brain, so as to minimize the linear acceleration of event data With the conversion of rotary acceleration, the observation linear acceleration so as to acquisition user's brain and observation rotary acceleration.Therefore, some Embodiment can be eliminated in order to the power from the acceleration based on the helmet or acceleration value or any other numerical transformation To the brain acceleration value for being observed.Therefore, some embodiments are provided specific to thing using less electric power and storage The data of part, so as to minimize the quantity of data transfer again, so as to cause lower through-put power to utilize and even lower General power is utilized.Based on the type of the inherent liner in the helmet, in rugby/athletic helmet of ice hockey/lacrosse On can utilize different isolators.Do not wear the helmet wherein or wear its that utilized in the sports of the helmet once in a while His embodiment can also utilize at least one capturing movement sensing of (on the medicated cap of such as baseball player) on ball cap or medicated cap Device, together with least one sensor being placed on batting helmet.Sports (the such as English foot of ball cap is not utilized wherein Ball) in can also utilize headband placing device equally determining cerebral concussion.In one or more embodiments, using on the helmet Isolator can remain attached to the helmet in a package, and sensor can be removed and be placed on not and utilize coupling to use On another equipment of the isolator of the damping of family brain liquid.Some embodiments can be based on certain types of equipment (namely Surfboard is compared to baseball bat) associated characterizable motion pattern automatic detection type of sports, and determine that capturing movement is sensed The type of the current accompanying equipment for arriving of device.
Embodiments of the invention may be configured to obtain/calculate linear acceleration numerical value or rotary acceleration numerical value or Both all.This allows for monitoring rotational event for cerebral concussion and linear acceleration.Other events can using linear and/ Or rotary acceleration and/or speed, for example it is compared with pattern or template, so as to not only switching sensor during event Property dynamically to change capture characteristic, but also characterize the equipment for utilizing together with current capturing movement sensor Type.This allows for buying by the single motion capture element of user and causing more than one piece equipment or medicated clothing tool, and this is logical Cross allow sensor based on the motion for being captured by the sensor and characterizable motion pattern or template relatively automatically determine the sensing Equipment or the type of medicated clothing that device is coupled to.
Embodiments of the invention can utilize connectionless broadcast message to transmit the event data being associated with event.One In individual or more embodiments, depending on the radio communication for being adopted, broadcast can include the data with limited quantity Payload, which can be utilized to avoid shaking hands and expense based on the agreement for connecting.In other embodiments, can pass through Combination in any is come using connectionless or based on connection agreement.
In one or more embodiments, computer can access the previously stored event being associated with user or equipment Data or motion analysiss data, so as to for example determine cerebral concussion fall down or other hit or any other motion event number Mesh.Some embodiments can also assume the event data being associated with least one user over the display, this be based on The associated event data of the user or equipment or motion analysiss data and with the user or equipment or with least one The associated previously stored event data of position other users or other equipments or motion analysiss data.This allow in number or In terms of quantitative value, motion event is compared, such as by the user or other users in particular game or in history On the maximum rotary acceleration that observes.Additionally, definition corresponding to typical event project equipment characterizable motion pattern or Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments In dynamicallyd update in capturing movement sensor by wave point.This allows for sensor to improve over time.
Embodiments of the invention can for example by radio and television or the Internet transmit information so as to computer or remote Shown on the visual displayss of journey computer coupling.The embodiment of the display can be configured to receive subevent Time location, to provide the discrete rolling of the timeline along whole event.For example, golf is hit can include The sub- thing of for example aim at (address), brandishing, brandish forward, impact, keeping posture (follow through) etc backward Part.System can show the time location corresponding to subevent and receive the user input near the position, to determine Video should start at the time point or stop, or is for example rolled to or returns to the time point to be easy to watch sub- thing Part.
Embodiments of the invention can also include to couple with least one capturing movement sensor or user or equipment Identifier.In one or more embodiments, the identifier can include team and team uniform number or student identifier Number or passport NO. or any other identifier, which allows relative uniquely identifying from the specific of specific user or equipment Event.This allows for application (app) the mark tool with regard to being configured to receive the data being associated with special exercise person or user There are team sport motion or the position of multidigit athlete or user.One or more embodiments receive identifier, such as with motion Member or the passive RFID identifier that is associated of user or MAC Address or other sequences number, and identifier and event data and Motion analysiss data are associated.
One or more embodiments of at least one capturing movement sensor can also include to be configured in event The light-emitting component of output light in the case of generation.This can be utilized to show potential, slight or weight in the Outboard Sections of the helmet Degree cerebral concussion, and without the need for any communication for example for any external equipment.Different colors or flash of light interval can also be utilized To pass on the information relevant with event.Alternatively or in combination, at least one capturing movement element can also be wrapped Audio output element is included, which is configured in the case of an incident or at least one capturing movement sensor Sound is exported in the case of outside the scope of computer, or wherein the computer is configured at least one fortune Display alarm in the case of capture sensor being moved outside the scope of computer, or aforementioned every combination in any.Sensing The embodiment of device can also utilize LCD, and which exports the volume of current event for example in quick response (QR) code or bar code Code division is analysed, and so as to for example allow referee locally to obtain the snapshot of code analysis on the mobile apparatus, and causes event Will not be watched with readable form on a sensor or be wirelessly communicated and intercepted by all other men.
In one or more embodiments, at least one capturing movement element also includes the position for coupling with microcontroller Put determination element.This can for example include GPS (global positioning system) equipment.Alternatively or in combination, the calculating Machine can cooperate with another computer to carry out triangle polyester fibre to position, or obtain from the receptor of any other triangle polyester fibre type Position, or based on by couple with the computer and image that the known camera for pointing to specific direction is captured is counting Position is calculated, the wherein computer for example calculates the skew with mobile device based on the direction of the object in image and size Amount.
In one or more embodiments, the computer is further configured to please from least one camera of proximal event Ask at least piece image comprising event or video.This can include from specific neighbouring camera or point to event direction The broadcast of camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour Nearly event or be directed to viewing event camera position request, and optionally for holding around events of interest The available camera of continuous time showing or the video at this.In one or more embodiments, the computer also by The list of one or more times of display event generation is configured to, desired so as to allow user to obtain by the computer Event video, and/or independently ask video from the third party with desired event time.
In one or more embodiments, at least one capturing movement sensor is coupled with mobile device, and example The internal motion sensor that mobile device in or with mobile device couple such as is used in.This allows for using generally existing The hardware of minimum level carrying out capturing movement and event recognition, such as using the mobile device with built-in accelerometer.? In one or more embodiments, the first mobile device can with record exercise data user couple, the second mobile device then by Using the video to record motion.In one or more embodiments, the user for experiencing motion can provide gesture, for example N times are tapped on the mobile apparatus, the mobile device so as to show second user should start recording video or stop recording video. Can transmit, using any other gesture, the instruction that event is related or motion is related between mobile device.
The embodiment of at least one capturing movement sensor can include temperature sensor, or the microcontroller Can couple with temperature sensor by other means.In these embodiments, microcontroller is configured to transmission and is derived from temperature The temperature of sensor is spent using as temperature event, such as heatstroke or the potential instruction of hypothermia.
Therefore, embodiments of the invention can recognize any kind of motion event, including with user, equipment or shifting The associated relevant event of moving of at least one capturing movement sensor that the combination in any of dynamic equipment is coupled, Huo Zheyu Show to stand, walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or not having The relevant event of breathing or the motion of its combination in any, or any other class for the persistent period for moving with period The event of type.
Embodiments of the invention can utilize motion capture data on data mining come obtain corresponding to user, equipment Pattern, or in certain embodiments of the invention using the motion capture data or event of given user or other users.Number It is related to find new pattern in large database according to excavating, wherein the pattern is that previously institute was ignorant.Can be to data Wherein should for example include statistical analysiss, neutral net and artificial intelligence in many ways to find new pattern.Due to depositing In substantial amounts of data, therefore can be by the computer-implemented automatic data mining of or more multiple stage to find in data not The pattern that knows.Unknown pattern can include dependency between the packet of related data, the abnormal, data element in data, Classification data being modeled with minimum error and the unknown pattern of function or any other type.Data mining results Display can include to summarize new discovery according to the mode that user is easier to understand compared with a large amount of purely undressed data Pattern display.The one of which result that data mining is processed is improved market intelligence, product improvement, consumption prospecting (lead generation) and targeted are sold.As a rule, must quilt by any kind of data for being subject to data mining Cleaning (cleanse), data mining, and its result are generally verified.Enterprise can be with additional income by using data mining. The example of the benefit of embodiments of the invention includes that the customer based on the pattern for finding in data for height target individual is closed System's management.Additionally, market basket analysis data mining allows identification by the personal product that buys or have of identical, which can be sharp It is used for having a product but the user for not having another product generally being had by other users promotes the sale of products.
The other field of data mining includes to be analyzed the large-scale exercise data set from different user, so as to base In the performance data suggestion from other users in order to improve the exercise of performance.For example, if a user is compared to general Buttocks rotation of the general family during hitting is less, then can be by system recommendations in order to improve the exercise of pliability or strength.? In golf course embodiment, which ball golf course designer can determine by a large number of users on golf course The length or difficulty in hole should be adjusted to obtain the more discrete numerical value of the average bar number corresponding to each match play, or Person is used for determining time quantum between golfer, for example specific in the daytime when or the golfer corresponding to given age Time quantum.Additionally, the physical culture of data mining and medical applications include to determine user's performance morphologic change over time, for example Change compared to recipe or exercise most for the improvement of performance what to determine, or for example what in the daytime when, temperature or its The event of hitting produced by his condition can cause farthest service or minimum fraction.By for specific user or with regard to which His user allows health care compliance using motion capture data, so as to for example guarantee to suffer from person with diabetes in the middle of one day Mobile specific quantity, and also allow for how motion or range of movement of the morphological analyses to determine user change over time. Can be played using motion capture data, so as to allow to carry out with historical greatness athlete or other users as opponent Virtual reality is competed.For example, someone can play for the prior behavior of same people, or can be directed to friend's Motion capture data plays.This allows for being compared in history stadium or place of the user in reality environment Match, but motion capture data is, for example, previously to gather from the user or other users.Military planning person can be using motion Capture data to determine which soldier is the most suitable and is therefore eligible for particular action or which soldier should be retired, Or by the cerebral concussion event that for example stood and its seriousness is trained based on athlete determine when athlete should rest, And it is potentially based upon wherein other users and improves time period that is excavated of performance after cerebral concussion dependent event and makes Determine.
The embodiment of the system implements capturing movement and/or aobvious by for example executing application on the mobile apparatus Show, the mobile device can include visual displayss and optional camera, and can be from such as visual indicia and/or nothing At least one capturing movement element of line sensor etc obtains data.The system can also be with free-standing camera or many Camera on platform mobile device is integrated.The system also allows for user in several ways analyzing and show motion Capture data, so as to provide the graphical information instant and easy to understand being associated with motion capture data.In the system It is relevant that middle utilized capturing movement element intelligently stores for example associated with batting, skiing revolution, jump etc. event Data, and eliminate error event, use and minimize storage demand so as to significantly improve memorizer.Additionally, for example may be used Repeatedly swung or corresponding with for the more than one event data storage being associated with physical education facilities, such as if necessary storing In the data of whole wheel golf range game, till being downloaded to mobile device or the Internet at least up to data.Can also utilize For the data compression of captured data, to store more motion capture datas in the memorizer of given quantity.Described The capturing movement element for being utilized in system is can be configured to intelligently by some part power-off of its circuit to save Electric power, such as by transceiver power-off till detecting certain types of motion.Embodiments of the invention can also be using spirit Battery connector living can utilize system so as to increase concurrently to couple two pieces or more polylith battery before battery is changed Time.Motion capture data is typically stored within the memorizer of such as local data base etc or is stored in network can In the data base of access, any one therein all allows data mining described above.Permissible using embodiments of the invention Implement the data mining of any other type, change with the time of one or the more relevant data of multidigit user including search Become, or simply search for the data relevant with specific user or equipment.
Other embodiment can show such as the selection of music or the music list that will play based on motion-dependent data Etc information.This for example allows the performance by performance with another one user to be compared and select another one user to be played Music type, or compare performance with respect to threshold value, the threshold value determines will advise or show what type of music Select.
Embodiments of the invention for sports for example allow for RFID or passive RFID label tag to be placed on user institute On mobile article, the embodiment pursuit movement of the wherein system.For example, by passive RFID label tag is placed on spy The fixed helmet or ball cap or for boxing, the protectiveness facing of rugby, Association football or other contact sports Upper and be especially located on the dumbbell in gymnasium, and by wear such as glove etc capturing movement element and Using for exampleEtc existing mobile device, The embodiment provides automatic safe compliance or Fitness and/or health care compliance.This is to track user by pursuit movement and by RIFD or passive RFID The weight lifted and realize.Therefore, embodiments of the invention can be multiplied by by each RFID label tag institute plus number of repetition The weight for showing, so as to calculate the calory count burnt by user.In another example, RFID label tag and stationary bicycle coupling Close, or wherein stationary bicycle can simulate identifier and/or radio communication so as to offer performance data, and wherein Mobile computer includes RFID reader, and the number of revolutions of user leg can be counted.For RFID or passive Any other of RFID is using the spirit for all meeting the present invention.This allows for doctor remotely to determine whether user defers to its medical treatment and build View, or beyond for example showing the linear or rotary acceleration of cerebral concussion.Some embodiments therefore can be true using coming by user Compliance is protected, and is utilized to reduce its malpractice liability insurance rate by doctor, this is because doctor is guaranteeing that its patient abides by From its recommendation, despite by remote mode.Embodiments of the invention are not required for RFID label tag for medical compliance, but RFID label tag can be utilized.For golf embodiments of the invention also allow for by using on each ball bar for example RFID label tag etc identifier (or alternately through being associated with the capturing movement electronic installation on golf clubs or The identifier for remotely being obtained by radio device) and each ball bar for being associated with golfer of mobile computer pair Golf driving counted, the mobile computer be, for example, equipped with RFID readerIts The process for counting for golf driving is concentrated on mobile computer rather than on each golf clubs.The present invention's Embodiment can also allow for referring to measure using Inertial Measurement Unit or accelerometer and/or magnetometer and/or gyroscope To (north south, and/or two trunnion axis and vertical axises).Golf driving is counted this point is not required for, but By vibration analysis, one or more embodiments for example can determine when golf clubs hits golf, and then to Golfer asks whether to count batting.This function for example can be with speed or acceleration rate threshold or range detection mutually group Close, to determine that whether golf clubs is advanced in acceptable speed or scope, or whether be in corresponding to should count In the acceleration of the hit of number or scope.Small echo can also be utilized be compared with signature of effectively hitting, so as to for example disappear Mistake impact is batted or is eliminated except counting.The scope can be different between different clubs, for example, open club velocity Scope can be " higher than 30mph ", and push rod velocity interval can be " less than 20mph " then, can be according to the phase for any club Hope and any scope is utilized, or can for example ignore the velocity interval.Alternatively or in combination, mobile computer can With only when golfer is not shifted laterally (be namely in golf cart or walking) just to Gao Er Husband player asks whether to count batting, and/or wherein golfer may carry out rotating or being batted, just As determined by the sensing that couples with mobile computer or gyro sensor.Ground that for example can be on mobile computer The position of batting is shown on figure.Furthermore, it is possible to the gps receiver with radio device is placed in ball seat labelling and hole (cup) to provide the daily renewal with regard to distance in, and for example help read push rod and greens.Golfer is acceptable Virtual glasses are worn, which allows golfer to see golf course map, current location, arrive the distance of match play, work as forecourt The number of strokes in hole, batting sum and any other desired measure.If for example by like that, using determined by GPS Family moves specific range without counting batting from batting, and system can prompt the user whether to count batting.The system Do not need user to start the switch on club to count batting, and do not need LED on each ball bar or active or electric Battery-powered electronic installation is counting batting.Mobile computer can also receive gesture from user to count batting or not Batting is counted, therefore golfer need not remove any glove to operate mobile computer.For using position/sensing sensing The embodiment of device, system can only club in be perpendicularly oriented to when and for example when shock is detected just count bat. Described device can also include the identifier for allowing mark specific device.The identifier can be for example serial number.The mark Know the RFID label tag that symbol can be for example derived from each golf clubs, or can alternatively include and golf clubs The associated serial number of associated capturing movement element or other identifiers.The specific height of mark is allowed by using the device Golf ball handss, specific club, and also allow for carrying out together with the system of TV and/or mobile device is included capturing movement and/ Or show, the wherein mobile device has visual displayss and an optional camera, and can from such as visual indicia and/ Or at least one capturing movement element of wireless senser etc obtains data.The system can also with free-standing camera or Camera on person's multiple stage mobile device is integrated.The system also allows for user in several ways analyzing and show Motion capture data, so as to provide the graphical information instant and easy to understand being associated with motion capture data.The dress Put the system that also allows for and determine " placed in the middle " degree for clashing into regard to ball and equipping (such as golf clubs).The system also allows for bag The debugging of the equipments such as footwear, club is included, even and if equipping needs the customization Assemble to Order request from retailer also to permit Equipment is bought perhaps at once.Once motion capture data, video or image and batting counting indicator are obtained by the system, can With by its for example locally stored in the local database, or for example remote data base is sent to by phone or wave point. Once in data base, various elements (such as age, sex, height, the body of any data including being associated with user Weight, address, income or any other relevant information) just can be used in embodiments of the invention and/or be subject to Data mining.One or more embodiments allow the access of user or OEM for example for the data mining ability of the system to enter Row is paid.
For example, the data for being obtained from described device using the embodiment permission analysis of capturing movement element, and permit Perhaps the exclusive display (such as 3D superposition) being associated with user is presented on the image of user's body, will pass through visual manner Describe captured exercise data.Additionally, these embodiments can also utilize the scope for up to 50 meters to use for exampleThe active wireless technology of low energy etc, is led to so as to the mobile computer with golfer Letter.For example as receiving the result of golf clubs ID (for example by RFID reader or alternatively by for example usingLow energy or the radio communication of IEEE 802.11), embodiments of the invention also allow for display and are directed to Count the inquiry of batting.By usingLow energy chip allows club using the coin unit of standard Battery is up to 3 years in sleep pattern, so as to the maintenance needed for reducing.One or more embodiments of the present invention are for example permissible More than one radio device using more than one technology.This allows for improving a certain degree of redundancy of system robustness Property.For example, if a radio device (for exampleRadio device) no longer work, then 802.11 radio device of IEEE can be utilized to transmission data and alert one of them wireless Denso to golfer Put and no longer work, while still allowing for golfer's record exercise data and carrying out for the associated batting of specific club Count.Enforcement for the present invention using the mobile device (or being more than a mobile device) without (multiple stage) camera Example, it is possible to use sensing data generates the display of captured exercise data, at the same the mobile device can alternatively from Other cameras or other mobile devices with camera obtain image.For example, it is possible to use or do not utilize use The display type of the image at family can include evaluation, the data for being calculated and timeline data.Can also by have or not The form of numeral or graph data with user images displays to the user that the evaluation being associated with the motion for being captured, for example " efficiency " is evaluated.Other evaluations can include linear acceleration and/or the rotation for being for example used for determining cerebral concussion and other events Acceleration value.Can be calculated in the case of the image with or without user's body on the mobile apparatus and show institute The data of calculating, such as predict ball flight path data.Can also show in the case of the image with or without user Describe data on the time line, for example to show the relative velocity peak of the various pieces corresponding to equipment or user's body Value.From multiple stage camera (including multiple stage mobile device) and be, for example, can be by group from the image of golf fan colony Close BULLETIn visual effect, the visual effect be by enclosing under normal speed and under all angles The slow motion hit around the golf shown in golfer is characterizing.The data that is all analyzed locally can shown Show, or count together with motion capture data, image/video, batting and position data is uploaded to data base and can To experience data mining process wherein, the wherein system can for example be directed to the access collection of charges of result.
In one or more embodiments, user for example can play ball on a certain golf course or play tennis or Simply hit so that motion capture data is generated, and the change of another one user is seen when virtual reality glasses are worn Body, no matter it is the true incarnation in virtual or augmented reality environment.In other embodiments, user's movement and any physical culture Equipment or simply move the user body of oneself for coupling with capturing movement sensor that motion is associated, and watch Show the movement of the user in virtual reality glasses or the reality environment of the movement of the equipment of such tool.Replace Ground or in combination, it is possible to use virtual reality room or other environment carry out projected virtual reality incarnation and exercise data. Therefore, the embodiment of the system can allow the user on real golf ball field with various location not in reality The another one user of batting plays, and moves the analyzed historical movement person of data or based on one or more Do more physical exercises capture data sequence data mining construction user play, and by the system one embodiment utilize To project the incarnation of historical movement person.Each in the middle of three athletes can be competed successively, be in phase just as which Same place is the same.
Motion capture data and/or event can be shown in many ways, such as during or after capturing movement Sending out text is pushed away to social networkies.For example, if having carried out certain amount of exercise or motion or having consumed certain amount of Calorie, or obtaining new sports Capability index maximum, then the system can be sent out new information automatically and push away Text arrives social network sites, such that it is able to notify to be connected to the Internet anyone.Upload to the Internet (namely remote data base or Remote server or the storage away from system) data can by obtain for data access any computer viewing, Analyze or carry out data mining.This allows for long-range compliance to push away text and sends (tweeting) and/or compliance and/or original dress What standby manufacturer determines for the equipment of compliance or the body of the embodiment for sports correlation for given user Educate armament-related work obtain best, and/or will advise what equipment.Data mining is also allowed for based on the number being associated with user According to and/or metadata suggestion user improve the planning of its compliance and/or sports place (including golf course), such as Age or any other demographic information that can be imported in system.The long-range storage of data also allows for medical treatment should With such as morphological analyses, range of movement over time and diabetes control, and foregoing exercise monitoring and compliance Application.Other application also allows for playing (example using the real motion capture data from other users or historical movement person Such as after the athletic video of analysis of history, no matter whether the historical movement person is alive).Virtual reality and enhancing are virtual existing Real application can also utilize motion capture data or historical movement data.The army personnel of such as commanding officer and/or doctor etc What kind of gravity can be experienced using motion and/or image to determine under blast of the people near improvised explosive devices, And automatically the medical rescue of optimal type is arranged into the position of capturing movement sensor.One or more realities of the system Apply example and for example its higher level can be relayed to the motion capture data beyond gravity or threshold speed by wireless communication link and refer to Wave at official or nearest healthcare givers.Or, embodiments of the invention can to any mobile device that is intercepting (for example The mobile phone of referee) the connectionless cerebral concussion related news of broadcast light-type, to help succour injured swimmer, Wherein the light-type message includes optional team/team uniform number and acceleration correlated digital, such as potentially/possible Cerebral concussion warning or index.
In one or more embodiments of the present invention, such as tennis tour, rugby match, baseball game, vapour Fixing camera at car or motorcycle race, golf tournaments or other sport events can be located at motion Wave point near the athlete/equipment of capture element is utilized together, to obtain, to analyze and show motion capture According to.In this embodiment it is possible to show the exercise data of real-time or near real-time for strengthening video playback on video.Cause This, by shown with visual manner be equipped in batting during mobile how soon must having and cause the lifting of amusement degree, for example surround Athletic buttocks and shoulder draw circle.Embodiments of the invention are also allowed on the mobile device relevant with another one user Using the athletic image from other with mobile device or video, so that user need not for example exchange mobile electricity Words.In one embodiment, when by first user for second user not with the mobile phone with outfit video cameras When physical education facilities in associated motion obtain video, the video can be automatically transferred to first user, to utilize The motion capture data being associated with first user is shown.Video and image can be uploaded in data base and pass through Graphical analyses are by data mining, so that the type/color of the medicated clothing that for example determination user is dressing or footwear.
Based on the display of data, user can determine optimal equipment, and buy equipment by mobile device at once. For example, when making decision between two secondary sleds, user can be tried out by the complete of capturing movement element tools The secondary sled in portion two, wherein is analyzed to determine which secondary sled allows more efficient movement to motion capture data.Right In golf embodiment, when making decision between two golf clubs, user can be entered using different clubs Row is hit, and quantitatively determines that the performance of which ball bar is more preferable based on the analysis of the exercise data to being captured.Can lead to Customization equipment is ordered at the interface that crosses on mobile device from retailer, and retailer can be equipped and example with Assemble to Order customization Such as equipment is checked at user.For example can based on user carries out push rod using the shaft of adjustable length when captured Exercise data, for specific user customization for example have full-length push rod shaft length.For example it is based on and motion is caught Obtain the data mining of data and batting enumeration data and distance, it is allowed to the user with similar characteristic of hitting and active user It is compared, wherein for example can advises for user or search for the given speed of hitting for the user with specific stature and age Degree provides the equipment of longer batting, to improve performance.For given speed of hitting, OEM is it may also be determined which kind of plate Optimal aggregate performance is provided with the club of model.It would be recognized by those skilled in the art that this is applicable to all of motion Activity and be not only golf.
The embodiment of the system can utilize multiple sensors type.In one or more embodiments of the present invention, Active sensor can with allow using together with being passively or actively the system integration of visual indicia, so as to capture user's body or The motion of the specified point on equipment.This simply can be implemented according to two-dimensional approach, or if mobile device is configured with two Platform or more multiple stage camera, or if multiple stage camera or mobile device are utilized to capture images (such as video) and are total to Described image is enjoyed to create the three-dimensional motion data of triangle polyester fibre from the set of the two dimensional image for being derived from each camera, Then can also implement according to three dimensional constitution.An alternative embodiment of the invention can utilize Inertial Measurement Unit (IMU) or Any other sensor of the combination in any of sensing, position, speed and/or acceleration information can be produced for mobile device.Cause This, the data that the sensor can be obtained can include and point to (vertical or north south or all both), position (by complete Ball alignment system (namely " GPS ") or pass through triangle polyester fibre), speed (in whole three axles), acceleration (whole three axles In) combination in any of associated one or more numerical value.The all motion capture datas for obtaining from various sensor types are all Can be stored in data base for analysis, monitoring, compliance, match or other purposes and/or data mining, and Regardless of sensor type.
In one or more embodiments of the present invention, it is possible to use include passive marker on the outer surface of sensor Or the sensor of active flag, so that sensor can also be utilized and visual tracking (two dimension or three-dimensional) and for referring to To, position, speed, acceleration or any other physical quantity for being produced by sensor.The vision of (multiple) capturing movement element Labelling embodiment can be passive or active, it means that itself or can have can be by the vision portion of visual tracking Point, or the light-emitting component that can include to allow to carry out image trace in low light conditions, such as light emitting diode (LED).This The figure of the opposed ends of the shaft end near handle or the golf clubs at club head can for example be passed through Symbol or coloured label are implementing.The image of labelling or video locally analyzed, or can be stored in data base simultaneously And analyze, and subsequently it is used in data mining.Additionally, for the embodiment of cerebral concussion correlation, visual indicia can be sent out Go out to show the light of cerebral concussion, for example the yellow flash corresponding to moderate cerebral concussion or the quick redness corresponding to severe cerebral concussion Flash of light, or any other vision or optional audio event index or all the two.As previously discussed, LCD Local vision encoded messages can be exported, so which will not be equipped to read the local of the code by not having Anyone of mobile device is intercepted or is read by other means.For example for the event that cerebral concussion or paralysis are related, this is just Allow only to read sensitive Medical News by referee or local healthcare givers.
The embodiment of capturing movement sensor can generally be placed in of physical education facilities (such as golf clubs) Or on more ends or opposing end portions or its any position (measuring for EI) nearby and/or therebetween, and can be with The other sensors for being coupled to equipment are integrated, such as weapon, medical equipment, wrist strap, footwear, trousers, shirt, glove, Club, bat, racket, ball, the helmet, ball cap, facing etc., and/or use can be attached to by any possible mode With family.For example be attached on rifle, so as to determine when recoil is detected by capturing movement sensor rifle positive sense what Place.The data can for example utilize mobile computer (such as mobile phone) or other equipment be sent to central server and Analyzed, put into practice for military exercises.Additionally, one or more embodiments of the sensor can be assembled to golf In the counterweight part of bar and/or it is assemblied in the handle end of golf clubs.Other embodiment can for example be assembled to net In the handle or end of racket or baseball bat.The embodiment relevant with safety or health monitoring can be with ball cap, the helmet and/or tooth Set coupling, or in the encapsulation of any other type.One or more embodiments of the present invention can also be utilized and are integrated with The ball of sensor is operated.One or more embodiments of mobile device can lay computer including small-sized, such asOrIt can with or without integrated display, and And be small enough on the shaft for be placed in physical education facilities and do not interfere with hitting for user.Or, the system can be calculated The virtual flight path of the ball for coming in contact with the equipment for being moved by athlete.For example for baseball bat or tennis racket or Gao Er Husband's club, wherein golf clubs have the biography in the counterweight part of the another part for the end for being integrated into club impact golf Sensor, and with for wearing at the handle tip of golf clubs or by athlete or more glove Second sensor, can calculate projected angle of impact for club.By knowing the angle of inclination (loft) of club striking surface, can be right Flight angle is calculated in golf.Additionally, by with sufficiently high speed the sensor of club end is sampled with Just determine and show that golf wherein hits the vibration of the striking surface of club, it may be determined that the quality of shock.These types Measurement and its analysis help athlete to make improvements, and allow athlete to buy at once suitable dress for debugging purposes Standby.(centering) data can be uploaded to data base and by data mining between two parties, so as to for example on the basis of manufacturer On find and have the relevant pattern of the bat of optimal average placed in the middle or minimum torque numerical value, racket or club, for product Improve.Any other unknown pattern found in data can also be presented or advise to user or carried out by user Search, or for example paid by manufacturer or user.
One or more embodiments of sensor can include such as mechanical eccentric counterweight etc charging feature, as As being utilized in some wrist-watches for being referred to as " automatic " or " self wind " wrist-watch, wherein alternatively include small power generation Machine or the inductive charging coil of the Indirect Electro mechanical charge for sensor power device.Other embodiment can be utilized to be used for The plug of the direct charging of sensor power device or based on electromechanical or micro electronmechanical charge member.One in the present invention Or can be using the micro- acquisition technique of the electric power of any other type in more embodiments.One or more embodiments of sensor can To utilize power saving feature, including the gesture for causing sensor energising or power-off.Such gesture can include motion, Physical switch with the contact of sensor, for example go to the wireless life of sensor from the mobile device being associated with particular sensor Order.The other elements that can couple with sensor for example include battery, low power microcontroller, antenna and radio device, heat Synchronous (heat sync), recharger and overcharge electric transducer.Additionally, embodiments of the invention are allowed one of system Divide or all components power-off, such as till determining that club is moved from the electronic signal of accelerometer or mechanical switch.
One or more embodiments of the present invention for example allow physical education facilities and the even elastic lag of body or EI to survey Amount.The embodiment of sensor along the shaft of golf clubs, tennis racket, baseball bat, ice stick, footwear, the arm of people or And the placement of any other non-fully hard article is allowed at the point between point or sensor residing for measurement sensor The quantity of flexing.Each sensor angle difference over time not only allows for calculating flexing distribution, and also allows for calculating Flexing depending on time or power is distributed.For example, it is known that EI machine determined using the static counterweight between the strong point EI is distributed.Therefore these machines cannot detect that EI distribution is depending on the time that applied power is also depending on applying power, example If EI distribution can be nonlinear with regard to power or time.There is the exemplary materials bag of different physical attributes known about the time Include Maxwell's material and non-Newtonian fluid.
User can also graphically watch captured exercise data on the display of the mobile device, or for example Watch on a pair of glasses comprising video display unitss.From the exercise data for being captured that the embodiment of capturing movement element is obtained The virtual reality for user that can also be utilized to strengthen in virtual environment shows.Looked in data base by data mining To the virtual reality of pattern or augmented reality view also comply with the spirit of the present invention.User is it can also be seen that for example aim at auxiliary Or aim at the enhancement information of guiding etc, its for example based on existing wind condition or consider dangerous (for example keep off for The tree of the desired destination of ball (such as hole) midway) show and should attempt wherein batting.
One or more embodiments of the present invention include motion event identification and video synchronizing system, and which includes to be configured to At least one capturing movement element that the mobile device for coupling with user or equipment or with user is coupled.Described at least one Capturing movement element can include:Memorizer;Sensing, the position being configured to capture with least one capturing movement element Put, the sensor of the combination in any of numerical value that speed and acceleration are associated;Radio device;With memorizer, sensor and nothing The microcontroller of line electric installation coupling.The microcontroller may be configured to collect the sensor values including from sensor Data, store data in memorizer, data be analyzed and pick out with event in data so as to determination event Data, the event data being associated with event by radio device transmission.The system can also include mobile device, described Mobile device includes computer, is configured to communicate to, with radio device, the event data that acquisition is associated with event Wireless communication interface, the wherein computer coupled with wireless communication interface, and wherein the computer is configured to from wireless Communication interface receiving event data.The computer can also analyze event data to form motion analysiss data, store event Data or motion analysiss data or event data and motion analysiss data all the two, from event obtain event initial time and Event dwell time, includes at least from event initial time to during the time span of event dwell time from camera request The view data of the video for being captured, and show event video over the display, including all following two:It is being engaged in Part initial time to event dwell time time span during institute's event data, motion analysiss data or which is any Combination;And from event initial time to the video for being captured during the time span of event dwell time.
The clock that some embodiments can be come in synchronization system using any kind of synchronous method, and at one or more In many embodiments, the computer on mobile device is further configured to determine the clock difference between capturing movement element and mobile device Different, and motion analysiss data and audio video synchronization.For example, one or more embodiments of the present invention are provided for causing The code of the information of multiple stage recording equipment synchronous time, position or sensing with regard to each equipment, such that it is able to combine from Distinct device with regard to event recorded data.Such recording equipment can be embedded type sensor, with camera or The mobile phone of mike, or be more generally to record any equipment to movable related data interested. In one or more embodiments, this is synchronously realized by exchanging information between devices, so that each sets Standby can reach an agreement in terms of the common measurement for time, position or sensing.For example, mobile phone and embedded biography Sensor can exchange the message of the current time stamp with its internal clocking;These message allow to consult, wherein two Equipment is reached an agreement in terms of common time.Such message periodically can be exchanged as required, so that before solving once The clock drift of the equipment after synchronization or motion.In other embodiments, multiple stage recording equipment can use common service Device or server set are to obtain the normalization measurement of time, position or sensing.For example, equipment can use GPS system To obtain the absolute location information corresponding to each equipment.GPS system can be utilized to obtain normalized temporal.NTP (net Network time protocol) server is also used as normalized temporal server.Individual device is allowed altogether by using server Reach an agreement in terms of with measurement, without being always configured to communicate with one another.
In one or more embodiments of the present invention, some of them recording equipment is configured to detect various things interested The generation of part.Some such events may occur in particular moment;Other such events may occur in interval of time, Wherein the detection includes the starting of detecting event and the end of event.These equipment are configured to using described above right Should be in the synchro measure of time, position and sensing basis to the combination in any of the time, position or sensing of recording equipment together with thing Number of packages evidence is recorded.
The embodiment of the computer on mobile device can be configured to discarding and fall in event initial time stop to event At least a portion video outside only.For example, in one or more embodiments of the present invention, some of them recording equipment Constantly data capture to memorizer while detecting event is waited.In order to save memorizer, some equipment can be joined It is set to and just locally deposits more permanent for data Cun Chudao only when data are in time adjacent to detected event Storage media or storage are to server.For example in the case of event is not detected by, the data of new record finally can deposited The data of precedence record are override in reservoir.Cyclic buffer can be used as one kind of such overriding scheme in certain embodiments Typical realisation.When event detection occurs, in addition to the data for capturing during the event of being stored in itself, recording equipment can A certain configured data volume after being terminated with a certain the configured data volume before the starting of storage event and event.Appoint Where front or posterior time interval is considered as a part for event initial time and event dwell time, so that for example The situation of event is shown in video.
The embodiment of the system can also include the server computer away from mobile device, wherein server computer It is configured to abandon at least a portion video outside event initial time to event stopping, and from event starting Time to event dwell time time span during the video that captured return to the computer in mobile device.
The embodiment of at least one capturing movement element is may be configured to event transmission at least another fortune Dynamic capture sensor or at least another mobile device or its combination in any, and wherein described at least another motion is caught Obtain sensor or at least another mobile device or its combination in any is configured to preserve the data being associated with the event. For example have and meanwhile operation multiple stage recording equipment embodiment in, this kind equipment can detect event, and to Other recording equipments send the message for showing that such event detection has occurred and that.The message can include event starting and/ Or the time labelling for stopping, wherein lock in time basis is used for the clock of individual device.Receiving device (such as other motions Capture sensor and/or camera) can be using event detection message non-volatile for data Cun Chudao being associated with event Storage device or storage are to server.In addition to the data being directly associated with event, the equipment may be configured to Storage event starting before certain data volume and event terminate after certain data volume.In this way, Suo Youshe Standby while record data, but can be initiated for from multiple using the event from an only wherein equipment The preservation of the distributed event data in source.
The embodiment of computer can be configured to preserve from event initial time to the video of event dwell time with And the motion analysiss data for occurring from event initial time to event dwell time, or can be preserved using remote server Video.In one or more embodiments of the present invention, some of them recording equipment wherein may generation event time period Interior possibly all cannot be directly communicated with each other all the time.In these cases, equipment may be configured to all numbers for having recorded which According to complete documentation be saved in permanent storage device or be saved in server.Only preserve the data being associated with event to exist Possibly cannot accomplish in the case of these, this is because some equipment possibly cannot receive event-triggered message.In these situations Under, can be processing to the data for being preserved afterwards, to extract and event phase detected by one or more Association is only related part.For example, multiple stage mobile device may record the video of athlete or performing artist, and Constantly the video is uploaded onto the server to be stored.The athlete or performing artist may individually be equipped with detection The embedded type sensor of the event of such as special exercise or action etc.Embedded type sensor data can by constantly or Later sometime upload to identical server.Due to including all including video flowing and embedded type sensor data Data are generally all added with time labelling, and the video being therefore associated with the event for being detected by embedded type sensor can be in clothes It is extracted on business device and combines.
The embodiment of server or computer is can be configured to when at least one capturing movement sensor and shifting When communication linkage between dynamic equipment is opened, abandon at least a portion outside event initial time to event stopping and regard Frequently, and preserve from event initial time to the video of event dwell time and from event initial time to event dwell time The motion analysiss data of generation.Or, if communication linkage is not opened, the embodiment of the computer can be configured to protect Video is deposited, and after event being received after communication linkage is opened, subsequently abandons to fall to stopping to event in event initial time At least a portion video outside only, and preserve from event initial time to the video of event dwell time and from event The motion analysiss data that time beginning occurs to event dwell time.For example in some embodiments of the invention, data can be as Front be uploaded to server describedly, and the position that is associated with the data flow of each equipment and point to data can by with To extract the data for detected event correlation.For example, a larger mobile device set can be used to Video is recorded at each position during whole golf tournaments.The video data can be by constantly or touring Upload onto the server after match.After tour, the sensing data with event detection can also be uploaded to identical Server.For these various data flows post processing can identify institute's event be physically adjacent to place and meanwhile record Particular video stream.Additional filter can select wherein camera positive sense to be correctly oriented the video with the event of observing Stream.These streams selected can be combined with sensing data, so as to form multiple video angles with the event that illustrates Aggregate data flow.
The system can be separated from the camera for being coupled with mobile device or with mobile device or by its other party Formula obtains video away from any camera of mobile device.In one or more embodiments, from the service away from mobile device Device obtains video, such as obtain after the inquiry of the video at for a certain position and time interval.
The embodiment of server or computer is may be configured to by the graphical analyses synchronously video and the event Data or the motion analysiss data, so as to more accurately determine in the video with the event initial time or institute State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this In one or more embodiments of invention, the clock between recording equipment can be synchronously approximate.May want to based on viewing Improve, from the event of each equipment, the accuracy that the synchronous data from multiple stage recording equipment feed.In one or more realities Apply in example, the process for multiple data flows is used to the signature of the event that observes in different streams, to help fine granularity same Step.For example, can be embedded type sensor and the mobile device synchronization for including video cameras, but time synchronized may Only it is accurate within 100 milliseconds.If video cameras are with 30 frame recording video per second, corresponding on embedded type sensor The frame of video of event detection be based solely within lock in time labelling can only be defined in 3 frames.A reality in the equipment Apply in example, it is possible to use video frame images process to determine the accurate frame for being most closely correspond to detected event.Citing For, can the skis for being detected by inertial sensor hit the vibrations on ground and the wherein geometrical boundary of skis and The frame correlation that ground comes in contact.Other image processing techniquess that other embodiment can be signed using detecting event or method are come Improve the synchronization of multiple data feeding.
The embodiment of at least one capturing movement element can include that coupled with microcontroller is configured to determine The position of position determines element, and wherein microcontroller is configured to the computer transmission position on mobile device.At one or In more embodiments, the system also includes server, and wherein microcontroller is configured to directly or by mobile device to clothes Business device transmits position, and its Computer or server are configured to stop based on position and event initial time and event Time forms event video from the various pieces of video.For example, in one or more embodiments, can be event video The event of length-specific is trimmed to, and any video quality is transcoded onto, and be superimposed with motion point in any manner Analyse data or event data (such as speed or acceleration information) or integrate therewith by other means.Video can according to It is locally stored with any resolution of storage video, depth or picture quality or compression type or any other technology, To maximize memory capacity or frame per second, or using any compression type to minimize storage, but regardless of mobile device, extremely Whether few communication linkage between a capturing movement sensor and/or server opens.In one or more embodiments, speed Degree or other motion analysiss data can for example be applied or be combined by other means in certain part below video, Including event starting and dwell time, before event starting and dwell time can include actual event and/or it Any number of seconds afterwards, for example to provide the video that hits before batting event.In one or more embodiments, described extremely A few capturing movement sensor and/or (multiple stage) mobile device can be sent to server event and video, wherein service Device can determine that particular video frequency and sensing data occur in ad-hoc location and special time, and from several videos and several biographies Sensor event tectonic event video.Sensor Events for example can be from the sensor for coupling with user and/or equipment Or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, deposit so as to for example greatly reduce video Storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or The microcontroller and computer are configured to determine the position of event and carry out correlation to position, and this is e.g. by para-position Putting carries out correlation or the average central point to provide event, and/or can minimize from initialization GPS sensor Erroneous position data.In this way, one group of user with mobile device can generate the video that golfer kicks off, The event location of an at least capturing movement equipment can be wherein utilized, and wherein server can obtain video from spectators And the event video that hits and bat of professional golfers is generated, wherein event video can be utilized from different photographies Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one Or multiple videos can be trimmed to the persistent period of event, such as from event initial time to event dwell time, and/or Person have around any in front or posterior scheduled time numerical value of event, so that it is guaranteed that capture including corresponding to hit or its Any time of his event and any holding posture time are in interior whole event.
In one or more embodiments, the computer on mobile device can be from least one camera of proximal event At least piece image or video of the request bag containing event, this is directed to by any camera in the region by directly broadcast The request of any video for shooting, its can alternatively include whether to be not only located at event nearby with regard to the camera but also Point to or by other means towards the directional information of event.In other embodiments, can be by the calculating on mobile device Machine asks video from remote server.In this case, any position being associated with event and/or time can be utilized To return image near event and/or video or the image for shooting in the time of the event that is close to and/or video or all The two.In one or more embodiments, computer or server can prune video to correspond to incident duration, and The various pieces of the further synchronous event of image processing techniquess, such as hitting with the respective frame in video can similarly be utilized Ball, which is matched with the acceleration information of the batting for corresponding on equipment.
The embodiment of the computer on mobile device or server may be configured to show that a certain event occurs or which In the list of one or more times that occurs of one or more events.In this way, user can be found from list Event is so as to rapidly Access Events video.
Embodiments of the invention can include at least one capturing movement sensing for physically coupling with the mobile device Device.These embodiments allow any kind of mobile phone with integrated sensor or camera chain (such as any types The camera laid of the helmet or including the whole any placing device of the two of camera and capturing movement sensor) generate thing Number of packages evidence and video data.
Description of the drawings
By the more specific description for being given later in connection with accompanying drawing, the idea passed on by present disclosure aforementioned Will become apparent from other aspects, features and advantages, wherein:
Fig. 1 shows one embodiment of motion event identification and video synchronizing system.
Figure 1A shows the logic hardware block chart of one embodiment of computer.
Figure 1B shows the Organization Chart of the one embodiment for the data base for being utilized in an embodiment of the present invention.
Fig. 1 C shows the one of the process that the embodiment corresponding to the computer in the system shown in Fig. 1 and 1A is implemented The flow chart of individual embodiment.
Fig. 1 D shows the data flow diagram of the one embodiment corresponding to the system.
Fig. 2A shows the placing device based on the helmet around user's head, wherein the placing device based on the helmet Fixing capturing movement sensor.Fig. 2 B shows the placing device based on neck insert (neck insert), and which allows using fortune Dynamic capture sensor is reequiped to the existing helmet.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, illustrated therein is the outside of capturing movement sensor and the helmet Isolator between part.
Fig. 4 A shows the top-sectional view of the helmet, liner, skull and user's brain.Fig. 4 B is shown corresponding in Fig. 4 A The rotation cerebral concussion event of each shown element.
Fig. 5 shows input power (G1) for the helmet with respect to observing in brain and by being placed in isolator The power that observes of sensor.
Fig. 6 shows the rotary acceleration numerical value of 3 axles together with total rotating vector quantity, together with obtaining from camera and The video of the cerebral concussion event for showing together with motion event data.
Fig. 7 shows that the timeline of user shows the peak along timeline together with the event being shown as along timeline Value and minimum angular velocity.Additionally, the curve shown in showing in bottom illustrates the lead and lag of golf clubs (lead and lag) determines high together with the sagging of golf clubs and drift (droop and drift), wherein these numerical value Degree of crook of the shaft of golf club in two axles that marks and draws with respect to the time.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, its allow with will be rolled to, be played to or from The input near start stop time point that the subevent that plays at this is associated, so as to easily allow to watch subevent.
Fig. 9 show each subevent start along the time and the relative position that stops and with starting and dwell time phase The gravitation of association, which allows the user input near these points to be attracted to starting and dwell time.
Figure 10 is shown by the use of a mobile device as capturing movement element and another mobile device as reception The motion event data of first user event and one embodiment of the computer of video.
Figure 11 shows the one embodiment for being utilized to the memorizer for storing the data relevant with potential event.
Figure 12 shows and is especially programmed in microcontroller to determine whether there occurs the one of the function of expected event The flow chart of individual embodiment.
Figure 13 shows typical Event Signing or template, and which is compared to eliminate mistake with motion capture data Positive events.
Figure 14 shows one embodiment of capturing movement element, and which is configured with locally displayed and viewing event phase The optional LED visual detector of pass information, and the word that is display configured to be associated with event or encoded messages can Select LCD.
Figure 15 shows the template properties of the motion event being associated with different types of equipment and/or tool medicated clothing One embodiment, can change more accurately or more efficiently to capture together with wherein capturing movement sensor individual character The region of the data being associated with special time period and/or subevent.
Figure 16 shows the front view of one embodiment of protectiveness facing and shows top view in the bottom of in figure, Which is for example worn in any contact sports, such as (and being not limited to) Association football, boxing, rugby, wrestling Or any other sports.
Figure 17 shows the one embodiment for the algorithm for being utilized by any computer in Fig. 1, and which is configured in combination Show moving image and motion capture data in form.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the present invention.
Figure 19 shows and detects event by one of capturing movement sensor, and event detection is sent to other motions Capture sensor and/or camera, preserve event motion data, and prune video to correspond to event.
Specific embodiment
A kind of identification of motion event and video synchronizing system and method will now be described.Explain in exemplary description below Many details are stated, to provide the more thorough explanation with regard to idea described in this specification.But this Skilled person will be recognized that, can put into practice in the case of it need not merge all aspects of detail as described herein The embodiment of idea as described herein.Additionally, particular aspects well-known to those skilled in the art are not described in detail, with Exempt to obscure present disclosure.Reader should note that, although elaborate the example of inventive concept in this disclosure, but The present invention is limited by the complete scope of claims and any equivalents.
Fig. 1 shows one embodiment of motion event identification and video synchronizing system 100.Some embodiments allow to be based on The viewing of event and low power event transmission and with execute application on the mobile apparatus and/or logical with external camera Letter, to specify the window in order to define event.Allow image or the identification of the motion event in video and event to specify, such as transport The batting of mobilization, movement or hit, athlete, boxer, the cerebral concussion of jockey or driver, or heatstroke, hypothermia, disease Burst, asthma attack, epilepsy, or including walk with fall down including any other physical culture or the related thing of body kinematicses Part.Can be event and the width or more multiple image that capture from one or more inner/outer camera or nurse's photographic head Or video carries out correlation, the first time for example to allow the video of preservation event, such as child walks, and acutely shakes event, Including the sport event including cerebral concussion, or the fall events being associated with old people.As illustrated, the enforcement of the system Example generally includes the application thereon of mobile device 101 and execution, and which includes that being shown positioned movement as dotted outline sets Computer 160 (that is referring further to the function view of the computer 160 of Figure 1A) inside standby 101, it is coupled to computer 160 Display 120 and the wireless communication interface that couples with computer (which is generally in the inside of mobile device, referring in Figure 1A Element 164).As the mobile phone with mobile computer is generally existing, therefore the user of the system can purchase One or more capturing movement elements and application (i.e. " app ") is bought, and to implement institute on its existing phone State one embodiment of system.Therefore, capturing movement ability is by affordable price for having had mobile phone, in terms of flat board Any user of calculation machine, music player etc. can use, and this is always impossible in the past.
Each mobile device 101,102,102a, 102b can alternatively include internal identifier reader 190 (for example RFID reader), or can be coupled with identifier reader or RFID reader (referring to mobile device 102) to obtain mark Symbol 191.Or, embodiments of the invention can be set to system transmission mark using any wireless technology in any equipment Standby 110 identifier.Embodiments of the invention can also include and at least one capturing movement sensor or user or equipment The identifier of any other type of coupling.In one or more embodiments, the identifier can include team and team uniform Number or student identification symbolic code or passport NO. or any other identifier, which allows relative uniquely identifying from spy Determine the particular event of user or equipment.This is allowed for regard to being configured to receive the data being associated with special exercise person or user Application (app) identify with multidigit athlete or user team sport motion or position.One or more embodiments are received Identifier, the passive RFID identifier being for example associated with athlete or user or MAC Address or other sequences number, and mark Know symbol to be associated with event data and motion analysiss data.
The system generally includes at least one capturing movement element 111, by placing device 192 and user 150 or dress Standby 110 coupling, for example, be coupled to golf clubs, baseball bat, tennis racket, ice stick, weapon, club, daggers and swords or for appointing Any other equipment of what sports, or such as footwear, belt, glove, glasses, medicated cap etc other physical education facilities or Any other article of person.At least one capturing movement element 111 can be placed on one end of equipment 110, both end Or any position between two ends or any position with user 150, for example it is placed on ball cap, headband, the helmet, facing Or in its combination in any, and also the EI measurement of any article can be used in.The capturing movement element can be optional Ground includes visual indicia (being passively or actively) and/or can include wireless senser, for example, can provide and capturing movement The associated one or more numerical value of the sensing (north south and/or up/down) of element, position, speed and/or acceleration any Any sensor of combination.The computer may be configured to for example by visual manner or wireless mode from club 110 The RFID of coupling obtains the identifier exclusive with each 110 (such as medicated clothing, bat etc.) of equipment (namely identifier 191) data for being associated and being alternatively associated with least one capturing movement element, analyze the data to be formed Motion analysiss data, and show motion analysiss data on the display 120 of mobile device 101.Capturing movement element 111 can To be placed in by capturing movement placing device 192, equipment is upper or which nearby or is placed in user or near which. The capturing movement element 111 being for example placed on the helmet can include isolator, and the isolator includes to be configured to around fortune Dynamic capture element so as to approximately about user's brain cerebrospinal fluid physics acceleration damping material, so as to minimize event The conversion of the linear acceleration and rotary acceleration of data, to obtain observation linear acceleration and the observation rotation of user's brain Acceleration.Process demand capturing movement element microcontroller on, and base for event data are so for example just reduced Transmission in event allows low memory to utilize and low-power requirements.From capturing movement element 111 motion capture data and The associated any data (such as identifier 191) of equipment 110 and with user 150 or any number of such user 150 (such as second user 152) associated any data can be stored locally in memorizer, or are stored in computer In local data base, or it is stored in remote data base, for example can be with the data base 172 of Coupled processors.For example When from capturing movement element 111 to mobile device 101 and from mobile device 101 to network 170 or the Internet 171 and to number When having network or telephony network links available according to storehouse 172, the data from each user 150,152 can be stored in data In storehouse 172.Subsequently with any number of user and its concrete property and show the large data collection that parameter is associated and close reality Apply data mining.For example in the golf embodiment of the present invention, club ID is obtained from golf clubs, and by motion Capture element detection batting.Mobile computer 101 stores the image/video of user, receives corresponding to event/hit/bat/transport The motion capture data of event location and follow-up batting on dynamic and court, and determine the parameter corresponding to each event (distance when such as event occurs or speed), and subsequently implement any local analytics, and show table on the mobile apparatus Existing data.When the network connection of from mobile device to network 170 or the Internet 171 is available, or for example golf is taken turns one After ball match, described image/video, motion capture data and performance data are uploaded to data base 172, for entering later Row analysis and/or display and/or data mining.In one or more embodiments, user 151 (such as original equipment manufacturer) Access for data base is paid, and this is, for example, the calculating by such as computer 105 or mobile computer 101 etc Machine, or from for example can pass through network 170, the Internet 171 or by website 173 communicated with data base 172 appoint What his computer, or form the part of data base 172 or server coupled thereto.Data mining can counted Execute according on storehouse 172, wherein can for example include local server computer, or can set in computer 105 or movement For operation on 101,102,102a or 102b, and for example access the free-standing embodiment of data base 172.Data mining results can With in mobile device 101, computer 105, television broadcasting or from camera 130,130a and 103b or 104 web video Upper display, or accessed by website 173, or its combination in any.
One or more embodiments of at least one capturing movement element can also include to be configured to send out in event The light-emitting component of output light in the case of life.This can be utilized to show potential, slight or weight on the Outboard Sections of the helmet Degree cerebral concussion, and without the need for any communication for example for any external equipment.Different colors or flash of light interval can also be utilized To pass on the information relevant with event.Alternatively or in combination, at least one capturing movement element can also be wrapped Audio output element is included, which is configured in the case of an incident or at least one capturing movement sensor Sound is exported in the case of outside the scope of computer, or wherein the computer is configured at least one fortune Display alarm in the case of capture sensor being moved outside the scope of computer, or aforementioned every combination in any.Sensing The embodiment of device can also utilize LCD, and which exports the volume of current event for example in quick response (QR) code or bar code Code division is analysed, and so as to for example allow referee locally to obtain the snapshot of code analysis on the mobile apparatus, and causes event Will not be watched with readable form on a sensor or be wirelessly communicated and intercepted by all other men.
One or more embodiments of the system can be using the mobile device for including an at least camera 130, institute State the computer that camera is for example coupled in mobile device.This allows for the computer command camera in mobile device 101 The 130 one or more images for for example obtaining user during physical culture movement.(several) image of user with showing and can be commented Fixed superposition, so as to for example cause motion analysiss data to be more appreciated that for the mankind.Or, the detailed data without user images Show and can also be shown on display 120, or on display of the example as shown in computer 105.In this manner it is achieved that Allow two dimensional image and follow-up display.If mobile device 101 includes two cameras, take the photograph as shown in mobile device 102 Shadow machine 130a and 130b, then the camera can be utilized to three-dimensional by for example creating for the graphical analyses of visual indicia Data acquisition system.So allow for determining and analyzing distance and the position of visual indicia.In any embodiment of the invention, come From the image of any camera and/or video can be stored on the data base 172 being for example associated with user 150 for Data mining purpose.In one or more embodiments of the present invention, graphical analyses can be implemented on image and/or video, So as to for example according to age of user 150 or match in the daytime when determine the board of utilized equipment, medicated clothing, footwear etc. Son/model, or find any other pattern in data.
Or, for the embodiment only with the mobile device of a camera, it is possible to use multiple stage mobile device is to scheme The form of picture obtains 2-D data, and carries out triangle polyester fibre to determine the position of visual indicia to which.In the system one In individual or more embodiments, mobile device 101 and mobile device 102a share the view data of user 150 to create three maintenance and operations Dynamic analytical data.It would be recognized by those skilled in the art that by determining the position of mobile device 101 and 102 (by such as equipment In the position of common GPS chip etc determine element or by cell tower triangle polyester fibre, its for clarity not by Illustrate but generally positioned at the inside of mobile device as computer 160), and by obtaining from capturing movement element 111 Data (location of pixels in the residing image in every piece image of such as visual indicia), it is easy to obtain distance and so as to Obtain speed.
Camera 103 can also be used in rest image, or be used in video as present institute is common.? In embodiment using the system of external camera, any method for obtaining data from external camera all meets the system Spirit, including the Wireless transceiver of data, or passes through wire communication for example when camera 103 is docked with computer 105, Which subsequently can be data transfer to mobile device 101.
In one or more embodiments of the system, it is not necessary to show the mobile device of motion analysiss data thereon With camera, that is to say, that mobile device 102b can also video data although being configured without camera.Therefore, mobile device 102b can be from mobile device 101,102,102a camera, any group of camera 103 and/or television camera 104 Close and image is obtained, as long as any external camera can be to mobile device 102b transmitted image.Or, completely without taking the photograph Shadow machine comes using the system.For example referring further to Figure 17.
For the data that television broadcasting, 111 Wireless transceiver of capturing movement element are received by antenna 106.So from The wireless sensor data that capturing movement element 111 is obtained is combined with the image for being derived from television camera 104, so as to produce Display with enhanced motion analysiss data, its can be broadcast to TV, computer (such as computer 105), movement set Standby 101,102,102a, 102b or be display configured to any other equipment of image.For example by knowing the position of camera (such as by GPS information) and direction and/or sensing by knowing camera institute direction is put, motion analysiss data can be by Position on display 120, as long as sensing data includes position data (such as GPS information).In other embodiments, Visual indicia or image procossing can be utilized to a motion analysiss data interlock to image, for example, can track height in the picture Golf club head, and corresponding high, the neutralization lower position of club can be utilized to determination user 150 for camera 130 or 104 or 103 sensing, so as to for example on the image for correctly marking and drawing user 150 through enhanced data.Pass through Labelling between the image added-time and labelling between the motion capture data added-time, such as the intervalometer in microcontroller and movement After timer synchronization and subsequent scanogram on equipment is to find visual indicia or the physical education facilities at each position, can So that the motion capture data through simplifying is added on image.Handle can be utilized in one or more embodiments of the present invention From any other method that the image of camera is combined with motion capture data.Spirit according to the present invention, it is possible to use Motion analysiss are properly located with regard to user on display 120 (or any other display on such as computer 105) Any other algorithm of data.For example, when event or event group is obtained by sensor, in application, event is received And/or in order to obtain the time range of image after, application can be from its local storage, any other mobile device, permissible The camera request of any other type for communicating is from the view data of the time span, and/or puts up event Position/time, so that can provide corresponding to (multiple) event in the local external camera system of (multiple) event Time view data.
Can generate on mobile device 101 and show one such show include using from mobile device 101,102, Two or the more multiple stage for selecting in the middle of 102a, camera 103 and/or television camera 104 or any other external camera The BULLET of cameraView.In the embodiment of the system, the computer is configured to obtain user 150 two width or more multiple image and with least one capturing movement element (no matter being visual indicia or wireless senser) Associated data, wherein two width or more multiple image are obtained from two or more multiple stage camera, and wherein institute State computer and be configured to generate and show, there is shown with normal speed and around the use shown in user under all angles The slow motion at family 150.Such embodiment for example allows one group of football fan to create the professional golfers of their own in tour In BULLETFilm.The film can be sent to computer 105, can implement to appoint on computer 105 What the image procossing needed for and for example broadcast to televiewer.In the other embodiment of the system, various mobile devices Users to share their own image collection, and/or for example by its uploading films to website for watching later.The present invention Embodiment also allow for using the athlete from other with mobile device on the mobile device relevant with another one user Image or video so that user need not for example exchange mobile phone.In one embodiment, when by first user pin When obtaining video to the physical education facilities in the motion that is not associated with the second user with video cameras mobile phone, permissible The video is automatically transferred to first user, to be shown using the motion capture data being associated with first user. Or, the mobile phone of first user can be utilized as motion sensor to substitute or supplement capturing movement element 111, and And the mobile phone of second user can be utilized to capture the video of first user at the volley.First user can be alternatively Make on phone gesture, tap/shake etc., with show the second mobile phone should for example start/stop motion capture.
Figure 1A shows one embodiment of computer 160.Include to execute the processor of software module in computer 160 161, the software module is generally also referred to as applied, and is stored in main storage usually as computer program instructions In 162.Display interface 163 drives the display 120 of mobile device as shown in Figure 1 101.Optional sensing/position module 167 can include north south or up/down point to chip or all the two.In one or more embodiments, the sensing/position Module can include that the position for coupling with microcontroller determines element.This can for example include GPS device.Alternatively or therewith Combined, the computer can cooperate with another computer to carry out triangle polyester fibre to position, or fixed from any other triangle The receptor of position type obtains position, or based on by couple with the computer and known sensing specific direction photography The image of machine capture calculating position, wherein the computer for example calculated based on the direction of the object in image and size with The side-play amount of mobile device.Optional temperature sensor can be coupled with processor 161 by wired or wireless link, and example Such as can by individually with the index as hypothermia or heatstroke, or with for example may indicate that shake or lose appointing for consciousness What detected motion is combined.Communication interface 164 can include wirelessly or non-wirelessly communication hardware protocol chip and/or RFID Reader, or RFID reader can be externally coupled to computer 160 or be for example coupled to by any other mode Computer 160.In one or more embodiments of the system, communication interface can include that phone and/or data communication are hard Part.In one or more embodiments, communication interface 164 can include Wi-Fi TM or 802.11 equipment of other IEEE and/orWireless communication interface orWireless device, or any other wireless technology.1st classEquipment has approximate 100 meters of scope, and the 2nd kind equipment has approximate 10 meters of scope.Low-power equipment has approximate 50 meters of scope.Can use in the embodiment of the system and appoint What wireless network protocol or type, as long as mobile device 101 and capturing movement element 111 can communicate with one another.Processor 161st, main storage 162, display interface 163, communication interface 164 and sensing/position module 167 can be by being commonly referred to as The communications infrastructure 165 of " bus " communicates with one another.Communication path 166 can include that permission is wired with other by network 170 Or the wired or wireless medium communicated by wireless device.Network 170 can be communicated with the Internet 171 and/or data base 172. Data base 172 can be utilized to preserve or fetch image or the video of user, or motion analysiss data, or according to certain The user that form is shown together with motion analysiss data.Upload to the Internet (namely remote data base or remote server or Person is away from the storage of system) data can by the viewing of any computer of the access for obtaining for data, analyze or enter line number According to excavation.This allows for original equipment manufacturer to determine that what physical education facilities works preferably for given user, and/or Any equipment will be advised.Data mining also allows for planning golf based on the data being associated with user and/or metadata Court, such as age or any other demographic information that can be imported in system.The long-range storage of data is also permitted Perhaps medical applications, such as morphological analyses, range of movement over time and diabetes control and exercise monitoring and compliance should With.Also allowed for using from other users, one or more previous performance of same subscriber based on the application of data mining Or historical movement person (for example after the athletic motion picture of analysis of history or video, no matter the historical movement person is No alive) real motion capture data play.Virtual reality and enhancing virtual reality applications can also be caught using motion Obtain data or historical movement data.The system also allows for the event that performance is related and/or motion capture data uploads to number According to storehouse 172, which for example may be implemented such that social network sites.This allows for user to send with regard to high score during or after match " push away literary (tweet) ", to notify the new event to everyone on the Internet.For example, one or more enforcements Example includes at least one capturing movement element 111, and which is configured to the mobile device for coupling with user or equipment or with user It is coupled, wherein at least one capturing movement element includes:Memorizer;It is configured to capture and at least one motion The sensor of the combination in any of the associated numerical value of the sensing of capture element, position, speed, acceleration;Radio device;And The microcontroller for coupling with memorizer, sensor and radio device.The microcontroller is configured to collection to be included to carry out autobiography The data of the sensor values of sensor, store data in memorizer, data are analyzed and are picked out in data Event is to determine event data, and the event data being associated by radio device transmission with event.The system Embodiment can also include the application for being configured to execute on the mobile apparatus, and wherein mobile device includes computer, is configured Become to communicate to obtain the wireless communication interface of the event data being associated with event with radio device.The computer Couple with wireless communication interface, its Computer executes application or " app " to configure the computer:Connect from wireless communication interface Event data is received, analysis event data is to form motion analysiss data, storage event data or motion analysiss data or event Both data and motion analysiss data are whole, and display includes and the event number that at least a user is associated over the display According to or motion analysiss data or whole information of the two.
Figure 1B shows the Organization Chart of the one embodiment for the data base 172 for being utilized in the embodiment of the system. As illustrated, table 180-186 include with regard to N position user, per user M part equipment, per user or per part equip P pass Sensor, the S item sensing data of each sensor, the T kind pattern, D position data user and the V video that find in other tables Information.The all tables for illustrating in Figure 1B be all exemplary, and according to for specific implementation mode is desired can To include more or less of information.Specifically, table 180 includes the information with regard to user 150, can wherein include and user Relevant data, such as age, height, body weight, sex, address or any other data.Table 181 includes to equip 110 with M part Relevant information, the type of the manufacturer that for example equips, the model of equipment and equipment, the equipment can include club, ball Bat, bat, shirt, trousers, footwear, glove, the helmet etc..For example in golf embodiment, at one of the present invention or In more embodiments, manufacturer can be the title of manufacturer, and model can be title or model number, and type can be Club numbers (such as No. 9 irons), and equipment ID can be identifier 191.Table 182 can be included with regard to user 150 or equipment 110 Or the information of the P sensor 111 on mobile computer 101.The sensor being associated with user 150 can include medicated clothing, ball Bar, the helmet, ball cap, headband, facing etc., the sensor being associated with equipment 110 can be for example motion capture data sensing Device, and the sensor being associated with mobile computer 101 can for example include for position/sensing sensor 167 and for The sensor 130 of image/video.Table 183 can include the information of the S item sensing data that equips with regard to per user per part, Wherein the table can include time and position or any other metadata relevant with sensing data of sensing data, than Temperature sensor as shown in pass through in Figure 1A is obtained or by radio communication or for example by any other side local The temperature of formula acquisition, weather, humidity, or sensing data can be including the information or its combination in any.The table is acceptable Comprising many other fields, such as ball type, that is to say, that in golf embodiment, the type of the golf for being utilized Can be saved and later data mining carried out to which to find out ball type for putting up the best performance etc..The table can also be wrapped The event type in local computing is included, for example potential cerebral concussion event.Table 184 can be included with regard to for example at data mining The information of the T kind pattern for finding in reason.This can include to have passed through the field that ad hoc inquiry searched in each table and Any obtained correlated results.In one or more embodiments of the present invention, can be according to for specific implementation mode institute Using any data mining results table type as expecting.This can include any kind of Search Results, including Can on a computer 160 local computing EI measurement, or from simply inquire complex patterns search any other search Numerical value.Table 185 can include the information with regard to D position data mining user 151 and can include its access type, that is, complete Full database or pattern table, or particular manufacturer etc. is limited to, the table can also for example include to dig corresponding to data Pick user has paid or the paying requirement of usage type agreeing to pay and/or receipt, and looks into any The relevant any search of inquiry or the pattern for being found or suggestion.Including allowing to sensing data (including motion capture data) The OODB Object Oriented Data Base relation of data mining or the data structure based on memorizer are carried out in any other interior scheme All meet the spirit of the present invention.Although give the exemplary embodiment corresponding to specific activities, those skilled in the art It will be recognized that, such as by using capturing movement element and operate in the existing cell phone 101,102 of user or other meters Application on calculation machine 105, the embodiment of the system can be captured and analyze any kind of based drive activity.Data The embodiment in storehouse can include the V video 179 being stored in table 186, wherein for example include to generate user, the video counts of video According to, time of video and position.The field is optional, and in one or more embodiments, video can be stored On any mobile device in systems or the combination in any of mobile device server/DB 172.In one or more realities Apply in example, video can be broken down into the video subset being associated with " time " field of sensing data table 183, wherein described Time field can include event initial time and event dwell time.In this case, larger video can be trimmed to about Become corresponding to one of generally less time window (which is associated with the event of the event type being stored in table 183) or more Much less event videos, so as to significantly reduce the video storage demand of the system.
Many applications are had to benefit from the embodiment of the system and realize by the embodiment of the system, its offer Watch on mobile computer or server/database and analysis motion capture data, so as to for example by user 151 to data base 172 carry out data mining.For example, user 151 can include compliance human observer, wherein for example include the head of a family, Er Tonghuo Old people, manager, doctor, insurance company, police, any other entity of army or such as equipment manufacturing business etc, its Data mining can be carried out for product improvement.By search corresponding to specific stature or age for example in tennis embodiment User highest serve speed, or by based in the sensing data field in table 183 in golf embodiment Speed of hitting carry out detection range (the namely difference between the ordinal position in table 183), so that it is determined which manufacturer has Optimal club or the optimal club of the age according to per user or height or body weight, or many other patterns.It is related to The other embodiment of compliance is allowed in the case of the threshold value (height or zero or any other grade) corresponding to gravity is met Generate from mobile computer 101 or the message from server/database, in order to it is sent to compliance human observer, management Person, doctor, insurance company etc., as already described above.User 151 can include marketing personnel, its determination Specific user has the article which correlation which equipment and other similar users may have, to be directed to specific user Sold.User 151 can include healthcare givers, its can determine for example with the footwear of Children with Diabetes (that is certain The equipment of type) sensor that couples carry out how many movements, and the mobile phase common non-diabetic child is had many Few, wherein can include to provide excitation for carrying out more exercises etc. for Children with Diabetes according to the suggestion of table 185, so that should Child is consistent with healthy children.Sports doctor, physiologist or Physical Therapist can utilize the data of per user, or Person scans in the middle of a large number of users and for example the specific movement of a certain user or range of movement is carried out with other users Relatively, can be improved in which field by stretching or exercise to determine given user, and which range of movement neck Domain changes over time according to user or according to colony, and for example user can using what type of equipment come tackle with The change (or even before these changes occur) of time.By to motion capture data and the view data related to motion Carrying out data mining unique advantage is provided for user 151.Number can be implemented in the flexing parameter for measuring by sensor According to excavation, so as to determine the pliability of physical education facilities, footwear, human body or any other article whether over time or Change or determine its combination in any between equipment manufacturing business.
During in order to ensure capturing movement, the analysis of user 150 is included that be associated relative with horizontal line (does not namely have Have inclination) image, the system can for example include on the computer 160 in mobile device 101 execute sensing module. The computer is configured to the sensing Notes of Key Data user based on the sensing hardware being derived from mobile device 101 along level Planar alignment camera.It would be recognized by those skilled in the art that it is common on the mobile apparatus to point to hardware.This allow for as The image of this capture keeps maintaining an equal level relatively with regard to horizontal plane.The sensing module can also point out user towards or away from the use Family travelling shot machine, or for user further focal length or zoom out focal length so as to user be placed on figure " debugging frame (fit Box in) ", so as to the size of the user that standardization will be captured to a certain extent.Image can also be utilized to prove by user Which has for example been deferred to for the doctor's advice for meeting special exercise requirement.
The embodiment of the system is further configured to recognize at least one motion being associated with user 150 or equipment 110 Capture element, and related for position specified by least one capturing movement element 111 and user 150 or equipment 110 Connection.For example, user can shake specific capturing movement element in the computer prompted being subject in mobile device 101, The identity of which capturing movement element asked by computer for confirmation.Or, can divide when known activity is implemented The position of analysis motion sensor data and/or speed and/or acceleration, and the riding position with regard to capturing movement element is automatic Being classified, or assumed position is confirmed by pointing out user.Sensor can be for example by team's title and team uniform number Code is associated with special exercise person, and is stored in the memorizer of capturing movement sensor for event transmission.In Fig. 1 Any computer for illustrating can be utilized to the identifier associated for special exercise capture sensor and be programmed, so as to Meet the spirit of the present invention.
One or more embodiments of the computer in mobile device 101 are configured to obtain an at least width of user 150 Image, and three-dimensional coating is shown at least piece image of user 150, wherein the three-dimensional coating and motion analysiss number According to associated.Various displays can be shown on display 120.The display of motion analysiss data can include and motion analysiss number According to associated evaluation, and/or the display of the ball flight path for being calculated being associated with motion analysiss data, and/ Or show along time shafts the time point that the peak value being associated with motion analysiss data is occurred timeline aobvious Show, and/or in order to help user to improve the suggestion training course of the ins and outs of the user.These are through filtering or analyzing Data pick-up result can be stored in data base 172, be for example stored in table 183, or can be on the database (or the server being associated with data base, or any other computer for example in the system shown in figure 1 or its combination In) undressed data are analyzed, and subsequently show on mobile device 101 or website 173, or for example pass through Television broadcasting from camera 104.In any manner data mining results can be shown phase with the unique of the system Combination, and also can be illustrated in any desired manner.
The embodiment of the system can also assume an interface, to allow 150 by mobile device 101 by no Line interface buying equipment 110, such as by the Internet or the computer by may be implemented such that the server of retailer 105 are bought.Additionally, for customization debugging equipment, such as putter shaft length or any kind of equipment any its He customizes size determination, and the embodiment of the system can assume an interface to allow user 150 by mobile device 101 Wave point come order customization debugging equipment.Embodiments of the invention also allow for mobile device 101 to 150 suggestiveness of user Can preferably equip, or allowing user 150 to be searched through, performance determined by data mining to be carried out to data base 172 more preferable Equipment, wherein for the golf of every ball bar of the user of the speed of hitting in the predefined scope having in user 150 Ball hitting distance carries out data mining.This allows for for example digging real-life performance data by user 151 (such as OEM) Dig and utilize to equip to the suggestion of user 150, and charged for this, this e.g. passes through to be directed to appointing as shown in Fig. 1 The access pay of the data mining results for showing in what computer or pass through website 173.In the one or more of the present invention In embodiment, data base 172 tracks OEM data mining, and is configured to for example for each user 151 in given note The quantity of the access that buys and/or use in the account period is charged to user 151.For example, see Figure 1B.
The embodiment of the system is configured to analyze the data for obtaining from least one capturing movement element, and is based on The intermediate degree for vibrating to determine the collision between ball and equipment of at least one capturing movement element for coupling with equipment, and Based on motion analysiss data display impingement position.The performance data are also stored in data base 172, and for example with The data mining that carried out in a large amount of collisions and by OEM or coach using advising the ball with higher hit probability placed in the middle Bar.
Although Figure 1A depicts physical equipment, the scope of system and method set forth herein can also cover specifically Virtual unit of the realization in one or more computer programs, virtual machine or simulator, the wherein computer program is held Row is on computer or computer system, and serves as or provide compatible with the method for implementing disclosed concept and process Computing system environments.Virtual machine, process, equipment etc. and the system physical computer system substantially similarly In the case of running, such virtual platform will also fall in the range of the system of present disclosure, although as described herein Physical system as shown in figure ia.
Fig. 1 C shows and corresponds to the pass the place for being implemented and allowed using the embodiment of computer in the system The flow chart of one embodiment of reason.In one or more embodiments of the system, at 301, alternatively calibrate multiple fortune Dynamic capture element.In certain embodiments, it means that the multiple sensors with calibration user or on equipment, to guarantee to pass Sensor is aligned and/or is configured to have same speed or acceleration value for given input motion.At this In the other embodiment of invention, it means that multiple capturing movement sensors are placed in calibration object, the calibration object Mobile and while calibration sensing, position, speed, acceleration or its combination in any.The step for generally include provide motion catch Obtain element and optional placing device (or alternatively allowing using the mobile device with capturing movement sensing function), and example Allow the user with existing mobile phone or computer utilize as described in system embodiment obtaining motion capture data simultaneously And potentially analysis based on this and/or the application of transmission message.In one or more embodiments, user simply can purchase Capturing movement element and application is bought, and begins to use at once the system.The system utilizes (multiple) capturing movement at 302 Element carrys out capture movement data, for example, be in motion capture data 303 and pick out any event, that is, beyond show brain shake The linear and/or rotary acceleration of the threshold value that swings, and at 304 for example motion capture data be sent to mobile computer 101, 102 or 105, can wherein include Phone or user can be utilized come the computer in any other type for being collected locally data.In one or more embodiments In, sensor can transmit event to any other capturing movement sensor, to start event for example in other sensors Data storage processing.In other embodiments, sensor can transmit event to other mobile devices, to show for example should The video corresponding to event is preserved in the case of unwanted video section is abandoned, so as to permission or the time point in event Nearby or in sometime pruning to video later.In one or more embodiments, the system is minimized and is passed The complexity of sensor, and for example process is unloaded to the ability for being found in existing mobile phone and other electronic equipments Be enough to competent computing element.From capturing movement element to the computer of user transmission data can may when occur, the cycle Property ground occur, occur on the basis of event, occur when polled or occur in any other manner, as will be at this In each chapters and sections described in as.This is two sides compared with the known system for continuously sending undressed data Face saves a large amount of electric power, can send data first in the time window for surrounding special exercise event in event packets, So as to a significant small subset data compaction to total unprocessed data, and secondly can be according to less than continuous The frequency of transmission or data are sent in the defined time or when data are solicited, to limit the total degree of transmission. In one or more embodiments, the LED for glistening on capturing movement sensor 111 can be for example utilized at 305 local Display event, such as yellow slow flash correspond to potential cerebral concussion, or red quick flashing is corresponding to the very high cerebral concussion of probability. Alternatively or in combination, can for example transmit and any other shown in FIG computer or mobile device on Display alarm or event.
Main intelligence in the system is typically found in mobile computer or server, can wherein utilize more many places Reason ability, and for example so as to the communication capacity using generally existing in existing mobile computer.In the system one In individual or more embodiments, mobile computer alternatively can obtain identifier, or the mark from user or equipment at 306 Symbol can be transmitted as a part for step 305, such as passive RFID or active RFID or such as team/team uniform number or Other identifiers of other athlete ID etc, which can be utilized which to determine based on the identifier of equipment by mobile computer Position user is just potentially injured, or what weight user is lifting, or user is wearing that what footwear is run, Huo Zheyong Family is currently in use any weapon, or user is currently in use what kind of activity.Mobile computer can locally divide at 307 Analysis motion capture data, and for example when threshold value is observed in data show (namely illustrating) or send for example message it The information of class, such as when athlete, soldier or racing driver stand excessive gravity, or when not there is enough motions (at that time or based on the data pattern in data base, the user is for example based on as discussed hereafter Typical movement pattern or other users motor pattern).In other embodiments, once user implement certain amount of Motion, can send a message to store or show by other means to (multidigit) safety or compliance human observer at 307 Registration evidence, wherein for example include referee, the head of a family, child or old people, manager, doctor, insurance company, police, army or Any other entity of person such as equipment manufacturing business etc.The message can be SMS message, Email, push away text or appoint What other kinds of electronic communication.If specific embodiment is configured for remote analysis or is used only for remote analysis, Then at 308, motion capture data can be sent to server/database.If implementation is not using teledata Storehouse, then the analysis on mobile computer is local.If implementation includes remote data base, can move at 309 Dynamic computer or server/database or all the two upper enforcement analyses.Once data base obtains motion capture data, subsequently Data can be analyzed, and desirably can send to compliance personnel or commercial entity from server/database Message, so as to individually show at 310 event or with the preceding events data being associated of the user or other users mutually group Close or show event with regard to the preceding events data.
Embodiments of the invention are used for the data from mobile computer and/or server to play, form compares, defer to Property, track burnt calorie, the work that is implemented, based on motion or in daytime and night different previous movement Pattern monitoring child or old people, when gravity stops beyond threshold value or motion for athlete, the safety monitoring of army, example As the honeycomb in the virtual reality applications for including the current and/or past data using user or the data from other users On phone, running, jump, throwing are captured to the local use of data, or implementing or entering line number based on user Music is played according to the type of the motion that excavates or select playlist.For example, if motion similar in data base Know athlete, then the playlist of the user can be sent to the mobile computer 101 of the user.The process can be Local enforcement, so as to play quick music if motion is very fast, and can play sound at a slow speed if motion is relatively slow Happy.Any other algorithm for music being played based on the motion of user all meets the spirit of the present invention.For from capturing movement element It is any using the spirit for all meeting the present invention with the motion capture data of the application acquisition on the existing mobile computer of user, Including exercise data used in reality environment, so as to using from the prior behavior of the user or from another The actual motion data of one user's (for example including historical movement person) illustrate the relative motion of the athletic incarnation of another one.Letter The display of breath is implemented typically by three kinds of situations, wherein display information be motion analysiss data based on user or Equipment and previous data with regard to user, wherein previous data can be from identical user/equipment or one or More multidigit other users/equipment.In this case, the elder generation being associated of current motion analysiss data and the user/equipment The comparison of front data is allowed using the extremely cost-effective system with capturing movement sensor and application come analytical model.? Under another kind of situation, the display of information is the performance according to active user, so that from the user or another user/equipment The past data of selection is the performance based on active user.This allows for the match of high realism, such as with historical movement person For the virtual tennis tournament of opponent, wherein actually by the capture movement from historical movement person, hitting for user is made back Should.Brought using this verity match of real data (current and previously stored data all the two) as true as possible Real match, such as user is played with the average mode of 10 tennis player before ranking as opponent, that is, service speed The speed and angle of the return of serve that degree, the given input for user are batted.For example television image can be analyzed to really Fixed by may alive historical movement person has not got batting hit speed and type, so as to be used with great master as opponent's test The skill at family, still alive and as currently just playing with user just as great master.Can be real in the third situation Compliance and the monitoring of the user or different user is applied, and need not be with the past data of the user or the elder generation of other users Front data are compared, and wherein the different user does not have for example with the access for mobile computer or movement Computer.In other words, mobile phone is associated with just monitored user, and different users is obtaining and for example wearing The relevant information of the current performance of the user (such as baby or diabeticss) for wearing capturing movement element.
Fig. 1 D shows the data flow diagram of the one embodiment corresponding to the system.As illustrated, from many inhomogeneities Multi-motion capture element 111 on the equipment 110 of type or being associated with user 150 sends motion capture data, its example Medicated clothing, the helmet, headband, ball cap, any other position for facing on or with user coupling such as are in.Equipment or user can Selection of land has identifier 191, its allow system numerical value with motion be associated, that is, lifting weight, be currently in use The type of racket, the type (namely game console) of electronic equipment being currently in use or other objects, such as with The associated baby's nightwear of two users 152 (such as baby).In one or more embodiments, capturing movement element can be used 111 substitute or strengthen the element 191 of in figure, as those skilled in the art will appreciate.One in the system Or in more embodiments, mobile computer 101 is for example with event form and for example on the basis of event or by moving Motion capture data is received during the request of computer 101, this is, for example, have data and reception in the statement of capturing movement element 111 Device opens set time amount with after replying and asking so as to avoid wasting electric power, without request is received, then connecing Receive device and close a period of time.Once data are in mobile computer 101, then data are analyzed, for example to obtain not Treated or based on event motion capture data, and for example determine easily according to simple and clear mode and understood by people The project such as such as average speed.The data can be stored (illustrating on the right side of mobile computer 101), and subsequently may be used In the form of for example according to human observer or compliance word or Email or with mobile computer 101 or computer 105 To user 150 or 151 video datas on associated display.This just potentially allows for not being associated simultaneously with capturing movement element And alternatively the user that is not even associated with mobile computer obtains human observer message (for example baby slowly breathes), or Person for example watches virtual reality match or performs, and can wherein include currently providing the user of motion capture data, have The user of previously stored data, or after the motion in the video of (many) tour performance to the past is analyzed Also include historical movement person (such as famous golfer) etc..Currently for example obtain from user 150 or equipment 110 wherein In the game scenario of data, such as the data display on virtual reality glasses can be utilized from the user/equipment or another The past data of one user/equipment, to respond to the current motion data of user, that is to say, that according to the input of user Respond.Previous data can be stored at any position in system, for example, be stored in mobile computer 101, meter In calculation machine 105 or it is stored on server or data base 172 (referring to Fig. 1).Previous data can for example be utilized to User 151 shows that user 150 has gone through certain number of potential cerebral concussion event, it is therefore necessary to treat special time amount Can have a return match.Insurance company can for example require such compliance to reduce medical expense.Can be from mobile computer 101st, computer 105 or on the server or store and take in the data base for coupling with server 172 as shown in fig. 1 Video is returned so as to event video is formed, the event video for example includes over the display while the event data that illustrates and event Video, which is generally for example applied or shows in the separate part of the display of mobile computer 101 or computer 105 Go out.
Fig. 2A shows the placing device based on helmet 110a of the head 150a around user, the wherein peace based on the helmet Put device to be fixed on the rear section of the helmet capturing movement sensor 111 as shown in figure.Fig. 2 B is shown in the helmet The bottom rear placing device based on neck insert shown partially, its permission is reequiped existing using capturing movement sensor 111 The helmet.Attached including to be configured to couple with the head 150a of user or being worn on user's head 150a by other means In the embodiment of at least one near capturing movement sensor, the microcontroller can be configured to calculate in user's head Impingement position.The calculating of the impingement position in user's head be based on user's head and/or helmet physical geometry.Citing For, if capturing movement element 111 shows the backward acceleration (as shown in the right side) without rotation, can lead to Cross tracking acceleration vector return to the circumference of the helmet or user's head outside direction calculating impingement position.This is non-rotating Calculate and actually show that the line of force, near the center of gravity of user's head/helmet or its, otherwise can be observed by capturing movement element 111 To revolving force.If observing lateral vector at capturing movement element 111, rum point is calculated as being in the helmet/head Side and through center of gravity.Thus, for example at least within the time period near acceleration peak value or in any other time Any other shock for not applying rotary acceleration to capturing movement sensor during section can be considered as being applied in On the direction for going to the helmet/head of center of gravity.Therefore, the calculating of rum point is calculated as detecting to the vector of power The intersection point of the outer perimeter of the helmet/head, and rum point is extended through by calculating the distance that goes back from center of gravity and angle to returning. For example, if acceleration does not rotate in 45 degree and not, rum point be from the center of gravity of the helmet/head to returning 45 Degree, therefore (radius (or 5 inches) of the helmet is multiplied by approximate 0.7) to the sine of calculating 45, so as to obtain apart from helmet front about 3.5 inches of shock.Or, impingement position can be maintained in angle form, so as to show shock be in apart from the helmet/ 45 degree of head front.If conversely, observing the rotary acceleration without linear acceleration, the helmet/head surrounds sensor Rotation.In this case, the power needed for rotation brain in front of the center of gravity through and generally be defined as through center of gravity and The line of sensor is orthogonal (such as side impact), will otherwise observe linear conversion acceleration.In this case, position is clashed into It is placed in the side relative with acceleration direction for being at the helmet/head.Therefore, for the both calculating of impingement position being can The example of the simplified calculation method to be utilized, but can also utilize in view of the quality of head/helmet and head/helmet Any other vector based method of size.A kind of such algorithm can utilize any mathematical equation, such as F=m*a, It is exactly that power is multiplied by acceleration, and moment of torsion=rXF equal to quality, wherein r is the position arrow of the lateral part office of head/helmet Amount, X are cross products and F is force vector, to calculate force vector, and are transformed back to the outer of the helmet/head if desired Circumference is to calculate the force vector being applied at the position.Although it is described with regard to the helmet, at least one motion The other embodiment of capture sensor is configured to any kind of placing device, encapsulation or coupling mechanism and medicated cap Or ball cap is coupled, is coupling in protectiveness facing.Can be for medicated cap/ball cap/facing using similar calculating, so as to from for example May indicate that the acceleration of cerebral concussion dependent event or any other quantity to determine the position/orientation of shock, linear or rotation Turn power.Some embodiments can include with least one capturing movement sensor or with the microcontroller for for example illustrating in figure ia The temperature sensor of device coupling.Temperature sensor can by individually with or with capturing movement elements combine, so as to for example Determine whether body or head shake, that is, show hypothermia, or determine whether movement is not detected by, and For example show body or brain higher than showing wirelessly or by the temperature of the temperature sensor measurement based on line The threshold value of heatstroke.
Embodiments of the invention can also using the isolator being configured to around at least one capturing movement element so as to Approximately about the physics acceleration damping of the cerebrospinal fluid of user's brain, so as to minimize linear acceleration and the rotation of event data The conversion of rotational acceleration, to obtain observation linear acceleration and the observation rotary acceleration of user's brain.Therefore, some enforcements Example need not be the power from the acceleration based on the helmet or acceleration value or any other numerical transformation to being observed Brain acceleration value, therefore embodiments of the invention are using less electric power and storage providing the data specific to event, So as to minimize the quantity of data transfer again, so as to cause lower delivering power to utilize.Based on the inherent liner in the helmet Type, can utilize different isolators on rugby/athletic helmet of ice hockey/lacrosse.Do not wear wherein The other embodiment for being utilized in the sports for helmeting or wearing once in a while the helmet can also utilize (example on ball cap or medicated cap As baseball player medicated cap on) at least one capturing movement sensor, together with least one for being placed on batting helmet Sensor.Not utilized in the sports (such as Association football) of ball cap wherein headband placing device can also be utilized come same Determine cerebral concussion.In one or more embodiments, head can be remained attached in a package using the isolator on the helmet Helmet, and sensor can be removed and be placed on another of isolator equipment of the damping for not utilizing coupling user's brain liquid On.Some embodiments can be based on the characteristic fortune being associated with certain types of equipment (namely surfboard is compared to baseball bat) Dynamic model formula automatic detection type of sports, and determine the type of the current accompanying equipment for arriving of capturing movement sensor.At one Or in more embodiments, a kind of algorithm that can be utilized to calculate the physical characteristics of isolator can include a motion to catch Obtain sensor to be placed on the helmet, and a capturing movement sensor is placed in the head dummy in crash tests manikin head In, the capturing movement sensor in its mesocrania is encapsulated in isolator.By applying linear and rotary acceleration to the helmet, And for example obtained by helmet sensor and by head dummy to observe with regard to the sensor in the corpse head that is placed in the helmet In the numerical value that observes of sensor in difference, it is possible to obtain be most closely matched mankind's brain damping with most The separator materials of good coupling damping values.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, illustrated therein is the outside of capturing movement sensor and the helmet Isolator between part.Embodiments of the invention may be configured to obtain/calculate linear acceleration numerical value or spin up Number of degrees value or all the two.This allows for monitoring rotational event for cerebral concussion and linear acceleration.As illustrated, outer Portion acceleration G1 can apply the lower acceleration that acceleration is more associated for being observed with mankind's brain, that is, pass through Using the G2 on the sensor 111 of the isolator 111c in sensor placing device 111b.This allow for for cerebral concussion and Linear acceleration is monitoring rotational event.Other events can using linear and/or rotary acceleration and/or speed, for example with Pattern or template are compared, so as to not only switch sensor individual character during event dynamically to change capture characteristic, and And also characterize the type of the equipment for utilizing together with current capturing movement sensor.This allows for the single by user Capturing movement element is bought and causes more than one piece equipment or medicated clothing tool, and this is caught by the sensor by allowing sensor to be based on The comparison of the motion for obtaining and characterizable motion pattern or template automatically determines the type of the equipment is coupled to by the sensor or medicated clothing.
Fig. 4 A shows the top-sectional view of the capturing movement element 111 being placed on helmet 110a, the helmet 110a Have around the skull 401 of user and the liner 110a1 of brain 402.Fig. 4 B is shown corresponding to each element for illustrating in Fig. 4 Rotation cerebral concussion event.As illustrated, different acceleration value may be applied in center of gravity 403 and by the helmet On the mankind's brain 402 and skull 401 that liner 110a1 in 110a is surrounded.As illustrated, in order to move in unit interval Dynamic, the front portion of brain must with speed G2a acceleration, speed G2a higher than the rear lateral portion office of brain speed G2c or Speed G2b of person center of gravity.Therefore, for given rotary acceleration numerical value, the zones of different of brain may be subject to different Impact.Therefore, one or more embodiments of the present invention can be transmitted not only relevant with linear acceleration but also be added with rotation The relevant information of speed.
Fig. 5 shows input power G1 (as shown being 500g) for the helmet with respect to the power for observing in brain G2, which is observed and be confirmed using known head dummy acceleration measurement system by the sensor being placed in isolator. Top-right curve illustrates head dummy system known to two kinds and confirms is caught based on the motion of isolator by illustrated in Fig. 4 A The acceleration value observed by the accelerometer that element 111 lays is obtained with regard to head dummy.
Fig. 6 shows the rotary acceleration numerical value of 3 axles together with total rotating vector quantity, together with obtaining from camera and The video of the cerebral concussion event for showing together with motion event data.In one or more embodiments, can for rotation (such as Figure shown in) or linear numerical shows the acceleration value from given sensor, this be, for example, by twice percussion mobile device Screen or by any other mode.Embodiments of the invention can utilize connectionless broadcast message to transmit and event phase The event data of association.In one or more embodiments, depending on the radio communication for being adopted, broadcast can include tool There is the payload of the data of limited quantity, which can be utilized to avoid shaking hands and expense based on the agreement for connecting.At which In his embodiment, can be according to combination in any come using connectionless or based on connection agreement.In this way, referee can To obtain the close instant reading of potential cerebral concussion dependent event on the mobile apparatus, so as to allow referee quickly to obtain Medical assist.
In one or more embodiments, computer can access the previously stored event being associated with user or equipment Data or motion analysiss data, so as to for example determine cerebral concussion fall down or other hit or any other motion event number Mesh.Some embodiments can also assume the event data being associated with least one user over the display, this be based on The associated event data of the user or equipment or motion analysiss data and with the user or equipment or with least one The associated previously stored event data of position other users or other equipments or motion analysiss data.This allow in number or In terms of quantitative value, motion event is compared, such as by the user or other users in particular game or in history On the maximum rotary acceleration that observes.Additionally, definition corresponding to typical event project equipment characterizable motion pattern or Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments In dynamicallyd update in capturing movement sensor by wave point.This allows for sensor to improve over time.Therefore, scheme Display shown in 6 could also indicate that the number of the cerebral concussion for being stored previously for given boxer/athlete, and permit Perhaps referee/doctor is maked decision with regard to whether the athlete can keep the field.
Embodiments of the invention can for example by radio and television or the Internet transmit information so as to computer or remote Shown on the visual displayss of journey computer coupling.Therefore, the display in Fig. 6 can also be for example to the spectators for watching Illustrate, to show to be applied to the quantity of the power with boxer/athlete/jockey etc..
Fig. 7 shows that the timeline of user shows 2601 together with the event being shown as along timeline along timeline Peak value and minimum angular velocity.Additionally, the curve shown in showing in bottom illustrates the advanced of golf clubs 2602 With delayed (lead and lag) together with the sagging of golf clubs and drift (droop and drift), wherein these numerical value Determine degree of crook of the shaft of golf clubs in two axles that marks and draws with respect to the time.Figure 8 illustrates one to show Show embodiment, on described display, be wherein labelled with timeline and the motion-related event (maximal rate that hits) of simplification.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, its allow with will be rolled to, be played to or from The associated start stop time point 802a-d in the subevent played at this (the meta during subevent for namely illustrating in Fig. 7 Put) neighbouring input, so as to easily allow to watch subevent.For example, golf is hit can include for example to take aim at Accurate (address), the subevent brandishing backward, brandish forward, impact, keeping posture (follow through) etc.Described System can show the time location corresponding to subevent 802a-d and receive the user input near the position, so as to sound Photopic vision frequency should start at the time point or stop, or is for example rolled to or returns to the time point to be easy to watch sub- thing Part.User input unit 801 can be utilized to the time be drawn near subevent, so as to for example video location in institute Desired time point.Another subevent time of such as statement alternatively or in combination, when video is played The user input of the finger pressing near point may indicate that video should stop at next subevent time point.User interface Control-towing point can also be utilized to, so as to video be more exactly synchronous to wherein to occur specific subevent or The frame of event.For example, user can pin control key and point 802b is pulled to the left or to the right, so as to frame of video The speed for being fitted on club head is zero point actual time, for example video to be closely synchronized to shown reality Motion analysiss data, here hit speed in terms of miles per hour.In the case of the spirit of the present invention is met, Ke Yili With any other user gesture user's frame synchronization to motion analysiss data, such as Voice command, arrow key etc..
Fig. 9 show subevent 802a and 802b start along timeline and the relative position that stops and with starting and stop The gravitation that only time correlation joins, which allows the user input near these points to be attracted to starting and dwell time.For example, When along timeline or so towing user interface elements 801, the user interface elements can be shown as towards potential trap 802a and 802b movement, so that user interface elements are easier to move to the start stop point of subevent.
In one or more embodiments, the computer is further configured to please from least one camera of proximal event Ask at least piece image comprising event or video.This can include from specific neighbouring camera or point to event direction The broadcast of camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour Nearly event or be directed to viewing event camera position request, and optionally for holding around events of interest The available camera of continuous time showing or the video at this.In one or more embodiments, the computer also by The list of one or more times of display event generation is configured to, desired so as to allow user to obtain by the computer Event video, and/or independently ask video from the third party with desired event time.The computer is also Video can be obtained from server 172, and locally video is being trimmed to desired event.This can be utilized to obtain Third party's video and the video from the system that still can not communicate with server 172 with the computer direct interface.
Figure 10 is shown by the use of a mobile device 102b as capturing movement element 111a and another mobile device 102a is used as the reception motion event data of first user event and one embodiment of the computer of video.From mobile device The view of 102a is illustrated in the upper left of the figure.In one or more embodiments, at least one capturing movement sensing Device is coupled with mobile device, and the internal motion sensor for being for example used in coupling in mobile device or with mobile device 111a.This allows for minimum level hardware using generally existing to carry out capturing movement and event recognition, such as using having The mobile device of built-in accelerometer.In one or more embodiments, the first mobile device 102b can be with record motion number According to user couple (which is shown here as carrying out Halfpipe), the second mobile device 102a be then utilized to record The video of motion.In one or more embodiments, the user for experiencing motion can provide gesture, such as in mobile device Upper percussion n times, the mobile device so as to show second user should start recording video or stop recording video.Can utilize and appoint What his gesture transmits the instruction that event is related or motion is related between mobile device.
Therefore, embodiments of the invention can recognize any kind of motion event, including with show to stand, OK Walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or breathing no more or which The relevant event of moving of combination in any, or the event of any other type of the persistent period for moving with period. Event can also for example include with known signature or mate any kind of mould by other means with any granularity Plate or the subevent of pattern, including the amplitude in the linear or specific collection of rotary shaft and/or time threshold.Citing comes Say, show that slide plate is released a series of event of (push-off) or promotions and can be grouped into the son for for example " preparing manipulation " etc In event, and the rotary shaft in X then for example may indicate that " slide plate is turned over/rolled ".In one or more embodiments, event can be by Packet and storage/transmission.
Figure 11 shows the one embodiment for the memorizer for being utilized to data storage.Memorizer 4601 can for example be collected Become the microcontroller in capturing movement element 111, or can be for example as single memory chip and microcontroller coupling Close.Memorizer 4601 as depicted may be configured to include one or more storage buffers 4610,4611 and respectively 4620、4621.The one embodiment for the storage buffer that can be utilized is circular buffer.Circular buffer can be by reality Apply into and repeatedly override, till event occurs.The length of circular buffer can be from 0 to N number of memory cell.For example There can be M circular buffer, for example, correspond to M impact event.Digital M may be greater than zero any numeral.At one Or in more embodiments, digital M can be equal to or more than the number of expected event, such as number of hits, or take turns corresponding to one high The batting number of golf ball match, or allow all motion capture datas to be stored on capturing movement element until at one or Any other number of mobile computer or the Internet is downloaded to after more events.In one embodiment, for example claimed Make the head of the pointers track buffer of head pointer (HEAD).As data are recorded in a buffer, head pointer is by reach Dynamic appropriate quantity, so as to point to next free storage unit.When the buffers get full, pointer unrolls opening to buffer Head, and override when previous numerical value is run into.Although data are written, but are depending on size and the record of buffer Speed, at any time (t) have from the time (t) to return record sensing data.As sensor is remembered in a buffer Record data, " event " in one or more embodiments stops overriding buffer with new data.When event is detected, sensing Device can continue record data in the second buffer 4611, for example to record special time amount under specific capture speed Event after data, so as to complete the record of expected film.Storage buffer 4610 includes now from event to the institute's phase that returns The data record of the time quantum (this is depending on size and the capture speed of buffer) of prestige, together with event posterior bumper 4611 Data after event.For example, see Figure 19, video can also be stored in a comparable manner and is trimmed to about later.
For example in golf is hit, event can be club head and ball impact.Or, event can be club head Portion makes impact with the ground, consequently, it is possible to causing error event.In other embodiments, event can be shown that cerebral concussion event User's head acceleration, or from weapon-shooting, or ball impact baseball bat, or when user moves to highest weight When putting and put down carrying out another repetition.Event anterior bumper stores the sensing data till crash, thing Sensing data after part posterior bumper storage crash.One or more embodiments of microcontroller are configured to analysis Event, and determine that event repeats, shoots or the event of such as impact or mistake impact etc.If event is according to pattern Or signature or template are considered validity event (referring to Figure 13 and 15) rather than error event, then by another storage buffer 4620 are used for motion capture data, till it there is second event.After the event occurs, captured data are utilized Filling event posterior bumper 4621.
Specifically, capturing movement element 111 may be implemented such that one or more MEMs sensors.The sensor can To be command by collecting data with specified time interval.In each interval, data are read from various MEMs equipment and store In circular buffer.The number value set for reading from MEMs sensor is considered a frame (FRAME) data.Depending on just by The type of the data being collected and stored in buffer, frame data can be 0,1 or multiple memory cells.One Frame data are also associated with a time interval.Therefore, based on the capture speed from sensor, each frame also with time quantum phase Association.For example, if with each frame of 2ms interval filling, 1000 frames will include the data (2 seconds) of 2000ms.General next Say, frame need not be joined with time correlation.
Data constantly can be stored in circular buffer, and for example in specified event, time or when logical Cross radio device/antenna go to mobile device or any other computer or memorizer communication available when or work as example As by when mobile device order (namely " poll ") or in any other desired event, data are written out to non- Volatile memory, or by wirelessly or non-wirelessly linking or being sent to remote memory by radio device/antenna Or equipment.
Figure 12 shows especially to be programmed in microcontroller and will transmit for application-specific to determine whether there occurs Event function one embodiment flow chart, the event is, for example, expected event or is, for example, the thing that has occurred and that Part.Motion, acceleration or the shock wave for occurring from the shock for physical education facilities is sent to the sensing capturing movement element Device, the sensor records motion capture data as described in Figure 11 above.The microcontroller is configured Become with event described in post analysis, and determine the event whether expected event.
The a type of event for being occurred is acceleration, or the sensor based on the head/helmet/ball cap/toilet article is super Go out the linear or rotation numerical that specifies, or shock of the face when golf is clashed into.Using ball and impact tool Application identical analysis in other sports, but the analysis is adjusted to specific sports and physical education facilities.? In tennis, it is contemplated that impact can be for example that racket is hit a ball, rather than racket is rotated before receiving.In such as running shoes etc Other application in, clash into detection algorithm can detect that when someone runs footwear hit ground.In exercise, which can be The special exercise that is reaching, this is with regard to for example allowing in weight lifting or number of repetition being counted while ride stationary bicycle Number.
In one or more embodiments of the present invention, process and start from 4701.At 4702, microcontroller is specific In collision time framework, the motion capture data in memorizer 4610 is compared with the linear speed for exceeding specific threshold, and And wherein there is the discontinuity threshold value higher than the suddenly change in the speed of specific threshold or acceleration in search at 4703.Such as There is no speed or the discontinuity in such as acceleration in fruit in defined time window, then process and continue at 4702 Continuous.If discontinuity occurs really, at 4704, expected shock is preserved in memory, and data after clashing into are protected Deposit given time P.For example, if clashing into threshold value to be set to 12G, discontinuity threshold value is set to 6G, and hits It is 10 frames to hit time frame, then the 12G acceleration at least one axle for detecting 10 frame ins or all axles and subsequent After the discontinuity of 6G, the signal of microcontroller 3802 shows to clash into.In typical event, acceleration sets up characteristic acceleration Write music line.Clash into the quick change being expressed as in acceleration/speed.These changes are typically different than passing by specific non-event The smoothed curve created by increasing or decline curve.For the event based on cerebral concussion, the linear or rotation in one or more axles Acceleration exceeds certain threshold value.For the event of golf correlation, if accelerating curve is hit with regard to golf, Specific axle has a specific acceleration for meeting signature, template or other patterns, and hit that ball causes to show to hit larger Acceleration spike.If the given template of Data Matching, which is saved, and continues if it does not match, processing and returning at 4702. If determining at 4705 to preserve data outside, that is to say, that there is the communication linkage for going to mobile device, and for example Mobile device just in poll or has requested that shock data when that occurs, then at 4706, event transmission is deposited to outside Reservoir or mobile device or will be stored in outside which at any other position, and process and continue at 4702 again, wherein Microcontroller is for the collected motion capture data of successor analysis.If data will not be preserved outside, process Continue at 4702, and be held locally within data are clashed in memorizer 4601.If being sent to outside, other motions are caught The equipment of obtaining can also preserve its exercise data for the event for being detected by another sensor.This for example allows for more smart The other sensors that thin resolution or the sensor alert that more does more physical exercises are associated with user or equipment preserve event, even if fortune Dynamic capture data do not reach specific threshold or pattern (for example, see Figure 15).Such process provides more robust Event detection, this is because multiple sensors can be utilized detecting certain types of event, and notify for various originals Because the other sensors of event schema may be mismatched.Additionally, camera can be informed that and prune or by its other party Formula abandons unwanted video and preserves the video of event correlation, such that it is able to reduce the event of being not only and also video Memorizer is utilized.In one or more embodiments of the present invention, noise can be filtered from motion capture data before transmitting, And sample rate can be changed based on the value data for being obtained, to maximize accuracy.For example, some sensors exist Inaccurate data are exported under high sampling rate and high gravity.Therefore, by declining low sampling rate in high gravity, accuracy is protected Hold.In one or more embodiments of the present invention, the microcontroller being associated with capturing movement element 111 can sense Gao Chong Power and the sample rate that automatically switches.In one or more embodiments, replace using with 6G/12G/24 scope or 2G/4G/ The accelerometer of 8G/16G scope, it is possible to use the accelerometer with 2 scopes (such as 2G and 24G) is to simplify at each The logic for switching between scope.
One or more embodiments of the present invention can be event transmission to mobile device, and/or for example for one Take turns golf range game or continue event to store in memory till realizing mobile device communication link.
For example for the sensor being placed in specific placing device, typical Event Signing is figure 13 illustrates, Additionally referring to by two kinds of characteristics shown by for example associated from different equipments or medicated clothing pattern or template in Figure 15 The comparison of type of sports.In one or more embodiments, microcontroller is configured to execution pattern matching algorithm to follow Corresponding to the curve of each axle, and using 1 or more multiaxis fragment come determine linear or rotary acceleration or its Whether there occurs in combination in any that characteristic is hit.If the motion capture data in memorizer 4601 be in shown in Figure 13 In the close enough scope of numerical value that typical case hits, then move consistent with event.Therefore, characterize first mobile angle and/ Or after linear speed signature, and usually determine whether to there occurs the class corresponding to future event followed by the unit of the signature Like signing, embodiments of the invention reduce the number of the false positive in event detection.
Capturing movement element is from each sensor collection data.Data capture speed can be higher, and if so If, then to capture mass data.Depending on concrete application, embodiments of the invention can use lossless and Lossy Compression Algorithm The data that comes on storage sensor.Compression algorithm allows capturing movement element in given resource IT more data.Transmission To (multiple stage) remote computer is also compressed data.The transmission of compressed data is faster.Compressed data is also stored on In " high in the clouds " in the Internet, or it is stored on data base, so as to locally take less space.
Figure 14 shows one embodiment of capturing movement element 111, and which is configured with locally displayed and viewing thing The optional LED visual detector 1401 of part relevant information, and the word or encoded for being display configured to be associated with event The optional LCD 1402 of message.In one or more embodiments, the LED visual detector can be for the brain of moderate type Concussion slow flash yellow, and the cerebral concussion quick flashing redness for severe form, so as in the case of without the need for any radio communication Provide the quick overview with regard to event.Additionally, LED can show some flashes of light or other colors, to show any temperature phase Pass event or other events.One or more embodiments can also adopt LCD 1402, and which can for example illustrate word or replace Can show that the encoded messages corresponding to sensitive health related information, referee or medical professional are for example permissible with changing Using the appropriate reader application on mobile device, which is read out and decodes.In the lower right-most portion of the figure, LCD shows Device can produce the encoded of statement " 1500 degree/s/s of potential cerebral concussion rotational event detection-alert medical professional immediately " Message.The message of other paralysis diagnostic messages or any other possibly sensitive type can be encoded and locally be shown Showing, user/athlete/boxer is succoured without disappearing due to diagnosis so as to for example allow medical professional to immediately begin to Breath startles other athletes, or without the need for wirelessly transmitting the message in the air to avoid intercepting.
Figure 15 shows the template properties of the motion event being associated with different types of equipment and/or tool medicated clothing One embodiment, can change more accurately or more efficiently to capture together with wherein capturing movement sensor individual character The region of the data being associated with special time period and/or subevent.As illustrated, showing in acceleration plots 1501 Characteristic corresponding to slide plate releases (push off), shows X, Y and z axis in the curve chart 6 timelines up Property acceleration and rotary acceleration numerical value, the wherein time goes forward one by one to the right.As illustrated, when user promotes slide plate by each step When, the discrete positive x-axis acceleration for being captured is shown at 1502 and 1503, is followed by promoting it each time with tail skid Between slack-off negative acceleration.Additionally, each time promote during y-axis swing also be captured to, and slide plate release or drive Change without z-axis linear acceleration in the specific template or pattern and without rotary acceleration.Or, the pattern is permissible Including one group of threshold acceleration in the x at predefined time window and corresponding to other threshold values or not right for swinging Wherein for example the data for being captured should be compared therewith in the threshold value for swinging, to automatically determine capturing movement element quilt The type of the equipment that equipment that be placed to or known is currently experiencing.This for example allow based on event data preserve and Transmission.
But pattern or template in curve chart 1511 show running event, wherein user during running event slightly Accelerate up and down.Due to the speed relative constancy of user, in x, acceleration is therefore relatively free of, and as user does not turn, Therefore in y, (left/right) is relatively free of acceleration.The pattern can for example be utilized to carry out in the range of corresponding to running Relatively, wherein the pattern includes the z-axis acceleration in time predefined window.Therefore, top in the middle of curve chart 1511 Three curve charts can be utilized as the pattern in order to labelling running event.Three curve charts of lower section can be in 1514 Hes Illustrate at 1515 and show when capturing movement element is placed in the helmet and/or facing user to being captured of watching of both sides Data, and the data 1516 for being captured then may indicate that and be observed by the rotary motion of per square of second sufficiently high angle number Moderate or severe cerebral concussion.Furthermore, it is possible to sensor individual character is dynamically changed at 1516 or at any other threshold value, For example to change capture speed or the capture bit size of capturing movement sensor, so as to more accurate in amplitude or in terms of the time True ground capturing events.This allows for dynamically changing capture quality for the period interested and/or dynamically changes work( Rate is utilized, and this is unknown in the art.In one or more embodiments, for example, the helmet, facing is placed in for utilizing The embodiments of the invention of the temperature sensor in interior or any other equipment or in user's body, can also record temperature Timeline.
Figure 16 shows the front view of one embodiment of protectiveness facing 1601 and shows top in the bottom of in figure View, which is for example worn in any contact sports, such as (and being not limited to) Association football, boxing, rugby, Wrestling or any other sports.The embodiment of facing can be worn to supplement with or without capturing movement element Any other head wear, to increase the motion capture data that is associated with user, and being worn from user The exercise data of any or all capturing movement element and/or event are carried out correlation or are combined by any other mode Or compare.The embodiment of facing and/or the helmet in shown in Fig. 2A-B or any other equipment can also for example be wrapped Temperature sensor is included, as previously discussed.
Figure 17 shows the one embodiment for the algorithm for being utilized by any computer in Fig. 1, and which is configured in combination Show moving image and motion capture data in form.In one or more embodiments, motion capture data and anything The start stop time of part correlation can be stored on capturing movement element 111.One or more embodiment bags of the present invention A kind of identification of motion event and video synchronizing system is included, which includes the shifting for being configured to couple with user or equipment or with user At least one capturing movement element that dynamic equipment is coupled.At least one capturing movement element can include:Memorizer;Quilt Be configured to capture the numerical value that be associated with the sensing of at least one capturing movement element, position, speed and acceleration times The sensor of meaning combination;Radio device;The microcontroller for coupling with memorizer, sensor and radio device.The micro-control Device processed may be configured to collect the data including the sensor values from sensor, store data in memorizer, right Data are analyzed and pick out the event in data to determine event data, by radio device transmission and event phase The event data of association.The system can also include mobile device, and the mobile device includes computer, is configured to and nothing Line electric installation communicates to obtain the wireless communication interface of event data being associated with event, wherein the computer and Wireless communication interface is coupled, and wherein the computer is configured to from wireless communication interface receiving event data.The computer Event data can also be analyzed to form motion analysiss data, storage event data or motion analysiss data or event data and Motion analysiss data all the two, obtain event initial time and event dwell time from event, from camera request include to Few from event initial time to the view data of the video for being captured during the time span of event dwell time, and aobvious Show on device and show event video, including all following two:From event initial time to the time of event dwell time Institute's event data, motion analysiss data or its combination in any during span;And from event initial time to thing The video for being captured during the time span of part dwell time.
When communication channel is available, start stop time of motion capture data and any event correlation is at 1701 Be pushed to any computer (such as 101,102,102a, 102b, 105), or obtained by any computer or by its He receives mode.The timing differential between the clock on sensor and/or in the motion capture data time can also be obtained.This can With by the current time stamp in reading incoming message and the incoming message time is current with the clock of local computer Time is compared to implement, for synchronous more details for example referring further to Figure 18.From sensor and the clock of computer In difference can be utilized at 1702 from any local or for consider any timing differential and through overregulating Time points to the camera request view data of event location.For example, computer can be by inquiring about all cameras 103rd, 104 or equipment 101,102 and/or the camera on 102a asking the image for shooting at the time/position, its In any or all described equipment have the image (such as based on GPS location or wireless range) for nearby shooting and/or Point to the event for being derived from capturing movement element 111.If equipment is not located at nearby but is directed to the position of event, join as working as Pass through when having magnetometer determined by its position and sensing like that, then which can also be by the figure corresponding to the time range As responding.Be able to can be queried by any kind of camera for electronically being communicated, including Nurse's photographic head etc..For example, the thing from capturing movement sensor 111 can received by mobile computer 101 Message is sent after part, and the wherein message can be sent to for instance in appointing in the wireless range of mobile computer 101 What camera.Alternatively or in combination, mobile computer 101 can send solicit in event location predefined away from From interior any photography identity, even if or inquiry sensing event direction any camera being not relatively close to.? Receive potential camera list when, mobile device 101 can for example to its inquiry around event predefined window in Any image for obtaining.At 1703, computer can receive view data, or if computer is coupled with camera Then local, image can be searched.In one or more embodiments, server 172 can with iteration through video and event so as to Determine any correlation video and event, and automatically prune video so as to corresponding to event starting and dwell time lasting when Between.Although radio communication can be utilized, the view data transmission of any other form also complies with the spirit of the present invention.No matter It is in numeral or figure coating form or can including the data from event in any other form of word Be illustrated together with the respective image corresponding to the time, or the respective image corresponding to the time is added at 1704 On.This is illustrated by graphics mode at time 1710 (i.e. current time) place, and which is for the capturing movement for illustrating with superposition The image 1711 of one frame of the motion event of data 1712 is e.g. rotatable.For data that are combination or being no superimposed simultaneously For example, see Fig. 6.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the present invention.One The clock that a little embodiments can be come in synchronization system using any kind of synchronous method, and in one or more embodiments In, the computer 160 on mobile device 101 is further configured to determine the clock between capturing movement element 111 and mobile device Difference, and motion analysiss data and audio video synchronization.For example, one or more embodiments of the present invention are provided for making The code of the information of multiple stage recording equipment synchronous time, position or sensing with regard to each equipment is obtained, is come such that it is able to combine From distinct device with regard to event recorded data.Such recording equipment can be embedded type sensor, with camera Or the mobile phone of mike, or more generally it is can to record to set to movable related any of data interested Standby.In one or more embodiments, this is synchronously realized by exchanging information between devices, so that each Equipment can be reached an agreement in terms of the common measurement for time, position or sensing.For example, mobile phone and embedded Sensor for example can wirelessly exchange the message of the current time stamp with its internal clocking across link 1802; These message allow to consult, and wherein two equipment are reached an agreement in terms of common time.Such message can be according to need Periodically to exchange, so as to solve previous subsynchronous after the clock drift of equipment or motion.In other embodiments, many Platform recording equipment can obtain the standardization degree of time, position or sensing using common server or server set 1801 Amount.For example, equipment can obtain the absolute location information corresponding to each equipment using GPS system.GPS system is also Can be used to obtain normalized temporal.NTP (NTP) server is also used as normalized temporal server. Individual device is allowed to reach an agreement in terms of common measurement by using server, without being always configured to communicate with one another.
Figure 19 shows and detects event by one of capturing movement sensor 111, transmission event detection (here by It is shown as other capturing movement sensings for sending from centrally located sensor 111 and going to such as mobile device 101 Device 111 and/or the arrow of camera), event motion data are preserved, and video are pruned to correspond to event.The present invention's In one or more embodiments, some of them recording equipment is configured to detect the generation of various events of interest.Some are such Event may occur in particular moment;Other such events may occur in interval of time, and the wherein detection includes The starting of detecting event and the end of event.These equipment be configured to using described above corresponding to the time, position and The synchro measure basis of sensing is recorded to the combination in any of the time, position or sensing of recording equipment, and which is for example together with thing Number of packages evidence is included together in storage buffer 4610, or in any other data structure.
The embodiment of the computer on mobile device can be configured to discarding and fall in event initial time stop to event At least a portion video outside only, for example event or with predefined front and rear interval 1902 and 1903 event Before and after part 1910 and 1911.For example, in one or more embodiments of the present invention, some of them are recorded Equipment is constantly data capture to memorizer while detecting event is waited.In order to save memorizer, some equipment are permissible It is configured to just more permanent for data Cun Chudao only when data are in time adjacent to detected event Ground storage medium or storage are to server 172.For example in the case of event is not detected by, the data of new record can be most The data of precedence record are override eventually in memory, and this is depending on each equipment for recording exercise data or video data In memorizer quantity.One kind typical case of the cyclic buffer as such overriding scheme can be realized in certain embodiments Mode.When event detection occurs, in addition to the data for capturing during the event of being stored in itself (i.e. 1901), recording equipment can It is terminated with a certain the configured data volume (being close to the starting in space before 1902) before the starting of storage event and event A certain configured data volume (being close to 1903) afterwards.Any event initial time is considered as in front or posterior time interval With a part for event dwell time so that for example illustrating the situation of event in video.This just gives feelings for event Border, for example, can be set in the quantity of front time interval according to sports, so as to the preparation for allowing golf to hit (setup) become a part for event video, although which occurred before the actual event of impact golf.Can also basis It is the interval quantity record holding posture in rear interval distribution.
The embodiment of the system can also include the server computer away from mobile device, wherein server computer It is configured to abandon at least a portion video outside event initial time to event stopping, and from event starting Time to event dwell time time span during the video that captured return to the computer in mobile device.Server or Mobile device can be motion analysiss data or event data (such as speed or undressed acceleration information) and video phase To form event video 1900 in combination or the video that is added to, such that it is able to the quantity of the video storage needed for greatly reducing, This is because the time span of part 1910 and 1911 generally may be more much bigger than event.
The embodiment of at least one capturing movement element is may be configured to event transmission at least another fortune Dynamic capture sensor or at least another mobile device or its combination in any, and wherein described at least another motion is caught Obtain sensor or at least another mobile device or its combination in any is configured to preserve the data being associated with the event. For example have and meanwhile operation multiple stage recording equipment embodiment in, this kind equipment can detect event, and to Other recording equipments send the message for showing that such event detection has occurred and that.The message can include event starting and/ Or the time labelling for stopping, wherein lock in time basis is used for the clock of individual device.Receiving device (such as other motions Capture sensor and/or camera) can use event detection message data Cun Chudao being associated with event for instance in Capturing movement element 111 or mobile device 101 or the Nonvolatile memory devices in server 172.Except straight with event 1901 Connect outside associated data, the equipment may be configured to the certain data volume before the starting of storage event and event knot Certain data volume (being 1902 and 1903 respectively) after bundle.In this way, all devices can while record data, but It is to be initiated for the distributed event data from multiple sources using the event from an only wherein equipment Preserve.
The embodiment of the computer can be configured to preserve regarding from event initial time to event dwell time Frequency and the motion analysiss data that occur from event initial time to event dwell time, or can using remote server come Preserve video.In one or more embodiments of the present invention, some of them recording equipment wherein may generation event when Between possibly all cannot directly communicate with each other all the time in section.In these cases, equipment may be configured to the institute for having recorded which The complete documentation for having data is saved in permanent storage device or is saved in server.The number that with event be associated only is preserved According to possibly accomplishing in these cases, this is because some equipment possibly cannot receive event-triggered message.At these In the case of, can be processing to the data for being preserved afterwards, to extract and one or more detected events Associated is only related part.For example, multiple stage mobile device may record the video of athlete or performing artist, and And constantly the video is uploaded onto the server 172 to be stored.The athlete or performing artist may be individually equipped with energy The embedded type sensor of the event of enough detection such as special exercise or action etc.Embedded type sensor data can be by constantly Or later sometime upload to identical server.Due to including including video flowing and embedded type sensor data All data generally all added with time labelling, the video being therefore associated with the event for being detected by embedded type sensor can To be extracted on the server and combine.The embodiment of server or computer is can be configured to when at least one fortune When communication linkage between dynamic capture sensor and mobile device is opened, abandon outside event initial time to event stopping At least a portion video, and preserve from event initial time to the video of event dwell time and from event initial time To the motion analysiss data that event dwell time occurs.Or, if communication linkage is not opened, the embodiment of the computer is also May be configured to video is preserved, and after event being received after communication linkage is opened, subsequently abandon to fall to rising in event Time beginning is at least a portion video outside event stopping, and preserves regarding from event initial time to event dwell time Frequency and the motion analysiss data for occurring from event initial time to event dwell time.For example in some embodiments of the present invention In, data can be uploaded as previously described server, and the position that is associated with the data flow of each equipment and refer to Can be used to extract the data for detected event correlation to data.For example, a larger mobile device Set can be used to record video at each position during whole golf tournaments.The video data can be held Upload onto the server continuously or after tour.After tour, the sensing data with event detection can also It is uploaded to identical server.Post processing for these various data flows can identify the physics in institute's event Adjacent place is while the particular video stream of record.Additional filter can select wherein camera positive sense to be correctly oriented to see Examine the video flowing of event.These streams selected can be combined with sensing data, illustrates many of event so as to be formed to have The aggregate data flow of individual video angle.
The system can be separated from the camera for being coupled with mobile device or with mobile device or by its other party Formula obtains video away from any camera of mobile device.In one or more embodiments, from the service away from mobile device Device obtains video, such as obtain after the inquiry of the video at for a certain position and time interval.
The embodiment of server or computer is may be configured to by the graphical analyses synchronously video and the event Data or the motion analysiss data, so as to more accurately determine in the video with the event initial time or institute State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this In one or more embodiments of invention, the clock between recording equipment can be synchronously approximate.May want to based on viewing Improve, from the event of each equipment, the accuracy that the synchronous data from multiple stage recording equipment feed.In one or more realities Apply in example, the process for multiple data flows is used to the signature of the event that observes in different streams, to help fine granularity same Step.For example, can be embedded type sensor and the mobile device synchronization for including video cameras, but time synchronized may Only it is accurate within 100 milliseconds.If video cameras are with 30 frame recording video per second, corresponding on embedded type sensor The frame of video of event detection be based solely within lock in time labelling can only be defined in 3 frames.A reality in the equipment Apply in example, it is possible to use video frame images process to determine the accurate frame for being most closely correspond to detected event.For More details are referring to Fig. 8 and its description.For example, can be the cunning as shown in Figure 17 for being detected by inertial sensor The vibrations that snow slab hits ground are related to the frame that the geometrical boundary of wherein skis and ground come in contact.Other embodiment is permissible Other image processing techniquess for being signed using detecting event or additive method are improving the synchronization of multiple data feeding.
The embodiment of at least one capturing movement element can include that coupled with microcontroller is configured to determine The position of position determines element, and wherein microcontroller is configured to the computer transmission position on mobile device.At one or In more embodiments, the system also includes server, and wherein microcontroller is configured to directly or by mobile device to clothes Business device transmits position, and its Computer or server are configured to stop based on position and event initial time and event Time forms event video from the various pieces of video.For example, in one or more embodiments, for example can move On any other computer for coupling on equipment 101 or on server 172 or in computer 105 or with system, event is regarded Frequency is trimmed to the event of length-specific, and is transcoded onto any video quality, and in any manner with motion analysiss Data or event data (such as speed or acceleration information) are superimposed or integrate therewith by other means.Video can be according to Any resolution, depth or picture quality or compression type or any other technology in order to store video are locally deposited Storage, to maximize memory capacity or frame per second, or using any compression type to minimize storage, but regardless of movement sets Whether the communication linkage between standby, at least one capturing movement sensor and/or server opens.In one or more embodiments In, speed or other motion analysiss data can for example be applied or combine a certain portion below the video by other means On point, including event starting and dwell time, before event starting and dwell time can include actual event and/ Or any number of seconds afterwards, for example to provide the video that hits before batting event.In one or more embodiments, institute State at least one capturing movement sensor and/or (multiple stage) mobile device can be sent to server event and video, wherein Server can determine that particular video frequency and sensing data occur in ad-hoc location and special time, and from several videos and several Individual Sensor Events tectonic event video.Sensor Events for example can be from the biography for coupling with user and/or equipment Sensor or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, regard so as to for example greatly reduce Frequency storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or The microcontroller and computer are configured to determine the position of event and carry out correlation to position, and this is e.g. by para-position Putting carries out correlation or the average central point to provide event, and/or can minimize from initialization GPS sensor Erroneous position data.In this way, one group of user with mobile device can generate the video that golfer kicks off, The event location of an at least capturing movement equipment can be wherein utilized, and wherein server can obtain video from spectators And the event video that hits and bat of professional golfers is generated, wherein event video can be utilized from different photographies Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one Individual or multiple videos can be trimmed to the persistent period of event, such as from event initial time to event dwell time, and/ Or with any in front or posterior scheduled time numerical value around event, so that it is guaranteed that capture including corresponding to hitting or Any time of other events and any holding posture time are in interior whole event.
In one or more embodiments, the computer on mobile device can be from least one camera of proximal event At least piece image or video of the request bag containing event, this is directed to by any camera in the region by directly broadcast The request of any video for shooting, its can alternatively include whether to be not only located at event nearby with regard to the camera but also Point to or by other means towards the directional information of event.In other embodiments, can be by the calculating on mobile device Machine asks video from remote server.In this case, any position being associated with event and/or time can be utilized Come return image that is near event or shooting in the time of the event that is close to and/or video or all the two.At one or In more embodiments, computer or server can prune video to correspond to incident duration, and similarly can profit With the various pieces of the further synchronous event of image processing techniquess, the batting of the respective frame such as having in video, its for example with Acceleration information corresponding to the batting on equipment matches.
The embodiment of the computer on mobile device or server may be configured to show occurred a certain event or Wherein there is the list of one or more times of one or more events.In this way, user can be from list Event is found so as to rapidly Access Events video.
Embodiments of the invention can include at least one capturing movement sensing for physically coupling with the mobile device Device.These embodiments allow any kind of mobile phone with integrated sensor or camera chain (such as any types The camera laid of the helmet or including the whole any placing device of the two of camera and capturing movement sensor) generate thing Number of packages evidence and video data.
Although idea disclosed herein is described by specific embodiment and its application, without departing substantially from claim In the case of the scope of the present invention for being illustrated in book, those skilled in the art can many modifications may be made and change.

Claims (31)

1. a kind of motion event is recognized and video synchronizing system, and which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to, Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time; And
Wherein the computer is further configured to abandon outside the event initial time to the event dwell time The video at least partially, and store not and have outside the event initial time to the event dwell time The event video of the part of the video.
2. the system of claim 1, wherein, the computer be further configured to determine at least one capturing movement element with Timing differential between the mobile device, and the motion analysiss data and the audio video synchronization.
3. the system of claim 1, wherein, the computer is further configured to from the event initial time to the event The video of dwell time and the motion analysiss for occurring to the event dwell time from the event initial time Data are saved in the server computer outside the computer together, without falling in the event initial time to the thing The part of the video outside part dwell time.
4. the system of claim 1, wherein, the system also includes the server computer away from the mobile device, and Wherein the server computer is configured to from the event initial time to the video of the event dwell time Preserve together with the motion analysiss data for occurring to the event dwell time from the event initial time, and handle Returning from the event initial time to the video for being captured during the time span of the event dwell time The computer in the mobile device.
5. the system of claim 1, wherein, the computer is further configured to when at least one capturing movement element and institute When stating the communication linkage opening between mobile device, abandon outside the event initial time to the event dwell time At least a portion video, and from the event initial time to the video of the event dwell time with from The motion analysiss data that the event initial time occurs to the event dwell time are preserved together.
6. the system of claim 1, wherein, the computer is further configured to when at least one capturing movement element and institute State and the video when communication linkage between mobile device is not opened, is preserved, and receive after the communication linkage is opened After the event, subsequently abandon at least a portion institute outside the event initial time to the event dwell time State video, and from the event initial time to the video of the event dwell time with from the event starting when Between to the event dwell time occur the motion analysiss data preserve together.
7. the system of claim 1, wherein, the video is obtained from the camera for coupling with the mobile device.
8. the system of claim 1, wherein, the video is obtained from the camera away from the mobile device.
9. the system of claim 1, wherein, the video is obtained from the server computer away from the mobile device.
10. the system of claim 1, wherein, at least one capturing movement element is further configured to be worn on user's head Near, and the event in the identification data includes the impingement position in calculating user's head.
The system of 11. claim 1, wherein, at least one capturing movement element be further configured to the helmet or medicated cap or Ball cap or facing coupling.
The system of 12. claim 1, wherein, at least one capturing movement element is further configured to couple with the helmet, and The event for recognizing in the data includes that the physical geometry based on the helmet calculates the shock position in user's head Put.
The system of 13. claim 1, which also includes to be configured to the isolator around at least one capturing movement element, So as to the physics acceleration damping of the cerebrospinal fluid of the brain approximately about the user, so as to minimize the event data Linear acceleration and the conversion of rotary acceleration, the observation linear acceleration and observation to obtain user's brain spins up Degree.
The system of 14. claim 1, wherein, the computer is further configured to by the graphical analyses synchronously video and institute State event data or the motion analysiss data, so as to more accurately determine in the video with the event starting when Between or the event dwell time or all the two most closely related initiation event frame or stopping event frame or whole two Person.
The system of 15. claim 1, wherein, the system also includes server computer, wherein the server computer quilt It is configured to by the graphical analyses synchronously video and the event data or the motion analysiss data, so as to more accurate Ground determine in the video with the event initial time or the event dwell time or all the two is most closely related The initiation event frame of connection or stopping event frame or all the two.
The system of 16. claim 1, wherein, the computer is further configured to:
Access the previously stored event data or motion analysiss data being associated with the user or equipment;
Wherein, the display event video is also included to be presented based on the following over the display and is associated with the user The event data:
The event data being associated with the user or equipment or motion analysiss data;And
The described previously stored event data being associated with the user or equipment or motion analysiss data;Or
The described previously stored event data being associated with least one other users or other equipments or motion analysiss data.
The system of 17. claim 1, wherein, the microcontroller at least one capturing movement element is also configured Become the event transmission at least another capturing movement element or at least another mobile device or its combination in any, And wherein described at least another capturing movement element or at least another mobile device or its combination in any are joined Being set to, the data being associated with the event are preserved based on the event initial time and the event dwell time.
The system of 18. claim 1, which also includes:
The identifier for coupling with least one capturing movement element or the user or the equipment;
Wherein, the computer is further configured to:
Receive the identifier;And
The identifier is associated with the event data and the motion analysiss data.
19. the system of claim 1, wherein, at least one capturing movement element also includes to be configured in the event The light-emitting component of output light in the case of generation.
The system of 20. claim 1, wherein, at least one capturing movement element also includes audio output element, and which is joined The scope being set in the case that the event occurs or at least one capturing movement element in the computer Outside in the case of export sound, or wherein the computer is configured to be at least one capturing movement element Display alarm in the case of outside the scope of the computer, or aforementioned every combination in any.
The system of 21. claim 1, wherein, at least one capturing movement element also includes to couple with the microcontroller The position for being configured to determine position determine element, and wherein the microcontroller is further configured to pass to the computer The position is sent, or wherein the system also includes server computer, and wherein the microcontroller is further configured to The position is transmitted to the server computer, and wherein the computer or server computer are further configured to be based on The position and the event initial time and the event dwell time from the various pieces of at least one video formed to A few event video.
The system of 22. claim 1, wherein, the microcontroller or the computer are further configured to determine the event Position, or wherein the microcontroller and the computer are further configured to determine the position of the event and enter position Row is related.
The system of 23. claim 1, wherein, the computer is further configured at least one photography from the neighbouring event Machine or from server computer request bag containing at least piece image of the event or video.
The system of 24. claim 1, wherein, the computer is further configured to broadcast and for the neighbouring event or is referred to Always the request of the camera position of the event is watched.
The system of 25. claim 1, wherein, the computer is further configured to show that the event has occurred or wherein one The list of one or more times that individual or more events has occurred.
The system of 26. claim 1, wherein, at least one capturing movement element is physically coupled with the mobile device.
The system of 27. claim 1, wherein, the microcontroller is coupled with temperature sensor, and the wherein microcontroller It is further configured to transmit the temperature for being derived from temperature sensor using as temperature event.
The system of 28. claim 1, wherein, the event data includes:
The exercise data being associated with least one capturing movement element, the wherein at least one capturing movement element with The combination in any of the user or the equipment or the mobile device is coupled;Or
Show to stand, walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or The exercise data for breathing no more;Or
Its combination in any.
A kind of 29. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to, Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time; And
Away from the server computer of the mobile device, wherein, the server computer is configured to:
Obtain the part fall without the video outside the event initial time to the event dwell time The event video, wherein do not have outside the event initial time to the event dwell time at least one Divide the video;And
From the event initial time to regarding described in being captured during the time span of the event dwell time Frequency returns to the computer in the mobile device.
A kind of 30. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to, Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time; And
When the communication linkage between at least one capturing movement element and the mobile device is opened, abandon described Event initial time at least a portion outside event dwell time video, and from the event starting when Between to the event dwell time the video and the institute that occurs to the event dwell time from the event initial time State motion analysiss data to preserve together.
A kind of 31. motion event identifications and video synchronizing system, which includes:
At least one capturing movement element that mobile device is coupled for coupling with user or equipment or with user is configured to, Wherein at least one capturing movement element includes:
Memorizer;
It is configured to capture the number being associated with the sensing of at least one capturing movement element, position, speed and acceleration The sensor of the combination in any of value;
Radio device;
The microcontroller for coupling with the memorizer, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collecting includes the data of the sensor values from the sensor;
The data storage in which memory;
The data are analyzed and pick out with the event in the data to determine event data;
The event data being associated with the event by radio device transmission;
Mobile device, which includes:
Computer;
Wireless communication interface, which is configured to:
Communicate to, with the radio device, the event data that acquisition is associated with the event;
Wherein the computer is coupled with wireless communication interface, and wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysiss data;
Store the event data or the motion analysiss data or the event data and the motion analysiss data are whole The two;
Event initial time and event dwell time are obtained from the event data;
Request is included at least from the event initial time to being captured during the time span of the event dwell time The view data captured by the utilization camera of video;
Show event video over the display, including all following two:
From the event initial time to the event for occurring during the time span of the event dwell time Data, the motion analysiss data or its combination in any;And
From the event initial time to the video for being captured during the time span of the event dwell time; And
Regard described in preserving when the communication linkage between at least one capturing movement element and the mobile device is not opened Frequently, after and receiving the event after the communication linkage is opened, subsequently abandon in the event initial time At least a portion to outside event dwell time video, and from the event initial time to the event The video of dwell time and the motion analysiss number for occurring to the event dwell time from the event initial time According to preserving together.
CN201580033463.0A 2014-04-21 2015-04-21 Motion event identification and video synchronizing system and method Active CN106464848B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/257,959 2014-04-21
US14/257,959 US9076041B2 (en) 2010-08-26 2014-04-21 Motion event recognition and video synchronization system and method
PCT/US2015/026896 WO2015164389A1 (en) 2014-04-21 2015-04-21 Motion event recognition and video synchronization system and method

Publications (2)

Publication Number Publication Date
CN106464848A true CN106464848A (en) 2017-02-22
CN106464848B CN106464848B (en) 2019-07-02

Family

ID=54333090

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580033463.0A Active CN106464848B (en) 2014-04-21 2015-04-21 Motion event identification and video synchronizing system and method

Country Status (6)

Country Link
EP (1) EP3017598A4 (en)
JP (1) JP2017521017A (en)
CN (1) CN106464848B (en)
AU (1) AU2015249884B2 (en)
CA (1) CA2917542C (en)
WO (1) WO2015164389A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107016686A (en) * 2017-04-05 2017-08-04 江苏德长医疗科技有限公司 Three-dimensional gait and motion analysis system
CN108307175A (en) * 2018-02-08 2018-07-20 华南理工大学 Dancing dynamic image based on flexible sensor captures and goes back original system and control method
CN109247909A (en) * 2017-07-12 2019-01-22 台湾安莉莎医疗器材科技股份有限公司 Physiological monitoring system
CN110190959A (en) * 2019-06-28 2019-08-30 中南大学 Encipher-decipher method based on continuous variable quantum nerve network
CN110543861A (en) * 2019-09-05 2019-12-06 深圳前海达闼云端智能科技有限公司 early warning method, server and early warning system
CN110639197A (en) * 2019-09-27 2020-01-03 上海淡竹体育科技有限公司 Sports test method, device and system
CN112752100A (en) * 2020-12-28 2021-05-04 杭州海康威视系统技术有限公司 Method and device for determining video integrity and readable storage medium
CN113326828A (en) * 2021-08-03 2021-08-31 湖南涉外经济学院 Sports tactics identification method and system
CN113542774A (en) * 2021-06-04 2021-10-22 北京格灵深瞳信息技术股份有限公司 Video synchronization method and device, electronic equipment and storage medium
US11504581B2 (en) 2019-09-06 2022-11-22 Taylor Made Golf Company, Inc. Systems and methods for integrating measurements captured during a golf swing

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6761765B2 (en) * 2017-02-20 2020-09-30 株式会社プロップ Heat stroke prevention device
EP3672233A1 (en) * 2018-12-21 2020-06-24 Axis AB Method for carrying out a health check of cameras and a camera system
JP7169213B2 (en) * 2019-02-05 2022-11-10 株式会社日立製作所 Physical health video analysis device, method and system
US11789843B1 (en) 2019-07-05 2023-10-17 Cornerstone Research Group, Inc. Event detection sensor and recording system
KR102100675B1 (en) * 2019-12-06 2020-05-15 주식회사 대산테크디자인 Method for manufacturing golf shoe insole
CN112291520B (en) * 2020-10-26 2022-12-06 浙江大华技术股份有限公司 Abnormal event identification method and device, storage medium and electronic device
WO2023097304A1 (en) * 2021-11-24 2023-06-01 Dreamsports Technology Development (Beijing) Co., Ltd. System and method for measuring activity performance
CN114554114B (en) * 2022-04-24 2022-08-16 浙江华眼视觉科技有限公司 Express item code recognition machine pickup evidence persistence method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050021292A1 (en) * 1996-12-12 2005-01-27 Vock Curtis A. Systems and methods for determining performance data
CN103026345A (en) * 2010-06-02 2013-04-03 惠普发展公司,有限责任合伙企业 Dynamic multidimensional schemas for event monitoring priority
CN103533235A (en) * 2013-09-17 2014-01-22 北京航空航天大学 Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene
CN103717994A (en) * 2011-06-20 2014-04-09 因文森斯公司 Motion determination

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8886298B2 (en) * 2004-03-01 2014-11-11 Microsoft Corporation Recall device
US20070150138A1 (en) * 2005-12-08 2007-06-28 James Plante Memory management in event recording systems
US8702516B2 (en) * 2010-08-26 2014-04-22 Blast Motion Inc. Motion event recognition system and method
WO2013184832A2 (en) * 2012-06-07 2013-12-12 Zoll Medical Corporation Systems and methods for video capture, user feedback, reporting, adaptive parameters, and remote data access in vehicle safety monitoring

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050021292A1 (en) * 1996-12-12 2005-01-27 Vock Curtis A. Systems and methods for determining performance data
CN103026345A (en) * 2010-06-02 2013-04-03 惠普发展公司,有限责任合伙企业 Dynamic multidimensional schemas for event monitoring priority
CN103717994A (en) * 2011-06-20 2014-04-09 因文森斯公司 Motion determination
CN103533235A (en) * 2013-09-17 2014-01-22 北京航空航天大学 Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107016686A (en) * 2017-04-05 2017-08-04 江苏德长医疗科技有限公司 Three-dimensional gait and motion analysis system
CN109247909A (en) * 2017-07-12 2019-01-22 台湾安莉莎医疗器材科技股份有限公司 Physiological monitoring system
CN108307175B (en) * 2018-02-08 2020-01-14 华南理工大学 Dance dynamic image capturing and restoring system based on flexible sensor and control method
CN108307175A (en) * 2018-02-08 2018-07-20 华南理工大学 Dancing dynamic image based on flexible sensor captures and goes back original system and control method
CN110190959A (en) * 2019-06-28 2019-08-30 中南大学 Encipher-decipher method based on continuous variable quantum nerve network
CN110190959B (en) * 2019-06-28 2021-05-07 中南大学 Encryption and decryption method based on continuous variable quantum neural network
US11251948B2 (en) 2019-06-28 2022-02-15 Central South University Encryption and decryption method and system with continuous-variable quantum neural network
CN110543861A (en) * 2019-09-05 2019-12-06 深圳前海达闼云端智能科技有限公司 early warning method, server and early warning system
US11504581B2 (en) 2019-09-06 2022-11-22 Taylor Made Golf Company, Inc. Systems and methods for integrating measurements captured during a golf swing
US11583729B2 (en) 2019-09-06 2023-02-21 Taylor Made Golf Company, Inc. Systems and methods for integrating measurements captured during a golf swing
CN110639197A (en) * 2019-09-27 2020-01-03 上海淡竹体育科技有限公司 Sports test method, device and system
CN112752100A (en) * 2020-12-28 2021-05-04 杭州海康威视系统技术有限公司 Method and device for determining video integrity and readable storage medium
CN113542774A (en) * 2021-06-04 2021-10-22 北京格灵深瞳信息技术股份有限公司 Video synchronization method and device, electronic equipment and storage medium
CN113542774B (en) * 2021-06-04 2023-10-20 北京格灵深瞳信息技术股份有限公司 Video synchronization method, device, electronic equipment and storage medium
CN113326828A (en) * 2021-08-03 2021-08-31 湖南涉外经济学院 Sports tactics identification method and system

Also Published As

Publication number Publication date
WO2015164389A1 (en) 2015-10-29
CA2917542A1 (en) 2015-10-29
AU2015249884B2 (en) 2019-07-18
EP3017598A4 (en) 2017-06-07
CN106464848B (en) 2019-07-02
AU2015249884A1 (en) 2016-01-28
CA2917542C (en) 2022-08-16
EP3017598A1 (en) 2016-05-11
JP2017521017A (en) 2017-07-27

Similar Documents

Publication Publication Date Title
CN106464848B (en) Motion event identification and video synchronizing system and method
US11311775B2 (en) Motion capture data fitting system
CN108028902A (en) Integrated sensor and video motion analysis method
CN107211109B (en) video and motion event integrated system
US9866827B2 (en) Intelligent motion capture element
US9361522B2 (en) Motion event recognition and video synchronization system and method
US8702516B2 (en) Motion event recognition system and method
US8903521B2 (en) Motion capture element
US8905855B2 (en) System and method for utilizing motion capture data
US8827824B2 (en) Broadcasting system for broadcasting images with augmented motion data
CN108369646A (en) Multisensor event detection and tagging system
US20150324636A1 (en) Integrated sensor and video motion analysis method
US20140378194A1 (en) Broadcasting method for broadcasting images with augmented motion data
EP2804678B1 (en) Intelligent motion capture element

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant