CN106464848B - Motion event identification and video synchronizing system and method - Google Patents

Motion event identification and video synchronizing system and method Download PDF

Info

Publication number
CN106464848B
CN106464848B CN201580033463.0A CN201580033463A CN106464848B CN 106464848 B CN106464848 B CN 106464848B CN 201580033463 A CN201580033463 A CN 201580033463A CN 106464848 B CN106464848 B CN 106464848B
Authority
CN
China
Prior art keywords
event
data
video
computer
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201580033463.0A
Other languages
Chinese (zh)
Other versions
CN106464848A (en
Inventor
迈克尔·本特利
瑞安·卡普斯
巴斯卡·博斯
希恩·阿拉姆
迈克尔·吉利安
马赞·阿比戴尔-拉赫曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bolasite Motor Co Ltd
Original Assignee
Bolasite Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US14/257,959 external-priority patent/US9076041B2/en
Application filed by Bolasite Motor Co Ltd filed Critical Bolasite Motor Co Ltd
Publication of CN106464848A publication Critical patent/CN106464848A/en
Application granted granted Critical
Publication of CN106464848B publication Critical patent/CN106464848B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/23Recognition of whole body movements, e.g. for sport training

Abstract

The present invention allows position based on event and/or time perhaps both all to recognize event in the exercise data obtained from portable mobile wireless capturing movement element and event and video are sometime carried out audio video synchronization when event occurs or in later.The usual smaller event video for automatically generating event in mobile device or server about the integrated video camera or external camera of mobile device can be used in the present invention.The present invention also allows that same subscriber, other users, historical user or the associated movement of groups of users are analyzed or compared.The present invention provides low memories and electric power to utilize, and significantly reduce the storage of the video data corresponding to event, the event is than if any the batting of sportsman, movement or hitting, the cerebral concussion of sportsman, or the first time walking or fall events etc event of other medical dependent events such as children.

Description

Motion event identification and video synchronizing system and method
Technical field
One or more embodiments are related to the field of motion capture data analysis, and based in motion capture data or Event that person picks out in motion analysis data associated with user or equipment and/or based on from the user or The previous movement of other (multidigit) users of person and/or equipment analyzes data to show information.More specifically (but not limit System), one or more embodiments realize it is a kind of allow recognize exercise data in event motion event identification and video it is same Walk system and method, the event includes the batting of sportsman, movement or hits, sportsman, boxer, jockey or driver brain Shake perhaps heatstroke, hypothermia, disease burst, asthma attack, epileptic attack or appointing including walking and falling down What his sport or the relevant event of body kinematics.Can motion event is related to (several) image or video progress and/ Perhaps synchronizing this by other means can be when event occurs or later sometime based on the position of event And/or the time or both all for example carried out in mobile device or remote server, and be capture from (more) it is internal/ External camera or nurse's camera are acutely trembled for example to allow the video of preservation event, such as the first time walking of children Dynamic event, sport, military affairs perhaps other motion events including cerebral concussion or associated with the elderly fall down thing Part, and the relevant video data of non-event is for example abandoned, to greatly reduce the storage demand for event video.
Background technique
Existing motion capture system handles and potentially stores the mass data about practical events of interest.Citing For, it is known that system acquisition from the accelerometer data for being coupled to user or equipment, and analyze or monitoring movement.At this In a little situations, thousands of or millions of capturing movement samples to it is static in or not in mobile user it is related Connection, mode are related with the particular event that existing system is try to analysis.For example, if monitoring rugby fortune Mobilize, then a large amount of exercise datas are unrelated with cerebral concussion event, for baby, a large amount of exercise datas usually with shake event or example Non-athletic event such as sudden infant death syndrome (SIDS) etc is unrelated, for golfer, by the height for being placed in sportsman The acceleration value of a large amount of exercise datas of sensor capture in golf club is lower, that is to say, that for example stands with sportsman Or wait another one sportsman or associated according to interested mode movement or acceleration in other respects.Therefore, The capture of data relevant for non-event, transimission and storage increase the demand for electric power, bandwidth and memory.
In addition, even more a large amount of data may include for the video capture for implementing certain type of movement, it is therein The actual event of many hitting with such as baseball bat or hommer etc is unrelated.There is no known system that can trim view automatically Frequently, it such as saves the relevant video of event and abandons the relevant video of non-event, occur in video to generate to correspond to And such as smaller video clip of event detected by the analysis by motion capture data.
Related some systems, which are collided, to monitoring is absorbed in the relevant collision of linear acceleration.These systems are unable to monitor rotation Rotational acceleration or speed, and therefore can not detect the certain types of event there may be cerebral concussion.In addition, for low-power Consider with durability, the system of these many types does not generate the relevant connectionless information of event.Therefore, these systems are based on It lacks robust property and is restricted in its use aspect.
Known system is not susceptible to carry out the data mining about event in exercise data yet, so as to based on first The function of the event picked out in the exercise data of preceding storage forms the expression of specific movement, such as ordinary movement person or common duty Industry sportsman grade or any sportsman's grade are hit.Therefore, it finds, trim and specify the relevant event of special exercise So as to for example using being very difficult and time consuming in virtual reality, and need hand labor.Therefore, current system without Method easily allows specific user with the previously stored movement of same subscriber or other users and, for example, historical movement person Event plays for opponent.Furthermore it is known that system do not account for the collision of accumulation, and, for example, have for cerebral concussion The information of the data mining of pass determines whether a series of collisions may cause brain function as the time is impaired.
Other kinds of motion capture system includes for the video for analyzing and instructing body technical detail (mechanics) System.These systems are based on videograph and analyze the video of the sportsman recorded to sportsman.This There is limitation in kind technology, including the accurate not to the utmost and not the same subjective analysis for example based on video.Another skill Art includes motion analysis, wherein for example capturing the three-dimensional point of movement associated with sportsman using at least two cameras. Known implementation utilizes static more camera chains, and the system is not portable enough and therefore can not be in the installation of system Be utilized except environment, for example, golf tournaments, rugby compete etc sport event during be utilized or It is utilized to monitoring children or the elderly.In general, the system based on video is also unfavorable with from pair for being undergoing movement As the digital moving capture data of upper sensor, this is because the system based on video is for acquisition and to analyze with view Feel the image of label rather than electronic sensor.In addition, these devices fixed are also prohibitively expensive.Such prior art exists It is summarized in the U.S. Patents Serial numbers 7,264,554 that on January 26th, 2006 submits, it is required that on January 26th, 2005 mentions The equity of the U.S. Provisional Patent Application Serial No. 60/645,751 of friendship, the specification of the two are all merged herein by reference. All two disclosures belong to the identical inventor of the subject content of the application.
Regardless of motion capture data obtained, usually every user or every time hit on the basis of to data into Row analysis, wherein not being susceptible to the processing on mobile phone, therefore user can only buy fortune for existing mobile phone Dynamic capture sensor and " applying (app) ".It is passed in addition, existing solution is not susceptible to mobile use, analysis and message It send and/or compares, perhaps use the previously stored motion capture data from the user or other users or movement is caught The large data set for obtaining data carries out data mining, for example to obtain or create capturing movement associated with one group of user Data, for example, direct golfer, tennis player, basket baller or any other sports sportsman, from And it provides and " professional grade " common or the associated event of outstanding virtual reality opponent.To sum up, motion capture data is logical It is commonly used for at-once monitor or sports performance feedback, and usually has be restricted and/or original in other areas It uses.
Known motion capture system is usually passively or actively label or several sensors using several.Without known System can be executed using as little as a visual indicia or sensor and, for example, in the mobile device that user has possessed Using analyzing and show motion capture data associated with user and/or equipment.The data are usually in the lab And analyzed in every user or hit every time on the basis of, and in addition to the motion analysis or motion table of the specific user It is not applied to any other purpose except showing, and usually not by data mining.
Do not have known system allow such as wireless sensor etc capturing movement element and user or footwear, gloves, Shirt, trousers, waistband or other equipment (such as baseball bat, tennis racket, golf club, boxer, rugby or English foots The facing of ball sportsman, the protectiveness facing either utilized in any other contact sports) Seamless integration- or It couples by other means, to carry out local analytics or later analysis in very small format, so that user does not know Sensor described in road is placed among or on these projects.There is no known system being capable of such as matching in golf club Seamless placing device is provided in weight portion (weight port) or at the end shaft close to handle, in order to provide being configured At the wireless golf club of capture movement data.Data are not maintained in corresponding to a large amount of things derived from existing sensor In the database of part, and do not made relative to any other item other than the performance that motion capture data is collected With.
In addition, for using equipment and ball sports, without known portable system allow user obtain about The flying distance of ball, speed of hitting, equipment the intermediate degree of hit efficiency or impact bead (namely the collision of ball is being equipped The position of upper generation) instant visual feedback.These systems do not allow user and acquisition from other users or historical movement person or Person acquires to play from the motion capture data of the prior behavior of its own.Known system does not allow to from largely hitting Motion capture data carry out data mining to suggest or allow to search for fortune of the better or optimal equipment to match user Dynamic capture data, and original equipment manufacturer (OEM) is not allowed to make commercial decision, such as improve its product, by its product It is compared from other manufacturers, excess promotional product or contacts the use for being likely to purchase the more products of different or profit Family.
In addition, carry out equipment debugging using motion capture data excavation without known system, and about purchasing at once Buy the follow-up sales point decision-making of the equipment of suitable sportsman.In addition, allow custom order to fulfil without known system, than The Assemble to Order (ATO) such as fulfiled for the custom order of physical education facilities, such as excavated according to based on motion capture data Customer specifications establish and be for example shipped during match or virtual reality are competed to customer to complete point of sale processing Equipment.
In addition, without known system for passive compliance and monitoring using mobile device and RFID label tag.
There is no known system to allow to be counted for a large number of users about its movement or the movement of associated equipment According to excavating to find the mode in data, thus allow based on up to the present still not found mode related with movement come Determine business strategy.There is no known system permission to obtain from OEM, medical professional, game company or other terminal temperature differences Payment is to allow to carry out data mining to exercise data.At least for previously described limitation, a kind of motion event is needed to recognize With video synchronizing system and method.
Summary of the invention
The embodiment of the present invention realizes a kind of identification of motion event and video synchronizing system and method, provides for fortune The INTELLIGENT IDENTIFICATION of event in dynamic data, including but not limited to from such as visual indicia and sensor, RFID tags And the motion capture data or described that the portable mobile wireless capturing movement element of mobile device computer system etc obtains Motion capture data be calculated based on movement by analysis associated with same subscriber, or with the user or Other users, historical user or groups of users are compared.It is detected to correspond to by trimming exercise data and video Event allows to utilize for the low memory of event data and video data.This can be in mobile device or remote server Implement, and be position based on event and/or time and position and/or time based on video, and can be optionally Direction including video camera may include the video of motion event further to limit.Some embodiments allow based on event Viewing and low power event transmission and with execute on the mobile apparatus using and/or communication with external camera, so as to Specify the window to define event.The motion event in image or video is allowed to recognize specified with event, such as sportsman It is batting, mobile or hit, sportsman, boxer, the cerebral concussion of jockey or driver or heatstroke, hypothermia, disease burst, Asthma attack, epileptic attack, or any other sport or the relevant event of body kinematics including walking and falling down.It can With event and capture from a width of one or more inner/outer video camera or nurse's camera or more image or video Correlation is carried out, for example to allow the video of preservation event, such as the first time walking of children, acutely shakes event, including brain Sport event including concussion, or fall events associated with the elderly.It can be with linear acceleration rate threshold and/or mould Formula and rotary acceleration and threshold speed and/or mode monitor cerebral concussion dependent event and other events, and/or It is carried out on the basis of event save and/or transmit it by light-type connectionless protocol or aforementioned every Any combination.
The embodiment of the present invention allows user to buy application or " app " and capturing movement element, and immediately by the system System is used together with its existing mobile computer (such as mobile phone).The embodiment of the present invention can to monitoring user or User associated with capturing movement element or equipment shows motion information.Some embodiments be also based on a certain user or Equip associated previously stored motion capture data or motion analysis data or associated with an at least other users Previously stored motion capture data or motion analysis data (function of comparing etc for example, by (and being not limited to)) show Show the information based on motion analysis data associated with the user or equipment.This allow for accurate monitoring, compliance, with The interaction of the motion capture data or mode that are obtained from (multidigit) other users, for example to utilize the true fortune obtained from user Dynamic data carry out virtual race, and based on this using previously from the user or from other users (or equipment) Real motion data capture generate response.This ability provides the match with historical movement person for opponent, such as virtual net Ball match, or take " common " professional sports sportsman as the match of opponent, it and is not in the art until the present moment Know.
For example, one or more embodiments include at least one capturing movement element, are configured to and user, dress Mobile device that is standby or coupling with user is coupled, wherein at least one described capturing movement element includes: memory;Matched It is related to the direction of at least one capturing movement element, position, speed, acceleration (linear and/or rotation) to be set to capture The sensor of any combination of the numerical value of connection;Radio device;And it is coupled with memory, sensor and radio device micro- Controller.The microcontroller is configured to the data that collection includes the sensor values from sensor, stores data in In memory, data are analyzed and pick out the event in data to determine event data, and pass through radio Device transmits event data associated with event.The embodiment of the system can also include being configured on the mobile apparatus The application of execution, wherein mobile device includes computer, is configured to communicate to acquisition and event with radio device The wireless communication interface of associated event data.The computer is coupled with wireless communication interface, and wherein computer execution is answered With or " app " to configure the computer: from wireless communication interface receiving event data, analyze event data to form movement point Data are analysed, store event data or motion analysis data or event data and motion analysis data all the two, and aobvious Show on device that display includes event data associated with an at least user or motion analysis data or whole information of the two.
One or more embodiments include at least one capturing movement sensor, are configured to be placed on the head of user Near, wherein the microcontroller is further configured to calculate the impingement position in user's head.At least one described capturing movement The embodiment of sensor is configured to any kind of placement, encapsulation or coupling mechanism and is coupling in cap or ball On cap, it is coupled in protectiveness facing.One or more embodiments of at least one capturing movement sensor can be matched It is set to and is coupled with the helmet in user's head, and be wherein to be based on using account about the calculating of the impingement position in user's head The physical geometry of portion and/or the helmet.Some embodiments may include for example at least one described capturing movement sensor Or the temperature sensor coupled with microcontroller.
The embodiment of the present invention can also utilize the isolator being configured to around at least one capturing movement element So that the physics acceleration of the celiolymph approximately about user's brain damps, to minimize the linear acceleration of event data With the transformation of rotary acceleration, so as to obtain user's brain observation linear acceleration and observation rotary acceleration.Therefore, some Embodiment can be eliminated to power or acceleration value or any other numerical transformation from the acceleration based on the helmet To the brain acceleration value observed.Therefore, some embodiments are provided using less electric power and storage specific to thing The data of part utilize and even lower to minimize the quantity of data transmission again so as to cause lower transimission power General power utilizes.Based on the type of the inherent liner in the helmet, in rugby/ice hockey/lacrosse sportsman helmet On can use different isolators.Do not wear wherein the helmet or once in a while wear the helmet sports in utilized its His embodiment can also be sensed using at least one capturing movement on (such as on the cap of baseball player) ball cap or cap Device, together at least one sensor being placed on batting helmet.In sports (such as the English foot for not utilizing ball cap wherein Ball) in can also using headband placing device come it is same determine cerebral concussion.In one or more embodiments, using on the helmet Isolator can remain attached to the helmet in a package, and sensor can be removed and be placed on and matching is not utilized to use On another equipment of the isolator of the damping of family brain liquid.Some embodiments can be based on certain types of equipment (namely Surfboard is compared to baseball bat) associated characterizable motion mode detects type of sports automatically, and determines capturing movement sensing The type of the current accompanying equipment arrived of device.
The embodiment of the present invention may be configured to acquisition/calculating linear acceleration numerical value or rotary acceleration numerical value or Both all.This is allowed for for cerebral concussion and linear acceleration monitoring rotational event.Other events can use it is linear and/ Or rotary acceleration and/or speed, such as be compared with mode or template, to not only switch sensor during event Property dynamically to change capture characteristic, but also the characterization equipment that is being utilized together with current capturing movement sensor Type.This allows for making more than one piece equipment or clothing tool by the single motion capture element purchase of user, this is logical Crossing allows sensor to automatically determine the sensing compared with characterizable motion mode or template based on the movement captured by the sensor The type of equipment or clothing that device is coupled to.
The embodiment of the present invention can use connectionless broadcast message to transmit event data associated with event.One In a or more embodiment, used wireless communication is depended on, broadcast message may include having the data of limited quantity Payload, can be utilized to avoid the agreement based on connection shake hands and expense.In other embodiments, can pass through Any combination utilizes agreement connectionless or based on connection.
In one or more embodiments, the accessible previously stored event associated with user or equipment of computer Data or motion analysis data, for example to determine cerebral concussion or to fall down or other are hit or the number of any other motion event Mesh.Some embodiments can also event data associated with an at least user present over the display, this be based on The user or the associated event data of equipment or motion analysis data and with the user or equipment or at least one Position other users or other associated previously stored event datas of equipment or motion analysis data.This allow in number or Motion event is compared in terms of quantitative value, such as by the user or other users in particular game or in history On the maximum rotary acceleration that observes.In addition, definition correspond to typical event project equipment characterizable motion mode or Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments In dynamically updated in capturing movement sensor by wireless interface.This allows for sensor to improve with the time.
The embodiment of the present invention can for example by radio and television or internet transmit information so as to computer or remote It is shown on the visual displays of journey computer coupling.The embodiment of the display can be configured to receive subevent Time location, in order to provide along the discrete rolling of the timeline of whole event.For example, golf, which is hit, may include Such as the sub- thing for aiming at (address), brandishing, brandish forward backward, striking, keeping posture (follow through) etc Part.System can show the time location corresponding to subevent and receive the input of the user near the position, to determine Video should start or stop at place at the time point, such as be rolled to or return to the time point to be easy to watch sub- thing Part.
The embodiment of the present invention can also include coupling at least one described capturing movement sensor or user or equipment Identifier.In one or more embodiments, the identifier may include team and team uniform number or student identifier Number or passport NO. or any other identifier, allow it is opposite uniquely identify it is specific from specific user or equipment Event.This is allowed for about application (app) the mark tool for being configured to receive data associated with special exercise person or user There are the movement of the team sport of multidigit sportsman or user or position.One or more embodiments receive identifiers, for example, with movement Member or the associated passive RFID identifier of user or MAC Address or other sequences number, and identifier and event data and Motion analysis data are associated.
One or more embodiments of at least one capturing movement sensor can also include being configured in event The light-emitting component of output light in the case where generation.This can be utilized to show in the exterior portion of the helmet potential, slight or again Cerebral concussion is spent, without for example for any communication of any external equipment.Different colors or flash of light interval can also be utilized To convey information related with event.Alternatively or in combination, at least one described capturing movement element can also wrap Audio output element is included, is configured in the case of an incident or at least one described capturing movement sensor Sound is exported in the case where except the range of computer, or wherein the computer is configured at least one described fortune Any combination of display alarm or aforementioned items in the case that dynamic capture sensor is in except the range of computer.Sensing The embodiment of device can also utilize LCD, such as the volume of current event is exported in quick response (QR) code or bar code Code analysis so that referee for example be allowed locally to obtain the snapshot of analysis code on the mobile apparatus, and makes event It will not be watched or be wirelessly communicated and intercepted by all other men with readable form on a sensor.
In one or more embodiments, at least one described capturing movement element further includes the position coupled with microcontroller Set determining element.This for example may include GPS (global positioning system) equipment.It is alternatively or in combination, the calculating Machine can cooperate with another computer to carry out triangulation location to position, or obtain from the receiver of any other triangulation location type Position, or by by couple with the computer and it is known direction specific direction video camera captured image come based on Position is calculated, wherein the computer for example calculates the offset with mobile device based on the direction of the object in image and size Amount.
In one or more embodiments, the computer is further configured to ask from an at least video camera for proximal event Ask at least piece image or video comprising event.This may include from specific neighbouring video camera or being directed toward event direction The broadcast message of video camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour The request of nearly event or the camera position for being directed to viewing event, and optionally for holding around events of interest The continuous available video camera of time showing or the video at this.In one or more embodiments, the computer also by It is configured to the list of one or more times of display event generation, so that user be allowed to pass through desired by computer acquisition Event video, and/or independently request video from the third party with desired event time.
In one or more embodiments, at least one described capturing movement sensor is coupled with mobile device, and example The internal motion sensor for being such as used in mobile device or being coupled with mobile device.This is allowed for using generally existing The hardware of minimum level carries out capturing movement and event recognition, such as uses the mobile device with built-in accelerometer.? In one or more embodiments, the first mobile device can with record exercise data user couple, the second mobile device then by Using come the video that records movement.In one or more embodiments, the user for being undergoing movement can provide gesture, such as N times are tapped on the mobile apparatus, to show that the mobile device of second user start recording video or should stop recording video. It can use any other gesture and transmit event correlation or the relevant instruction of movement between mobile device.
The embodiment of at least one capturing movement sensor may include temperature sensor or the microcontroller It can be coupled by other means with temperature sensor.In these embodiments, microcontroller is configured to transmit obtained from temperature The temperature of sensor is spent using as temperature event, such as heatstroke or the potential instruction of hypothermia.
Therefore, the embodiment of the present invention can recognize any kind of motion event, including with user, equipment or shifting The related event of associated movement at least one capturing movement sensor that any combination of dynamic equipment is coupled, Huo Zheyu Show to stand, walk, fall down, heatstroke, disease burst, shake, cerebral concussion, collision, abnormal gait, adnormal respiration or not having acutely The breathing perhaps related event of movement of any combination thereof or any other class of the duration moved with period The event of type.
The embodiment of the present invention can use the data mining on motion capture data obtain corresponding to user, equipment Mode, or in certain embodiments of the invention using given user or the motion capture data or event of other users.Number It is related to finding new mode in large database according to excavating, wherein the mode is that previous institute is ignorant.It can be to data It should be in many ways to find new mode, wherein for example including statistical analysis, neural network and artificial intelligence.Due to depositing In a large amount of data, therefore can be found in data not by one or more computer-implemented automatic data mining The mode known.Unknown mode may include the grouping of related data, the exception in data, the correlation between data element, With the unknown pattern of classification and function or any other type that the smallest error models data.Data mining results Display may include purely summarizing new discovery in such a way that user is easier to understand compared with untreated data with a large amount of Mode display.The one of them of data mining processing are the result is that improved market intelligence, product improvement, consumption prospecting The sale of (lead generation) and targeted.Usually, by must quilt by any kind of data of data mining (cleanse), data mining are cleared up, and its result is usually verified.Enterprise can be with additional income by using data mining. The example of the benefit of the embodiment of the present invention includes that the customer based on the mode found in data for height target individual is closed System's management.In addition, market basket analysis data mining allows to identify by identical personal purchase or the product possessed, it can be sharp For promoting the sale of products to the user for possessing a product but not possessing another product usually possessed by other users.
The other field of data mining includes analyzing the large-scale exercise data set from different user, so as to base In practice of the performance data suggestion from other users to improve performance.For example, if a user is compared to general Buttocks rotation of the general family during hitting is less, then can be by practice of the system recommendations to improve flexibility or strength.? In golf course embodiment, which ball golf course designer can determine by a large number of users on golf course The length or difficulty in hole should be adjusted to obtain the more discrete numerical value for the average bar number for corresponding to each match play, or Person is used to determine the time quantum between golfer, such as specific day time or the golfer corresponding to given age Time quantum.In addition, the sport of data mining and medical applications include morphologic change of the determining user's performance with the time, such as Compared to recipe or practice change determine what such as what day time most for the improvement of performance, temperature or its The event of hitting caused by his condition will lead to farthest service or minimum score.By for specific user or about it His user uses motion capture data to allow health care compliance, to for example ensure to suffer from person with diabetes in one day Mobile specific quantity, and also allow morphological analysis so that the movement for determining user or motion range are as how the time changes. It can use motion capture data to play, to allow with historical great sportsman or other users for opponent's progress Virtual reality match.For example, someone can play for the prior behavior of same people, or can be for friend's Motion capture data plays.This allows for user to compare in the history stadium or place in reality environment Match, but motion capture data is, for example, previously to have acquired from the user or other users.Military planning person can use movement Capture data determine which soldier is suitble to the most and is therefore eligible for particular action or which soldier should be retired, Or determine when sportsman should rest by training the cerebral concussion event being for example subjected to based on sportsman and its seriousness, And it is potentially based upon wherein other users and improves period excavated of performance after cerebral concussion dependent event and make It determines.
The embodiment of the system is implemented capturing movement for example, by executing application on the mobile apparatus and/or is shown Show, the mobile device may include visual displays and optional video camera, and can be from such as visual indicia and/or nothing At least one capturing movement element of line sensor etc obtains data.The system can also be with free-standing video camera or more Video camera in platform mobile device integrates.The system also allows user to analyze and show movement in several ways Data are captured, to provide instant and readily comprehensible graphical information associated with motion capture data.In the system Middle utilized capturing movement element intelligently stores for example related with the associated event of batting, skiing revolution, jump etc. Data, and eliminate error event, use to significantly improve memory and minimize storage demand.In addition, for example may be used With for more than one event storing data associated with physical education facilities, such as if necessary, storage is repeatedly swung or corresponded to In the data of whole wheel golf range game, until being downloaded to mobile device or internet at least up to data.It can also utilize Data compression for captured data, to store more motion capture datas in the memory of given quantity.Described The capturing movement element utilized in system can be configured to intelligently power off certain parts of its circuit to save Electric power, such as by transceiver power-off until detecting certain types of movement.The embodiment of the present invention can also utilize spirit Battery connector living can use system before replacing battery concurrently to couple two pieces or more batteries, to increase Time.Motion capture data is typically stored in the memory of such as local data base etc or is stored in network can It is any one of therein all to allow data mining described above in the database of access.It can be with using the embodiment of the present invention The data mining for implementing any other type changes including the time for searching for data related with one or more user Become, or simply searches and specific user or the related data of equipment.
The music list that other embodiments can show such as the selection of music based on motion-dependent data or will play Etc information.This for example allows for performance to be compared with the performance of another one user and another one user is selected to be played Music type, or compare performance relative to threshold value, the threshold value determination will suggest or show what type of music Selection.
For example allow RFID or passive RFID label tag being placed on user institute for the embodiment of the present invention of sports On mobile article, wherein the embodiment pursuit movement of the system.For example, by the way that passive RFID label tag is placed on spy The fixed helmet or ball cap or for boxing, the protectiveness facing of rugby, Association football or other contact sports It is upper and be especially located on the dumbbell in gymnasium, and the capturing movement element by wearing such as gloves etc and Using for exampleEtc existing mobile device, the embodiment provides automatic safe compliance or Grade of fit and/or health care compliance.This is to track user by pursuit movement and by RIFD or passive RFID The weight lifted and realize.Therefore, the embodiment of the present invention can be plus number of repetition multiplied by by each RFID label tag institute The weight shown, to calculate the calory count that user is burnt.In another example, RFID label tag and stationary bicycle coupling It closes, or wherein stationary bicycle can simulate identifier and/or wireless communication in order to provide performance data, and wherein Mobile computer includes RFID reader, and can be counted to the number of revolutions of user leg.For RFID or passive Any other use of RFID all meets spirit of the invention.This allows for doctor remotely to determine whether user defers to its medical treatment and build View, or beyond the linear or rotary acceleration for for example showing cerebral concussion.Some embodiments therefore can be by user's utilization Lai really Compliance is protected, and reduces its malpractice liability insurance rate by doctor's utilization, this is because doctor is ensuring that its patient abides by From its recommendation, despite passing through remote mode.The embodiment of the present invention is not required for RFID label tag for medical compliance, still It can use RFID label tag.For golf the embodiment of the present invention also allow by using on each ball bar for example RFID label tag etc identifier (either alternately through associated with the capturing movement electronic device on golf club or The identifier remotely obtained by radio device) and mobile computer pair each ball bar associated with golfer Golf driving counted, the mobile computer be, for example, equipped with RFID readerIts The processing counted for golf driving concentrates on mobile computer rather than on each golf club.Of the invention Embodiment can also allow for referring to using Inertial Measurement Unit or accelerometer and/or magnetometer and/or gyroscope to measure To (north south and/or two trunnion axis and vertical axis).This point is not required for for golf driving counting, still One or more embodiments for example can determine when golf club hits golf by vibration analysis, and then to Golfer asks whether to count batting.This function for example can be with speed or acceleration rate threshold or range detection phase group It closes, to determine whether golf club advances in acceptable speed or range, or whether in corresponding to and should count In the acceleration or range of several hits.It can also be compared using small echo with signature of effectively hitting, to for example disappear It is struck except counting batting or eliminating mistake.The range can be different between different clubs, such as opens club velocity Range can be " being higher than 30mph ", and push rod velocity interval then can be " lower than 20mph ", can be according to the phase for any club It hopes and utilizes any range, such as the velocity interval can be ignored.Alternatively or in combination, mobile computer can Only (not namely to be in golf cart or walk) Shi Caixiang Gao Er in lateral movement in golfer Husband player asks whether to count batting, and/or wherein golfer can be carried out rotation or batted, just As determined by the direction or gyro sensor coupled with mobile computer.Such as it can be on the ground on mobile computer The position of batting is shown on figure.Furthermore, it is possible to which the GPS receiver with radio device, which is placed on ball seat, marks interior and hole (cup) the daily update about distance is provided in, and for example helps to read push rod and greens.Golfer can be with Wear virtual glasses, allow golfer see golf course map, current location, to match play distance, work as forecourt Number of strokes, batting sum and any other desired measurement in hole.If such as by like that, being used determined by GPS Family moves specific range from batting place and bats without counting, and system can prompt the user whether to count batting.The system It does not need user and starts the switch on club to count batting, and do not need the LED or active or electric on each ball bar Battery-powered electronic device is batted to count.Mobile computer can also receive gesture from the user so as to count batting or not Batting is counted, therefore golfer need not remove any gloves to operate mobile computer.For being sensed using position/direction The embodiment of device, system can only club be in be perpendicularly oriented to when and for example when detecting shock just count bat. Described device can also include the identifier for allowing to identify specific device.The identifier for example can be sequence number.The mark Knowing symbol for example can be from the RFID label tag on each golf club, or optionally may include and golf club The associated sequence number of associated capturing movement element or other identifier symbol.By allowing to identify specific height using the device Golf ball hand, specific club, and also allow and include TV and/or mobile device system together with carry out capturing movement and/ Or display, wherein the mobile device have visual displays and optional video camera, and can from such as visual indicia and/ Or at least one capturing movement element of wireless sensor etc obtains data.The system can also with free-standing video camera or Video camera in more mobile devices of person integrates.The system also allows user to analyze and show in several ways Motion capture data, to provide instant and readily comprehensible graphical information associated with motion capture data.The dress Setting also allows system to determine " placed in the middle " degree hit about ball and equipment (such as golf club).The system also allows to wrap The debugging of the equipments such as footwear, club is included, and needs the customization Assemble to Order from retailer to permit request even if equipment Perhaps purchase is equipped at once.Once motion capture data, video or image and batting counting indicator are obtained by the system, it can It to be for example locally stored in the local database, such as remote data base is sent to by phone or wireless interface. Once in the database, various elements including any data associated with the user (such as age, gender, height, body Weight, address, income or any other relevant information) can be utilized in an embodiment of the present invention and/or by Data mining.One or more embodiments allow users or OEM for example for the access of the data mining ability of the system into Row payment.
For example, allow to analyze the data obtained from described device using the embodiment of capturing movement element, and permit Perhaps exclusive display (for example 3D is superimposed) associated with the user is presented on the image of user's body, will pass through visual manner Describe captured exercise data.In addition, these embodiments can also utilize the range for being up to 50 meters using for exampleThe active wireless technology of low energy etc, to lead to the mobile computer of golfer Letter.Such as receive golf club ID result (such as by RFID reader or alternatively by for example usingThe wireless communication of low energy or IEEE 802.11), the embodiment of the present invention, which also allows to show, to be directed to Count the inquiry of batting.By usingLow energy chip allows club using the coin unit of standard Battery is in sleep pattern up to 3 years, to reduce required maintenance.One or more embodiments of the invention for example can be with Utilize the more than one radio device of more than one technology.This allows for a degree of redundancy for improving system robustness Property.For example, if radio device (such asRadio device) no longer work, then 802.11 radio device of IEEE can be utilized to transmission data and alert one of them wireless Denso to golfer It sets and no longer works, while golfer being still allowed for record exercise data and batting associated for specific club progress It counts.For the implementation of the invention using the mobile device (or being more than a mobile device) for not having (more) video camera Example, can use the display that sensing data generates captured exercise data, at the same the mobile device can optionally from Other video cameras or other mobile devices with video camera obtain image.For example, it can use or do not utilize use The display type of the image at family may include evaluation, data calculated and timeline data.It can also by having or not The form of number or graph data with user images shows evaluation associated with the movement captured to user, such as " efficiency " evaluation.Other evaluations may include for example for determining the linear acceleration and/or rotation of cerebral concussion He other events Acceleration value.It can be calculated on the mobile apparatus with or without the image of user's body and show institute The data of calculating, such as prediction ball flight path data.It can also be shown in the case where the image with or without user Describe data on the time line, for example to show the relative velocity peak for the various pieces for corresponding to equipment or user's body Value.From more video cameras (including more mobile devices) and be, for example, the image from golf fan group can be by group Close BULLETIn visual effect, the visual effect is by under normal speed and under all angles The slow motion hit around the golf shown in golfer characterizes.The data all analyzed can be in local quilt It has been shown that, or together with motion capture data, image/video, batting count and position data be uploaded to database and Data mining can be undergone to handle wherein, wherein the system can for example collect the charges for the access of result.
In one or more embodiments, user for example can play ball or play tennis on a certain golf course or It simply hits to generate motion capture data, and sees the change of another one user when wearing virtual reality glasses Body, true incarnation either virtual or in augmented reality environment.In other embodiments, user's movement and any sport It moves associated equipment or simply moves the body of the user oneself coupled with capturing movement sensor, and watch It is shown in the reality environment of the movement of the user in virtual reality glasses or the movement of the equipment of such tool.Replacement Ground is in combination, can use virtual reality room or other environment come projected virtual reality incarnation and exercise data. Therefore, the embodiment of the system can permit at user on real golf ball field and different location there is no in reality The another one user of batting plays, and moves historical movement person that data have been analyzed or based on one or more Do more physical exercises capture data sequence data mining construction user play, and by one embodiment of the system utilize To project the incarnation of historical movement person.Each in three sportsmen can successively compete, and be in phase just as it Same place is the same.
Motion capture data and/or event can be shown in many ways, such as during or after capturing movement Hair pushes away text to social networks.For example, if having carried out certain amount of practice or movement or having consumed certain amount of Calorie, or obtaining new sports Capability index maximum value, then the system can automatically push away new information hair Text arrives social network sites, so as to notify to be connected to internet anyone.Upload to internet (namely remote data base or Remote server or far from system storage) data can by obtain the access for data any computer watch, Analysis carries out data mining.This allows for long-range compliance to push away text and sends (tweeting) and/or compliance and/or original dress Standby manufacturer is for giving what user determines for the equipment of compliance or for the body of the relevant embodiment of sports Educate armament-related work obtain it is best, and/or will suggest what equip.Data mining also allows based on number associated with the user According to and/or metadata suggest that user improves the planning of its compliance and/or sports place (including golf course), such as Age or any other demographic information that can be input into system.The long-range storage of data also allows medical treatment to answer With, such as morphological analysis, motion range and diabetes control with the time, and foregoing practice monitoring and compliance Using.Other application also allows the (example that plays using the real motion capture data from other users or historical movement person Such as after the video of analysis of history sportsman, regardless of whether the historical movement person is alive).Virtual reality and enhancing are virtual existing Real application can also utilize motion capture data or historical movement data.Such as the army personnel of commanding officer and/or doctor etc Movement and/or image be can use to determine that people experienced what kind of gravity under the explosion near improvised explosive devices, And the medical rescue of best type is arranged into automatically the position of capturing movement sensor.One or more realities of the system It applies example and can for example link by wireless communication and the motion capture data beyond gravity or threshold speed is relayed to its higher level refers to It waves at official or nearest healthcare givers.Alternatively, the embodiment of the present invention can to listening to any mobile device (such as The mobile phone of referee) the broadcast connectionless cerebral concussion related news of light-type, to help to succour injured swimmer, Wherein the light-type message includes optional team/team uniform number and acceleration correlated digital, such as potentially/possible Cerebral concussion warning or index.
In one or more embodiments of the invention, such as tennis tour, rugby match, baseball game, vapour Fixation video camera at vehicle or motorcycle race, golf tournaments or other sport events can have movement with being located at Wireless interface near sportsman/equipment of capture element is utilized together, to obtain, analyze and show motion capture According to.In this embodiment it is possible to show real-time or near real-time exercise data for enhancing video playback on video.Cause This, by with visual manner display equipment during batting it is mobile have how soon and lead to the promotion of amusement degree, such as around The buttocks and shoulder of sportsman draws circle.The embodiment of the present invention also allows in mobile device related with another one user Using image or video from other sportsmen with mobile device, so that user does not need for example to exchange mobile electricity Words.In one embodiment, when by the first user for not with have be equipped with video cameras mobile phone second user When physical education facilities in associated movement obtain video, the video can be automatically transferred to the first user, to utilize Motion capture data associated with the first user is shown.Video and image can be uploaded in database and pass through Image analysis is by data mining, for example to determine the type/color of clothing or footwear that user is dressing.
Display based on data, user can determine most suitable equipment, and bought and equipped by mobile device at once. For example, when to make decision between two secondary sleds, user can be tried out through the complete of capturing movement element tools The secondary sled in portion two, wherein being analyzed to determine which secondary sled allows more efficient movement to motion capture data.It is right In golf embodiment, when to make decision between two golf clubs, user can use different clubs into Row is hit, and more preferable based on the performance which ball bar the analysis to the exercise data captured quantitatively determines.It can lead to It crosses the interface in mobile device and orders customization equipment from retailer, retailer can customize equipment and example with Assemble to Order Such as equipment is checked at user.Such as can based on user using adjustable length shaft carry out push rod when captured Exercise data, for specific user customize such as push rod with full-length shaft length.Such as based on being caught to movement The data mining for obtaining data and bat enumeration data and distance allows the user and active user with similar characteristic of hitting It is compared, wherein can for example suggest or search for the given speed of hitting for the user with specific stature and age for user Degree provides the equipment of longer batting, to improve performance.For given speed of hitting, which kind of brand OEM can also determine Optimal aggregate performance is provided with the club of model.It would be recognized by those skilled in the art that this is applicable to all of movement Activity and be not only golf.
The embodiment of the system can use multiple sensors type.In one or more embodiments of the invention, Active sensor can with allow using being passively or actively together with the system integration of visual indicia, so as to capture user's body or The movement of specified point on equipment.This can simply be implemented according to two-dimensional approach, or if mobile device is configured with two Platform or more video camera, or if more video cameras or mobile device are utilized to capture image (such as video) and are total to Enjoy described image so as to from the two dimensional image obtained from each video camera set creation triangulation location three-dimensional motion data, It can also then implement according to three dimensional constitution.Another embodiment of the invention can use Inertial Measurement Unit (IMU) or Any other sensor of any combination of direction, position, speed and/or acceleration information can be generated for mobile device.Cause This, the data that the sensor can obtain may include and be directed toward (vertical or north south or all the two), position (by complete Ball positioning system (namely " GPS ") passes through triangulation location), speed (all three axis in), acceleration (all three axis In) any combination of associated one or more numerical value.All motion capture datas obtained from various sensor types are all Can be saved in the database with for analyzing, monitoring, compliance, match or other purposes and/or data mining, and Regardless of sensor type.
In one or more embodiments of the invention, can use includes passive marker on the outer surface of sensor Or the sensor of active flag, so that sensor can also be utilized with vision tracking (two dimension or three-dimensional) and for referring to To, position, speed, acceleration or any other physical quantity generated by sensor.The vision of (multiple) capturing movement element Label embodiment can be passively or active, it means that it can have the vision portion that can be tracked by vision Point, or may include the light-emitting component for allowing to carry out image trace in low light conditions, such as light emitting diode (LED).This Such as the shaft end near handle or the figure of the opposed ends of the golf club at club head can be passed through Symbol or coloured label are implemented.The image or video of label can be locally analyzed, or are saved in the database simultaneously And it analyzes, and be then used in data mining.In addition, embodiment relevant for cerebral concussion, visual indicia can be sent out Show the light of cerebral concussion, such as the yellow flash corresponding to moderate cerebral concussion or the quick red corresponding to severe cerebral concussion out Flash of light or any other vision or optional audio event index or all the two.As previously discussed, LCD Local vision encoded messages can be exported, so that so that it will not had the local for being equipped to read the code Anyone of mobile device is intercepted or is read by other means.Such as cerebral concussion or the relevant event of paralysis, this is just Allow only to read sensitive Medical News by referee or local healthcare givers.
The embodiment of capturing movement sensor can usually be placed in one of physical education facilities (such as golf club) Or more on end or opposing end portions or its any position (being measured for EI) nearby and/or therebetween, and can be with The other sensors for being coupled to equipment integrate, for example, weapon, medical equipment, wrist strap, footwear, trousers, shirt, gloves, Club, bat, racket, ball, the helmet, ball cap, facing etc., and/or use can be attached to by any possible mode With family.Such as be attached on rifle, so as to determine when detecting recoil by capturing movement sensor rifle positive sense what Place.The data for example can use mobile computer (such as mobile phone) or other equipment be sent to central server and It is analyzed, to be practiced for military exercises.In addition, one or more embodiments of the sensor can be assembled to golf In the counterweight part of bar and/or it is assemblied in the handle end of golf club.Other embodiments can for example be assembled to net In the handle or end of racket or baseball bat.Embodiment related with safety or health monitoring can be with ball cap, the helmet and/or tooth Set coupling, or in the encapsulation in any other type.One or more embodiments of the invention can also be utilized and are integrated with The ball of sensor is operated.One or more embodiments of mobile device may include it is small-sized place computer, such asOrIt can have or without integrated display, and And it is small enough on the shaft for being placed in physical education facilities and will not influence hitting for user.Alternatively, the system can calculate The virtual flight path for the ball being in contact with the equipment moved by sportsman.Such as baseball bat or tennis racket or Gao Er Husband's club, wherein golf club has the biography in the counterweight part of the another part for the end for being integrated into club impact golf Sensor, and have in one or more the gloves at the handle tip of golf club or by sportsman's wearing Second sensor can calculate projected angle of impact for club.It, can be right by knowing the tilt angle (loft) of club striking surface Flight angle is calculated in golf.In addition, by with sensor of the sufficiently high speed to club end sampled with Just determination shows that golf wherein hits the oscillation of the striking surface of club, can determine the quality of shock.These types Measurement and its analysis help sportsman to make improvements, and sportsman is allowed to buy suitable dress at once for debugging purposes It is standby.(centering) data can be uploaded to database and by data mining between two parties, so as to for example on the basis of manufacturer On find mode related with the bat, racket or club with best average placed in the middle or minimum torque numerical value, to be used for product It improves.Any other unknown mode found in data can also be presented or suggest carrying out to user or by user Search, such as paid by manufacturer or user.
One or more embodiments of sensor may include the charging feature of such as mechanical eccentric counterweight etc, as As being utilized in some wrist-watches referred to as " automatic " or " self wind " wrist-watch, wherein optionally including small power generation The inductive charging coil of machine or the Indirect Electro mechanical charge for sensor power supply unit.Other embodiments, which can use, to be used for The plug of the plug-in of sensor power supply unit or based on electromechanical or micro electronmechanical charge member.At of the invention one Or more can use the micro- acquisition technique of electric power of any other type in embodiment.One or more embodiments of sensor can To utilize power saving feature, including the gesture for making sensor be powered or power off.Such gesture may include movement, Physical switch, the contact with sensor, the wireless life that sensor is for example gone to from mobile device associated with particular sensor It enables.The other elements that can be coupled with sensor are for example including battery, low power microcontroller, antenna and radio device, heat It synchronizes (heat sync), recharger and overcharges electric transducer.In addition, the embodiment of the present invention allows one of system Point or all components power-off, such as until from accelerometer electronic signal or mechanical switch determine that club has moved until.
One or more embodiments of the invention for example allow the elastic lag of physical education facilities and even body or EI to survey Amount.The embodiment of sensor along the shaft of golf club, tennis racket, baseball bat, ice stick, footwear, people arm or And the placement of any other non-fully hard article allows at the point locating for measurement sensor between point or sensor The quantity of buckling.Each sensor not only allows for calculating buckling distribution with the angle difference of time, but also allows to calculate It is distributed depending on the buckling of time or power.For example, it is known that EI machine determined using the static counterweight between supporting point EI distribution.Therefore it is to depend on applied power or the time depending on applied force, example that these machines, which can not detect EI distribution, As EI be distributed can be about power or time it is nonlinear.There is the exemplary materials packet of different physical attributes known about the time Include Maxwell's material and non-newtonian fluid.
User can also graphically watch captured exercise data on the display of the mobile device, such as It is watched on a pair of glasses with video display.The exercise data captured obtained from the embodiment of capturing movement element It can also be utilized to showing in enhancing virtual environment for the virtual reality of user.It is looked in the database by data mining To mode virtual reality or augmented reality view also comply with spirit of the invention.User, which can also be seen that, for example aims at auxiliary Or the enhancement information for aiming at guidance etc, such as based on existing wind condition or in view of it is dangerous (such as gear for The tree of the desired destination of ball (such as hole) midway) it shows and should attempt wherein to bat.
One or more embodiments of the invention include motion event identification and video synchronizing system comprising are configured to At least one the capturing movement element being coupled with user or equipment or the mobile device coupled with user.It is described at least one Capturing movement element may include: memory;It is configured to capture and the direction of at least one capturing movement element, position It sets, the sensor of any combination of the associated numerical value of velocity and acceleration;Radio device;With memory, sensor and nothing The microcontroller of line electric installation coupling.It includes the sensor values from sensor that the microcontroller, which may be configured to collect, Data, store data in memory, data analyzed and pick out the event in data to determine event Data transmit event data associated with event by radio device.The system can also include mobile device, described Mobile device includes computer, is configured to communicate to radio device to obtain event data associated with event Wireless communication interface, wherein the computer is coupled with wireless communication interface, wherein the computer is configured to from wireless Communication interface receiving event data.The computer can also analyze event data to form motion analysis data, store event Data or motion analysis data or event data and motion analysis data both all, from event obtain event initial time and Event dwell time includes at least during from event initial time to the time span of event dwell time from video camera request The image data of the video captured, and event video is shown over the display, including all two following: being engaged in Part initial time to event dwell time time span during the event data, the motion analysis data or it is any that are occurred Combination;And the video captured during from event initial time to the time span of event dwell time.
The clock that any kind of synchronous method comes in synchronization system can be used in some embodiments, and at one or more In more embodiments, the computer in mobile device is further configured to determine the clock difference between capturing movement element and mobile device It is different, and motion analysis data and audio video synchronization.For example, one or more embodiments of the invention provide be used for so that The regulation of the synchronous information about the time of each equipment, position or direction of more recording equipments, comes from so as to combine Distinct device about event recorded data.Such recording equipment can be embedded type sensor, have video camera or The mobile phone of microphone, or be more generally any equipment that can recorde data relevant to interested activity. In one or more embodiments, this, which is synchronized, is realized by exchanging information between devices, so that each sets It is standby to reach an agreement in terms of the common measurement for the time, position or direction.For example, mobile phone and embedded biography Sensor can exchange the message of the current time stamp with its internal clocking;These message allow to negotiate, wherein two Equipment is reached an agreement in terms of common time.Such message can be exchanged periodically as required, preceding primary to solve The clock drift or movement of equipment after synchronization.In other embodiments, common service can be used in more recording equipments Device or server set are to obtain time, position or the normalization measurement of direction.For example, GPS system can be used in equipment To obtain the absolute location information corresponding to each equipment.GPS system can be utilized to obtain normalized temporal.NTP (net Network time protocol) server is also used as normalized temporal server.Allow individual device altogether by using server Reach an agreement with measurement aspect, communicates with one another without being always configured to.
In one or more embodiments of the invention, some of recording equipments are configured to detect various things interested The generation of part.Some such events may occur in particular moment;Other such events may occur in interval of time, Wherein the detection includes the starting of detecting event and the end of event.These equipment are configured to using described above right Should in the synchro measure basis of time, position and direction to any combination of the time of recording equipment, position or direction together with thing Number of packages is according to being recorded.
The embodiment of computer in mobile device can be configured to abandon and fall in event initial time and stop to event At least part video except only.For example, in one or more embodiments of the invention, some of recording equipments Constantly data capture to memory while waiting detecting event.In order to save memory, some equipment can be matched Be set to only when data in time adjacent to detected event when just the data stored deposit to more permanent local Server is arrived in storage media or storage.Such as in the case where not detecting event, the data of new record can deposited finally The data of precedence record are override in reservoir.Cyclic buffer can be used as one kind of such overriding scheme in some embodiments Typical realisation.When event detection occurs, other than the data captured during being stored in event itself, recording equipment can A certain configured data volume after being terminated with a certain the configured data volume and event before the starting of storage event.Appoint Where before or posterior time interval be considered as a part of event initial time and event dwell time so that for example The situation of event is shown in video.
The embodiment of the system can also include the server computer far from mobile device, wherein server computer It is configured to abandon at least part video fallen in except event initial time stops to event, and handle is originated from event Time to event dwell time time span during the video that is captured back to the computer in mobile device.
The embodiment of at least one capturing movement element may be configured to event transmission at least another fortune Dynamic capture sensor or at least another mobile device or any combination thereof, and wherein at least another described movement is caught It obtains sensor or at least another mobile device or any combination thereof is configured to save data associated with the event. Such as in having the embodiment of more recording equipments of operation simultaneously, such equipment can detecte event, and to Other recording equipments send the message for showing that such event detection has occurred and that.The message may include event starting and/ Or the time label stopped, wherein the clock for individual device uses basis synchronization time.Receiving device (such as other movements Capture sensor and/or video camera) storage of event detection message handle associated with event data can be used to non-volatile Server is arrived in storage device or storage.Other than the data being directly associated with event, the equipment be may be configured to Storage event starting before certain data volume and event terminate after certain data volume.In this way, Suo Youshe It is standby to record data simultaneously, but using from only wherein the event triggering of an equipment is multiple next for coming to initiate The preservation of the distributed event data in source.
The embodiment of computer can be configured to save from event initial time to the video of event dwell time with And the motion analysis data occurred from event initial time to event dwell time, or can use remote server to save Video.In one or more embodiments of the invention, some of recording equipments are in the period that event may wherein occur It is interior possibly all to directly communicate with each other always.In these cases, equipment may be configured to all numbers for having recorded it According to complete documentation be saved in permanent storage device or be saved in server.Data associated with event are only saved to exist Possibly it can not accomplish in the case of these, this is because some equipment possibly can not receive event-triggered message.In these situations Under, the data saved can handled afterwards, to extract and one or more detected event phases Associated is only relevant part.For example, more mobile devices may record the video of sportsman or performing artist, and Constantly the video is uploaded onto the server to store.The sportsman or performing artist may be individually equipped with being able to detect Such as the embedded type sensor of the event of special exercise or movement etc.Embedded type sensor data can by constantly or Later sometime uploads to identical server.Due to all including video flowing and embedded type sensor data Data are usually all marked added with the time, therefore video associated with the event detected by embedded type sensor can take It is extracted and combines on business device.
The embodiment of server or computer can be configured to when at least one described capturing movement sensor and move When communication linkage between dynamic equipment is open, at least part view fallen in except event initial time stops to event is abandoned Frequently, it and saves from event initial time to the video of event dwell time and from event initial time to event dwell time The motion analysis data of generation.Alternatively, the embodiment of the computer can be configured to protect if communication linkage does not open Video is deposited, and after receiving event after communication linkage is open, then discarding falls in event initial time and stops to event At least part video except only, and save from event initial time to the video of event dwell time and from event The motion analysis data that time beginning occurs to event dwell time.Such as in some embodiments of the invention, data can be as It is preceding to be uploaded to server describedly, and position associated with the data flow of each equipment and be directed toward data can by with To extract for the detected relevant data of event.For example, a biggish mobile device set can be used to Place records video at various locations during entire golf tournaments.The video data can be by constantly or touring It uploads onto the server after match.After tour, the sensing data with event detection can also be uploaded to identical Server.The place of being physically adjacent in the event occurred can be identified for the post-processing of these various data flows while being recorded Particular video stream.Additional filter can choose wherein video camera positive sense and be correctly oriented to observe the video of event Stream.These selected streams can be combined with sensing data, to form multiple video angles with the event that shows Aggregate data flow.
The system can separate from the video camera coupled with mobile device or with mobile device or by its other party Formula obtains video far from any video camera of mobile device.In one or more embodiments, from the service far from mobile device Device obtains video, such as obtains after the inquiry for the video at a certain position and time interval.
The embodiment of server or computer may be configured to synchronize the video and the event by image analysis Data or the motion analysis data, so as to more accurately determine in the video with the event initial time or institute State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this In one or more embodiments of invention, the clock between recording equipment, which synchronizes, be can be approximately.It may want to based on viewing Event from each equipment improves the accuracy of the synchronous data feeding from more recording equipments.In one or more realities It applies in example, the processing of multiple data flows is used to observe the signature of the event in different stream, to help fine granularity same Step.For example, can embedded type sensor is synchronous with including the mobile device of video cameras, but time synchronization may It is only accurate within 100 milliseconds.If video cameras is corresponded on embedded type sensor with 30 frame recording video per second Event detection video frame be based solely on synchronization time label can only be defined within 3 frames.In a reality of the equipment It applies in example, video frame images processing can be used to determine the accurate frame for being most closely correspond to detected event.Citing For, the skis detected by inertial sensor can be hit the vibration on ground and the wherein geometrical boundary of skis and The frame that ground is in contact is related.Other image processing techniques of detecting event signature can be used in other embodiments or method is come Improve the synchronization of multiple data feedings.
The embodiment of at least one capturing movement element may include being configured to determine of coupling with microcontroller The position of position determines element, and wherein microcontroller is configured to the transmission of the computer in mobile device position.At one or In more embodiments, the system also includes server, wherein microcontroller is configured to directly or by mobile device to clothes Business device transmits position, and wherein computer or server are configured to stop based on position and event initial time and event Time forms event video from the various pieces of video.It for example, can be event video in one or more embodiments It is trimmed to the event of specific length, and is transcoded onto any video quality, and is superimposed with movement point in any manner Analysis data or event data (such as speed or acceleration information) is integrated therewith by other means.Video can according to It is locally stored with storing any resolution ratio, depth or picture quality or compression type or any other technology of video, To maximize memory capacity or frame per second, or using any compression type to minimize storage, but regardless of mobile device, extremely Whether the communication linkage between a few capturing movement sensor and/or server opens.In one or more embodiments, speed Degree or other motion analysis data can be for example applied or be combined by other means in certain a part below video, Including event starting and dwell time, before event starting and dwell time may include actual event and/or it Any number of seconds afterwards, so as to the video hit before for example providing batting event.In one or more embodiments, it is described extremely Event and video can be transmitted to server by a few capturing movement sensor and/or (more) mobile device, wherein servicing Device can determine that particular video frequency and sensing data occur in specific position and specific time, and from several videos and several biographies Sensor event tectonic event video.Sensor Events for example can be from the sensor coupled with user and/or equipment Or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, deposit to for example greatly reduce video Storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or The microcontroller and computer are configured to determine the position of event and related to position progress, this is, for example, to pass through contraposition It sets and carries out the related or average central point in order to provide event, and/or can be minimized from initialization GPS sensor Erroneous position data.In this way, the video that golfer kicks off can be generated in one group of user with mobile device, It wherein can use the event location of at least one capturing movement equipment, and wherein server can obtain video from spectators And the event video of professional golfers hit and batted is generated, wherein event video can use from different photographies Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one A or multiple videos can be trimmed to the duration of event, such as from event initial time to event dwell time, and/ Or with any in preceding or posterior predetermined time numerical value around event, so that it is guaranteed that capture hit including corresponding to or Any time of other events and any whole event kept including the posture time.
In one or more embodiments, the computer in mobile device can be from an at least video camera for proximal event Request includes at least piece image or video of event, this is directed to by any video camera in the region by directly broadcasting Shooting any video request, optionally may include whether be not only located at about the video camera near event but also It is directed toward or by other means towards the directional information of event.It in other embodiments, can be by the calculating in mobile device Machine requests video from remote server.In this case, any position associated with event and/or time can be utilized To return to image near event and/or video or in the image and/or video or whole of the time shooting close to event The two.In one or more embodiments, computer or server can trim video to correspond to incident duration, and It similarly can use the various pieces of the further synchronous event of image processing techniques, such as hitting with the respective frame in video Ball matches with the acceleration information of the batting corresponded on equipment.
The embodiment of computer in mobile device or server may be configured to show a certain event occur or its In the list of one or more times that occurs of one or more events.In this way, user can find from list Event is so as to rapidly Access Events video.
The embodiment of the present invention may include to be sensed at least one capturing movement that the mobile device physically couples Device.Any kind of mobile phone or camera chain that these embodiments allow to have integrated sensor (such as any type The video camera placed of the helmet or any placing device including video camera and capturing movement sensor both all) generate thing Number of packages evidence and video data.
Detailed description of the invention
By the more specifical description provided later in connection with attached drawing, the idea conveyed by present disclosure it is aforementioned It will become apparent with other aspects, features and advantages, in which:
Fig. 1 shows one embodiment of motion event identification and video synchronizing system.
Figure 1A shows the logic hardware block diagram of one embodiment of computer.
Figure 1B shows the architecture diagram of one embodiment of the database utilized in an embodiment of the present invention.
The one of the processing that the embodiment that Fig. 1 C shows the computer corresponded in the system as shown in Fig. 1 and 1A is implemented The flow chart of a embodiment.
Fig. 1 D shows the data flow diagram of one embodiment corresponding to the system.
Fig. 2A shows the placing device based on the helmet around user's head, wherein the placing device based on the helmet Fixed capturing movement sensor.Fig. 2 B shows the placing device based on neck insert (neck insert), allows to utilize fortune Dynamic capture sensor reequips the existing helmet.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, and the outside of capturing movement sensor and the helmet is shown Isolator between part.
Fig. 4 A shows the top-sectional view of the helmet, liner, skull and user's brain.Fig. 4 B is shown corresponding in Fig. 4 A Shown in each element rotation cerebral concussion event.
Fig. 5 shows the input power (G1) for the helmet relative to observing in brain and by being placed in isolator The power that observes of sensor.
Fig. 6 shows the rotary acceleration numerical value of 3 axis together with total rotating vector quantity, together with being obtained from video camera and The video for the cerebral concussion event being display together with motion event data.
The timeline that Fig. 7 shows user is shown together with the peak along timeline for being shown as the event along timeline Value and minimum angular speed.In addition, curve shown in showing in bottom shows the lead and lag of golf club (lead and lag) together with the sagging of golf club and drift (droop and drift), wherein these numerical value determine high Bending degree of the shaft of golf club in two axis marked and drawed relative to the time.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, allow with will be rolled to, be played to or from The input near the associated start stop time point of subevent played at this, to easily allow to watch subevent.
Fig. 9 show the relative position that each subevent started and stops along the time and with starting and dwell time phase Associated gravitation allows user's input near these points to be attracted to starting and dwell time.
Figure 10 is shown using a mobile device as capturing movement element and another mobile device as reception One embodiment of the computer of the motion event data and video of first customer incident.
Figure 11 shows the one embodiment for being utilized to store the memory of data related with potential event.
Figure 12 show especially be programmed into microcontroller so as to determine whether to have occurred expected event function one The flow chart of a embodiment.
Figure 13 shows typical Event Signing or template, is compared to eliminate mistake with motion capture data Positive events.
Figure 14 shows one embodiment of capturing movement element, configured with for being locally displayed and watching event phase Close the optional LED visual detector of information, and be display configured to text associated with event or encoded messages can Select LCD.
Figure 15 shows the template properties of motion event associated with different types of equipment and/or tool clothing One embodiment is can change together with wherein capturing movement sensor individual character more accurately or more efficiently to capture The region of data associated with special time period and/or subevent.
Figure 16 shows the front view of one embodiment of protectiveness facing and the bottom in figure shows top view, It is for example worn in any contact sports, such as (and being not limited to) Association football, boxing, rugby, wrestling Or any other sports.
Figure 17 shows one embodiment of the algorithm utilized by any computer in Fig. 1, it is configured to combining Moving image and motion capture data are shown in format.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the invention.
Figure 19, which is shown, detects event by one of capturing movement sensor, and event detection is transmitted to other movements Sensor and/or video camera are captured, saves event motion data, and trimming video to correspond to event.
Specific embodiment
A kind of identification of motion event and video synchronizing system and method will now be described.It is explained in exemplary description below Many details are stated, in order to provide the more thorough understanding about idea described in this specification.But this Field in the situation in all aspects without merging detail as described herein it will be recognized that can practice The embodiment of idea as described herein.In addition, particular aspects well-known to those skilled in the art are not described in detail, with Exempt from fuzzy present disclosure.Reader should note that arrive, although elaborating the example of inventive concept in this disclosure, The present invention is limited by the complete scope of claims and any equivalent expression.
Fig. 1 shows one embodiment of motion event identification and video synchronizing system 100.Some embodiments allow to be based on The viewing of event and low power event transmission and with execute application on the mobile apparatus and/or logical with external camera Letter, to specify the window to define event.Allow the motion event in image or video to recognize specified with event, for example transports The batting of mobilization, movement are hit, sportsman, boxer, jockey or driver cerebral concussion or heatstroke, hypothermia, disease Burst, asthma attack, epileptic attack, or any other sport or the relevant thing of body kinematics including walking and falling down Part.It event and can capture from a width of one or more inner/outer video camera or nurse's camera or more image Or video carries out correlation, for example to allow the video of preservation event, such as the first time walking of children, acutely shakes event, Sport event including cerebral concussion, or fall events associated with the elderly.As shown, the implementation of the system Example generally includes the application of mobile device 101 and execution on it comprising is shown positioned movement as dotted outline and sets Computer 160 (that is seeing also the function view of the computer 160 of Figure 1A) inside standby 101 is coupled to computer 160 Display 120 and wireless communication interface (its inside for being generally in mobile device, referring in Figure 1A for being coupled with computer Element 164).Due to the mobile phone with mobile computer be it is generally existing, the user of the system can purchase It buys one or more capturing movement elements and applies (i.e. " app "), and be mounted on its existing phone to implement State one embodiment of system.Therefore, capturing movement ability is by affordable price for having possessed mobile phone, in terms of plate Any user of calculation machine, music player etc. is available, this had been always impossible in the past.
Each mobile device 101,102,102a, 102b can optionally include internal identifier reader 190 (such as RFID reader), or can couple with identifier reader or RFID reader (referring to mobile device 102) to be identified Symbol 191.Alternatively, the embodiment of the present invention can be set using any wireless technology to system transmission mark in any equipment Standby 110 identifier.The embodiment of the present invention can also include and at least one capturing movement sensor or user or equipment The identifier of any other type of coupling.In one or more embodiments, the identifier may include team and team uniform Number or student identification symbolic code or passport NO. or any other identifier allow opposite uniquely identify from spy Determine the particular event of user or equipment.This is allowed for about being configured to receive associated with special exercise person or user data Application (app) mark there is team sport movement or the position of multidigit sportsman or user.One or more embodiments receive Identifier, such as passive RFID identifier associated with sportsman or user or MAC Address or other sequences number, and mark It is associated with event data and motion analysis data to know symbol.
The system generally includes at least one capturing movement element 111, passes through placing device 192 and user 150 or dress Standby 110 coupling, such as be coupled to golf club, baseball bat, tennis racket, ice stick, weapon, club, daggers and swords or be used to appoint Other physical education facilities of any other equipment of what sports such as footwear, belt, gloves, glasses, cap etc or Any other article of person.At least one described capturing movement element 111 can be placed on one end of equipment 110, both end Either any position between both ends or any position with user 150, such as it is placed on ball cap, headband, the helmet, facing Or in any combination thereof, and the EI measurement of any article can also be used in.The capturing movement element can be optional Ground includes visual indicia (being passively or actively) and/or may include wireless sensor, such as is capable of providing and capturing movement The direction (north south and/or up/down) of element, position, speed and/or the associated one or more numerical value of acceleration it is any Any sensor of combination.The computer may be configured to for example by visual manner or wireless mode from club 110 The RFID of coupling obtains identifier (the namely identifier exclusive with each 110 (such as clothing, bats etc.) of equipment 191) it is associated and optionally data associated at least one described capturing movement element, analyzes the data to be formed Motion analysis data, and motion analysis data are shown on the display of mobile device 101 120.Capturing movement element 111 can To be placed in by capturing movement placing device 192, equipment is upper or it nearby or is placed in user or near it. Such as the capturing movement element 111 being placed on the helmet may include isolator, the isolator includes being configured to around fortune The material that dynamic capture element damps so as to the physics acceleration of the celiolymph approximately about user's brain, to minimize event The transformation of the linear acceleration and rotary acceleration of data, to obtain the observation linear acceleration and observation rotation of user's brain Acceleration.The process demand on capturing movement element microcontroller is for example just reduced in this way, and for the base of event data Allow low memory utilization and low-power requirements in the transmission of event.Motion capture data from capturing movement element 111, with Equip 110 associated any data (such as identifier 191) and with user 150 or any number of such user 150 (such as second user 152) associated any data can be stored locally in memory, or be stored in computer In local database, or it is stored in remote data base, such as can be with the database 172 of Coupled processors.Such as When from capturing movement element 111 to mobile device 101 and slave mobile device 101 to network 170 or internet 171 and to number When having network or available telephony network links according to library 172, the data from each user 150,152 can be stored in data In library 172.Then reality is closed in large data collection associated with any number of user and its concrete property and performance parameter Apply data mining.Such as in golf embodiment of the invention, club ID is obtained from golf club, and pass through movement Capture element detection batting.Mobile computer 101 stores the image/video of user, receives and bats/transport corresponding to event/hitting/ The motion capture data of event location and subsequent batting on dynamic and court, and determine the parameter for corresponding to each event (such as distance or speed when event generation), and then implement any local analytics, and show table on the mobile apparatus Existing data.Golf is taken turns when the network connection of slave mobile device to network 170 or internet 171 is available, such as one Ball match after, described image/video, motion capture data and performance data be uploaded to database 172, for later into Row analysis and/or display and/or data mining.In one or more embodiments, user 151 (such as original equipment manufacturer) Access for database is paid, this is, for example, the calculating for passing through such as computer 105 or mobile computer 101 etc Machine, or from can for example pass through network 170, internet 171 or by website 173 communicated with database 172 appoint What his computer, or formed database 172 a part or server coupled thereto.Data mining can be in number According to being executed on library 172, wherein for example may include local server computer, can either be set in computer 105 or movement It is run on standby 101,102,102a or 102b, and for example accesses the free-standing embodiment of database 172.Data mining results can In mobile device 101, computer 105, television broadcasting or web video from video camera 130,130a and 103b or 104 Upper display, or accessed by website 173 or any combination thereof.
One or more embodiments of at least one capturing movement element can also include being configured to send out in event The light-emitting component of output light in the case where life.This can be utilized to show on the exterior portion of the helmet potential, slight or again Cerebral concussion is spent, without for example for any communication of any external equipment.Different colors or flash of light interval can also be utilized To convey information related with event.Alternatively or in combination, at least one described capturing movement element can also wrap Audio output element is included, is configured in the case of an incident or at least one described capturing movement sensor Sound is exported in the case where except the range of computer, or wherein the computer is configured at least one described fortune Any combination of display alarm or aforementioned items in the case that dynamic capture sensor is in except the range of computer.Sensing The embodiment of device can also utilize LCD, such as the volume of current event is exported in quick response (QR) code or bar code Code analysis so that referee for example be allowed locally to obtain the snapshot of analysis code on the mobile apparatus, and makes event It will not be watched or be wirelessly communicated and intercepted by all other men with readable form on a sensor.
One or more embodiments of the system can use the mobile device including at least one video camera 130, institute State the computer that video camera is for example coupled in mobile device.This allows for the computer command video camera in mobile device 101 130 for example obtain the one or more image of user during sport is mobile.(several) image of user can with show and comment Fixed superposition, so that motion analysis data for example be made more to be appreciated that the mankind.Alternatively, the not no detailed data of user images Display can also be shown on display 120, such as be shown on the display of computer 105.In this manner it is achieved that Allow two dimensional image and subsequent display.If mobile device 101 includes two cameras, taken the photograph as shown in mobile device 102 Shadow machine 130a and 130b, then the video camera can be utilized to three-dimensional for example, by the image analysis creation for visual indicia Data acquisition system.Allow for determining and analyzing distance and the position of visual indicia in this way.In any embodiment of the invention, come It can be stored on database 172 for example associated with user 150 from the image of any video camera and/or video to be used for Data mining purpose.In one or more embodiments of the invention, image analysis can be implemented on image and/or video, For example to determine the board of utilized equipment, clothing, footwear etc. according to the day time of the age of user 150 or match Any other mode in son/model, or discovery data.
Alternatively, can use more mobile devices for the embodiment of the mobile device only with a video camera to scheme The form of picture obtains 2-D data, and carries out triangulation location to it to determine the position of visual indicia.The one of the system In a or more embodiment, mobile device 101 and mobile device 102a share the image data of user 150 to create three maintenance and operations Dynamic analysis data.It would be recognized by those skilled in the art that by determining the position of mobile device 101 and 102 (for example, by equipment In the position of common GPS chip etc determine element or by cellular tower triangulation location, for clarity not by Show but be usually located at as computer 160 inside of mobile device), and by being obtained from capturing movement element 111 Data (such as location of pixels in visual indicia image locating in every piece image), it is easy to obtain distance and to Obtain speed.
Video camera 103 can also be used in static image, or be used in video as present institute is common.? In embodiment using the system of external camera, any method for obtaining data from external camera all meets the system Spirit including the Wireless transceiver of data, such as passes through wire communication when video camera 103 is docked with computer 105, It can then be transferred to data mobile device 101.
In one or more embodiments of the system, the mobile device for showing motion analysis data on it is not needed With video camera, that is to say, that mobile device 102b can also show data although not configuring video camera.Therefore, mobile device 102b can be with any group of video camera, video camera 103 and/or television camera 104 on slave mobile device 101,102,102a It closes and obtains image, as long as any external camera can transmit image to mobile device 102b.Alternatively, completely without taking the photograph Shadow machine utilizes the system.Such as see also Figure 17.
For television broadcasting, 111 Wireless transceiver of capturing movement element passes through the data that antenna 106 receives.So from The wireless sensor data that capturing movement element 111 obtains is combined with the image obtained from television camera 104, to generate The display of motion analysis data with enhancing, can be broadcast to TV, computer (such as computer 105), movement set Standby 101,102,102a, 102b or any other equipment for being display configured to image.Such as the position by knowing video camera Set (such as passing through GPS information) and the direction by knowing video camera institute direction and/or direction, motion analysis data can be by It positions on display 120, as long as sensing data includes position data (such as GPS information).In other embodiments, Visual indicia or image procossing can be utilized to a motion analysis data interlock to image, such as can track height in the picture Golf club head, and corresponding high, the neutralization lower position of club can be utilized to determine user 150 for video camera 130 or 104 or 103 direction, so that for example the data by enhancing are correctly marked and drawed on the image of user 150.Pass through Between the image added-time mark and marked between the motion capture data added-time, such as in microcontroller timer and movement It, can after timer synchronization and subsequent scan image in equipment are to find the visual indicia or physical education facilities at each position The motion capture data by simplification is added on image.It can use handle in one or more embodiments of the invention Any other method that image and motion capture data from video camera are combined.According to spirit of the invention, can use Motion analysis is properly located about user on display 120 (or any other display on such as computer 105) Any other algorithm of data.For example, when obtaining event or event group by sensor, event is received in application And/or after the time range to obtain image, using can from its local storage, any other mobile device, can be with The video camera of any other type communicated requests the image data from the time span, and/or puts up event Position/time, so that the external camera system in (multiple) event local can provide and correspond to (multiple) event Time image data.
The such display of one that can generate and show in mobile device 101 include using slave mobile device 101,102, Two or more selected in 102a, video camera 103 and/or television camera 104 or any other external camera The BULLET of video cameraView.In the embodiment of the system, the computer is configured to obtain user 150 two width or more image and at least one capturing movement element (either visual indicia or wireless sensor) Associated data, wherein described two width or more image is obtained from two or more video cameras, and wherein institute It states computer and is configured to generate display, there is shown with the use surrounded shown in user under normal speed and under all angles The slow motion at family 150.Such embodiment for example allows one group of football fan to create the professional golfers of their own in tour In BULLETFilm.The film can be sent to computer 105, can implement to appoint on computer 105 What image procossing needed for and for example broadcasted to televiewer.In the other embodiments of the system, various mobile devices User sharing their own image collection, and/or for example by its uploading films to website for watching later.The present invention Embodiment also allow in mobile device related with another one user using from other sportsmen with mobile device Image or video so that user do not need for example exchange mobile phone.In one embodiment, when by first user's needle It, can be with when obtaining video to the physical education facilities in movement not associated with the second user with video cameras mobile phone The video is automatically transferred to the first user, to show using motion capture data associated with the first user. Alternatively, the mobile phone of the first user can be utilized as motion sensor with substituted or supplemented capturing movement element 111, and And the mobile phone of second user can be utilized to capture the video of the first user during exercise.First user can be optionally Gesture, percussion/shake etc. are made on phone, should start/stop motion capture to show the second mobile phone for example.
Figure 1A shows one embodiment of computer 160.It include the processor for executing software module in computer 160 161, the software module is generally also referred to as applying, and is stored in main memory usually as computer program instructions In 162.Display interface 163 drives the display 120 of mobile device 101 as shown in Figure 1.Optional direction/position module 167 may include north south or up/down is directed toward chip or all the two.In one or more embodiments, the direction/position Module may include that the position coupled with microcontroller determines element.This for example may include GPS device.Alternatively or therewith It is combined, the computer can cooperate with another computer to carry out triangulation location to position, or fixed from any other triangle Position type receiver obtain position, or based on by couple with the computer and it is known direction specific direction photography Machine captured image comes calculating position, wherein the computer for example calculated based on the direction of the object in image and size with The offset of mobile device.Optional temperature sensor can be coupled by wired or wireless link with processor 161, and example Such as appointing for consciousness can be shaken or lost using only the index as hypothermia or heatstroke, or with for example may indicate that What detected movement is combined.Communication interface 164 may include wirelessly or non-wirelessly communication hardware protocol chip and/or RFID Reader or RFID reader can be externally coupled to computer 160 such as be coupled to by any other mode Computer 160.In one or more embodiments of the system, communication interface may include that phone and/or data communication are hard Part.In one or more embodiments, communication interface 164 may include Wi-Fi TM or other 802.11 equipment of IEEE and/orWireless communication interface orWireless device or any other wireless technology.1st classEquipment has approximate 100 meters of range, and the 2nd class equipment has approximate 10 meters of range.Low-power equipment has approximate 50 meters of range.It can be used and appoint in the embodiment of the system What wireless network protocol or type, as long as mobile device 101 and capturing movement element 111 can communicate with one another.Processor 161, main memory 162, display interface 163, communication interface 164 and direction/position module 167 can be by being commonly referred to as The communications infrastructure 165 of " bus " communicates with one another.Communication path 166 may include allow it is wired with other by network 170 Or the wired or wireless medium that wireless device is communicated.Network 170 can be communicated with internet 171 and/or database 172. Database 172 can be utilized to save or fetch the image of user or video perhaps motion analysis data or according to certain The user that form and motion analysis data are display together.Upload to internet (namely remote data base or remote server or Storage of the person far from system) data can be watched by any computer for obtaining the access for data, analyze or count According to excavation.This allows for original equipment manufacturer to determine that physical education facilities works preferably for given user, and/or It will suggest that is equipped.Data mining also allows to plan golf based on data associated with the user and/or metadata Court, such as age or any other demographic information that can be input into system.The long-range storage of data is also permitted Perhaps medical applications, for example, morphological analysis, with the time motion range and diabetes control and practice monitoring and compliance answer With.Application based on data mining also allows using one or more previous performances from other users, same subscriber Or historical movement person is (such as after the motion picture or video of analysis of history sportsman, regardless of the historical movement person is It is no alive) real motion capture data play.Virtual reality and enhancing virtual reality applications can also be caught using movement Obtain data or historical movement data.The system also allows the relevant event of performance and/or motion capture data to upload to number According to library 172, such as it may be implemented such that social network sites.This allows for user to send during or after match about high score " pushing away literary (tweet) ", to notify the new event to the owner on internet.For example, one or more implementations Example includes at least one capturing movement element 111, is configured to and user or equipment or the mobile device coupled with user It is coupled, wherein at least one described capturing movement element includes: memory;It is configured to capture and at least one described movement The sensor of any combination of the associated numerical value of direction, position, speed, acceleration of capture element;Radio device;And The microcontroller coupled with memory, sensor and radio device.It includes carrying out autobiography that the microcontroller, which is configured to collect, The data of the sensor values of sensor, store data in memory, are analyzed data and are picked out in data Event transmits event data associated with event by radio device to determine event data.The system Embodiment can also include the application for being configured to execute on the mobile apparatus, and wherein mobile device includes computer, is configured At the wireless communication interface for communicating to obtain event data associated with event with radio device.The computer It is coupled with wireless communication interface, wherein computer executes application or " app " to configure the computer: connecing from wireless communication interface Event data is received, event data is analyzed to form motion analysis data, stores event data or motion analysis data or event Both data and motion analysis data are whole, and display includes event number associated with an at least user over the display According to or motion analysis data or all both information.
Figure 1B shows the architecture diagram of one embodiment of the database 172 utilized in the embodiment of the system. As shown, table 180-186 includes passing about P of N users, the M part equipment of every user, every user or every equipment Sensor, the S item sensing data of each sensor, the T kind mode found in other tables, D data users and V video Information.All tables shown in Figure 1B are all exemplary, and like that may be used according to desired for specific implementation To include more or fewer information.Specifically, table 180 includes the information about user 150, wherein may include and user Related data, such as age, height, weight, gender, address or any other data.Table 181 includes and M part equips 110 Related information, such as manufacturer, the model of equipment and the type of equipment of equipment, the equipment may include club, ball Bat, bat, shirt, trousers, footwear, gloves, the helmet etc..Such as in golf embodiment, at one of the invention or In more embodiments, manufacturer can be the title of manufacturer, and model can be title or model number, and type can be Club numbers (such as No. 9 irons), and equipment ID can be identifier 191.Table 182 may include about user 150 or equipment 110 Or the information of the P sensor 111 on mobile computer 101.Sensor associated with user 150 may include clothing, ball Bar, the helmet, ball cap, headband, facing etc. for example can be motion capture data sensing with 110 associated sensors of equipment Device, and sensor associated with mobile computer 101 for example may include for position/direction sensor 167 and being used for The sensor 130 of image/video.Table 183 may include the information about the S item sensing data of every user every equipment, Wherein the table may include time and position or any other metadata related with sensing data of sensing data, than The temperature sensor as shown in through Figure 1A obtains in local or by wireless communication such as by any other side Temperature, weather, humidity or the sensing data that formula obtains may include the information or any combination thereof.The table can be with Include many other fields, such as ball type, that is to say, that in golf embodiment, the type of the golf utilized It can be saved and data mining was being carried out to it later to find out the ball type etc. put up the best performance.The table can also wrap Include the event type in local computing, such as potential cerebral concussion event.Table 184 may include about for example at data mining The information of the T kind mode found in reason.This may include passed through field that ad hoc inquiry was searched in each table and Any obtained correlated results.It, can be according to for specific implementation institute in one or more embodiments of the invention Any data mining results table type is utilized as it is expected that.This may include any kind of search result, including Can on a computer 160 local computing EI measurement, or from simply inquire complex patterns search for any other search Numerical value.Table 185 may include the information about D data mining users 151 and may include its access type, that is, complete Full database perhaps mode table or is limited to particular manufacturer etc., which for example can also include corresponding to data to dig Pick user has paid or has agreed to payment requirement and/or the receipt of the usage type paid, and looks into any The related any search of mode or suggestion ask or found.Including allowing to sensing data (including motion capture data) Carry out any other scheme including the OODB Object Oriented Data Base relationship of data mining or the data structure based on memory All meet spirit of the invention.Although giving the exemplary embodiment corresponding to specific activities, those skilled in the art It will be recognized that for example by using capturing movement element and operate in user existing cellular phone 101,102 or other meter The embodiment of application on calculation machine 105, the system can capture and analyze any kind of based drive activity.Data The embodiment in library may include the V video 179 being stored in table 186, wherein for example including the user, the video counts that generate video According to, time of video and position.The field is optional, and in one or more embodiments, video can be stored In any mobile device or mobile device and any combination of server/DB 172 in systems.In one or more realities It applies in example, video can be broken down into video subset associated with " time " field of sensing data table 183, wherein described Time field may include event initial time and event dwell time.In this case, biggish video can be trimmed to about At one corresponding to usual smaller time window (it is associated with the event for the event type being stored in table 183) or more Mostly smaller event video, to significantly reduce the video storage demand of the system.
The embodiment of the system is benefited from there are many application and is realized by the embodiment of the system, is provided It is watched on mobile computer or server/database and analyzes motion capture data, so as to for example by user 151 to database 172 carry out data mining.For example, user 151 may include compliance human observer, wherein for example including parent, Er Tonghuo Any other entity of the elderly, manager, doctor, insurance company, police, army such as equipment manufacturing quotient etc, Data mining can be carried out for product improvement.Such as specific stature or age are corresponded to by search in tennis embodiment User highest serve speed, or by based in the sensing data field in table 183 in golf embodiment Speed of hitting come detection range (difference between ordinal position namely in table 183), so that it is determined which manufacturer has Optimal club is perhaps according to the age of every user or the best club or many other modes of height or weight.It is related to The other embodiments of compliance allow in the case where meeting the threshold value for corresponding to gravity (height or zero or any other grade) It generates from mobile computer 101 or from the message of server/database, to be sent to compliance human observer, management Person, doctor, insurance company etc., as already described above.User 151 may include marketing personnel, determine Specific user possesses which equipment and other similar user may possess which relevant article, to be directed to specific user It is sold.User 151 may include healthcare givers, can determine for example with the footwear of Children with Diabetes (that is certain The equipment of seed type) coupling sensor carried out how many movement and the movement have relative to common non-diabetic children it is more It is few, wherein may include providing the excitation etc. more taken exercise for Children with Diabetes according to the suggestion of table 185, so that should Children are consistent with healthy children.Sports doctor, physiologist or Physical Therapist can use the data of every user, or Person scans in a large number of users and the specific movement for example a certain user or motion range are carried out with other users Compare, to determine that given user can be improved by stretching or practice in which field and which motion range is led Domain according to user or according to group as the time changes and, for example, user can use what type of equipment cope with The change (or even before these change generation) of time.By to motion capture data and image data relevant to movement Carrying out data mining is that user 151 provides unique advantage.It can implement number in the buckling parameter by sensor measurement According to excavation, so as to determine physical education facilities, footwear, human body or any other article flexibility whether with the time or Any combination thereof is changed or determined between equipment manufacturing quotient.
In order to ensure including relatively associated with horizontal line (not having namely for the analysis of user 150 during capturing movement Have inclination) image, the system for example may include the direction module executed on the computer 160 in mobile device 101. The computer is configured to the direction Notes of Key Data user based on the direction hardware in mobile device 101 along level Planar alignment video camera.It would be recognized by those skilled in the art that being directed toward hardware is common on the mobile apparatus.This allow for as This captured image keeps maintaining an equal level relatively about horizontal plane.The direction module can also prompt user towards or away from the use Family travelling shot machine, or for user further focal length or zoom out focal length so as to user be placed on figure " debugging frame (fit Box in) ", so as to the size for the user that will be captured that standardizes to a certain extent.Image can also be proved by user's utilization It has for example been deferred to for the doctor's advice for meeting special exercise requirement.
The embodiment of the system is further configured to identification at least one movement associated with user 150 or equipment 110 Capture element, and at least one capturing movement element 111 is related to the specified position on user 150 or equipment 110 Connection.For example, user can shake specific capturing movement element when by computer prompted in mobile device 101, Computer for confirmation is requesting the identity of which capturing movement element.Alternatively, can divide when implementing known activity The position of analysis motion sensor data and/or speed and/or acceleration, and the riding position about capturing movement element is automatic Classify, or confirms assumed position by prompt user.Sensor can for example pass through team's title and team uniform number Code is associated with special exercise person, and is stored in the memory of capturing movement sensor for event transmission.In Fig. 1 Any computer shown can be utilized to be programmed the special exercise capture associated identifier of sensor, so as to Meet spirit of the invention.
One or more embodiments of computer in mobile device 101 are configured to obtain at least width of user 150 Image, and three-dimensional coating is shown on at least piece image of user 150, wherein the three-dimensional coating and motion analysis number According to associated.Various displays can be shown on display 120.The display of motion analysis data may include and motion analysis number According to associated evaluation, and/or the display of ball flight path calculated associated with motion analysis data, and/ Or show along the time axis the time point that peak value associated with motion analysis data is occurred timeline it is aobvious Show, and/or to help user improve the user technical detail suggestion training course.These are by filtering or analysis Data pick-up result can be stored in database 172, such as be stored in table 183, or can be on the database (or associated with database server, such as any other computer in the system shown in figure 1 or combinations thereof In) untreated data are analyzed, and then shown in mobile device 101 or website 173, such as pass through Television broadcasting from video camera 104.It can be in any manner unique display phase of data mining results and the system Combination, and can also be shown in any desired manner.
An interface can also be presented in the embodiment of the system, to allow 150 to pass through nothing by mobile device 101 Line interface buys equipment 110, such as passes through internet or the computer of the server by may be implemented such that retailer 105 are bought.In addition, for customization debugging equipment, for example, putter shaft length or any kind of equipment it is any its He customizes size and determines, an interface can be presented to allow user 150 to pass through mobile device 101 in the embodiment of the system Wireless interface come order customization debugging equipment.The embodiment of the present invention also allows mobile device 101 to 150 suggestiveness of user Can preferably equip, or allow user 150 be searched through to database 172 carry out data mining determined by performance it is better Equipment, wherein the golf of every ball bar for the user with the speed of hitting in the predefined scope in user 150 Ball hitting distance carries out data mining.This allows for for example digging real-life performance data by user 151 (such as OEM) It digs and utilizes to suggest equipping to user 150, and charged thus, this is, for example, to pass through to be directed to such as shown in Fig. 1 appoint The access pay of the data mining results shown in what computer either passes through website 173.Of the invention one or more In embodiment, database 172 tracks OEM data mining, and is configured to for example for each user 151 in given note The quantity for the access bought and/or used in the account period is charged to user 151.For example, see Figure 1B.
The embodiment of the system is configured to analyze the data obtained from least one capturing movement element, and is based on The intermediate degree of at least one the capturing movement element coupled with equipment vibrated to determine the collision between ball and equipment, and Impingement position is shown based on motion analysis data.The performance data are also stored in database 172, and for example with The data mining that is carried out in a large amount of collisions and by OEM or coach using suggesting the ball with higher hit probability placed in the middle Bar.
Although Figure 1A depicts physical equipment, the range of system and method set forth herein can also cover specifically Virtual unit, virtual machine or simulator in one or more computer programs are realized, wherein the computer program is held Row serves as or provides the method for the concept disclosed with implementation on computer or computer system and handle compatible Computing system environments.Virtual machine, processing, equipment etc. and the system physical computer system substantially similarly In the case where running, in the range of such virtual platform will also fall in the system of present disclosure, although as described herein Physical system as shown in figure 1A.
Fig. 1 C shows the place for corresponding to the pass and implementing and allow using the embodiment of computer in the system The flow chart of one embodiment of reason.In one or more embodiments of the system, multiple fortune are optionally calibrated at 301 Dynamic capture element.In some embodiments, it means that multiple sensors with calibration user or on equipment, to ensure to pass Sensor is aligned and/or is configured to for given input motion speed having the same or acceleration value.At this In the other embodiments of invention, it means that multiple capturing movement sensors are placed in calibration object, the calibration object Movement is and at the same time calibration direction, position, speed, acceleration or any combination thereof.The step for generally include provide movement Capture element and optional placing device (or alternatively allowing to utilize the mobile device with capturing movement sensing function), with And for example allow that there is the user of existing mobile phone or computer using the embodiment of the system to obtain capturing movement Data and the application for potentially analyzing and/or sending based on this message.In one or more embodiments, user can be with Capturing movement element and application are simply bought, and begins to use the system at once.The system utilizes (more at 302 It is a) capturing movement element carrys out capture movement data, such as any event is picked out in motion capture data at 303, also It is above the linear and/or rotary acceleration for the threshold value for showing cerebral concussion, and for example motion capture data is sent at 304 To mobile computer 101,102 or 105, wherein may includePhone or user can use Come in the computer for any other type for being collected locally data.In one or more embodiments, sensor can be to any Other capturing movement sensors transmit event, to start event data storage processing for example in other sensors.At other In embodiment, sensor can transmit event to other mobile devices, to show should for example to abandon unwanted video The video for corresponding to event is saved in the case where part, to allow or near the time point of event or in certain later One time trimmed video.In one or more embodiments, the system minimizes the complexity of sensor, and example It is enough competent computing element as processing is unloaded to the ability found in existing mobile phone and other electronic equipments. It can occur when possible from capturing movement element to the computer of user transmission data, periodically occur, in the base of event Occur on plinth, occur when being polled or occur in any other manner, as will be retouched in each chapters and sections herein As stating.This saves a large amount of electric power at two aspects compared with the known system for continuously sending untreated data, Data can be sent in event packets in the time window around special exercise event first, thus data compaction to always Unprocessed data a significant small subset, and secondly can be according to lower than the frequency that continuously transmits or The time of definition sends data when being solicited data, to limit the total degree of transmission.In one or more embodiments In, it is slow in the event that is locally displayed, such as yellow for example to can use the LED to glisten on capturing movement sensor 111 at 305 It dodges and corresponds to potential cerebral concussion, or red quick flashing corresponds to the very high cerebral concussion of possibility.Alternatively or therewith phase group It closes, such as can transmit and display alarm or event in any other computer shown in Fig. 1 or mobile device.
Main intelligence in the system is typically found in mobile computer or server, wherein can use more many places Reason ability, and for example to utilize communication capacity generally existing in existing mobile computer.The one of the system In a or more embodiment, mobile computer optionally can obtain identifier or the mark from user or equipment at 306 Symbol can be used as a part of step 305 and be transmitted, for example, passive RFID or active RFID such as team/team uniform number or The other identifier of other sportsman ID etc accords with, which can determine come the identifier based on equipment by mobile computer utilization Just potentially injured perhaps user is lifting any weight to position user or user is wearing what shoes running, Huo Zheyong Any weapon is used in family or what kind of activity is used in user.Mobile computer can be local point at 307 Analyse motion capture data, and for example when observing threshold value in data show (namely showing) or send for example message it The information of class, such as when sportsman, soldier or racing driver are subjected to excessive gravity, or when there is no enough movements (at that time or based on the data pattern in database, for example based on the user as discussed hereafter Typical movement pattern or other users motor pattern).In other embodiments, once user implement it is certain amount of Movement can send a message to storage to (multidigit) safety or compliance human observer at 307 or show by other means Registration evidence, wherein for example including referee, parent, children or the elderly, manager, doctor, insurance company, police, army or Any other entity of person such as equipment manufacturing quotient etc.The message can be SMS message, Email, push away text or appoint What other kinds of electronic communication.If specific embodiment is configured for remote analysis or is used only for remote analysis, Then motion capture data can be sent to server/database at 308.If implementation does not utilize teledata Library, then the analysis on mobile computer is local.If implementation includes remote data base, can moved at 309 Implement analysis in dynamic computer or server/database or whole the two.Once database obtains motion capture data, then Data can be analyzed, and can desirably be sent from server/database to compliance personnel or commercial entity Message, so as to individually shown at 310 event or with the associated preceding events data phase group of the user or other users It closes or shows event about the preceding events data.
The embodiment of the present invention compares the data from mobile computer and/or server for game, form, defers to Property, work tracking burnt calorie, implemented, based on movement or the previous movement different on daytime and night Mode monitors children or the elderly, when gravity stops beyond threshold value or movement for sportsman, the safety monitoring of army, example Such as in the honeycomb of the virtual reality applications of the current and/or past data or data from other users including the use of user For running, jump, local the using of throwing capture data on phone, is either implementing or counting based on user Music or selection playlist are played according to the type of the movement of excavation.For example, if movement is similar in database Know sportsman, then the playlist of the user can be sent to the mobile computer 101 of the user.The processing can be It is local to implement, to play quick music if movement is very fast, and sound at a slow speed can be played if movement is relatively slow It is happy.Any other algorithm that movement based on user plays music all meets spirit of the invention.For from capturing movement element Any use of the motion capture data obtained with the application on the existing mobile computer of user all meets spirit of the invention, Including exercise data is used in reality environment, so as to using the prior behavior from the user or from another The actual motion data of one user's (for example including historical movement person) show the relative motion of the incarnation of another one sportsman.Letter The display of breath be usually implemented by three kinds of situations, wherein display information be motion analysis data based on user either About the equipment of user and previous data, wherein previous data can be from identical user/equipment or one or More multidigit other users/equipment.In this case, current motion analysis data elder generation associated with the user/equipment The comparison of preceding data allows using the extremely cost-effective system with capturing movement sensor and application come analytical model.? Under another situation, the display of information is the performance according to active user, so that from the user or another user/equipment The past data of selection is the performance based on active user.This allows for the match of high realism, such as with historical movement person For the virtual tennis tournament of opponent, wherein being made back actually by the capture movement from historical movement person to hitting for user It answers.It is brought using this authenticity match of real data both (current and previously stored data all) as true as possible Real match, such as user are played with the average mode of 10 tennis player before ranking for opponent, that is, service speed The speed and angle of degree, the return of serve batted for the given input of user.Such as television image can be analyzed to really It is fixed by may alive historical movement person has not got batting hit speed and type, to be that opponent tests and uses with great master The skill at family, it is still alive just as great master and currently just playing with user.It can be real in the third situation The compliance and monitoring for applying the user or different user, the elder generation without past data or other users with the user Preceding data are compared, wherein the different user does not for example possess without the access for mobile computer or movement Computer.In other words, the mobile phone user associated and different with just monitored user is obtaining and is for example wearing The related information of current performance for the user (such as baby or diabetic) for wearing capturing movement element.
Fig. 1 D shows the data flow diagram of one embodiment corresponding to the system.As shown, from many inhomogeneities Multi-motion capture element 111 on the equipment 110 of type or associated with user 150 sends motion capture data, example Such as it is in clothing, the helmet, headband, ball cap, on facing or any other position for coupling with user.Equipment or user can Selection of land have identifier 191, allow system numerical value is associated with movement, that is, lifting weight, be used The type of racket, the type (namely game console) of electronic equipment currently in use or other objects, such as with The two associated baby's nightwear of user 152 (such as baby).In one or more embodiments, capturing movement element can be used Element 191 in 111 substitutions or enhancing figure, as those skilled in the art will appreciate.At one of the system Or more in embodiment, mobile computer 101 is for example with event form and for example on the basis of event or by moving Computer 101 receives motion capture data when requesting, this is, for example, to have data and reception in the statement of capturing movement element 111 After device opens set time amount to reply request to avoid waste electric power, without request is received, then connecing It receives device and closes a period of time.Once data are in mobile computer 101, then data are analyzed, for example to obtain not Motion capture data processed or based on event, and for example determined in the way of concise and be easier to be understood by people The project such as average speed.The data can be stored and (be shown on the right side of mobile computer 101), and then may be used By for example according to human observer or compliance text or Email in the form of or with mobile computer 101 or computer 105 Data are shown to user 150 or 151 on associated display.This just potentially allow for it is not associated with capturing movement element simultaneously And user optionally or even not associated with mobile computer obtains human observer message (such as baby slowly breathes), or Person for example watches virtual reality match or performance, wherein may include currently providing the user of motion capture data, has The user of previously stored data, or after the movement in the video showed past (more) tour is analyzed It further include historical movement person (such as famous golfer) etc..It is current wherein for example to be obtained from user 150 or equipment 110 Data in the game scenario of data, such as on virtual reality glasses, which are shown, can use from the user/equipment or another One user/equipment past data, so that the current motion data to user makes a response, that is to say, that according to the input of user It makes a response.Previous data can be stored at any position in system, such as be stored in mobile computer 101, meter In calculation machine 105 or it is stored on server or database 172 (referring to Fig. 1).Previous data can for example be utilized to User 151 shows that user 150 has gone through certain number of potential cerebral concussion event, it is therefore necessary to treat special time amount It can have a return match.Insurance company can for example require such compliance to reduce medical expense.It can be from mobile computer 101, it computer 105 or stores and takes on the server or in the database coupled with server 172 as shown in fig. 1 Video is returned to form event video, the event video is for example including the event data and event shown simultaneously over the display Video, be usually for example applied or show in the separated part of the display of mobile computer 101 or computer 105 Out.
Fig. 2A shows the placing device based on helmet 110a of the head 150a around user, wherein the peace based on the helmet Device is put as shown in figure to be fixed on the rear section of the helmet capturing movement sensor 111.Fig. 2 B is shown in the helmet The bottom rear placing device shown partially based on neck insert allows to reequip using capturing movement sensor 111 existing The helmet.Attached including being configured to couple with the head 150a of user or being worn on user's head 150a by other means In the embodiment of at least one close capturing movement sensor, the microcontroller can be configured to calculate in user's head Impingement position.The calculating of impingement position in user's head is based on user's head and/or helmet physical geometry.Citing For, if capturing movement element 111 shows to lead to without the backward acceleration (as shown on the right side of the figure) of rotation The direction that the vector of tracking acceleration returns to except the helmet or the circumference of user's head is crossed to calculate impingement position.This is non-rotating Otherwise calculating can be observed near actually showing the line of force by user's head/helmet center of gravity or its by capturing movement element 111 To rotary force.If observing lateral vector at capturing movement element 111, rum point is calculated as being in the helmet/head Side and pass through center of gravity.Thus, for example at least within the period near acceleration peak value or in any other time Any other shock for not applying rotary acceleration to capturing movement sensor during section can be considered as being applied in By going on the direction of the helmet/head for center of gravity.Therefore, the calculating of rum point is calculated as detecting the vector of power The intersection point of the helmet/head outer perimeter, and rum point is extended through to returning by calculating the distance gone back from center of gravity and angle. For example, it 45 degree and is not rotated if acceleration is in, rum point is from the helmet/head center of gravity to times 45 Degree, therefore 45 sine (approximation 0.7) is calculated multiplied by the radius (or 5 inches) of the helmet, to obtain apart from helmet front about 3.5 inches of shock.Alternatively, impingement position can be maintained in angle format, so as to show to hit be in apart from the helmet/ 45 degree of head front.On the contrary, the helmet/head surrounds sensor if observing the rotary acceleration of not linear acceleration Rotation.In this case, power needed for rotating brain pass through in front of center of gravity and usually be defined as by center of gravity and The line of sensor is orthogonal (such as side impact), otherwise will observe linear conversion acceleration.In this case, position is hit Be placed in is to be in the helmet/head side opposite with acceleration direction.Therefore, being for both calculating of impingement position can Example with the simplified calculation method being utilized, but also can use in view of head/helmet quality and head/helmet Any other vector based method of size.Algorithm as a kind of can use any mathematical equation, such as F=m*a, It is exactly that power is equal to quality multiplied by acceleration and torque=rXF, wherein r is the position arrow at head/helmet exterior portion Amount, X is cross product and F is force vector, and to calculate force vector, and it is outer to be transformed back to the helmet/head if desired Circumference is to calculate the force vector applied at this location.Although being described about the helmet, at least one described movement The other embodiments of capture sensor are configured to any kind of placing device, encapsulation or coupling mechanism and cap Or ball cap is coupled, is coupled in protectiveness facing.Similar calculating can be utilized for cap/ball cap/facing, so as to from for example Acceleration or any other quantity of cerebral concussion dependent event be may indicate that determine the position/orientation of shock, linear or rotation Turn power.Some embodiments may include at least one capturing movement sensor or with the microcontroller that for example shows in figure 1A The temperature sensor of device coupling.Temperature sensor can be by using only or with capturing movement elements combine, so as to for example It determines whether body or head are shaking, that is, shows hypothermia, or determine whether not detect movement, and Such as wirelessly or shows that body or brain are higher than by the temperature of the temperature sensor measurement based on line and show The threshold value of heatstroke.
The embodiment of the present invention can also using the isolator being configured to around at least one capturing movement element so as to Approximately about the physics acceleration damping of the celiolymph of user's brain, to minimize the linear acceleration and rotation of event data The transformation of rotational acceleration, to obtain the observation linear acceleration and observation rotary acceleration of user's brain.Therefore, some implementations Example need not from the acceleration based on the helmet power or acceleration value or any other numerical transformation to being observed Brain acceleration value, therefore the embodiment of the present invention provides the data specific to event using less electric power and storage, To minimize the quantity of data transmission again, so as to cause the utilization of lower delivering power.Based on the inherent liner in the helmet Type can use different isolators on rugby/ice hockey/lacrosse sportsman helmet.It does not wear wherein Helmeting or wear the other embodiments utilized in the sports of the helmet once in a while can also be using (example on ball cap or cap As baseball player cap on) at least one capturing movement sensor, together at least one being placed on batting helmet Sensor.It can also be using headband placing device come same in the sports (such as Association football) for not utilizing ball cap wherein Determine cerebral concussion.In one or more embodiments, head can be remained attached in a package using the isolator on the helmet Helmet, and sensor can be removed and be placed on another equipment of the isolator for the damping for not utilizing matching user's brain liquid On.Some embodiments can be transported based on characteristic associated with certain types of equipment (namely surfboard is compared to baseball bat) Dynamic model formula detects type of sports automatically, and determines the type of the current accompanying equipment arrived of capturing movement sensor.At one Or more in embodiment, can be utilized to calculate a kind of algorithm of the physical characteristic of isolator to may include catching a movement It obtains sensor to be placed on the helmet, and a capturing movement sensor is placed in the head dummy in crash tests manikin head In, the capturing movement sensor in mesocrania is encapsulated in isolator.By applying linear and rotary acceleration to the helmet, And it such as is obtained by helmet sensor and to observe by head dummy about the sensor in the corpse head being placed in the helmet In the numerical value that observes of sensor in difference, can obtain the damping for being most closely matched mankind's brain has most The separator materials of good matching damping values.
Fig. 3 shows the feature of the placing device of Fig. 2A-B, and the outside of capturing movement sensor and the helmet is shown Isolator between part.The embodiment of the present invention may be configured to acquisition/calculating linear acceleration numerical value or spin up Degree value or all the two.This allows for monitoring rotational event for cerebral concussion and linear acceleration.As shown, outer Portion acceleration G1 can apply with the more associated lower acceleration of the acceleration that mankind's brain is observed, that is, pass through Utilize the G2 on the sensor 111 of the isolator 111c in sensor placing device 111b.This allow for for cerebral concussion and Linear acceleration monitors rotational event.Other events can use linear and/or rotary acceleration and/or speed, such as with Mode or template are compared, thus switch sensor individual character during event not only dynamically to change capture characteristic, and And also characterize the type of the equipment utilized together with current capturing movement sensor.This allows for the single by user Capturing movement element is bought and makes more than one piece equipment or clothing tool, this is by allowing sensor to be based on being caught by the sensor The movement obtained automatically determines the type of the equipment that the sensor is coupled to or clothing compared with characterizable motion mode or template.
Fig. 4 A shows the top-sectional view for the capturing movement element 111 being placed on helmet 110a, the helmet 110a Liner 110a1 with skull 401 and brain 402 around user.Fig. 4 B is shown corresponding to each element shown in Fig. 4 Rotation cerebral concussion event.As shown, different acceleration values may be applied in center of gravity 403 and by the helmet On the mankind's brain 402 and skull 401 that liner 110a1 in 110a is surrounded.As shown, in order to be moved in unit interval It is dynamic, the front portion of brain must be higher than with rate G2a acceleration, the rate G2a rate G2c at the rear section of brain or The rate G2b of person center of gravity.Therefore, for given rotary acceleration numerical value, the different zones of brain may be by different It influences.Therefore, one or more embodiments of the invention, which can transmit, not only adds with linear acceleration in relation to but also with rotate The related information of speed.
Fig. 5 shows the input power G1 (as shown being 500g) for the helmet relative to the power observed in brain G2 is observed by the sensor being placed in isolator and is confirmed using known head dummy acceleration measurement system. The curve in upper right side show two kinds known to head dummy system confirm that the movement as shown in Fig. 4 A based on isolator is caught Obtain the acceleration value that the accelerometer that element 111 is placed about head dummy is observed.
Fig. 6 shows the rotary acceleration numerical value of 3 axis together with total rotating vector quantity, together with being obtained from video camera and The video for the cerebral concussion event being display together with motion event data.It, can be for rotation (such as in one or more embodiments Shown in figure) or linear numerical show the acceleration value from given sensor, this is, for example, to pass through and taps mobile device twice Screen either passes through any other mode.The embodiment of the present invention can use connectionless broadcast message to transmit and event phase Associated event data.In one or more embodiments, used wireless communication is depended on, broadcast message may include tool Have the payload of the data of limited quantity, can be utilized to avoid the agreement based on connection shake hands and expense.At it In his embodiment, agreement connectionless or based on connection can be utilized according to any combination.In this way, referee can With obtain on the mobile apparatus potential cerebral concussion dependent event close to instant reading, so that referee be allowed to be quickly obtained Medical assist.
In one or more embodiments, the accessible previously stored event associated with user or equipment of computer Data or motion analysis data, for example to determine cerebral concussion or to fall down or other are hit or the number of any other motion event Mesh.Some embodiments can also event data associated with an at least user present over the display, this be based on The user or the associated event data of equipment or motion analysis data and with the user or equipment or at least one Position other users or other associated previously stored event datas of equipment or motion analysis data.This allow in number or Motion event is compared in terms of quantitative value, such as by the user or other users in particular game or in history On the maximum rotary acceleration that observes.In addition, definition correspond to typical event project equipment characterizable motion mode or Template can be dynamically updated, such as on a central server or in local update, and in one or more embodiments In dynamically updated in capturing movement sensor by wireless interface.This allows for sensor to improve with the time.Therefore, scheme Display shown in 6 could also indicate that the number of the cerebral concussion stored previously for given boxer/sportsman, and permit Perhaps referee/doctor makes decision about whether the sportsman can keep the field.
The embodiment of the present invention can for example by radio and television or internet transmit information so as to computer or remote It is shown on the visual displays of journey computer coupling.Therefore, the display in Fig. 6 can also be for example to the spectators watched It shows, to show to be applied to the quantity of the power with boxer/sportsman/jockey etc..
The timeline that Fig. 7 shows user show 2601 together be shown as along timeline event along timeline Peak value and minimum angular speed.In addition, curve shown in showing in bottom shows the advanced of golf club 2602 It together with the sagging of golf club and drifts about (droop and drift) with lag (lead and lag), wherein these numerical value Determine bending degree of the shaft of golf club in two axis marked and drawed relative to the time.One is shown in FIG. 8 to show Show embodiment, wherein being labelled with simplified timeline and motion-related event (maximum speed hit) in the display.
Fig. 8 shows subevent fast forwarding and fast rewinding (scrub) timeline, allow with will be rolled to, be played to or from Subevent associated start stop time point 802a-d (meta position when subevent shown in namely Fig. 7 played at this Set) neighbouring input, to easily allow to watch subevent.For example, it may include for example taking aim at that golf, which is hit, Quasi- (address), the subevent brandishing, brandish forward backward, striking, keeping posture (follow through) etc.It is described System can show the time location corresponding to subevent 802a-d and receive the input of the user near the position, so as to sound Photopic vision frequency should start or stop at place at the time point, such as be rolled to or return to the time point to be easy to watch sub- thing Part.User input unit 801 can be utilized to be drawn to neighbouring subevent the time, so as to for example video location in institute Desired time point.It is alternatively or in combination, another subevent time of such as statement when video is playing User's input of finger pressing near point may indicate that video should stop at next subevent time point.User interface Can also be utilized to control-towing point, so as to video is synchronized to more accurately wherein occur specific subevent or The frame of event.For example, user can pin control key and point 802b is pulled to the left or to the right, so as to video frame The real time point that the speed for being fitted on club head is zero, for example video to be closely synchronized to shown reality Motion analysis data, here hit speed in terms of miles per hour.In the case where meeting spirit of the invention, Ke Yili With any other user gesture user's frame synchronization to motion analysis data, such as voice control, arrow key etc..
Fig. 9 show the relative position that subevent 802a and 802b start and stop along timeline and with originate and stop The only gravitation of time correlation connection allows user's input near these points to be attracted to starting and dwell time.For example, When pulling user interface elements 801 along timeline or so, the user interface elements can be shown as towards potential trap 802a and 802b is mobile, so that user interface elements are easier to be moved to the start stop point of subevent.
In one or more embodiments, the computer is further configured to ask from an at least video camera for proximal event Ask at least piece image or video comprising event.This may include from specific neighbouring video camera or being directed toward event direction The broadcast message of video camera request video.In one or more embodiments, the computer is further configured to broadcast for neighbour The request of nearly event or the camera position for being directed to viewing event, and optionally for holding around events of interest The continuous available video camera of time showing or the video at this.In one or more embodiments, the computer also by It is configured to the list of one or more times of display event generation, so that user be allowed to pass through desired by computer acquisition Event video, and/or independently request video from the third party with desired event time.The computer is also Video can be obtained from server 172, and video is trimmed to desired event in local.This can be utilized to obtain Third party's video and from not with the computer direct interface but the video of system that can be communicated with server 172.
Figure 10 is shown using a mobile device 102b as capturing movement element 111a and another mobile device The one embodiment of 102a as the computer for the motion event data and video for receiving the first customer incident.From mobile device The view of 102a is shown in the upper left of the figure.In one or more embodiments, at least one capturing movement sensing Device is coupled with mobile device, and is for example used in the internal motion sensor coupled in mobile device or with mobile device 111a.This allows for carrying out capturing movement and event recognition using generally existing minimum level hardware, such as using having The mobile device of built-in accelerometer.In one or more embodiments, the first mobile device 102b can move number with record According to user couple (it is shown here as carrying out Halfpipe), the second mobile device 102a is then utilized to record The video of movement.In one or more embodiments, the user for being undergoing movement can provide gesture, such as in mobile device Upper percussion n times, to show that the mobile device of second user start recording video or should stop recording video.It can use and appoint What his gesture transmits event correlation or the relevant instruction of movement between mobile device.
Therefore, the embodiment of the present invention can recognize any kind of motion event, including with show stand, row Walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or breathe no more or its The related event of the movement of any combination, or the event of any other type of duration moved with period. Event can also have any granularity, for example including matching any kind of mould with known signature or by other means The subevent of plate or mode, including the amplitude and/or time threshold in linear or rotary shaft specific collection.Citing comes It says, shows that slide plate releases the event of (push-off) or promotions a series of and can be grouped into the son for for example " preparing manipulation " etc In event, and the rotary shaft in X then for example may indicate that " slide plate is turned over/rolled ".In one or more embodiments, event can be by Grouping and storage/transmission.
Figure 11 shows the one embodiment for being utilized to the memory of storing data.Memory 4601 can for example be collected At to the microcontroller in capturing movement element 111, or can be for example as individual memory chip and microcontroller coupling It closes.Memory 4601 as shown in the figure may be configured to respectively include one or more storage buffers 4610,4611 and 4620,4621.The one embodiment for the storage buffer that can be utilized is circular buffer.Circular buffer can be by reality It applies into and is repeatedly override, until event occurs.The length of circular buffer can be from 0 to N number of memory cell.Such as There can be M circular buffer, such as corresponding to M impact event.Digital M may be greater than zero any number.At one Or more in embodiment, digital M can be equal to or more than the number of expected event, such as number of hits, or to correspond to a wheel high The batting number of golf ball match, or allow all motion capture datas to be stored on capturing movement element until at one or Any other number of mobile computer or internet is downloaded to after more events.In one embodiment, such as claimed Make the head of the pointers track buffer of head pointer (HEAD).As data are recorded in a buffer, head pointer is by Forward Quantity appropriate is moved, to be directed toward next free storage unit.When the buffers get full, pointer unrolls opening to buffer Head, and override when encountering previous numerical value.Although data are written, the size and record of buffer are depended on Rate, at any time (t) have from the time (t) to return record sensing data.As sensor is remembered in a buffer Data are recorded, " event " in one or more embodiments stops overriding buffer with new data.When detecting event, sensing Device can continue to record data in the second buffer 4611, for example to record special time amount under specifically capture rate Event after data, to complete the record of expected film.Storage buffer 4610 now comprising from event to return institute's phase The data record of the time quantum (this depends on the size of buffer and capture rate) of prestige, together in event posterior bumper 4611 Data after event.For example, see Figure 19, video can also be stored in a comparable manner and is trimmed to about later.
Such as in golf is hit, event can be club head and ball impact.Alternatively, event can be club head Portion makes impact with the ground, so as to lead to error event.In other embodiments, event, which can be, can be shown that cerebral concussion event User's head acceleration, perhaps from weapon-shooting perhaps ball impact baseball bat or when weight is moved to highest by user When putting and put down carrying out another repetition.Event anterior bumper stores sensing data until impact event, thing Part posterior bumper stores the sensing data after impact event.One or more embodiments of microcontroller are configured to analyze Event, and determine that event is the event of repetition, shooting or such as impact or mistake impact etc.If event is according to mode Or signature or template are considered as validity event (referring to Figure 13 and 15) rather than error event, then by another storage buffer 4620 are used for motion capture data, until second event occurs.After event generation, captured data are utilized Filling event posterior bumper 4621.
Specifically, capturing movement element 111 may be implemented such that one or more MEMs sensors.The sensor can Data are collected with specified time interval to be command by.In each interval, data are read from various MEMs equipment and are stored In circular buffer.The several value sets read from MEMs sensor are considered as a frame (FRAME) data.Depending on just quilt It is collected and stored in the type of the data in buffer, a frame data can be 0,1 or multiple memory cells.One Frame data are also associated with a time interval.Therefore, based on the capture rate from sensor, each frame also with time quantum phase Association.For example, if filling each frame with the interval 2ms, 1000 frames are by the data (2 seconds) comprising 2000ms.It is general next It says, frame need not join with time correlation.
Data can be constantly stored in circular buffer, and for example in specified event, time or when logical Cross radio device/antenna go to mobile device or any other computer or memory communication it is available when or work as example Such as by when mobile device order (namely " poll ") or in any other desired event, data are written out to non- Volatile memory, either by wirelessly or non-wirelessly linking or being sent to remote memory by radio device/antenna Or equipment.
Figure 12, which is shown, to be especially programmed into microcontroller to determine whether to have occurred and specific application will to be transmitted Event function one embodiment flow chart, the event is, for example, expected event such as is the thing having occurred and that Part.Movement, acceleration or the shock wave occurred from the shock for physical education facilities is sent to the sensing in capturing movement element Device, the sensor record motion capture data as described in Figure 11 in front.The microcontroller is configured At with event described in post analysis, and determine the event whether expected event.
The a type of event occurred is acceleration, or super based on the head/helmet/ball cap/toilet article sensor The shock of specified linear or rotation numerical or face when hitting golf out.Utilizing ball and impact tool Identical analysis is applied in other sports, but the analysis is adjusted to specific sports and physical education facilities.? In tennis, it is contemplated that impact for example can be racket and hit a ball, rather than rotate racket before receiving.In such as running shoes etc Other application in, shoes can be detected when someone is running and hit ground by hitting detection algorithm.In practice, it can be The special exercise reached, this is with regard to for example allowing to count number of repetition in weight lifting or ride stationary bicycle while Number.
In one or more embodiments of the invention, processing starts from 4701.At 4702, microcontroller is specific The motion capture data in memory 4610 is compared with the linear speed beyond specific threshold in collision time frame, and And at 4703 wherein there is the discontinuity threshold value of the sudden change in the speed for being higher than specific threshold or acceleration in search.Such as Fruit in defined time window there is no the discontinuity in speed such as acceleration, then processing at 4702 after It is continuous.If discontinuity occurs really, expected hit is saved in memory at 4704, and data after hitting are protected Deposit given time P.For example, if hitting threshold value is set to 12G, discontinuity threshold value is set to 6G, and hits Hitting time frame is 10 frames, then is detecting 12G acceleration at least one axis or all axis in 10 frames and subsequent After the discontinuity of 6G, microcontroller 3802 shows to hit with signal.In typical event, acceleration establishes characteristic acceleration It writes music line.Hit the quick change being expressed as in acceleration/speed.These changes are typically different than passing by specific non-event The smoothed curve that increasing or decline curve are created.Linear or rotation for the event based on cerebral concussion, in one or more axis Acceleration exceeds certain threshold value.Event relevant for golf, if accelerating curve is hit about golf, Specific axis has the specific acceleration for meeting signature, template or other modes, and hit ball cause to show to hit it is larger Acceleration spike.If the given template of Data Matching, is saved, continue if it does not match, processing returns at 4702. If determining that data will be saved in outside at 4705, that is to say, that there is the communication linkage for going to mobile device, and for example Mobile device just in poll or has requested that shock data when that occurs, then event transmission is deposited to outside at 4706 Reservoir or mobile device will be stored at any other position outside it, and are handled and continued at 4702 again, wherein Microcontroller analyzes collected motion capture data for successor.If data will not be saved in outside, processing exists Continue at 4702, and be held locally within data are hit in memory 4601.If being sent to outside, other movements are caught Its exercise data can also be saved for the event detected by another sensor by obtaining equipment.This for example allows for having more smart The sensor alert other sensors associated with user or equipment of thin resolution ratio or more movement save event, even if fortune Dynamic capture data do not reach specific threshold or mode (for example, see Figure 15).Such processing provides more robust Event detection, this is because can use multiple sensors to detect certain types of event, and notify for various originals Because the other sensors of event schema may be mismatched.In addition, video camera can be informed that and trim or pass through its other party Formula abandons unwanted video and saves the relevant video of event, so as to reduce the event of being not only and there are also videos Memory utilizes.In one or more embodiments of the invention, noise can be filtered out from motion capture data before transmitting, And sample rate can be changed based on value data obtained, to maximize accuracy.For example, some sensors exist The data of inaccuracy are exported under high sampling rate and high gravity.Therefore, by declining low sampling rate in high gravity, accuracy is protected It holds.In one or more embodiments of the invention, microcontroller associated with capturing movement element 111 can sense Gao Chong Power and automatically switch sample rate.In one or more embodiments, replace using with 6G/12G/24 range or 2G/4G/ The accelerometer of 8G/16G range can use the accelerometer with 2 ranges (such as 2G and 24G) to simplify each The logic switched between range.
One or more embodiments of the invention can be event transmission to mobile device, and/or for example for one It takes turns golf range game or continues event storage in memory until realizing mobile device communication link.
Such as the sensor for being placed in specific placing device, typical Event Signing is shown in FIG. 13, Additionally referring in Figure 15 for example, by from two kinds of characteristics shown by different equipments or the associated mode of clothing or template The comparison of type of sports.In one or more embodiments, microcontroller is configured to execution pattern matching algorithm to follow Corresponding to the curve of each axis, and determined using 1 or more segment linear or rotary acceleration or its Characteristic whether has occurred in any combination to hit.If motion capture data in memory 4601 be in shown in Figure 13 In the close enough range of the numerical value that typical case hits, then move consistent with event.Therefore, characterize first mobile angle and/ Or after linear speed signature, and usually determine whether that the class corresponding to future event has occurred followed by the member of the signature Like signature, the embodiment of the present invention reduces the number of the false positive in event detection.
Capturing movement element is from each sensor collection data.Data capture rate can be higher, and if it is in this way If, then to capture mass data.Depending on concrete application, lossless and Lossy Compression Algorithm is can be used in the embodiment of the present invention Carry out the data on storage sensor.Compression algorithm allows capturing movement element to capture more data in given resource.Transmission What it is to (more) remote computer is also compressed data.The transmission of compressed data is faster.Compressed data is also stored on It in " cloud " in internet, or is stored on database, thus locally occupying less space.
Figure 14 shows one embodiment of capturing movement element 111, configured with for being locally displayed and watching thing The optional LED visual detector 1401 of part relevant information, and it is display configured to text or encoded associated with event The optional LCD 1402 of message.In one or more embodiments, the LED visual detector can be for the brain of moderate type Slow flash yellow is shaken, and red for the cerebral concussion quick flashing of severe form, so as in the case where being not necessarily to any wireless communication Provide the quick overview about event.In addition, LED can show several flashes of light or other colors, to show any temperature phase Pass event or other events.One or more embodiments can also use LCD 1402, such as can show text or replace It can show the encoded messages corresponding to sensitive health related information with changing, referee or medical professional for example can be with It is read out and is decoded using the reader application appropriate in mobile device.In the lower right-most portion of the figure, LCD is shown Device can produce the encoded of statement " 1500 degree of potential cerebral concussion/detection of s/s rotational event-alerts medical professional immediately " Message.Other paralysis diagnostic messages may be that the message of any other sensitive type can be encoded and locally be shown Show, so that medical professional for example be allowed to immediately begin to relief user/sportsman/boxer without since diagnosis disappears Breath startles other sportsmen, or without transmitting the message in the sky wirelessly to avoid interception.
Figure 15 shows the template properties of motion event associated with different types of equipment and/or tool clothing One embodiment is can change together with wherein capturing movement sensor individual character more accurately or more efficiently to capture The region of data associated with special time period and/or subevent.As shown, being shown in acceleration plots 1501 Characteristic corresponding to slide plate releases (push off), shows X, Y and z axis in 6 timelines of the curve graph above Property acceleration and rotary acceleration numerical value, wherein the time is progressive to the right.As shown, when user pushes slide plate by each step When, the discrete positive x-axis acceleration captured is shown at 1502 and 1503, is followed by and is being pushed it each time with tail skid Between slack-off negative acceleration.In addition, the y-axis swing during pushing each time is also captured to, and release or drive in slide plate There is no the change of z-axis linear acceleration in the specific template or mode and there is no rotary acceleration.Alternatively, the mode can be with Including one group of threshold acceleration in the x at predefined time window and corresponding to other threshold values of swing or no pair It should be in the threshold value of swing, wherein being for example compared the data captured therewith, to automatically determine capturing movement element quilt The type for equipping the equipment being currently undergoing be placed to or known.This for example allow the data based on event save and Transmission.
But the mode or template in curve graph 1511 show running event, wherein user during running event slightly Accelerate up and down.Since the speed of user is relative constant, acceleration is relatively free of in x, and since user does not turn, Therefore (left/right) is relatively free of acceleration in y.The mode can for example be utilized to carry out in the range of corresponding to running Compare, wherein the mode includes the z-axis acceleration in time predefined window.Therefore, top in curve graph 1511 Three curve graphs can be utilized as the mode to mark running event.Three curve graphs of lower section can be in 1514 Hes Being captured of showing that user watches to two sides when capturing movement element is placed in the helmet and/or facing is shown at 1515 Data, and the data 1516 captured then may indicate that and be observed by the rotary motion of every square of second sufficiently high angle number Moderate or severe cerebral concussion.Furthermore, it is possible to sensor individual character is dynamically changed at 1516 or at any other threshold value, So as to for example change capturing movement sensor capture rate or capture bit size, thus amplitude or in terms of the time it is more quasi- True ground capturing events.This allows for dynamically changing the interested period capture quality and/or dynamically changes function Rate utilizes, this is unknown in the art.The helmet, facing are placed in one or more embodiments, such as utilizing The embodiment of the present invention of temperature sensor in interior or any other equipment or in user's body, can also record temperature Timeline.
Figure 16 shows the front view of one embodiment of protectiveness facing 1601 and the bottom in figure shows top View, such as worn in any contact sports, for example, (and being not limited to) Association football, boxing, rugby, Wrestling or any other sports.The embodiment of facing can be worn to supplement with or without capturing movement element Any other head wear, to increase motion capture data associated with the user, and being worn from user The exercise data and/or event of any or all capturing movement element are carried out related or are combined by any other mode Or compare.The embodiment of facing and/or the helmet shown in Fig. 2A-B or in any other equipment can also for example wrap Temperature sensor is included, as previously discussed.
Figure 17 shows one embodiment of the algorithm utilized by any computer in Fig. 1, it is configured to combining Moving image and motion capture data are shown in format.In one or more embodiments, motion capture data and anything The part relevant start stop time can be saved on capturing movement element 111.One or more embodiment packets of the invention Include a kind of identification of motion event and video synchronizing system comprising be configured to and user or equipment or the shifting coupled with user At least one capturing movement element that dynamic equipment is coupled.At least one described capturing movement element may include: memory;Quilt It is configured to appointing for capture numerical value associated with direction, position, the velocity and acceleration of at least one capturing movement element The combined sensor of meaning;Radio device;The microcontroller coupled with memory, sensor and radio device.The micro-control Device processed may be configured to the data that collection includes the sensor values from sensor, store data in memory, right Data are analyzed and pick out the event in data to determine event data, and radio device transmission and event phase are passed through Associated event data.The system can also include mobile device, and the mobile device include computer, be configured to and nothing Line electric installation communicates to obtain the wireless communication interface of event data associated with event, wherein the computer with Wireless communication interface coupling, wherein the computer is configured to from wireless communication interface receiving event data.The computer Event data can also be analyzed to form motion analysis data, store event data or motion analysis data or event data and Motion analysis data both all, obtain event initial time and event dwell time from event, from video camera request include to The image data of few video captured during from event initial time to the time span of event dwell time, and aobvious Show and show event video on device, including all two following: from event initial time to the time of event dwell time Event data, motion analysis data or any combination thereof occurred during span;And from event initial time to thing The video captured during the time span of part dwell time.
When communication channel can be used, motion capture data and any event relevant start stop time are at 1701 Any computer (such as 101,102,102a, 102b, 105) are pushed to, is either obtained by any computer or is passed through it He receives mode.The timing differential between the clock on sensor and/or in the motion capture data time can also be obtained.This can By reading the current time stamp in incoming message and the current of the clock of incoming message time and local computer Time is compared to implement, and for example sees also Figure 18 for synchronous more details.Clock from sensor and computer In difference can be utilized at 1702 from any local or overregulated for considering any timing differential The video camera that time is directed toward event location requests image data.For example, computer can be by inquiring all video cameras 103, the video camera on 104 or 101,102 and/or 102a of equipment come request at the time/position shoot image, In any or all described equipment have the image (such as based on GPS location or wireless range) that nearby shoots and/or It is directed toward the event obtained from capturing movement element 111.If equipment is not located at nearby but is directed to the position of event, match as working as Pass through determined by its position and direction when having magnetometer like that, then it can also pass through the figure corresponding to the time range As making a response.It can be queried by any kind of video camera electronically communicated, including Nurse's camera etc..For example, the thing from capturing movement sensor 111 can received by mobile computer 101 Message is sent after part, wherein the message can be sent to appointing in the wireless range for instance in mobile computer 101 What video camera.It is alternatively or in combination, mobile computer 101 can send solicit in event location it is predefined away from From interior any photography identity, even if inquiry direction event direction not any video camera for being relatively close to.? When receiving the list of potential video camera, mobile device 101 can be for example to its inquiry in the predefined window around event Any image obtained.At 1703, computer can receive image data, or if computer is coupled with video camera Then it can locally search image.In one or more embodiments, server 172 can with iteration by video and event so as to Determine any relevant video and event, and automatically trimming video so as to correspond to event starting and dwell time it is lasting when Between.Although can use wireless communication, the image data transmission of any other form also complies with spirit of the invention.Regardless of It is that data from event in number or figure coating format or any other format including text are ok It is shown together with the respective image for corresponding to the time, or is added to the respective image corresponding to the time at 1704 On.This is shown at time 1710 (i.e. current time) by graphics mode, has the capturing movement of superposition for showing The image 1711 of one frame of the motion event of data 1712 is e.g. rotatable.For combination or simultaneously without the data of superposition For example, see Fig. 6.
Figure 18 shows the one embodiment for the synchronous architecture that can be utilized by one or more embodiments of the invention.One The clock that any kind of synchronous method comes in synchronization system can be used in a little embodiments, and in one or more embodiments In, the computer 160 in mobile device 101 is further configured to determine the clock between capturing movement element 111 and mobile device Difference, and motion analysis data and audio video synchronization.For example, one or more embodiments of the invention are provided for making Much regulations of the synchronous information about the time of each equipment, position or direction of platform recording equipment, come so as to combine From distinct device about event recorded data.Such recording equipment can be embedded type sensor, have video camera Or the mobile phone of microphone, or be more generally that can recorde any of data relevant to interested activity to set It is standby.In one or more embodiments, this, which is synchronized, is realized by exchanging information between devices, so that each Equipment can reach an agreement in terms of the common measurement for the time, position or direction.For example, mobile phone and embedded Sensor for example can wirelessly exchange the message of the current time stamp with its internal clocking across link 1802; These message allow to negotiate, wherein two equipment are reached an agreement in terms of common time.Such message can be according to need Periodically to exchange, so as to solve it is previous it is subsynchronous after equipment clock drift or movement.In other embodiments, more Common server or server set 1801 can be used to obtain the standardization degree of time, position or direction in platform recording equipment Amount.For example, GPS system can be used to obtain the absolute location information corresponding to each equipment in equipment.GPS system is also It can be used to obtain normalized temporal.NTP (Network Time Protocol) server is also used as normalized temporal server. Allow individual device to reach an agreement in terms of common measurement by using server, communicates with one another without being always configured to.
Figure 19, which is shown, detects event by one of capturing movement sensor 111, transmission event detection (herein by It is shown as and the sensing of other capturing movements in such as mobile device 101 is issued and gone to from centrally located sensor 111 The arrow of device 111 and/or video camera), event motion data, and trimming video are saved to correspond to event.Of the invention In one or more embodiments, some of recording equipments are configured to detect the generation of various events of interest.It is some such Event may occur in particular moment;Other such events may occur in interval of time, wherein the detection includes The starting of detecting event and the end of event.These equipment be configured to using it is described above correspond to the time, position and The synchro measure basis of direction records any combination of the time of recording equipment, position or direction, such as together with thing Number of packages evidence is included together in storage buffer 4610, or in any other data structure.
The embodiment of computer in mobile device can be configured to abandon and fall in event initial time and stop to event At least part video except only, for example, event or with it is predefined it is preceding and it is rear interval 1902 and 1903 event Before and after part 1910 and 1911.For example, in one or more embodiments of the invention, some of them record Equipment is while waiting detecting event constantly data capture to memory.In order to save memory, some equipment can be with Be configured to only when data in time adjacent to detected event when just data storage to more permanent Server 172 is arrived in ground storage medium or storage.Such as in the case where not detecting event, the data of new record can be most Override the data of precedence record in memory eventually, this depends on each equipment for recording exercise data or video data In memory quantity.Cyclic buffer can be used as a kind of typical realization of such overriding scheme in some embodiments Mode.When event detection occurs, other than the data captured during being stored in event itself (i.e. 1901), recording equipment can Terminate it with a certain the configured data volume (close to the starting in space before 1902) and event before storing event starting A certain configured data volume afterwards (close to 1903).It is any to be considered as event initial time in preceding or posterior time interval With a part of event dwell time so that for example showing the situation of event in video.This is just that event gives feelings Border, such as the quantity of preceding time interval can be set according to sports, so as to the preparation for allowing golf to hit (setup) become a part of event video, although it occurs before the actual event of impact golf.It can also basis To keep posture in the interval quantity record of rear interval distribution.
The embodiment of the system can also include the server computer far from mobile device, wherein server computer It is configured to abandon at least part video fallen in except event initial time stops to event, and handle is originated from event Time to event dwell time time span during the video that is captured back to the computer in mobile device.Server or Mobile device can be motion analysis data or event data (such as speed or untreated acceleration information) and video phase It combines or is added to form event video 1900 on video, so as to greatly reduce the quantity of required video storage, This is because the time span of part 1910 and 1911 usually may be more much bigger than event.
The embodiment of at least one capturing movement element may be configured to event transmission at least another fortune Dynamic capture sensor or at least another mobile device or any combination thereof, and wherein at least another described movement is caught It obtains sensor or at least another mobile device or any combination thereof is configured to save data associated with the event. Such as in having the embodiment of more recording equipments of operation simultaneously, such equipment can detecte event, and to Other recording equipments send the message for showing that such event detection has occurred and that.The message may include event starting and/ Or the time label stopped, wherein the clock for individual device uses basis synchronization time.Receiving device (such as other movements Capture sensor and/or video camera) can be used the storage of event detection message handle associated with event data to for instance in Non-volatile memory device in capturing movement element 111 or mobile device 101 or server 172.In addition to straight with event 1901 It connects except associated data, the equipment may be configured to certain data volume and event knot before the starting of storage event Certain data volume (being 1902 and 1903 respectively) after beam.In this way, all devices can record data simultaneously, but It is using from only wherein the event of an equipment is triggered to initiate for the distributed event data from multiple sources It saves.
The embodiment of the computer can be configured to save the view from event initial time to event dwell time Frequency and the motion analysis data occurred from event initial time to event dwell time, or can use remote server Save video.In one or more embodiments of the invention, some of recording equipments may wherein occur event when Between possibly can not all directly communicate with each other always in section.In these cases, equipment may be configured to the institute for having recorded it There is the complete documentation of data to be saved in permanent storage device or is saved in server.Only save number associated with event It can not accomplish according to possibly in these cases, this is because some equipment possibly can not receive event-triggered message.At these In the case of, the data saved can handled afterwards, to extract and one or more detected events Associated is only relevant part.For example, more mobile devices may record the video of sportsman or performing artist, and And the video is constantly uploaded onto the server 172 to store.The sportsman or performing artist may be individually equipped with energy The embedded type sensor of the event of enough detection such as special exercise or movement etc.Embedded type sensor data can be by constantly Or identical server is sometime uploaded in later.Due to including video flowing and embedded type sensor data All data usually all marked added with the time, therefore video associated with the event detected by embedded type sensor can To be extracted and combine on the server.The embodiment of server or computer can be configured to when at least one described fortune When communication linkage between dynamic capture sensor and mobile device is open, discarding is fallen in except event initial time to event stopping At least part video, and save from event initial time to the video of event dwell time and from event initial time The motion analysis data occurred to event dwell time.Alternatively, the embodiment of the computer is also if communication linkage does not open It may be configured to save video, and after receiving event after communication linkage is open, then abandon the event that falls in and rise At least part video except time beginning to event stopping, and save from event initial time to the view of event dwell time Frequency and the motion analysis data occurred from event initial time to event dwell time.Such as in some embodiments of the present invention In, data can be uploaded as previously described server, and position associated with the data flow of each equipment and refer to It can be used to extract for the detected relevant data of event to data.For example, a biggish mobile device Set can be used to locate record video at various locations during entire golf tournaments.The video data can be held Continuous ground is uploaded onto the server after tour.After tour, the sensing data with event detection can also be with It is uploaded to identical server.Physics in the event occurred can be identified for the post-processing of these various data flows The particular video stream that adjacent place records simultaneously.Additional filter can choose wherein video camera positive sense and be correctly oriented to see Examine the video flowing of event.These selected streams can be combined with sensing data, show the more of event to be formed and be had The aggregate data flow of a video angle.
The system can separate from the video camera coupled with mobile device or with mobile device or by its other party Formula obtains video far from any video camera of mobile device.In one or more embodiments, from the service far from mobile device Device obtains video, such as obtains after the inquiry for the video at a certain position and time interval.
The embodiment of server or computer may be configured to synchronize the video and the event by image analysis Data or the motion analysis data, so as to more accurately determine in the video with the event initial time or institute State event dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.At this In one or more embodiments of invention, the clock between recording equipment, which synchronizes, be can be approximately.It may want to based on viewing Event from each equipment improves the accuracy of the synchronous data feeding from more recording equipments.In one or more realities It applies in example, the processing of multiple data flows is used to observe the signature of the event in different stream, to help fine granularity same Step.For example, can embedded type sensor is synchronous with including the mobile device of video cameras, but time synchronization may It is only accurate within 100 milliseconds.If video cameras is corresponded on embedded type sensor with 30 frame recording video per second Event detection video frame be based solely on synchronization time label can only be defined within 3 frames.In a reality of the equipment It applies in example, video frame images processing can be used to determine the accurate frame for being most closely correspond to detected event.For More details are referring to Fig. 8 and its description.It for example, can be the cunning as shown in Figure 17 detected by inertial sensor The vibration that snow slab hits ground is related to the frame that the geometrical boundary of wherein skis and ground are in contact.Other embodiments can be with The synchronization of multiple data feedings is improved using other image processing techniques of detecting event signature or other methods.
The embodiment of at least one capturing movement element may include being configured to determine of coupling with microcontroller The position of position determines element, and wherein microcontroller is configured to the transmission of the computer in mobile device position.At one or In more embodiments, the system also includes server, wherein microcontroller is configured to directly or by mobile device to clothes Business device transmits position, and wherein computer or server are configured to stop based on position and event initial time and event Time forms event video from the various pieces of video.It for example, can be for example in movement in one or more embodiments It is regarded in equipment 101 or on server 172 or on computer 105 or any other computer coupled with system event Frequency is trimmed to the event of specific length, and is transcoded onto any video quality, and in any manner with motion analysis Data or event data (such as speed or acceleration information) superposition are integrated therewith by other means.Video can be according to Any resolution ratio, depth or picture quality or the compression type to store video or any other technology are locally deposited Storage sets to maximize memory capacity or frame per second, or using any compression type to minimize storage but regardless of movement Whether the communication linkage between standby, at least one capturing movement sensor and/or server opens.In one or more embodiments In, speed or other motion analysis data can for example be applied or combine by other means a certain portion below video On point, including event starting and dwell time, before event starting and dwell time may include actual event and/ Or any number of seconds later, so as to the video hit before for example providing batting event.In one or more embodiments, institute Server can be transmitted to event and video by stating at least one capturing movement sensor and/or (more) mobile device, wherein Server can determine that particular video frequency and sensing data occur in specific position and specific time, and from several videos and several A Sensor Events tectonic event video.Sensor Events for example can be from the biography coupled with user and/or equipment Sensor or multiple sensors.Therefore, the system can construct the short-sighted frequency corresponding to event, to for example greatly reduce view Frequency storage demand.
In one or more embodiments, the microcontroller or computer are configured to determine the position of event, or The microcontroller and computer are configured to determine the position of event and related to position progress, this is, for example, to pass through contraposition It sets and carries out the related or average central point in order to provide event, and/or can be minimized from initialization GPS sensor Erroneous position data.In this way, the video that golfer kicks off can be generated in one group of user with mobile device, It wherein can use the event location of at least one capturing movement equipment, and wherein server can obtain video from spectators And the event video of professional golfers hit and batted is generated, wherein event video can use from different photographies Each frame of machine generates the BULLET around golfer when golfer hitsVideo.Obtained one A or multiple videos can be trimmed to the duration of event, such as from event initial time to event dwell time, and/ Or with any in preceding or posterior predetermined time numerical value around event, so that it is guaranteed that capture hit including corresponding to or Any time of other events and any whole event kept including the posture time.
In one or more embodiments, the computer in mobile device can be from an at least video camera for proximal event Request includes at least piece image or video of event, this is directed to by any video camera in the region by directly broadcasting Shooting any video request, optionally may include whether be not only located at about the video camera near event but also It is directed toward or by other means towards the directional information of event.It in other embodiments, can be by the calculating in mobile device Machine requests video from remote server.In this case, any position associated with event and/or time can be utilized To return to image and/or both video or whole near event or in the time shooting close to event.At one or In more embodiments, computer or server can trim video to correspond to incident duration, and similarly can benefit With the various pieces of the further synchronous event of image processing techniques, such as the batting with the respective frame in video, such as with Acceleration information corresponding to the batting on equipment matches.
The embodiment of computer in mobile device or server may be configured to display occurred a certain event or The list of one or more times of one or more events has wherein occurred.In this way, user can be from list Event is found so as to rapidly Access Events video.
The embodiment of the present invention may include to be sensed at least one capturing movement that the mobile device physically couples Device.Any kind of mobile phone or camera chain that these embodiments allow to have integrated sensor (such as any type The video camera placed of the helmet or any placing device including video camera and capturing movement sensor both all) generate thing Number of packages evidence and video data.
Although idea disclosed herein is described by specific embodiment and its application, without departing substantially from claim In the case where the scope of the present invention illustrated in book, those skilled in the art can be with many modifications may be made and variation.

Claims (31)

1. a kind of motion event identification and video synchronizing system comprising:
It is configured at least one the capturing movement element being coupled with user or equipment or the mobile device coupled with user, Wherein at least one described capturing movement element includes:
Memory;
It is configured to capture number associated with direction, position, the velocity and acceleration of at least one capturing movement element The sensor of any combination of value;
Radio device;
The microcontroller coupled with the memory, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collection includes the data of the sensor values from the sensor;
In the memory data storage;
The data are analyzed and pick out the event in the data to determine event data;
The event data associated with the event is transmitted by the radio device;
Mobile device comprising:
Computer;
Wireless communication interface is configured to:
It communicates to obtain the event data associated with the event with the radio device;
Wherein the computer is coupled with wireless communication interface, wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysis data;
It stores the event data or the motion analysis data or the event data and the motion analysis data is whole The two;
Event initial time and event dwell time are obtained from the event data;
Request includes at least being captured during from the event initial time to the time span of the event dwell time Video utilizes video camera institute captured image data;
Event video is shown over the display, including all two following:
The event occurred during from the event initial time to the time span of the event dwell time Data, the motion analysis data or any combination thereof;And
The video captured during from the event initial time to the time span of the event dwell time; And
Wherein the computer is further configured to:
Based on the motion analysis data, at least one fallen in except the event initial time to the event dwell time The part video is abandoned as the relevant video of non-event, and
Storage does not have the part of the video fallen in except the event initial time to the event dwell time The event video and with the movement occurred from the event initial time to the event dwell time point Analyse the event video of data.
2. motion event identification according to claim 1 and video synchronizing system, wherein the computer is further configured to Determine the timing differential between at least one described capturing movement element and the mobile device, and the motion analysis number According to the audio video synchronization.
3. motion event identification according to claim 1 and video synchronizing system, wherein the computer is further configured to Have the motion analysis data occurred from the event initial time to the event dwell time from the thing The video of part initial time to the event dwell time is saved in the server computer outside the computer, and Do not have the part for falling in the video except the event initial time to the event dwell time from institute The video for stating event initial time to the event dwell time is saved in the server computer outside the computer.
4. motion event identification according to claim 1 and video synchronizing system, wherein the system also includes far from institute The server computer of mobile device is stated, and wherein the server computer is configured to handle from the event initial time The institute occurred to the video of the event dwell time and from the event initial time to the event dwell time It states motion analysis data to save together, and from the event initial time to the time of the event dwell time The video captured during span returns to the computer in the mobile device.
5. motion event identification according to claim 1 and video synchronizing system, wherein the computer is further configured to When the communication linkage between at least one described capturing movement element and the mobile device is open, discarding falls in the event At least part video except initial time to the event dwell time, and from the event initial time to The video of the event dwell time and the fortune occurred from the event initial time to the event dwell time Dynamic analysis data save together.
6. motion event identification according to claim 1 and video synchronizing system, wherein the computer is further configured to The video is saved when the communication linkage between at least one described capturing movement element and the mobile device is not open, and And after receiving the event after the communication linkage is open, then abandons and fall in the event initial time described in At least part video except event dwell time, and when stopping from the event initial time to the event Between the video together with the motion analysis data occurred from the event initial time to the event dwell time It saves.
7. motion event according to claim 1 identification and video synchronizing system, wherein the video be from the shifting What the video camera of dynamic equipment coupling obtained.
8. motion event identification according to claim 1 and video synchronizing system, wherein the video is from far from described What the video camera of mobile device obtained.
9. motion event identification according to claim 1 and video synchronizing system, wherein the video is from far from described What the server computer of mobile device obtained.
10. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught It obtains element to be further configured to be worn near user's head, and the event in the identification data includes calculating to use Impingement position in account portion.
11. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught Element is obtained to be further configured to couple with the helmet or cap or facing.
12. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught It obtains element to be further configured to couple with the helmet, and the event in the identification data includes the physics based on the helmet Impingement position in geometry calculation user's head.
13. motion event identification according to claim 1 and video synchronizing system, further include being configured to around described The isolator of at least one capturing movement element, so as to the physics acceleration of the celiolymph of the brain approximately about the user Damping, so that the transformation of the linear acceleration and rotary acceleration of the event data is minimized, to obtain user's brain Observe linear acceleration and observation rotary acceleration.
14. motion event identification according to claim 1 and video synchronizing system, wherein the computer is also configured The video and the event data or the motion analysis data are synchronized at by image analysis, so as to more accurately true It is most closely related with the event initial time or the event dwell time or whole the two in the fixed video Initiation event frame or stopping event frame or all the two.
15. motion event identification according to claim 1 and video synchronizing system, wherein the system also includes services Device computer, wherein the server computer be configured to synchronize by image analysis the video and the event data or Motion analysis data described in person, so as to more accurately determine in the video with the event initial time or the event Dwell time or all the two most closely related initiation event frame or stopping event frame or all the two.
16. motion event identification according to claim 1 and video synchronizing system, wherein the computer is also configured At:
Access previously stored event data associated with the user or equipment or motion analysis data;
Wherein, the display event video further include presented over the display based on the following terms it is associated with the user The event data:
The event data associated with the user or equipment or motion analysis data;And
The previously stored event data associated with the user or equipment or motion analysis data;Or
The previously stored event data associated with an at least other users or other equipments or motion analysis data.
17. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught The microcontroller in element is obtained to be further configured to the event transmission at least another capturing movement element or extremely Few another mobile device or any combination thereof, and wherein at least another described capturing movement element or described at least another One mobile device or any combination thereof are configured to save based on the event initial time and the event dwell time Data associated with the event.
18. motion event identification according to claim 1 and video synchronizing system, further include:
The identifier coupled at least one described capturing movement element or the user or the equipment;
Wherein, the computer is further configured to:
Receive the identifier;And
The identifier is associated with the event data and the motion analysis data.
19. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught Obtaining element further includes the light-emitting component for being configured to the output light in the case where the event occurs.
20. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught Obtaining element further includes audio output element, is configured in the case where the event occurs or at least one described fortune Dynamic capture element exports sound in the case where being in except the range of the computer, or wherein the computer is configured to The display alarm or aforementioned each except the range that at least one described capturing movement element is in the computer Any combination of item.
21. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught It obtains element and further includes that the position for being configured to determine position coupled with the microcontroller determines element, and is wherein described micro- Controller is further configured to transmit the position to the computer, or wherein the system also includes server computer, And wherein the microcontroller is further configured to transmit the position, and the wherein calculating to the server computer Machine or server computer are further configured to based on the position and the event initial time and the event dwell time At least one event video is formed from the various pieces of at least one video.
22. motion event identification according to claim 1 and video synchronizing system, wherein the microcontroller is described Computer is further configured to determine the position of the event, or wherein the microcontroller and the computer are further configured to It determines the position of the event and position is carried out related.
23. motion event identification according to claim 1 and video synchronizing system, wherein the computer is also configured It include an at least width for the event at at least video camera from the neighbouring event or from server computer request Image or video.
24. motion event identification according to claim 1 and video synchronizing system, wherein the computer is also configured It for the neighbouring event or is directed to watch the request of the camera position of the event at broadcast.
25. motion event identification according to claim 1 and video synchronizing system, wherein the computer is also configured At show the event occurred or one of them or more the list of one or more times that has occurred of event.
26. motion event identification according to claim 1 and video synchronizing system, wherein at least one described movement is caught Element is obtained physically to couple with the mobile device.
27. motion event identification according to claim 1 and video synchronizing system, wherein the microcontroller and temperature Sensor coupling, and wherein the microcontroller is further configured to transmit the temperature obtained from temperature sensor using as temperature Event.
28. motion event identification according to claim 1 and video synchronizing system, wherein the event data includes:
Exercise data associated at least one described capturing movement element, wherein at least one described capturing movement element with Any combination of the user or the equipment or the mobile device is coupled;Or
Show to stand, walk, fall down, heatstroke, disease burst, acutely shake, cerebral concussion, collision, abnormal gait, adnormal respiration or The exercise data to breathe no more;Or
Any combination thereof.
29. a kind of motion event identification and video synchronizing system comprising:
It is configured at least one the capturing movement element being coupled with user or equipment or the mobile device coupled with user, Wherein at least one described capturing movement element includes:
Memory;
It is configured to capture number associated with direction, position, the velocity and acceleration of at least one capturing movement element The sensor of any combination of value;
Radio device;
The microcontroller coupled with the memory, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collection includes the data of the sensor values from the sensor;
In the memory data storage;
The data are analyzed and pick out the event in the data to determine event data;
The event data associated with the event is transmitted by the radio device;
Mobile device comprising:
Computer;
Wireless communication interface is configured to:
It communicates to obtain the event data associated with the event with the radio device;
Wherein the computer is coupled with wireless communication interface, wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysis data;
It stores the event data or the motion analysis data or the event data and the motion analysis data is whole The two;
Event initial time and event dwell time are obtained from the event data;
Request includes at least being captured during from the event initial time to the time span of the event dwell time Video utilizes video camera institute captured image data;
Event video is shown over the display, including all two following:
The event occurred during from the event initial time to the time span of the event dwell time Data, the motion analysis data or any combination thereof;And
The video captured during from the event initial time to the time span of the event dwell time; And
Server computer far from the mobile device, wherein the server computer is configured to:
Obtain at least part video for not having and falling in except the event initial time to the event dwell time; And
The view captured during from the event initial time to the time span of the event dwell time Frequency returns to the computer in the mobile device.
30. a kind of motion event identification and video synchronizing system comprising:
It is configured at least one the capturing movement element being coupled with user or equipment or the mobile device coupled with user, Wherein at least one described capturing movement element includes:
Memory;
It is configured to capture number associated with direction, position, the velocity and acceleration of at least one capturing movement element The sensor of any combination of value;
Radio device;
The microcontroller coupled with the memory, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collection includes the data of the sensor values from the sensor;
In the memory data storage;
The data are analyzed and pick out the event in the data to determine event data;
The event data associated with the event is transmitted by the radio device;
Mobile device comprising:
Computer;
Wireless communication interface is configured to:
It communicates to obtain the event data associated with the event with the radio device;
Wherein the computer is coupled with wireless communication interface, wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysis data;
It stores the event data or the motion analysis data or the event data and the motion analysis data is whole The two;
Event initial time and event dwell time are obtained from the event data;
Request includes at least being captured during from the event initial time to the time span of the event dwell time Video utilizes video camera institute captured image data;
Event video is shown over the display, including all two following:
The event occurred during from the event initial time to the time span of the event dwell time Data, the motion analysis data or any combination thereof;And
The video captured during from the event initial time to the time span of the event dwell time; And
When the communication linkage between at least one described capturing movement element and the mobile device is open, discarding falls in described At least part video except event initial time to the event dwell time, and from when event starting Between the video to the event dwell time and the institute that occurs from the event initial time to the event dwell time Motion analysis data are stated to save together.
31. a kind of motion event identification and video synchronizing system comprising:
It is configured at least one the capturing movement element being coupled with user or equipment or the mobile device coupled with user, Wherein at least one described capturing movement element includes:
Memory;
It is configured to capture number associated with direction, position, the velocity and acceleration of at least one capturing movement element The sensor of any combination of value;
Radio device;
The microcontroller coupled with the memory, the sensor and the radio device, wherein the microcontroller quilt It is configured to:
Collection includes the data of the sensor values from the sensor;
In the memory data storage;
The data are analyzed and pick out the event in the data to determine event data;
The event data associated with the event is transmitted by the radio device;
Mobile device comprising:
Computer;
Wireless communication interface is configured to:
It communicates to obtain the event data associated with the event with the radio device;
Wherein the computer is coupled with wireless communication interface, wherein the computer is configured to:
The event data is received from the wireless communication interface;
The event data is analyzed to form motion analysis data;
It stores the event data or the motion analysis data or the event data and the motion analysis data is whole The two;
Event initial time and event dwell time are obtained from the event data;
Request includes at least being captured during from the event initial time to the time span of the event dwell time Video utilizes video camera institute captured image data;
Event video is shown over the display, including all two following:
The event occurred during from the event initial time to the time span of the event dwell time Data, the motion analysis data or any combination thereof;And
The video captured during from the event initial time to the time span of the event dwell time; And
The view is saved when the communication linkage between at least one described capturing movement element and the mobile device is not open Frequently, it and after receiving the event after the communication linkage is open, then abandons and falls in the event initial time At least part video except to the event dwell time, and from the event initial time to the event The video of dwell time and the motion analysis number occurred from the event initial time to the event dwell time According to saving together.
CN201580033463.0A 2014-04-21 2015-04-21 Motion event identification and video synchronizing system and method Active CN106464848B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/257,959 2014-04-21
US14/257,959 US9076041B2 (en) 2010-08-26 2014-04-21 Motion event recognition and video synchronization system and method
PCT/US2015/026896 WO2015164389A1 (en) 2014-04-21 2015-04-21 Motion event recognition and video synchronization system and method

Publications (2)

Publication Number Publication Date
CN106464848A CN106464848A (en) 2017-02-22
CN106464848B true CN106464848B (en) 2019-07-02

Family

ID=54333090

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580033463.0A Active CN106464848B (en) 2014-04-21 2015-04-21 Motion event identification and video synchronizing system and method

Country Status (6)

Country Link
EP (1) EP3017598A4 (en)
JP (1) JP2017521017A (en)
CN (1) CN106464848B (en)
AU (1) AU2015249884B2 (en)
CA (1) CA2917542C (en)
WO (1) WO2015164389A1 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6761765B2 (en) * 2017-02-20 2020-09-30 株式会社プロップ Heat stroke prevention device
CN107016686A (en) * 2017-04-05 2017-08-04 江苏德长医疗科技有限公司 Three-dimensional gait and motion analysis system
CN109247909A (en) * 2017-07-12 2019-01-22 台湾安莉莎医疗器材科技股份有限公司 Physiological monitoring system
CN108307175B (en) * 2018-02-08 2020-01-14 华南理工大学 Dance dynamic image capturing and restoring system based on flexible sensor and control method
EP3672233A1 (en) * 2018-12-21 2020-06-24 Axis AB Method for carrying out a health check of cameras and a camera system
JP7169213B2 (en) * 2019-02-05 2022-11-10 株式会社日立製作所 Physical health video analysis device, method and system
CN110190959B (en) 2019-06-28 2021-05-07 中南大学 Encryption and decryption method based on continuous variable quantum neural network
US11789843B1 (en) 2019-07-05 2023-10-17 Cornerstone Research Group, Inc. Event detection sensor and recording system
CN110543861A (en) * 2019-09-05 2019-12-06 深圳前海达闼云端智能科技有限公司 early warning method, server and early warning system
US11583729B2 (en) 2019-09-06 2023-02-21 Taylor Made Golf Company, Inc. Systems and methods for integrating measurements captured during a golf swing
CN110639197A (en) * 2019-09-27 2020-01-03 上海淡竹体育科技有限公司 Sports test method, device and system
KR102100675B1 (en) * 2019-12-06 2020-05-15 주식회사 대산테크디자인 Method for manufacturing golf shoe insole
FR3106919B1 (en) * 2020-02-03 2022-03-04 Psa Automobiles Sa VEHICLE WITH ANALYSIS CAMERA(S) STORING GROUPS OF IMAGES IN THE PRESENCE OF DETECTED EVENTS
CN112291520B (en) * 2020-10-26 2022-12-06 浙江大华技术股份有限公司 Abnormal event identification method and device, storage medium and electronic device
CN112752100B (en) * 2020-12-28 2022-08-12 杭州海康威视系统技术有限公司 Method and device for determining video integrity and readable storage medium
CN113542774B (en) * 2021-06-04 2023-10-20 北京格灵深瞳信息技术股份有限公司 Video synchronization method, device, electronic equipment and storage medium
CN113326828B (en) * 2021-08-03 2021-10-26 湖南涉外经济学院 Sports tactics identification method and system
WO2023097304A1 (en) * 2021-11-24 2023-06-01 Dreamsports Technology Development (Beijing) Co., Ltd. System and method for measuring activity performance
CN114554114B (en) * 2022-04-24 2022-08-16 浙江华眼视觉科技有限公司 Express item code recognition machine pickup evidence persistence method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103026345A (en) * 2010-06-02 2013-04-03 惠普发展公司,有限责任合伙企业 Dynamic multidimensional schemas for event monitoring priority
CN103533235A (en) * 2013-09-17 2014-01-22 北京航空航天大学 Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene
CN103717994A (en) * 2011-06-20 2014-04-09 因文森斯公司 Motion determination

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6539336B1 (en) * 1996-12-12 2003-03-25 Phatrat Technologies, Inc. Sport monitoring system for determining airtime, speed, power absorbed and other factors such as drop distance
US8886298B2 (en) * 2004-03-01 2014-11-11 Microsoft Corporation Recall device
US20070150138A1 (en) * 2005-12-08 2007-06-28 James Plante Memory management in event recording systems
US8702516B2 (en) * 2010-08-26 2014-04-22 Blast Motion Inc. Motion event recognition system and method
JP2015531900A (en) * 2012-06-07 2015-11-05 ゾール メディカル コーポレイションZOLL Medical Corporation System and method for video capture, user feedback, reporting, adaptive parameters, remote data access in vehicle safety monitoring

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103026345A (en) * 2010-06-02 2013-04-03 惠普发展公司,有限责任合伙企业 Dynamic multidimensional schemas for event monitoring priority
CN103717994A (en) * 2011-06-20 2014-04-09 因文森斯公司 Motion determination
CN103533235A (en) * 2013-09-17 2014-01-22 北京航空航天大学 Quick digital panoramic device based on linear array charge coupled device (CCD) for great case/event scene

Also Published As

Publication number Publication date
EP3017598A4 (en) 2017-06-07
EP3017598A1 (en) 2016-05-11
CA2917542A1 (en) 2015-10-29
AU2015249884A1 (en) 2016-01-28
CA2917542C (en) 2022-08-16
WO2015164389A1 (en) 2015-10-29
AU2015249884B2 (en) 2019-07-18
CN106464848A (en) 2017-02-22
JP2017521017A (en) 2017-07-27

Similar Documents

Publication Publication Date Title
CN106464848B (en) Motion event identification and video synchronizing system and method
CN107211109B (en) video and motion event integrated system
CN108028902A (en) Integrated sensor and video motion analysis method
CN108369646B (en) Multi-sensor event detection and tagging system
US9401178B2 (en) Event analysis system
US9396385B2 (en) Integrated sensor and video motion analysis method
US9607652B2 (en) Multi-sensor event detection and tagging system
US9406336B2 (en) Multi-sensor event detection system
US9361522B2 (en) Motion event recognition and video synchronization system and method
US8903521B2 (en) Motion capture element
US8702516B2 (en) Motion event recognition system and method
US20120122574A1 (en) System and method for utilizing motion capture data
WO2017011811A1 (en) Event analysis and tagging system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant