CN105224064A - A kind of method and apparatus obtaining user's human body movement data in mouse action - Google Patents
A kind of method and apparatus obtaining user's human body movement data in mouse action Download PDFInfo
- Publication number
- CN105224064A CN105224064A CN201410225554.1A CN201410225554A CN105224064A CN 105224064 A CN105224064 A CN 105224064A CN 201410225554 A CN201410225554 A CN 201410225554A CN 105224064 A CN105224064 A CN 105224064A
- Authority
- CN
- China
- Prior art keywords
- human body
- user
- movement data
- body movement
- mouse
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The object of this invention is to provide a kind of method and apparatus obtaining user's human body movement data in mouse action.Obtain the human body movement data of described user in the operation of described mouse, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and described human body movement data corresponds to described cursor moving device at the wearing position of described user.Compared with prior art, enforcement one aspect of the present invention wearing position have also been obtained while realization is to mouse action takes exercise targetedly, there is good health-care effect, the muscular fatigue that also can effectively prevent wearing position from keeping anchor to cause for a long time on the other hand and possible discomfort.
Description
Technical field
The present invention relates to computer realm, particularly relating to a kind of technology for obtaining user's human body movement data in mouse action.
Background technology
Mouse is people's routine work and a kind of computer entry device be in daily use in life.In the prior art, mouse mainly comprises following several: roller-ball mouse, optical mouse and wireless mouse.These mouses are often fixed on a certain position, can produce fatigue even muscular strain after causing people to use mouse for a long time.And, above-mentioned three kinds of mouses are all independent of keyboard, and therefore, people are when use mouse and keyboard carry out computer operation, often need a hand to switch continually between mouse and keyboard, this switching mode not only operates loaded down with trivial details but also easily causes the reduction of people's work efficiency.
In order to solve the problem, there has been proposed wearable mouse, certain position (such as head) of health is worn on by mouse (or for controlling the part of cursor in mouse), rolling mouse (or for controlling the part of cursor in mouse) is carried out by the motion of dressing position, and then the cursor on mobile computer screen, thus realize the control to cursor.Thus, people switch between mouse and keyboard without the need to using hand, thus effectively improve the work efficiency of people.
But, still there is certain weak point in wearable mouse, such as, dresses in the process that position operates mouse by moving, if dress the mode of motion at position and be not suitable for this wearing position, easily cause muscular fatigue and other possible discomforts of dressing position.
Summary of the invention
The object of this invention is to provide a kind of method and apparatus obtaining user's human body movement data in mouse action.
According to an aspect of the present invention, provide a kind of method for obtaining user's human body movement data in mouse action, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and the method comprises:
Obtain the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
According to a further aspect in the invention, additionally provide a kind of equipment for obtaining user's human body movement data in mouse action, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and this equipment comprises:
Acquisition device, for obtaining the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
Compared with prior art, implement the present invention and can obtain user's human body movement data in mouse action, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and described human body movement data corresponds to described cursor moving device at the wearing position of described user.Further, determine corresponding motion information according to described human body movement data and described motion information is supplied to described user.The present invention is avoiding the hand of user regularly to carry out switching between mouse and keyboard thus is effectively ensureing on the basis of user job efficiency, obtain and analyze human body movement data, reasonably motion adjustment suggestion is provided to user for this human body movement data, thus, wearing position have also been obtained and takes exercise targetedly while realization is to mouse action on the one hand, there is good health-care effect, the muscular fatigue that also can effectively prevent wearing position from keeping anchor to cause for a long time on the other hand and possible discomfort.
Accompanying drawing explanation
By reading the detailed description done non-limiting example done with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:
Fig. 1 illustrates a kind of equipment schematic diagram obtaining user's human body movement data in mouse action according to one aspect of the invention;
Fig. 2 illustrates a kind of equipment schematic diagram obtaining user's human body movement data in mouse action in accordance with a preferred embodiment of the present invention;
Fig. 3 illustrates a kind of method flow diagram obtaining user's human body movement data in mouse action according to a further aspect of the present invention;
Fig. 4 illustrates a kind of method flow diagram obtaining user's human body movement data in mouse action in accordance with a preferred embodiment of the present invention.
In accompanying drawing, same or analogous Reference numeral represents same or analogous parts.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Fig. 1 illustrates a kind of equipment schematic diagram obtaining user's human body movement data in mouse action according to one aspect of the invention.Wherein, described mouse 10 comprises the cursor moving device 100 moving cursor by being worn on described user, this equipment 20 comprises: acquisition device 200, for obtaining the human body movement data of described user in the operation of described mouse 10, wherein, described human body movement data corresponds to described cursor moving device 100 at the wearing position of described user.At this, human body movement data includes but not limited to the data of the forms of motion such as movement, rotation carried out about position one or more in human body.Those skilled in the art will be understood that mouse 10 and equipment 20 carry out data interaction based on wired or wireless mode; In concrete enforcement, this equipment 20 or independent of mouse 10, or mutually integrated with mouse 10; When mouse 10 is separate type, this equipment 20 can also be mutually integrated with any portion of this mouse 10.
Particularly, mouse 10 is people's routine work and a kind of computer entry device be in daily use in life.Described mouse 10 comprises cursor moving device 100 and button/roller devices 110, wherein, described cursor moving device 100 is for carrying out the movement of computer for controlling onscreen cursor by changing position, and described button/roller devices 110 is for realizing the operation to computer screen element by single-click operation or double click operation or other move mode.In a specific embodiment, described cursor moving device 100 and described button/roller devices 110 are designed to clastotype, wherein, described cursor moving device 100 is designed to the structure that applicable human body is dressed, described button/roller devices 110 can be integrated with keyboard, user can closely operate button/roller devices 110 when knocking keyboard, or the independent individual components of described button/roller devices 110 is operated by the position such as hand or pin.In another specific embodiment, described cursor moving device 100 integrates with described button/roller devices 110, integrally dresses.Cursor moving device 100 is worn on certain position of health when using mouse 10 by user, is hereinafter called at the position of dressing cursor moving device 100 and dresses position.Wherein, described wearing position includes but not limited to other positions of head, shoulder, ancon, knee or user's body.What it will be appreciated by those skilled in the art that is; everyly comprise cursor moving device and this cursor moving device can carry out the mouse dressed; include in the scope that the present invention protects, for brevity, no longer all possible structure of mouse is enumerated.
User is when carrying out mouse 10 and operating, and cursor moving device 100 is worn on corresponding wearing on position, by moving, this wearing position makes the position of cursor moving device 100 change, and then changes the position of cursor on computer screen.For user, cursor moving device 100 is worn on head, user carrys out the movement in the front, rear, left and right of computer for controlling onscreen cursor, left front, right front, left back and right back eight directions by the front, rear, left and right of neck, the motion in left front, right front, left back and right back eight directions.It should be noted that, how the position of cursor moving device 100 is changed be mapped to the movement of cursor on computer screen be those skilled in the art the technological means be familiar with, such as by carrying out to the Mobile data that acceleration transducer and gyro sensor in cursor moving device 110 gather the Mobile data that data processing generates the X/Y direction vector of corresponding screen, for brevity, no longer its principle is specifically described at this.In addition, it will be understood by those skilled in the art that, the corresponding relation of above-mentioned neck movement direction and cursor motion track is only citing, in actual applications, dress position direction of motion from can there is multiple different corresponding relation between cursor motion track, this corresponding relation can also be arranged voluntarily according to the use habit of user, individual preference etc.
Preferably, the described cursor moving device in this equipment can independence or be contained in the earphone of described user, such as, in the earphone being integrated in user or auditory prosthesis, can make to listen to the music or broadcast and operate that this mouse cursor position mobile is parallel carries out.More preferably, this equipment also comprises feedback assembly (not shown), for providing information of voice prompt about mouse action process by described earphone to described user.Such as, this equipment supports that the computing equipment that mouse connects carries out interactive voice by earphone and user in the mouse action process of user, such as reminding user cursor shifts out screen, a certainly can report corresponding pending operation during click location when cursor is placed in, and its up and down content of operation prompting, allow blind operator can rapidly according to remember find the operation that will click.Such invention, in repetition training with when enforcing one's memory, is not only applicable to blind person, dysphotia user operation computing equipment, domestic consumer also can be facilitated under the environment that screen is not visible to carry out mouse action.
In the process that user is controlled cursor by wearing position, obtain the human body movement data corresponding with dressing position.Wherein, be directed to cursor moving device 100 dress the difference at position, the corresponding difference of human body movement data.Such as, when wearing position is head, described human body movement data comprises head movement data, neck movement data or its combination etc.It will be appreciated by persons skilled in the art that above-mentioned human body movement data is only citing, every data that can reflect to move in wearing position include in the scope that the present invention protects.How to obtain the human body movement data of user in the operation of mouse to acquisition device 200 to be below described in detail.
In a preferred embodiment, whether described acquisition device 200 meets the trigger condition obtaining the human body movement data of described user in the operation of described mouse 10 for detecting, and when meeting described trigger condition, obtains described human body movement data.Particularly, described trigger condition can be predetermined period, also can be scheduled event, that is, there occurs scheduled event when acquisition device 200 detects to meet predetermined period the time or detect, then trigger obtaining described human body movement data.Such as acquisition device 200 triggers in real time and obtains the described human body movement data of user in operating mouse 10 process, such as trigger when acquisition device 200 detects that human body movement data is accumulative and meets some threshold values again and obtain this human body movement data, such as trigger the described human body movement data of acquisition when acquisition device 200 detects that user completes after mouse 10 operates again.
In a further advantageous embodiment, the human body movement data of described user in the operation of described mouse 10 that record for obtaining described cursor moving device 100 of described acquisition device 200.Particularly, the motion sensor (not shown) that cursor moving device 100 comprises can measure the exercise data (i.e. the 3 D motion trace of cursor moving device 100) of cursor moving device 100, because the wearing position of cursor moving device 100 with user is fixed, therefore the exercise data of cursor moving device 100 i.e. the human body movement data of user in the operation of mouse 10, cursor moving device 100 carries out record to this human body movement data after measuring and obtaining human body movement data.When the human body movement data needing acquisition user in the operation of mouse 10, the record that acquisition device 200 obtains in cursor moving device can obtain described human body movement data.
In another preferred embodiment, described acquisition device 200, for according to the movable information of described cursor in the operation of described mouse 10, determines the human body movement data of described user in the operation of described mouse 10.Particularly, cursor two dimensional motion track on the computer screen can correspond to the movement locus at the wearing position of user, such as this wearing position straight line or curvilinear motion track on two dimensional surface, therefore, human body movement data can be extrapolated according to cursor movable information on the computer screen.Such as, gather movement locus when user dresses cursor moving device 100 in advance, and the cursor of correspondence corresponding cursor motion track on the computer screen, and set up the mapping relations between user movement track and cursor motion track; According to current gathered cursor current motion track on the computer screen, in conjunction with these mapping relations, determine corresponding human body movement data, such as, continue the time stopping or move in a direction.
In another preferred embodiment, described acquisition device 200 is for according to the movable information of described cursor in the operation of described mouse 10, and the exercise data at the described wearing position of recording in conjunction with described cursor moving device 100, determine the human body movement data position of described user in the operation of described mouse 10.Particularly, because the movement locus dressing position is 3 D motion trace, the exercise data at the wearing position therefore can recorded with cursor moving device 100 by cursor movable information on the computer screen (two dimensional motion track) further combines and calculates the human body movement data of user in mouse 10 operates.Such as, first tentatively human body movement data is determined according to the motion track information of cursor on screen, then, the exercise data at the described wearing position of recording according to described cursor moving device 100 again, interpolation processing is carried out to the human body movement data tentatively determined, thus obtains more accurate human body movement data.Preferably, when carrying out interpolation processing according to recorded wearing position exercise data to the human body movement data tentatively determined, can process according to time attribute, such as, interval sometime wearing position exercise data is used to carry out interpolation processing to this human body movement data in same time interval.
Fig. 2 illustrates a kind of equipment schematic diagram obtaining user's human body movement data in mouse action in accordance with a preferred embodiment of the present invention.Wherein, described mouse 10 ' comprises the cursor moving device 100 ' moving cursor by being worn on described user, and this equipment 20 ' comprises acquisition device 200 ', determining device 210 ' and generator 220 '.Described acquisition device 200 ', for obtaining the human body movement data of described user in the operation of described mouse 10 ', wherein, described human body movement data corresponds to described cursor moving device 100 ' at the wearing position of described user; Described determining device 210 ', for determining corresponding motion information according to described human body movement data; Described generator 220 ', for being supplied to described user by described motion information.Wherein, described mouse 10 ', described cursor moving device 100 ', described acquisition device 200 ' are identical with corresponding intrument shown in Fig. 1 or substantially identical, so place repeats no more, and are contained in this by way of reference.
Particularly, after the human body movement data of the user that described acquisition device 200 ' gets in mouse 10 ' operates, described determining device 210 ' according to the motion conditions at the wearing position of the corresponding user of this human body movement data identification cursor moving device 100 ', and determines corresponding motion information according to described motion conditions.
In a preferred embodiment, described determining device 210 ' according to described human body movement data, and combines the motor pattern information corresponding with described wearing position, determines the motion information about described wearing position.Particularly, be specific implementation for dressing position and can play the motion of best health-care effect with dressing the corresponding motor pattern information in position.The described motor pattern information corresponding with dressing position can be obtained by medical science general knowledge and health care experience.Such as, the motor pattern corresponding with head is " rice font " motor pattern, and so corresponding with head motor pattern information is then the specific implementation that " rice font " moves; The motor pattern corresponding with shoulder is " O font " motor pattern, and so corresponding with shoulder motor pattern information is then the specific implementation that " O font " moves.Described determining device 210 ' carries out human body movement data analyzing the mode of motion that can obtain the wearing position of user, motor pattern information corresponding with this wearing position for described mode of motion is compared, if described mode of motion is different from described motor pattern information, then think that described mode of motion can not play best health-care effect for the wearing position of user, in this case, described determining device 210 ' determines the motion information about described wearing position, wherein, this motion information is aimed at the motion adjustment that the difference between the mode of motion at the wearing position of the user motor pattern information corresponding with this wearing pattern provides and advises.Illustrate, when cursor moving device 100 ' is worn on user's head, user controls the motion of cursor moving device 100 ' by neck and then realizes controlling the cursor on computer screen, be directed to neck, " rice font " motor pattern is beneficial to the health care of neck most, that is, neck removes according to " rice word " the best health-care effect that can realize neck that moves, therefore, the motor pattern information corresponding with head is the information that " rice font " moves, namely before comprising, after, left, right, left front, right front, the motion in left back and right back eight directions, if human body movement data shows that the head of user carries out " cross " motion (before namely only comprising, after, left, the motion of right four direction), then described determining device 210 ' determines that motion information about the head of user is for " to increase left front, right front, left back and right back to motion ".
It should be noted that, the wearing position of the user that cursor moving device 100 ' is corresponding can be preset or dress cursor moving device 100 ' in real time setting afterwards by user, in this case, the information preset described in described determining device 210 ' basis or the information of described real-time setting can know the wearing position of user, and then can determine the motor pattern information corresponding with this wearing position.Be directed to the situation that wearing position does not preset or user does not set in real time of the corresponding user of cursor moving device 100 ', described determining device 210 ' needs the concrete wearing position first determining that cursor moving device is corresponding.Particularly, described determining device 210 ', according to the body dynamics information of described human body movement data, determines described wearing position.Its ultimate principle is, in the process controlled cursor moving device 100 ', different its mode of motion of wearing position is different, and the body dynamics information entrained by different mode of motion is also different.That is, described determining device 210 ' carries out the human body movement data of user analyzing the body dynamics information that can obtain the wearing position of user, can judge cursor moving device is worn on which position of user by this body dynamics information.Such as, if the body dynamics information of human body movement data shows that the movement locus at the wearing position of user is " rice font ", then described determining device 210 ' can determine that cursor moving device is worn on the head of user; If the body dynamics information of human body movement data shows that the movement locus at the wearing position of user is " O font ", then described determining device 210 ' determines that the wearing position corresponding to cursor moving device is shoulder.It should be noted that, described determining device 210 ' analyze human body movement data with obtain body dynamics information be those skilled in the art the technological means be familiar with, for brevity, no longer its process is repeated at this.
In a further advantageous embodiment, described determining device 210 ', according to described human body movement data and default movement threshold information, determines corresponding motion information.Particularly, the human body movement data of user and the movement threshold information preset compare by described determining device 210 ', wherein, described movement threshold information is for judging whether the motion conditions at the wearing position that described cursor moving device is corresponding can cause the discomfort at this wearing position, such as dress the stay time threshold value at position, such as dress again the scope of activities threshold value etc. at position.If described human body movement data does not exceed default movement threshold information, then think that the motion conditions at the wearing position that described somatic data is corresponding can not cause discomfort to this wearing position; Otherwise, if described human body movement data exceeds the scope of default movement threshold information, then think that the motion conditions at the wearing position that described human body movement data is corresponding likely causes the discomfort at this wearing position, in this case, described determining device 210 ' needs to determine corresponding motion information, wherein, described motion information be aimed at described motion conditions may cause user dress position produce discomfort provide motion adjustment suggestion.Illustrate, when the human body movement data of user does not change (or amplitude of variation is very little) and the duration of this period of time exceedes default stay time threshold value within a period of time, or when the continuously active scope at the wearing position of the corresponding user of the human body movement data display highlighting mobile device 100 ' of user is less than default scope of activities threshold value, described determining device 210 ' then thinks that the wearing position of user keeps the overlong time of a certain anchor, in order to avoid owing to fixing the discomforts such as such as muscular fatigue that a certain posture may cause for a long time, now, described determining device 210 ' determines the motion information corresponding with described wearing position, such as " break-off ", the suggestion such as " activity of standing up " user adjusts the information that it dresses position motion conditions.What those skilled in the art should understand that is, movement threshold information is not limited only to above-mentioned " stay time threshold value " and " scope of activities threshold value ", the difference that can also be directed to the corresponding wearing position of cursor moving device arranges corresponding movement threshold information, in addition, the concrete value of movement threshold information needs the wearing position being directed to cursor moving device 100 ' corresponding to set, for brevity, be no longer directed to different wearing positions at this to be described one by one the particular content of movement threshold information and concrete value.Those skilled in the art it should also be understood that motion information is not limited only to above-mentioned " break-off " and " activity of standing up ", other motion adjustment suggestions being directed to described wearing position can also be comprised, such as " movable neck ", " minimizing is leaned forward ", " minimizing is bowed ", " not to the left for a long time ", " not to the right for a long time " etc., for brevity, no longer all possible motion information is enumerated at this.
After described determining device 210 ' determines corresponding motion information according to described human body movement data, the motion information determined is prompted to user by described generator 220 ', adjusts accordingly according to the motion conditions of this motion information to the corresponding wearing position of cursor moving device 100 ' for user.Wherein, the concrete form of motion information can be one in word, image, sound or its combination in any.Illustrate, if the motion information that described determining device 210 ' is determined is " movable neck ", described generator 220 ' then can be pointed out user by showing word " movable neck " on the computer screen, also by the exemplary animation playing neck activity on the computer screen, user can be pointed out, also can being pointed out user by voice broadcast " movable neck ", can also point out user by playing the music being applicable to neck movement.
In a preferred embodiment, the scenario-related information that described generator 220 ' is corresponding according to described user, is supplied to described user by described motion information.Particularly, user may be in different scenes when carrying out mouse 10 ' operation, such as operative scenario, Entertainment Scene etc., the scenario-related information that described generator 220 ' is corresponding according to user, selects the mode being suitable for this scene that motion information is supplied to described user pointedly.Illustrate, when user is in operative scenario, motion information is then presented to user by the mode such as showing word or image etc. " peace and quiet " on the computer screen by described generator 220 '; When user is in Entertainment Scene, motion information is then conveyed to user by the mode of such as voice broadcast or broadcasting music etc. " significantly " by described generator 220 '.It will be understood by those skilled in the art that, there is the obtain manner of several scenes relevant information, be the working time at 6 in afternoon in the morning 9 that such as user can pre-set the every workday according to himself situation, so in this setting-up time section, after described determining device 210 ' determines motion information according to the human body movement data of user, described generator 220 ' all adopts the mode of above-mentioned " peace and quiet " that this motion information is supplied to user; Arrange this scenario-related information in real time after such as user enters a certain scene again, so described generator 220 ' adopts corresponding mode to provide described motion information to user according to the configuration information of this user.
Preferably, described generator 220 ' is also for being supplied to described user by described earphone by the information of voice prompt in described motion information.At this, the described cursor moving device in this equipment can independence or be contained in the earphone of described user, such as, in the earphone being integrated in user or auditory prosthesis, can make to listen to the music or broadcast and operate that this mouse cursor position mobile is parallel carries out.More preferably, this equipment reports information of voice prompt by this generator 220 ' to user, such as " movable neck ", " minimizing is leaned forward ", " minimizing is bowed ", " not to the left for a long time ", " not to the right for a long time " etc., for brevity, no longer all possible motion information is enumerated at this.Obviously, such invention not only protects the privacy information of user, also reduce in public or in office to other people interference.
Fig. 3 illustrates a kind of method flow diagram obtaining user's human body movement data in mouse action according to a further aspect of the present invention.Particularly, in step sl, equipment obtains the human body movement data of user in the operation of mouse, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and described human body movement data corresponds to described cursor moving device at the wearing position of described user.
Particularly, in step sl, mouse is people's routine work and a kind of computer entry device be in daily use in life.Described mouse comprises cursor moving device and button/roller devices, wherein, described cursor moving device is used for the movement carrying out computer for controlling onscreen cursor by changing position, and described button/roller devices is for realizing the operation to computer screen element by single-click operation or double click operation.In a specific embodiment, described cursor moving device and described button/roller devices are designed to clastotype, wherein, described cursor moving device is designed to the structure that applicable human body is dressed, described button/roller devices can be integrated with keyboard, and user can closely operate button/roller devices when knocking keyboard, in another specific embodiment, described cursor moving device and described button/roller devices integrate, and integrally dress.Cursor moving device is worn on certain position of health when using mouse by user, is hereinafter called at the position of dressing cursor moving device and dresses position.Wherein, described wearing position includes but not limited to head, shoulder and ancon.What it will be appreciated by those skilled in the art that is; everyly comprise cursor moving device and this cursor moving device can carry out the mouse dressed; include in the scope that the present invention protects, for brevity, no longer all possible structure of mouse is enumerated.
User is when carrying out mouse action, and cursor moving device is worn on corresponding wearing on position, by moving, this wearing position makes the position of cursor moving device change, and then changes the position of cursor on computer screen.For user, cursor moving device is worn on head, user carrys out the movement in the front, rear, left and right of computer for controlling onscreen cursor, left front, right front, left back and right back eight directions by the front, rear, left and right of neck, the motion in left front, right front, left back and right back eight directions.It should be noted that, how the position of cursor moving device is changed be mapped to the movement of cursor on computer screen be those skilled in the art the technological means be familiar with, for brevity, no longer its principle is specifically described at this.In addition, it will be understood by those skilled in the art that, the corresponding relation of above-mentioned neck movement direction and cursor motion track is only citing, in actual applications, dress position direction of motion from can there is multiple different corresponding relation between cursor motion track, this corresponding relation can also be arranged voluntarily according to the use habit of user, individual preference etc.
Preferably, the described cursor moving device in this equipment can independence or be contained in the earphone of described user, such as, in the earphone being integrated in user or auditory prosthesis, can make to listen to the music or broadcast and operate that this mouse cursor position mobile is parallel carries out.More preferably, the method also comprises step S4 (not shown), and this equipment provides information of voice prompt about mouse action process by described earphone to described user.Such as, this equipment supports that the computing equipment that mouse connects carries out interactive voice by earphone and user in the mouse action process of user, such as reminding user cursor shifts out screen, a certainly can report corresponding pending operation during click location when cursor is placed in, and its up and down content of operation prompting, allow blind operator can rapidly according to remember find the operation that will click.Such invention, in repetition training with when enforcing one's memory, is not only applicable to blind person, dysphotia user operation computing equipment, domestic consumer also can be facilitated under the environment that screen is not visible to carry out mouse action.
In the process that user is controlled cursor by wearing position, obtain the human body movement data corresponding with dressing position.Wherein, be directed to cursor moving device dress the difference at position, the corresponding difference of human body movement data.Such as, when wearing position is head, described human body movement data comprises head movement data, neck movement data or its combination etc.It will be appreciated by persons skilled in the art that above-mentioned human body movement data is only citing, every data that can reflect to move in wearing position include in the scope that the present invention protects.To how obtaining the human body movement data of user in the operation of mouse be described in detail below.
In a preferred embodiment, detect whether meet the trigger condition obtaining the human body movement data of described user in the operation of described mouse; When meeting described trigger condition, obtain described human body movement data.Particularly, described trigger condition can be predetermined period, also can be scheduled event, that is, upon this detection between on meet predetermined period or detect and there occurs scheduled event, then trigger obtaining described human body movement data.Such as trigger in real time and obtain the described human body movement data of user in operating mouse process, such as triggering when detecting that human body movement data is accumulative and meeting some threshold values again and obtain this human body movement data, such as triggering the described human body movement data of acquisition when detecting after user completes mouse action again.
In a further advantageous embodiment, the human body movement data of described user in the operation of described mouse that described cursor moving device records is obtained.Particularly, the motion sensor that cursor moving device comprises can measure the exercise data (i.e. the 3 D motion trace of cursor moving device) of cursor moving device, because the wearing position of cursor moving device and user is fixed, therefore the exercise data of cursor moving device i.e. the human body movement data of user in the operation of mouse, cursor moving device measurement carries out record to this human body movement data after obtaining human body movement data.When needing to obtain the human body movement data in the operation of user at mouse, the record obtained in cursor moving device can obtain described human body movement data.
In another preferred embodiment, according to the movable information of described cursor in the operation of described mouse, determine the human body movement data of described user in the operation of described mouse.Particularly, cursor two dimensional motion track on the computer screen can correspond to the movement locus at the wearing position of user, such as this wearing position straight line or curvilinear motion track on two dimensional surface, therefore, human body movement data can be extrapolated according to cursor movable information on the computer screen.Such as, gather movement locus when user dresses cursor moving device 100 in advance, and the cursor of correspondence corresponding cursor motion track on the computer screen, and set up the mapping relations between user movement track and cursor motion track; According to current gathered cursor current motion track on the computer screen, in conjunction with these mapping relations, determine corresponding human body movement data, such as, continue the time stopping or move in a direction.
In another preferred embodiment, according to the movable information of described cursor in the operation of described mouse, and the exercise data at the described wearing position of recording in conjunction with described cursor moving device, determine the human body movement data position of described user in the operation of described mouse.Particularly, because the movement locus dressing position is 3 D motion trace, the exercise data at the wearing position therefore cursor movable information on the computer screen (two dimensional motion track) can recorded with cursor moving device combines and calculates the human body movement data of user in mouse action.Such as, first tentatively human body movement data is determined according to the motion track information of cursor on screen, then, the exercise data at the described wearing position of recording according to described cursor moving device 100 again, interpolation processing is carried out to the human body movement data tentatively determined, thus obtains more accurate human body movement data.Preferably, when carrying out interpolation processing according to recorded wearing position exercise data to the human body movement data tentatively determined, can process according to time attribute, such as, interval sometime wearing position exercise data is used to carry out interpolation processing to this human body movement data in same time interval.Calculate human body movement data compared to aforementioned by means of only cursor movable information on the computer screen, calculate that the human body movement data obtained can be more accurate according to the method in the present embodiment.
Fig. 4 illustrates a kind of method flow diagram obtaining user's human body movement data in mouse action in accordance with a preferred embodiment of the present invention.Particularly, in step S1 ', obtain the human body movement data of user in the operation of mouse, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and described human body movement data corresponds to described cursor moving device at the wearing position of described user; In step S2 ', determine corresponding motion information according to described human body movement data; In step S3 ', described motion information is supplied to described user.Wherein, described step S1 ' is identical with step S1 corresponding shown in Fig. 3 or substantially identical, so place repeats no more, and is contained in this by way of reference.
Particularly, in step S2 ', according to the human body movement data of the user got in step S1 ' in mouse action, identify the motion conditions at the wearing position of the user that cursor moving device is corresponding, and determine corresponding motion information according to described motion conditions.
In a preferred embodiment, according to described human body movement data, and combine the motor pattern information corresponding with described wearing position, determine the motion information about described wearing position.Particularly, be specific implementation for dressing position and can play the motion of best health-care effect with dressing the corresponding motor pattern information in position.The described motor pattern information corresponding with dressing position can be obtained by medical science general knowledge and health care experience.Such as, the motor pattern corresponding with head is " rice font " motor pattern, and so corresponding with head motor pattern information is then the specific implementation that " rice font " moves; The motor pattern corresponding with shoulder is " O font " motor pattern, and so corresponding with shoulder motor pattern information is then the specific implementation that " O font " moves.Carry out human body movement data analyzing the mode of motion that can obtain the wearing position of user, motor pattern information corresponding with this wearing position for described mode of motion is compared, if described mode of motion is different from described motor pattern information, then think that described mode of motion can not play best health-care effect for the wearing position of user, in this case, determine the motion information about described wearing position, wherein, this motion information is aimed at the motion adjustment that the difference between the mode of motion at the wearing position of the user motor pattern information corresponding with this wearing pattern provides and advises.Illustrate, when cursor moving device is worn on user's head, user controls the motion of cursor moving device by neck and then realizes controlling the cursor on computer screen, be directed to neck, " rice font " motor pattern is beneficial to the health care of neck most, that is, neck removes according to " rice word " the best health-care effect that can realize neck that moves, therefore, the motor pattern information corresponding with head is the information that " rice font " moves, namely before comprising, after, left, right, left front, right front, the motion in left back and right back eight directions, if human body movement data shows that the head of user carries out " cross " motion (before namely only comprising, after, left, the motion of right four direction), then determine that motion information about the head of user is for " to increase left front, right front, left back and right back to motion ".
It should be noted that, the wearing position of the user that cursor moving device is corresponding can be that preset or real-time after dressing cursor moving device by user setting, in this case, the wearing position of user can be known according to the information of the described information that presets or described real-time setting, and then the motor pattern information corresponding with this wearing position can be determined.Be directed to the situation that wearing position does not preset or user does not set in real time of the corresponding user of cursor moving device, need the concrete wearing position first determining that cursor moving device is corresponding.Particularly, according to the body dynamics information of described human body movement data, determine described wearing position.Its ultimate principle is, in the process controlled cursor moving device, different its mode of motion of wearing position is different, and the body dynamics information entrained by different mode of motion is also different.That is, carry out the human body movement data of user analyzing the body dynamics information that can obtain the wearing position of user, can judge cursor moving device is worn on which position of user by this body dynamics information.Such as, if the body dynamics information of human body movement data shows that the movement locus at the wearing position of user is " rice font ", then can determine that cursor moving device is worn on the head of user; If the body dynamics information of human body movement data shows that the movement locus at the wearing position of user is " O font ", then determine that the wearing position corresponding to cursor moving device is shoulder.It should be noted that, analyze human body movement data with obtain body dynamics information be those skilled in the art the technological means be familiar with, for brevity, no longer its process is repeated at this.
In a further advantageous embodiment, according to described human body movement data and default movement threshold information, determine corresponding motion information.Particularly, the human body movement data of user and the movement threshold information preset are compared, wherein, described movement threshold information is for judging whether the motion conditions at the wearing position that described cursor moving device is corresponding can cause the discomfort at this wearing position, such as dress the stay time threshold value at position, such as dress again the scope of activities threshold value etc. at position.If described human body movement data does not exceed default movement threshold information, then think that the motion conditions at the wearing position that described somatic data is corresponding can not cause discomfort to this wearing position; Otherwise, if described human body movement data exceeds the scope of default movement threshold information, then think that the motion conditions at the wearing position that described human body movement data is corresponding likely causes the discomfort at this wearing position, in this case, need to determine corresponding motion information, wherein, described motion information be aimed at described motion conditions may cause user dress position produce discomfort provide motion adjustment suggestion.Illustrate, when the human body movement data of user does not change (or amplitude of variation is very little) and the duration of this period of time exceedes default stay time threshold value within a period of time, or when the continuously active scope at the wearing position of the corresponding user of the human body movement data display highlighting mobile device of user is less than default scope of activities threshold value, then think that the wearing position of user keeps the overlong time of a certain anchor, in order to avoid owing to fixing the discomforts such as such as muscular fatigue that a certain posture may cause for a long time, now, determine the motion information corresponding with described wearing position, such as " break-off ", the suggestion such as " activity of standing up " user adjusts the information that it dresses position motion conditions.What those skilled in the art should understand that is, movement threshold information is not limited only to above-mentioned " stay time threshold value " and " scope of activities threshold value ", the difference that can also be directed to the corresponding wearing position of cursor moving device arranges corresponding movement threshold information, in addition, the concrete value of movement threshold information needs the wearing position being directed to cursor moving device corresponding to set, for brevity, be no longer directed to different wearing positions at this to be described one by one the particular content of movement threshold information and concrete value.Those skilled in the art it should also be understood that motion information is not limited only to above-mentioned " break-off " and " activity of standing up ", other motion adjustment suggestions being directed to described wearing position can also be comprised, such as " movable neck ", " minimizing is leaned forward ", " minimizing is bowed ", " not to the left for a long time ", " not to the right for a long time " etc., for brevity, no longer all possible motion information is enumerated at this.
In step S3 ', the motion information determined is prompted to user, adjusts accordingly according to the motion conditions of this motion information to the corresponding wearing position of cursor moving device for user.Wherein, the concrete form of motion information can be one in word, image, sound or its combination in any.Illustrate, if the motion information determined in step S2 ' is " movable neck ", then can point out user by showing word " movable neck " on the computer screen, also by the exemplary animation playing neck activity on the computer screen, user can be pointed out, also can being pointed out user by voice broadcast " movable neck ", can also point out user by playing the music being applicable to neck movement.
Preferably, in described step S3 ', the information of voice prompt in described motion information is also supplied to described user by described earphone by this equipment.At this, the described cursor moving device in this equipment can independence or be contained in the earphone of described user, such as, in the earphone being integrated in user or auditory prosthesis, can make to listen to the music or broadcast and operate that this mouse cursor position mobile is parallel carries out.More preferably, in described step S3 ', this equipment reports information of voice prompt to user, such as " movable neck ", " minimizing is leaned forward ", " minimizing is bowed ", " not to the left for a long time ", " not to the right for a long time " etc., for brevity, no longer all possible motion information is enumerated at this.Obviously, such invention not only protects the privacy information of user, also reduce in public or in office to other people interference.
In a preferred embodiment, the scenario-related information corresponding according to described user, is supplied to described user by described motion information.Particularly, user may be in different scenes when carrying out mouse action, such as operative scenario, Entertainment Scene etc., the scenario-related information corresponding according to user, selects the mode being suitable for this scene that motion information is supplied to described user pointedly.Illustrate, when user is in operative scenario, then motion information is presented to user by the mode by such as showing word or image etc. " peace and quiet " on the computer screen; When user is in Entertainment Scene, then by the mode of such as voice broadcast or broadcasting music etc. " significantly ", motion information is conveyed to user.It will be understood by those skilled in the art that, there is the obtain manner of several scenes relevant information, be the working time at 6 in afternoon in the morning 9 that such as user can pre-set the every workday according to himself situation, so in this setting-up time section, after determining motion information according to the human body movement data of user, all adopt the mode of above-mentioned " peace and quiet " that this motion information is supplied to user; In real time this scenario-related information is arranged after such as user enters a certain scene again, so adopt corresponding mode to provide described motion information to user according to the configuration information of this user.
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and when not deviating from spirit of the present invention or essential characteristic, the present invention can be realized in other specific forms.Therefore, no matter from which point, all should embodiment be regarded as exemplary, and be nonrestrictive, scope of the present invention is limited by claims instead of above-mentioned explanation, and all changes be therefore intended in the implication of the equivalency by dropping on claim and scope are included in the present invention.Any Reference numeral in claim should be considered as the claim involved by limiting.In addition, obviously " comprising " one word do not get rid of other unit or step, odd number does not get rid of plural number.If the step in claim to a method comprises number of steps, to be somebody's turn to do (s) numbering and to be intended to step corresponding to convenient citation, and should not be regarded as the restriction to execution sequence between step, also should not be regarded as the claim involved by limiting.Multiple unit of stating in equipment claim or device also can be realized by software or hardware by a unit or device.First, second word such as grade is used for representing title, and does not represent any specific order.
Claims (26)
1. for obtaining a method for user's human body movement data in mouse action, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and the method comprises:
A obtains the human body movement data of described user in the operation of described mouse, and wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
2. method according to claim 1, wherein, the method also comprises:
B determines corresponding motion information according to described human body movement data;
Described motion information is supplied to described user by c.
3. method according to claim 2, wherein, described step b comprises:
According to described human body movement data, and combine the motor pattern information corresponding with described wearing position, determine the motion information about described wearing position.
4. method according to claim 3, wherein, described step b also comprises:
According to the body dynamics information of described human body movement data, determine described wearing position.
5. method according to claim 2, wherein, described step b comprises:
According to described human body movement data and default movement threshold information, determine corresponding motion information.
6. the method according to any one of claim 2 to 5, wherein, described step c comprises:
The scenario-related information corresponding according to described user, is supplied to described user by described motion information.
7. method according to any one of claim 1 to 6, wherein, described cursor moving device independence or be contained in the earphone of described user.
8. method according to claim 7, wherein, the method also comprises:
Information of voice prompt about mouse action process is provided to described user by described earphone.
9. method according to claim 7, described claim 7 comprises method according to claim 2, and wherein, described step c comprises:
By described earphone, the information of voice prompt in described motion information is supplied to described user.
10. method according to any one of claim 1 to 9, wherein, described step a comprises:
Detect and whether meet the trigger condition obtaining the human body movement data of described user in the operation of described mouse;
When meeting described trigger condition, obtain described human body movement data, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
11. methods according to any one of claim 1 to 10, wherein, described step a comprises:
Obtain the human body movement data of described user in the operation of described mouse that described cursor moving device records, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
12. methods according to any one of claim 1 to 11, wherein, described step a comprises:
According to the movable information of described cursor in the operation of described mouse, determine the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
13. methods according to claim 12, wherein, described step a comprises:
According to the movable information of described cursor in the operation of described mouse, and the exercise data at the described wearing position of recording in conjunction with described cursor moving device, determine the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described wearing position.
14. 1 kinds for obtaining the equipment of user's human body movement data in mouse action, wherein, described mouse comprises the cursor moving device moving cursor by being worn on described user, and this equipment comprises:
Acquisition device, for obtaining the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
15. equipment according to claim 14, wherein, this equipment also comprises:
Determining device, for determining corresponding motion information according to described human body movement data;
Generator, for being supplied to described user by described motion information.
16. equipment according to claim 15, wherein, described determining device is used for:
According to described human body movement data, and combine the motor pattern information corresponding with described wearing position, determine the motion information about described wearing position.
17. equipment according to claim 16, wherein, described determining device also for:
According to the body dynamics information of described human body movement data, determine described wearing position.
18. equipment according to claim 15, wherein, described determining device is used for:
According to described human body movement data and default movement threshold information, determine corresponding motion information.
19. according to claim 15 to the equipment according to any one of 18, and wherein, described generator is used for:
The scenario-related information corresponding according to described user, is supplied to described user by described motion information.
20. according to claim 14 to the equipment according to any one of 19, wherein, and described cursor moving device independence or be contained in the earphone of described user.
21. equipment according to claim 20, wherein, this equipment also comprises:
Feedback assembly, for providing information of voice prompt about mouse action process by described earphone to described user.
22. equipment according to claim 21, described claim 21 comprises equipment according to claim 15, and wherein, described generator is used for:
By described earphone, the information of voice prompt in described motion information is supplied to described user.
23. according to claim 14 to the equipment according to any one of 22, and wherein, described acquisition device is used for:
Detect and whether meet the trigger condition obtaining the human body movement data of described user in the operation of described mouse;
When meeting described trigger condition, obtain described human body movement data, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
24. according to claim 14 to the equipment according to any one of 23, and wherein, described acquisition device is used for:
Obtain the human body movement data of described user in the operation of described mouse that described cursor moving device records, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
25. according to claim 14 to the equipment according to any one of 24, and wherein, described acquisition device is used for:
According to the movable information of described cursor in the operation of described mouse, determine the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described cursor moving device at the wearing position of described user.
26. equipment according to claim 25, wherein, described acquisition device is used for:
According to the movable information of described cursor in the operation of described mouse, and the exercise data at the described wearing position of recording in conjunction with described cursor moving device, determine the human body movement data of described user in the operation of described mouse, wherein, described human body movement data corresponds to described wearing position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410225554.1A CN105224064A (en) | 2014-05-26 | 2014-05-26 | A kind of method and apparatus obtaining user's human body movement data in mouse action |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410225554.1A CN105224064A (en) | 2014-05-26 | 2014-05-26 | A kind of method and apparatus obtaining user's human body movement data in mouse action |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105224064A true CN105224064A (en) | 2016-01-06 |
Family
ID=54993091
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410225554.1A Pending CN105224064A (en) | 2014-05-26 | 2014-05-26 | A kind of method and apparatus obtaining user's human body movement data in mouse action |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105224064A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105807915A (en) * | 2016-02-24 | 2016-07-27 | 北京小鸟看看科技有限公司 | Control method and control device of virtual mouse, and head-mounted display equipment |
| CN108363527A (en) * | 2018-02-12 | 2018-08-03 | 四川斐讯信息技术有限公司 | A kind of cursor control method and cursor control system |
| CN108389372A (en) * | 2018-02-12 | 2018-08-10 | 四川斐讯信息技术有限公司 | A kind of neck health control method and system |
| CN108415562A (en) * | 2018-02-12 | 2018-08-17 | 四川斐讯信息技术有限公司 | A kind of cursor control method and cursor control system |
| CN108536285A (en) * | 2018-03-15 | 2018-09-14 | 中国地质大学（武汉） | A kind of mouse interaction method and system based on eye movement identification and control |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1826636A (en) * | 2003-11-18 | 2006-08-30 | 微软公司 | Adaptive computing environment |
| CN103180800A (en) * | 2010-09-20 | 2013-06-26 | 寇平公司 | Advanced remote control of host application using motion and voice commands |
| CN105343843A (en) * | 2015-12-08 | 2016-02-24 | 济南舜祥医药科技有限公司 | Traditional Chinese medicine for treating damp-abundance spleen trapped type somnolence disease |
-
2014
- 2014-05-26 CN CN201410225554.1A patent/CN105224064A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1826636A (en) * | 2003-11-18 | 2006-08-30 | 微软公司 | Adaptive computing environment |
| CN103180800A (en) * | 2010-09-20 | 2013-06-26 | 寇平公司 | Advanced remote control of host application using motion and voice commands |
| CN105343843A (en) * | 2015-12-08 | 2016-02-24 | 济南舜祥医药科技有限公司 | Traditional Chinese medicine for treating damp-abundance spleen trapped type somnolence disease |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105807915A (en) * | 2016-02-24 | 2016-07-27 | 北京小鸟看看科技有限公司 | Control method and control device of virtual mouse, and head-mounted display equipment |
| US10289214B2 (en) | 2016-02-24 | 2019-05-14 | Beijing Pico Technology Co., Ltd. | Method and device of controlling virtual mouse and head-mounted displaying device |
| CN108363527A (en) * | 2018-02-12 | 2018-08-03 | 四川斐讯信息技术有限公司 | A kind of cursor control method and cursor control system |
| CN108389372A (en) * | 2018-02-12 | 2018-08-10 | 四川斐讯信息技术有限公司 | A kind of neck health control method and system |
| CN108415562A (en) * | 2018-02-12 | 2018-08-17 | 四川斐讯信息技术有限公司 | A kind of cursor control method and cursor control system |
| CN108536285A (en) * | 2018-03-15 | 2018-09-14 | 中国地质大学（武汉） | A kind of mouse interaction method and system based on eye movement identification and control |
| CN108536285B (en) * | 2018-03-15 | 2021-05-14 | 中国地质大学（武汉） | Mouse interaction method and system based on eye movement recognition and control |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10735831B2 (en) | System and method communicating biofeedback to a user through a wearable device | |
| US11163361B2 (en) | Calibration techniques for handstate representation modeling using neuromuscular signals | |
| US10970936B2 (en) | Use of neuromuscular signals to provide enhanced interactions with physical objects in an augmented reality environment | |
| JP2022500729A (en) | Neuromuscular control of augmented reality system | |
| CN102056535B (en) | Method of obtaining a desired state in a subject | |
| US10905374B2 (en) | Method and wearable device for performing actions using body sensor array | |
| CN105224064A (en) | A kind of method and apparatus obtaining user's human body movement data in mouse action | |
| US10015579B2 (en) | Audio accelerometric feedback through bilateral ear worn device system and method | |
| US20130152002A1 (en) | Data collection and analysis for adaptive user interfaces | |
| CN104023802B (en) | Use the control of the electronic installation of neural analysis | |
| US20100045595A1 (en) | System and method for controlling a displayed presentation, such as a sexually explicit presentation | |
| CN111656304B (en) | Communication method and system | |
| CN108351701A (en) | Ancillary technique control system and correlation technique | |
| CN109074418B (en) | System and method for detecting movement of a user of an oral care device and providing feedback | |
| US20150355733A1 (en) | Input device and computer system with operating pattern analysis | |
| Hossain et al. | Recognition of human affection in smartphone perspective based on accelerometer and user's sitting position | |
| JP6244026B2 (en) | Input device, biosensor, program, computer-readable medium, and mode setting method | |
| EP4307206A1 (en) | Content recommendation system, content recommendation method, content library, method for generating content library, and target input user interface | |
| WO2018020513A1 (en) | A system for recognizing muscle activities and method thereof. | |
| JP2017010214A (en) | Behavior determination device and behavior determination method | |
| US20240069639A1 (en) | Systems and Methods for Customizing a Haptic Output of a Haptic Actuator of a User Device | |
| KR102048546B1 (en) | System and Method for rehabilitation training using Virtual reality device | |
| Lee et al. | Hand Gesture Segmentation Method using a Wrist-Worn Wearable Device | |
| US20230152896A1 (en) | Method and system for conveying digital texture information to a user | |
| GB2622063A (en) | System and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160106 |