The content of the invention
The present invention proposes a kind of mobile terminal and method that user's attitude detection is realized by operating system, solves user plane
The attitude incorrect problem for causing actual bodily harm during to display screen using mobile terminal device.
The present invention realizes the mobile terminal of user's attitude detection by operating system, comprising attitude sensing module 1, Yong Hupei
Put input module 2, alarm signal output module 3, operating system device 4, display screen 6, one or more application program moulds
Block 71,72 ..., 7N.
Attitude sensing module 1 produces attitude transducing signal S.The identifying user of user configuring input module 2 is operated, and user is referred to
I is made to be transferred to application program module described in operating system device 4 and at least one(Such as 71).Alarm signal output module
3 send the recognizable signal of user's sense organ.
Sensing module driver element 41, input module driver element 42, output module are included in operating system device 4
Driver element 43, the appearance that the control attitude of sensing module driver element 41 sensing module 1 works and exports attitude sensing module 1
State transducing signal S is converted to attitude data D;The control user configuring input module work of input module driver element 42, receives and uses
Family instructs I;The output signal O of output module driver element 43, comprising alert data A and/or attitude correction data R, control alarm
Signal output module 3 works.
Pose service module 40 is also included in operating system device 4, attitude detection is included in pose service module 40
Unit 46, the posture detecting unit 46 starts sensing module driver element 41, reads the output of sensing module driver element 41
Attitude data D, the position of identifying user face, produces attitude parameter G.
In operating system device 4 also include application database 44, the application database 44 storage operational data and
Default setting data.
Application programming interface is also included in operating system device 4(API)45.
Application program module described at least one(Such as 71)In comprising attitude comparing unit 47, attitude reminding unit 48,
Input and output processing unit 70.With corresponding threshold T be compared the attitude parameter G by attitude comparing unit 47;It is described
Attitude reminding unit 48 produces alert data A and/or attitude correction data R.The input and output processing unit 70, by described
Application programming interface 45 read or set operational data in application database 44, start input module driver element 42,
Start output module driver element 43.
In an embodiment of the present invention, transducing signal S further includes picture signal S1 and angle sensor signal S2.Attitude
Data D further includes user's attitude data D1 and the machine attitude data D2.Attitude parameter G further includes relative attitude parameter
G1 and absolute pose parameter G2.The corresponding threshold value of G1, G2 is respectively T1, T2.
Terminal user's attitude detecting method of the present invention, comprises the following steps:
Configuration input:The application program module of operating system device 4 and at least one(Such as 71)Receive to come from user
Configuration input module director data I;
Attitude detection:Posture detecting unit 46 starts sensing module driver element 41, and control attitude sensing module 1 is gathered and passed
Sense signal S1, S2, and be converted to attitude data D1, D2;Posture detecting unit 46 reads the output of sensing module driver element 41
Attitude data D1, D2, are analyzed to attitude data, draw relative attitude parameter G1 and/or absolute pose parameter G2;Attitude is examined
Survey unit 46 attitude parameter is stored in application database.
Attitude compares:Application program module(Such as 71)In input and output processing unit 70 connect by application programming
Mouth 45, reads attitude parameter and threshold value from application database 44;Application program module(Such as 71)In attitude it is more single
47 couples of attitude parameters G1, G2 of unit and threshold T 1, T2 are compared;
Attitude is reminded:When the attitude parameter exceedes threshold value, application program module(Such as 71)In attitude remind
Unit 48 generates alert data A and/or attitude correction data R;Application program module(Such as 71)In input and output treatment it is single
The application programming interface 45 that unit 70 is provided by operating system device 4, starts output module driver element 43, control
Alarm signal output module 3 sends the signal that user feels recognizable to client, comprising warning message and/or correction suggestion.
Above step is in the application program module of operating system device 4 and at least one(Such as 71)Cooperation under, lead to
Cross the course of work that data exchange completes the inventive method jointly.
With system and method for the invention, by carrying out effective prompting to user, usable family maintains one always
Compare correct attitude.This can allow the user will not to be damaged to body because of using these electronic equipments, therefore be beneficial to
User.On the other hand, correct attitude is also in fact least easily to make user's attitude tired out, therefore user can be with the long period
Using these equipment, so as to improve user to the equipment producer and the degree of sticking together of application program.
Specific embodiment
Below in conjunction with the accompanying drawings, specific embodiment is described as follows.
Device of the invention as shown in figure 1, realize the mobile terminal 5 of user's attitude detection by operating system, comprising appearance
State sensing module 1, user configuring input module 2, alarm signal output module 3, operating system device 4, display screen 6,
Individual or multiple application program modules 71,72 ..., 7N.
Attitude sensing module produces transducing signal S.The identifying user of user configuring input module 2 is operated, and user instruction I is passed
It is handed to application program module described in operating system device 4 and at least one(Such as 71).Alarm signal output module 3 sends
The recognizable signal of user's sense organ.
Sensing module driver element 41, input module driver element 42, output module are included in operating system device 4
Driver element 43, the appearance that the control attitude of sensing module driver element 41 sensing module 1 works and exports attitude sensing module 1
State transducing signal S is converted to attitude data D;The control user configuring input module work of input module driver element 42, receives and uses
Family instructs I;The output signal O of output module driver element 43, comprising alert data A and/or attitude correction data R, control alarm
Signal output module 3 works.
Pose service module 40 is also included in operating system device 4, attitude detection is included in pose service module 40
Unit 46, starts sensing module driver element 41, reads the attitude data D of the output of sensing module driver element 41, identifying user
The position of face, produces attitude parameter G.
In operating system device 4 also include application database 44, the application database 44 storage operational data and
Default setting data.
Application program module described at least one(Such as 71)In comprising attitude comparing unit 47, attitude reminding unit 48,
Input and output processing unit 70.With corresponding threshold T be compared the attitude parameter G by attitude comparing unit 47;It is described
Attitude reminding unit 48 produces alert data A and/or attitude correction data R.The input and output processing unit 70, by application
Data, startup input module driver element 42 in the reading application data storehouse 44 of Program Interfaces 45, startup output module drive
Moving cell 43.
Operating system device of the present invention, is the device for loading and running mobile terminal operating system, for example, add
Carry and operation Android, iOS, BlackBerry operating system and its alternative program.Application program module of the present invention 71,72 ...,
7N, is the device for loading and running application program, particularly load and run some users may for a long time continuously use should
With program, such as video player, web browser, ocr software.Application program module of the present invention, operating system
Each part such as module can be realized with the combination of cpu system, PLD and memory.
As the embodiment of further optimization of the invention, the shifting of user's attitude detection is realized shown in Fig. 1 by operating system
Dynamic terminal 5, also comprising following part:
Data scanning unit 49 is also included in pose service module 40, the data scanning unit inquires about the application data
Operational data in storehouse 44, according to the instruction of the operational data, when needing to start attitude detection process, triggers attitude detection
Unit 46.
The operational data of the storage of the application database 44, refers to the data changed in device of the invention work, bag
Include " Application Status table ", " attitude detection flag bit ", " applications registry " and the attitude parameter etc..
Application Status table, such as information comprising application program module working condition in terminal, the application program mould
Whether whether block runs, occupies display screen etc..
Attitude detection flag bit, refers to whether pose service module 40 is run in operating system device 4 mark.
Applications registry, includes certain mark of the necessary application program module title of detection or system distribution
Symbol.Application program module 71,72 ..., 7N can add the title or identifier of oneself by application programming interface 45
To in application database 44.
The default setting data of the storage of the application database 44, comprising one or more of:Attitude detection flag bit,
Applications registry, threshold value.These data can also manually be set, wherein attitude detection flag bit and application program
Registration table is also possible to be reset at work.
Used as the embodiment of further optimization of the invention, in scheme shown in Fig. 2~3, transducing signal S further includes image
Signal S1 and angle sensor signal S2.Attitude data D further includes user's attitude data D1 and the machine attitude data D2.Attitude
Parameter G further includes relative attitude parameter G1 and absolute pose parameter G2.The corresponding threshold value of G1, G2 is respectively T1, T2.
As shown in Fig. 2 being the one of the mobile terminal that the present invention realizes user's attitude detection by operating system device 4
Individual embodiment, attitude sensing module 1 uses camera scheme, comprising one or many front cameras 11, produces picture signal
S1.Webcam driver unit 411 is included in sensing module driver element 41.Posture detecting unit 46 reads webcam driver unit
The user attitude data D1 of 411 outputs, detection user's face and display screen 6(Fig. 4~5)Relative position, produce relative attitude
Parameter G1.Attitude comparing unit 47 is compared the attitude parameter G1 with corresponding threshold T 1 in application program module 71
Compared with.Attitude reminding unit 48 produces alert data A and/or attitude correction data R in application program module 71.
As shown in figure 3, being the another of the mobile terminal that the present invention realizes user's attitude detection by operating system device 4
One embodiment, the scheme that attitude sensing module 1 is combined using camera and the machine attitude transducer.Wherein, attitude sensing
Module 1 includes one or many front cameras 11, produces picture signal S1.Also being included in attitude sensing module can detect display
The machine attitude transducer 12 of planar inclination where screen(Such as gravity sensor, obliquity sensor is also called), produce angle sensor
Signal S2.Webcam driver unit 411 and the machine attitude transducer are included in sensing module driver element 41(Gravity sensor,
Obliquity sensor)Driver element 412.Posture detecting unit 46 reads user's attitude data of webcam driver unit output
D1, detection user's face and display screen 6(Fig. 4~5)Relative position, produce relative attitude parameter G1.Posture detecting unit 46
Read the machine attitude transducer driver element 412 and export the machine attitude data D2, determine the inclination angle of the place plane of the machine display screen 6
α.Posture detecting unit 46 produces absolute pose ginseng according to relative attitude parameter G1 and the inclination alpha of the place plane of the machine display screen 6
Number G2.Attitude comparing unit 47 carries out described attitude parameter G1, G2 with corresponding threshold T 1, T2 in application program module 71
Compare;Attitude reminding unit 48 produces alert data A and/or attitude correction data R in application program module 71.
" attitude parameter " being previously mentioned in above-mentioned each scheme, can be defined, definition illustrated below with various methods
With the method for analysis.Apparatus and method of the present invention does not limit the concrete mode of attitude parameter.
Such as a kind of attitude parameter is:Horizontal range L1 between user's face reference point and terminal display screen reference point,
Vertical range L2, the angle β between user's face medium line and display screen, the angle between user's face medium line and horizontal plane
γ.Wherein L1, L2, β reflect the relative position relation between user's face and terminal display screen, therefore are referred to as " relative attitude
Parameter(G1)", wherein γ reflects the user's face location parameter unrelated with terminal display screen, referred to as " absolute pose parameter
(G2)”.Parameter G1 can use user's attitude data D1 of webcam driver unit output to use monocular camera machine vision, binocular machine
The method of device vision or many mesh machine vision is obtained, and the inclination alpha of plane is obtained where G2 combinations G1 and the machine display screen.I.e.:G1=
[L1, L2, β], G2=γ=alpha+beta.
For example a kind of attitude parameter is again:The scope Af that is occupied in camera image data user's face contour line and
Facial medium line slip chart is as the degree d of medium line, the angle γ between user's face medium line and horizontal plane, it is also possible to build
Relative attitude parameter, i.e. G1=[Af, d, β].User's attitude data D1 that parameter G1 can be exported with webcam driver unit makes
Obtained with the method for analysis of image data.Absolute pose parameter can still use G2=γ=alpha+beta.
Corresponding threshold T refers to the threshold value that correct attitude is demarcated in G1, G2, and such as L1, L2, Af, α, β, γ are most
Big value or minimum value.According to the embodiment of foregoing attitude parameter, threshold T 1=[Min (L1), Max of relative attitude parameter
(L1), Min (L2), Max (L2), Min (β), Max (β)], or T1=[Min (Af), Max (Af), Max (d), Min (β), Max
(β)];The threshold T 2=[Min (α), Max (α), Min (γ), Max (γ)] of absolute pose parameter.So-called user's attitude is not just
Really, refer to the scope of the attitude parameter beyond threshold value of user.
Fig. 4 and Fig. 5 represent the placement scheme of camera and the machine attitude transducer in mobile terminal.Wherein, Fig. 4 is represented and taken the photograph
Substantially it is in flat board as first 11 position and function on the panel of terminal device 5, when the equipment of movable-type intelligent terminal 5 is used
Shape, there is one or more user oriented cameras 11.A user oriented display screen 6 is also comprised at least, user is existed
Equipment oriented is when reading or working towards in camera 11, the IMAQ space in camera 11.Fig. 5 represents that attitude is sensed
Position and function of the device 12 on terminal device 5.The hardware of the equipment includes at least one user oriented display screen 6 and one
The sensor 12 of planar inclination where display screen can be detected.The sensor 12 is arranged in terminal device, is had with display screen 6
Fixed position relationship.The data exported by the sensor, can obtain the inclination angle of the place plane of display screen 6 of terminal device
(α), i.e., the angle where the display screen of terminal device between plane and horizontal plane, as the machine attitude parameter.
In embodiment shown in Fig. 6, application program module 71 directly reads the attitude parameter in application database 44.Operation
Pose service module 40 in system operation device 4 only includes posture detecting unit 46;Attitude is included in application program module 71
Comparing unit 47, attitude reminding unit 48, input and output processing unit 70.Pose service module in operating system device 4
Attitude parameter is simultaneously stored in application database 44 by 40 automatic runnings, forms attitude parameter storehouse.It is input into application program module 71
Output processing unit 70 periodically reads these appearances by the application programming interface 45 that operating system device 4 is provided
State parameter.
Fig. 6(a)Represent the job step in operating system device:
501st step, attitude detection:Posture detecting unit 46 starts sensing module driver element 41, control attitude sensing mould
Block 1 gathers transducing signal S1, S2, and is converted to attitude data D1, D2;Posture detecting unit 46 reads sensing module driver element
Attitude data D1, D2 of output;Posture detecting unit 46 is analyzed to attitude data, draw relative attitude parameter G1 and/or
Absolute pose parameter G2;
502nd step, data storage:The attitude parameter that posture detecting unit 46 is produced is stored in application database 44.
503rd step, wait, turn the 501st step after time delay.
Fig. 6(b)Represent the job step in application program module:
504th step, application program module 71 perform the function of main program
505th step, digital independent:Input and output processing unit 70 is filled by operating system in application program module 71
Attitude parameter and threshold value data in the reading application data storehouse 44 of application programming interface 45 of 4 offers is provided;
506th step, attitude compare:Attitude comparing unit 47 in application program module 71 is by described attitude parameter G1, G2
It is compared with threshold T 1, T2, the 504th step is turned when attitude is normal, otherwise turns the 507th step;
507th step, attitude are reminded:Attitude reminding unit 48 in application program module 71 exceedes door in the attitude parameter
During limit value, generation alert data A and/or attitude correction data R;Input and output processing unit 70 passes through operating system device
4 application programming interfaces 45 for providing, start output module driver element 43, and control alarm signal output module 3 is to client
The signal that user feels recognizable is sent, comprising warning message and/or correction suggestion, after alarm output, turns the 504th step.
In embodiment shown in Fig. 7, application program module 71 is started and shutoff operation system using attitude detection flag bit
The result preserved in the posture detecting unit 46 of system running gear 4 and reading application data storehouse 44.Operating system device 4
In pose service module 40 include posture detecting unit 46, data scanning unit 49.Attitude comparing unit 47 and attitude are reminded
Unit 48 is then included in application program module 71.Input and output processing unit 70 in application program module 71 is by operating system
The application programming interface 45 that system running gear 4 is provided(API)To set " attitude detection flag bit ".Data scanning unit 49
The periodic queries flag bits, posture detecting unit 46 is run when the flag bit is set and attitude parameter is stored in into application
Database 44, forms attitude parameter storehouse.The application programming that application program module 71 is provided by operating system device
Interface 45 reads these attitude parameters, and decides whether to be reminded according to attitude parameter.
Fig. 7(a)It is the job step in operating system device:
601st step, data scanning unit 49 inquire about whether " the attitude detection flag bit " is set, and in this way, then turn the
602 steps, trigger posture detecting unit 46;Otherwise turn the 604th step;
602nd step, attitude detection:Posture detecting unit 46 starts sensing module driver element 41, control attitude sensing mould
Block 1 gathers transducing signal S1, S2, and is converted to attitude data D1, D2;Posture detecting unit 46 reads sensing module driver element
Attitude data D1, D2 of output;Posture detecting unit 46 is analyzed to attitude data, draw relative attitude parameter G1 and/or
Absolute pose parameter G2;
603rd step, data storage:The attitude parameter that posture detecting unit 46 is produced is stored in application database 44;
604th step, wait, turn the 601st step after time delay.
Fig. 7(b)It is the job step in application program module:
605th step, the input and output processing unit 70 of application program module 71 set by application programming interface 45 or
Remove " the attitude detection flag bit " in application database 44;
606th step, time delay are waited, or perform other functions;
607th step, digital independent:Input and output processing unit 70 is filled by operating system in application program module 71
Attitude parameter and threshold value data in the reading application data storehouse 44 of application programming interface 45 of 4 offers is provided;
608th step, attitude compare:Attitude comparing unit 47 in application program module 71 is by described attitude parameter G1, G2
It is compared with threshold T 1, T2, the 605th step is turned when attitude is normal, otherwise turns the 609th step;
609th step, attitude are reminded:Attitude reminding unit 48 in application program module 71 exceedes door in the attitude parameter
During limit value, generation alert data A and/or attitude correction data R;Input and output processing unit 70 passes through operating system device
4 application programming interfaces 45 for providing, start output module driver element 43, and control alarm signal output module is sent out to client
Go out the signal that user feels recognizable, comprising warning message and/or correction suggestion, after alarm output, turn the 605th step.
Fig. 8 is the protocol procedures figure that operating system device starts attitude detection according to Application Status table.Operation
Pose service module in system operation device 40 includes posture detecting unit 46, data scanning unit 49.Pose service module
40 with application program module 71,72 ..., 7N concurrent workings, the data scanning unit 49 in pose service module 40 is every one section
The application program module of time detecting currently operation, when monitoring user's attitude is necessary, starts posture detecting unit 46 and works.
Application program module described at least one(Such as 71)When occupying display screen, repaiied by application programming interface 45
Change " the Application Status table " in application database 44, write the title of the application program module(Or system distribution certain
Identifier).
User can set " applications registry " by user configuring input module 2, and these application programs occupy aobvious
Attitude detection and prompting are carried out during display screen.Some application program modules oneself actively can also change " applications registry ",
Oneself will be added in this list.
Fig. 8(a)It is the job step in operating system device:
701a is walked, is judged application program module(Such as 71)Whether display screen is taken:Data scanning unit 49 is from application
The application program module title for being currently in use display screen is obtained in " Application Status table " in database 44(Or system distribution
Certain identifier), in this way, then 701b steps, otherwise turn the 704th step;
Whether 701b steps, data scanning unit 49 check application program module 71 in " applications registry ", such as
It is then to turn the 702nd step, triggers posture detecting unit 46;Otherwise turn the 704th step;
702nd step, attitude detection:Posture detecting unit 46 starts sensing module driver element 41, control attitude sensing mould
Block 1 gathers transducing signal S1, S2, and is converted to attitude data D1, D2;Posture detecting unit 46 reads sensing module driver element
Attitude data D1, D2 of output;Posture detecting unit 46 is analyzed to attitude data, draw relative attitude parameter G1 and/or
Absolute pose parameter G2;
703rd step, data storage:The attitude parameter that posture detecting unit 46 is produced is stored in application database 44.
704th step, wait, turn 701a steps after time delay.
Fig. 8(b)It is the job step in application program module:
, when display screen is occupied, input and output processing unit 70 is compiled by application program for 705th step, application program module 71
" Application Status table " in the modification application database 44 of journey interface 45, writes the title or mark of the application program module
Symbol;
706th step, time delay are waited, or perform other functions of application program module;
707th step, digital independent:Input and output processing unit 70 is filled by operating system in application program module 71
Attitude parameter and threshold value data in the reading application data storehouse 44 of application programming interface 45 of 4 offers is provided;
708th step, attitude compare:Attitude comparing unit 47 in application program module 71 is by described attitude parameter G1, G2
It is compared with threshold T 1, T2, the 705th step is turned when attitude is normal, otherwise turns the 709th step;
709th step, attitude are reminded:Attitude reminding unit 48 in application program module 71 exceedes door in the attitude parameter
During limit value, generation alert data A and/or attitude correction data R;Input and output processing unit 70 passes through operating system device
4 application programming interfaces 45 for providing, start output module driver element 43, and control alarm signal output module is sent out to client
Go out the signal that user feels recognizable, comprising warning message and/or correction suggestion, after alarm output, turn the 705th step.
Each embodiment for more than, illustrates the user function plan of establishment.Operating system device 4 and at least one
Individual application program module(Such as 71)Receive to come from user configuring input module director data I.In input module driver element 42
Control under, identifying user configuration input module 2 input user instruction.Input module driver element both can be by operating system
Running gear 4 starts, it is also possible to by application program module(Such as 71)Middle input and output processing unit 70 is compiled by application program
Journey interface 45 starts.Director data at least includes with the middle one kind that gives an order:1. application program selection instruction, " applies for setting
Program registration table ".Only these application programs of front stage operation when the background service just carry out attitude detection.Some application programs
Can be oneself being actively added in this list.The function is allowed to be not enabled in some applications by setting.Such as foreground application
Program is answered, called, listening to the radio or during other audio contents, because now user will not for a long time pay close attention to display
Screen, it is now unnecessary to open this function.2. enabled instruction, for setting " attitude detection flag bit ".The mark is set by user
Will position directly initiates or forbids posture detection function.3. thresholding instruction, for setting attitude parameter threshold value.By setting thresholding
Value adapts to the demand of different user.When there is no user instruction, application number of the above-mentioned director data in operating system device 4
According to there are default setting data in storehouse 44.
Each embodiment for more than, illustrates alarm output scheme.The output module in operating system device 4
Under the control of driver element 43, the treatment alert data A of alarm signal output module 3 and attitude correction data R.Alert data refers to
Attitude parameter exceeds what is generated during threshold value, the feature such as the mode comprising alarm, the intensity of alarm, time length of alarm, this
A little data be deviateed according to user correct attitude degree and the time determine.Attitude correction data be according to attitude parameter and
How difference between threshold value, changed user's attitude to reach the data of correct attitude, including distance, angle and adjustment
The information such as direction.The signal of the output of alarm output module 3 is the recognizable signal of user's sense organ, using one or more of
Form:The prompt tone issued by audio-frequency module, the vibration issued by vibratory equipment, the figure be given by display screen
Or text prompt.