Summary of the invention
The present invention proposes a kind of mobile terminal and method that realizes user's attitude detection by operating system, the incorrect problem that causes actual bodily harm of attitude while solving user in the face of display screen use mobile terminal device.
The present invention realizes the mobile terminal of user's attitude detection by operating system, comprise attitude sensing module 1, user configures load module 2, alarm signal output module 3, operating system device 4, display screen 6, one or more application program module 71,72 ..., 7N.
Attitude sensing module 1 produces attitude transducing signal S.User configures load module 2 and identifies user's operation, and user instruction I is passed to operating system device 4.Alarm signal output module 3 sends the discernible signal of user's sense organ.
In operating system device 4, comprise sensing module driver element 41, load module driver element 42, output module driver element 43, sensing module driver element 41 is controlled the attitude transducing signal S that attitude sensing module 1 is worked and attitude sensing module 1 is exported and is converted to attitude data D; Load module driver element 42 is controlled user and is configured load module work, receives user instruction I; Output module driver element 43 output signal O, comprise alert data A and/or attitude and correct data R, control alarm signal output module 3 and work.
In operating system device 4, also comprise attitude service module 40, in attitude service module 40, comprise attitude detection unit 46, described attitude detection unit 46 starts sensing module driver element 41, read the attitude data D that sensing module driver element 41 is exported, the position of identification user face, produces attitude parameter G.In described attitude service module 40, also comprise attitude comparing unit 47, attitude comparing unit 47 compares described attitude parameter G with corresponding threshold value; In described attitude service module 40, also comprise attitude reminding unit 48, attitude reminding unit 48 produces alert data A and/or attitude is corrected data R.
In operating system device 4, also comprise application data base 44, described application data base 44 is stored operational data and default setting data.
In an embodiment of the present invention, transducing signal S further comprises picture signal S1 and angle sensor signal S2.Attitude data D further comprises user's attitude data D1 and the machine attitude data D2.Attitude parameter G further comprises relative attitude parameter G1 and absolute attitude parameter G2.The threshold value that G1, G2 are corresponding is respectively T1, T2.
Terminal user's attitude detecting method of the present invention, comprises following steps:
Configuration input: operating system device 4 is accepted to configure load module director data I from user;
Attitude detection: attitude detection unit 46 starts sensing module driver element 41 and controls attitude sensing module 1, gathers transducing signal S1, S2, and is converted to attitude data D1, D2; Attitude detection unit 46 reads attitude data D1, the D2 that sensing module driver element 41 is exported, and attitude data is analyzed, and draws relative attitude parameter G1 and/or absolute attitude parameter G2;
Attitude comparison: attitude comparing unit 47 compares attitude parameter G1, G2 and user's attitude threshold T 1, T2;
Attitude is reminded: in the time that described attitude parameter exceedes threshold value, attitude reminding unit 48 generates alert data A and/or attitude is corrected data R; Control alarm signal output module 3 through output module driver element 43 and send user to client and feel discernible signal, comprise warning message and/or correct suggestion.
Above step all completes under the unit control in operating system device 4.
Use system and method for the present invention, by user is effectively reminded, can make user maintain a more correct attitude always.This can allow user can, because of using these electronic equipments to damage health, therefore not be of value to user.On the other hand, correct attitude is also the attitude that least easily makes user tired out in fact, and therefore user can use these equipment the long period, thereby improves the degree of sticking together of user to device fabrication person and application program.
Embodiment
Below in conjunction with accompanying drawing, embodiment is described as follows.
Device of the present invention as shown in Figure 1, realize the mobile terminal 5 of user's attitude detection by operating system, comprise attitude sensing module 1, user configures load module 2, alarm signal output module 3, operating system device 4, display screen 6, one or more application program module 71,72,, 7N.
Attitude sensing module produces transducing signal S.User configures load module 2 and identifies user's operation, and user instruction I is passed to operating system device 4.Alarm signal output module 3 sends the discernible signal of user's sense organ.
In operating system device 4, comprise sensing module driver element 41, load module driver element 42, output module driver element 43, sensing module driver element 41 is controlled the attitude transducing signal S that attitude sensing module 1 is worked and attitude sensing module 1 is exported and is converted to attitude data D; Load module driver element 42 is controlled user and is configured load module work, receives user instruction I; Output module driver element 43 output signal O, comprise alert data A and/or attitude and correct data R, control alarm signal output module 3 and work.
In operating system device 4, also comprise attitude service module 40, in attitude service module 40, comprise attitude detection unit 46, start sensing module driver element 41, read the attitude data D that sensing module driver element 41 is exported, the position of identification user face, produces attitude parameter G.In described attitude service module 40, also comprise attitude comparing unit 47, described attitude parameter G is compared with corresponding threshold T; In described attitude service module 40, also comprise attitude reminding unit 48, in the time that user's attitude is incorrect, produce alert data A and/or attitude and correct data R.
In operating system device 4, also comprise application data base 44, described application data base 44 is stored operational data and default setting data.
Operating system device of the present invention, is the device that loads and move mobile terminal operating system, for example, load and move Android, iOS, blackberry, blueberry operating system and alternative program thereof.Application program module 71,72 of the present invention ..., 7N, is the device that loads and run application, and particularly loads and move the application program that some users' possibility long-time continuous are used, as video player, web browser, ocr software etc.Each ingredients such as application program module of the present invention, operating system module can be realized with the combination of cpu system, Programmable Logic Device and storer.
As the further embodiment of optimization of the present invention, shown in Fig. 1, realize the mobile terminal 5 of user's attitude detection by operating system, also comprise following part:
In operating system device 4, also comprise application programming interface (API) 45, described application program module 71,72 ..., 7N calls described application data base 44 by described application programming interface 45, and data are wherein arranged or removed.
In attitude service module 40, also comprise data scanning unit 49, the operational data in described application data base is inquired about in described data scanning unit, according to the instruction of described operational data, in the time that needs start attitude detection process, triggers attitude detection unit 46.
The operational data that described application data base 44 is stored, refers to the data that change in device work of the present invention, comprises " Application Status table ", " attitude detection zone bit ", " applications registry " and described attitude parameter etc.
Application Status table, the information that comprises application program module duty in terminal, display screen etc. is moved, whether occupied to for example this application program module whether.
Attitude detection zone bit, refers to the mark that in operating system device 4, whether attitude service module 40 moves.
Applications registry, includes and detects necessary application program module title or certain identifier of system assignment.Application program module 71,72 ..., 7N can add the title of oneself or identifier in application data base 44 to by application programming interface 45.
The default setting data that described application data base 44 is stored, comprise following one or more: attitude detection zone bit, applications registry, threshold value.These data also can be by manually arranging, and wherein attitude detection zone bit and applications registry also may be reset at work.
The embodiment further optimizing as the present invention, shown in Fig. 2~3, in scheme, transducing signal S further comprises picture signal S1 and angle sensor signal S2.Attitude data D further comprises user's attitude data D1 and the machine attitude data D2.Attitude parameter G further comprises relative attitude parameter G1 and absolute attitude parameter G2.The threshold value that G1, G2 are corresponding is respectively T1, T2.
As shown in Figure 2, be an embodiment of the present invention's mobile terminal of realizing user's attitude detection by operating system device 4, attitude sensing module 1 uses camera scheme, comprises one or many front-facing cameras 11, produces picture signal S1.In sensing module driver element 41, comprise webcam driver unit 411.Attitude detection unit 46 reads the user's attitude data D1 exporting webcam driver unit 411, detects user face and display screen 6(Fig. 4~5) relative position, produce relative attitude parameter G1.In attitude service module 40, also comprise attitude comparing unit 47, described attitude parameter G1 is compared with corresponding threshold T 1.In attitude service module 40, also comprise attitude reminding unit 48, produce alert data A and/or attitude and correct data R.
As shown in Figure 3, be the present invention realizes the mobile terminal of user's attitude detection another embodiment by operating system device 4, the scheme that attitude sensing module 1 uses camera and the machine attitude sensor to combine.Wherein, attitude sensing module 1 comprises one or many front-facing cameras 11, produces picture signal S1.In attitude sensing module, also comprise the machine attitude sensor 12(at energy detection display screen plane inclination angle, place as gravity sensor, be called again obliquity sensor), produce angle sensor signal S2.In sensing module driver element 41, comprise the driver element 412 of webcam driver unit 411 and the machine attitude sensor (gravity sensor, obliquity sensor).Attitude detection unit 46 reads user's attitude data D1 of webcam driver unit output, detects user's face and display screen 6(Fig. 4~5) relative position, produce relative attitude parameter G1.Attitude detection unit 46 reads the machine attitude sensor driver element 412 and exports the machine attitude data D2, determines the inclination alpha of the machine display screen 6 place planes.Attitude detection unit 46, according to the inclination alpha of relative attitude parameter G1 and the machine display screen 6 place planes, produces absolute attitude parameter G2.In attitude service module 40, also comprise attitude comparing unit 47, described attitude parameter G1, G2 are compared with corresponding threshold T 1, T2; In attitude service module 40, also comprise attitude reminding unit 48, produce alert data A and/or attitude and correct data R.
" attitude parameter " mentioned in above-mentioned each scheme, can define by several different methods, the method that below illustrates definition and analyze.Apparatus and method of the present invention do not limit the concrete mode of attitude parameter.
For example attitude parameter is: horizontal range L1, a vertical range L2 between user's face reference point and terminal display screen reference point, the angle β between user's face medium line and display screen, the angle γ between user's face medium line and surface level.Wherein L1, L2, β have reflected the relative position relation between user's face and terminal display screen, therefore be called " relative attitude parameter (G1) ", wherein γ has reflected the location parameter that user is facial and terminal display screen is irrelevant, is called " definitely attitude parameter (G2) ".Parameter G1 can use user's attitude data D1 of webcam driver unit output to use the method for monocular camera machine vision, binocular machine vision or many orders machine vision to obtain, and G2 obtains in conjunction with the inclination alpha of G1 and the machine display screen place plane.That is: G1=[L1, L2, β], G2=γ=alpha+beta.
For example a kind of attitude parameter is again: the scope Af occupying in camera image data user face contour line and facial medium line slip chart are as the degree d of medium line, angle γ between user's face medium line and surface level, also can build relative attitude parameter, i.e. G1=[Af, d, β].Parameter G1 can use user's attitude data D1 of webcam driver unit output to use the method for analysis of image data to obtain.Definitely attitude parameter still can adopt G2=γ=alpha+beta.
Corresponding threshold T refers to the threshold value of demarcating correct attitude in G1, G2, for example maximal value of L1, L2, Af, α, β, γ or minimum value.According to the embodiment of aforementioned attitude parameter, the threshold T 1=[Min (L1) of relative attitude parameter, Max (L1), Min (L2), Max (L2), Min (β), Max (β)], or T1=[Min (Af), Max (Af), Max (d), Min (β), Max (β)]; The definitely threshold T 2=[Min (α) of attitude parameter, Max (α), Min (γ), Max (γ)].So-called user's attitude is incorrect, refers to that user's attitude parameter exceeds the scope of threshold value.
Fig. 4 and Fig. 5 represent camera and the machine attitude sensor arrangement scheme at mobile terminal.Wherein, Fig. 4 represents position and the function of camera 11 on the panel of terminal device 5, and movable-type intelligent terminal 5 equipment are roughly tabular while use, have one or more user oriented cameras 11.Also at least comprise a user oriented display screen 6, make user equipment oriented read or when work in camera 11, image acquisition space in camera 11.Fig. 5 represents position and the function of attitude sensor 12 on terminal device 5.The hardware of this equipment comprises at least one user oriented display screen 6 and one and can detect the sensor 12 at plane inclination angle, display screen place.This sensor 12 is arranged in terminal device, has fixing position relationship with display screen 6.The data of exporting by this sensor, can obtain the inclination angle (α) of the display screen place plane of terminal device, i.e. angle between display screen place plane and the surface level of terminal device, as the machine attitude parameter.
Fig. 6 is the operating system device 4 scheme process flow diagram that operation attitude detection, attitude comparison and attitude are reminded automatically.Attitude service module 40 in operating system device 4 comprises attitude detection unit 46, attitude comparing unit 47, attitude reminding unit 48.Attitude service module 40 and application program module 71,72 ..., prompting is sent in 7N concurrent working in the time finding that user's attitude is incorrect.Job step is as follows:
The 202nd step, attitude detection: attitude detection unit 46 starts sensing module driver element 41, control attitude sensing module 1, gathers transducing signal S1, S2, and be converted to attitude data D1, D2; Attitude service module 40 reads attitude data D1, the D2 that sensing module driver element 41 is exported; Attitude detection unit 46 in attitude service module 40 is analyzed attitude data, draws relative attitude parameter G1 and/or absolute attitude parameter G2;
The 203rd step, attitude comparison: the attitude comparing unit 47 in attitude service module 40 compares described attitude parameter G1, G2 and user's attitude threshold T 1, T2, turns the 205th step when attitude is normal, otherwise turn the 204th step;
The 204th step, attitude are reminded: the attitude in attitude service module 40 reminds Unit 48 in the time that described attitude parameter exceedes threshold value, generate alert data A and/or attitude and correct data R; Alarm signal output module 48 sends user to client and feels discernible signal, comprises warning message and/or corrects suggestion, after alarm output, turns the 205th step.
The 205th step, wait, turn the 202nd step after time delay.
Shown in Fig. 6, in embodiment of the method, between attitude detection service routine and application program module, there is not exchanges data.For example, in Android or iOS system, can comprise an attitude service module.Posture is measured as a system background service, and the system service that it calls other, obtains the output of front-facing camera, and posture is measured, and in the time of fault, this background service switches to foreground, and user is pointed out.
Fig. 7 is that operating system device is by the scheme process flow diagram that need to move attitude detection, attitude comparison and attitude prompting of application program module.Attitude service module in operating system device 40 comprises attitude detection unit 46, attitude comparing unit 47, attitude reminding unit 48, data scanning unit 49.Attitude service module 40 and application program module 71,72 ... 7N concurrent working, data scanning unit 49 in attitude service module 40 detects the application program module of current operation at set intervals, in the time being necessary monitor user ' attitude, starting attitude detection unit 46 and works.
Application program module 71,72 ..., when 7N occupies display screen, revise " the Application Status table " in application data base 44 by application programming interface 45, write the title (or certain identifier of system assignment) of this application program module.
User can configure load module 2 by user " applications registry " is set, and carries out attitude detection and prompting when these application programs occupy display screen.Some application program module also can ownly initiatively be revised " applications registry ", will oneself join in this list.
The step that data scanning, attitude detection, attitude comparison and attitude are reminded is as follows:
In 302a step, " the Application Status table " of data scanning unit 49 from application data base 44, acquisition is being used the application program module title (or certain identifier of system assignment) of display screen;
302b step, data scanning unit 49 check that these application program modules whether in " applications registry ", in this way, turn the 303rd step, trigger attitude detection unit 46; Otherwise turn 302c step;
302c step, time delay proceed to 302a step after waiting for;
The 303rd step, attitude detection: attitude detection unit 46 starts sensing module driver element 41, control attitude sensing module 1 and gather transducing signal S1, S2, and be converted to attitude data D1, D2; Attitude detection unit 46 reads attitude data D1, the D2 of sensing module driver element output; Attitude detection unit 46 is analyzed attitude data, draws relative attitude parameter G1 and/or absolute attitude parameter G2;
The 304th step, attitude comparison: the attitude comparing unit 47 in attitude service module 40 compares described attitude parameter G1, G2 and user's attitude threshold T 1, T2, turns the 306th step when attitude is normal, otherwise turn the 305th step;
The 305th step, attitude are reminded: the attitude reminding unit 48 in attitude service module 40, in the time that described attitude parameter exceedes threshold value, generates alert data A and/or attitude and corrects data R; Alarm signal output module 43 sends user to client and feels discernible signal, and comprise warning message and/or correct suggestion, after alarm output,
The 306th step, wait, turn 302a step after time delay.
Fig. 8 is the scheme process flow diagram of attitude service module in the startup of application program module service marking position and shutoff operation system running gear.Attitude service module 40 in operating system device 4 comprises attitude detection unit 46, attitude comparing unit 47, attitude reminding unit 48, data scanning unit 49.Attitude service module 40 and application program module 71,72 ..., 7N concurrent working.The application programming interface 45 that operating system device 4 provides is for arranging or remove " attitude detection zone bit ".Application program module, in the time taking display screen and be necessary user to carry out attitude detection, is called this application programming interface, and this zone bit is set, thereby has activated posture detection function.When application program module exits or other does not need situation that attitude is monitored to occur, remove this zone bit.In the time having multiple application program module operation, each application program module can arrange this zone bit, as long as arranged all in the application program module of this zone bit and have not remove this zone bit, attitude detection and prompting function are activated so.
Fig. 8 (a) represents application program module 71,72 ..., the course of work of 7N, step is as follows:
The 400th step, application program module are arranged or are removed " the attitude detection zone bit " in application data base 44 by application programming interface;
The 401st step, the application program module function of tonic chord that runs application, after proceed to again the 400th step;
Fig. 8 (b) represents the course of work of attitude service module 40, and step is as follows:
Whether the 402nd step, 49 inquiries described " attitude detection zone bit " of data scanning unit are set up, and in this way, turn the 403rd step, trigger attitude detection unit 46; Otherwise turn the 406th step;
The 403rd step, attitude detection: attitude detection unit 46 starts sensing module driver element 41, control attitude sensing module 1, gathers transducing signal S1, S2, and be converted to attitude data D1, D2; Attitude detection unit 46 reads attitude data D1, the D2 of sensing module driver element output; Attitude detection unit 46 is analyzed attitude data, draws relative attitude parameter G1 and/or absolute attitude parameter G2;
The 404th step, attitude comparison: the attitude comparing unit 47 in attitude service module 40 compares described attitude parameter G1, G2 and user's attitude threshold T 1, T2, turns the 406th step when attitude is normal, otherwise turn the 405th step;
The 405th step, attitude are reminded: the attitude reminding unit 48 in attitude service module 40, in the time that described attitude parameter exceedes threshold value, generates alert data A and/or attitude and corrects data R; Alarm signal output module 43 sends user to client and feels discernible signal, comprises warning message and/or corrects suggestion, after alarm output, turns the 406th step;
The 406th step, wait, proceed to the 402nd step after time delay.
For above each embodiment, illustrate the user function plan of establishment.In operating system device 4, under the control of load module driver element 42, identification user configures the user instruction that load module 2 is inputted.Director data at least comprises the middle one that gives an order: 1. application program selection instruction, and for " applications registry " is set.While only having these application programs of front stage operation, this background service just carries out attitude detection.Some application program also can own initiatively join in this list.Allow this function not be activated in some applications by setting.If foreground application is to answer, call, listen to the radio or when other audio content, because user now can not pay close attention to display screen, now unnecessary this function of unlatching for a long time.2. enabled instruction, for arranging " attitude detection zone bit ".By user, this zone bit being set directly starts or forbids posture detection function.3. thresholding instruction, for arranging attitude parameter threshold value.By being set, threshold value adapts to the demand of different user.In the time there is no user instruction, there are default setting data in above-mentioned director data in the application data base 44 of operating system device 4.
For above each embodiment, illustrate alarm output scheme.In operating system device 4, under the control of output module driver element 43, alert data A processed by alarm signal output module 3 and attitude is corrected data R.Alert data refers to and generates when attitude parameter exceeds threshold value, the features such as the time length of the mode that comprises warning, the intensity of warning, warning, and these data are to determine degree and the time of departing from correct attitude according to user.It is poor according between attitude parameter and threshold value that attitude is corrected data, how to be changed user's attitude to reach the data of correct attitude, comprises distance, angle and the information such as the direction adjusted.The signal that alarm output module 3 is exported is the discernible signal of user's sense organ, adopts following one or more forms: the prompt tone sending by audio-frequency module, the vibration sending by vibratory equipment, the figure providing by display screen or text prompt.