A kind of mobile terminal and method that realizes user's attitude detection by watchdog routine
Technical field
The present invention relates to terminal device, relate in particular to mobile terminal device and method of work that user's attitude is detected.
Background technology
The mobile terminal devices such as mobile phone, panel computer, e-book and notebook computer are very universal in modern's life.User generally with one hand or hand-held these equipment of both hands, allows the display screen of equipment facing to oneself when using these equipment, learns, the activity such as reading, amusement.Along with the appearance of a large amount of application programs, user uses the time of these equipment more and more longer every day.The user who for example has sees novel with mobile phone on subway, and be dozens of minutes general continuous service time; In panel computer or mobile phone screen, be often several hours at a glance.Open-minded along with 4G business, mobile Internet will provide more colourful content, and this can use the time of these terminal devices longer by let us.
Although use these equipment let us obtained very easily various information, at any time can amusement,, the incorrect using method of these equipment has also been brought to a lot of worries to user.A more typical situation is, after long-time hand-held these equipment of user, arm is tired out, and equipment is put lower and lower, and the edge of a field is also more and more lower naturally.If cervical vertebra in extremely anteflexion abnormal steady state (SS), will damage cervical vertebra for a long time, easily cause neck and shoulder part muscle rigidity, spasm, of long duration, just may cause the illnesss such as cervical curvature straightens, Cervical Disk Herniation.Also somebody like seeing the mobile phone in crowded places such as subways, panel computer or e-book, due to limited space, the distance of these equipment and eyes is very near.Also have some custom bed when having a rest to read.These incorrect attitudes have caused very large injury to user's eyes and cervical vertebra, and these injuries are much irreversible, need drug administration, physiatrics and even operation just can obtain the effective treatment.
Mobile terminal includes, but are not limited to the equipment such as mobile phone, panel computer, and great majority are dull and stereotyped form, and the hardware of this equipment forms generally the devices such as front-facing camera, display screen and processor and hardware adaptor.Equipment comprises one or more display screen, and wherein the display screen of front-facing camera and equipment is structurally positioned at the same geometrical plane of equipment.Mobile terminal generally comprises one or more processors, processor operating software operating system and program, and hardware and software triggers corresponding processing by signal interruption mechanism.User is when using such equipment, and the application of display screen, such as web page browing, game etc. are watched in general existence for a long time attentively.Due to aforesaid situation, mobile terminal or panel computer are easy to use attitude incorrect while using, and such as excessively near apart from human eye, head is too low etc.These incorrect attitudes have caused very large injury to user's eyes and cervical vertebra.But current mobile terminal not yet addresses this problem.
Summary of the invention
The present invention proposes a kind of mobile terminal and method that realizes user's attitude detection by watchdog routine, the incorrect problem that causes actual bodily harm of attitude while solving user in the face of display screen use mobile terminal device.
The present invention realizes the mobile terminal of user's attitude detection by watchdog routine, comprise attitude sensing module 1, user configures load module 2, alarm signal output module 3, one or more application program module 71,72 ..., 7N, slip condition database 8, monitoring program module 4.
Attitude sensing module 1 produces attitude data D; User configures load module 2 identification user operations, produces user instruction I; Alarm signal output module 3 sends the discernible signal of user's sense organ.
In described slip condition database 8, store application program module 71,72 ..., the status data producing in 7N work.
In described monitoring program module 4, comprise input and output processing unit 41, configure load module 2 with described attitude sensing module 1, user, alarm signal output module 3 is connected, and receives described attitude data D, user instruction I, produce output data O;
In described monitoring program module 4, comprise attitude processing unit 40, according to the position of attitude data D identification user face, produce attitude parameter G, described attitude parameter G is compared with corresponding threshold T, when user's attitude is incorrect, produce alert data A and/or attitude and correct data R.
In described monitoring program module 4, comprise status scan unit 42, periodically scanning mode database 8, according to the status data in slip condition database 8, start attitude processing unit 40.
Application program module 71,72 of the present invention ..., 7N, is the device that loads and run application, and particularly loads and move the application program that some users' possibility long-time continuous are used, as video player, web browser, ocr software etc.Monitoring program module 4 of the present invention is devices of loading and operation monitoring program.Each ingredients such as monitoring program module of the present invention, application program module can be realized with the combination of cpu system, Programmable Logic Device and storer.
In an embodiment of the present invention, transducing signal S further comprises picture signal S1 and angle sensor signal S2.Attitude data D further comprises user's attitude data D1 and the machine attitude data D2.Attitude parameter G further comprises relative attitude parameter G1 and absolute attitude parameter G2.The threshold value that G1, G2 are corresponding is respectively T1, T2.
Terminal user's attitude detecting method of the present invention, comprises following steps:
Configuration input: monitoring program module 4 accepts to configure from user the user instruction I of load module 2;
Application scan: the status scan unit 42 in monitoring program module 4, periodically scanning mode database 8, understand described application program module 71,72,, the duty of 7N, in described application program module 71,72,, when 7N takies display screen, start attitude processing unit 40.
Attitude detection: the input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1 and gathered user's attitude, receives attitude data D1, D2; Attitude processing unit 40 couples of attitude data D1, D2 analyze, and draw user's relative attitude parameter G1 and/or absolute attitude parameter G2;
Attitude comparison: the attitude processing unit 40 in monitoring program module 4 compares attitude parameter G1, G2 and corresponding threshold T 1, T2;
Attitude is reminded: the attitude processing unit 40 in monitoring program module 4 is (user's attitude is incorrect) when attitude parameter exceeds threshold value, generates alert data A and/or attitude and corrects data R; Input and output processing unit 41 output signal O in monitoring program module 4, triggering alarm signal output module 3 sends user to client and feels discernible signal, comprises warning message and/or corrects suggestion.
Above-mentioned steps circulation is carried out, and in order to reduce the frequency of detection, also comprises the step of time delay.
Use system and method for the present invention, by user is effectively reminded, can make user maintain a more correct attitude always.This can allow user can, because of using these electronic equipments to damage health, therefore not be of value to user.On the other hand, correct attitude is also the attitude that least easily makes user tired out in fact, so user can use these equipment the long period, thereby improves the degree of sticking together of user to device fabrication person and application program.
Accompanying drawing explanation
Fig. 1 realizes the mobile terminal of user's attitude detection by monitoring program module
Fig. 2 is that attitude sensing module is used camera scheme
Fig. 3 is that attitude sensing module is used camera and obliquity sensor scheme
Fig. 4 is that monitoring program module calls attitude processing unit scheme schematic diagram
Fig. 5 is the arrangement scheme schematic diagram of camera on terminal device panel
Fig. 6 is the arrangement scheme schematic diagram of the machine attitude sensor on terminal device
Fig. 7 realizes the method flow diagram of user's attitude detection by monitoring program module 4
Fig. 8 is the process flow diagram that monitoring program module 4 scanning mode databases 8 obtain application program instructions, carry out attitude processing
Fig. 9 is the process flow diagram that monitoring program module 4 scanning mode databases 8 obtain Application Status, carry out attitude processing
Below in conjunction with accompanying drawing, embodiment is described as follows.
The mobile terminal that the present invention realizes user's attitude detection by application program as shown in Figure 1, comprise attitude sensing module 1, user configures load module 2, alarm signal output module 3, application program module 71,72 ..., 7N, slip condition database 8, monitoring program module 4.
Attitude sensing module 1 produces attitude data D; User configures load module 2 identification user operations, produces user instruction I; Alarm signal output module 3 sends the discernible signal of user's sense organ.
Application program module 71,72 of the present invention ..., 7N, is the device that loads and run application, and particularly loads and move the application program that some users' possibility long-time continuous are used, as video player, web browser, ocr software etc.
In described slip condition database 8, store the status data of work.Described status data 8 comprises " applications registry ", " Application Status table ", " attitude processing zone bit ".
Application Status table, whether the information that comprises application program module duty in terminal, move, whether occupy display screen etc. such as this application program module.
Applications registry, includes and detects necessary application program module title or certain identifier of system assignment.Application program module 71,72 ..., 7N can add the title of oneself or identifier in slip condition database 8 to, represents to have registered attitude processing capacity.
Attitude is processed zone bit, refers to the sign whether attitude processing module 40 is moved.
In described monitoring program module 4, comprise input and output processing unit 41, configure load module 2 with described attitude sensing module 1, user, alarm signal output module 3 is connected, and receives described attitude data D, user instruction I, produce output data O.
In described monitoring program module 4, comprise attitude processing unit 40, according to the position of attitude data D identification user face, produce attitude parameter G, described attitude parameter G is compared with corresponding threshold T, when user's attitude is incorrect, produce alert data A and/or attitude and correct data R.
In described monitoring program module 4, comprise status scan unit 42, periodically scanning mode database 8, understand described application program module 71,72 ..., the duty of 7N, for example, when described at least one application program module (71) takies display screen, start attitude processing unit 40.
As shown in Figure 2, an embodiment of the present invention's mobile terminal of realizing user's attitude detection by watchdog routine, attitude sensing module 1 comprises camera and drive unit 11 thereof, and the picture signal by one or many front-facing camera generation user face, generates user's attitude data D1.Input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1, receive user's attitude data D1, attitude processing unit 40 detects the relative position of user's face and display screen, produce relative attitude parameter G1, described attitude parameter G1 is compared with corresponding threshold T 1, and user's attitude when incorrect, produces alert data A and/or attitude is corrected data R.
As shown in Figure 3, the present invention realizes the mobile terminal of user's attitude detection another embodiment by watchdog routine, attitude sensing module 1 comprises camera and drive unit 11 thereof, by one or many front-facing cameras generation picture signals, generates user's attitude data D1.In attitude sensing module 1, also comprise and can shield the machine attitude sensor (as gravity sensor, being called again obliquity sensor) and the drive unit 12 thereof at plane inclination angle, place by detection display, produce angle sensor signal, generate the machine attitude data D2.Input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1, receives attitude data D1, D2.Attitude processing unit 40 detects the relative position of user's face and display screen according to user's attitude data D1, produce relative attitude parameter G1; Attitude processing unit 40 is determined the inclination alpha of the machine display screen place plane according to the machine attitude data D2.Attitude processing unit 40, according to the inclination alpha of relative attitude parameter G1 and the machine display screen place plane, produces absolute attitude parameter G2.
Attitude processing unit 40 compares described attitude parameter G1, G2 with corresponding threshold T 1, T2; User's attitude when incorrect, produces alert data A and/or attitude is corrected data R.
Fig. 4, as another embodiment that realizes the mobile terminal of attitude detection by watchdog routine, is the scheme that monitoring program module 4 calls attitude processing unit 40.
Now, in mobile terminal 5, there is a processing unit storehouse 9, in described processing unit storehouse 9, comprise attitude processing unit 40 and other processing units (for example 91).Described attitude processing unit 40 detects user's attitude according to attitude data D, produce attitude parameter G, and described attitude parameter G is compared with corresponding threshold T, produces alert data A and/or attitude and correct data R when user's attitude is incorrect.In processing unit storehouse 9, also comprise an application programming interface (API) 90, make described attitude processing unit 40 and other processing units (for example 91) can receive enabling signal and data, and Output rusults.
In monitoring program module 4, comprise input and output processing unit 41, status scan unit 42, attitude processing call unit 43.Described input and output processing unit 41 configures load module 2 with described attitude sensing module 1, user, alarm signal output module 3 is connected, and receives described attitude data D, user instruction I, produces output data O.Described status scan unit 42, periodically scanning mode database 8, understand described application program module 71,72 ..., the duty of 7N, for example, when at least one (71) takies display screen in described application program module, start attitude and process call unit 43.Described attitude is processed call unit 43, can inquire about the position of attitude processing unit 40 in processing unit storehouse 9, send enabling signal and transmit attitude detection and more needed data (comprising attitude data D1, D2 and threshold T 1, T2), and return to alert data A and attitude is corrected data R.
With embodiment illustrated in fig. 4 corresponding, for example, adopt the scheme of setting up built-in function in Android operating system.In Android system running gear, the part of the attitude processing unit 40 of attitude detection, attitude comparison, attitude prompting function as a local library (Library) running gear will be realized, mode with built-in function running gear exists, and providing an API in application framework (Application Framework), this API can provide to other application program module active user's the whether correct judgement of attitude.Monitoring program module 4 completes by Using Call Library Function running gear the function that the present invention realizes.
For example in iOS operating system, set up built-in function again.In iOS system running gear, mode with built-in function running gear realizes attitude processing unit 40, comprise attitude detection, attitude comparison, attitude prompting function, a part as Media layer or kernel service layer, and an API is provided in CocoaTouch, this API can provide to monitoring program module 4 active user's the whether correct judgement of attitude.Monitoring program module 4 completes by Using Call Library Function running gear the function that the present invention realizes.
The scheme that also has built-in function in third party's developing instrument.Mode with built-in function running gear realizes attitude processing unit 40, comprises attitude detection, attitude comparison, attitude prompting function, and the device of User Exploitation can directly call the API relevant with this function library running gear like this.Monitoring program module 4 of the present invention completes by Using Call Library Function running gear the function that the present invention realizes.
" attitude parameter " mentioned in above-mentioned each scheme embodiment, can define by several different methods, the method that below illustrates definition and analyze.Apparatus and method of the present invention do not limit the concrete mode of attitude parameter.
For example attitude parameter is: horizontal range L1, a vertical range L2 between user's face reference point and terminal display screen reference point, the angle β between user's face medium line and display screen, the angle γ between user's face medium line and surface level.Wherein L1, L2, β have reflected the relative position relation between user's face and terminal display screen, are therefore called " relative attitude parameter G1 ", and wherein γ has reflected the location parameter that user is facial and terminal display screen is irrelevant, are called " definitely attitude parameter G2 ".That is: G1=[L1, L2, β], G2=γ=alpha+beta.Parameter G1 can use user's attitude data D1 of camera and drive unit 11 outputs thereof to use the method for monocular camera machine vision, binocular machine vision or many orders machine vision to obtain, and G2 obtains in conjunction with the inclination alpha of G1 and the machine display screen place plane.
For example a kind of attitude parameter is again: the scope Af occupying in camera image data user face contour line and facial medium line slip chart are as the degree d of medium line, angle γ between user's face medium line and surface level, also can build relative attitude parameter, i.e. G1=[Af, d, β].Parameter G1 can use user's attitude data D1 of camera and drive unit 11 outputs thereof to use the method for analysis of image data to obtain.Definitely attitude parameter still can adopt G2=γ=alpha+beta.
Corresponding threshold T refers to the threshold value of demarcating correct attitude in G1, G2, for example the maximal value of L1, L2, Af, α, β, γ or minimum value.According to the embodiment of aforementioned attitude parameter, the threshold T 1=[Min of relative attitude parameter (L1), Max (L1), Min (L2), Max (L2), Min (β), Max (β)], or T1=[Min (Af), Max (Af), Max (d), Min (β), Max (β)]; The threshold T 2=[Min (α) of absolute attitude parameter, Max (α), Min (γ), Max (γ)].So-called user's attitude is incorrect, refers to that user's attitude parameter exceeds the scope of threshold value.
Fig. 5 and Fig. 6 represent that camera 11 and the machine attitude sensor 12 are in the arrangement scheme of mobile terminal.Wherein, Fig. 5 represents position and the function of camera on terminal device panel, and a movable-type intelligent terminal device 5 is roughly tabular while using, and has one or more user oriented cameras 11.Also at least comprise a user oriented display screen 6, make user equipment oriented read or during work in camera 11, image acquisition space in camera.Fig. 6 represents position and the function of attitude sensor 12 on terminal device 5.The hardware of this equipment comprises at least one user oriented display screen 6 and a sensor 12 that can detect plane inclination angle, display screen place.This installation of sensors, in terminal device, has fixing position relationship with display screen 6.The data of exporting by this sensor, can obtain the inclination alpha of the display screen place plane of terminal device, i.e. the display screen place plane of terminal device and the angle between surface level, as the machine attitude parameter.
The method that realizes user's attitude detection by monitoring program module 4 as shown in Figure 7, comprises following steps:
The 101st step, configuration input: in monitoring program module 4, input and output processing unit 41 accepts to configure from user the user instruction I of load module 2;
The 102nd step, application scan: the status scan unit 42 in monitoring program module 4, periodically scanning mode database 8, according to the information of slip condition database 8, start attitude processing unit 40.
The 103rd step, attitude detection: the input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1 and gathered user's attitude, receives attitude data D1, D2; Attitude processing unit 40 couples of attitude data D1, D2 analyze, and draw user's relative attitude parameter G1 and/or absolute attitude parameter G2;
The 104th step, attitude comparison: the attitude processing unit 40 in monitoring program module 4 compares attitude parameter G1, G2 and corresponding threshold T 1, T2, turns the 2nd step when attitude is correct, otherwise the 5th step;
The 105th step, attitude are reminded: the attitude processing unit 40 in monitoring program module 4, when user's attitude is incorrect, generates alert data A and/or attitude and corrects data R; In monitoring program module 4, input and output processing unit 41 output signals (O) trigger alarm signal output module 3 and to client, send user and feel discernible signal, comprise warning message and/or correct suggestion, after alarm output, turn the 2nd step.
In said method, when the mode that circulation is carried out revert to the 2nd step from the 4th step, the 5th step, can comprise the step of a time delay.
Each embodiment is on the basis of above-mentioned method of work below, and the specific implementation to 2nd~4 steps in mobile terminal provides kinds of schemes.
Fig. 8 is the process flow diagram that monitoring program module 4 scanning mode databases 8 obtain application program instructions, carry out attitude processing.Attitude processing unit 40 is realized the function of attitude detection, attitude comparison, attitude prompting.Monitoring program module 4 and application program module 71,72,, 7N paired running, application program module 71,72,, in 7N any when taking display screen and be necessary user to carry out attitude detection (for example, for a long time in browse state time), in slip condition database 8, arrange " attitude processing zone bit ", be used for starting attitude processing unit 40, when the situation that application program module exits display screen or other does not need the attitude to detect occurs, remove this zone bit.
Fig. 8 (a) represents application program module 71,72 ..., a paragraph of the course of work of 7N, step is as follows:
The 201st step, any one application program module (for example 71) arrange or remove " the attitude processing zone bit " in application data base 8;
The function of tonic chord runs application for the 202nd step, application program module (for example 71);
Fig. 8 (b) represents the course of work of monitoring program module, and step is as follows:
The 203rd step, status scan unit 42 query State databases 8, confirm that attitude processing zone bit is set up? if yes then enter the 204th step, start attitude processing unit 40, otherwise turn the 207th step;
The 204th step, attitude detection: the input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1 and gathered user's attitude, receives attitude data D1, D2; Attitude processing unit 40 couples of attitude data D1, D2 analyze, and draw relative attitude parameter G1 and/or absolute attitude parameter G2;
The 205th step, attitude comparison: attitude processing unit 40 compares described attitude parameter G1, G2 and threshold T 1, T2, turn the 207th step when attitude is correct, otherwise enter the 206th step;
The 206th step, attitude are reminded: attitude processing unit 40 is T1, T2 when described attitude parameter G1, G2 surpass threshold value, generate alert data A and/or attitude and correct data R; Input and output processing unit 41 output signal O trigger warning information output module 3;
The 207th step, wait, turn the 203rd step after time delay.
Fig. 9 is the process flow diagram that monitoring program module 4 scanning mode databases 8 obtain Application Status, carry out attitude processing.Attitude processing unit 40 is realized attitude detection, attitude comparison, attitude prompting function.Application program module 71,72 ..., 7N, when occupying display screen, by the title of application program module or identifier write state database 8, forms Application Status table.Status scan unit 42 in monitoring program module 4 is in operation and obtains " applications registry ", determines the application program module of registration monitoring function; If this application program module that takies display screen in applications registry, triggers attitude processing unit at title or identifier.
Fig. 9 (a) represents application program module 71,72 ..., a paragraph of the course of work of 7N, step is as follows:
The 301st step, application program module (for example 71), when taking display screen, arrange or remove " the Application Status table " in application data base 44 by application programming interface;
The function of tonic chord runs application for the 302nd step, application program module (for example 71);
Fig. 9 (b) represents the course of work of monitoring program module, and step is as follows:
The 303rd step, status scan unit 42 query State databases, do you confirm to use the application program module title of display screen or identifier in " applications registry "? if yes then enter the 304th step, start attitude processing unit 40, otherwise turn the 307th step;
The 304th step, attitude detection: the input and output processing unit 41 in monitoring program module 4 is controlled attitude sensing module 1 and gathered user's attitude, receives attitude data D1, D2; Attitude processing unit 40 couples of attitude data D1, D2 analyze, and draw relative attitude parameter G1 and/or absolute attitude parameter G2;
The 305th step, attitude comparison: attitude processing unit 40 compares described attitude parameter G1, G2 and threshold T 1, T2, turn the 307th step when attitude is correct, otherwise enter the 306th step;
The 306th step, attitude are reminded: attitude processing unit 40 is T1, T2 when described attitude parameter G1, G2 surpass threshold value, generate alert data A and/or attitude and correct data R; Input and output processing unit 41 output signal O trigger warning information output module 3;
The 307th step, wait, turn the 303rd step after time delay.
For above-mentioned each embodiment, illustrate the user function plan of establishment.Input and output processing unit 41 in monitoring program module 4 receives the user instruction that configures load module 2 from user.Director data is a kind of at least comprising giving an order: 1. application program selection instruction, user arranges " applications registry ".While only having these application programs of front stage operation, this background service just carries out attitude detection.Some application program module also can own initiatively join in this list.By setting, allow this function not be activated in some applications.If foreground application is to answer, call, listen to the radio or during other audio content, because user now can not pay close attention to display screen for a long time, unnecessary this function of unlatching now.2. thresholding instruction, user arranges attitude parameter threshold value.The demand that adapts to different user by threshold value is set.When there is no user instruction, above-mentioned setting can be also to have default setting in attitude processing unit 40 or attitude processing call unit 43, configures load module 2 manually arrange or revise by user.
For above-mentioned each embodiment, illustrate alarm output scheme.Alarm signal output module 3, processes alert data A and attitude and corrects data R.These data are included in the input and output processing unit 41 output signal O of monitoring program module 4.Alert data refers to and generates when attitude parameter exceeds threshold value, the features such as time length of the mode that comprises warning, the intensity of warning, warning, and these data are to determine degree and the time of according to user, departing from correct attitude.It is poor according between attitude parameter and threshold value that attitude is corrected data, obtains how changing user's attitude to reach the data of correct attitude, comprises distance, angle and the information such as direction of adjusting.The signal of alarm output module output is the discernible signal of user's sense organ, comprises following one or more types: the prompt tone sending by audio-frequency module, the vibration sending by vibratory equipment, the figure providing by display screen or text prompt.