CN104965593B - The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives - Google Patents
The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives Download PDFInfo
- Publication number
- CN104965593B CN104965593B CN201510410823.6A CN201510410823A CN104965593B CN 104965593 B CN104965593 B CN 104965593B CN 201510410823 A CN201510410823 A CN 201510410823A CN 104965593 B CN104965593 B CN 104965593B
- Authority
- CN
- China
- Prior art keywords
- action
- behavior
- arm
- data
- mobile phone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
- Manipulator (AREA)
Abstract
The taking photograph of intelligent mobile phone energy conserving system and method for work perceived the invention discloses a kind of Behavior-based control.The system includes behavior sensing module and energy-saving module of taking pictures.Wherein, behavior sensing module perceives the action of trunk during user takes pictures, arm and wrist and behavior based on linear accelerometer, gyroscope and gravity sensor, including it is static, walk, run, upper lift arm, decentralization arm, rotating mobile, finely tuning and take pictures；Energy-saving module of taking pictures can set corresponding Energy Saving Strategy, including blank screen, regulation screen intensity, adjustment frame rate, closing software, closure sensor according to specific user behavior.The taking photograph of intelligent mobile phone energy conserving system Behavior-based control sensing module completes the perception of the behavior of taking pictures to user, and specific mobile phone Energy Saving Strategy is formulated based on energy-saving module of taking pictures, the overall energy consumption of mobile phone is greatly reduced on the basis of experience not significantly reducing user and taking pictures.
Description
Technical field
The present invention relates to a kind of taking photograph of intelligent mobile phone energy conserving system and method, especially a kind of intelligence of Behavior-based control perception
Mobile phone photograph energy conserving system and method for work.
Background technology
With the development of smart mobile phone, increasing user tends to be taken pictures using smart mobile phone.However, intelligence
The problem of presence one of shooting mobile phone is very serious, i.e. energy consumption problem.The process taken pictures using smart mobile phone is to consume very much
Can.At the same time, the built-in sensors on smart mobile phone are also increasingly abundanter, and the energy consumption of operative sensor is very low, profit
The behavior act of user can be perceived with the sensor of these low energy consumption.
During taking pictures, most of energy consumption is wasted in the set-up procedure taken pictures, or continuously take pictures twice
In interval, therefore, reducing the energy consumption in set-up procedure of taking pictures just can reduce overall energy consumption.Based on being moved to the middle user that takes pictures
The observation of work, using built-in sensors, user action is perceived, and different Energy Saving Strategies is carried out for different actions, so as to reach
To the overall energy consumption of mobile phone is greatly reduced on the basis of experience not significantly reducing user and take pictures.
The content of the invention
For above-mentioned technical problem, it is an object of the invention to provide the taking photograph of intelligent mobile phone section that a kind of Behavior-based control perceives
The data of user's current state are recorded by energy system and method for work by the built-in sensors of the low-power consumption of smart mobile phone
Record；Analyzing and processing is carried out to sensing data by recognizer and obtains user's current behavior；Implemented based on user's current behavior
Different energy-saving schemes, the final purpose for realizing intelligent energy-conservation of taking pictures.
To reach above-mentioned purpose, the invention provides the taking photograph of intelligent mobile phone energy conserving system that a kind of Behavior-based control perceives, institute
Stating smart mobile phone includes that the movable sensor of posture and light sensor, screen and the camera of sensing light can be perceived, and this is
System also includes behavior sensing module and energy-saving module of taking pictures, and behavior sensing module includes being used to receive movable sensor and light passes
The data acquisition submodule of sensor data, for the data sectional submodule being segmented to the data of acquisition；And to segmentation after
Data Activity recognition state machine；Energy-saving module is connected with the state machine of Activity recognition module, and energy-saving module is according to state machine
The behavior state information of offer is controlled to smart mobile phone screen intensity and camera.
The movable sensor includes linear accelerometer, gyroscope, gravity sensor.
A kind of method of work of the taking photograph of intelligent mobile phone energy conserving system perceived present invention also offers Behavior-based control, including with
Lower step：
1）User behavior data is obtained using the movable sensor built in smart mobile phone and light sensor and is transmitted to row
For sensing module；
2）Behavior sensing module is segmented to the user behavior data of input first；
3）The action that user takes pictures is preset in behavior sensing module to be abstracted as 8 kinds of actions and according to the characteristics of action be divided into
Three levels：Body work：Including static, on foot and run；Arm action：Including upper lift arm and decentralization arm；Wrist is moved
Make：Including rotating mobile, finely tune and take pictures；The behavioral data of user after segmentation is identified according to above-mentioned action division,
The current behavior state of user is judged according to the level of the action of user；And return to energy-saving module；
4）Energy-saving module based on the current behavior state of user, smart mobile phone screen intensity and camera are controlled with
Implement different conservation measures.
Step 2）Middle fragmentation procedure is：User has of short duration pause between two actions are done, and is carried out using the pause
Data sectional；Data sectional comprises the following steps：
A. the variance of three number of axle evidences of linear acceleration sensor is calculated using sliding window, when the variance of three axles in window is equal
During less than a threshold value, then it is assumed that the window is the beginning or end of behavioral data block；
B. when continuous two windows, which meet, to be required in A, increase carries out sliding window using the data of the axle of gyroscope three
Variance calculate；Continue to calculate if the threshold value of continuous two windows reaches requirement, the window that threshold value is higher than until having produces；This
One data segment is an action section.Then, the beginning using last sample of window as next data segment, and again
Return to the calculating of the data of linear accelerometer；
If C. two data volumes being less than between the window of threshold value are excessive, data sectional is carried out using maximal segment length；
After detecting that meets a window for result, if still without detecting second window for meeting result after a period of time,
Then force to carry out data sectional.
Step 3）The middle behavioral data by user includes according to the process that action division is identified：
3.1）The identification of action in level：
The identification of body work：Selection carries out Activity recognition using the data of linear accelerometer y-axis and sets a threshold
Data are calculated, if the threshold value less than setting by value, then it is assumed that current action is static；If it is more than the threshold value, to data
Fourier transformation is carried out, obtains the frequency of current action；A running threshold value is set, if obtained frequency is less than running threshold value,
Current action is then thought to walk；Otherwise, current action is running；
The identification of arm action：To each sampled point, the point of maximum absolute value in the axle of gravity sensor three is selected, and is selected
The correspondingly value of linear accelerometer, two class values are multiplied, positive and negative values ballot is carried out to first half and latter half；If first half
Part is just, latter half is negative, then current action is upper lift arm；Conversely, current action is decentralization arm；
The identification of list action：The variance of three number of axle evidences of linear accelerometer and gyroscope is calculated, average value is maximum
Value, minimum value carry out Activity recognition as feature using SVMs；
3.2）Action recognition between level：
The judgement acted using state machine, before being judged, preceding state is first obtained, then carry out arm and move
The identification of work, if arm action, then return to recognition result；If not arm action, then judge whether preceding state is body
Dry action；If so, then carry out body work identification and return to recognition result；If it is not, then carry out list action identification and return
Recognition result.
Step 4）Detailed process be：
If current action is body work, screen and camera will close；If action is in body work level up to necessarily
Duration, then closure sensor is until software of taking pictures is used again；
If current action is arm action, screen is opened and adjusts brightness；When upper lift arm, screen is opened and basis is worked as
Preceding ambient light intensity carries out brightness adjustment；Instantly let go arm when, screen intensity is transferred to minimum；
If current action is list action, the frame rate of camera preview is adjusted；When action is rotating mobile, camera
Run with minimum frame rate；When action is finely tunes, camera is run with medium frame rate；When action is to take pictures, take the photograph
As head is run with normal frame rate.
Beneficial effects of the present invention：
The system compared to traditional mobile phone photograph, can Intelligent Recognition user action, so as to judge the behavior of user and
Be intended to, including it is static, walk, run, it is upper lift arm, decentralization arm, rotating mobile, finely tune and take pictures；Energy-saving module being capable of root
Set corresponding Energy Saving Strategy according to specific user behavior, including blank screen, regulation screen intensity, adjustment frame rate, close software,
Closure sensor, so as to which the overall energy consumption of mobile phone be greatly reduced on the basis of experience not significantly reducing user and take pictures, return use
More preferable taking photograph of intelligent mobile phone is brought to experience in family.
Brief description of the drawings
Fig. 1 illustrates the taking photograph of intelligent mobile phone energy conserving system of Behavior-based control perception of the present invention and the system module of method of work
Figure.
Fig. 2 illustrates the taking photograph of intelligent mobile phone energy conserving system of Behavior-based control perception of the present invention and the DFD of method of work.
Fig. 3 illustrates the state transition diagram of state machine used in the Activity recognition of the present invention.
Fig. 4 illustrates Activity recognition flow chart in the present invention.
Fig. 5 illustrates the taking photograph of intelligent mobile phone energy conserving system of Behavior-based control perception of the present invention and the Energy Saving Strategy of method of work
Figure.
Embodiment
For the ease of the understanding of those skilled in the art, the present invention is made further with reference to embodiment and accompanying drawing
Bright, the content that embodiment refers to not is limitation of the invention.
Shown in reference picture 1, the present invention is that the taking photograph of intelligent mobile phone energy conserving system that Behavior-based control perceives and method of work have altogether
Including two modules, Activity recognition module and energy-saving module.In Activity recognition module, three parts are broadly divided into, data acquisition,
Data sectional and Activity recognition.Data acquisition is the behavioral data using the sensor record user of mobile phone.Data sectional
It is to be used as segmentation foundation by the use of the minibreak between human action.Activity recognition, carry out user using state machine and take pictures action
Identification.In energy-saving module, mainly for trunk, arm and wrist, different energy-saving schemes is proposed.
Shown in reference picture 2, using mobile phone built-in sensors, including linear accelerometer, gyroscope and gravity sensor,
Obtain data of the user during taking pictures.The data of three axles of the sensor of acquisition are subjected to data sectional.The shape of state machine
The input of state and data sectional as Activity recognition, current user state is exported, while update the state of state machine.Current shape
State is the input of energy-saving module, based on current state, adaptive implementation conservation measures.
Shown in reference picture 3, the state transition diagram of state machine used in Activity recognition of the invention.The present invention is related to altogether
8 kinds of states, including：It is static, walk, run, upper lift arm, transfer arm, rotating mobile, finely tune and take pictures.It is static, walk and
Running belongs to body work and three can mutually change.Upper lift arm belongs to arm action with decentralization arm and both can phase
Mutually conversion.Rotating mobile, finely tuning and taking pictures belongs to list action and three can mutually change.Body work and arm action it
Between can change.It can be changed between arm action and list action.But it cannot turn between body work and list action
Change.Body work can be converted to the upper lift arm in arm action.Decentralization arm in arm action can be converted to trunk
Action.Upper lift arm in arm action can be converted to list action.Under list action can be converted in arm action
Let go arm.
Shown in reference picture 4, Activity recognition flow chart is as follows：The judgement acted using state machine.Before being judged,
Preceding state is first obtained, the identification of arm action is then carried out, if arm action, then returns to recognition result；If not hand
Arm acts, then judges whether preceding state is body work；If so, then carry out body work identification and return to recognition result；
If it is not, then carry out list action identification and return to recognition result.
Arm identification content in above-mentioned steps is as follows：
To each sampled point, the point of maximum absolute value in the axle of gravity sensor three is selected, and selects corresponding linear acceleration
The value of meter is spent, two class values are multiplied, positive and negative values ballot is carried out to first half and latter half；If first half is just, later half
Part is negative, then current action is upper lift arm；Conversely, current action is decentralization arm.
Body work identification content in above-mentioned steps is as follows：
Set the threshold value of linear accelerometer y-axis data.The linear accelerometer y-axis data of data segment to obtaining are carried out
Calculate, if less than fixed threshold value, then it is assumed that current action is static；If result of calculation is more than threshold value, Fu is carried out to data
In leaf transformation, obtain the frequency of current action.Set running threshold value.If the result of Fourier transform is less than running threshold value, recognize
It is that current action is to walk, otherwise, current action is running.
List action identification content in above-mentioned steps is as follows：
The variance of three number of axle evidences of linear accelerometer and gyroscope is calculated, average value, maximum, minimum value is as special
Sign, Activity recognition is carried out using SVMs.
Shown in reference picture 5, the Energy Saving Strategy figure of taking photograph of intelligent mobile phone energy-saving scheme in the present invention.
Energy Saving Strategy includes herein below：
If current action is body work, screen and camera will close.If action reaches certain time length in trunk level,
Then closure sensor is until software of taking pictures is used again.
If current action is arm action, screen is opened and adjusts brightness.When upper lift arm, screen is opened and basis is worked as
Preceding ambient light intensity carries out brightness adjustment；Instantly let go arm when, screen intensity is transferred to minimum.
If current action is list action, the frame rate of preview is adjusted.When action is rotating mobile, camera is with minimum
Frame rate operation；When action is finely tunes, camera is run with medium frame rate；When action for take pictures when, camera with
Normal frame rate operation.
Concrete application approach of the present invention is a lot, and described above is only the preferred embodiment of the present invention, it is noted that for
For those skilled in the art, under the premise without departing from the principles of the invention, some improvement can also be made, this
A little improve also should be regarded as protection scope of the present invention.
Claims (4)
1. the method for work for the taking photograph of intelligent mobile phone energy conserving system that a kind of Behavior-based control perceives, it is characterised in that including following step
Suddenly：
1）User behavior data is obtained using the movable sensor built in smart mobile phone and light sensor and is transmitted to behavior sense
Know module；
2）Behavior sensing module is segmented to the user behavior data of input first；Fragmentation procedure is：User do two it is dynamic
Of short duration pause is had between work, data sectional is carried out using the pause；Data sectional comprises the following steps：
A. the variance of three number of axle evidences of linear accelerometer is calculated using sliding window, when the variance of three axles in window is respectively less than one
During individual threshold value, then it is assumed that the window is the beginning or end of behavioral data block；
B. when continuous two windows, which meet, to be required in A, increase carries out the side of sliding window using the data of the axle of gyroscope three
Difference calculates；Continue to calculate if the threshold value of continuous two windows reaches requirement, the window that threshold value is higher than until having produces；This
Data segment is an action section；Then, the beginning using last sample of window as next data segment, and come back to
The calculating of the data of linear accelerometer；
If C. two data volumes being less than between the window of threshold value are excessive, data sectional is carried out using maximal segment length；Work as inspection
Measure one meet the window of result after, if still without second window for meeting result is detected after a period of time, by force
System carries out data sectional；
3）The action that user takes pictures is preset in behavior sensing module to be abstracted as 8 kinds of actions and be divided into three according to the characteristics of action
Level：Body work：Including static, on foot and run；Arm action：Including upper lift arm and decentralization arm；List action：Bag
Rotating mobile is included, finely tunes and takes pictures；By the behavioral data of the user after segmentation according to above-mentioned action division be identified, according to
The level of the action at family judges the current behavior state of user；And return to energy-saving module；
4）Energy-saving module is controlled to implement based on the current behavior state of user to smart mobile phone screen intensity and camera
Different conservation measures.
2. the method for work for the taking photograph of intelligent mobile phone energy conserving system that Behavior-based control according to claim 1 perceives, its feature
It is, step 3）The middle behavioral data by user includes according to the process that action division is identified：
3.1）The identification of action in level：
The identification of body work：Selection carries out Activity recognition using the data of linear accelerometer y-axis and sets a threshold value, right
Data are calculated, if the threshold value less than setting, then it is assumed that current action is static；If being more than the threshold value, data are carried out
Fourier transformation, obtain the frequency of current action；A running threshold value is set, if obtained frequency is less than running threshold value, is recognized
It is that current action is to walk；Otherwise, current action is running；
The identification of arm action：To each sampled point, the point of maximum absolute value in the axle of gravity sensor three is selected, and is selected corresponding
The value of linear accelerometer, two class values are multiplied, positive and negative values ballot is carried out to first half and latter half；If first half
For just, latter half is negative, then current action is upper lift arm；Conversely, current action is decentralization arm；
The identification of list action：The variance of three number of axle evidences of calculating linear accelerometer and gyroscope, average value, maximum, most
Small value is used as feature, and Activity recognition is carried out using SVMs；
3.2）Action recognition between level：
The judgement acted using state machine, before being judged, preceding state is first obtained, then carry out arm action
Identification, if arm action, then returns to recognition result；If not arm action, then judge whether preceding state is that trunk moves
Make；If so, then carry out body work identification and return to recognition result；If it is not, then carry out list action identification and return to identification
As a result.
3. the method for work for the taking photograph of intelligent mobile phone energy conserving system that Behavior-based control according to claim 2 perceives, its feature
It is, step 4）Detailed process be：
If current action is body work, screen and camera will close；If action reaches certain time length in body work level,
Then closure sensor is until software of taking pictures is used again；
If current action is arm action, screen is opened and adjusts brightness；When upper lift arm, screen is opened and according to current
Ambient light intensity carries out brightness adjustment；Instantly let go arm when, screen intensity is transferred to minimum；
If current action is list action, the frame rate of camera preview is adjusted；When action is rotating mobile, camera is with most
Low frame rate operation；When action is finely tunes, camera is run with medium frame rate；When action is to take pictures, camera
Run with normal frame rate.
4. the work for the taking photograph of intelligent mobile phone energy conserving system that the Behavior-based control according to claims 1 to 3 any one perceives
Method, it is characterised in that the movable sensor includes linear accelerometer, gyroscope, gravity sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510410823.6A CN104965593B (en) | 2015-07-14 | 2015-07-14 | The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510410823.6A CN104965593B (en) | 2015-07-14 | 2015-07-14 | The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104965593A CN104965593A (en) | 2015-10-07 |
| CN104965593B true CN104965593B (en) | 2017-12-26 |
Family
ID=54219631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510410823.6A Active CN104965593B (en) | 2015-07-14 | 2015-07-14 | The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104965593B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106448573A (en) * | 2016-11-07 | 2017-02-22 | 珠海格力电器股份有限公司 | Method and device for adjusting brightness of display screen based on gravity sensor |
| CN108111690A (en) * | 2017-12-26 | 2018-06-01 | 北京传嘉科技有限公司 | Image pickup method and mobile electronic terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370201A (en) * | 2008-08-20 | 2009-02-18 | 上海闻泰电子科技有限公司 | Method for saving power in mobile phone camera shooting |
| CN103116464A (en) * | 2013-01-31 | 2013-05-22 | 广东欧珀移动通信有限公司 | Touch screen device and method for touch screen device fast entering photographing mode |
| CN104049759A (en) * | 2014-06-25 | 2014-09-17 | 华东理工大学 | Instruction input and protection method integrating touch screen and behavior sensing |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103123537B (en) * | 2011-11-21 | 2016-04-20 | 国基电子（上海）有限公司 | Electronic display unit and electricity saving method thereof |
-
2015
- 2015-07-14 CN CN201510410823.6A patent/CN104965593B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370201A (en) * | 2008-08-20 | 2009-02-18 | 上海闻泰电子科技有限公司 | Method for saving power in mobile phone camera shooting |
| CN103116464A (en) * | 2013-01-31 | 2013-05-22 | 广东欧珀移动通信有限公司 | Touch screen device and method for touch screen device fast entering photographing mode |
| CN104049759A (en) * | 2014-06-25 | 2014-09-17 | 华东理工大学 | Instruction input and protection method integrating touch screen and behavior sensing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104965593A (en) | 2015-10-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI646444B (en) | Method for waking up intelligent robot and intelligent robot | |
| CN101795400B (en) | Method for actively tracking and monitoring infants and realization system thereof | |
| CN110163806B (en) | Image processing method, device and storage medium | |
| KR100954835B1 (en) | System for extracting the face change of same person, and intelligent system using it | |
| CN105700363A (en) | Method and system for waking up smart home equipment voice control device | |
| CN105155941B (en) | Smart lock and its control method | |
| CN106778623A (en) | A kind of terminal screen control method, device and electronic equipment | |
| CN107358241A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN106032927B (en) | The control method and control device of air conditioner | |
| CN104965593B (en) | The taking photograph of intelligent mobile phone energy conserving system and method for work that Behavior-based control perceives | |
| CN106791440A (en) | Control the method and device of Face datection function | |
| CN111783375A (en) | Chip system and related device | |
| CN109044272A (en) | Sleep state monitoring and sleep environment parameter regulation method, system and terminal device | |
| CN105630161A (en) | Android system-based gesture control ring and using method thereof | |
| CN105042789A (en) | Control method and system of intelligent air conditioner | |
| CN104270535A (en) | Method, device and system for regulating and controlling camera shooting and picture recording power consumption | |
| CN115039897B (en) | Internet of things control method and device suitable for coffee bean production | |
| CN110515462A (en) | It is a kind of intelligence wearable device in apply control method, device | |
| CN108279019B (en) | Step counting method and device and intelligent wearable device | |
| CN113177229A (en) | Data processing method and related device | |
| CN106453965B (en) | The adaptive regulation method and device of terminal backlight | |
| CN106681477A (en) | Method for controlling low power consumption motion mode and intelligent terminal | |
| CN113255396A (en) | Training method and device of image processing model, and image processing method and device | |
| TW201514776A (en) | Wake up method and optical input device using the same | |
| CN107959756B (en) | System and method for automatically turning off electronic equipment during sleeping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |