CN106899766A - A kind of safety instruction method and its device and mobile terminal - Google Patents
A kind of safety instruction method and its device and mobile terminal Download PDFInfo
- Publication number
- CN106899766A CN106899766A CN201710145959.8A CN201710145959A CN106899766A CN 106899766 A CN106899766 A CN 106899766A CN 201710145959 A CN201710145959 A CN 201710145959A CN 106899766 A CN106899766 A CN 106899766A
- Authority
- CN
- China
- Prior art keywords
- user
- mobile terminal
- danger zone
- judge
- safety
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72457—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to geographic location
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Telephone Function (AREA)
Abstract
The invention discloses a kind of safety instruction method and its device and mobile terminal, wherein safety instruction method, including：Judge whether mobile terminal is kept in motion；When mobile terminal is kept in motion, judge user whether in viewing mobile terminal state by front camera；When user is in viewing mobile terminal state, judge nearby to whether there is danger zone by rear camera；When neighbouring dangerous region, judge the distance between border of current location and danger zone whether more than safe distance；When the distance between border when current location and danger zone is not more than safe distance, safety instruction is carried out.The present invention is by performing comprehensive safety detection, safety instruction is carried out to danger zone, so as to help user to be effectively shielded from dangerous spot or dangerous obstacles, reduce the generation of peril, therefore can ensure that user watches mobile phone or other mobile devices during walking, can be averted danger region, it is ensured that user's personal safety.
Description
Technical field
The present invention relates to safety instruction field, and in particular to a kind of safety instruction method and its device and mobile terminal.
Background technology
With the development of the communication technology, various smart machines emerge in large numbers commercially, while being practised as people live
Used is grown with each passing hour, and these smart machines are widely used in daily life, and such as smart mobile phone is used as of new generation high
Performance intelligent mobile terminal, because its is simple to operate, is easy to carry, so the life for giving people brings great convenience, at this
In the case of kind, people also gradually step up for the degree of dependence of smart machine, and then many people are absorbed in mobile phone whenever and wherever possible,
Even if also mobile phone is played in hand during walking, therefore it is easy to the perils such as wrestling.
The method that safety instruction or the monitoring of some smart machines are also disclosed that in currently available technology, such as Chinese special
A kind of intelligent mobile terminal disclosed in sharp document CN201510283722 carries out hazards monitoring and early warning based on Doppler effect
Method, judges whether user is in away line state first with accelerometer data, afterwards using sound Doppler effect harmony
Sound find range real-time monitoring surrounding environment, environmental information is judged whether by grader it is potentially dangerous, and by danger according to
Danger classes carries out early warning, in time the presence of warning consumers risk, the method need repeatedly to obtain various data messages participate in compared with
It is complicated calculating, such as by calculating the distance between sound source and barrier, when sound source carries out relative motion with user, Yong Hushou
To acoustic vibration frequency it is different from the frequency that sound source sends occur frequency displacement, contrast transmitting sound wave and reflection sound wave frequency it is inclined
Move, you can speed of related movement between mobile object and intelligent mobile terminal equipment in detection surrounding environment, thus judge be
It is no dangerous to occur, need repeatedly to calculate the frequency of sound wave in the program, and carry out Data Comparison, it is necessary to repeatedly process number
According to process is complex.
The content of the invention
In view of this, a kind of safety instruction method is the embodiment of the invention provides, to solve user during walking,
Seen the mobile phone because being too absorbed in, so the dangerous obstacles of front presence or the problem of dangerous spot cannot be seen in time.
First aspect present invention provides a kind of safety instruction method, and for mobile terminal, the mobile terminal includes preceding
Camera and rear camera are put, including：Judge whether mobile terminal is kept in motion；Described in being in when the mobile terminal
During motion state, judge user whether in viewing mobile terminal state by the front camera；Described in being in as user
During viewing mobile terminal state, judge nearby to whether there is danger zone by the rear camera；Exist when nearby described
During danger zone, judge the distance between current location and border of the danger zone whether more than safe distance；When described
When the distance between current location and border of the danger zone are not more than the safe distance, safety instruction is carried out.
By implementing the method that first aspect is described, first according to the motion state of user, and then mobile terminal can be known
Whether move, then the sight line state according to user, obtain whether user watches mobile phone during walking, further
For this behavior, comprehensive safety detection is performed, safety instruction is carried out to danger zone, so as to help user to be effectively shielded from
Dangerous spot or dangerous obstacles, reduce peril generation, therefore can ensure that user watched during walking mobile phone or its
His mobile device, can avert danger region, it is ensured that user's personal safety.
It is described by the preposition shooting in first aspect present invention first embodiment with reference to first aspect present invention
Whether head judges user in viewing mobile terminal state, including：The image of user face is obtained by the front camera；
The sight line movement of human eye in tracking described image；Whether the sight line according to user determines user in the viewing mobile terminal shape
State.
By performing above-mentioned steps, the image of user face is detected using front camera, according to recognition of face,
The image information of user face is obtained, further the sight line mobile status of tracking human eye, so as to judge whether user moves in viewing
Dynamic terminal, according to this judgement, it is known that user's current state judges whether to be necessary to continue executing with peace with the presence or absence of danger
The operation of full prompting, therefore can effectively align in walking or mobile user, the sight line of human eye becomes in traceable its face
Change, obtain user's current motion state, be also to improve user indirectly side sees the mobile phone the safety of this behavior when walking.
It is described by the rearmounted shooting in first aspect present invention second embodiment with reference to first aspect present invention
Head judges nearby to whether there is danger zone, including：The image of surrounding is obtained by the rear camera；Identification described image
Interior region whether there is target obstacle or target dangerous spot.
By performing above-mentioned steps, surrounding environment is detected by using rear camera, mainly to neighbouring bag
Danger zone containing target obstacle or target dangerous spot carries out complete detection, such as electric pole, step, puddle, in user's fortune
Real-time detection in dynamic process, searches for danger zone, and for user, mobile terminal is seen on the side during walking about to final purpose, keeps away
Open dangerous spot, it is ensured that its personal safety.
With reference to first aspect present invention or first aspect first embodiment or first aspect second embodiment, the present invention
It is described to carry out safety instruction in the implementation method of first aspect the 3rd, including：Pass on the tinkle of bells, vibration and/or warm tip frame.
By foregoing description, according to safety instruction pattern, such as the tinkle of bells, vibration and warm tip frame, for alerting user
Danger is there is currently, is conducive to warning user currently to take away from measure, be effectively shielded from danger zone, less dangerous thing
Therefore generation.
Additionally, second aspect present invention provides a kind of safety reminding device, for mobile terminal, including for execution
State the module or unit of first aspect or the described safety instruction method of any one realization of first aspect.
For example, the safety reminding device includes：First judge module, for judging mobile terminal whether in motion shape
State；Second judge module, for when the mobile terminal is in the motion state, judging to use by the front camera
Whether family is in viewing mobile terminal state；3rd judge module, for when user be in it is described viewing mobile terminal state when,
Judge nearby to whether there is danger zone by the rear camera；4th judge module, for ought nearby there is the danger
During the domain of danger zone, judge the distance between current location and border of the danger zone whether more than safe distance；Safety instruction
Module, for when the distance between the current location and border of the danger zone are not more than the safe distance, entering
Row safety instruction.
By implementing the safety reminding device of second aspect, first according to the motion state of user, and then movement can be known
Whether terminal follows motion, then the sight line state according to user, obtains whether user watches mobile phone during walking, enters
One step is directed to this behavior, performs comprehensive safety detection, safety instruction is carried out to danger zone, so as to help user effectively
Avert danger a little or dangerous obstacles, reduce the generation of peril, therefore can ensure that user watches mobile phone during walking
Or other mobile devices, can avert danger region, it is ensured that personal safety.
By combining second aspect present invention, in the first embodiment of second aspect present invention, described second judges mould
Block includes：First acquisition submodule, the image for obtaining user face by the front camera；Tracking submodule, uses
In the sight line movement of human eye in tracking described image；Determination sub-module, for determining whether user is according to the sight line of user
The viewing mobile terminal state.
By implementing above-mentioned safety reminding device, the image of user face is detected using front camera, according to
Whether recognition of face, obtains the image information of user face, further the sight line mobile status of tracking human eye, so as to judge user
In viewing mobile terminal, according to this judgement, it is known that user's current state judges whether to be necessary to hold with the presence or absence of danger
The operation of row safety instruction, therefore can effectively align in walking or mobile user, the sight line in traceable its face becomes
Change, obtain user's current motion state, be also to improve user indirectly side sees the mobile phone the safety of this behavior when walking.
With reference to second aspect present invention, in the second embodiment of second aspect present invention, the 3rd judge module bag
Include：Second acquisition module, the image for obtaining surrounding by the rear camera；Identification module, for recognizing the figure
Region as in whether there is target obstacle or target dangerous spot.
By implementing above-mentioned safety reminding device, surrounding environment is detected by using rear camera, it is main right
The neighbouring danger zone comprising target obstacle or target dangerous spot carries out complete detection, such as electric pole, step, puddle,
The real-time detection during user movement, searches for danger zone, and for user, shifting is seen on the side during walking about to final purpose
Dynamic terminal, averts danger a little, it is ensured that safety.
With reference to second aspect present invention or second aspect first embodiment or first aspect second embodiment, the present invention
In the implementation method of second aspect the 3rd, the safety instruction module includes：Pass on the tinkle of bells, vibration and/or warm tip frame.
By the description of above-mentioned safety reminding device, according to safety instruction pattern, such as the tinkle of bells, vibration and warm tip
Frame, danger is there is currently for alerting user, is conducive to warning user currently to take away from measure, is effectively shielded from danger
Region, the generation of less peril.
Module or unit included by the safety control are not limited to above-mentioned naming method.
These aspects of the application can more straightforward in the following description.
Third aspect present invention provides a kind of mobile terminal, including above-mentioned second aspect, the embodiment party of second aspect first
Safety reminding device described in formula, second embodiment and the 3rd implementation method.
The mobile terminal that third aspect present invention is provided, also includes：Motion state motion detection for detecting user is filled
Put, the front camera of sight line variable condition for detecting face, for detecting the target obstacle in danger zone or danger
The rear camera of danger point, the range sensor of the frontier distance for detecting current location and danger zone, memory and place
Reason device, the motion detection apparatus, front camera, rear camera, range sensor, memory and processor pass through bus
Interconnect, be stored with computer instruction in the memory, the processor is by performing the computer instruction, so that reality
Existing following methods：Judge whether mobile terminal is kept in motion；When mobile terminal is kept in motion, by described preposition
Whether camera judges user in viewing mobile terminal state；When user is in viewing mobile terminal state, by described
Rear camera judges nearby to whether there is danger zone；When neighbouring dangerous region, judge current location with the danger
Whether the distance between the border in danger zone domain is more than safe distance；When between the border of current location and the danger zone away from
During from the no more than safe distance, safety instruction is carried out.
The mobile terminal that third aspect present invention is provided, the motion detection apparatus are angular-rate sensor, for detecting
Skew of the user in motion process, angular speed when inclining.
By implementing above-mentioned mobile terminal, according to angular-rate sensor, also known as gyroscope, the current fortune of user can be detected
Dynamic state, frontal eminence speed when such as by measuring the deflection of user's current kinetic, inclining, can accurately obtain the current of user
Actual act, obtains the motion state of mobile terminal indirectly, and corresponding operation is performed according to This move.
Above-mentioned mobile terminal first according to the motion state of user, and then can know whether mobile terminal follows motion, so
The sight line state according to user, obtains whether user watches mobile phone during walking afterwards, further directed to this behavior, holds
The comprehensive safety detection of row, safety instruction is carried out to danger zone, so as to help user to be effectively shielded from dangerous spot or dangerous barrier
Hinder thing, reduce the generation of peril, therefore can ensure that user watches mobile phone or other mobile devices during walking, all may be used
With the region that averts danger, it is ensured that the personal safety of user.
Brief description of the drawings
The features and advantages of the present invention can be more clearly understood from by reference to accompanying drawing, accompanying drawing is schematical without that should manage
Solution is to carry out any limitation to the present invention, in the accompanying drawings：
Fig. 1 shows the structure chart of mobile phone in the embodiment of the present invention；
Fig. 2 shows the flow chart of the safety instruction method of the mobile terminal in the embodiment of the present invention；
Fig. 3 shows a kind of structural representation of the mobile terminal in the embodiment of the present invention；
Fig. 4 shows the hardware schematic of the mobile terminal in the embodiment of the present invention.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
A part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those skilled in the art are not having
There is the every other embodiment made and being obtained under the premise of creative work, belong to the scope of protection of the invention.
As shown in figure 1, being the application scenarios schematic diagram of embodiments of the invention.Mobile terminal can be mobile phone or flat board electricity
The mobile devices such as brain, by taking mobile phone as an example, the part-structure block diagram of mobile phone is as shown in figure 1, mobile phone includes radio circuit to mobile terminal
110th, memory 120, input block 130, display unit 140, sensor 150, voicefrequency circuit 160, wireless module 170, treatment
Device 180 and the grade of power supply 190 part.It will be understood by those skilled in the art that the handset structure shown in Fig. 1 does not constitute opponent
The restriction of machine, can include part more more or less than diagram, or combine some parts, or different part arrangements.
Wherein RF circuits 110 be used for receive and send messages or communication process in, the reception and transmission of signal.Memory 120 is used for
Storage software program and module, processor 180 store the software program and module in memory 120 by operation, so that
Perform various function application and the data processing of mobile phone.Input block 130 is used to receive the numeral or character information of input, with
And produce the key signals relevant with user's setting of mobile phone and function control to be input into.Input block 130 may include contact panel
131 and other input equipments 132.Other input equipments 132 can include but is not limited to physical keyboard, function key, mouse, behaviour
Make one or more in bar.Display unit 140 be used for show by user input information or be supplied to user information and
The various menus of mobile phone.Display unit 140 can include display panel 141.Contact panel 131 can cover display panel 141, when
Contact panel 131 is detected thereon or after neighbouring touch operation, sends processor 180 to determine the class of touch event
Type, corresponding visual output is provided with preprocessor 180 according to the type of touch event on display panel 141.
Mobile phone may also include at least one sensor 150, such as optical sensor, motion sensor and other sensors.Light
Sensor may include ambient light sensor and proximity transducer, and environmental sensor can adjust display according to the light and shade of ambient light
The brightness of panel 141, proximity transducer can close display panel 141 and/or backlight when mobile phone is moved in one's ear.This implementation
Optical sensor can be arranged on the housing of the front and back of mobile phone in example, for detecting blocked area during user's grip mobile phone
Domain.Pressure sensor can also be included herein, be arranged in the front of mobile phone or back housing, for the side by detecting pressure
Formula obtains occlusion area during user's grip mobile phone.Additionally, mobile phone can also configure gyroscope, barometer, hygrometer, temperature
The other sensors such as meter, infrared ray sensor, repeat no more.
Voicefrequency circuit 160, loudspeaker 161, microphone 162 can provide the COBBAIF between user and mobile phone.Wireless mould
Block 170 can be WIFI module, provide the user wireless the Internet access service.
Processor 180 is the control centre of mobile phone, using various interfaces and the various pieces of connection whole mobile phone, is led to
Cross operation or perform software program of the storage in memory 120 and/or module, and call storage in memory 120
Data, perform the various functions and processing data of mobile phone, so as to carry out integral monitoring to mobile phone.Optionally, processor 180 can be with
Including one or more processing units.Additionally, mobile phone also includes the power supply 190 powered of each part, by power-supply management system with
Processor 180 is logically contiguous, so as to realize the functions such as management charging, electric discharge and power managed by power-supply management system.
Although not shown, mobile phone can also will not be repeated here including camera, bluetooth module etc..
Refer to Fig. 2, method of controlling security provided in an embodiment of the present invention can be used for above-mentioned mobile terminal, such as mobile phone,
Panel computer etc., the method includes：
S1, judge whether mobile terminal is kept in motion.
The motion state of mobile terminal is judged herein, main device-motion detection apparatus by inside mobile terminal,
As angular-rate sensor, also known as gyroscope, its measurement physical quantity is rotational angular velocity when deflecting, inclining, and it can be right
Rotate, the action of deflection is done and measured well, Accurate Analysis judge the actual act of user, then can be to mobile terminal
Corresponding operation is done, is exactly in fact whether mobile terminal is judged in motion according to the motion state of user, because in user's walking
During, mobile terminal is carried with by user, therefore mobile terminal can be judged indirectly at the same whether motion, in order to
Safety detection is implemented integrally in help, and when situation is faced a danger, mobile terminal can effectively express safety instruction to such as user,
User is helped quickly to avert danger region, improving user can use mobile terminal safely during walking.
S2, when mobile terminal is kept in motion, judge whether user mobile eventually in viewing by front camera
End state.
Front camera herein is also mobile terminal internal components, and it may recognize that human eye equivalent to a video camera
Or the image of face, positioning and the tracking of face and human eye in image are then realized with software, so as to estimate what user watched attentively
Position.
In the step, as a kind of specific implementation, judge whether user moves in viewing by front camera
The SOT state of termination, including：
First, the image of user face is obtained by front camera；It searches for face equivalent to using front camera,
The face image of currently used person is identified, the main image information for obtaining human eye, this is the process of personal-machine interaction, is utilized
Computer vision technique, completes the positioning to the eyes of user, and eye is dynamic three kinds of principal modes：Watch, beat and smooth trailing attentively
Tracking, by these three actions of user's eye, extracts the status information of the current eye of user, judges whether user watches attentively and moves
Dynamic terminal.
Then, the sight line of human eye is moved in tracing figure picture.By after the positioning for obtaining the eyes in user face, tracking eye
Dynamic gaze area, changes, in the data message for extracting, accurately according to tone around pupil in image frame and pupil shape
Calculate the direction of sight line, and then may determine that whether user is currently watching mobile terminal, judge that user whether there is
It is potential dangerous, if to be necessary to continue executing with comprehensive security detection, pass on the operation of safety instruction, solve user in walking
During can run into front dangerous region when, may remind the user that and avert danger a little in time, so as to reduce dangerous thing
Therefore generation, it is ensured that user security.Without compared with needing to calculate many complicated data messages in technology, without using sound
Doppler effect and sound ranging real-time monitoring surrounding environment, calculate the distance between sound source and barrier, and sound source is entered with user
During row relative motion, the acoustic vibration frequency generation frequency displacement different from the frequency that sound source sends that user receives, contrast transmitting sound wave
With the frequency shift (FS) of reflection sound wave, you can the relative fortune in detection surrounding environment between mobile object and intelligent mobile terminal equipment
Dynamic speed, the method needs to be related to frequency, the calculating of distance and compares, it is necessary to obtain multiple data, it is impossible to directly obtain letter
The mobile status of breath, simply and accurately acquisition user, and then send safety instruction.The present embodiment not only can be to the reality of user
Border action is made and being accurately judged that, and simple to operate.
Finally, whether the sight line according to user determines user in viewing mobile terminal state.
By the location of sight line or angle of user, can quickly judge user it is current watch position attentively, such as work as user
Two in viewing terminal, the sight line of user is the angle of viewing of bowing, and confirms that user is the state in viewing mobile terminal.
S3, when user be in viewing mobile terminal state when, by rear camera judge nearby whether there is hazardous area
Domain.
Now, after above-mentioned two operation is performed, illustrate that the current state of user is in motion and is watching simultaneously
Mobile terminal, currently, the occurrence of user can be dangerous, so rear camera herein is also mobile terminal
Internal components, also using computer vision technique, the danger zone in front of real-time detection searches out dangerous spot or dangerous obstacles
Untill, so as to point out user to take care, avert danger region in time, it is ensured that user during walking, viewing mobile phone when
Safe handling.
In the step, as a kind of specific implementation, judge nearby to whether there is danger zone by rear camera,
Including：
The image of surrounding is obtained by rear camera.
Herein, surrounding environment is detected by using rear camera, mainly to neighbouring comprising target obstacle
It is real during user movement or the danger zone of target dangerous spot carries out complete detection, such as electric pole, step, puddle
When detect, search for danger zone, for user, mobile terminal is seen on the side during walking about to final purpose, averts danger a little, really
Protect user security.
Region in identification image whether there is target obstacle or target dangerous spot.
By the target obstacle detected in the image in the dangerous image data base that pre-builds and environment around
Or target dangerous spot is compared, judge whether current region is danger zone, such as：When rear camera detects user's week
There is the dangerous spot of step in the environment for enclosing, now by when the danger stored in the image of front step with threat data storehouse
Image is compared, and judges whether it is real dangerous diagram picture, so as to confirm whether current region is danger zone.
S4, when neighbouring dangerous region, judge whether current location big with the distance between the border of danger zone
In safe distance.
Herein, judge that the distance between border of current location and danger zone uses range sensor, to mobile terminal
Carry out early warning, range sensor and measures light using the principle-by launching especially short light pulse of time-of-flight method
Range finding is realized in pulse to be transmitted into time that testee is reflected, is with a kind of sensor of detection object distance.This
The safe distance at place is a safety instruction distance of system default, and such as 5 meters of system default is early warning distance, if user with
The distance between dangerous spot reaches 5 meters of this critical points, will make corresponding danger early warning prompting message, is conducive to user to carry
High safety, it is to avoid stride into the danger zone in front, effectively enhance the safety of user, it is ensured that user is during walking
Seeing the mobile phone can also avoid the generation of peril.
S5, when the distance between the border of current location and danger zone is not more than safe distance, carry out safety instruction.
In the step, carrying out safety instruction includes：Pass on the tinkle of bells, vibration and warm tip frame.
During mobile terminal performs safety instruction, safety instruction client has been in advance the state opened,
Security client herein is usually the safe App installed on mobile terminal, and prompting mode can be configured, and opens the person
Safety prompt function pattern, mainly to the tinkle of bells, vibration mode, prompting frame setting.Danger is there is currently for alerting user, in user
After hearing or seeing prompt message, be conducive to warning user currently to take away from measure, be effectively shielded from danger zone, compared with
The generation of few peril.
By implementing the safety instruction method in the present embodiment, above-mentioned all steps are real during user walks
When cycle detection, first according to the motion state of user, and then can know whether mobile terminal follows motion, then according to user
Sight line state, obtain whether user watches mobile phone during walking, further directed to this behavior, perform comprehensively peace
Full inspection is surveyed, and safety instruction is carried out to danger zone, so as to help user to be effectively shielded from dangerous spot or dangerous obstacles, reduces danger
The generation of dangerous accident, therefore can ensure that user watches mobile phone or other mobile devices during walking, can avert danger
Region, it is ensured that user's personal safety.
It is a kind of schematic diagram of safety reminding device provided in an embodiment of the present invention referring to Fig. 3, for mobile terminal, its
Including：
First judge module 31, for judging whether mobile terminal is kept in motion；
Second judge module 32, for when mobile terminal is kept in motion, judging that user is by front camera
It is no in viewing mobile terminal state；
3rd judge module 33, for when user is in viewing mobile terminal state, judging attached by rear camera
Closely whether there is danger zone；
4th judge module 34, for when neighbouring dangerous region, judging the border of current location and danger zone
The distance between whether be more than safe distance；
Safety instruction module 35, safe distance is not more than for the distance between border when current location and danger zone
When, carry out safety instruction.
By implementing the safety reminding device of second aspect, first according to the motion state of user, and then movement can be known
Whether terminal follows motion, then the sight line state according to user, obtains whether user watches mobile phone during walking, enters
One step is directed to this behavior, performs comprehensive safety detection, safety instruction is carried out to danger zone, so as to help user effectively
Avert danger a little or dangerous obstacles, reduce the generation of peril, therefore can ensure that user watches mobile phone during walking
Or other mobile devices, can avert danger region, it is ensured that people's safety.
Safety control in the present embodiment is presented in the form of functional unit, and unit here refers to ASIC electricity
Road, performs the processor and memory of one or more softwares or fixed routine, and/or other can provide the device of above-mentioned functions
Part.
Alternatively, the second judge module 32 includes：Second acquisition submodule, for obtaining user's face by front camera
The image in portion；Tracking submodule, for the sight line movement of human eye in tracing figure picture；Determination sub-module, the sight line according to user is true
Whether user is determined in viewing mobile terminal state.
By implementing above-mentioned safety reminding device, the image of user face is detected using front camera, according to
Whether recognition of face, obtains the image information of user face, further the sight line mobile status of tracking human eye, so as to judge user
In viewing mobile terminal, according to this judgement, it is known that user's current state judges whether to be necessary to hold with the presence or absence of danger
The operation of row safety instruction, therefore can effectively align in walking or mobile user, the sight line in traceable its face becomes
Change, obtain user's current motion state, be also to improve user indirectly side sees the mobile phone the safety of this behavior when walking.
Alternatively, the 3rd judge module 33 includes：Second acquisition submodule, for obtaining surrounding by rear camera
Image；Identification submodule, for recognizing that the region in image whether there is target obstacle or target dangerous spot.
By implementing above-mentioned safety reminding device, surrounding environment is detected by using rear camera, it is main right
The neighbouring danger zone comprising target obstacle or target dangerous spot carries out complete detection, such as electric pole, step, puddle,
The real-time detection during user movement, searches for danger zone, and for user, shifting is seen on the side during walking about to final purpose
Dynamic terminal, averts danger a little, it is ensured that safety.
Alternatively, safety instruction module 35 includes：Pass on the tinkle of bells, vibration and/or warm tip frame.
By the description of above-mentioned safety reminding device, according to safety instruction pattern, such as the tinkle of bells, vibration and warm tip
Frame, danger is there is currently for alerting user, is conducive to warning user currently to take away from measure, is effectively shielded from danger
Region, the generation of less peril.
Safety reminding device in above-described embodiment, first according to the motion state of user, and then can know mobile terminal
Whether motion is followed, then the sight line state according to user, obtain whether user watches mobile phone during walking, further
For this behavior, comprehensive safety detection is performed, safety instruction is carried out to danger zone, so as to help user to be effectively shielded from
Dangerous spot or dangerous obstacles, reduce peril generation, therefore can ensure that user watched during walking mobile phone or its
His mobile device, can avert danger region, it is ensured that user's personal safety.
The embodiment of the present invention also provides a kind of mobile terminal, the safety reminding device of the mobile terminal with above-mentioned Fig. 3.
Additionally, the mobile terminal provided in the embodiment of the present invention, as shown in figure 4, being movement provided in an embodiment of the present invention
The hardware architecture diagram of terminal, the equipment includes one or more processors 41, memory 42, the motion for detecting user
The motion detection apparatus 43 of state, the front camera 44 of sight line variable condition for detecting face, for detecting hazardous area
The rear camera 45 of target obstacle or dangerous spot in domain, the frontier distance for detecting current location and danger zone
Range sensor 46, in Fig. 4 by taking a processor 41 as an example.Motion detection apparatus 43, front camera 44, rear camera 45
Connection processor 41, the connection memory 42 of processor 41 can be connected, with by total in Fig. 4 by bus or other modes
As a example by line connection.
Processor 41 can be central processing unit (Central Processing Unit, CPU).Processor 41 can be with
It is other general processors, digital signal processor (Digital Signal Processor, DSP), application specific integrated circuit
(Application Specific Integrated Circuit, ASIC), field programmable gate array (Field-
Programmable Gate Array, FPGA) or other PLDs, discrete gate or transistor logic,
The chips such as discrete hardware components, or above-mentioned all kinds of chips combination.General processor can be microprocessor or the treatment
Device can also be any conventional processor etc..
Memory 42 can be used to storing non-transient software program, non-as a kind of non-transient computer readable storage medium storing program for executing
The corresponding program of processing method of the list items operation in transient computer executable program and module, such as the embodiment of the present application
Instruction/module.Processor 41 passes through to run the non-transient software program stored in memory 42, instruction and module, so that
The various function application of execute server and data processing, that is, realize the treatment side of above method embodiment list items operation
Method.
Memory 42 can include storing program area and storage data field, wherein, storing program area can storage program area,
Application program required at least one function；Storage data field can store the use institute of the processing unit operated according to list items
Data of establishment etc..Additionally, memory 42 can include high-speed random access memory, non-transient memory can also be included,
For example, at least one disk memory, flush memory device or other non-transient solid-state memories.In certain embodiments, deposit
Reservoir 41 is optional including the memory remotely located relative to processor 42, and these remote memories can be by network connection extremely
The processing unit of list items operation.The example of above-mentioned network includes but is not limited to internet, intranet, LAN, movement
Communication network and combinations thereof.
Alternatively, motion detection apparatus are angular-rate sensor, for detecting skew, inclination of the user in motion process
When angular speed.Motion state for detecting user
The method that the executable embodiment of the present invention of above-mentioned mobile terminal is provided, possesses the corresponding functional module of execution method
And beneficial effect.Processor 41 passes through computer instructions, so as to realize following methods：
The first step, judges whether mobile terminal is kept in motion；
Second step, when mobile terminal is kept in motion, judges whether user moves in viewing by front camera
The dynamic SOT state of termination；
Alternatively whether implementation, user is judged in viewing mobile terminal state by front camera,
Including：
First, the image of user face is obtained by front camera；
Then, the sight line of human eye is moved in tracing figure picture；
Finally, whether the sight line according to user determines user in viewing mobile terminal state.
3rd step, when user is in viewing mobile terminal state, is judged nearby with the presence or absence of danger by rear camera
Danger zone domain.
As another implementation, judge nearby to whether there is danger zone by rear camera, including：
The image of surrounding is obtained by rear camera；
Region in identification image whether there is target obstacle or target dangerous spot.
4th step, when neighbouring dangerous region, judges that the distance between current location and border of danger zone are
It is no more than safe distance；
5th step, when the distance between the border of current location and danger zone is not more than safe distance, carries out safety
Prompting.
Used as another implementation, carrying out safety instruction includes：Pass on the tinkle of bells, vibration and/or warm tip frame.
Above-mentioned mobile terminal according to the motion state of user, and then can know whether mobile terminal follows motion, then
Sight line state according to user, obtains whether user watches mobile phone during walking, further directed to this behavior, performs
Comprehensive safety detection, carries out safety instruction, so as to help user to be effectively shielded from dangerous spot or dangerous obstacles to danger zone
Thing, reduces the generation of peril, therefore can ensure that user watches mobile phone or other mobile devices during walking, can
Avert danger region, it is ensured that user's personal safety.
It will be understood by those skilled in the art that all or part of flow in realizing above-described embodiment method, can be logical
Computer program is crossed to instruct the hardware of correlation to complete, described program can be stored in a computer read/write memory medium
In, the program is upon execution, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, described storage medium can be magnetic
Dish, CD, read-only memory (ROM) or random access memory (RAM) etc..
Although being described in conjunction with the accompanying embodiments of the invention, those skilled in the art can not depart from the present invention
Spirit and scope in the case of various modification can be adapted and modification, such modification and modification are each fallen within by appended claims institute
Within the scope of restriction.
Claims (10)
1. a kind of safety instruction method, for mobile terminal, the mobile terminal includes front camera and rear camera, its
It is characterised by, including：
Judge whether mobile terminal is kept in motion；
When the mobile terminal is in the motion state, judge whether user moves in viewing by the front camera
The dynamic SOT state of termination；
When user is in the viewing mobile terminal state, judge nearby to whether there is hazardous area by the rear camera
Domain；
When nearby there is the danger zone, judge whether current location is big with the distance between the border of the danger zone
In safe distance；
When the distance between the current location and border of the danger zone are not more than the safe distance, safety is carried out
Prompting.
2. method according to claim 1, it is characterised in that described to judge whether user locates by the front camera
In viewing mobile terminal state, including：
The image of user face is obtained by the front camera；
The sight line movement of human eye in tracking described image；
Whether the sight line according to user determines user in the viewing mobile terminal state.
3. method according to claim 1, it is characterised in that described to judge nearby whether deposit by the rear camera
In danger zone, including：
The image of surrounding is obtained by the rear camera；
Region in identification described image whether there is target obstacle or target dangerous spot.
4. the method according to claim 1 or 2 or 3, it is characterised in that described to carry out safety instruction, including：
Pass on the tinkle of bells, vibration and/or warm tip frame.
5. a kind of safety reminding device, for mobile terminal, it is characterised in that including：
First judge module, for judging whether mobile terminal is kept in motion；
Second judge module, for when the mobile terminal is in the motion state, being judged by the front camera
Whether user is in viewing mobile terminal state；
3rd judge module, for when user is in the viewing mobile terminal state, being judged by the rear camera
Nearby whether there is danger zone；
4th judge module, the side for when nearby there is the danger zone, judging current location and the danger zone
Whether the distance between boundary is more than safe distance；
Safety instruction module, for being not more than the peace when the distance between the current location and border of the danger zone
During full distance, safety instruction is carried out.
6. device according to claim 5, it is characterised in that second judge module includes：
First acquisition submodule, the image for obtaining user face by the front camera；
Tracking submodule, the sight line for tracking human eye in described image is moved；
Determination sub-module, for determining user whether in viewing mobile terminal state according to the sight line of user.
7. device according to claim 5, it is characterised in that the 3rd judge module includes：
Second acquisition submodule, the image for obtaining surrounding by the rear camera；
Identification submodule, for recognizing that the region in described image whether there is target obstacle or target dangerous spot.
8. the device according to claim 5 or 6 or 7, it is characterised in that the safety instruction module includes：
Submodule is passed on, for passing on the tinkle of bells, vibration and/or warm tip frame.
9. a kind of mobile terminal, it is characterised in that including：
Safety reminding device described in claim any one of 5-8；
Motion detection apparatus, the motion state for detecting user；
Front camera, the sight line variable condition for detecting face；
Rear camera, for detecting the target obstacle in danger zone or dangerous spot；
Range sensor, the frontier distance for detecting current location and danger zone.
10. mobile terminal according to claim 9, it is characterised in that the motion detection apparatus are angular-rate sensor,
For detecting angular speed when skew, inclination of the user in motion process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710145959.8A CN106899766A (en) | 2017-03-13 | 2017-03-13 | A kind of safety instruction method and its device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710145959.8A CN106899766A (en) | 2017-03-13 | 2017-03-13 | A kind of safety instruction method and its device and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106899766A true CN106899766A (en) | 2017-06-27 |
Family
ID=59192736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710145959.8A Pending CN106899766A (en) | 2017-03-13 | 2017-03-13 | A kind of safety instruction method and its device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106899766A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107566659A (en) * | 2017-10-20 | 2018-01-09 | 维沃移动通信有限公司 | User security based reminding method and mobile terminal |
| CN107564237A (en) * | 2017-10-27 | 2018-01-09 | 华润电力技术研究院有限公司 | A kind of image detection warning system |
| CN107682542A (en) * | 2017-09-28 | 2018-02-09 | 努比亚技术有限公司 | A kind of barrier alarm method, mobile terminal and computer-readable recording medium |
| CN107730830A (en) * | 2017-09-21 | 2018-02-23 | 努比亚技术有限公司 | A kind of roadblock alarm method, mobile terminal and computer-readable recording medium |
| CN108122372A (en) * | 2018-01-04 | 2018-06-05 | 上海闻泰电子科技有限公司 | The method that electronic equipment and warning user not use electronic equipment when walking |
| CN108156321A (en) * | 2017-12-26 | 2018-06-12 | 上海展扬通信技术有限公司 | A kind of multi-screen display method and terminal |
| CN108174026A (en) * | 2017-12-25 | 2018-06-15 | 珠海格力电器股份有限公司 | The safety prompt function method, apparatus and electronic equipment of a kind of mobile terminal |
| CN108195385A (en) * | 2017-12-29 | 2018-06-22 | 杭州后博科技有限公司 | A kind of threat identification system and method for combination geographical feature |
| CN108418965A (en) * | 2018-03-01 | 2018-08-17 | 广东欧珀移动通信有限公司 | Safe early warning method, device, intelligent earphone and computer readable storage medium |
| CN109001741A (en) * | 2018-05-24 | 2018-12-14 | 深圳市沃特沃德股份有限公司 | The alarm method and system of intelligent terminal chance barrier |
| CN109194825A (en) * | 2018-08-15 | 2019-01-11 | 北京小米移动软件有限公司 | Early warning and reminding method and terminal |
| WO2019029157A1 (en) * | 2017-08-07 | 2019-02-14 | 广东轻工职业技术学院 | Apparatus and method capable of automatically identifying obstacle in front of mobile terminal |
| EP3462424A1 (en) * | 2017-09-30 | 2019-04-03 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and device for mobile illumination, and storage medium |
| CN110176129A (en) * | 2018-10-31 | 2019-08-27 | 广东小天才科技有限公司 | Safety detection method and wearable device in a kind of water based on dual camera |
| CN110266891A (en) * | 2019-06-28 | 2019-09-20 | 无锡睿勤科技有限公司 | Information cuing method, device, terminal and storage medium |
| CN112712678A (en) * | 2019-10-24 | 2021-04-27 | 深圳富泰宏精密工业有限公司 | Electronic device and photographing safety detection method |
| CN112925301A (en) * | 2019-12-05 | 2021-06-08 | 杭州海康机器人技术有限公司 | Control method for AGV danger avoidance and AGV |
| CN113140132A (en) * | 2021-04-20 | 2021-07-20 | 重庆邮电大学 | Pedestrian anti-collision early warning system and method based on 5G V2X mobile intelligent terminal |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103249352A (en) * | 2010-12-08 | 2013-08-14 | 索尼电脑娱乐公司 | Adaptive displays using gaze tracking |
| CN104881949A (en) * | 2015-04-24 | 2015-09-02 | 深圳市欧珀通信软件有限公司 | Road condition monitoring method based on mobile terminal and road condition monitoring device based on mobile terminal |
| CN105446673A (en) * | 2014-07-28 | 2016-03-30 | 华为技术有限公司 | Screen display method and terminal device |
| CN105812908A (en) * | 2016-03-28 | 2016-07-27 | 苏州乐聚堂电子科技有限公司 | Smart television system |
| CN106095375A (en) * | 2016-06-27 | 2016-11-09 | 联想(北京)有限公司 | Display control method and device |
| CN106183997A (en) * | 2016-08-11 | 2016-12-07 | 上海青橙实业有限公司 | display device for vehicle and vehicle |
| CN106201392A (en) * | 2016-06-27 | 2016-12-07 | 北京小米移动软件有限公司 | The display control method of curve screens and device |
| EP3115982A1 (en) * | 2015-07-09 | 2017-01-11 | Xiaomi Inc. | Method and apparatus for road condition prompt |
-
2017
- 2017-03-13 CN CN201710145959.8A patent/CN106899766A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103249352A (en) * | 2010-12-08 | 2013-08-14 | 索尼电脑娱乐公司 | Adaptive displays using gaze tracking |
| CN105446673A (en) * | 2014-07-28 | 2016-03-30 | 华为技术有限公司 | Screen display method and terminal device |
| CN104881949A (en) * | 2015-04-24 | 2015-09-02 | 深圳市欧珀通信软件有限公司 | Road condition monitoring method based on mobile terminal and road condition monitoring device based on mobile terminal |
| EP3115982A1 (en) * | 2015-07-09 | 2017-01-11 | Xiaomi Inc. | Method and apparatus for road condition prompt |
| CN105812908A (en) * | 2016-03-28 | 2016-07-27 | 苏州乐聚堂电子科技有限公司 | Smart television system |
| CN106095375A (en) * | 2016-06-27 | 2016-11-09 | 联想(北京)有限公司 | Display control method and device |
| CN106201392A (en) * | 2016-06-27 | 2016-12-07 | 北京小米移动软件有限公司 | The display control method of curve screens and device |
| CN106183997A (en) * | 2016-08-11 | 2016-12-07 | 上海青橙实业有限公司 | display device for vehicle and vehicle |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019029157A1 (en) * | 2017-08-07 | 2019-02-14 | 广东轻工职业技术学院 | Apparatus and method capable of automatically identifying obstacle in front of mobile terminal |
| US10871755B2 (en) | 2017-08-07 | 2020-12-22 | Guangdong Industry Polytechnic | Apparatus and method capable of automatically identifying obstacle in front of mobile terminal |
| CN107730830A (en) * | 2017-09-21 | 2018-02-23 | 努比亚技术有限公司 | A kind of roadblock alarm method, mobile terminal and computer-readable recording medium |
| CN107730830B (en) * | 2017-09-21 | 2020-08-07 | 江苏鑫里程科技服务有限公司 | Roadblock warning method, mobile terminal and computer readable storage medium |
| CN107682542A (en) * | 2017-09-28 | 2018-02-09 | 努比亚技术有限公司 | A kind of barrier alarm method, mobile terminal and computer-readable recording medium |
| US11022461B2 (en) | 2017-09-30 | 2021-06-01 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and device for mobile illumination, and storage medium |
| EP3462424A1 (en) * | 2017-09-30 | 2019-04-03 | Beijing Xiaomi Mobile Software Co., Ltd. | Method and device for mobile illumination, and storage medium |
| CN107566659A (en) * | 2017-10-20 | 2018-01-09 | 维沃移动通信有限公司 | User security based reminding method and mobile terminal |
| CN107564237A (en) * | 2017-10-27 | 2018-01-09 | 华润电力技术研究院有限公司 | A kind of image detection warning system |
| CN108174026A (en) * | 2017-12-25 | 2018-06-15 | 珠海格力电器股份有限公司 | The safety prompt function method, apparatus and electronic equipment of a kind of mobile terminal |
| CN108156321A (en) * | 2017-12-26 | 2018-06-12 | 上海展扬通信技术有限公司 | A kind of multi-screen display method and terminal |
| CN108156321B (en) * | 2017-12-26 | 2021-12-03 | 上海展扬通信技术有限公司 | Split screen display method and terminal |
| CN108195385A (en) * | 2017-12-29 | 2018-06-22 | 杭州后博科技有限公司 | A kind of threat identification system and method for combination geographical feature |
| CN108122372A (en) * | 2018-01-04 | 2018-06-05 | 上海闻泰电子科技有限公司 | The method that electronic equipment and warning user not use electronic equipment when walking |
| CN108418965A (en) * | 2018-03-01 | 2018-08-17 | 广东欧珀移动通信有限公司 | Safe early warning method, device, intelligent earphone and computer readable storage medium |
| CN109001741A (en) * | 2018-05-24 | 2018-12-14 | 深圳市沃特沃德股份有限公司 | The alarm method and system of intelligent terminal chance barrier |
| CN109194825A (en) * | 2018-08-15 | 2019-01-11 | 北京小米移动软件有限公司 | Early warning and reminding method and terminal |
| CN110176129A (en) * | 2018-10-31 | 2019-08-27 | 广东小天才科技有限公司 | Safety detection method and wearable device in a kind of water based on dual camera |
| CN110266891A (en) * | 2019-06-28 | 2019-09-20 | 无锡睿勤科技有限公司 | Information cuing method, device, terminal and storage medium |
| CN112712678A (en) * | 2019-10-24 | 2021-04-27 | 深圳富泰宏精密工业有限公司 | Electronic device and photographing safety detection method |
| CN112925301A (en) * | 2019-12-05 | 2021-06-08 | 杭州海康机器人技术有限公司 | Control method for AGV danger avoidance and AGV |
| CN112925301B (en) * | 2019-12-05 | 2024-05-17 | 杭州海康机器人股份有限公司 | Control method for AGV risk avoidance and AGV |
| CN113140132A (en) * | 2021-04-20 | 2021-07-20 | 重庆邮电大学 | Pedestrian anti-collision early warning system and method based on 5G V2X mobile intelligent terminal |
| CN113140132B (en) * | 2021-04-20 | 2023-11-03 | 西安华企众信科技发展有限公司 | Pedestrian anti-collision early warning system and method based on 5G V2X mobile intelligent terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106899766A (en) | A kind of safety instruction method and its device and mobile terminal | |
| CN110895861B (en) | Abnormal behavior early warning method and device, monitoring equipment and storage medium | |
| CN105487649B (en) | A kind of reminding method and mobile terminal | |
| CN108182896B (en) | A kind of brightness detection method, device and mobile terminal | |
| CN111556294A (en) | Safety monitoring method, device, server, terminal and readable storage medium | |
| JP6105953B2 (en) | Electronic device, line-of-sight input program, and line-of-sight input method | |
| CN110097736B (en) | Alarm method and alarm device | |
| CN108012026B (en) | Eyesight protection method and mobile terminal | |
| CN104463145A (en) | Electronic equipment and obstacle reminding method | |
| CN106470277A (en) | A kind of safety instruction method and device | |
| CN109558715A (en) | A kind of terminal device and face identification method | |
| CN110300267A (en) | Photographic method and terminal device | |
| CN108318706A (en) | The speed-measuring method and device of mobile object | |
| CN110505549A (en) | The control method and device of earphone | |
| CN110874905A (en) | Monitoring method and device | |
| CN109600297A (en) | A kind of mark sweep-out method and terminal device | |
| CN110659542A (en) | Monitoring method and device | |
| CN112748798B (en) | Eyeball tracking calibration method and related equipment | |
| CN109104689A (en) | A kind of safety alarm method and terminal | |
| CN109793491A (en) | A kind of colour blindness detection method and terminal device | |
| CN109143254A (en) | A kind of working method and terminal device of laser emitter | |
| CN109471119A (en) | A kind of method and terminal device controlling power consumption | |
| CN109164456A (en) | Depth camera mould group, mobile terminal and camera module mutual interference processing method | |
| CN108375356B (en) | Method and device for determining length of upright post of guardrail and computer readable storage medium | |
| CN108322598A (en) | A kind of information cuing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170627 |