US20170351908A1 - Portable electronic device and operation method thereof - Google Patents
Portable electronic device and operation method thereof Download PDFInfo
- Publication number
- US20170351908A1 US20170351908A1 US15/371,909 US201615371909A US2017351908A1 US 20170351908 A1 US20170351908 A1 US 20170351908A1 US 201615371909 A US201615371909 A US 201615371909A US 2017351908 A1 US2017351908 A1 US 2017351908A1
- Authority
- US
- United States
- Prior art keywords
- electronic device
- portable electronic
- image
- image sensor
- resolution
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G06K9/00288—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G06K9/00255—
-
- G06K9/00268—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/17—Image acquisition using hand-held instruments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H04N5/23241—
-
- H04N5/23245—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Definitions
- the instant disclosure relates to a portable electronic device and an operation method thereof; in particular, to a portable electronic device and an operation method thereof that can analyze low-resolution images and consumes less power.
- the instant disclosure provides a portable electronic device that can be operated in a suspend state and a work state.
- the portable electronic device comprises a body, an image sensor, a camera and a recognition module.
- the image sensor In the suspend state, the image sensor continually captures a first image outside the body and detects whether there is a face image information in the first image.
- the camera In the suspend state, the camera captures a second image outside the body after the face image information is detected from the first image.
- the first image has a first resolution
- the second image has a second resolution.
- the second resolution is higher than the first resolution.
- the recognition module recognizes at least one facial feature in the second image.
- the portable electronic device enters the work state when the recognition module recognizes the correct facial feature.
- the instant disclosure further provides an operation method that is applied to a portable electronic device.
- the portable electronic device that can be operated in a suspend state and a work state, and comprises a body, an image sensor, a camera and a recognition module.
- the operation method comprises: in the suspend state, turning on the image sensor to continually capture a first image outside the body and to detect whether there is a face image information in the first image, wherein first image has a first resolution; and turning on the camera to capture a second image outside the body after the face image information is detected from the first image, and recognizing at least one facial feature in the second image by the recognition module, wherein the second image has a second resolution and the second resolution is higher than the first resolution.
- the portable electronic device enters the work state when the recognition module recognizes the correct facial feature.
- a built-in image sensor can continually detect whether there is a face image information in the first image. Accordingly, it can be determined whether to turn on a camera to capture a second image having higher resolution for recognizing at least one facial feature in the second image.
- the unlocking mechanism of the portable electronic device can be implemented by two-stage face recognitions, which can effectively reduce the power consumption of the portable electronic device.
- FIG. 1 shows a block diagram of a portable electronic device of one embodiment of the instant disclosure.
- FIG. 2 is a schematic diagram showing how the portable electronic device shown in FIG. 1 operates.
- FIG. 3 shows a flow chart of an operation method applied to a portable electronic device of one embodiment of the instant disclosure.
- FIG. 4 shows a block diagram of a portable electronic device of another embodiment of the instant disclosure.
- FIG. 5A is a schematic diagram showing how a call is answered by the portable electronic device shown in FIG. 1 .
- FIG. 5B is a schematic diagram showing how a call is declined by the portable electronic device shown in FIG. 1 .
- FIG. 6 shows a flow chart of an operation method applied to a portable electronic device of another embodiment of the instant disclosure.
- FIG. 7 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 8 is a schematic diagram showing how the portable electronic device shown in FIG. 7 operates.
- FIG. 9 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 10 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 11 is a schematic diagram showing how the portable electronic device shown in FIG. 10 operates.
- FIG. 12 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 13 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 14 is a schematic diagram showing how the portable electronic device shown in FIG. 13 operates.
- FIG. 15 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- FIG. 1 shows a block diagram of a portable electronic device of one embodiment of the instant disclosure
- FIG. 2 is a schematic diagram showing how the portable electronic device shown in FIG. 1 operates.
- the portable electronic device 1 mainly comprises an image sensor 11 and a recognition module 13 .
- the image sensor 11 and the recognition module 13 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the portable electronic device 1 can also comprise a main system 15 , a screen 17 and a camera 19 , and they are respectively connected to the main system 15 .
- the portable electronic device 1 can be a mobile communication device, a personal digital assistant (PDA), a tablet or the like, and it is not limited herein. Take the mobile communication device as an example of the portable electronic device 1 shown in FIG. 2 .
- the portable electronic device 1 further comprises a body 21 .
- the image sensor 11 , the screen 17 and the camera 19 can be exposed on the same surface which is part of the housing of the body 21 .
- the recognition module 13 and the main system 15 are configured inside the body 21 .
- the positions where the image sensor 11 , the screen 17 and the camera 19 are configured are not limited by FIG. 2 . That is, the positions where the image sensor 11 , the screen 17 and the camera 19 are configured can be designed based on need.
- the portable electronic device 1 can be operated in a suspend state and a work state.
- the screen 17 of the portable electronic device 1 is turned on and the main system 15 can execute a function or a service required by a user according to their operation.
- the portable electronic device 1 is switched to the suspend state.
- the power supply to the main system 15 is temporarily cut.
- the main system 15 enters a power-saving mode and the screen 17 is also turned off to reduce the power consumption of the portable electronic device 1 , until the portable electronic device 1 is again operated in the work state.
- the image sensor 11 is an always-on image sensor, which has low power consumption and can analyze low-resolution images.
- the image sensor 11 is turned on to continually capture a first image outside the body 21 and to detect whether there is a face image information in the first image.
- the first image has a first resolution.
- the image sensor 11 and the screen 17 can be configured on the same surface, which is part of the housing of the body 21 , but it is not limited herein. In this manner, the first image continually captured and detected by the image sensor 11 shows the scene in front of the screen 17 . As shown in FIG.
- the user tends to unlock the screen 17 because he tends to operate the portable electronic device 1 to execute certain function or service (at this moment, the portable electronic device 1 is still operated in the suspend state), and the image sensor 11 is turned on to continually capture and detect the first image outside the body 21 .
- the image sensor 11 accordingly outputs an actuation signal to the main system 15 , such that the camera 19 and the recognition module 13 are activated by the main system 15 .
- more image sensors 11 can be used or conditions to determine whether the face image information is correctly detected from the first image can be added. For example, after the face image information in the first image is detected by the image sensor 11 , the image sensor 11 needs to further determine whether the face image information has appeared for over two seconds. Only when the image sensor 11 detects the face image information in the first image and the face image information has appeared for over two seconds, will the image sensor 11 output an actuation signal to the main system 15 , such that the camera 19 and the recognition module 13 are activated by the main system 15 .
- These conditions to determine whether the face image information is correctly detected from the first image are just examples but not for restricting the instant disclosure.
- the camera 19 captures a second image outside the body 21 .
- the second image has a second resolution, and the second resolution is higher than the first resolution.
- the recognition module 13 is configured in the body 21 to recognize at least one facial feature in the second image.
- the recognition module 13 is connected to the main system 15 .
- the recognition module 13 can be activated by the main system 15 to recognize at least one facial feature in the second image through the camera 19 .
- the camera 19 can be a VGA camera built in the portable electronic device 1 , which, compared with the image sensor 11 , can provide images having higher resolution (that is, the second image).
- the camera 19 is considered to be the front camera of the portable electronic device 1 , as shown in FIG. 2 .
- the second image captured by the camera 19 is the scene in front of the screen 17 .
- the portable electronic device 1 turns on the camera 19 to capture the second image, which shows the scene in front of the screen 17 .
- the recognition module 13 recognizes at least one facial feature in the second image.
- the recognition module 13 determines that the user has a legal identification to operate the portable electronic device 1 for executing a function or a service, so the main system 15 leaves the power-saving mode and the screen 17 is unlocked. Thus, the portable electronic device 1 is switched from the suspend state to the work state to execute a function or a service. On the other hand, when the recognition module 13 has not yet correctly recognized the facial feature, the portable electronic device 1 will not be switched from the suspend state to the work state and the screen 17 will not be turned on, which can prevent the user that does not have a legal identification from operating the portable electronic device 1 for executing a function or a service. Details about the mechanism for recognizing facial features are easily understood by those skilled in the art and thus they will not be described herein.
- the built-in image sensor 11 continually captures and detects whether there is a face image information in the first image, and then determines whether to turn on the camera 19 to capture the second image having higher resolution.
- the recognition module 13 detects at least one facial feature in the second image. In this manner, the unlocking mechanism of the portable electronic device 1 can be implemented by a two-stage face recognition, which can effectively reduce the power consumption of the portable electronic device 1 .
- the first-stage face recognition is to use the image sensor 11 that is always on to determine whether there is a face image information detected in the first image that shows the scene in front of the screen 17 , and to accordingly determine whether to start the second-stage face recognition.
- the portable electronic device 1 turns on the camera 19 to capture images having higher resolution and turns on the recognition module 13 to analyze high-resolution images, to determine whether the user has a legal identification to operate the portable electronic device 1 for executing a function or a service.
- the image sensor 11 When the portable electronic device 1 is switched from the suspend state to the work state, the image sensor 11 is switched to the power-saving mode.
- the image sensor 11 will be turned on to continually capture and detect the first image outside the body 21 until the portable electronic device 1 has been switched from the work state to the suspend state because it has not been operated for a period of time.
- the recognition module 13 when the portable electronic device 1 is operated in the suspend state and when the image sensor 11 has not yet detected the face image information from the first image, the recognition module 13 does not need to be activated and the camera 19 does not need to be turned on.
- the power consumption of the portable electronic device 1 can be reduced because the recognition module 13 and the camera 19 are both off.
- the recognition module 13 will be activated and the camera 19 will be turned on when the main system 15 receives an actuation signal from the image sensor 11 .
- FIG. 3 shows a flow chart of an operation method applied to a portable electronic device of one embodiment of the instant disclosure.
- the method of this embodiment is executable for a portable electronic device 1 as shown in FIG. 1 and FIG. 2 , and thus please refer to FIG. 1 and FIG. 2 for better understanding.
- step S 301 after the portable electronic device 1 is turned on but has been not operated for a period of time, the portable electronic device 1 is switched from the work state to the suspend state.
- the image sensor 11 In the suspend state, the image sensor 11 is turned on to continually capture a first image outside the body 21 .
- the first image has a first resolution.
- step S 303 the image sensor 11 detects whether there is a face image information in the first image.
- step S 305 if there is a face image information detected from the first image, the camera 19 is turned on to capture a second image outside the body 21 .
- the recognition module 13 is also activated to recognize at least one facial feature in the second image.
- the second image has a second resolution, and the second resolution is higher than the first resolution.
- step S 307 it is determined whether the correct facial feature is recognized.
- step S 309 if the recognition module 13 correctly recognizes the facial feature, the portable electronic device 1 is switched from the suspend state to the work state. At the same time, the image sensor 11 is switched to the power-saving mode. On the other hand, if the portable electronic device 1 is switched from the work state to the suspend state, the recognition module 13 and the camera 19 are both turned off to reduce the power consumption of the portable electronic device 1 .
- step S 311 if the recognition module 13 does not recognize the correct facial feature, the portable electronic device 1 will not be switched to the work state and the screen 17 will not be turned on, which can prevent a user that does not have a legal identification from operating the portable electronic device 1 for executing a function or a service.
- step S 311 if the recognition module 13 does not recognize the correct facial feature, the recognition module 13 and the camera 19 are both turned off, and it returns to step S 303 .
- a built-in image sensor can continually detect whether there is a face image information in the first image. Accordingly, it can be determined whether to turn on a camera to capture a second image having higher resolution for recognizing at least one facial feature in the second image. In this manner, the unlocking mechanism of the portable electronic device can be implemented by a two-stage face recognition, which can effectively reduce the power consumption of the portable electronic device.
- FIG. 4 shows a block diagram of a portable electronic device of another embodiment of the instant disclosure
- FIG. 5A is a schematic diagram showing how a call is answered by the portable electronic device shown in FIG. 1
- FIG. 5B is a schematic diagram showing how a call is declined by the portable electronic device shown in FIG. 1
- Like reference numbers in FIGS. 4, 5A and 5B and FIGS. 1 and 2 refer to like elements throughout.
- the portable electronic device 4 shown in FIG. 4 also comprises an off-hook controller 43 and a DND controller (Do Not Disturb controller; DND controller) 45 .
- the off-hook controller 43 and the DND controller 45 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the off-hook controller 43 and the DND controller 45 can be integrated in the main system 15 or be configured separately.
- the portable electronic device 4 also comprises a body 21 .
- the image sensor 41 , the screen 17 and the camera 19 can be exposed on the same surface which is part of the housing of the body 21 .
- the main system 15 , the off-hook controller 43 and the DND controller 45 are configured in the body 21 .
- the image sensor 41 continually captures a first image outside the body 21 and detects whether there is a first predetermined object or a second predetermined object in the first image.
- the off-hook controller 43 can control the portable electronic device 4 to answer the call, or the DND controller 45 can control the portable electronic device 4 to decline the call.
- the working mechanism for answering or declining a call is easily understood by the skilled in the art, and thus details about how the off-hook controller 43 or the DND controller 45 controls the portable electronic device 4 to answer or decline a call are not described herein. Briefly speaking, by determining whether there is a first predetermined object or a second predetermined object detected in the first image, the off-hook controller 43 or the DND controller 45 in the portable electronic device 4 can determine whether to answer or decline a call.
- the contact information of the caller is shown on the screen, such as the name, the identification number, the phone number or the like.
- a user can determine to answer or to decline the call based on this contact information shown on the screen.
- the user always needs to push buttons or touch the screen to control the portable electronic device to answer or to decline the call, which may be not be convenient because sometimes the user may not be free or may be too busy to push buttons or touch the screen of his portable electronic device.
- the image sensor 41 when the portable electronic device 4 receives a call, the image sensor 41 is turned on to continually capture a first image outside the body 21 . When there is a first predetermined object or a second predetermined object detected in the first image, the portable electronic device 4 accordingly determines to answer or decline the call. As shown in FIG. 5A , if there is a first predetermined object detected in the first image, such as the user's ear, the image sensor 41 outputs a first actuation signal to the main system 15 . As a result, the main system 15 activates the off-hook controller 43 to control the portable electronic device 4 to answer the call. On the other hand, as shown in FIG.
- the image sensor 41 if there is a second predetermined object detected in the first image, such as the user's palm, the image sensor 41 outputs a second actuation signal to the main system 15 . As a result, the main system 15 activates the DND controller 45 to control the portable electronic device 4 to decline the call. In this manner, the portable electronic device 4 uses the image sensor 41 that can analyze lower-resolution images and has low power consumption to recognize predetermined objects to further answer or decline a call. In other words, the portable electronic device 4 can automatically determine to answer or to decline a call, so a user does not need to do it manually.
- the image sensor 41 To prevent the image sensor 41 from wrongly determining whether there is a first predetermined object or a second predetermined object in a first image, more image sensors 41 can be used or the conditions to determine whether there is the first predetermined object or the second predetermined object in a first image can be added.
- the image sensor 41 not only needs to detect whether there is the first predetermined object or the second predetermined object in a first image, but also needs to detect changes in the distance between the first predetermined object and the portable electronic device 4 and the distance between the second predetermined object and the portable electronic device 4 .
- the image sensor 41 detects the first predetermined object, such as the user's ear, that is approaching the portable electronic device 4 .
- the main system 15 activates the off-hook controller 43 to control the portable electronic device 4 to answer the call.
- the image sensor 41 detects the second predetermined object, such as the user's palm, that is approaching the portable electronic device 4 .
- the main system 15 activates the DND controller 45 to control the portable electronic device 4 to decline the call.
- these conditions to determine whether there is a first predetermined object or a second predetermined object detected in a first image are just examples and not for restricting the instant disclosure.
- the portable electronic device 4 can further comprise an on-hook controller 47 that is also configured in the body 21 .
- the on-hook controller 47 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the on-hook controller 47 and the DND controller 45 can be integrated or separately configured.
- the on-hook controller 47 can control the portable electronic device 4 to go on-hook.
- the image sensor 41 keeps capturing and detecting the first image outside the body 21 .
- the image sensor 41 outputs a third actuation signal to the main system 15 when there is a third predetermined object (not shown) in the first image detected by the image sensor 41 .
- the main system 15 activates the on-hook controller 47 to control the portable electronic device 4 to go on-hook.
- FIG. 6 shows a flow chart of an operation method applied to a portable electronic device of another embodiment of the instant disclosure.
- the method of this embodiment is executable for a portable electronic device 4 as shown in FIGS. 4, 5A and 5B , and thus please refer to FIGS. 4, 5A and 5B for better understanding.
- step S 601 when the portable electronic device 4 receives a call, the image sensor 41 is tuned on to continually capture and detect a first image outside the body 21 .
- step S 603 the image sensor 41 determines whether there is a first predetermined object or a second predetermined object detected in the first image. If it is determined that a first predetermined object is detected in the first image, in step S 605 , the portable electronic device 4 determines to answer the call (that is, the off-hook controller 43 controls the portable electronic device 4 to answer the call). In addition, if it is determined that a second predetermined object is detected in the first image, in step S 607 , the portable electronic device 4 determines to decline the call (that is, the DND controller 45 controls the portable electronic device 4 to decline the call).
- the image sensor 41 After the call is answered, the image sensor 41 keeps capturing and detecting the first image outside the body 21 . Thus, in step S 609 , the image sensor 41 further determines whether there is a third predetermined object in the first image. If the image sensor 41 determines that there is the third predetermined object in the first image, in step S 611 , the portable electronic device 4 determines to decline the call (that is, the on-hook controller 47 is activated to control the portable electronic device 4 to go on-hook). It is worth mentioning that, the image sensor 41 can only analyze low-resolution images and has low power consumption, so the resolution of first images captured by the image sensor 41 must be much lower than the resolution of second images captured by the camera 19 which is built in the portable electronic device 4 . Moreover, when a call is declined, the image sensor 41 is switched to a power-saving mode to reduce the power consumption of the portable electronic device 4 . The image sensor 41 will be turned on again when the portable electronic device 4 receives the next call.
- FIG. 7 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure
- FIG. 8 is a schematic diagram showing how the portable electronic device shown in FIG. 7 operates.
- Like reference numbers in FIGS. 7 and 8 , and FIGS. 1-2, 4, 5A and 5B refer to like elements throughout.
- the portable electronic device 7 mainly comprises an image sensor 71 , a main system 15 , a screen 17 and a camera 19 .
- the image sensor 71 and the main system 15 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the image sensor 71 can be integrated into the main system 15 or be configured outside the main system 15 .
- the portable electronic device 7 also comprises a body 21 .
- the image sensor 71 , the screen 17 and the camera 19 can be exposed on the same surface which is part of the housing of the body 21 .
- the main system 15 is configured in the body 21 .
- the position where the image sensor 71 is configured is not limited by FIG. 8 . That is, the position where the image sensor 71 is configured can be designed based on need.
- the image sensor 71 continually captures a first image outside the body 21 .
- the image sensor 71 detects at least one motion of a user to generate a control signal according to the detected motion.
- the image sensor 71 shown in FIG. 7 can do more complex motion recognition, by which the image sensor 71 can recognize and analyze a gesture, a number of fingers and/or a moving direction in the captured first image. Accordingly, the image sensor 71 obtains at least one motion of the user and generates a control signal relevant to the motion of the user.
- the image sensor 71 can only analyze low-resolution images and has low power consumption, so the resolution of first images captured by the image sensor 71 must be much lower than the resolution of second images captured by the camera 19 which is built in the portable electronic device 7 .
- the image sensor 71 can be an always-on image sensor, and the conditions to turn on the image sensor 71 are not restricted. In other words, a user can design the conditions that the portable electronic device 7 needs to turn on the image sensor 71 based on his need.
- the main system 15 receives the control signal from the image sensor 71 , and correspondingly executes a function or a service. For example, after the image sensor 71 recognizes and analyzes a gesture, a number of fingers and/or a moving direction in the captured first image, the image sensor 71 obtains a motion of the user, which is “waving palm left and right”. Thus, the image sensor 71 generates a control signal relevant to the motion “waving palm left and right” to the main system 15 . Receiving the control signal, the main system 15 learns the motion corresponding to this control signal is “waving palm left and right” by checking a look-up table. Finally, the main system 15 executes a function or a service which corresponds to this motion “waving palm left and right”, such as an audio broadcasting service.
- a function or a service which corresponds to this motion “waving palm left and right”, such as an audio broadcasting service.
- FIG. 9 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- the method of this embodiment is executable for a portable electronic device 7 as shown in FIGS. 7 and 8 , and thus please refer to FIGS. 7 and 8 for better understanding.
- step S 901 the image sensor 71 is turned on to continually capture a first image outside the body 21 .
- the image sensor 71 detects at least one motion of a user according to the captured first image, and generates a control signal according to this detected motion of the user.
- step S 903 the main system 15 receives the control signal from the image sensor 71 , and correspondingly executes a function or a service according to the control signal.
- step S 901 the image sensor 71 detects at least one motion of the user according to a gesture, a number of fingers and/or a moving direction in the captured first image.
- FIG. 10 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure
- FIG. 11 is a schematic diagram showing how the portable electronic device shown in FIG. 10 operates.
- Like reference numbers in FIGS. 10 and 11 , and FIGS. 1 ⁇ 9 refer to like elements throughout.
- the portable electronic device 10 mainly comprises an image sensor 101 , a main system 15 , a screen 17 , a camera 19 , a first communication module 103 and a second communication module 105 .
- the image sensor 101 , the main system 15 , the first communication module 103 and the second communication module 105 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the image sensor 101 , the main system 15 , the first communication module 103 and the second communication module 105 can be integrated and configured separately.
- the portable electronic device 10 further comprises a body 21 .
- the image sensor 101 , the screen 17 and the camera 19 can be exposed on the same surface which is part of the housing of the body 21 .
- the main system 15 , the first communication module 103 and the second communication module 105 are configured inside the body 21 .
- the position where the image sensor 101 is configured is not limited by FIG. 11 . That is, the position where the image sensor 101 is configured can be designed based on need.
- the image sensor 101 continually captures a first image outside the body 21 , and determines whether the portable electronic device 10 is located indoors or outdoors according to the captured first image.
- the first communication module 103 controls the portable electronic device 10 to connect to the Internet through a first network IT 1
- the second communication module 105 controls the portable electronic device 10 to connect to the Internet through a second network IT 2 .
- the first network IT 1 can be the Wi-Fi network
- the second network IT 2 can be the 3G communication network or the 4G communication network, but it is not limited herein.
- the image sensor 101 determines whether the portable electronic device 10 is located indoors or outdoors, it can be determined whether to activate the first communication module 103 or the second communication module 105 to make the portable electronic device connect to the Internet through the first network IT 1 or the second network IT 2 .
- the conditions to turn on the image sensor 101 are not restricted. In other words, a user can design the conditions under which the portable electronic device 10 needs to turn on the image sensor 101 based on his need. For example, as shown in FIG. 11 , the image sensor 101 is turned on, and when the image sensor 101 determines that the portable electronic device is located indoors, the first communication module 103 is activated to control the portable electronic device 10 to connect to the Internet through the first network IT 1 (e.g., the Wi-Fi network). On the other hand, when the image sensor 101 determines that the portable electronic device is located outdoors, the second communication module 105 is activated to control the portable electronic device 10 to connect to the Internet through the second network IT 2 (e.g., the 3G communication network or the 4G communication network).
- the first network IT 1 e.g., the Wi-Fi network
- the second communication module 105 is activated to control the portable electronic device 10 to connect to the Internet through the second network IT 2 (e.g., the 3G communication network or the 4G communication network).
- the built-in image sensor 101 can detect and then determine that the portable electronic device is located indoors or outdoors. After that, it can be determined that the portable electronic device 10 is supposed to connect to the Internet through the first network IT 1 or the second network IT 2 .
- the image sensor 101 has low power consumption and can not only capture and analyze low-resolution images, but also can recognize the scene or the environment to automatically and appropriately choose a network to connect to the Internet. Thus, a user does not need to manually operate the portable electronic device 10 to choose a network to connect to the Internet and it is very convenient.
- the image sensor 101 determines that the portable electronic device 10 is located indoors or outdoors according to a flicker frequency and/or an exposure time of the captured first image. For example, because of the exposure to the fluorescent light, the flicker frequency of the image captured indoors is higher than the flicker frequency of the image captured outdoors. Thus, the image sensor 101 can determine that the portable electronic device 10 is located indoors if the flicker frequency of the captured first image is higher than a threshold frequency. On the other hand, because of the exposure to the natural light, the exposure time of the image captured outdoors is longer than the exposure time of the image captured indoors. Thus, the image sensor 101 can determine that the portable electronic device 10 is located outdoors if the exposure time of the captured first image is longer than a threshold time.
- the above examples are only for illustrating but not for restricting the instant disclosure.
- FIG. 12 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- the method of this embodiment is executable for a portable electronic device 10 as shown in FIGS. 10 and 11 , and thus please refers to FIGS. 10 and 11 for better understanding.
- step S 121 the image sensor 101 is turned on to continually capture a first image outside the body 21 .
- step S 123 the image sensor 101 determines that the portable electronic device 10 is located indoors or outdoors according to the first image.
- step S 125 the portable electronic device 10 connects to the Internet through the first network IT 1 if the portable electronic device 10 is located indoors.
- step S 127 the portable electronic device 10 connects to the Internet through the second network IT 2 if the portable electronic device 10 is located outdoors.
- the flicker frequency of the image may vary with the exposures of different fluorescent lamps. Moreover, the flicker frequency can be also defined as the coding data for the data transmission used in navigation or broadcasting, especially indoor navigation or indoor broadcasting.
- FIG. 13 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure
- FIG. 14 is a schematic diagram showing how the portable electronic device shown in FIG. 14 operates.
- Like reference numbers in FIGS. 13 and 14 , and FIGS. 1-12 refer to like elements throughout.
- the portable electronic device 130 mainly comprises an image sensor 131 , a main system 15 , a screen 17 , a camera 19 and a navigation module 133 .
- the image sensor 131 , the main system 15 and the navigation module 133 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein.
- the image sensor 131 , the main system 15 and the navigation module 133 can be integrated or configured separately.
- the portable electronic device 130 further comprises a body 21 .
- the image sensor 131 , the screen 17 and the camera 19 are exposed on the same surface which is part of the housing of the body 21 .
- the main system 15 and the navigation module 133 are configured inside the body 21 .
- the position where the image sensor 131 is configured is not limited by FIG. 13 . That is, the position where the image sensor 131 is configured can be designed based on need.
- the image sensor 131 continually captures a first image outside the body 21 .
- the image sensor 131 detects the flicker frequency of the first image and generates a navigation signal according to the flicker frequency.
- the first image has a first resolution.
- the navigation module 133 receives the navigation signal from the image sensor 131 , and obtains a location information of the portable electronic device 130 according to the navigation signal.
- the conditions to turn on the image sensor 131 are not limited herein.
- the image sensor 131 detects the flicker frequency of the LED lamp L 1 and generates a navigation signal according to the detected flicker frequency.
- the navigation module 133 can learn that the flicker frequency corresponding to the navigation signal is the flicker frequency of the LED lamp L 1 by checking a look-up table. In this manner, the navigation module 133 can determine that the portable electronic device 130 is within the irradiation range of the LED lamp L 1 according to the location information of the portable electronic device 130 .
- the image sensor 131 detects the flicker frequency of the LED lamp L 2 and generates a navigation signal according to the detected flicker frequency.
- the navigation module 133 can learn that the flicker frequency corresponding to the navigation signal is the flicker frequency of the LED lamp L 2 by checking the look-up table. In this manner, the navigation module 133 can determine that the portable electronic device 130 is within the irradiation range of the LED lamp L 2 according to the location information of the portable electronic device 130 .
- the above examples are only for illustrating but not for restricting the instant disclosure.
- FIG. 15 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure.
- the method of this embodiment is executable for a portable electronic device 130 as shown in FIGS. 13 and 14 , and thus please refers to FIGS. 13 and 14 for better understanding.
- step S 151 the image sensor 131 is turned on to continually capture a first image outside the body 21 .
- the image sensor 131 detects the flicker frequency of the first image, and generates a navigation signal according to the detected flicker frequency.
- the first image has a first resolution.
- step S 153 the navigation module 133 receives the navigation signal from the image sensor 131 , and determines a location information of the portable electronic device 130 according to the navigation signal.
- the adjective “always on” refers to a function that the image sensor is always turned on and capturing images when the portable electronic device is operated in specific state (e.g., the suspend state).
- the image frames captured by the image sensor can be consecutive or not consecutive. In other words, there can be no time interval between the captured image frames or there can be a time interval between the captured image frames.
- the built-in image sensor 131 can detect the flicker frequency according to the ambient light, wherein the flicker frequency varies with the ambient light in different areas.
- the navigation module 133 can obtain a location information of the portable electronic device 130 according to the detected flicker frequency.
- the flicker frequency can be also defined as the coding data for the data transmission used in the navigation or the broadcasting, and thus the image sensor 131 of the portable electronic device 130 can be also used in indoor navigation or indoor broadcasting.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Telephone Function (AREA)
- Studio Devices (AREA)
Abstract
Description
- The instant disclosure relates to a portable electronic device and an operation method thereof; in particular, to a portable electronic device and an operation method thereof that can analyze low-resolution images and consumes less power.
- Usually, when a portable electronic device captures an image, a built-in baseband circuit of the portable electronic device must turn on a camera to capture a high-resolution image. However, this operation process consumes much power. To reduce the power consumption of the portable electronic device and to make the portable electronic device able to be used in more situations, an improved portable electronic device that can analyze low-resolution images and consumes less power is needed.
- The instant disclosure provides a portable electronic device that can be operated in a suspend state and a work state. The portable electronic device comprises a body, an image sensor, a camera and a recognition module. In the suspend state, the image sensor continually captures a first image outside the body and detects whether there is a face image information in the first image. In the suspend state, the camera captures a second image outside the body after the face image information is detected from the first image. The first image has a first resolution, and the second image has a second resolution. The second resolution is higher than the first resolution. The recognition module recognizes at least one facial feature in the second image. The portable electronic device enters the work state when the recognition module recognizes the correct facial feature.
- The instant disclosure further provides an operation method that is applied to a portable electronic device. The portable electronic device that can be operated in a suspend state and a work state, and comprises a body, an image sensor, a camera and a recognition module. The operation method comprises: in the suspend state, turning on the image sensor to continually capture a first image outside the body and to detect whether there is a face image information in the first image, wherein first image has a first resolution; and turning on the camera to capture a second image outside the body after the face image information is detected from the first image, and recognizing at least one facial feature in the second image by the recognition module, wherein the second image has a second resolution and the second resolution is higher than the first resolution. The portable electronic device enters the work state when the recognition module recognizes the correct facial feature.
- To sum up, in the portable electronic device and the operation method provided by the instant disclosure, a built-in image sensor can continually detect whether there is a face image information in the first image. Accordingly, it can be determined whether to turn on a camera to capture a second image having higher resolution for recognizing at least one facial feature in the second image. In this manner, in the instant disclosure, the unlocking mechanism of the portable electronic device can be implemented by two-stage face recognitions, which can effectively reduce the power consumption of the portable electronic device.
- For further understanding of the instant disclosure, reference is made to the following detailed description illustrating the embodiments of the instant disclosure. The description is only for illustrating the instant disclosure, not for limiting the scope of the claim.
- Embodiments are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
-
FIG. 1 shows a block diagram of a portable electronic device of one embodiment of the instant disclosure. -
FIG. 2 is a schematic diagram showing how the portable electronic device shown inFIG. 1 operates. -
FIG. 3 shows a flow chart of an operation method applied to a portable electronic device of one embodiment of the instant disclosure. -
FIG. 4 shows a block diagram of a portable electronic device of another embodiment of the instant disclosure. -
FIG. 5A is a schematic diagram showing how a call is answered by the portable electronic device shown inFIG. 1 . -
FIG. 5B is a schematic diagram showing how a call is declined by the portable electronic device shown inFIG. 1 . -
FIG. 6 shows a flow chart of an operation method applied to a portable electronic device of another embodiment of the instant disclosure. -
FIG. 7 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure. -
FIG. 8 is a schematic diagram showing how the portable electronic device shown inFIG. 7 operates. -
FIG. 9 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. -
FIG. 10 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure. -
FIG. 11 is a schematic diagram showing how the portable electronic device shown inFIG. 10 operates. -
FIG. 12 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. -
FIG. 13 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure. -
FIG. 14 is a schematic diagram showing how the portable electronic device shown inFIG. 13 operates. -
FIG. 15 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. - The aforementioned illustrations and following detailed descriptions are exemplary for the purpose of further explaining the scope of the instant disclosure. Other objectives and advantages related to the instant disclosure will be illustrated in the subsequent descriptions and appended drawings. In addition, for an easy instruction, similar reference numbers or symbols refer to elements alike.
- Referring to
FIG. 1 andFIG. 2 ,FIG. 1 shows a block diagram of a portable electronic device of one embodiment of the instant disclosure, andFIG. 2 is a schematic diagram showing how the portable electronic device shown inFIG. 1 operates. The portableelectronic device 1 mainly comprises animage sensor 11 and arecognition module 13. Theimage sensor 11 and therecognition module 13 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, as shown inFIG. 1 , the portableelectronic device 1 can also comprise amain system 15, ascreen 17 and acamera 19, and they are respectively connected to themain system 15. - The portable
electronic device 1 can be a mobile communication device, a personal digital assistant (PDA), a tablet or the like, and it is not limited herein. Take the mobile communication device as an example of the portableelectronic device 1 shown inFIG. 2 . The portableelectronic device 1 further comprises abody 21. Theimage sensor 11, thescreen 17 and thecamera 19 can be exposed on the same surface which is part of the housing of thebody 21. Therecognition module 13 and themain system 15 are configured inside thebody 21. The positions where theimage sensor 11, thescreen 17 and thecamera 19 are configured are not limited byFIG. 2 . That is, the positions where theimage sensor 11, thescreen 17 and thecamera 19 are configured can be designed based on need. - The portable
electronic device 1 can be operated in a suspend state and a work state. When the portableelectronic device 1 enters the work state, thescreen 17 of the portableelectronic device 1 is turned on and themain system 15 can execute a function or a service required by a user according to their operation. In addition, when the user has not operated the portableelectronic device 1 for a period of time, the portableelectronic device 1 is switched to the suspend state. Thus, the power supply to themain system 15 is temporarily cut. Themain system 15 enters a power-saving mode and thescreen 17 is also turned off to reduce the power consumption of the portableelectronic device 1, until the portableelectronic device 1 is again operated in the work state. - Specifically speaking, the
image sensor 11 is an always-on image sensor, which has low power consumption and can analyze low-resolution images. When the portableelectronic device 1 is operated in the suspend state, theimage sensor 11 is turned on to continually capture a first image outside thebody 21 and to detect whether there is a face image information in the first image. The first image has a first resolution. For the convenience of unlocking the screen 17 (that is, to switch the portableelectronic device 1 to the work state), theimage sensor 11 and thescreen 17 can be configured on the same surface, which is part of the housing of thebody 21, but it is not limited herein. In this manner, the first image continually captured and detected by theimage sensor 11 shows the scene in front of thescreen 17. As shown inFIG. 2 , the user tends to unlock thescreen 17 because he tends to operate the portableelectronic device 1 to execute certain function or service (at this moment, the portableelectronic device 1 is still operated in the suspend state), and theimage sensor 11 is turned on to continually capture and detect the first image outside thebody 21. In addition, after a face image information is detected from the first image, theimage sensor 11 accordingly outputs an actuation signal to themain system 15, such that thecamera 19 and therecognition module 13 are activated by themain system 15. - To prevent the
image sensor 11 from wrongly detecting a face image information from the first image,more image sensors 11 can be used or conditions to determine whether the face image information is correctly detected from the first image can be added. For example, after the face image information in the first image is detected by theimage sensor 11, theimage sensor 11 needs to further determine whether the face image information has appeared for over two seconds. Only when theimage sensor 11 detects the face image information in the first image and the face image information has appeared for over two seconds, will theimage sensor 11 output an actuation signal to themain system 15, such that thecamera 19 and therecognition module 13 are activated by themain system 15. These conditions to determine whether the face image information is correctly detected from the first image are just examples but not for restricting the instant disclosure. - In the suspend state, after the face image information in the first image is detected by the
image sensor 11, thecamera 19 captures a second image outside thebody 21. The second image has a second resolution, and the second resolution is higher than the first resolution. Therecognition module 13 is configured in thebody 21 to recognize at least one facial feature in the second image. Therecognition module 13 is connected to themain system 15. Therecognition module 13 can be activated by themain system 15 to recognize at least one facial feature in the second image through thecamera 19. Thecamera 19 can be a VGA camera built in the portableelectronic device 1, which, compared with theimage sensor 11, can provide images having higher resolution (that is, the second image). Still for the convenience of unlocking thescreen 17, thecamera 19 is considered to be the front camera of the portableelectronic device 1, as shown inFIG. 2 . Thus, the second image captured by thecamera 19 is the scene in front of thescreen 17. After the face image information is detected from the first image, the portableelectronic device 1 turns on thecamera 19 to capture the second image, which shows the scene in front of thescreen 17. After that, therecognition module 13 recognizes at least one facial feature in the second image. - After the
recognition module 13 recognizes at least one correct facial feature, therecognition module 13 determines that the user has a legal identification to operate the portableelectronic device 1 for executing a function or a service, so themain system 15 leaves the power-saving mode and thescreen 17 is unlocked. Thus, the portableelectronic device 1 is switched from the suspend state to the work state to execute a function or a service. On the other hand, when therecognition module 13 has not yet correctly recognized the facial feature, the portableelectronic device 1 will not be switched from the suspend state to the work state and thescreen 17 will not be turned on, which can prevent the user that does not have a legal identification from operating the portableelectronic device 1 for executing a function or a service. Details about the mechanism for recognizing facial features are easily understood by those skilled in the art and thus they will not be described herein. - One of the main achievements of the portable
electronic device 1 is that, the built-inimage sensor 11 continually captures and detects whether there is a face image information in the first image, and then determines whether to turn on thecamera 19 to capture the second image having higher resolution. After that, therecognition module 13 detects at least one facial feature in the second image. In this manner, the unlocking mechanism of the portableelectronic device 1 can be implemented by a two-stage face recognition, which can effectively reduce the power consumption of the portableelectronic device 1. - More specifically, the first-stage face recognition is to use the
image sensor 11 that is always on to determine whether there is a face image information detected in the first image that shows the scene in front of thescreen 17, and to accordingly determine whether to start the second-stage face recognition. In the second-stage face recognition, the portableelectronic device 1 turns on thecamera 19 to capture images having higher resolution and turns on therecognition module 13 to analyze high-resolution images, to determine whether the user has a legal identification to operate the portableelectronic device 1 for executing a function or a service. - When the portable
electronic device 1 is switched from the suspend state to the work state, theimage sensor 11 is switched to the power-saving mode. Theimage sensor 11 will be turned on to continually capture and detect the first image outside thebody 21 until the portableelectronic device 1 has been switched from the work state to the suspend state because it has not been operated for a period of time. In addition, when the portableelectronic device 1 is operated in the suspend state and when theimage sensor 11 has not yet detected the face image information from the first image, therecognition module 13 does not need to be activated and thecamera 19 does not need to be turned on. The power consumption of the portableelectronic device 1 can be reduced because therecognition module 13 and thecamera 19 are both off. Therecognition module 13 will be activated and thecamera 19 will be turned on when themain system 15 receives an actuation signal from theimage sensor 11. - In order to further illustrate the operation method applied to the portable
electronic device 1, there is one embodiment provided as below. Referring toFIG. 3 ,FIG. 3 shows a flow chart of an operation method applied to a portable electronic device of one embodiment of the instant disclosure. The method of this embodiment is executable for a portableelectronic device 1 as shown inFIG. 1 andFIG. 2 , and thus please refer toFIG. 1 andFIG. 2 for better understanding. - In step S301, after the portable
electronic device 1 is turned on but has been not operated for a period of time, the portableelectronic device 1 is switched from the work state to the suspend state. In the suspend state, theimage sensor 11 is turned on to continually capture a first image outside thebody 21. The first image has a first resolution. In step S303, theimage sensor 11 detects whether there is a face image information in the first image. - After that, in step S305, if there is a face image information detected from the first image, the
camera 19 is turned on to capture a second image outside thebody 21. In addition, therecognition module 13 is also activated to recognize at least one facial feature in the second image. The second image has a second resolution, and the second resolution is higher than the first resolution. In the step S307, it is determined whether the correct facial feature is recognized. Finally, in step S309, if therecognition module 13 correctly recognizes the facial feature, the portableelectronic device 1 is switched from the suspend state to the work state. At the same time, theimage sensor 11 is switched to the power-saving mode. On the other hand, if the portableelectronic device 1 is switched from the work state to the suspend state, therecognition module 13 and thecamera 19 are both turned off to reduce the power consumption of the portableelectronic device 1. - Again referring to
FIG. 3 , if therecognition module 13 does not recognize the correct facial feature, the portableelectronic device 1 will not be switched to the work state and thescreen 17 will not be turned on, which can prevent a user that does not have a legal identification from operating the portableelectronic device 1 for executing a function or a service. Thus, in step S311, if therecognition module 13 does not recognize the correct facial feature, therecognition module 13 and thecamera 19 are both turned off, and it returns to step S303. - In the portable electronic device and the operation method provided in this embodiment, a built-in image sensor can continually detect whether there is a face image information in the first image. Accordingly, it can be determined whether to turn on a camera to capture a second image having higher resolution for recognizing at least one facial feature in the second image. In this manner, the unlocking mechanism of the portable electronic device can be implemented by a two-stage face recognition, which can effectively reduce the power consumption of the portable electronic device.
- Referring to
FIG. 4 ,FIG. 5A andFIG. 5B ,FIG. 4 shows a block diagram of a portable electronic device of another embodiment of the instant disclosure,FIG. 5A is a schematic diagram showing how a call is answered by the portable electronic device shown inFIG. 1 , andFIG. 5B is a schematic diagram showing how a call is declined by the portable electronic device shown inFIG. 1 . Like reference numbers inFIGS. 4, 5A and 5B andFIGS. 1 and 2 refer to like elements throughout. - In addition to an
image sensor 41, amain system 15, ascreen 17 and acamera 19, the portable electronic device 4 shown inFIG. 4 also comprises an off-hook controller 43 and a DND controller (Do Not Disturb controller; DND controller) 45. The off-hook controller 43 and theDND controller 45 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, the off-hook controller 43 and theDND controller 45 can be integrated in themain system 15 or be configured separately. Take a mobile communication device as an example of the portable electronic device 4 shown inFIG. 5A orFIG. 5B . The portable electronic device 4 also comprises abody 21. Theimage sensor 41, thescreen 17 and thecamera 19 can be exposed on the same surface which is part of the housing of thebody 21. Themain system 15, the off-hook controller 43 and theDND controller 45 are configured in thebody 21. - The
image sensor 41 continually captures a first image outside thebody 21 and detects whether there is a first predetermined object or a second predetermined object in the first image. When the portable electronic device 4 receives a call, the off-hook controller 43 can control the portable electronic device 4 to answer the call, or theDND controller 45 can control the portable electronic device 4 to decline the call. The working mechanism for answering or declining a call is easily understood by the skilled in the art, and thus details about how the off-hook controller 43 or theDND controller 45 controls the portable electronic device 4 to answer or decline a call are not described herein. Briefly speaking, by determining whether there is a first predetermined object or a second predetermined object detected in the first image, the off-hook controller 43 or theDND controller 45 in the portable electronic device 4 can determine whether to answer or decline a call. - Usually, when a portable electronic device receives a call, the contact information of the caller is shown on the screen, such as the name, the identification number, the phone number or the like. A user can determine to answer or to decline the call based on this contact information shown on the screen. However, the user always needs to push buttons or touch the screen to control the portable electronic device to answer or to decline the call, which may be not be convenient because sometimes the user may not be free or may be too busy to push buttons or touch the screen of his portable electronic device.
- In this embodiment, when the portable electronic device 4 receives a call, the
image sensor 41 is turned on to continually capture a first image outside thebody 21. When there is a first predetermined object or a second predetermined object detected in the first image, the portable electronic device 4 accordingly determines to answer or decline the call. As shown inFIG. 5A , if there is a first predetermined object detected in the first image, such as the user's ear, theimage sensor 41 outputs a first actuation signal to themain system 15. As a result, themain system 15 activates the off-hook controller 43 to control the portable electronic device 4 to answer the call. On the other hand, as shown inFIG. 5B , if there is a second predetermined object detected in the first image, such as the user's palm, theimage sensor 41 outputs a second actuation signal to themain system 15. As a result, themain system 15 activates theDND controller 45 to control the portable electronic device 4 to decline the call. In this manner, the portable electronic device 4 uses theimage sensor 41 that can analyze lower-resolution images and has low power consumption to recognize predetermined objects to further answer or decline a call. In other words, the portable electronic device 4 can automatically determine to answer or to decline a call, so a user does not need to do it manually. - To prevent the
image sensor 41 from wrongly determining whether there is a first predetermined object or a second predetermined object in a first image,more image sensors 41 can be used or the conditions to determine whether there is the first predetermined object or the second predetermined object in a first image can be added. For example, theimage sensor 41 not only needs to detect whether there is the first predetermined object or the second predetermined object in a first image, but also needs to detect changes in the distance between the first predetermined object and the portable electronic device 4 and the distance between the second predetermined object and the portable electronic device 4. In this manner, only when theimage sensor 41 detects the first predetermined object, such as the user's ear, that is approaching the portable electronic device 4, does theimage sensor 41 output a first actuation signal to themain system 15. As a result, themain system 15 activates the off-hook controller 43 to control the portable electronic device 4 to answer the call. On the other hand, only when theimage sensor 41 detects the second predetermined object, such as the user's palm, that is approaching the portable electronic device 4, theimage sensor 41 outputs a second actuation signal to themain system 15. As a result, themain system 15 activates theDND controller 45 to control the portable electronic device 4 to decline the call. However, these conditions to determine whether there is a first predetermined object or a second predetermined object detected in a first image are just examples and not for restricting the instant disclosure. - When a call is declined, the
image sensor 41 is switched to a power-saving mode to reduce the power consumption of the portable electronic device 4. Theimage sensor 41 will be turned on again when the portable electronic device 4 receives the next call. Again referring toFIG. 4 , the portable electronic device 4 can further comprise an on-hook controller 47 that is also configured in thebody 21. The on-hook controller 47 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, the on-hook controller 47 and theDND controller 45 can be integrated or separately configured. - After a call is answered, the on-
hook controller 47 can control the portable electronic device 4 to go on-hook. Specifically speaking, after a call is answered, theimage sensor 41 keeps capturing and detecting the first image outside thebody 21. Theimage sensor 41 outputs a third actuation signal to themain system 15 when there is a third predetermined object (not shown) in the first image detected by theimage sensor 41. According to the third actuation signal, themain system 15 activates the on-hook controller 47 to control the portable electronic device 4 to go on-hook. - In order to further illustrate the operation method applied to the portable electronic device 4, another embodiment is provided as below. Referring to
FIG. 6 ,FIG. 6 shows a flow chart of an operation method applied to a portable electronic device of another embodiment of the instant disclosure. The method of this embodiment is executable for a portable electronic device 4 as shown inFIGS. 4, 5A and 5B , and thus please refer toFIGS. 4, 5A and 5B for better understanding. - In step S601, when the portable electronic device 4 receives a call, the
image sensor 41 is tuned on to continually capture and detect a first image outside thebody 21. In step S603, theimage sensor 41 determines whether there is a first predetermined object or a second predetermined object detected in the first image. If it is determined that a first predetermined object is detected in the first image, in step S605, the portable electronic device 4 determines to answer the call (that is, the off-hook controller 43 controls the portable electronic device 4 to answer the call). In addition, if it is determined that a second predetermined object is detected in the first image, in step S607, the portable electronic device 4 determines to decline the call (that is, theDND controller 45 controls the portable electronic device 4 to decline the call). - After the call is answered, the
image sensor 41 keeps capturing and detecting the first image outside thebody 21. Thus, in step S609, theimage sensor 41 further determines whether there is a third predetermined object in the first image. If theimage sensor 41 determines that there is the third predetermined object in the first image, in step S611, the portable electronic device 4 determines to decline the call (that is, the on-hook controller 47 is activated to control the portable electronic device 4 to go on-hook). It is worth mentioning that, theimage sensor 41 can only analyze low-resolution images and has low power consumption, so the resolution of first images captured by theimage sensor 41 must be much lower than the resolution of second images captured by thecamera 19 which is built in the portable electronic device 4. Moreover, when a call is declined, theimage sensor 41 is switched to a power-saving mode to reduce the power consumption of the portable electronic device 4. Theimage sensor 41 will be turned on again when the portable electronic device 4 receives the next call. - Referring to
FIG. 7 andFIG. 8 ,FIG. 7 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure, andFIG. 8 is a schematic diagram showing how the portable electronic device shown inFIG. 7 operates. Like reference numbers inFIGS. 7 and 8 , andFIGS. 1-2, 4, 5A and 5B refer to like elements throughout. - The portable
electronic device 7 mainly comprises animage sensor 71, amain system 15, ascreen 17 and acamera 19. Theimage sensor 71 and themain system 15 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, theimage sensor 71 can be integrated into themain system 15 or be configured outside themain system 15. - Take a mobile communication device as an example of the portable
electronic device 7 shown inFIG. 8 . The portableelectronic device 7 also comprises abody 21. Theimage sensor 71, thescreen 17 and thecamera 19 can be exposed on the same surface which is part of the housing of thebody 21. Themain system 15 is configured in thebody 21. The position where theimage sensor 71 is configured is not limited byFIG. 8 . That is, the position where theimage sensor 71 is configured can be designed based on need. - The
image sensor 71 continually captures a first image outside thebody 21. In addition, theimage sensor 71 detects at least one motion of a user to generate a control signal according to the detected motion. Compared with theimage sensor 11 shown inFIG. 1 and theimage sensor 41 shown inFIG. 4 , theimage sensor 71 shown inFIG. 7 can do more complex motion recognition, by which theimage sensor 71 can recognize and analyze a gesture, a number of fingers and/or a moving direction in the captured first image. Accordingly, theimage sensor 71 obtains at least one motion of the user and generates a control signal relevant to the motion of the user. It is worth mentioning that, theimage sensor 71 can only analyze low-resolution images and has low power consumption, so the resolution of first images captured by theimage sensor 71 must be much lower than the resolution of second images captured by thecamera 19 which is built in the portableelectronic device 7. Moreover, theimage sensor 71 can be an always-on image sensor, and the conditions to turn on theimage sensor 71 are not restricted. In other words, a user can design the conditions that the portableelectronic device 7 needs to turn on theimage sensor 71 based on his need. - After the
image sensor 71 is turned on, themain system 15 receives the control signal from theimage sensor 71, and correspondingly executes a function or a service. For example, after theimage sensor 71 recognizes and analyzes a gesture, a number of fingers and/or a moving direction in the captured first image, theimage sensor 71 obtains a motion of the user, which is “waving palm left and right”. Thus, theimage sensor 71 generates a control signal relevant to the motion “waving palm left and right” to themain system 15. Receiving the control signal, themain system 15 learns the motion corresponding to this control signal is “waving palm left and right” by checking a look-up table. Finally, themain system 15 executes a function or a service which corresponds to this motion “waving palm left and right”, such as an audio broadcasting service. The above example is only for illustrating but not for restricting the instant disclosure - In order to further illustrate the operation method applied to the portable
electronic device 7, another embodiment is provided as below. Referring toFIG. 9 ,FIG. 9 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. The method of this embodiment is executable for a portableelectronic device 7 as shown inFIGS. 7 and 8 , and thus please refer toFIGS. 7 and 8 for better understanding. - In step S901, the
image sensor 71 is turned on to continually capture a first image outside thebody 21. In addition, theimage sensor 71 detects at least one motion of a user according to the captured first image, and generates a control signal according to this detected motion of the user. In step S903, themain system 15 receives the control signal from theimage sensor 71, and correspondingly executes a function or a service according to the control signal. - More specifically, in step S901, the
image sensor 71 detects at least one motion of the user according to a gesture, a number of fingers and/or a moving direction in the captured first image. - Referring to
FIG. 10 andFIG. 11 ,FIG. 10 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure, andFIG. 11 is a schematic diagram showing how the portable electronic device shown inFIG. 10 operates. Like reference numbers inFIGS. 10 and 11 , andFIGS. 1 ˜9, refer to like elements throughout. - The portable
electronic device 10 mainly comprises animage sensor 101, amain system 15, ascreen 17, acamera 19, afirst communication module 103 and asecond communication module 105. Theimage sensor 101, themain system 15, thefirst communication module 103 and thesecond communication module 105 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, theimage sensor 101, themain system 15, thefirst communication module 103 and thesecond communication module 105 can be integrated and configured separately. - Take a mobile communication device as an example of the portable
electronic device 10. The portableelectronic device 10 further comprises abody 21. Theimage sensor 101, thescreen 17 and thecamera 19 can be exposed on the same surface which is part of the housing of thebody 21. Themain system 15, thefirst communication module 103 and thesecond communication module 105 are configured inside thebody 21. The position where theimage sensor 101 is configured is not limited byFIG. 11 . That is, the position where theimage sensor 101 is configured can be designed based on need. - Specifically speaking, the
image sensor 101 continually captures a first image outside thebody 21, and determines whether the portableelectronic device 10 is located indoors or outdoors according to the captured first image. Moreover, thefirst communication module 103 controls the portableelectronic device 10 to connect to the Internet through a first network IT1, and thesecond communication module 105 controls the portableelectronic device 10 to connect to the Internet through a second network IT2. The first network IT1 can be the Wi-Fi network, and the second network IT2 can be the 3G communication network or the 4G communication network, but it is not limited herein. After theimage sensor 101 determines whether the portableelectronic device 10 is located indoors or outdoors, it can be determined whether to activate thefirst communication module 103 or thesecond communication module 105 to make the portable electronic device connect to the Internet through the first network IT1 or the second network IT2. - The conditions to turn on the
image sensor 101 are not restricted. In other words, a user can design the conditions under which the portableelectronic device 10 needs to turn on theimage sensor 101 based on his need. For example, as shown inFIG. 11 , theimage sensor 101 is turned on, and when theimage sensor 101 determines that the portable electronic device is located indoors, thefirst communication module 103 is activated to control the portableelectronic device 10 to connect to the Internet through the first network IT1 (e.g., the Wi-Fi network). On the other hand, when theimage sensor 101 determines that the portable electronic device is located outdoors, thesecond communication module 105 is activated to control the portableelectronic device 10 to connect to the Internet through the second network IT2 (e.g., the 3G communication network or the 4G communication network). - Thus, for the portable
electronic device 10 provided in this embodiment, the built-inimage sensor 101 can detect and then determine that the portable electronic device is located indoors or outdoors. After that, it can be determined that the portableelectronic device 10 is supposed to connect to the Internet through the first network IT1 or the second network IT2. In this embodiment, theimage sensor 101 has low power consumption and can not only capture and analyze low-resolution images, but also can recognize the scene or the environment to automatically and appropriately choose a network to connect to the Internet. Thus, a user does not need to manually operate the portableelectronic device 10 to choose a network to connect to the Internet and it is very convenient. - More specifically, the
image sensor 101 determines that the portableelectronic device 10 is located indoors or outdoors according to a flicker frequency and/or an exposure time of the captured first image. For example, because of the exposure to the fluorescent light, the flicker frequency of the image captured indoors is higher than the flicker frequency of the image captured outdoors. Thus, theimage sensor 101 can determine that the portableelectronic device 10 is located indoors if the flicker frequency of the captured first image is higher than a threshold frequency. On the other hand, because of the exposure to the natural light, the exposure time of the image captured outdoors is longer than the exposure time of the image captured indoors. Thus, theimage sensor 101 can determine that the portableelectronic device 10 is located outdoors if the exposure time of the captured first image is longer than a threshold time. The above examples are only for illustrating but not for restricting the instant disclosure. - In order to further illustrate the operation method applied to the portable
electronic device 10, another embodiment is provided as below. Referring toFIG. 12 ,FIG. 12 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. The method of this embodiment is executable for a portableelectronic device 10 as shown inFIGS. 10 and 11 , and thus please refers toFIGS. 10 and 11 for better understanding. - In step S121, the
image sensor 101 is turned on to continually capture a first image outside thebody 21. In step S123, theimage sensor 101 determines that the portableelectronic device 10 is located indoors or outdoors according to the first image. After that, in step S125, the portableelectronic device 10 connects to the Internet through the first network IT1 if the portableelectronic device 10 is located indoors. On the other hand, in step S127, the portableelectronic device 10 connects to the Internet through the second network IT2 if the portableelectronic device 10 is located outdoors. - The flicker frequency of the image may vary with the exposures of different fluorescent lamps. Moreover, the flicker frequency can be also defined as the coding data for the data transmission used in navigation or broadcasting, especially indoor navigation or indoor broadcasting. Referring to
FIG. 13 andFIG. 14 ,FIG. 13 shows a block diagram of a portable electronic device of still another embodiment of the instant disclosure, andFIG. 14 is a schematic diagram showing how the portable electronic device shown inFIG. 14 operates. Like reference numbers inFIGS. 13 and 14 , andFIGS. 1-12 refer to like elements throughout. - The portable
electronic device 130 mainly comprises animage sensor 131, amain system 15, ascreen 17, acamera 19 and anavigation module 133. Theimage sensor 131, themain system 15 and thenavigation module 133 can be implemented all by hardware or by a combination of hardware and firmware or software, and it is not limited herein. In addition, theimage sensor 131, themain system 15 and thenavigation module 133 can be integrated or configured separately. - Take a mobile communication device as an example of the portable
electronic device 130 shown in andFIG. 13 andFIG. 14 . The portableelectronic device 130 further comprises abody 21. Theimage sensor 131, thescreen 17 and thecamera 19 are exposed on the same surface which is part of the housing of thebody 21. Themain system 15 and thenavigation module 133 are configured inside thebody 21. The position where theimage sensor 131 is configured is not limited byFIG. 13 . That is, the position where theimage sensor 131 is configured can be designed based on need. - The
image sensor 131 continually captures a first image outside thebody 21. In addition, theimage sensor 131 detects the flicker frequency of the first image and generates a navigation signal according to the flicker frequency. The first image has a first resolution. When theimage sensor 131 is turned on, thenavigation module 133 receives the navigation signal from theimage sensor 131, and obtains a location information of the portableelectronic device 130 according to the navigation signal. The conditions to turn on theimage sensor 131 are not limited herein. - As shown in
FIG. 14 , if the flicker frequency of an LED lamp L1 and the flicker frequency of an LED lamp L2 are not equal, when the portableelectronic device 130 is exposed to the light emitted by the LED lamp L1, theimage sensor 131 detects the flicker frequency of the LED lamp L1 and generates a navigation signal according to the detected flicker frequency. After receiving the navigation signal, thenavigation module 133 can learn that the flicker frequency corresponding to the navigation signal is the flicker frequency of the LED lamp L1 by checking a look-up table. In this manner, thenavigation module 133 can determine that the portableelectronic device 130 is within the irradiation range of the LED lamp L1 according to the location information of the portableelectronic device 130. - On the other hand, when the portable
electronic device 130 is exposed to the light emitted by the LED lamp L2, theimage sensor 131 detects the flicker frequency of the LED lamp L2 and generates a navigation signal according to the detected flicker frequency. After receiving the navigation signal, thenavigation module 133 can learn that the flicker frequency corresponding to the navigation signal is the flicker frequency of the LED lamp L2 by checking the look-up table. In this manner, thenavigation module 133 can determine that the portableelectronic device 130 is within the irradiation range of the LED lamp L2 according to the location information of the portableelectronic device 130. The above examples are only for illustrating but not for restricting the instant disclosure. - In order to further illustrate the operation method applied to the portable
electronic device 130, another embodiment is provided as below. Referring toFIG. 15 ,FIG. 15 shows a flow chart of an operation method applied to a portable electronic device of still another embodiment of the instant disclosure. The method of this embodiment is executable for a portableelectronic device 130 as shown inFIGS. 13 and 14 , and thus please refers toFIGS. 13 and 14 for better understanding. - Is step S151, the
image sensor 131 is turned on to continually capture a first image outside thebody 21. In addition, theimage sensor 131 detects the flicker frequency of the first image, and generates a navigation signal according to the detected flicker frequency. The first image has a first resolution. After that, in step S153, thenavigation module 133 receives the navigation signal from theimage sensor 131, and determines a location information of the portableelectronic device 130 according to the navigation signal. - It should be noted that, the adjective “always on” refers to a function that the image sensor is always turned on and capturing images when the portable electronic device is operated in specific state (e.g., the suspend state). However, the image frames captured by the image sensor can be consecutive or not consecutive. In other words, there can be no time interval between the captured image frames or there can be a time interval between the captured image frames.
- For the portable
electronic device 130 provided by this embodiment, the built-inimage sensor 131 can detect the flicker frequency according to the ambient light, wherein the flicker frequency varies with the ambient light in different areas. After that, thenavigation module 133 can obtain a location information of the portableelectronic device 130 according to the detected flicker frequency. Moreover, the flicker frequency can be also defined as the coding data for the data transmission used in the navigation or the broadcasting, and thus theimage sensor 131 of the portableelectronic device 130 can be also used in indoor navigation or indoor broadcasting. - The descriptions illustrated supra set forth simply the preferred embodiments of the instant disclosure; however, the characteristics of the instant disclosure are by no means restricted thereto. All changes, alterations, or modifications conveniently considered by those skilled in the art are deemed to be encompassed within the scope of the instant disclosure delineated by the following claims.
Claims (9)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/608,109 US10757377B2 (en) | 2016-06-01 | 2017-05-30 | Surveillance system and operation method thereof |
US17/334,600 US11756331B2 (en) | 2016-06-01 | 2021-05-28 | Portable electronic device and operation method |
US18/196,250 US20230282023A1 (en) | 2016-06-01 | 2023-05-11 | Electronic device unlocked and controlled by gesture recognition |
US18/225,443 US20230368572A1 (en) | 2016-06-01 | 2023-07-24 | Portable electronic device and operation method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW105117190 | 2016-06-01 | ||
TW105117190A TW201743241A (en) | 2016-06-01 | 2016-06-01 | Portable electronic device and operation method thereof |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/608,109 Continuation-In-Part US10757377B2 (en) | 2016-06-01 | 2017-05-30 | Surveillance system and operation method thereof |
US17/334,600 Continuation US11756331B2 (en) | 2016-06-01 | 2021-05-28 | Portable electronic device and operation method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170351908A1 true US20170351908A1 (en) | 2017-12-07 |
Family
ID=60482390
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/371,909 Abandoned US20170351908A1 (en) | 2016-06-01 | 2016-12-07 | Portable electronic device and operation method thereof |
US17/334,600 Active US11756331B2 (en) | 2016-06-01 | 2021-05-28 | Portable electronic device and operation method |
US18/225,443 Pending US20230368572A1 (en) | 2016-06-01 | 2023-07-24 | Portable electronic device and operation method |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/334,600 Active US11756331B2 (en) | 2016-06-01 | 2021-05-28 | Portable electronic device and operation method |
US18/225,443 Pending US20230368572A1 (en) | 2016-06-01 | 2023-07-24 | Portable electronic device and operation method |
Country Status (2)
Country | Link |
---|---|
US (3) | US20170351908A1 (en) |
TW (1) | TW201743241A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10158797B2 (en) * | 2017-03-31 | 2018-12-18 | Motorola Mobility Llc | Combining images when a face is present |
US20190306490A1 (en) * | 2018-03-29 | 2019-10-03 | Beijing Boe Optoelectronics Technology Co., Ltd. | 3d display device, method for controlling the same and computing device |
US10757377B2 (en) | 2016-06-01 | 2020-08-25 | Pixart Imaging Inc. | Surveillance system and operation method thereof |
US20210073541A1 (en) * | 2018-05-22 | 2021-03-11 | Vivo Mobile Communication Co., Ltd. | Object recognition method and mobile terminal |
JP2021524203A (en) * | 2018-05-22 | 2021-09-09 | 維沃移動通信有限公司Vivo Mobile Communication Co., Ltd. | Object recognition method and mobile terminal |
US11144749B1 (en) * | 2019-01-09 | 2021-10-12 | Idemia Identity & Security USA LLC | Classifying camera images to generate alerts |
US20220366722A1 (en) * | 2021-05-12 | 2022-11-17 | Lenovo (Singapore) Pte. Ltd. | Electronic apparatus and control method |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW201743241A (en) * | 2016-06-01 | 2017-12-16 | 原相科技股份有限公司 | Portable electronic device and operation method thereof |
TWI677751B (en) * | 2017-12-26 | 2019-11-21 | 技嘉科技股份有限公司 | Image capturing device and operation method thereof |
CN118116117A (en) * | 2022-11-30 | 2024-05-31 | 荣耀终端有限公司 | Crowd identification method, device and storage medium |
Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040212678A1 (en) * | 2003-04-25 | 2004-10-28 | Cooper Peter David | Low power motion detection system |
US6970183B1 (en) * | 2000-06-14 | 2005-11-29 | E-Watch, Inc. | Multimedia surveillance and monitoring system including network configuration |
US20060215022A1 (en) * | 2005-03-25 | 2006-09-28 | Yongyouth Damabhorn | A security camera and monitor system activated by motion sensor and body heat sensor for homes or offices |
US7806604B2 (en) * | 2005-10-20 | 2010-10-05 | Honeywell International Inc. | Face detection and tracking in a wide field of view |
US20110279683A1 (en) * | 2010-05-17 | 2011-11-17 | Edward John Yarmchuk | Automatic Motion Triggered Camera with Improved Triggering |
US20130135499A1 (en) * | 2011-11-28 | 2013-05-30 | Yong-Bae Song | Method of eliminating a shutter-lag, camera module, and mobile device having the same |
US20140221051A1 (en) * | 2011-09-21 | 2014-08-07 | Nec Casio Mobile Communications, Ltd. | Portable Terminal Device and Program |
US20160212329A1 (en) * | 2015-01-19 | 2016-07-21 | Microsoft Technology Licensing, Llc | Profiles Identifying Camera Capabilities That Are Usable Concurrently |
US20160360116A1 (en) * | 2015-06-07 | 2016-12-08 | Apple Inc. | Devices and Methods for Capturing and Interacting with Enhanced Digital Images |
US20160360097A1 (en) * | 2015-06-07 | 2016-12-08 | Apple Inc. | Devices and Methods for Capturing and Interacting with Enhanced Digital Images |
US20160360382A1 (en) * | 2015-05-27 | 2016-12-08 | Apple Inc. | Systems and Methods for Proactively Identifying and Surfacing Relevant Content on a Touch-Sensitive Device |
US9578159B2 (en) * | 2011-06-20 | 2017-02-21 | Prasad Muthukumar | Fisheye lens based proactive user interface for mobile devices |
US9603524B2 (en) * | 2012-06-22 | 2017-03-28 | Fitbit, Inc. | Portable biometric monitoring devices and methods of operating same |
US20170169295A1 (en) * | 2015-12-15 | 2017-06-15 | Samsung Electronics Co., Ltd. | Method, storage medium and electronic apparatus for providing service associated with image |
US20180120935A1 (en) * | 2013-06-11 | 2018-05-03 | Samsung Electronics Co., Ltd. | Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device |
US20190037173A1 (en) * | 2016-02-02 | 2019-01-31 | Samsung Electronics Co., Ltd. | Method and apparatus for providing image service |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9576285B2 (en) * | 2002-10-01 | 2017-02-21 | Dylan T X Zhou | One gesture, one blink, and one-touch payment and buying using haptic control via messaging and calling multimedia system on mobile and wearable device, currency token interface, point of sale device, and electronic payment card |
FI117308B (en) * | 2004-02-06 | 2006-08-31 | Nokia Corp | gesture Control |
US7633076B2 (en) * | 2005-09-30 | 2009-12-15 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
CN100361138C (en) | 2005-12-31 | 2008-01-09 | 北京中星微电子有限公司 | Method and system of real time detecting and continuous tracing human face in video frequency sequence |
US8189100B2 (en) * | 2006-07-25 | 2012-05-29 | Qualcomm Incorporated | Mobile device with dual digital camera sensors and methods of using the same |
US8446398B2 (en) | 2009-06-16 | 2013-05-21 | Intel Corporation | Power conservation for mobile device displays |
ES2530019T3 (en) | 2011-05-24 | 2015-02-25 | Huawei Device Co., Ltd. | Method and apparatus for reducing power consumption of mobile phone and mobile phone |
KR101909630B1 (en) * | 2012-10-30 | 2018-10-18 | 삼성전자주식회사 | Method and apparatus of recognizing a motion |
US20140365981A1 (en) * | 2013-06-11 | 2014-12-11 | Voxer Ip Llc | Motion control of mobile device |
US9489051B2 (en) * | 2013-07-01 | 2016-11-08 | Blackberry Limited | Display navigation using touch-less gestures |
CN103677267A (en) | 2013-12-09 | 2014-03-26 | 惠州Tcl移动通信有限公司 | Mobile terminal and awakening method and device thereof |
TW201743241A (en) * | 2016-06-01 | 2017-12-16 | 原相科技股份有限公司 | Portable electronic device and operation method thereof |
US10630888B2 (en) * | 2017-02-09 | 2020-04-21 | Samsung Electronics Co., Ltd. | Method and apparatus for selecting capture configuration based on scene analysis |
-
2016
- 2016-06-01 TW TW105117190A patent/TW201743241A/en unknown
- 2016-12-07 US US15/371,909 patent/US20170351908A1/en not_active Abandoned
-
2021
- 2021-05-28 US US17/334,600 patent/US11756331B2/en active Active
-
2023
- 2023-07-24 US US18/225,443 patent/US20230368572A1/en active Pending
Patent Citations (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6970183B1 (en) * | 2000-06-14 | 2005-11-29 | E-Watch, Inc. | Multimedia surveillance and monitoring system including network configuration |
US20040212678A1 (en) * | 2003-04-25 | 2004-10-28 | Cooper Peter David | Low power motion detection system |
US20060215022A1 (en) * | 2005-03-25 | 2006-09-28 | Yongyouth Damabhorn | A security camera and monitor system activated by motion sensor and body heat sensor for homes or offices |
US7806604B2 (en) * | 2005-10-20 | 2010-10-05 | Honeywell International Inc. | Face detection and tracking in a wide field of view |
US20110279683A1 (en) * | 2010-05-17 | 2011-11-17 | Edward John Yarmchuk | Automatic Motion Triggered Camera with Improved Triggering |
US9578159B2 (en) * | 2011-06-20 | 2017-02-21 | Prasad Muthukumar | Fisheye lens based proactive user interface for mobile devices |
US20140221051A1 (en) * | 2011-09-21 | 2014-08-07 | Nec Casio Mobile Communications, Ltd. | Portable Terminal Device and Program |
US20130135499A1 (en) * | 2011-11-28 | 2013-05-30 | Yong-Bae Song | Method of eliminating a shutter-lag, camera module, and mobile device having the same |
US9603524B2 (en) * | 2012-06-22 | 2017-03-28 | Fitbit, Inc. | Portable biometric monitoring devices and methods of operating same |
US20180120935A1 (en) * | 2013-06-11 | 2018-05-03 | Samsung Electronics Co., Ltd. | Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device |
US20160212329A1 (en) * | 2015-01-19 | 2016-07-21 | Microsoft Technology Licensing, Llc | Profiles Identifying Camera Capabilities That Are Usable Concurrently |
US20160360382A1 (en) * | 2015-05-27 | 2016-12-08 | Apple Inc. | Systems and Methods for Proactively Identifying and Surfacing Relevant Content on a Touch-Sensitive Device |
US20160360097A1 (en) * | 2015-06-07 | 2016-12-08 | Apple Inc. | Devices and Methods for Capturing and Interacting with Enhanced Digital Images |
US20160360116A1 (en) * | 2015-06-07 | 2016-12-08 | Apple Inc. | Devices and Methods for Capturing and Interacting with Enhanced Digital Images |
US20170169295A1 (en) * | 2015-12-15 | 2017-06-15 | Samsung Electronics Co., Ltd. | Method, storage medium and electronic apparatus for providing service associated with image |
US20190037173A1 (en) * | 2016-02-02 | 2019-01-31 | Samsung Electronics Co., Ltd. | Method and apparatus for providing image service |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10757377B2 (en) | 2016-06-01 | 2020-08-25 | Pixart Imaging Inc. | Surveillance system and operation method thereof |
US10158797B2 (en) * | 2017-03-31 | 2018-12-18 | Motorola Mobility Llc | Combining images when a face is present |
US20190306490A1 (en) * | 2018-03-29 | 2019-10-03 | Beijing Boe Optoelectronics Technology Co., Ltd. | 3d display device, method for controlling the same and computing device |
US10764568B2 (en) * | 2018-03-29 | 2020-09-01 | Beijing Boe Optoelectronics Technology Co., Ltd. | 3D display device, method for controlling the same and computing device |
US20210073541A1 (en) * | 2018-05-22 | 2021-03-11 | Vivo Mobile Communication Co., Ltd. | Object recognition method and mobile terminal |
JP2021524203A (en) * | 2018-05-22 | 2021-09-09 | 維沃移動通信有限公司Vivo Mobile Communication Co., Ltd. | Object recognition method and mobile terminal |
JP7221305B2 (en) | 2018-05-22 | 2023-02-13 | 維沃移動通信有限公司 | Object recognition method and mobile terminal |
US11144749B1 (en) * | 2019-01-09 | 2021-10-12 | Idemia Identity & Security USA LLC | Classifying camera images to generate alerts |
US11682233B1 (en) * | 2019-01-09 | 2023-06-20 | Idemia Identity & Security USA LLC | Classifying camera images to generate alerts |
US20220366722A1 (en) * | 2021-05-12 | 2022-11-17 | Lenovo (Singapore) Pte. Ltd. | Electronic apparatus and control method |
Also Published As
Publication number | Publication date |
---|---|
US20210289136A1 (en) | 2021-09-16 |
TW201743241A (en) | 2017-12-16 |
US20230368572A1 (en) | 2023-11-16 |
US11756331B2 (en) | 2023-09-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11756331B2 (en) | Portable electronic device and operation method | |
US9921658B2 (en) | Device and method for detecting gestures on the skin | |
CN105208191B (en) | Mode switching method and device | |
US10824844B2 (en) | Fingerprint acquisition method, apparatus and computer-readable storage medium | |
US9426187B2 (en) | Device with TV phone function, non-transitory computer readable storage medium, and control method of device with TV phone function | |
US20100103303A1 (en) | Method for displaying image by virtual illumination and portable terminal using the same | |
TW200509650A (en) | Mobile phone with image recognition function | |
JP2008227672A (en) | Mobile terminal, power saving control method and power saving control program | |
US8643771B2 (en) | Electronic device and control method for controlling powering-saving state of electronic device | |
KR101696383B1 (en) | Lobby Phone | |
US20150055003A1 (en) | Portable electronic device | |
JP2014020790A (en) | Information terminal | |
KR100613063B1 (en) | Apparatus for sensing illumination by using image sensor and method thereof | |
US20190258843A1 (en) | Electronic device and control method | |
CN107516028B (en) | Portable electronic device and operation method thereof | |
KR100778927B1 (en) | Device capable of recognizing non-contact key selection and method thereof | |
CN104822017A (en) | Photographing control method and apparatus | |
EP3789849A1 (en) | Contactless gesture control method, apparatus and storage medium | |
KR20130037939A (en) | Image recognition device and method for improving image recognition rate | |
US20040242184A1 (en) | Camera arrangement | |
CN111382406B (en) | Fingerprint unlocking method and device | |
JP2002335501A (en) | Portable display device | |
KR100687690B1 (en) | Digital processing apparatus capable of inputting data using camera and inputting method thereof | |
CN118312940A (en) | Operation method for portable electronic device | |
CN118312941A (en) | Portable electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: PIXART IMAGING INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WANG, GUO-ZHEN;LIN, HAN-CHANG;REEL/FRAME:040592/0492 Effective date: 20161202 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |