TW202113552A - Control method of mobile device and mobile device - Google Patents

Abstract

A control method of a mobile device and the communication are provided. The control method includes: detecting a calling signal of the mobile device; activating a camera lens of the mobile device and obtaining at least one image by the camera lens in response to the calling signal; analyzing the image by an image recognition module to identify a behavior of a user that moves the mobile device in response to the calling signal; and controlling the mobile device according to the identified behavior.

Description

Control method of mobile device and mobile device

The present invention relates to a control technology of a mobile device, and particularly relates to a control method of a mobile device and a mobile device.

With the advancement of technology, the use of mobile devices has become more and more popular. Users can communicate and interact with others via mobile devices anytime, anywhere. However, in some cases, when there is an incoming call, it may be inconvenient for the user to operate the phone by tapping or pressing. For example, if the user wears gloves or his fingers are wet, the user may not be able to easily operate the mobile device (such as Switch the call mode of the phone from the preset mode to the amplification mode).

The present invention provides a control method of a mobile device and a mobile device, which can effectively improve the above-mentioned problems.

An embodiment of the present invention provides a control method of a mobile device, which includes: detecting an incoming call signal of the mobile device; in response to the incoming call signal, activating a camera lens of the mobile device and capturing at least one image through the camera lens Analyze the image by the image recognition module to recognize the behavior of the user moving the mobile device in response to the incoming call signal; and control the mobile device according to the recognized behavior.

An embodiment of the present invention further provides a mobile device, which includes a photographing lens, a communication circuit, and a processor. The processor is coupled to the photographing lens and the communication circuit. The communication circuit is used to detect incoming call signals. The processor is used for activating the photographing lens in response to the incoming call signal and capturing at least one image through the photographing lens. The processor is further used for analyzing the image through the image recognition module to recognize the behavior of the user moving the mobile device in response to the incoming call signal. The processor is further configured to control the mobile device according to the recognized behavior.

Based on the above, after detecting the incoming call signal of the mobile device, in response to the incoming call signal, the camera lens of the mobile device can be activated to capture images. The image recognition module can analyze the image to recognize the behavior of the user moving the mobile device in response to the incoming call signal. Then, the mobile device can be automatically controlled according to the recognized behavior. In this way, even if the user is currently inconvenient to operate the mobile device by clicking or pressing, the mobile device can be effectively controlled, thereby effectively improving the user experience.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail in conjunction with the accompanying drawings.

FIG. 1 is a functional block diagram of a mobile device according to an embodiment of the invention. Please refer to FIG. 1, the mobile device 10 includes a camera lens 11, a communication circuit 12, an input/output device 13, a processor 14 and an image recognition module 15. The mobile device 10 may be a variety of handheld communication devices supporting mobile call functions, such as a smart phone or a tablet computer. The photographic lens 11 is used to capture images. For example, the photographing lens 11 includes at least one optical lens and at least one photosensitive element. The number of photographing lenses 11 may be one or more. It should be noted that the invention does not limit the type and number of photographic lenses 11.

The communication circuit 12 is used to perform long-distance wireless communication. For example, the communication circuit 12 may have circuits for wireless communication, such as an antenna, a wireless receiver, and a wireless transmitter, to send and receive wireless signals. In one embodiment, the communication circuit 12 can perform voice communication through a public switched telephone network (PSTN) or similar communication protocol. Alternatively, in one embodiment, the communication circuit 12 may also support VoIP (Voice over Internet Protocol) or similar technology to perform voice calls based on the Internet protocol. In addition, the communication circuit 12 can also support various wireless communication technologies, such as cellular network, WiFi, third-generation mobile communication technology (3G), fourth-generation mobile communication technology (4G) and/or fifth-generation mobile communication technology (5G), etc., the present invention is not limited.

The input/output device 13 may include interface devices such as a screen, a touch screen, a touchpad, a mouse, a keyboard, physical buttons, a speaker, a microphone, etc., to receive signals input by a user or output signals, and the input/output device 13 The type is not limited to this. The processor 14 is coupled to the photographing lens 11, the communication circuit 12 and the input/output device 13. The processor 14 can be a central processing unit (CPU), a graphics processing unit (GPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors, programmable controllers, and special-application integrated circuits. Circuits, programmable logic devices or other similar devices or combinations of these devices. The processor 14 can be used to control the photographic lens 11, the communication circuit 12 and the input/output device 13. In an embodiment, the processor 14 may also control the whole or part of the operation of the mobile device 10.

The image recognition module 15 is coupled to the processor 14. The image recognition module 15 can be implemented as a software module, a firmware module, or a hardware circuit. In one embodiment, the image recognition module 15 may include at least one graphics processor or similar processing chip to perform machine vision image recognition. In addition, the image recognition module 15 can also be combined with the processor 14 into a single chip or chipset. Alternatively, in one embodiment, the image recognition module 15 is a program code that can be executed by the processor 14. In addition, the image recognition module 15 can have an artificial intelligence architecture such as machine learning and/or deep learning, and can continuously improve its image recognition performance through training.

The communication circuit 12 can detect the incoming call signal and notify the processor 14. For example, when a remote user makes a call to the user of the mobile device 10 through a traditional phone or Internet phone, the communication circuit 12 can detect the incoming call signal corresponding to the incoming call. For example, the incoming call signal may reflect the remote user name, source phone number, and/or source IP address of the incoming call. In addition, the screen or touch screen in the input/output device 13 can display incoming call information such as the name of the remote user, the image screen of the remote user, the source phone number and/or the source IP address.

The processor 14 can activate the camera lens 11 in response to the incoming call signal and capture at least one image through the camera lens 11. For example, before receiving the incoming call signal, the camera lens 11 may be turned off or disabled to save power consumption and protect user privacy. In response to the incoming call signal, the processor 14 can switch the camera lens 11 to an on or enabled state to capture images. Then, the processor 14 can analyze the image captured by the camera lens 11 through the image recognition module 15 to recognize the behavior of the user of the mobile device 10 (also referred to as the target user) moving the mobile device 10 in response to the incoming call signal. Then, the processor 14 can automatically control the mobile device according to the recognized behavior.

2 is a schematic diagram of a user holding a mobile device and incoming call information according to an embodiment of the present invention. 1 and 2, the user (ie, the target user) 21 can hold the mobile device 10 by hand. The camera lens 201 can be disposed on the front of the mobile device 10 and located on the side of the screen 202 (for example, above). For example, the photographic lens 201 is also called a front lens. When the communication circuit 12 detects an incoming call, the screen 202 can display the incoming call information related to the incoming call (for example, Kevin's incoming call). Then, the user 21 can choose to answer or hang up the incoming call. If the user chooses to answer the incoming call, the user can further choose to answer the incoming call in the handset mode (also known as the normal call mode) or the loudspeaker mode and perform the voice call. The preset output volume of the speaker of the mobile device 10 in the earpiece mode will be lower than the preset output volume of the speaker of the mobile device 10 in the sound reinforcement mode.

Fig. 3 is a schematic diagram illustrating a call in the earpiece mode according to an embodiment of the present invention. Referring to FIG. 3, in one embodiment, when receiving an incoming telecom signal, the user 21 may hold the mobile device 10 next to the ear and talk with a remote user (such as Kevin in FIG. 2) based on the earpiece mode. At this time, both the camera lens 201 and the screen 202 will face the side face of the user 21 (ie, near the ear). Therefore, when the user wants to talk to a remote user in the earpiece mode, the image captured by the camera lens 201 may include the image of the facial features of the side face of the user 21 (for example, the ear 301).

In one embodiment, the processor 14 can analyze the image captured by the camera lens 201 through the image recognition module 15 to recognize whether the user 21 wants to answer the call. For example, suppose that the behavior of the user 21 moving the mobile device 10 is to move the mobile device 10 toward the ear 301 of the user 21 after detecting the incoming telegram, the captured image may include the side face of the user 21 At least a partial pattern of facial features (e.g. ears 301). The processor 14 can recognize these patterns through the image recognition module 15. If the recognition result reflects that the captured image contains these patterns, it means that the behavior of the user 21 to move the mobile device 10 is to move the mobile device 10 toward the ear 301 of the user 21. Therefore, the processor 14 can determine that the user 21 wants to answer the incoming call and can automatically connect the incoming call. Conversely, if the recognition result reflects that the captured image does not contain such patterns, the processor 14 may not act.

In one embodiment, if the processor 14 analyzes the captured image through the image recognition module 15 and determines that the user 21 wants to answer the call (for example, the captured image includes at least part of the side face of the user 21). Part features), the processor 14 can further set the call mode of the incoming call to the handset mode. In this way, after detecting the incoming call signal, the user 21 only needs to naturally move the mobile device 10 near the ear 301, the call can be automatically connected and the user 21 can directly answer the call in the earpiece mode.

In one embodiment, after detecting the incoming call signal, the user 21 may also manually select and connect to the incoming call (for example, perform a specific operation gesture). After the incoming call is connected, the processor 14 can analyze the image captured by the photographic lens 201 through the image recognition module 15. If the analysis result (that is, the image recognition result) reflects that the behavior of the user 21 moving the mobile device 10 is to move the mobile device 10 toward the ear 301 of the user 21 (for example, the captured image contains at least part of the side face of the user 21). Facial features), the processor 14 can automatically set the call mode to the earpiece mode.

In other words, even if the default call mode of the mobile device 10 is the loudspeaker mode before answering an incoming call, after the user 21 moves the mobile device 10 near the ear 301, the call mode of the mobile device 10 can be automatically changed from the loudspeaker mode Switch to handset mode. In this way, the convenience of the user when answering an incoming call can be effectively improved. In addition, by automatically adjusting the call mode of the mobile device 10 from the loudspeaker mode to the earpiece mode, it is possible to reduce the risk to the user due to the loudness of the loudspeaker sound at the moment of answering the call because the default is to answer the call in the loudspeaker mode. Damage to the ears.

Fig. 4 is a schematic diagram illustrating a call in a loudspeaker mode according to an embodiment of the present invention. Referring to FIG. 4, in one embodiment, when receiving an incoming telegram, the user 21 may also turn the screen 202 of the mobile device 10 toward the front of the face of the user 21 based on the loudspeaker mode and the remote user Make a call. At this time, both the camera lens 201 and the screen 202 will face the front of the user 21's face. Therefore, when a user wants to talk to a remote user in a loudspeaker mode, the image captured by the camera lens 201 may contain the facial features of the front face of the user 21 (such as eyes, pupils, eyebrows). , Nostrils and/or mouth).

In one embodiment, after the incoming call is selected (for example, the answer button 203 displayed on the screen 202 is clicked), the processor 14 can analyze the image captured by the photographic lens 201 through the image recognition module 15. If the analysis result (that is, the image recognition result) reflects that the behavior of the user 21 moving the mobile device 10 is to point the screen 202 of the mobile device 10 toward the front of the face of the user 21 (for example, the captured image contains the face of the user 21). At least part of the facial features on the front side), the processor 14 can automatically set the call mode to the loudspeaker mode.

In other words, even if the default call mode of the mobile device 10 is the handset mode before answering a call, if the user 21 chooses to face the screen 202 of the mobile device 10 toward the front of the user 21's face after answering the call, the mobile device 10 The call mode can be automatically switched from the handset mode to the amplification mode. In this way, the convenience of the user when answering an incoming call can be effectively improved. In addition, by automatically adjusting the call mode of the mobile device 10 from the earpiece mode to the loudspeaker mode, it can be reduced that the volume of the sound emitted by the speaker is too low due to the default earpiece mode to answer incoming calls and missed some conversations.

It should be noted that in the foregoing embodiment, the processor 14 recognizes the behavior of the user moving the mobile device 10 in response to the incoming call signal based on the image recognition technology. Then, the processor 14 can automatically control the mobile device 10 according to the image recognition result to perform actions such as connecting the call, activating the earpiece mode, and/or activating the sound reinforcement mode. In one embodiment, the mobile sensors such as gyroscopes, accelerometers, and/or gravity sensors built in the mobile device 10 are susceptible to unintentional shaking by the user, which may affect the judgment result. Therefore, in one embodiment, when performing image recognition in response to an incoming call signal and automatically controlling the operation of the mobile device 10 according to the result of the image recognition, the processor 14 may not consider the built-in gyroscope, accelerometer, and/or of the mobile device 10 Or the sensing result of a mobile sensor such as a gravity sensor to improve the accuracy of the judgment result.

FIG. 5 is a flowchart of a control method of a mobile device according to an embodiment of the present invention. Please refer to FIG. 5, in step S501, the incoming call signal of the mobile device is detected. In step S502, in response to the incoming call signal, the camera lens of the mobile device is activated and at least one image is captured through the camera lens. In step S503, the image recognition module analyzes the image to recognize the behavior of the user moving the mobile device in response to the incoming call signal. In step S504, the mobile device is controlled according to the recognized behavior.

Fig. 6 is a flowchart of a method for controlling a mobile device according to an embodiment of the present invention. Please refer to FIG. 6, in step S601, the incoming call signal of the mobile device is detected. In step S602, in response to the incoming call signal, the camera lens of the mobile device is activated and at least one image is captured through the camera lens. In step S603, the image recognition module analyzes the image to recognize the behavior of the user moving the mobile device in response to the incoming call signal. In step S604, it is determined whether the behavior is to move the mobile device toward the user's ear. If yes, in step S605, the incoming call is automatically connected and the handset mode is activated. If not, the method can return to step S602.

FIG. 7 is a flowchart of a method for controlling a mobile device according to an embodiment of the present invention. Referring to FIG. 7, in step S701, an incoming call signal of the mobile device is detected. In step S702, it is determined whether the user manually connects the incoming call. If not, step S702 can be repeated. If it is (that is, the user manually answers the call), in step S703, in response to the incoming call signal, the camera lens of the mobile device is activated and at least one image is captured through the camera lens. In step S704, the image recognition module analyzes the image to recognize the behavior of the user moving the mobile device in response to the incoming call signal. In step S705, it is determined whether the behavior is to move the mobile device toward the user's ear. If yes, in step S706, the handset mode is activated. If not, in step S707, the loudspeaker mode is activated.

It should be noted that, in one embodiment, step S705 can also be adjusted to determine whether the behavior is to direct the screen of the mobile device toward the front of the user's face. If so, in step S707, the sound reinforcement mode is activated. If not, in step S706, the handset mode is activated.

However, the steps in FIG. 5, FIG. 6 and FIG. 7 have been described in detail as above, and will not be repeated here. It should be noted that each step in FIG. 5, FIG. 6 and FIG. 7 can be implemented as multiple program codes or circuits, and the present invention is not limited. In addition, the methods in FIG. 5, FIG. 6 and FIG. 7 can be used in conjunction with the above embodiments, or can be used alone, and the present invention is not limited.

In summary, after detecting the incoming call signal of the mobile device, in response to the incoming call signal, the camera lens of the mobile device can be activated to capture images. The image recognition module can analyze the image to recognize the behavior of the user moving the mobile device in response to the incoming call signal. Then, the mobile device can be automatically controlled according to the recognized behavior. In this way, even if the user is inconvenient to use tap or press to select the appropriate answering mode, the mobile device can be effectively controlled to automatically connect the call, activate the handset mode and/or activate the loudspeaker mode, thereby effectively improving User experience.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the relevant technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be determined by the scope of the attached patent application.

10: Mobile device 11.201: Photography lens 12: Communication circuit 13: Input/output device 14: processor 15: Image recognition module 21: User 202: screen 301: Ear S501~S504, S601~S605, S701~S707: steps

FIG. 1 is a functional block diagram of a mobile device according to an embodiment of the invention. 2 is a schematic diagram of a user holding a mobile device and incoming call information according to an embodiment of the present invention. Fig. 3 is a schematic diagram illustrating a call in the earpiece mode according to an embodiment of the present invention. Fig. 4 is a schematic diagram illustrating a call in a loudspeaker mode according to an embodiment of the present invention. FIG. 5 is a flowchart of a control method of a mobile device according to an embodiment of the present invention. Fig. 6 is a flowchart of a method for controlling a mobile device according to an embodiment of the present invention. FIG. 7 is a flowchart of a method for controlling a mobile device according to an embodiment of the present invention.

S501~S504: steps

Claims (10)

A control method of a mobile device includes: Detect an incoming call signal from a mobile device; In response to the incoming call signal, activate a camera lens of the mobile device and capture at least one image through the camera lens; Analyzing the at least one image by an image recognition module to recognize a user's behavior of moving the mobile device in response to the incoming call signal; and Control the mobile device according to the identified behavior. According to the control method of the mobile device described in item 1 of the scope of patent application, the step of controlling the mobile device according to the identified behavior includes: In response to the recognized behavior being to move the mobile device toward an ear of the user, the incoming call is automatically connected. The method for controlling a mobile device as described in item 2 of the scope of patent application, wherein the step of controlling the mobile device according to the identified behavior further includes: In response to the recognized behavior being to move the mobile device toward an ear of the user, a call mode is automatically set to a handset mode. According to the control method of the mobile device described in item 1 of the scope of patent application, the step of controlling the mobile device according to the identified behavior further includes: In response to the call being answered by the user and the recognized behavior is to move the mobile device toward an ear of the user, a call mode is automatically set to a handset mode. According to the control method of the mobile device described in item 1 of the scope of patent application, the step of controlling the mobile device according to the identified behavior includes: In response to the recognized behavior of the incoming call being connected to the user by the user, a screen of the mobile device is directed toward the front of the user's face, and a call mode is automatically set to a loudspeaker mode. A mobile device including: A photographic lens; A communication circuit; and A processor coupled to the photographic lens and the communication circuit, The communication circuit is used to detect an incoming call signal, The processor is used for activating the photographing lens in response to the incoming call signal and capturing at least one image through the photographing lens, The processor is further configured to analyze the at least one image through an image recognition module to recognize a user's behavior of moving the mobile device in response to the incoming call signal, and The processor is further used for controlling the mobile device according to the recognized behavior. For the mobile device described in item 6 of the scope of patent application, the processor controlling the operation of the mobile device according to the identified behavior includes: In response to the recognized behavior being to move the mobile device toward an ear of the user, the incoming call is automatically connected. For the mobile device described in item 7 of the scope of patent application, the processor controlling the operation of the mobile device according to the identified behavior further includes: In response to the recognized behavior being to move the mobile device toward an ear of the user, a call mode is automatically set to a handset mode. For the mobile device described in item 6 of the scope of patent application, the processor controlling the operation of the mobile device according to the identified behavior further includes: In response to the call being answered by the user and the recognized behavior is to move the mobile device toward an ear of the user, a call mode is automatically set to a handset mode. For the mobile device described in item 6 of the scope of patent application, the processor controlling the operation of the mobile device according to the identified behavior includes: In response to the recognized behavior of the incoming call being connected to the user by the user, a screen of the mobile device is directed toward the front of the user's face, and a call mode is automatically set to a loudspeaker mode.

Images