TWI817262B - Electronic device and operating environment setting method using the same - Google Patents

Abstract

An electronic device includes a camera and a processor. The camera is configured to capture a to-be-recognized face image and a to-be-recognized object image. The processor is configured to: determine whether the to-be-recognized face image has a recorded facial feature; when the to-be-recognized object image has the recorded facial feature, determine whether the to-be-recognized object image has a recorded object feature; and when the to-be-recognized object image has the recorded object feature, an operation environment setting mode corresponding to the recorded facial feature and the recorded object feature is enabled.

Description

Electronic device and operating environment setting method for applying the same

Embodiments of the present invention relate to an electronic device and an operating environment setting method using the same.

Users can activate different software and hardware as needed. For example, when a user wants to play a computer game, he needs to open the game software, brighten the screen display brightness, increase the speaker volume, etc. However, different users will have different settings, and even the same user will have different settings due to different software being opened. Therefore, proposing a new operating environment switching mechanism to increase the efficiency of operating environment setting is one of the goals of industry players in this technical field.

Embodiments of the present invention relate to an electronic device and an operating environment setting method using the same, which can improve the aforementioned conventional problems.

According to an embodiment of the present invention, an electronic device is provided. The electronic device includes a camera and a processor. The camera is used to capture a face image to be identified and an object image to be identified. The processor is used to: determine whether the face image to be recognized has a recorded facial feature; when the face image to be recognized has a recorded face feature, Determine whether the image of the object to be recognized has a recorded object feature; and, when the image of the object to be recognized has a recorded object feature, activate an operating environment setting mode corresponding to the recorded face feature and the recorded object feature.

According to another embodiment of the present invention, an operating environment setting method is provided. The operating environment setting method includes the following steps. Capture a face image to be identified and an object image to be identified; determine whether the face image to be identified has a recorded facial feature; when the face image to be identified has a recorded face feature, determine whether the object image to be identified has a recorded object feature; and, when the image of the object to be recognized has the recorded object feature, an operating environment setting mode corresponding to the recorded face feature and the recorded object feature is activated.

In order to have a better understanding of the above and other aspects of the present invention, examples are given below and are described in detail with reference to the accompanying drawings:

100: Electronic devices

110:Camera

120: Processor

130:Screen

C1: Face name input field

C2: Object name input field

M1: Operating environment setting mode

P1: Face image to be recognized

P2: Image of the object to be identified

P1r: Facial features have been recorded

P2r: Recorded object characteristics

P1s: face image to be recorded

P2s: image of object to be recorded

S110~S1392: Steps

U1: User interface

FIG. 1 illustrates a functional block diagram of an electronic device 100 according to an embodiment of the present invention.

Figures 2A-2B illustrate a flow chart of the operating environment setting method of the electronic device in Figure 1.

Figure 3 shows a schematic diagram of a user's face image to be recognized and an object to be recognized image of an object to be recognized.

Please refer to FIG. 1 , which illustrates a functional block diagram of an electronic device 100 according to an embodiment of the present invention. The electronic device 100 is, for example, an electronic device equipped with a camera lens, such as a notebook computer, a tablet computer, or a desktop computer.

The electronic device 100 includes a camera 110, a processor 120 and a screen 130. The camera 110 is used to capture the face image P1 to be recognized and the object image P2 to be recognized. The processor 120 is used to: (1). Determine whether the face image P1 to be recognized has (or matches) the recorded (registered) face feature P1r; (2). When the face image P1 to be recognized has (or matches) The recorded facial feature P1r is used to determine whether the object image P2 to be recognized has the recorded (trained) object feature P2r; and (3). When the object image P2 to be recognized has the recorded object feature P2r, enable the corresponding recorded facial feature The operating environment setting mode M1 of P1r and recorded object characteristics P2r. In this way, users do not need to waste time manually opening/changing operation settings. Specifically, the user only needs to allow the electronic device 100 to pre-record the face image and object image, and establish the relationship between the image and the operation settings in advance. After the electronic device 100 obtains the face image and object image, the operation will be automatically loaded. settings.

The aforementioned recorded facial features P1r are, for example, facial feature points obtained by the electronic device 100 through machine learning of human faces in advance, and the aforementioned recorded object features P2r are, for example, obtained by the electronic device 100 through machine learning of objects to be identified in advance. The characteristic points of the object.

The flow of the method for setting the operating environment of the electronic device 100 is further described below.

Please refer to Figures 2A~2B and 3. Figures 2A~2B illustrate a flow chart of the operating environment setting method of the electronic device 100 in Figure 1, and Figure 3 illustrates the user's face image P1 to be recognized and the face image to be recognized. A schematic diagram of the object image P2 to be identified.

In step S110, the camera 110 captures the face image P1 to be recognized and the object image P2 to be recognized. Specifically, as shown in Figure 3, the user's face and the object to be recognized can be located within the imaging range of the camera 110 of the electronic device 100, allowing the camera 110 to capture the face image P1 and the face to be recognized. Image P2 of the object to be identified. The objects to be identified are, for example, the user's personal identification card, objects that can represent the software to be executed, such as trademarks, joysticks, etc. Embodiments of the present invention do not limit the geometric form, type and/or quantity of objects to be identified.

In step S120, the processor 120 determines whether the face image P1 to be recognized has the recorded face feature P1r. If the face image P1 to be recognized has (or matches) the recorded face feature P1r, it means that the user's face has been recorded (previously successfully registered), so the process proceeds to step S121. In step S121, the processor 120 determines whether the object image P2 to be identified has (or matches) the recorded object feature P2r. If the image P2 of the object to be recognized has the recorded object feature P2r, it means that the object to be recognized has been recorded (previously trained successfully), and the processor 120 has established an operating environment setting mode M1 corresponding to the user's face and the object to be recognized. , so the process proceeds to step S122, where the processor 120 activates the operating environment setting mode M1 corresponding to the face image P1 to be recognized and the object image P2 to be recognized.

The operating environment setting mode M1 includes opening software, settings of the opened software, opening hardware and/or settings of the opened hardware, etc. The software can be various software that users need, such as email software, video conferencing software, instant messaging software, game software, browsers, audio and video playback software, word processing software, etc. The settings of the opened software include these All function settings of the software. Hardware is, for example, the hardware of the electronic device itself and/or the devices connected to it, such as processors, graphics processing units (GPU), fans, screens, speakers (speakers), etc., and the settings of the hardware that are turned on Including all functional settings of these hardware, such as processing clock, volume, sound effect mode, brightness of the screen displayed, air volume, etc.

In one embodiment, when the object to be identified is a personal identification card, the processor 120 can open email software, open video conferencing software and set it to the online state, open Lync communication software and set it to the online state, virtual private network ( Virtual Private Network (VPN) automatically logs in and/or closes Line communication software, etc. When the object to be recognized is a joystick, the processor 120 may increase the operating clock of the graphics processor, increase the fan speed, and/or close other non-game software. When the object to be identified is the trademark of the video streaming service provider, the processor 120 can open the video streaming service software, increase the screen display brightness and/or adjust the sound effect mode to movie mode, etc. However, embodiments of the present invention are not limited to the specific settings of the operating environment setting mode corresponding to the face and the object to be recognized, which may include any software type and its functions and/or parameter settings and/or any hardware type and its functions and /or parameter settings.

In step S120, if the face image P1 to be recognized does not have the recorded face feature P1r, the process proceeds to step S131.

In step S131, the processor 120 sends an enable user record inquiry message. In step S132, the processor 120 determines whether the instruction responding to the enable user record inquiry message is an consent instruction. When the response is disagreement with the instruction, the process ends. When the response is an consent instruction, it means that the user agrees to record his or her face, and the process proceeds to step S133. In another embodiment, the process may also omit steps S131 and S132.

In step S133, the processor 120 controls the camera 110 to capture the user's face image P1s to be recorded based on the consent instruction. For example, the user's face can be located within the imaging range of the camera 110 (eg, facing the camera 110), allowing the camera 110 to capture the user's face image P1s to be recorded.

In addition, the processor 120 can respond to the input command of the face name (or user name) of the face image P1s to be recorded, and record the face name. Specifically, as shown in FIG. 3 , the processor 120 can control the screen 130 to display a face name input field C1 for the user to input a face name. After the user inputs the face name, the processor 120 records the face name corresponding to the face image P1s to be recorded.

In step S134, the processor 120 uses appropriate image analysis technology to obtain the facial features of the face image P1s to be recorded. The facial features include, for example, several facial feature points, such as inter-pupillary distance, etc. Image analysis technology is, for example, Artificial Intelligence (AI) image recognition technology, such as Convolutional Neural Networks (CNN), neural network-like structures (such as Softmax function) and/or other suitable image learning /Identification technology. In step S135, the processor 120 records the facial features. The recorded facial features become one of at least one recorded facial feature P1r. Each recorded facial feature P1r represents a user's identity recognition data. As more users register, the number of recorded facial features P1r increases. Although not shown, the electronic device 100 may further include a database, which may be located inside or outside the processor 120 . The processor 120 may store the recorded facial features P1r in the database.

After step S135, the process proceeds to step S123 in Figure 2B, where the processor 120 sends an enable object record inquiry message. In step S124, the processor 120 determines back The object recording should be enabled to ask whether the message is an consent command; when the response is a disagree command, the process ends; when the response is an consent command, it means that the user agrees to record his object, and the process proceeds to step 136. In another embodiment, the process may also omit steps S123 and S124.

In addition, the processor 120 can respond to the input command of the object name of the object image P2s to be recorded, and record the object name. Specifically, as shown in FIG. 3 , the processor 120 can control the screen 130 to display an object name input field C2 for the user to input the object name. After the user inputs the object name, the processor 120 records the object name corresponding to the object image P2s to be recorded.

In step S136, the processor 120 controls the camera 110 to capture the object image P2s to be recorded according to the consent command in response to the enable object recording inquiry message. For example, the object may be located within the imaging range of the camera 110 (eg, facing the camera 110), allowing the camera 110 to capture the image P2s of the object to be recorded. Then, in step S137, the processor 120 may use the aforementioned image analysis technology to obtain the object characteristics of the object image P2s to be recorded. Object features include, for example, several object feature points, such as the size, shape and other geometric features of the object. In step S138, the processor 120 records the object characteristics, and the recorded object characteristics become at least one of the recorded object characteristics P2r. Each recorded object feature P2r represents the identification data of an object to be identified. In addition, the processor 120 may store the recorded object characteristics P2r in the database. As more objects are trained, the number of recorded object features P2r increases.

In step S139, the processor 120 establishes a corresponding relationship between the recorded facial features P1r and the recorded object features P2r and the operating environment setting mode M1. For example, in step S1391, the processor 120 may generate a user interface U1, and the user interface U1 includes several operation setting options; in step S1392, the processor 120 responds to this The selection instruction of the operation setting option is to set the selected at least one operation setting option to the operation environment setting mode M1 corresponding to the aforementioned recorded face feature P1r and recorded object feature P2r. The aforementioned selection instructions can be generated by the user after selecting the operation setting option. The operation setting options include, for example, the aforementioned software type, settings of the opened software, hardware type, and/or settings of the opened hardware. In one embodiment, the user interface U1 is, for example, a menu screen, and the screen 130 can display the user interface U1 for the user to select.

In another embodiment, the processor 120 can also directly use the face image P1 to be recognized obtained in step S110 to obtain the face features. In this case, the process can omit step S133 in Figure 2A. However, in step S134, when the processor 120 cannot obtain facial features from the face image P1 to be recognized, the processor 120 then controls the camera 110 to capture another face image P1s of the user to be recorded.

In summary, embodiments of the present invention provide an electronic device and an operating environment setting method using the same, which can capture face images and object images, and enable operating environment setting modes corresponding to the face images and object images. In this way, users do not need to waste time manually opening software, hardware and settings.

In summary, although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Those with ordinary knowledge in the technical field to which the present invention belongs can make various modifications and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the appended patent application scope.

100: Electronic devices

110:Camera

120: Processor

130:Screen

P1: Face image to be recognized

P2: Image of the object to be identified

P1r: Facial features have been recorded

P2r: Recorded object characteristics

P1s: face image to be recorded

P2s: image of object to be recorded

U1: User interface

Claims (12)

An electronic device, including: a camera used to capture a face image of a user's face to be identified and an object to be identified image of an object to be identified; a processor used to: determine the person to be identified Whether the face image has a recorded facial feature; when the face image to be recognized has the recorded face feature, determine whether the object image to be recognized has a recorded object feature; and when the object image to be recognized has the recorded object feature Record the object characteristics and activate an operating environment setting mode corresponding to the recorded facial characteristics and the recorded object characteristics; wherein, the operating environment setting mode includes opening the software, settings of the opened software, opening hardware and/or opening Hardware settings; where the object to be identified includes a trademark or a joystick. The electronic device as described in claim 1, wherein the processor is further used to: when the face image to be recognized does not have the recorded facial features, send an activated user record inquiry message; and respond to the activated user record according to One of the consent instructions in the query message controls the camera to capture a face image to be recorded; obtain facial features of the face image to be recorded; and record the facial features so that the facial features become the recorded face. Characteristics. The electronic device as described in claim 2, wherein the processor is further used to: send an enabled object record inquiry message; and control the camera to capture an image of an object to be recorded according to a consent instruction in response to the enabled object record inquiry message. ; Obtain an object characteristic of the image of the object to be recorded; and record the object characteristic so that the object characteristic becomes the recorded object characteristic. The electronic device as described in claim 3, wherein the processor is further used to: establish a correspondence between the recorded facial features and the recorded object features and the operating environment setting mode. The electronic device as described in claim 2, wherein the processor is further configured to: respond to an input command of a face name of the face image to be recorded and an input command of an object name of the recorded object feature, record the face name and the name of the object. The electronic device as described in claim 4, wherein the processor is further used to: output a user interface, the user interface includes a plurality of operation setting options; and respond to a selection command of an operation setting option, selecting at least - The operation setting option is set to the operation environment setting mode. An operating environment setting method includes: a camera captures a face image to be recognized and an object image to be recognized; a processor determines whether the face image to be recognized has a recorded face feature; When the face image to be recognized has the recorded face feature, the processor determines whether the object image to be recognized has a recorded object feature; and when the object image to be recognized has the recorded object feature, the processor activates An operating environment setting mode corresponding to the recorded facial features and the recorded object features, wherein the operating environment setting mode includes opening the software, settings of the opened software, opening hardware, and/or settings of the opened hardware; wherein , the object to be identified includes a trademark or rocker. The operating environment setting method as described in claim 7 further includes: when the face image to be recognized does not have the recorded facial features, the processor sends an enable user record inquiry message; in response to the enable user record According to a consent instruction in the query message, the processor controls the camera to capture a face image to be recorded; the processor obtains facial features of the face image to be recorded; and the processor records the facial features so that the The facial features become the recorded facial features. The operating environment setting method as described in claim 8 further includes: the processor sending an enable object record inquiry message; The processor controls the camera to capture an image of an object to be recorded according to a consent instruction in response to the enable object recording inquiry message; obtains the object characteristics of the image of the object to be recorded; and records the object characteristics so that the object characteristics become The recorded object characteristics. The operating environment setting method described in claim 9 further includes: establishing a correspondence between the recorded facial features and the recorded object features and the operating environment setting mode. The operating environment setting method as described in claim 8 further includes: in response to an input command of a face name of the face image to be recorded and an input command of an object name of the recorded object characteristics, the processor records the face name and the name of the object. The operating environment setting method as described in claim 11 further includes: the processor outputting a user interface, the user interface including a plurality of operating setting options; and in response to a selection command of an operating setting option, the processor Select at least one of the operation setting options to set the operation environment setting mode.

Images