CN109814764B

CN109814764B - Equipment control method and device and electronic equipment

Info

Publication number: CN109814764B
Application number: CN201711168747.8A
Authority: CN
Inventors: 孙长宇
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2017-11-21
Filing date: 2017-11-21
Publication date: 2021-06-29
Anticipated expiration: 2037-11-21
Also published as: CN109814764A

Abstract

The disclosure relates to an equipment control method and device and electronic equipment, which are applied to the electronic equipment provided with a fingerprint identification module; the method comprises the following steps: identifying characteristic points in the skin texture image aiming at the skin texture image of the user collected by the fingerprint identification module; and controlling the electronic equipment according to the position change information of the feature points in the continuously acquired skin texture images.

Description

Equipment control method and device and electronic equipment

Technical Field

The present disclosure relates to the field of terminal technologies, and in particular, to an apparatus control method and apparatus, and an electronic device.

Background

In the related art, a touch panel may be mounted on an electronic device, so that a user can input a sliding gesture through the touch panel, or control a positioning cursor on the electronic device to move, thereby implementing a control operation on the electronic device.

Disclosure of Invention

The present disclosure provides a device control method and apparatus, and an electronic device, to solve the deficiencies in the related art.

According to a first aspect of the embodiments of the present disclosure, an apparatus control method is provided, which is applied to an electronic apparatus provided with a fingerprint identification module; the method comprises the following steps:

identifying characteristic points in the skin texture image aiming at the skin texture image of the user collected by the fingerprint identification module;

and controlling the electronic equipment according to the position change information of the feature points in the continuously acquired skin texture images.

Optionally, the controlling the electronic device according to the position change information of the feature point in the continuously acquired skin texture images includes:

and controlling the screen display content of the electronic equipment according to the position change information.

Optionally, the screen display content includes a positioning cursor; the controlling the screen display content of the electronic device according to the position change information includes:

and performing displacement control or click control on the positioning cursor according to the position change information.

Optionally, the method further includes:

and adjusting the numerical ratio between the position change numerical value of the characteristic point and the moving distance of the positioning cursor.

Optionally, the screen display content includes interface content; the controlling the screen display content of the electronic device according to the position change information includes:

and performing in-page sliding control or inter-page jumping control on the interface content according to the position change information.

and performing function switching or function adjustment on the electronic equipment according to the position change information.

Optionally, the method further includes:

and when the electronic equipment detects the authentication requirement aiming at the user, authenticating the user according to the skin texture image.

According to a second aspect of the embodiments of the present disclosure, an apparatus control device is provided, which is applied to an electronic apparatus provided with a fingerprint identification module; the device comprises:

the identification unit is configured to identify feature points in the skin texture image aiming at the skin texture image of the user acquired by the fingerprint identification module;

a control unit configured to control the electronic device according to position change information of the feature points in the continuously acquired skin texture images.

Optionally, the control unit includes:

and the display content control subunit is configured to control the screen display content of the electronic equipment according to the position change information.

Optionally, the screen display content includes a positioning cursor; the control subunit includes:

and the cursor control module is configured to perform displacement control or click control on the positioning cursor according to the position change information.

Optionally, the method further includes:

an adjusting unit configured to adjust a numerical ratio between a position change numerical value of the feature point and a moving distance of the positioning cursor.

Optionally, the screen display content includes interface content; the control subunit includes:

and the page control module is configured to perform in-page sliding control or inter-page jumping control on the interface content according to the position change information.

Optionally, the control unit includes:

and the device function control subunit is configured to perform function switching or function adjustment on the electronic device according to the position change information.

Optionally, the method further includes:

an authentication unit configured to authenticate the user according to the skin texture image when the electronic device detects an authentication requirement for the user.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a fingerprint identification module; a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method as in any of the above embodiments.

According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method as in any one of the above-mentioned embodiments.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

Fig. 1 is a flow chart illustrating a device control method according to an exemplary embodiment.

Fig. 2 is a schematic perspective view of an electronic device according to an exemplary embodiment.

Fig. 3 is a schematic perspective view of another electronic device according to an exemplary embodiment.

FIG. 4 is a schematic diagram illustrating a captured fingerprint image according to an exemplary embodiment.

FIG. 5A is a schematic diagram illustrating one type of finger motion, according to an exemplary embodiment.

FIG. 5B is a schematic diagram illustrating a captured fingerprint image according to an exemplary embodiment.

Fig. 5C is a diagram illustrating movement control of a positioning cursor according to a fingerprint image according to an exemplary embodiment.

FIG. 6 is a diagram illustrating a recognized click operation according to an exemplary embodiment.

FIG. 7 is a diagram illustrating another recognized click operation in accordance with an exemplary embodiment.

Fig. 8-14 are block diagrams illustrating a device control apparatus according to an exemplary embodiment.

Fig. 15 is a schematic diagram illustrating a configuration of an apparatus for device control according to an example embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

Fig. 1 is a flowchart illustrating an apparatus control method according to an exemplary embodiment, where the method is applied to an electronic apparatus provided with a fingerprint identification module, as shown in fig. 1, and may include the following steps:

in step 102, feature points in the skin texture image are identified for the skin texture image of the user collected by the fingerprint identification module.

In an embodiment, the fingerprint identification module may include any module or component capable of implementing a fingerprint identification function in the related art, such as a capacitive type, a photoelectric type, an ultrasonic type, or other types of fingerprint identification modules, which is not limited by the present disclosure as long as the image resolution can achieve the purpose of identifying the feature points of the skin texture image. For example, the resolution of the fingerprint recognition module is higher than 500DPI (Dots Per Inch) or higher to ensure that the user operation can be accurately recognized.

In an embodiment, the user can place the finger in the collection area of the fingerprint identification module, so that the fingerprint identification module collects the fingerprint image of the user, and the fingerprint image is used as the skin texture image. In other embodiments, the user may place the skin of the palm, arm, or any other part in the collection area of the fingerprint identification module, so that the collection area collects the corresponding skin texture image, which may achieve effective control of the electronic device.

In an embodiment, the user may place an object having a surface texture other than skin in the collection area, so that the fingerprint identification module may collect an image of the surface texture of the object to obtain the skin texture image. According to the theory of operation that the fingerprint identification module adopted, probably only can be applicable to the image acquisition operation that carries out the surface texture to some types of object, for example when the fingerprint identification module is capacitanc, probably can not sense objects such as plastics, timber to can not implement image acquisition to corresponding object, but can respond to human skin, in order to gather corresponding skin texture image.

In step 104, the electronic device is controlled according to the position change information of the feature points in the continuously acquired skin texture images.

In one embodiment, the fingerprint identification module can acquire the skin texture image according to a certain frequency. For example, when a user places a finger in the collection area of the fingerprint identification module and executes a certain action, the fingerprint identification module can collect a plurality of skin texture images in the process that the finger executes the action, and identify a plurality of feature points contained in the skin texture images.

In an embodiment, when the position change information of the feature point in the continuously acquired skin texture images of the frames is unchanged, and it is detected that a plurality of contact-separation operations occur between the finger and the acquisition area within a preset time duration, if the contact-separation operations occur once, it can be considered that the user performs one-click operation, if the contact-separation operations occur twice, it can be considered that the user performs one-double-click operation, and if the contact-separation operations occur three times or more times, it can be considered that the user performs a plurality of-click operations, and the like.

In one embodiment, in order to reduce the erroneous judgment of the user operation and avoid the situation that the user touches the acquisition area unintentionally to form a "contact-separation" operation, the "contact-separation" operation may be changed to a "separation-contact" operation, that is, the user must first place a finger on the acquisition area, and if the "separation-contact" operation further occurs, it is determined that the user is the operation actively performed, and not the unintentional touch.

In an embodiment, when the position change information of the feature point in the continuously acquired skin texture images of a plurality of frames is changed, the operation performed by the user may be determined according to the change rule of the position of the feature point in the skin texture image. For example, when the position of the feature point moves from the upper edge to the lower edge of the skin texture image, it can be determined that the user performs finger sliding from top to bottom on the acquisition area; when the position of the feature point is moved from the left edge to the right edge of the skin texture image, it can be determined that the user has performed finger sliding from left to right on the capture area.

In an embodiment, the image capturing frequency of the fingerprint identification module should reach a preset frequency, so as to ensure that the same feature point can still appear in at least two frames of skin texture images continuously captured at a possible operating speed (for example, not greater than the preset speed) for the user, so as to ensure accurate identification of the user operation.

In an embodiment, the screen display content of the electronic device can be controlled according to the position change information; in other words, through operating the collection region of fingerprint identification module, the user can control the screen display content of electronic equipment.

In one embodiment, the screen display content may include a positioning cursor. According to the position change information, the electronic equipment can carry out displacement control or click control on the positioning cursor.

For example, the user places a finger in the acquisition area of the fingerprint identification module, and slides the finger on the acquisition area, the electronic device can identify a user fingerprint image (i.e., a skin texture image at the finger) acquired by the fingerprint identification module, and determine a sliding operation performed by the user according to a position change of a fingerprint feature point on the user fingerprint image, thereby controlling a display position of a positioning cursor in a screen; for example, when the electronic device recognizes that the sliding operation of the user's finger is sliding from lower left to upper right, the positioning cursor may be controlled to slide along "lower left to upper right" from the located position or a preset specific position.

For another example, according to the recognized triggering operation of the "contact-separation" or "separation-contact" type, if the electronic device detects several triggering operations of the finger on the acquisition area within the preset time length, and the position of the feature point in the continuously acquired skin texture image is unchanged or almost unchanged, it may be determined that the user has performed a click operation on the acquisition area. For example, if the electronic device detects a single trigger operation within a preset time period, it may be determined that the user has performed a click operation, and the electronic device may perform a left-click operation on the display element at the position where the positioning cursor is located; if the electronic equipment detects two trigger operations within the preset time length, it can be determined that the user performs double-click operation and the electronic equipment can perform left-key double-click operation on the display element at the position of the positioning cursor; if the electronic device detects a single trigger operation exceeding a preset time length, it can be determined that the user performs a long-time pressing operation, and the electronic device can perform a right-click operation on the display element at the position of the positioning cursor.

In an embodiment, the electronic device may determine a position change value of the feature point according to the position change information, and a numerical ratio may exist between the position change value and the moving distance of the positioning cursor. For example, when the numerical ratio is 1:1, that is, the position change numerical value is equal to the moving distance, when the finger of the user moves 10pix (pixels) in the acquisition area, the positioning cursor correspondingly moves 10pix on the screen of the electronic device; when the numerical ratio is 1:100, namely the moving distance is 100 times of the position change numerical value, when the finger of the user moves 10pix in the acquisition area, the positioning cursor correspondingly moves 1000pix on the screen of the electronic device. In an embodiment, the electronic device may perform a custom adjustment on the numerical value ratio according to a received user adjustment instruction, so as to make the electronic device conform to the operation habit of the user.

In an embodiment, the screen display content may include interface content. According to the position change information, the electronic equipment can perform in-page sliding control or inter-page jumping control on the interface content. For example, when the electronic device recognizes that the user finger performs a sliding operation in an up-and-down direction, the interface content may be controlled to slide in the current page, for example, when the finger slides from top to bottom, the interface content slides down in the current page, and when the finger slides from bottom to top, the interface content slides up in the current page; for another example, when the electronic device recognizes that the user finger performs a sliding operation in the left-right direction, the interface content may be controlled to jump between the current page and the adjacent page, for example, when the finger slides from left to right, the interface content jumps from the current page to the next page, and when the finger slides from right to left, the interface content jumps from the current page to the previous page.

In an embodiment, further, more operation control may be implemented on the screen display content of the electronic device according to the identification result of the fingerprint identification module, for example, page switching between different application programs, page switching between a foreground application function and a background application function, scaling control of interface content, and the like, which is not limited by the present disclosure.

In an embodiment, according to the position change information, a function switch or a function adjustment may be performed on the electronic device, where the function refers to a control function of the electronic device itself, which is different from an adjustment control on screen display content of the electronic device, and for example, the function may include: volume size adjustment, screen brightness adjustment, cellular network switch, bluetooth switch, etc., which the present disclosure does not limit.

In an embodiment, when the electronic device detects an authentication requirement for the user, the user may be authenticated according to the skin texture image. Then, especially when the fingerprint identification module is applied to the control process in the above embodiment, the user can be authenticated in the process of executing the control operation by the user through the acquisition area of the fingerprint identification module without implementing a separate authentication process or jumping out of the current operation process of the user, so that the use interference to the user is reduced, and the user can be authenticated without perception.

According to the embodiment, the skin texture image collected by the fingerprint identification module is analyzed, so that the user operation of the user in the collection area of the fingerprint identification module can be identified, the operation control of the electronic equipment is realized, the operation is convenient and fast, an independent touch panel is not required to be assembled on the electronic equipment, the size of the electronic equipment is favorably reduced, and the electronic equipment is convenient to thin, light and portable.

Fig. 2 is a schematic perspective view illustrating an electronic device according to an exemplary embodiment, and as shown in fig. 2, assuming that the electronic device is a notebook computer 200, an upper half of the notebook computer 200 is provided with a screen 21, and a lower half is provided with a keyboard 22; in addition, the notebook computer 200 may further include a fingerprint recognition module according to the present disclosure. The fingerprint identification module can form the collection area 23 as shown in fig. 2 on the notebook computer 200 so that the user can attach the skin such as fingers to the collection area 23, and the corresponding skin texture image, such as a fingerprint image, is collected by the fingerprint identification module.

The capture area 23 may be located anywhere on the laptop 200, and the disclosure is not limited thereto. In an embodiment, as shown in fig. 2, since the occupied area of the collecting area 23 is small, the collecting area can be disposed at the right side of the keyboard area 2A where the keyboard 22 is located, and the area 2B (located below the keyboard area 2A) generally used for disposing a touch panel in the related art is not required to be occupied, which is helpful for reducing the device volume of the notebook computer 200, and further realizing the lightness, thinness and portability. In an embodiment, as shown in fig. 3, the collecting area 23 may be disposed inside the keyboard area 2A, for example, in the middle of the keyboard 22, so that a user can perform an operation at the collecting area 23 more conveniently during using the keyboard 22 without moving his hand out of the keyboard area 2A, which helps to simplify the user operation and improve the input efficiency.

Fig. 4 is a schematic diagram illustrating a fingerprint image collection according to an exemplary embodiment, as shown in fig. 4, when a user places a finger 4 in a collection area 23 of a fingerprint identification module, the fingerprint identification module may perform an image collection operation on the collection area 23 to obtain a corresponding fingerprint image 400; the fingerprint image 400 includes the fingerprint 40 corresponding to the finger 4, and a blank area not covered by the finger 4 (i.e. the blank area around the fingerprint 40 in the fingerprint image 400 shown in fig. 4). Of course, in some scenarios, the finger 4 may also completely cover the acquisition area 23, and thus the fingerprint image 400 may only contain the fingerprint 40 without blank areas, but this does not affect the implementation of the technical solution of the present disclosure.

In one embodiment, the fingerprint recognition module can include a plurality of modes: when there is an authentication requirement, for example, the notebook computer 200 needs to log in an operating system, a browser page or an application program requests login, a browser page or an application program requests payment, etc., the fingerprint identification module may be configured in an authentication mode, and the fingerprint identification module may compare the fingerprint 40 in the fingerprint image 400 with a standard fingerprint of a preset authorized user to determine whether the current user is an authorized user, thereby completing authentication. When there is no need for authentication, the fingerprint recognition module may be configured in a mouse mode, and the fingerprint recognition module may recognize a plurality of feature points included in the fingerprint 40 in the fingerprint image 400, such as feature points a, B, C and the like shown in fig. 4, which may be recorded as corresponding to the finger 4 and applied to the operation of recognizing the finger 4. When there is no need for authentication and it is not detected that the user touches the capture area 23 within a predetermined time period, the fingerprint identification module may be configured to be in a sleep mode to reduce its power consumption.

FIG. 5A is a schematic diagram illustrating one type of finger motion, according to an exemplary embodiment. Assuming that the finger 4 is attached to the collecting area 23 and moves as shown in fig. 5A, that is, the finger 4 moves from left to right on the collecting area 23, so that when the fingerprint identification module performs image collection according to a predetermined frequency, two fingerprint images 400 on the left side and the right side as shown in fig. 5B can be collected successively; of course, when the image capturing frequency of the fingerprint identification module is higher, a greater number of fingerprint images 400 can be captured, and only two fingerprint images 400 shown in fig. 5B are taken as an example for illustration.

Assume that when the finger 4 is located at the position P1 of the capturing area 23 shown in fig. 5A, the fingerprint identification module acquires the fingerprint image 400 on the left side in fig. 5B, and the fingerprint 40 is located at the position Q1 in the fingerprint image 400, and when the finger 4 is located at the position P2 of the capturing area 23 shown in fig. 5A, the fingerprint identification module acquires the fingerprint image 400 ' on the right side in fig. 5B, and the fingerprint 40 ' is located at the position Q2 in the fingerprint image 400 '. By identifying the fingerprint 40 and the fingerprint 40 ', the feature points a to C included in the fingerprint 40 and the feature points a to C included in the fingerprint 40' can be determined, so that the notebook computer 200 can determine: in one aspect, the fingerprints 40, 40' both belong to the same skin texture (i.e. the skin texture of the finger 4); on the other hand, since it can be determined that the feature points a to C have changed in position from left to right based on the positional information of the feature points a to C in the fingerprint image 400 and the fingerprint image 400', respectively, it can be estimated that the finger 4 has slid on the capture area 23 from left to right as shown in fig. 5A.

In response to the recognized user operation, the notebook computer 200 may respond according to a preset rule, for example, when the user operation is a sliding operation from left to right as shown in fig. 5A, the pointing cursor 24 displayed on the screen 21 as shown in fig. 5C may be moved from left to right, so that the pointing cursor 24 is moved from the initial position S1 to the position S2. Similarly, according to the rule content preset in the notebook computer 200, other responses may also be implemented to the "sliding operation from left to right", which is not limited by the present disclosure; and, the user can also form other sliding operations in any direction on the collecting area 23 by the finger 4, and make the notebook computer 200 implement corresponding responses, which is not limited by the present disclosure.

In an embodiment, the fingerprint identification module may further identify a click operation of the user. As shown in fig. 6, in the schematic diagram on the left side, it is assumed that the finger 4 is in a contact state with the collection area 23 of the fingerprint identification module, and at this time, the fingerprint identification module can collect the fingerprint image 400 shown in fig. 4, the fingerprint image 400 contains the fingerprint 40, and the fingerprint identification module can identify the feature points a to C contained in the fingerprint 40; entering the middle schematic diagram in sequence, the user can lift the finger 4 to separate the finger 4 from the acquisition area 23, and the fingerprint identification module cannot detect the fingerprint image 400 corresponding to the finger 4; in the schematic diagram that gets into the right side along with the chronogenesis, the user contacts finger 4 with gathering regional 23 once more for the fingerprint identification module can gather again and obtain such as the fingerprint image 400 that figure 4 shows, contain fingerprint 40 in this fingerprint image 400, and the fingerprint identification module can discern the characteristic point A ~ C that this fingerprint 40 contains. Then, if the diagram shown in fig. 6 is switched from the left diagram to the middle diagram (the contact time before the finger 4 leaves the collection area 23 is counted, and the time length before the finger leaves is not counted), and then switched from the middle diagram to the right diagram (the contact time length before the finger 4 leaves the collection area 23 is counted, and the time length consumed is not longer than the first preset time length, and when the finger 4 successively contacts the collection area 23, the fingerprint image 400 collected by the fingerprint identification module includes the same feature points a to C, and the positions of the feature points a to C in the fingerprint image 400 are unchanged or almost unchanged or the changes do not exceed the preset range, it can be determined that one click operation of the finger 4 on the collection area 23 is detected.

Based on the embodiment shown in fig. 6, a single click operation, i.e., a single click operation, performed on the acquisition area 23 by the finger 4 of the user can be detected; similarly, a double-click or multi-click operation of the acquisition area 23 by the finger 4 may also be detected. Take a double click as an example: after switching to the right schematic diagram shown in fig. 6 according to the time sequence, the user can continue to repeatedly implement the middle schematic diagram and the right schematic diagram shown in fig. 6, that is, two clicks can be completed; correspondingly, if the consumed time length is not more than the second preset time length, and when the finger 4 is successively contacted with the acquisition area 23, the fingerprint image 400 acquired by the fingerprint identification module comprises the same characteristic points a to C, and meanwhile, the positions of the characteristic points a to C in the fingerprint image 400 are unchanged or almost unchanged or the change does not exceed the preset range, it can be determined that the finger 4 is detected to complete the double-click operation on the acquisition area 23. The judgment manner of the more clicking operations is similar, and is not described herein again.

In an embodiment, the finger 4 of the user may not first contact the acquisition area 23, and a click operation may be implemented as well. Taking the single click operation as an example: as shown in fig. 7, in the left schematic view, the finger 4 contacts the pickup area 23 by moving downward in a state of not contacting the pickup area 23; then, switching to the right-hand diagram in time series, the finger 4 is lifted from the acquisition region 23 and separated from the acquisition region 23. In the above process, the finger 4 of the user and the collection area 23 complete the operation of "separation-contact-separation", and in the short contact process, the fingerprint identification module can also perform multiple image collections on the surface texture of the finger 4 to obtain multiple fingerprint images 400 such as those shown in fig. 4, and identify the feature points a-C included in the fingerprint 40 in the fingerprint image 400, so as to obtain the feature points a-C; correspondingly, if the contact duration of the finger 4 and the acquisition area 23 is not longer than the third preset duration, and when the finger 4 contacts the acquisition area 23, a plurality of fingerprint images 400 acquired by the fingerprint identification module include the same characteristic points a to C, and the positions of the characteristic points a to C in the fingerprint images 400 are unchanged or almost unchanged or the change does not exceed the preset range, it can be determined that the finger 4 completes the clicking operation on the acquisition area 23. The judgment manner for the double-click operation or the multiple-click operation is similar, and the description is omitted here.

In one embodiment, the user may perform a long-press operation on the acquisition area 23 by the finger 4; based on the embodiments shown in fig. 6 or fig. 7, it can be detected that the fingerprint identification module continuously collects a plurality of fingerprint images 400 corresponding to the finger 4, such as the fingerprint image 400 shown in fig. 4, in a time period exceeding a fourth preset time period, and positions of the feature points a to C in the fingerprint images 400 are not changed or almost not changed or change does not exceed a preset range, it can be determined that the long-press operation of the finger 4 on the collection area 23 is detected.

In one embodiment, when the single-click operation or the double-click operation for the capture area 23 is detected, the notebook computer 200 may accordingly perform the left-click operation or the left-double-click operation on the positioning cursor 24, such as shown in fig. 5C; when a long press operation for the capture area 23 is detected, the notebook computer 200 can perform a right click operation on the positioning cursor 24 shown in fig. 5C.

Therefore, the fingerprint identification module of the present disclosure can replace a touch panel in the related art, thereby greatly reducing the volume of the notebook computer 200, and facilitating the realization of the lightness, thinness and portability of the notebook computer 200.

Corresponding to the foregoing embodiment of the device control method, the present disclosure also provides an embodiment of a device control apparatus.

Fig. 8 is a block diagram illustrating an apparatus control device according to an exemplary embodiment. Referring to fig. 8, the device is applied to an electronic device provided with a fingerprint identification module; the apparatus may include:

the identification unit 81 is configured to identify feature points in the skin texture image of the user, which is acquired by the fingerprint identification module;

a control unit 82 configured to control the electronic device according to position change information of the feature points in the continuously acquired skin texture images.

As shown in fig. 9, fig. 9 is a block diagram of another device control apparatus according to an exemplary embodiment, and the control unit 82 may include, on the basis of the foregoing embodiment shown in fig. 8:

a display content control subunit 91 configured to control the screen display content of the electronic device according to the position change information.

As shown in fig. 10, fig. 10 is a block diagram of another device control apparatus according to an exemplary embodiment based on the foregoing embodiment shown in fig. 9, wherein the screen display content includes a positioning cursor; the display content control subunit 91 may include:

and the cursor control module 911 is configured to perform displacement control or click control on the positioning cursor according to the position change information.

As shown in fig. 11, fig. 11 is a block diagram of another device control apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 10:

an adjusting unit 83 configured to adjust a numerical ratio between a position change numerical value of the feature point and a moving distance of the positioning cursor.

As shown in fig. 12, fig. 12 is a block diagram of another device control apparatus according to an exemplary embodiment, which is based on the foregoing embodiment shown in fig. 9, and the screen display content may include interface content; the display content control subunit 91 includes:

a page control module 912 configured to perform intra-page sliding control or inter-page jumping control on the interface content according to the position change information.

It should be noted that the structure of the page control module 912 in the device embodiment shown in fig. 12 may also be included in the device embodiment shown in fig. 10 or fig. 11, and the disclosure is not limited thereto.

As shown in fig. 13, fig. 13 is a block diagram of another device control apparatus according to an exemplary embodiment, and the control unit 82 of this embodiment may include, on the basis of the foregoing embodiment shown in fig. 8:

a device function control subunit 92 configured to perform function switching or function adjustment on the electronic device according to the position change information.

It should be noted that, the structure of the device function control subunit 92 in the apparatus embodiment shown in fig. 13 may also be included in the apparatus embodiment shown in any one of fig. 9 to 12, and the disclosure is not limited thereto.

As shown in fig. 14, fig. 14 is a block diagram of another device control apparatus according to an exemplary embodiment, which may further include, on the basis of the foregoing embodiment shown in fig. 8:

an authentication unit 84 configured to authenticate the user according to the skin texture image when the electronic device detects an authentication requirement for the user.

It should be noted that the structure of the verification unit 84 in the apparatus embodiment shown in fig. 14 may also be included in the apparatus embodiment shown in any one of fig. 9 to 12, and the disclosure is not limited thereto.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.

Correspondingly, the present disclosure also provides an apparatus control device, including: a fingerprint identification module; a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method as in any of the above embodiments. For example, the method may include: identifying characteristic points in the skin texture image aiming at the skin texture image of the user collected by the fingerprint identification module; and controlling the electronic equipment according to the position change information of the feature points in the continuously acquired skin texture images.

Accordingly, the present disclosure also provides a terminal comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and configured to be executed by the one or more processors comprises implementing the method according to any of the above embodiments. For example, the program may contain instructions for: identifying characteristic points in the skin texture image aiming at the skin texture image of the user collected by the fingerprint identification module; and controlling the electronic equipment according to the position change information of the feature points in the continuously acquired skin texture images.

FIG. 15 is a block diagram illustrating an apparatus 1500 for device control in accordance with an exemplary embodiment. For example, the apparatus 1500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 15, apparatus 1500 may include one or more of the following components: processing components 1502, memory 1504, power components 1506, multimedia components 1508, audio components 1510, input/output (I/O) interfaces 1512, sensor components 1514, and communication components 1516.

The processing component 1502 generally controls overall operation of the device 1500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 1502 may include one or more processors 1520 executing instructions to perform all or a portion of the steps of the methods described above. Further, processing component 1502 may include one or more modules that facilitate interaction between processing component 1502 and other components. For example, processing component 1502 may include a multimedia module to facilitate interaction between multimedia component 1508 and processing component 1502.

The memory 1504 is configured to store various types of data to support operations at the apparatus 1500. Examples of such data include instructions for any application or method operating on the device 1500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power supply component 1506 provides power to the various components of the device 1500. The power components 1506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 1500.

The multimedia component 1508 includes a screen that provides an output interface between the device 1500 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, multimedia component 1508 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 1500 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1510 is configured to output and/or input audio signals. For example, the audio component 1510 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 1500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 1504 or transmitted via the communication component 1516. In some embodiments, audio component 1510 also includes a speaker for outputting audio signals.

The I/O interface 1512 provides an interface between the processing component 1502 and peripheral interface modules, which can be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 1514 includes one or more sensors for providing status assessment of various aspects of the apparatus 1500. For example, the sensor assembly 1514 can detect an open/closed state of the device 1500, the relative positioning of components, such as a display and keypad of the device 1500, the sensor assembly 1514 can also detect a change in position of the device 1500 or a component of the device 1500, the presence or absence of user contact with the device 1500, orientation or acceleration/deceleration of the device 1500, and a change in temperature of the device 1500. The sensor assembly 1514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. The sensor assembly 1514 may include a fingerprint recognition module for performing fingerprint recognition functions via principles such as capacitive, photoelectric, or ultrasonic. In some embodiments, the sensor assembly 1514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 1516 is configured to facilitate wired or wireless communication between the apparatus 1500 and other devices. The apparatus 1500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1516 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 1500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 1504 comprising instructions, executable by the processor 1520 of the apparatus 1500 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. The equipment control method is characterized by being applied to electronic equipment provided with a fingerprint identification module; the method comprises the following steps:

controlling the electronic equipment according to the position change information of the feature points in the continuously acquired skin texture images;

in the control process, when single trigger operation is detected within a preset time length, left key clicking operation is carried out on the electronic equipment; when two trigger operations are detected within a preset time length, performing left key double-click operation on the electronic equipment; when single trigger operation exceeding a preset time length is detected, right click operation is carried out on the electronic equipment;

and in the control process, authenticating the user according to the skin texture image.

2. The method according to claim 1, wherein the controlling the electronic device according to the position change information of the feature points in the continuously acquired skin texture images comprises:

3. The method of claim 2, wherein the screen displaying content comprises positioning a cursor; the controlling the screen display content of the electronic device according to the position change information includes:

4. The method of claim 3, further comprising:

5. The method of claim 2, wherein the screen display content comprises interface content; the controlling the screen display content of the electronic device according to the position change information includes:

6. The method according to claim 1, wherein the controlling the electronic device according to the position change information of the feature points in the continuously acquired skin texture images comprises:

7. The method of claim 1, wherein the authenticating the user from the skin texture image comprises:

8. The equipment control device is characterized by being applied to electronic equipment provided with a fingerprint identification module; the device comprises:

a control unit configured to control the electronic device according to position change information of the feature points in the continuously acquired skin texture images;

the operation unit is configured to implement left-key single-click operation on the electronic equipment when single trigger operation is detected within a preset time length in the control process; when two trigger operations are detected within a preset time length, performing left key double-click operation on the electronic equipment; when single trigger operation exceeding a preset time length is detected, right click operation is carried out on the electronic equipment;

an authentication unit configured to authenticate the user according to the skin texture image in the control process.

9. The apparatus of claim 8, wherein the control unit comprises:

10. The apparatus of claim 9, wherein the screen display content comprises a pointing cursor; the display content control subunit includes:

11. The apparatus of claim 10, further comprising:

12. The apparatus of claim 9, wherein the on-screen display content comprises interface content; the display content control subunit includes:

13. The apparatus of claim 8, wherein the control unit comprises:

14. The apparatus of claim 8, wherein the verification unit is further configured to:

15. An electronic device, comprising:

a fingerprint identification module;

a processor;

a memory for storing processor-executable instructions;

wherein the processor is configured to implement the method of any one of claims 1-7.

16. A computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the steps of the method according to any one of claims 1-7.