TWI523003B - Method for displaying object and electronic device - Google Patents

Description

Object display method and electronic device

The present invention relates to an electronic device, and more particularly to an object display method and an electronic device.

With the rapid development of technology, electronic devices equipped with screens have become very popular applications. In addition, the size of the screen is also large and small to meet the needs of various users. Generally, the electronic device displays a user interface (UI) on the screen to interact with the user through the user interface. For example, the application shortcuts and application operation screens are displayed on the user interface, etc., so that the user can operate various applications intuitively.

However, for the display of applications such as application shortcuts or application lists on the user interface, although some electronic devices support the user to select objects of different sizes by means of large icons or small icons, but If the user does not manually switch, the display size of the object will not be adjusted. In addition, for users of myopia or hyperopia, there is no suitable object size adjustment mechanism.

The invention provides an object display method and an electronic device, which can adaptively adjust the display size of an object according to the size of the face in front of the lens.

The invention provides an object display method, which is suitable for an electronic device having a screen and a lens. The method includes: displaying an object through a screen, wherein the object has a first size; capturing a plurality of facial images through the lens, and determining whether the facial image meets the sampling condition, wherein each facial image includes a human face; and when the facial image conforms to the sampling In the condition, the distance information corresponding to the face is obtained, and the second size of the object is calculated according to the distance information; and the third size of the object is calculated according to the first size and the second size, and the object is displayed in the third size.

Viewed from another perspective, the present invention also provides an electronic device. The electronic device includes a screen, a lens, and a processor. The processor is coupled to the screen and the lens, and is configured to: display an object through the screen, wherein the object has a first size; capture a plurality of facial images through the lens, and determine whether the facial image meets the sampling condition, wherein each The face image includes a face; when the face image meets the sampling condition, the distance information corresponding to the face is obtained, and the second size of the object is calculated according to the distance information; and the third item is calculated according to the first size and the second size Size, and display the object in a third size.

Based on the above, the object display method and the electronic device of the present invention can capture a plurality of face images through the lens and determine whether the face image meets the sampling condition. When the face image meets the sampling condition, the distance information corresponding to the face in the face image is obtained, thereby adaptively adjusting the display size of the object on the screen.

The above described features and advantages of the invention will be apparent from the following description.

10‧‧‧Electronic devices

102‧‧‧ screen

104‧‧‧ lens

106‧‧‧ memory

108‧‧‧Processor

110_1~110_6‧‧‧ objects

201‧‧‧Users

D, D _best , D _max , D _min ‧‧‧ distance

S602, S604, S606, S608, S610‧‧‧ steps of the object display method in an exemplary embodiment of the present invention

1A and 1B are schematic diagrams of an electronic device according to an exemplary embodiment of the invention.

FIG. 2 and FIG. 3 are schematic diagrams showing the display size of an adjustment object according to an exemplary embodiment of the invention.

4 and FIG. 5 are schematic diagrams showing the display size of an adjustment object according to another exemplary embodiment of the present invention.

FIG. 6 is a flow chart of a method for displaying an object according to an exemplary embodiment of the invention.

1A and 1B are schematic diagrams of an electronic device according to an exemplary embodiment of the invention.

Referring to FIG. 1A and FIG. 1B , in the exemplary embodiment, the electronic device 10 may be a smart phone, a tablet PC, an e-book, or a game console. It is not limited to this. In another exemplary embodiment, the electronic device 10 may also be an electronic device having a display and computing function, such as a notebook, a desktop computer, or a smart TV. Limited to this.

In the present exemplary embodiment, the electronic device 10 includes a screen 102, a lens 104, a memory 106, and a processor 108.

The screen 102 may be an electrophoretic display, a liquid crystal display, a plasma display, or an organic light-emitting diodes display, and is not limited thereto. In the exemplary embodiment, the screen 102 can be a resistive touch screen, a capacitive touch screen, an optical touch screen, an acoustic wave touch screen or an electromagnetic type. (electromagnetic) touch screens such as touch screens with display and touch detection functions. The user can perform a touch operation such as clicking or sliding on the screen 102 by using an input tool such as a stylus or a finger to input text or instructions to the electronic device 10. However, in another exemplary embodiment, the screen 102 has only a display function, and the present invention is not limited thereto.

The lens 104 is part of a camera module (not shown) of the electronic device 10 and can be used to capture an external image. In the present exemplary embodiment, the lens 104 refers to the front lens and is disposed on the front side of the electronic device 10 together with the screen 102.

The memory 106 may include volatile memory, non-volatile memory, Hard Disk Drive (HDD), and/or external storage media (eg, USB flash drive), and the like. It is not limited to this.

The processor 108 is coupled to the screen 102, the lens 104, and the memory 106, and is responsible for the main data processing work of the electronic device 10. For example, the processor 106 can include a central processing unit (CPU), an embedded controller (embedded controller) And at least one of a micro-controller, and is not limited thereto.

In addition, the electronic device 10 may further include a basic component such as a wireless communication module (not shown), an input device (not shown), a power supply module (not shown), and an audio output module (not shown). The invention is not limited. The wireless communication module may include a wireless communication chip, and the input device may include a mouse, a keyboard, a touch pad, a microphone, etc., and the power supply module may include a battery, and Limited to this.

As shown in FIG. 1B, the processor 108 displays the objects 110_1 110 110_6 through the screen 102, wherein the objects 110_1 110 110_6 each have a size (hereinafter collectively referred to as the first size). In the present exemplary embodiment, a rectangle or a square is used as a display reference for an object, and any side length of a rectangle or a square is used as a measurement reference for the size of the object. However, in another exemplary embodiment, the article may have any shape, and the size of the article may be adaptively adjusted to different measurement datums depending on the display shape of the article. The first size of each of the objects 110_1~110_6 may be the same or different, and the number of the objects 110_1~110_6 may be more or less, which is not limited by the present invention. In the present exemplary embodiment, the objects 110_1~110_6 may be icons of a plurality of shortcuts in the application list, or icons of a plurality of contacts in the contact list, and the like, and are not limited thereto. In addition, in another exemplary embodiment, the objects 110_1~110_6 may also be buttons, menus, and the like presented by any application, and are not limited thereto.

After receiving a trigger condition, the processor 108 captures multiple facial images through the lens 102, wherein each facial image includes at least one person. face. For example, the trigger condition may be that the application list or the contact list is turned on, or any application that presents the above object is executed, and is not limited thereto. For example, after receiving the trigger condition, the processor 108 can activate the camera module of the electronic device 10 to capture a plurality of candidate images through the lens 102 in a unit time, wherein the candidate images include the face images. For example, the unit time may be 5 seconds to 10 seconds, and is not limited thereto. In addition, the processor 108 can store the captured candidate images in the memory 106.

The processor 108 then determines if the facial images meet the sampling conditions. For example, the processor 108 can determine whether the proportion of the face images in the candidate images meets the preset ratio conditions. If the proportion of these face images in the candidate images meets the preset ratio condition, the processor 108 determines that the face images meet the sampling conditions. On the other hand, if the proportion of these face images in the candidate images does not meet the preset ratio condition, the processor 108 determines that the face images do not meet the sampling conditions. For example, assume that the preset ratio condition is that the face image accounts for more than 80% of all candidate images, and the processor 108 captures 300 candidate images through the lens 102 within 10 seconds, and the 300 candidate images include 270 face images containing faces. Since the face image accounts for 90% (greater than 80%) of all candidate images, the processor 108 can determine that the face images meet the sampling conditions. On the other hand, if the face image including the face occupies less than 80% (for example, 50%) of the 300 candidate images, the processor 108 can determine that the face images do not meet the sampling conditions.

The processor 108 can also determine the faces of any two of these face images. Whether the position change meets the position change condition. This position change condition may include a position change threshold value. For example, assuming that each person's face image contains a face of the same user, the processor 108 can compare the position of the face in each person's face image. If the position of the user's face in one face image is different from the position of the user's face in another face image is greater than the position change threshold, the processor 108 may determine the person in the two face images. The position change of the face does not meet the position change condition. On the other hand, if the position of the user's face in each face image is not greater than the position change threshold, the position of the user's face in each face image is similar, so the processor 108 can determine The positional changes of any two of these face images conform to the position change condition.

In addition, the processor 108 can also determine whether the size change of any two of the face images conforms to the dimensional change condition. This dimensional change condition can include a dimensional change threshold. For example, assuming that each person's face image contains a face of the same user, the processor 108 can compare the size of the face in each person's face image. If the size of the user's face in one face image is greater than the size change threshold of the user's face in another face image, the processor 108 may determine the two face images. The size change of the face does not meet the position change condition. On the other hand, if the size difference of the user's face in each face image is not greater than the size change threshold, the size of the user's face in each face image is similar, so the processor 108 can determine The dimensional changes of any two of these face images conform to the position change condition.

That is, the processor 108 can be in the candidate image according to the face image. Whether the proportion is in accordance with the preset ratio condition, whether the position change of any two faces in different face images conforms to the position change condition, and whether the size changes of any two faces in different face images conform to At least one of the dimensional change conditions is used to determine whether the facial images meet the sampling conditions. These judgment conditions may be used singly or in combination of two or three, and the invention is not limited. For example, in an exemplary embodiment, only when the proportion of the face image in the candidate image meets the preset ratio condition, the position changes of any two faces in different face images conform to the position change condition and are different. When the size change of any two faces in the face image conforms to the dimensional change condition, the processor 108 determines that the face image meets the sampling condition.

When the face image does not meet the sampling condition, the processor 108, for example, reacquires more candidate images, and repeatedly performs the above determination. In an exemplary embodiment, the processor 108 may also set to stop capturing the face image and the like after the failure exceeds a certain number of times, and the present invention is not limited thereto.

When the face image meets the sampling condition, the processor 108 obtains the distance information corresponding to the face, and calculates another size of the object based on the distance information (hereinafter collectively referred to as the second size). The distance information of the face mentioned here indicates the distance between the face of the user who operates the electronic device 10 on the front side of the electronic device 10 and the electronic device 10. For example, processor 108 can count the size of the faces in each person's face image and obtain an average size of those faces. In addition, the average size may also be a weighted average of the sizes of the faces in the respective face images or an average size obtained by a special operation, which is not limited in the present invention. Processor 108 can then calculate distance information corresponding to the faces based on the average size. In the present exemplary embodiment, the distance information includes a distance value. For example, processor 108 can calculate this distance value by the following relation (1.1):

Where D is the distance between the face of the user operating the electronic device 10 on the front side of the electronic device 10 and the electronic device 10, C is a constant, and A is the face size. For example, A may be the length of one side of the face when the face in the face image is set to a rectangle or a square.

The processor 108 can then compare the distance information (or distance value) with the preset distance to obtain a difference between the distance information and the preset distance, and calculate the second size of the object based on the difference. In the present exemplary embodiment, the preset distance is set as the optimal distance for the user with normal vision to view the screen 102. When the distance between the user's head and the electronic device 10 is less than the preset distance, it indicates that the user may have problems such as myopia or the display size of the object on the screen 102 is too small, so the user will move the head closer. Electronic device 10. On the contrary, when the distance between the user's head and the electronic device 10 is greater than the preset distance, it indicates that the user may have problems such as farsightedness or the display size of the object on the screen 102 is too large, so the user will turn the head. The remote electronic device 10 is moved. Therefore, in the exemplary embodiment, when the distance information indicates that the distance between the user's head and the electronic device 10 is less than the preset distance, the processor 108 increases the display size of the object on the screen 102, and When the distance information indicates that the distance between the user's head and the electronic device 10 is greater than a preset distance, the processor 108 reduces the display size of the object on the screen 102. For example, processor 108 may calculate the second size of the object according to the following relation (1.2): I _best = I _current - (I _{max -} I _min ) × ((DD _best ) / (D _{max -} D _min )) ( 1.2)

Where I _best is the second size of the object, I _current is the first size of the object, I _max is the maximum display size of the object, I _min is the minimum display size of the object, D is the distance information, D _best is the preset distance, D _Max is the maximum distance and D _min is the minimum distance. Similarly, I _best , I _current , I _{max ,} and I _{min are,} for example, the length of one side of the object when displayed, and are not limited thereto. That is, I _max , I _min , D _best , D _{max ,} and D _min are presets, and I _current is the size at which the object is currently being displayed (as shown in FIG. 1B ). Through Equation (1.2) can be known, when the distance information indicates a distance between the head of the user and the electronic device 10 is less than the predetermined distance D _best, the second processor 108 calculates the size will be greater than the first size In order to make the object displayed on the screen 102 large. On the other hand, when the distance information indicates that the distance between the user's head and the electronic device 10 is greater than the preset distance D _best , the second size calculated by the processor 108 is smaller than the first size, so that the display is displayed on the screen 102. The objects on it become smaller. The magnitude of the object becoming larger or smaller depends on the difference between the distance between the user and the electronic device 10 (i.e., the distance information) and the preset distance.

After obtaining the second size of the object, the processor 108 calculates another size of the object (hereinafter collectively referred to as the third size) according to the first size and the second size, and displays the object in the third size. That is to say, if the processor 108 directly displays the object in the second size, the display size of the object may vary too much, which may affect the user's operating experience. Therefore, in order to avoid that the magnitude of the display size change of the object is too large, the processor 108 can adjust the display size of the object based on past experience. For example, the processor 108 can calculate the third size of the object by the following relation (1.3): I _best '=I _current ×(1-α)+I _best ×α (1.3)

Where I _best 'is the third size of the object, I _current is the first size of the object, I _best is the second size of the object, α is the learning coefficient, and 0 ≦ α < 1. That is, by substituting the first size and the second size of the object into relation (1.3), the processor 108 can obtain the third size of the object in a near approach and display the object in a third size.

FIG. 2 and FIG. 3 are schematic diagrams showing the display size of an adjustment object according to an exemplary embodiment of the invention.

Referring to FIG. 2, assuming that the distance between the user and the electronic device 10 (ie, distance information) is D, and the preset distance is D _best , the difference between the distance D and the preset distance is DD _best (negative value). After the DD _best is substituted into the relation (1.2) with the first size of the object in the exemplary embodiment of FIG. 1 and the first size and the obtained second size are substituted into the relation (1.3), the processor 108 can obtain the object. The third size.

Referring to FIG 3, in this exemplary embodiment, the distance D between the head of the user and the electronic device 10 is less than the predetermined distance D _Best, and therefore with respect to exemplary embodiment of FIG. 1B, processor 108 causes object 110_1 The display size of ~110_6 on the screen 102 becomes larger.

4 and FIG. 5 are schematic diagrams showing the display size of an adjustment object according to another exemplary embodiment of the present invention.

Referring to FIG 4, similarly assumed that the distance between the user and the electronic apparatus 10 (i.e., distance information) is D, and D is the _Best predetermined distance, then the difference between the distance and the predetermined distance D is the DD _best ( Positive value). Through the relationship (1.2) and the relation (1.3), the processor 108 can also obtain the third size of the object.

Referring to FIG. 4, the difference from the exemplary embodiment of FIG. 3 is that, in this exemplary embodiment, the distance D between the user's head and the electronic device 10 is greater than the preset distance _Db , and thus is relative to FIG. 1B. In the exemplary embodiment of FIG. 3, the processor 108 reduces the display size of the objects 110_1 110 110_6 on the screen 102. In addition, D _best , D _max and D _min in FIG. 2 and FIG. 4 may be directly substituted into the relation (1.2) or adjusted and then substituted into the relation (1.2), and the invention is not limited.

FIG. 6 is a flow chart of a method for displaying an object according to an exemplary embodiment of the invention.

Referring to FIG. 6, in step S602, the processor 108 displays the object through the screen 102, wherein the object has a first size. In step S604, the processor 108 captures a plurality of facial images through the lens, wherein each facial image includes a human face. In step S606, the processor 108 determines whether the face image meets the sampling condition. When the processor 108 determines that the face image does not meet the sampling condition, the processor 108 repeats the step S604, for example, and may repeatedly perform the operation or end the operation after the number of failures exceeds a preset number of times, etc., and the present invention is not limited. . When the processor 108 determines that the face image meets the sampling condition, in step S608, the processor 108 obtains the distance information corresponding to the face, and calculates the second size of the object based on the distance information. In step S610, the processor 108 calculates a third size of the object according to the first size and the second size, and displays the object in the third size.

However, the steps in FIG. 6 have been described in detail above, and are not described herein. It should be noted that the steps in FIG. 6 can be implemented as multiple code codes or circuits, and the present invention is not limited thereto. In addition, the method of FIG. 6 may be used in combination with the above embodiments, or may be used alone, and the present invention is not limited thereto.

In summary, the object display method and the electronic device of the present invention can capture a plurality of face images through the lens and determine whether the face image meets the sampling condition. When the face image meets the sampling condition, the distance information corresponding to the face in the face image is obtained, thereby adaptively adjusting the display size of the object on the screen.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

S602, S604, S606, S608, S610‧‧‧ items display method steps

Claims (10)

An object display method is applicable to an electronic device having a screen and a lens, the method comprising: displaying an object through the screen, wherein the object has a first size; capturing a plurality of facial images through the lens, and determining Whether the facial images meet a sampling condition, wherein each of the facial images includes a human face; and when the facial images meet the sampling condition, obtaining a distance information corresponding to the human faces, and according to the The distance information calculates a second size of the object; and calculates a third size of the object based on the first size and the second size, and displays the object in the third size. The object display method of claim 1, wherein the step of capturing the facial images through the lens and determining whether the facial images meet the sampling condition comprises: transmitting the lens through the lens in a unit time Extracting a plurality of candidate images, wherein the candidate images include the facial images; and determining whether a proportion of the candidate images occupies a predetermined ratio condition, the facial images according to the facial images Judging whether a position change of any two of the faces conforms to a position change condition and whether a size change of any two faces in the face images conforms to at least one of a size change condition Whether these facial images meet the sampling conditions. The method for displaying an object according to Item 1 of the patent application, wherein the pair is obtained The step of calculating the distance information of the faces and calculating the second size of the object according to the distance information comprises: obtaining an average size of the faces, and calculating corresponding faces according to the average size The distance information; comparing the distance information with a preset distance to obtain a difference between the distance information and the preset distance; and calculating the difference between the distance information and the preset distance The second size. The object display method of claim 3, wherein when the distance information is less than the preset distance, the second size is greater than the first size, and when the distance information is greater than the preset distance, the first The second size is smaller than the first size. The object display method of claim 1, wherein the calculating the third size of the object according to the first size and the second size comprises: calculating the third of the object according to the following relationship Size: I _best '=I _current ×(1-α)+I _best ×α, where I _best ' is the third size, I _current is the first size, I _best is the second size, and α is a learning Coefficient, and 0 ≦ α < 1. An electronic device includes: a screen; a lens; and a processor coupled to the screen and the lens, wherein the processor is configured to perform the following operations: Displaying an object through the screen, wherein the object has a first size; capturing a plurality of facial images through the lens, and determining whether the facial images meet a sampling condition, wherein each of the facial images includes a human face When the facial images meet the sampling condition, obtain a distance information corresponding to the faces, and calculate a second size of the object according to the distance information; and according to the first size and the second size A third size of the object is calculated and displayed in the third size. The electronic device of claim 6, wherein the capturing of the facial images through the lens and determining whether the facial images meet the sampling condition comprises: transmitting the lens through the lens in a unit time. Taking a plurality of candidate images, wherein the candidate images include the facial images; and determining whether a proportion of the candidate images in the candidate images conforms to a preset ratio condition, and the facial images are Judging whether a position change of any two faces conforms to a position change condition and whether a size change of any two faces in the face images conforms to at least one of a dimensional change condition Whether the face image meets the sampling condition. The electronic device of claim 6, wherein obtaining the distance information corresponding to the faces and calculating the second size of the object based on the distance information comprises: obtaining one of the faces Average size and calculate the corresponding size based on the average size The distance information of the faces; comparing the distance information with a predetermined distance to obtain a difference between the distance information and the preset distance; and according to the distance information and the preset distance The difference is calculated for the second size. The electronic device of claim 8, wherein when the distance information is less than the preset distance, the second size is greater than the first size, and when the distance information is greater than the preset distance, the second The size is smaller than the first size. The electronic device of claim 6, wherein the calculating the third size of the object according to the first size and the second size comprises: calculating the third size of the object according to the following relationship :I _best '=I _current ×(1-α)+I _best ×α, where I _best ' is the third size, I _current is the first size, I _best is the second size, and α is a learning coefficient And 0≦α<1.