TW201319911A - Method for displaying background wallpaper and one or more user interface units on display unit of electrical device at the same time and computer program product and electrical device thereof - Google Patents

Abstract

A method for displaying a background wallpaper and one or more user interface units on a display unit of an electrical device at the same time is disclosed. The method includes identifying a region of interest (ROI) of the background wallpaper by analyzing the background wallpaper, displaying the background wallpaper, and displaying the one or more user interface units on the background wallpaper outside the ROI.

Description

Method for simultaneously displaying a background tablecloth and one or more user interface components in a display unit of one electronic device, computer program product thereof and electronic device thereof

The present invention relates to a display method, a computer program product thereof and an electronic device thereof, and more particularly to a method for simultaneously displaying a background tablecloth and one or more user interface elements in a display unit of an electronic device and Computer program products and their electronic devices.

Current handheld electronic devices provide personalized wallpaper features such as static wallpaper, Live wallpaper, and idle screen background. Therefore, the user can arbitrarily set the favorite image as a background tablecloth and display it on the desktop. But often, because there are various icons (Icon), widgets or other operating elements on the desktop, the favorite patterns on the background tablecloth are covered by the above components. Therefore, the user usually has to manually rearrange the positions of the components on the screen, which is quite troublesome.

Therefore, how to avoid the user's favorite pattern on the background tablecloth is covered by other operating elements is one of the current important research and development topics, and it has become an urgent need for improvement in related fields.

Accordingly, one aspect of the present invention is to provide a method of simultaneously displaying a background tablecloth and one or more user interface elements in a display unit of an electronic device. The simultaneous display method is used to specify a region of interest from one of the background tiles displayed by the display component, and display the background tablecloth and one or more user interface components outside the region of interest of the background tablecloth. A method of simultaneously displaying a background tablecloth and one or more user interface components can be implemented as a computer program product. Among them, the computer program product stores a computer program. When a computer program is loaded via an electronic device having a display unit, the computer program causes the electronic device to perform a simultaneous display method. The method of simultaneous display comprises the steps of: analyzing the background tablecloth to specify a Region of Interest (ROI) in the background tablecloth. The background tablecloth and one or more user interface elements are displayed outside of the area of interest of the background tablecloth.

Another aspect of the present invention is to provide an electronic device. The electronic device may specify a region of interest from a background tablecloth displayed by its display element and cause the user interface component to be displayed on a background tablecloth displayed by its display element, an area outside the region of interest. The electronic device includes a display unit, a display control unit, and a processing unit. The display control unit is electrically connected to the display unit, and the processing unit is electrically connected to the display control unit. A display control unit is used to control the display unit. The processing unit specifies one of the regions of interest in the background tablecloth by analyzing the background tablecloth. The display control unit controls the display unit to display one or more user interface elements within the available area of the background tablecloth.

The application of the present invention has the following advantages. There is no user interface component in the area of interest on the display unit to display the subject of interest. That is to say, it is possible to avoid the subject of interest of interest to the user, which is obscured by the user interface component.

The spirit and scope of the present invention will be apparent from the following description of the preferred embodiments of the invention. The spirit and scope of the invention are not departed.

1 is a flow chart of a method for simultaneously displaying a background tablecloth and one or more user interface elements in a display unit of an electronic device according to an embodiment of the invention. The background tablecloth can be a static wallpaper, a Live Wallpaper, an Idle Screen, or any combination thereof. The one or more user interface elements include at least one of an Icon, a Widget, a Notification, and a Button. Fig. 2 is an embodiment of a functional block diagram of an electronic device using the method shown at the same time as Fig. 1. In the simultaneous display method, the electronic device specifies a region of interest from a background tablecloth displayed by its display element, and causes the user interface component to be displayed on an area other than the region of interest on the background tablecloth. The method of simultaneous display can be implemented as a computer program product. Among them, the computer program product stores a computer program. When a computer program is loaded via an electronic device having a display unit, the computer program causes the computer to perform a simultaneous display method. Computer program products can be stored in read-only memory, flash memory, floppy disk, hard disk, optical disk, flash drive, tape, network accessible database or those skilled in the art can easily think of the same function. The electronic device can read the recording medium.

Refer to both Figure 1 and Figure 2. The electronic device 200 includes a display unit 210, a display control unit 220, and a processing unit 230. The display control unit 220 is electrically connected to the display unit 210, and the processing unit 230 is electrically connected to the display control unit 220. The display control unit 220 can be a Graphical Processing Unit (GPU) or other type of display control unit. Processing unit 230 can be a Central Processing Unit (CPU) or other type of processing unit.

The method 100 for simultaneously displaying a background tablecloth and one or more user interface elements in a display unit of an electronic device comprises the following steps:

In step 110, the processing unit 230 specifies one of the regions of interest in the background tablecloth by analyzing the background tablecloth. The area of interest contains one of the topics of interest on the background tablecloth that the user will be interested in. For example, the user can set the topic of interest as a face. Thus, the processing unit 230 can analyze the background tablecloth to specify a region of interest in the background tablecloth having a face. In another embodiment of the present invention, if the background tablecloth includes a dynamic tablecloth, and the dynamic tablecloth includes a plurality of consecutive images, the processing unit 230 may analyze the continuous image to specify the region of interest in the background tablecloth (steps) 110). For example, the processing unit 230 can analyze the region of interest on the continuous image and view the analyzed region as the region of interest. However, in other embodiments, other topics of interest may be set for processing unit 230 in step 110 as a basis for analysis.

In step 130, the display control unit 220 controls the display unit 210 to display the background tablecloth.

In step 140, the display control unit 220 controls the display unit 210 to display one or more user interface elements outside the region of interest of the background tablecloth. In this way, there is no user interface component in the region of interest on the display unit 210 for displaying the subject of interest. That is to say, it is possible to avoid the subject of interest of interest to the user, which is obscured by the user interface component.

In one embodiment of step 140, display control unit 220 can display one or more user interface elements outside of the region of interest of the background tablecloth by moving at least one of the one or more user interface elements. In this way, by moving the user interface component, the subject of interest that is of interest to the user can be prevented from being obscured by the user interface component.

In another embodiment of step 140, the display control unit 220 can display one or more user interface components on the background tablecloth by adjusting the size of at least one of the user interface components of the one or more user interface components. Outside the area of interest. In this way, even if the region of interest is too large, the remaining area on the background tablecloth is small, or the size of the user interface component is too large, the user's interest can be avoided after adjusting the size of the user interface component. The subject of interest is obscured by the user interface component.

3A to 3C are diagrams showing an embodiment of a display screen on the display unit 210 of Fig. 2. In FIG. 3A, a plurality of user interface elements 211a, 211b are displayed on the display screen of the display unit 210. In FIG. 3B, if the subject of interest is set as a face, the processing unit 230 may self-analyze the background tablecloth 212 to specify the region of interest 212a having the face in the background tablecloth 212 (step 110). In FIG. 3C, the display control unit 220 controls the display unit 210 to display the background tablecloth 212 (step 130). In addition, the display control unit 220 controls the display unit 210 to display the user interface elements 211a, 211b outside the region of interest 212a of the background tablecloth 212. The display control unit 220 displays the user interface elements 211a, 211b outside the region of interest 212a of the background tablecloth 212 by moving the user interface elements 211a, 211b. In another embodiment of the present invention, the processing unit 230 may further specify an area other than the region of interest 212a in the background tablecloth 212 (that is, an area having no face) as an available area 212b. Thus, the display control unit 220 can display the user interface elements 211a, 211b in the background tablecloth 212 usable area 212b by moving the user interface elements 211a, 211b. In this way, the user interface elements 211a, 211b can be displayed outside the region of interest 212a of the background tablecloth 212.

4A to 4C are diagrams showing another embodiment of the display screen on the display unit 210 of Fig. 2. In FIG. 4A, a plurality of user interface elements 211c, 211d, and 211e are displayed on the display screen of the display unit 210. In FIG. 4B, if the subject of interest is set as a face, the processing unit 230 may self-analyze the background tablecloth 212 to specify the region of interest 212a having the face in the background tablecloth 212 (step 110). In FIG. 4C, the display control unit 220 controls the display unit 210 to display the background tablecloth 212 (step 130). In addition, the display control unit 220 controls the display unit 210 to display the user interface elements 211c, 211d, 211e outside the region of interest 212a of the background tablecloth 212. The display control unit 220 moves the user interface elements 211c, 211d outside the region of interest 212a of the background tablecloth 212 by moving the user interface elements 211c, 211d. In addition, the display control unit 220 adjusts the size of the user interface component 211e such that the adjusted user interface component 211e is smaller in size and can be displayed outside the region of interest 212a of the background tablecloth 212. In this way, after the user interface component 211e having a larger size is adjusted, the subject of interest of interest to the user is prevented from being obscured by the user interface component 211e. In another embodiment of the present invention, the processing unit 230 may further specify an area other than the region of interest 212a in the background tablecloth 212 (that is, an area having no face) as an available area 212b. Thus, the display control unit 220 can display the user interface elements 211c, 211d in the available area 212b of the background tablecloth 212 by moving the user interface elements 211c, 211d without obscuring the region of interest 212a. In addition, the display control unit 220 can adjust the size of the user interface component 211e such that the adjusted user interface component 211e is smaller than the available area 212b of the background tablecloth 212 without being obscured to the region of interest 212a.

In addition, in step 110, the processing unit 230 includes the following three implementation manners by analyzing the background tablecloth to specify a common analysis method in the background tablecloth that includes the region of interest of the subject of interest:

1. By analyzing the image feature value: the processing unit 230 can analyze the image feature values (such as color, material, line, etc.) of the entire background tablecloth, and cut the image into regions of different sizes according to the complexity thereof, that is, the more The more detailed the cut, the thinner the area, and the simpler the material, the larger the cut area (see Figure 5A). Next, the processing unit 230 applies an image smoothing filter according to the size of the area where the background tablecloth is cut to remove unimportant noise, leaving a representative feature value on the background tablecloth (eg, 5B). Figure). Finally, processing unit 230 merges the smoothed areas on the background tablecloth until the theme on the background tablecloth is highlighted. In this way, you can get the theme of this background tablecloth as the area of interest (as shown in Figure 5C).

2. Specific object detection: This method uses various algorithms to detect various objects that are meaningful to the human eye, such as faces, objects, words, cars, facial features, etc. All kinds of objects have their own detection methods. The processing unit 230 can detect the presence of the objects on the background tablecloth through the detection algorithms, and use the area as the region of interest on the background tablecloth (such as FIG. 3B and FIG. 4B).

3. User feedback: This method can be mixed with the two methods listed above. When the processing unit 230 detects more than two regions of interest on the background tablecloth, the user can specify the user interface through one of the electronic devices 200, so that the processing unit 230 knows the feature type that the user is interested in. Why? When the processing unit 230 detects a plurality of regions of interest, the processing unit 230 can adjust the weight of the region of interest having a similar feature value to the user, thereby predicting the region of interest on the background tablecloth. , reducing the number of user input.

In addition, the processing unit 230 may use a Region of interest technique to detect an area (hot area) on the background tablecloth that is considered to be an important part by the user, such as a face, or a subject in the composition. Thus, processing unit 230 can treat this region as a hot zone (region of interest) that must be avoided, reordering the UI elements. In addition, the processing unit 230 can also move the position or automatically modify the size of the UI object according to the size of the available space (non-hot area), so that the UI element can automatically avoid the region of interest. In this way, the user can modify the image of the background tablecloth displayed by the electronic device 200 without manual modification to avoid the region of interest, and reduce the problem that the region of interest is covered by the UI component.

It will be apparent from the above-described embodiments of the present invention that the application of the present invention has the following advantages. There is no user interface component in the area of interest on the display unit to display the subject of interest. That is to say, it is possible to avoid the subject of interest of interest to the user, which is obscured by the user interface component.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and the present invention can be modified and modified without departing from the spirit and scope of the present invention. The scope is subject to the definition of the scope of the patent application attached.

100. . . Method for simultaneously displaying a background tablecloth and one or more user interface components

110~140. . . step

200. . . Electronic device for simultaneously displaying a background tablecloth and one or more user interface components

210. . . Display unit

211a, 211b, 211c, 211d, 211e. . . User interface component

212. . . Background tablecloth

212a. . . Area of interest

212b. . . Available area

220. . . Display control unit

230. . . Processing unit

1 is a flow chart of a method for simultaneously displaying a background tablecloth and one or more user interface elements in accordance with an embodiment of the present invention.

Fig. 2 is an embodiment of a functional block diagram of an electronic device using the method shown at the same time as Fig. 1.

3A to 3C are diagrams showing an embodiment of a display screen on the display unit 210 of Fig. 2.

4A to 4C are diagrams showing another embodiment of the display screen on the display unit 210 of Fig. 2.

5A to 5C are diagrams showing an embodiment of a region of interest in a background tablecloth containing a subject of interest by analyzing image feature values.

100. . . Method for simultaneously displaying a background tablecloth and one or more user interface components in a display unit of an electronic device

110~140. . . step

Claims (15)

A method for simultaneously displaying a background tablecloth and one or more user interface elements in a display unit of an electronic device, the method comprising: specifying a region of interest of the background tablecloth by analyzing the background tablecloth (Region of Interest, ROI); displaying the background tablecloth; and displaying the one or more user interface elements outside the region of interest on the background tablecloth. The method of claim 1, wherein the step of displaying the one or more user interface elements outside the region of interest on the background tablecloth comprises: moving at least one of the one or more user interface components First, displaying the one or more user interface elements outside the region of interest on the background tablecloth. The method of claim 1, wherein the step of displaying the one or more user interface elements outside the region of interest on the background tablecloth comprises: adjusting at least one of the one or more user interface components The size of a user interface component displays the one or more user interface elements outside of the region of interest on the background tablecloth. The method of claim 1, wherein the region of interest comprises one of the background tiles of interest. The method of claim 4, wherein the subject of interest is a face. The method of claim 1, wherein the background tablecloth is a Live Wallpaper, the dynamic tablecloth includes a plurality of consecutive images, and the background tablecloth is used to specify the region of interest of the background tablecloth. The step includes: specifying the region of interest of the background tablecloth by analyzing the plurality of consecutive images. The method of claim 1, wherein the one or more user interface elements comprise at least one of an Icon, a Widget, a Notification, and a Button. A computer program product comprising a computer program, when the computer program is loaded via an electronic device having a display unit, the computer program causing the electronic device to perform any one of the claims 1 to 7 . An electronic device comprising: a display unit; a display control unit electrically connected to the display unit for controlling the display unit; and a processing unit electrically connected to the display control unit, wherein the processing unit is configured by analyzing a background tablecloth, the area of interest of the background tablecloth is specified, the display control unit controls the display unit, displays the background tablecloth, and displays the one or more user interface elements outside the region of interest on the background tablecloth . The electronic device of claim 9, wherein the display control unit displays the one or more user interface components by moving at least one of the one or more user interface components displayed by the display unit The background tablecloth is outside the area of interest. The electronic device of claim 9, wherein the display control unit displays the one or more by adjusting a size of at least one of the one or more user interface elements displayed by the display unit The user interface component is outside the region of interest of the background tablecloth. The electronic device of claim 9, wherein the region of interest comprises one of the background tiles of interest. The electronic device of claim 12, wherein the subject of interest comprises a face. The electronic device of claim 9, wherein: the background tablecloth is a dynamic tablecloth; and the processing unit analyzes the plurality of consecutive images to specify the region of interest in the background tablecloth. The electronic device of claim 9, wherein the one or more user interface elements comprise at least one of a pictogram, a widget, a notification, and a button.