JP4783447B2 - Display control apparatus and display control method - Google Patents

Description

  The present invention relates to a display control device and a display control method.

  In order to improve the operability and convenience of a plurality of windows displayed on a display in a conventional multi-window system, for example, Patent Document 1 redisplays a plurality of windows on a display in an arrangement with the least overlap. It is described. Japanese Patent Application Laid-Open No. 2004-228620 describes switching a window covered with a predetermined ratio or more by another window to an icon display.

Japanese Patent Laid-Open No. 5-66911 Japanese Patent Laid-Open No. 8-320777

  Here, it is considered that there are many cases where an image selected by the user is set as a display background image such as a desktop wallpaper image of a personal computer or a standby image of a mobile phone. For this reason, it is preferable that the objects can be arranged so that the background image is not hidden by an object such as an icon or a window displayed so as to be superimposed on the background image.

  However, in the display control devices described in Patent Documents 1 and 2, it is possible to arrange the objects displayed on the display with high convenience, but the arrangement of the objects is determined in consideration of the contents of the background image. It is not a thing. Therefore, there are cases where the object displayed in an overlapping manner on the background image blocks the background image and does not necessarily provide a desired screen display for the user.

  The present invention has been made to solve the above problems, and provides a display control apparatus and a display control method capable of determining the arrangement of objects to be displayed on a background screen in consideration of the content of the background screen. The purpose is to provide.

In order to solve the above problems, a display control device according to the present invention includes an acquisition unit that acquires object information including a display size of an object image displayed on a background image, and a plurality of occupancy ratios in the background image that are higher the area defined respectively in color, and the display area determining means for determining a plurality of display area capable of displaying the object image in the background image, a plurality of displayable determined by the display area determining means Arrangement position determining means for determining the arrangement position of the object image on the background image based on the display size of the object information so that the area includes the object image, and the object image at the arrangement position determined by the arrangement position determination means incorporated in, and a control means for displaying on the display means a background image, a position determination means, occupancy maximum color When an object image cannot be included in the defined displayable area, a plurality of displayable areas are sequentially added in order of occupation until the object image is included in the displayable area. enlargement be characterized by Rukoto.

Similarly, in order to solve the above-described problem, the display control method according to the present invention includes an acquisition step of acquiring object information including a display size of an object image to be displayed on the background image, and a higher occupancy ratio in the background image. a plurality a plurality of regions defined respectively by the color, which is determined by the displayable region determining step of determining a plurality of display area capable of displaying the object image in the background image, the display area determining step of The arrangement position determining step for determining the arrangement position of the object image on the background image based on the display size of the object information, and the arrangement position determined in the arrangement position determination step so that the object image is included in the displayable area of incorporate object image, and a control step of displaying on display means a background image, and In the position determining step, when the object image cannot be included in the displayable area defined by the color with the maximum occupation ratio, the plurality of displayable areas are added until the object image is included in the displayable area. to enlarge the display area are sequentially added in the order of occupancy characterized Rukoto.

  According to such a display control apparatus and display control method, an area defined by a color with a high occupation ratio in the background image is determined as a displayable area in which the object image can be displayed in the background image. The arrangement position of the object image on the background image is determined based on the display size of each object so that the object image is included in the displayable area. Thereby, the displayable area of the object can be dynamically changed according to the background image, and the arrangement of the objects to be displayed on the background screen can be determined in consideration of the content of the background screen.

Furthermore , since the size of the displayable region can be changed as appropriate even in the same background image according to the display size and number of object images displayed on the background image, the degree of freedom of object display control can be improved. It becomes possible.

  In the display control apparatus of the present invention, it is preferable that the arrangement position determination unit reduces the display size of the object image when the displayable region determined by the displayable region determination unit cannot include the object image. It is. As a result, the object image can be included in the displayable area even in a situation where the initial display size of the object image cannot be arranged in the displayable area of the background image, and the convenience of object display control can be improved. it can.

  In the display control apparatus of the present invention, it is preferable that the displayable area determining unit deletes the character string portion in the background image from the displayable area. As a result, the object image can be prevented from being placed on the character string portion of the background image, the visibility of the background image is improved, and a screen display that is easier for the user to see can be realized.

  The display control apparatus according to the present invention can determine the arrangement of objects to be displayed on the background screen in consideration of the content of the background screen.

It is a functional block diagram of the communication terminal which concerns on one Embodiment of this invention. It is a hardware block diagram of a communication terminal. It is a figure which shows an example of a structure of a widget information database. It is a figure which shows the process of extracting a displayable area | region from a standby image. It is a flowchart which shows the process performed in the communication terminal of this embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the description of the drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is a functional block diagram of a communication terminal 1 (display control device) according to an embodiment of the present invention. As shown in FIG. 1, the communication terminal 1 includes a pasted widget information acquisition unit (acquisition means) 11, a widget information database 12, a standby image information database 13, a standby image color type detection unit 14, a rank determination unit 15, A received image character string detection unit 16, a widget displayable area determination unit (displayable area determination unit) 17, a widget arrangement position determination unit (arrangement position determination unit) 18, and a widget pasting control unit (control unit) 19 are provided.

  Here, in the present embodiment, the communication terminal 1 such as a mobile phone is cited as an example of the display control apparatus according to the present invention, and a widget (object) is displayed on the standby image (background image) displayed on the display of the communication terminal 1. ) Will be described in a superimposed manner. The “widget” used in the present embodiment refers to a window for constantly displaying frequently used content such as a calculator, a clock, and stock price information on a standby image, and is provided by this widget. The application (content) is called “widget application”. For example, the display size of the widget and the display position on the screen can be freely set by a user operation.

  FIG. 2 is a hardware configuration diagram of the communication terminal 1. The communication terminal 1 physically includes a CPU (Central Processing Unit) 111, a RAM (Random Access Memory) 112 and a ROM (Read Only Memory) 113 that are main storage devices, and an operation unit 114 such as an input key that is an input device. , A terminal device having a display (display unit) 115, a wireless communication unit 116, and the like. Each function of the communication terminal 1 shown in FIG. 1 is configured such that predetermined computer software is loaded on hardware such as the CPU 111 and the RAM 112 shown in FIG. This is realized by operating the communication unit 116 and reading and writing data in the RAM 112 and the ROM 113.

  Next, each function of the communication terminal 1 shown in FIG. 1 will be described.

  The affixed widget information acquisition unit 11 acquires widget information (object information) related to a widget application that is pasted and displayed on a standby image. The widget information specifically includes information such as a widget application name, display size (area, number of dots), thumbnail display presence / absence (details of each information will be described later). The affixed widget information acquisition unit 11 transmits this widget information to the widget information database 12 in response to receiving, for example, widget information input by a user operation from the operation unit 114 of the communication terminal 1, and the standby image color. A control command to start processing of each unit is transmitted to the type detection unit 14 and the standby image character string detection unit 16.

  The widget information database 12 is a part that holds widget information related to a widget application to be displayed on a standby image. FIG. 3 is a diagram illustrating an example of the configuration of the widget information database 12. As shown in FIG. 3, the widget information database 12 specifically includes an “application ID” assigned to each widget application registered to identify the application, and an “application name” indicating the name of the widget application. ”,“ Area ”indicating the set display size of the widget application (the number of dots in the example of FIG. 3),“ Thumbnail display ”indicating whether or not to display the thumbnail of the widget application on the standby image, The widget application is stored as one record in association with “usage frequency” indicating the number of times the widget application has been used since being displayed on the standby image.

  In the example of FIG. 3, the “map widget” with the application ID “1” has an area of “500” dots, is set to perform thumbnail display, and has been used “1” times in the past. Further, the “search engine widget” of the application ID “3” has an area of “2000” dots, is set not to perform thumbnail display, and has been used “five times” in the past. In the search engine widget, the thumbnail image of the search engine screen is not displayed in the standby image widget by setting the thumbnail display “none”, but information such as an application name is displayed instead.

  The widget information database 12 is sequentially updated when new widget information or updated widget information is acquired by the pasted widget information acquisition unit 11 or when the display size of the widget is changed by the widget arrangement position determination unit 18 described later. Updated.

  The standby image information database 13 holds information on the standby image currently displayed on the display 115. The standby image information specifically indicates information indicating the color type of each dot constituting the standby image, and indicates the position and area of a character string such as a clock or a telop displayed on the standby screen. Contains information. The standby image information database 13 is updated when the standby image is changed by a user operation input via the operation unit 114, for example.

  The standby image color type detection unit 14 is a part that detects the configuration of the color type of the standby image. Specifically, the standby image color type detection unit 14 acquires information on the current standby image from the standby image information database 13 in response to receiving a control command from the pasted widget information acquisition unit 11. Then, based on the acquired information on the standby image, the color type of each pixel constituting the standby image is identified, and the number of pixels in which each color type is used is counted. Then, the color configuration information including the color type composing the standby image thus obtained and the number of used pixels of this color type is transmitted to the rank determination unit 15.

  The rank determination unit 15 ranks the color types constituting the standby image according to the occupation ratio. Specifically, the rank determination unit 15 ranks the color types with the highest first to third use pixel ranks 1 based on the color configuration information of the standby image received from the standby image color type detection unit 14. The rank information including the color types of ranks 1 to 3 is transmitted to the widget displayable area determination unit 17. Note that the rank determination unit 15 forms a group by grouping a plurality of similar colors, not in units of individual color types, in order to rank, and creates rank information. Also good.

  The standby image character string detection unit 16 detects a character string portion of the standby image. Specifically, similarly to the standby image color type detection unit 14, the standby image character string detection unit 16 receives the control command from the pasted widget information acquisition unit 11, and receives the standby image information database 13. To obtain information on the current standby image. Then, based on the acquired standby image information, a portion such as a clock display or a telop display embedded in the standby image is detected as a character string portion, and the position / area information of the detected character string portion is displayed in a widget. It transmits to the possible area | region determination part 17. FIG.

  The widget displayable area determination unit 17 determines a displayable area in which a widget can be displayed in the standby image based on information from the rank determination unit 15 and the standby image character string detection unit 16. Specifically, the widget displayable area determination unit 17 receives the rank information of the color type of the standby image from the rank determination unit 15 and the character string portion of the standby image from the standby image character string detection unit 16. Receive location / area information. Based on these pieces of information, first, a set of pixels of the rank 1 color type in the standby image is defined as a first displayable area. Next, a pixel set of color type of rank 2 is defined as a second displayable area. Further, a pixel set of color type of rank 3 is defined as a third displayable area. Further, when a character string portion is included in these first to third displayable areas, a final displayable area is obtained by deleting the character string part.

  Here, the process of extracting the displayable area from the standby image will be described with reference to FIG. In the example of FIG. 4, to simplify the description, the standby image 41 includes four color areas, a first color area 42, a second color area 43, a third color area 44, and a fourth color area 45. Suppose that In the third color region 44, a clock-displayed character string portion 46 is arranged. In this case, the widget displayable area determination unit 17 first determines the first color area 42 having the largest area as the first displayable area 51. Next, the second color area 43 having the second area is determined as the second displayable area 52. Then, a region excluding the character string portion 46 from the third color region 43 having the third area is determined as the third displayable region 53.

  As described above, when the area defined by the color with a high occupation ratio of the standby image is determined as the displayable area of the widget, a part of the standby image that the user does not want to hide in the widget (for example, a snapshot) It is possible to make it easier to place widgets by avoiding human parts of For example, when the standby image is a person photo, there are many cases where various colors are mixed in the person part in a complicated manner, so that the person part is less likely to be selected as a displayable area. It is thought that the widget is easy to be placed avoiding the person part.

  Note that the widget displayable area determination unit 17 may display a display area, for example, even if there is a different color pixel set inside the displayable area, for example, if this pixel set is a small area of a predetermined number of pixels or less. The rule for defining the area may be appropriately set so that the widget can be easily arranged by suppressing the inside of the displayable area from becoming a worm-eaten state.

  The widget displayable area determination unit 17 transmits the determined position information of the first to third displayable areas to the widget arrangement position determination unit 18.

  The widget arrangement position determination unit 18 determines the arrangement position of the widget on the standby image so that the displayable area determined by the widget displayable area determination unit 17 includes the widget. Specifically, the widget placement position determination unit 18 first acquires area information of all widgets displayed on the standby image from the widget information database 12. Next, in the first displayable area among the first to third displayable areas determined by the widget displayable area determining unit 17, it is confirmed whether or not all the widgets to be displayed on the standby image can be arranged. . If it is confirmed that not all widgets can be arranged in the first displayable area, the second displayable area and the third displayable area are added step by step to increase the target area, and the same confirmation is performed. Do.

  In addition, when all widgets cannot be arranged in all the first to third displayable areas, the widget arrangement position determination unit 18 reduces the display size of all widgets at the same magnification, and then repeats the above process. Perform the confirmation process. The display size of this widget is repeatedly reduced until all widgets can be arranged. The widget arrangement position determination unit 18 updates the “area” data in the widget information database 12 when the display size of the widget is changed.

  After confirming that all widgets are finally included in the displayable area, the widget arrangement position determination unit 18 transmits information on the arrangement position of each widget to the widget pasting control unit 19.

  The widget placement position determination unit 18 refers to the “usage frequency” data in the widget information database 12 and refers to the displayable area in the order of the highest usage frequency, ie, upper left → upper right → left middle → right middle → lower left → lower right. It is preferable to arrange widgets along a typical user's line-of-sight movement direction. In the example of FIG. 3, “search engine widget” has the highest usage frequency, and therefore is preferentially arranged at the upper left of the displayable area. On the other hand, since the “map widget” has the lowest usage frequency, the priority of the arrangement position is the lowest, and the possibility of being arranged at the lower right of the displayable area is high.

  The widget pasting control unit 19 incorporates the widget at the arrangement position in the standby image determined by the widget arrangement position determination unit 18 and displays the standby image on the display 115.

  Next, processing executed in the communication terminal 1 of the present embodiment will be described using the flowchart shown in FIG. 5, and a display control method according to the present embodiment will be described. FIG. 5 is a flowchart showing processing executed in the communication terminal 1 of the present embodiment.

  First, the pasted widget information acquisition unit 11 acquires widget information related to a widget application that is pasted and displayed on a standby image (S101: acquisition step). For example, when the user selects a widget application to be pasted on the standby image from the application list screen displayed on the display 115 of the communication terminal 1, the pasting widget information acquisition unit 11 performs this user selection operation via the operation unit 114. Detect and obtain widget information about the widget app selected by this user. Then, the acquired widget information is transmitted to the widget information database 12 and a control command for starting processing of each unit is transmitted to the standby image color type detection unit 14 and the standby image character string detection unit 16.

  Next, the configuration of the color type of the standby image is analyzed by the standby image color type detection unit 14 and the rank determination unit 15 and includes the color types of ranks 1 to 3 in which the number of used pixels is the first to third. Rank information is determined (S102). Further, the standby image character string detection unit 16 detects the position / area information of the character string portion of the standby image (S103). The rank information of these color types and the position / area information of the character string portion are transmitted to the widget displayable area determination unit 17. Note that either of steps S102 and S103 may be executed first.

  Next, the widget displayable area determination unit 17 determines a displayable area in which the widget can be displayed in the standby image (S104: displayable area determination step). The widget displayable area determination unit 17 receives the rank information of the color type of the standby image from the rank determination unit 15 and receives the position / area information of the character string portion of the standby image from the standby image character string detection unit 16. Receive. Based on these pieces of information, first, a set of pixels of the rank 1 color type in the standby image is defined as a first displayable area. Next, a pixel set of color type of rank 2 is defined as a second displayable area. Further, a pixel set of color type of rank 3 is defined as a third displayable area. In addition, when a character string portion is included in these first to third displayable regions, a region excluding the character string portion is set as a final displayable region. The widget displayable area determination unit 17 transmits the determined position information of the first to third displayable areas to the widget arrangement position determination unit 18.

  Next, the widget arrangement position determination unit 18 performs a process of determining the arrangement position of the widget on the standby image.

  First, among the first to third displayable areas determined by the widget displayable area determination unit 17, the first displayable area (that is, the pixel set of the color type of rank 1) of the widget to be displayed on the standby image is displayed. It is confirmed whether or not all can be arranged (S105). For example, the widget displayable area determination unit 17 acquires area information of all widgets to be displayed in the standby image from the widget information database 12, and based on the area information, all widgets are included in the first displayable area. Search whether there is a combination of arrangement positions of widgets that can fit.

  If it is determined that all the widgets cannot be arranged in the first displayable area, the process proceeds to step S107. When it is determined that all the widgets can be arranged in the first displayable area, the widget arrangement position determining unit 18 determines the arrangement position of each widget in the first displayable area (S106: arrangement). (Position determination step), information on the arrangement position is transmitted to the widget pasting control unit 19, and the process proceeds to step S112.

  If it is determined in step S105 that all widgets cannot be placed in the first displayable area, the widget displayable area determination unit 17 continues to display the first displayable area and the second displayable area (that is, ranks 1 and 2). In the color type pixel set), it is confirmed whether or not all the widgets to be displayed in the standby image can be arranged (S107).

  If it is determined that all the widgets cannot be arranged in the first displayable area and the second displayable area, the process proceeds to step S109. When it is determined that all widgets can be arranged in the first displayable area and the second displayable area, the widget arrangement position determination unit 18 determines the first displayable area and the second displayable area. The layout position of each widget is determined (S108: layout position determination step), and information on the layout position is transmitted to the widget pasting control unit 19, and the process proceeds to step S112.

  If it is determined in step S107 that all widgets cannot be placed in the first displayable area and the second displayable area, the widget displayable area determination unit 17 continues to display the first displayable area and the second displayable area. In the area and the third displayable area (that is, pixel sets of color types of ranks 1 to 3), it is confirmed whether or not all widgets to be displayed on the standby image can be arranged (S109).

  When it is determined that all the widgets can be arranged in the first displayable area, the second displayable area, and the third displayable area, the widget arrangement position determination unit 18 determines the first displayable area, Arrangement positions of the respective widgets are determined in the second displayable area and the third displayable area (S110: arrangement position determination step), and information on the arrangement positions is transmitted to the widget pasting control unit 19, and the process proceeds to step S112. To do.

  When it is determined that all the widgets cannot be arranged in the first displayable area, the second displayable area, and the third displayable area, the widget arrangement position determination unit 18 sets the display sizes of all the widgets, etc. The image is reduced by a factor of 2 (S111), and the process returns to step S105. The processes in steps S105 to S111 are repeated until all widgets can be arranged in the displayable area. The widget arrangement position determination unit 18 updates the “area” data in the widget information database 12 when the display size of the widget is changed.

  The widget arrangement position determination unit 18 refers to the “usage frequency” data in the widget information database 12 in the widget arrangement position determination process in steps S106, S108, and S110, and displays the displayable areas in descending order of the usage frequency. It is preferable to arrange the widgets in the direction of upper left → upper right → left middle → right middle → lower left → lower right.

  Then, the widget pasting control unit 19 pastes the widget at the placement position in the standby image determined by the widget placement position determining unit 18 in steps S106, S108, and S110 (S112: control step), and processing in this way. The standby image thus displayed is displayed on the display 115 (S113).

  As described above, according to the communication terminal 1 and the display control method according to the present embodiment, a region defined by a color with a high occupation ratio in the standby image displays a widget in the standby image. The display position of each widget is determined based on the display size of each widget so that the displayable area includes the widget. As a result, the displayable area of the widget can be dynamically changed according to the standby image, and the arrangement of the widget to be displayed on the standby image can be determined in consideration of the content of the standby image. It becomes.

  In addition, the widget displayable area determination unit 17 determines a first displayable area, a second displayable area, and a third displayable area that are respectively defined by the upper three colors in the standby image. When the widget arrangement position determination unit 18 cannot include a widget in the first displayable area, the second displayable area and the third displayable area are displayed until all widgets are included in the displayable area. The displayable area is expanded by sequentially adding the areas. As a result, the size of the displayable area of the same standby image can be changed as appropriate according to the display size and number of widgets displayed on the standby image, thereby improving the degree of freedom of widget display control. It becomes possible.

  In addition, when the widget arrangement position determination unit 18 cannot include all the widgets in the displayable area determined by the widget displayable area determination unit 17, the widget display size is reduced. For this reason, even in a situation where the initial display size of the widget cannot be placed in the displayable area of the standby image, the widget can be included in the displayable area, and the convenience of widget display control can be improved. .

  Further, the widget displayable area determination unit 17 deletes the character string portion in the standby image detected by the standby image character string detection unit 16 from the displayable area. For this reason, it is possible to prevent the widget from being placed on the character string portion of the standby image, to improve the visibility of the standby image, and to realize a screen display that is easier for the user to see.

  The display control apparatus and the display control method according to the present invention have been described with reference to the preferred embodiments, but the present invention is not limited to the above embodiments. For example, in the above embodiment, a communication terminal such as a mobile phone is used as an example of the display control device, but the present invention can also be applied to a desktop of a personal computer. Further, as the background image, in addition to the standby image of the mobile phone in the above-described embodiment, for example, a one-segment video of a mobile phone or a desktop wallpaper of a personal computer may be used. In addition to the widget of the embodiment, an icon image may be used.

  In the above embodiment, when the widget arrangement position determining unit 18 cannot arrange all the widgets in all the first to third displayable areas, the display size of all the widgets is reduced by the same magnification. However, it is possible to reduce only a part of widgets having a large display size, or to change the reduction ratio depending on the display size and type of the widget.

  In the above-described embodiment, the rank determination unit 15 ranks the color types constituting the standby image in three stages according to the top three colors of the occupation ratio. However, the number of ranks may be increased or decreased as appropriate.

  DESCRIPTION OF SYMBOLS 1 ... Communication terminal (display control apparatus) 11 ... Paste widget information acquisition part (acquisition means), 12 ... Widget information database, 13 ... Standby image information database, 14 ... Standby image color type detection part, 15 ... Rank determination , 16 ... standby image character string detection unit, 17 ... widget displayable area determination unit (displayable area determination unit), 18 ... widget arrangement position determination unit (arrangement position determination unit), 19 ... widget pasting control unit (control) Means), 115... Display (display means).

Claims (4)

Acquisition means for acquiring object information including a display size of an object image to be displayed on a background image;
Displayable area determining means for determining, as the plurality of displayable areas capable of displaying the object image in the background image, areas defined by a plurality of colors having higher occupation ratios in the background image. When,
An arrangement position for determining an arrangement position of the object image on the background image based on a display size of the object information so that the object image is included in a plurality of displayable areas determined by the displayable area determination unit. A determination means;
Control means for incorporating the object image at the arrangement position determined by the arrangement position determination means and displaying the background image on the display means;
Equipped with a,
The arrangement position determination means, when the object image cannot be included in the displayable area defined by the color having the maximum occupation ratio, until the object image is included in the displayable area. display control device characterized that you enlarge the display area by sequentially adding the displayable area in the order of occupancy.   The arrangement position determining means reduces the display size of the object image when the object image cannot be included in the displayable area determined by the displayable area determining means. The display control apparatus according to 1.   The display control apparatus according to claim 1, wherein the displayable area determination unit deletes a character string portion in the background image from the displayable area. An acquisition step of acquiring object information including a display size of the object image to be displayed on the background image;
Display area determining step of occupancy determines the region defined by a plurality of colors of upper, a plurality of display area capable of displaying the object image within said background image in said background image When,
An arrangement position for determining an arrangement position of the object image on the background image based on a display size of the object information so that the object image is included in a plurality of displayable areas determined in the displayable area determination step. A decision step;
A control step of incorporating the object image into the arrangement position determined in the arrangement position determination step and displaying the background image on a display means;
Equipped with a,
In the arrangement position determination step, when the object image cannot be included in the displayable area defined by the color having the maximum occupation ratio, the plurality of the object images are included in the displayable area. display control method, wherein that you enlarge sequentially added to allow the display area to the displayable region in the order of occupancy.

Images