JP2014059736A - Information processing device, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for improving visibility for a user to search a desired icon in an information processing device displaying a plurality of icons.SOLUTION: The information processing device includes: a display part for displaying a predetermined upper-limit number of images (icons) on one screen; an operation part for receiving an operation for selecting an image displayed on the display part; a storage part for storing therein history of execution of a function corresponding to the image due to the image selection operation as use frequency management information for each image; a display order management part for determining an arrangement position of the image on the basis of the execution history of each function indicated by the use frequency management information; and a display control part causing a display screen 40 of the display part to display the predetermined upper-limit number or less of images in accordance with the display arrangement position of each image determined by the display order management part.

Description

  The present invention relates to an information processing apparatus that displays icons, and more particularly to a technique for improving user convenience.

  In order to make it easier for the user to use the information device, the information device displays various information on the monitor using icons. For example, the information device displays an icon for starting the application, an icon indicating the state of the information device such as a remaining battery level and radio wave intensity, and the like.

  When an information device displays an icon on a monitor, various techniques are known that improve user convenience by, for example, speeding up a drawing process or increasing the amount of information presented to the user.

  For example, Japanese Patent Application Laid-Open No. 09-179716 (Patent Document 1) uses an icon itself as one piece of graphic information, and realizes a process of drawing by arbitrarily changing the color of the icon with a small amount of memory consumption. The technology which can do is disclosed. International Publication No. 10/084949 (Patent Document 2) discloses a technique capable of efficiently presenting an information source to a user even when the display capability of the display device is limited. International Publication No. 09/004996 (Patent Document 3) extracts difference areas based on the screen data of the previous screen and the current screen in order to reduce the amount of transmission data when transmitting screen data. A technique for calculating the degree of change in pixel value is disclosed. For example, when the user operates an icon on the screen, the degree of change in the pixel value of the difference area corresponding to the icon is greater than the degree of change in the pixel value of the difference area corresponding to the background portion. The transmission buffer is preferentially stored in the order of the degree of change.

  In recent years, communication devices such as smartphones and tablet terminals have become widespread, and these communication devices can acquire various applications through a network. The communication device displays an icon for starting an application on the screen and accepts a user operation. The communication device exhibits various functions by activating these acquired applications.

JP 09-179716 A International Publication No. 10/084949 International Publication No. 09/004996

  For example, when acquiring an application, the communication device automatically adds an icon to the end of a column in which the icon is displayed. As described above, since the communication device adds icons to be displayed on the screen according to a predetermined standard, when the number of icons increases, there is a problem that visibility for a user to search for a desired icon decreases. .

  Since the communication device has a restriction on the size of the display area of the screen, the number of icons that can be displayed on one screen is limited. In order to display a list of icons for starting an application, the communication apparatus provides a plurality of pages and displays icons on each page. Therefore, when the number of applications that are frequently used increases, the user uses the communication device in a state where the applications are distributed over a plurality of pages, and it takes time to search for icons by visual inspection.

  Therefore, there is a need for a technique for improving the convenience of the user by improving the visibility for the user to search for a desired icon.

  An information processing apparatus according to an embodiment includes an image associated with a function of the information processing apparatus, a display unit configured to display a number of images equal to or less than a predetermined upper limit number on one screen, and a display unit An operation unit that receives an operation for selecting an image to be displayed, a storage unit that stores, for each image, a history of execution of a function corresponding to an image by an image selection operation, and execution of each function corresponding to each image Based on the history, a display order management unit that determines an arrangement position for displaying an image for each image, and displays a number of images equal to or less than a predetermined upper limit number on the display unit according to the determined arrangement position of the image display Display control unit.

  Preferably, the display unit includes a plurality of image display areas for displaying an image constituting one screen, and the storage unit determines whether to display an image or prohibit display of the image in each of the image display areas. The display control unit prohibits the display of the image in the image display area for prohibiting the display of the image, and arranges the determined display of the image in the image display area for displaying the image. An image may be displayed according to the position.

  Preferably, the display order management unit obtains a background image to be displayed on the display unit, and performs an image recognition process on the acquired background image, thereby extracting an image recognition unit that extracts a region in which the image display is prohibited from the background image. In addition, according to the extraction result of the image recognition unit, an image display region corresponding to a region in which image display is prohibited in the background image may be stored in the storage unit in association with information indicating that image display is prohibited. Good.

  Preferably, the storage unit stores the number of times the function corresponding to the image is executed as a history of execution of the function corresponding to the image, and the display order management unit includes the function within a predetermined period of each function. The arrangement position for displaying the image may be determined based on the number of executions.

  Preferably, the storage unit stores an execution time when the function corresponding to the image is executed as a history of execution of the function corresponding to the image, and the display order management unit includes a predetermined period of each function. The arrangement position for displaying the image may be determined based on the length of the execution time executed inside the image.

  Preferably, the display control unit may arrange one or more images in a matrix and display the images on the display unit.

  Preferably, the information processing apparatus further includes an inclination sensor that detects the inclination of the information processing apparatus, and the display control unit may display an image according to the detected inclination.

  According to another embodiment, a method for controlling display of an information processing device is provided. The information processing apparatus is an image associated with the function of the information processing apparatus, and a display unit configured to display a number of images equal to or less than a predetermined upper limit number on one screen, and an image selected by an image selection operation A storage unit for storing, for each image, a history of execution of the corresponding function. In this method, the information processing apparatus receives an operation of selecting an image displayed on the display unit, and the information processing apparatus displays an image for each image based on an execution history of each function corresponding to each image. Determining an arrangement position to be performed, and causing the information processing apparatus to display a number of images equal to or less than a predetermined upper limit number on the display unit in accordance with the determined arrangement position of the image display.

  According to another embodiment, a program for controlling display processing of an information processing apparatus is provided. The information processing apparatus includes an image associated with the function of the information processing apparatus, a display unit configured to display a number of images equal to or less than a predetermined upper limit number on one screen, a processor, and an image selection operation And a memory for storing a history of execution of the function corresponding to the image for each image. The program includes a step of accepting an operation for selecting an image displayed on the display unit in the processor, and a step of determining an arrangement position for displaying the image for each image based on an execution history of each function corresponding to each image. And causing the display unit to display a number of images equal to or less than a predetermined upper limit number in accordance with the determined display order of images.

  According to the one embodiment, visibility for a user to search for a desired icon can be improved, and user convenience can be improved.

  The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the present invention taken in conjunction with the accompanying drawings.

It is a figure which shows the outline of the whole structure of the network containing the information processing apparatus of embodiment. 2 is a diagram illustrating a hardware configuration of the information processing apparatus 100. FIG. 2 is a functional block diagram illustrating a configuration of an information processing apparatus 100. FIG. It is a figure which shows the example which the information processing apparatus 100 displays the list of applications on the display part 22 with an icon. It is a figure which shows the example of a display of the icon in the mode which displays a shortcut. It is a figure which shows the usage frequency management information 29. FIG. It is a figure which shows the display order information. 10 is a flowchart illustrating processing in which the information processing apparatus 100 rearranges the arrangement of icons. It is a figure which shows the example which rearranged the icon displayed on the display screen. It is a figure which shows an example of the background image. It is a figure which shows the example which displays an icon avoiding the display of the icon in the fixed part of a background image in the icon display area. It is a flowchart which shows the process which extracts the area | region which restrict | limits the arrangement | positioning of an icon based on a background image. It is a figure which shows the example of a display of the display screen 40 in the case of changing the arrangement | positioning location of an icon based on a background image. It is a figure which shows control of the icon arrangement position at the time of use by landscape orientation. It is a figure which shows the example of control of the icon display according to the inclination of a display.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<1.1 Network configuration overview>
FIG. 1 is a diagram illustrating an outline of an overall configuration of a network including an information processing apparatus according to an embodiment. As illustrated in FIG. 1, the network includes an information processing device 100A, an information processing device 100B, a wireless router 200, a wireless base station 300, a network 700, and a server 800. The information processing apparatus 100A and the information processing apparatus 100B (hereinafter, the plurality of information processing apparatuses may be collectively referred to as “information processing apparatus 100”) include a CPU (Central Processing Unit), a ROM (Read Only Memory), A RAM (Random Access Memory), a display, a sensor (acceleration sensor, gyro sensor, etc.), a communication interface, etc. are provided and operates according to a program. For example, the information processing apparatus 100A is a tablet terminal, and the information processing apparatus 100B is a smartphone.

  As illustrated in FIG. 1, the information processing apparatus 100 is connected to the Internet through a wireless router 200, a wireless base station 300, and the like, can communicate with a server 800 through a network 700, and can download an application from the server 800.

  The server 800 is a server group including a plurality of servers such as the server 800A and the server 800B. The server 800 functions as a content distribution platform for distributing digital content. The server 800 receives access from the information processing apparatus 100, authenticates the user who uses the content, and transmits the content desired by the user to the information processing apparatus 100 of the authenticated user.

  For example, the server 800 distributes various applications operating on the information processing apparatus 100, music data, moving image data, and the like as digital contents. The application distributed by the server 800 includes, for example, an application for using map information using a GPS (Global Positioning System) function, an application for using SNS (Social Network Service), and the information processing apparatus 100. An application for using the camera function, an application functioning as a browser of the information processing apparatus 100, and the like.

  When the information processing apparatus 100 acquires an application or the like from the server 800, the information processing apparatus 100 generates an image (for example, an icon, a symbol, or a graphic) indicating the acquired application, and displays the image on a display according to a user operation. In addition, the information processing apparatus 100 displays an image indicating a shortcut of a frequently used file such as a phone book file or a document file. In the following description, it is assumed that an image indicating an application and an image indicating a file shortcut are icons.

<1.2 Hardware Configuration of Information Processing Apparatus 100>
Next, the configuration of the information processing apparatus 100 will be described with reference to FIGS. 2 and 3. FIG. 2 is a diagram illustrating a hardware configuration of the information processing apparatus 100. As illustrated in FIG. 2, the information processing apparatus 100 includes a CPU 11, a RAM 12, a ROM 13, a communication interface 14, a touch panel display 15, and an acceleration sensor 16.

  The CPU 11 is a processor that operates according to a program, and controls the operation of the information processing apparatus 100 by, for example, reading and executing a program stored in the ROM 13. The RAM 12 holds a program, data for the CPU 11 to execute the program, and the like. The ROM 13 stores a program for controlling the operation of the information processing apparatus 100.

  The communication interface 14 is an interface for the information processing apparatus 100 to communicate with other apparatuses, such as a wireless local area network (LAN) module according to the IEEE (The Institute of Electrical and Electronic Engineers) 802.11 standard, A communication module for a mobile communication system (LTE (Long Term Evolution), 3G, etc.).

  The touch panel display 15 detects, for example, a contact position of the user with a capacitive touch panel, and outputs a signal indicating the detected operation position of the user to the CPU 11.

  The acceleration sensor 16 is a triaxial acceleration sensor module, for example, and detects the inclination of the information processing apparatus 100 by detecting gravity or the like. Based on the detection result of the acceleration sensor 16, the CPU 11 determines the side that is closer to the user among the four sides of the display, and controls the display content of the screen according to the determination result.

<1.3 Configuration of Functions of Information Processing Device 100>
The configuration of the information processing apparatus 100 will be described with reference to FIG. FIG. 3 is a functional block diagram illustrating the configuration of the information processing apparatus 100. As illustrated in FIG. 3, the information processing apparatus 100 includes a communication unit 21, a display unit 22, an operation unit 23, a control unit 24, a storage unit 25, and an inclination detection unit 26. The control unit 24 includes a display order management unit 27 and a display control unit 28.

  The communication unit 21 includes an antenna, a high frequency circuit, and the like, and performs modulation / demodulation and frequency conversion of the wireless communication signal of the information processing apparatus 100. The communication unit 21 includes an antenna or the like corresponding to each communication method. The communication method includes, for example, a short-range wireless communication standard such as Bluetooth (registered trademark), a wireless LAN standard such as IEEE 802.11, and an infrared communication standard such as IrDA. Further, the communication unit 21 corresponds to a communication system in a mobile communication system such as a 3G system.

  The display unit 22 is a display for displaying icons and background images on the menu screen, and displaying still images, moving images, and the like by application operations. A specific example of displaying icons and the like by the display unit 22 will be described later. The display unit 22 is realized by, for example, an LCD (Liquid Crystal Display) or an organic EL (electroluminescence) display.

  The operation unit 23 is an operation member for receiving a user's operation, and is a touch panel that receives a user's contact operation by, for example, a capacitance method.

  The control part 24 is comprised by CPU etc. and controls operation | movement of the communication apparatus 1 according to a program. The display order management unit 27 manages the arrangement positions of icons for displaying the icons corresponding to the applications on the display based on the frequency with which the user executes the function corresponding to the icons. The display control unit 28 controls display contents on the display unit 22. The control unit 24, for example, a process of communicating with an external communication device by the communication unit 21, a process of installing an application from the server 800, a process of displaying an icon indicating the application on the display unit 22, and a usage frequency management described later. Based on the information 29, it is determined which of the four sides of the display is the front side for the user according to the process of rearranging the icons and the detection result of the tilt detection unit 26, and the display on the display to the user according to the determination result Execute processing that rotates appropriately.

  The storage unit 25 includes a ROM, a RAM, and the like, and stores usage frequency management information 29, display order information 30, and applications. The usage frequency management information 29 is information that associates the frequency with which the function associated with the icon is executed (application execution frequency) with each icon. The display order information 30 is information indicating the order for displaying the icons on the display. Details of the usage frequency management information 29 and the display order information 30 will be described later.

  The inclination detection unit 26 is configured by an acceleration sensor or the like, detects the inclination of the information processing apparatus 100, and outputs the detection result to the control unit 24.

<1.4 Display examples>
A specific example of an icon display method on the display unit 22 will be described with reference to FIGS. 4 and 5.

  FIG. 4 is a diagram illustrating an example in which the information processing apparatus 100 displays a list of applications on the display unit 22 using icons. As shown in FIG. 4, the display unit 22 displays icons indicating each application in a matrix on the display screen 40. The terminal status display area 41 indicates information for a user who uses the information processing apparatus 100, such as the remaining battery level of the information processing apparatus 100, the reception intensity of radio waves received by the information processing apparatus 100, and the time counted by the information processing apparatus 100. This is an area for displaying a state in which the processing apparatus 100 is operating.

  The menu display area 42 shows a display mode for displaying icons. Specifically, the display mode is an application mode that displays a list of applications, a widget mode that displays a list of widgets that operate on the standby screen, and a shortcut mode that displays a list of applications frequently used by the user. It is. The information processing apparatus 100 accepts an input operation from the user to the menu display area 42, thereby switching between these modes and displaying icons.

(Arranged display based on the number of icons)
The information processing apparatus 100 stores a setting value for the upper limit number of icons displayed on one screen in the display unit 22. The information processing apparatus 100 sets the upper limit number of icons to be displayed based on the display resolution, the image resolution of each icon, and the like, and stores the setting value. For example, the image resolution of the icon is set to an image resolution that allows the user to visually recognize and select the icon with the user's finger or the like. When the information processing apparatus 100 displays icons of this image resolution on the display, the interval between the icons is the upper limit number of icons to be displayed on one screen as an interval at which the user does not select an unintended icon. Stores the set value.

  When the number of icons to be displayed by the information processing apparatus 100 is larger than the setting value of the upper limit number of icons to be displayed on one screen, all the icons cannot be displayed on one screen on the display unit 22. In this case, the information processing apparatus 100 displays icons on a plurality of pages. When the user desires to perform a selection operation on the remaining icons that are not displayed on one screen in the display unit 22, for example, the user performs a slide operation of sliding a finger on the touch panel. The information processing apparatus 100 scrolls the screen by detecting the user's slide operation, and displays the remaining icons not displayed on one screen on the display.

(Automatic icon generation)
Each application is associated with an icon so that each application can be identified by the user. The information processing apparatus 100 downloads an application from the server 800 and stores the application in the storage unit 25. The information processing apparatus 100 generates an icon corresponding to the newly downloaded application, and adds the generated icon to a menu screen or the like. In order to add an icon to a menu screen or the like, the information processing apparatus 100 adds and arranges an icon at the end of the icons arranged and arranged, for example.

(Displayed according to the display order)
The information processing apparatus 100 manages the display order of the icons using the display order information 30. As will be described in detail later, the display order information 30 is information indicating the correspondence between icon display positions and applications. The information processing apparatus 100 displays icons on the display according to the order in which the icons are displayed.

  In the example of FIG. 4, the information processing apparatus 100 sets the maximum number of icons to be displayed on one screen to 12 and arranges icons in each row in order from the upper area of the screen according to the order in which icons are displayed. For example, the information processing apparatus 100 displays three 12 icons in one line, and the first line (first line display area 110) and the second line (second line display area 120) from the top of the screen. Each time the third line (third line display area 130) and fourth line (fourth line display area 140) are filled, the icons are sequentially arranged on the next line.

  In this case, the first line icon display area 111, the first line icon display area 112, and the first line icon display area 113 are areas for displaying icons in the first line (first line display area 110). . The first row icon display area 111 is an area in which icons are displayed in the first order. The first line icon display area 112 is an area in which icons are displayed in the second order. The first row icon display area 113 is an area in which icons are displayed in the third order. Similarly, in the second line, the second line icon display area 121, the second line icon display area 122, and the second line icon display area 123 have the fourth, fifth, This is the sixth area. Similarly, in the third row icon display area 131, the third line icon display area 132, and the third line icon display area 133 of the third line, the icons are displayed in the seventh, eighth, This is the ninth area. The fourth line icon display area 141, the fourth line icon display area 142, and the fourth line icon display area 143 in the fourth line are the tenth, eleventh, and twelfth areas in which icons are displayed, respectively. It is.

  In the example of FIG. 4, the information processing apparatus 100 uses the second line icon display area 122 and the second line icon display area 123 as areas where icon display is prohibited, and does not display icons. Therefore, in the example of FIG. 4, the information processing apparatus 100 places the fourth icon in the second row icon display area 121 in the order of displaying icons, and the fifth icon in the third line icon display area 131. And the sixth icon is arranged in the third row icon display area 132.

  FIG. 5 is a diagram illustrating a display example of icons in a mode for displaying shortcuts. In FIG. 5, the information processing apparatus 100 displays, in the icon display area 43, icons indicating applications and files that are frequently started by the user in accordance with the usage frequency of applications and files by the user.

  In the example of FIG. 5, it is assumed that there are many opportunities for a user to perform an operation of calling a personal contact because he frequently contacts other users. Therefore, in the example illustrated in FIG. 5, the information processing apparatus 100 displays icons indicating personal contact shortcuts as the first line icon display area 111, the first line icon display area 112, the first line icon display area 113, and the first line icon. They are displayed in a two-line icon display area 121, a second line icon display area 122, and a second line icon display area 123.

<2 data>
Next, data used by the information processing apparatus 100 will be described with reference to FIGS. 6 and 7.

  FIG. 6 is a diagram showing the usage frequency management information 29. As shown in FIG. 6, one record of the usage frequency management information 29 includes an application / file name 291, a usage count 292, and a usage time 293.

  The application / file name 291 indicates information for identifying an application or file stored in the information processing apparatus 100. In the application / file name 291, the information for identifying the application is, for example, the application name “browser” and the application name “camera”, and the information for identifying the file is, for example, the file name “contact information“ AA ””. It is.

  The usage count 292 indicates the number of times the application indicated by the application / file name 291 has been executed or the number of times the file indicated by the application / file name 291 has been referenced.

  The usage time 293 indicates the total usage time when the application indicated by the application / file name 291 is executed or the total time when the file indicated by the application / file name 291 is referred to.

  The display order management unit 27 of the control unit 24 updates the usage frequency management information 29 every time each application is executed and each file is referred to. Further, the display order management unit 27 measures the time when each application is executed and the time when each file is referred to, and updates the usage time 293.

  FIG. 7 is a diagram showing the display order information 30. As shown in FIG. 7, one record of the display order information 30 includes an item 31, a display position 32, an application / file 33, and an icon ID 34.

  An item 31 indicates a display mode when displaying an icon. In the example of FIG. 7, an application mode and a shortcut mode are shown as display modes.

  The display position 32 indicates a display position for displaying an icon in each display mode. The example of FIG. 7 corresponds to the display example of FIG. The information processing apparatus 100 displays a corresponding icon at each display position.

  Note that the application / file 33 stores information indicating that icon display is prohibited for the record in which the display position 32 in the application mode of FIG. 7 is the display position “4”. This indicates that the display of the icon is prohibited in the fourth area of the display position for displaying the icon. The display control unit 28 refers to the display order information 30 and reads the icon display position indicated by the display position 32 and the icon ID 34 corresponding to the display position and displays them on the display unit 22.

  The application / file 33 indicates an application or file name associated with the icon.

  The icon ID 34 indicates an identifier of an image for displaying the application indicated by the application / file 33 on the display unit 22 as an icon.

  The display control unit 28 displays each icon on the display screen 40 by referring to the display order information 30 and reading the association between the icon display position and the icon.

<3 operation>
Next, the operation of the information processing apparatus 100 will be described with reference to FIGS. FIG. 8 is a flowchart illustrating processing in which the information processing apparatus 100 rearranges the arrangement of icons. The display order management unit 27 manages the usage frequency and usage time of each application, and sequentially updates the usage frequency management information 29. The information processing apparatus 100 executes the process illustrated in FIG. 8 and rearranges the shortcut mode icon arrangement every predetermined period (for example, every day).

In step S <b> 11, the display order management unit 27 reads the usage frequency management information 29.
In step S <b> 13, the display order management unit 27 calculates the usage frequency of each application and each file by the user based on the usage frequency 292 and usage time 293 of the read usage frequency management information 29. As a usage frequency calculation method, for example, the usage frequency management information 29 is extracted when the usage count 292 is equal to or greater than a predetermined count, and the extraction results are assumed to be used in descending order of usage time 293.

  In step S15, the display order management unit 27 updates the display order information 30 by rearranging the identifiers of the applications or files in the descending order of use frequency as a result of the calculation process in step S13.

  For example, by rearranging the identifiers by the display order management unit 27, the file name “AA contact information”, the file name “CC contact information”, and the file name “EE contact” are arranged in descending order of usage frequency. Suppose that it was rearranged as "first", ... The display order management unit 27 associates the file name “AA contact information”, which is the most frequently used identifier, with the position “0” of the display position 32 where the item 31 is indicated as the shortcut mode. Subsequently, the display order management unit 27 associates the file name “EE contact information”, which is the next most frequently used identifier, with the position “1” of the display position 32. Hereinafter, the identifiers of applications or files are similarly rearranged in descending order of usage frequency.

  In step S17, the display control unit 28 reads the display order information 30, determines the display mode, reads the display position 32 corresponding to the display mode, arranges the icons, and displays them on the display.

  FIG. 9 is a diagram illustrating an example in which icons displayed on the display screen 40 are rearranged. FIG. 9A is a diagram illustrating a display example of the display screen 40 before icon rearrangement. FIG. 9B shows a display example of the display screen 40 when the icons are rearranged according to the frequency of use of the application or file associated with the icons by the information processing apparatus 100 executing the processing of FIG. FIG.

  Comparing FIG. 9A and FIG. 9B, since the user increased the frequency of use of the contact file, the icon indicating the shortcut to the file of each contact in FIG. They are displayed in the display order (first line display area 110, second line display area 120). Further, the icon indicating the application name “setting” is displayed at the bottom of the display screen 40 with the display order lowered as a result of the relative decrease in the usage frequency by the user compared to the contact file or the like.

(Summary)
As described above, the information processing apparatus 100 according to the embodiment has been described. This information processing apparatus 100 arranges the arrangement order of icons according to the frequency with which the application or file associated with the icon is used by the user, and displays the icons in order of frequency of use for the user, thereby improving the convenience of the user. Improves sex.

<4 Modification>
In addition, the configuration of the information processing apparatus 100 may be configured as follows.

<4.1 Control of icon arrangement position based on background image>
In the description of the above embodiment, the information processing apparatus 100 sets an area in which icon display is prohibited in FIG. For example, depending on the background image displayed on the display of the information processing apparatus 100, the visibility of the background image and the icon may be reduced due to the overlapping display with the icon.

  Therefore, the information processing apparatus 100 may avoid displaying icons in a specific area by extracting features of the background image. Thereby, the visibility of an icon can be improved and a user's convenience can be improved. For example, the information processing apparatus 100 may display an icon on the display screen 40 so as to avoid a specific target specified in advance, such as a person.

  FIG. 10 is a diagram illustrating an example of the background image 45. In the example illustrated in FIG. 10, the background image 45 includes two persons. For an image showing two persons, the information processing apparatus 100 can extract a person's face part by image recognition (face part 46A, face part 46B). For example, the information processing apparatus 100 may display icons while avoiding the face portion 46A and the face portion 46B. Thereby, the part (the face part 46A and the face part 46B) that the user wants to browse in the background image is not hindered by the icon display. In addition, for example, when the visibility of the icon is reduced due to the overlap between the icon and the background image, the visibility of the icon is improved by displaying the icon while avoiding this overlap.

  FIG. 11 is a diagram illustrating an example in which icons are displayed in the icon display area 43 while avoiding the display of icons on certain portions of the background image. As shown in FIG. 11, icons are arranged avoiding the face portions of two persons included in the background image.

  FIG. 12 is a flowchart illustrating a process of extracting an area for restricting icon arrangement based on a background image.

  In step S <b> 21, the display order management unit 27 reads wallpaper data serving as a background image from the storage unit 25.

  In step S23, the display order management unit 27 performs image recognition processing on the wallpaper data, thereby extracting a specific target such as a person specified in advance. The area including the specific object shown in the extraction result is an area where icon display is prohibited.

  Note that the display order management unit 27 may execute this image recognition processing in the information processing apparatus 100, or may transmit the data (wallpaper data) that is the object of image recognition processing to an external server such as the server 800. The server may accept the result of the image recognition processing.

  In step S25, the display order management unit 27 determines whether there is an area where icon display is prohibited as a result of the process in step S25. For example, the display order management unit 27 extracts a person's face by image recognition, and when the overlap between the area indicated by the outline and the area for displaying the icon exceeds a certain level, the display prohibition area Is determined. In addition, when the overlap between the area indicated by the outline and the area for displaying the icon is not more than a certain level, the display order management unit 27 determines that the icon display is not prohibited for the area.

  If there is an area where icon display is prohibited for each area for displaying an icon (YES in step S25), display order management unit 27 executes the process of step S27 and prohibits icon display. If there is no (NO in step S25), the process is terminated.

  In step S <b> 27, if there is an area where icon display is prohibited as a result of the background image recognition process, the display order management unit 27 reads the display order information 30. Based on the read display order information 30, the display order information 30 refers to the display position 32 corresponding to the area where icon display is prohibited, and inserts a record for indicating the area where icon display is prohibited.

  Referring to the example of the display order information 30 in FIG. 7, the record in which the item 31 indicates the application mode and the display position 32 is the display position “4” is an area where the icon display is prohibited, and the application / file 33 and the icon are displayed. A record indicating an area where icon display is prohibited is inserted in ID34.

  FIG. 13 is a diagram illustrating a display example of the display screen 40 when the icon arrangement location is changed based on the background image. FIG. 13A shows a display example of the display screen 40 in a state where the icons are not rearranged by the background image. FIG. 13B shows a display example of the display screen 40 when the display order management unit 27 rearranges icons based on the background image by the process shown in FIG.

  As shown in FIGS. 13A and 13B, the display order management unit 27 recognizes the background image as a second row icon display region 122 and a second row as a result of image recognition of the background image. The icon display area 123 is set. The display control unit 28 displays a background image and prohibits display of icons in the second row icon display region 122 and the second row icon display region 123 according to the image recognition result of the background image.

  In FIG. 13A, an icon indicating the application name “mail” is displayed in the second line icon display area 122, and an icon indicating the application name “camera” is displayed in the second line icon display area 123. ing. On the other hand, in FIG. 13B, since the display of the icons in the second row icon display area 122 and the second row icon display area 123 is prohibited, the display location of each icon is shifted, and the display control unit 28, an icon indicating the application name “mail” is displayed in the third line icon display area 131, and an icon indicating the application name “camera” is displayed in the third line icon display area 132.

<4.2 Control of Icon Arrangement Position Based on Inclination of Information Processing Device 100>
Further, the control of the icon arrangement position based on the image recognition result of the background image can be performed both when the display of the information processing apparatus 100 is in a vertically long state and in a horizontally long state.

  FIG. 14 is a diagram illustrating the control of the icon arrangement position during use in landscape orientation. FIG. 14A is a diagram illustrating a display example of the display screen 40 when there is no region where the icon display is prohibited. The information processing apparatus 100 switches display contents on the display according to the detection result by the inclination detection unit 26.

  As shown in FIG. 14A, when the display is in a horizontally long state, the number of icons that can be arranged in one line is increased compared to that in a vertically long state, and the number of lines for arranging icons is reduced. As for the icon arrangement method, when the display is in a vertically long state and a horizontally long state, as shown in FIG. 4 and the like, for example, in the vertically long state, three icons are arranged in each row and four lines are displayed on one screen. An icon for the minute is to be displayed. In the state where the display is horizontally long, as shown in FIG. 14A, four icons are arranged in each line, and icons for three lines are displayed on one screen.

  When the display is in the horizontally long state, as in the case of the vertically long state, the display control unit 28 arranges the icons in each row in order from the upper area of the screen of the display screen 40 according to the order of displaying the icons. Display an icon on. When the display is horizontally long, the first line icon display area 111, the first line icon display area 112, the first line icon display area 113, and the first line icon display area 114 are the first line (first line display area). 110) is an area for displaying an icon. The first row icon display area 111 is an area in which icons are displayed in the first order. The first line icon display area 112 is an area in which icons are displayed in the second order. The first row icon display area 113 is an area in which icons are displayed in the third order. The first row icon display area 114 is the fourth area in which icons are displayed. Similarly, in the second line, the second line icon display area 121, the second line icon display area 122, the second line icon display area 123, and the second line icon display area 124 are ranked in the order of displaying icons. The fifth, sixth, seventh, and eighth regions. Hereinafter, similarly, the third line icon display area 131, the third line icon display area 132, the third line icon display area 133, and the third line icon display area 134 of the third line have the order of displaying icons. The ninth, tenth, eleventh, and twelfth areas.

  FIG. 14B shows a display example of the display screen 40 when icons are rearranged based on the background image in a state where the display is horizontally long. As a result of the image recognition by the display order management unit 27, the display order management unit 27 detects the second line icon display area 122 and the second line icon display area 123 of the display screen 40 as areas for prohibiting icon display. .

  FIG. 15 is a diagram illustrating an example of icon display control according to the tilt of the display. FIG. 15A1 and FIG. 15A2 show icon display examples when there is no icon rearrangement based on the background image. FIG. 15A1 shows a vertically long state of the display, and FIG. 15A2 shows a horizontally long state of the display. The display order information 30 is displayed on the display screen 40 by switching the arrangement of icons each time a portrait or landscape state is detected according to the detection result of the tilt detection unit 26.

  FIG. 15B1 and FIG. 15B2 show icon display examples when there is a rearrangement of icons based on the background image. FIG. 15B1 shows a vertically long state of the display, and FIG. 15B2 shows a horizontally long state of the display.

(Enlargement / reduction of icon image resolution)
In the description of the above embodiment, the image resolution of the icons is fixed, but the resolution of each icon may be changed according to the order in which the icons are displayed. For example, it is assumed that the first and second icons in the order in which icons are displayed are frequently used. Therefore, an icon corresponding to an application with high usage frequency may be enlarged and displayed.

  As a result, the user can easily select an icon that is frequently used. Further, the information processing apparatus 100 may reduce some icons and display them on the display screen 40 according to the usage frequency. For example, the information processing apparatus 100 reduces and displays icons that are less frequently used on the display screen 40. As a result, the total number of icons that can be confirmed on one screen can be increased, so that the user does not need to frequently perform a scrolling operation or the like when visually confirming a desired icon from an icon group with low usage frequency. .

  The embodiment disclosed this time must be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  11 CPU, 12 RAM, 13 ROM, 14 communication interface, 15 touch panel display, 16 acceleration sensor, 21 communication unit, 22 display unit, 23 operation unit, 24 control unit, 25 storage unit, 26 tilt detection unit, 27 display order management Part, 28 display control part, 29 usage frequency management information, 30 display order information, 31 items, 32 display position, 33 application / file, 34 icon ID, 40 display screen, 41 terminal state display area, 42 menu display area, 43 Icon display area, 45 background image, 100 information processing device, 110 first line display area, 111 first line icon display area, 112 first line icon display area, 113 first line icon display area, 120 second line display area 121 Second line icon display area, 122 Second line Icon display area, 123 Second line icon display area, 130 Third line display area, 131 Third line icon display area, 132 Third line icon display area, 133 Third line icon display area, 140 Fourth line display area, 141 4th line icon display area, 142 4th line icon display area, 143 4th line icon display area, 200 wireless router, 291 application / file name, 292 usage count, 293 usage time, 300 wireless base station, 700 network, 800 servers.

Claims (9)

An information processing apparatus,
A display unit configured to display an image associated with the function of the information processing apparatus and displaying a number of images equal to or less than a predetermined upper limit number on one screen;
An operation unit that receives an operation of selecting an image displayed on the display unit;
A storage unit for storing, for each image, a history of execution of a function corresponding to the image by the image selection operation;
A display order management unit that determines an arrangement position for displaying an image for each image based on an execution history of each function corresponding to each image;
A display control unit that causes the display unit to display a number of images equal to or less than the predetermined upper limit number according to the determined image display arrangement position,
Information processing device. The display unit includes a plurality of image display areas for displaying the image, constituting the one screen,
The storage unit is configured to store whether to display an image or prohibit display of an image in each of the image display areas,
The display control unit prohibits display of an image in an image display area that prohibits display of the image, and displays the image in the image display area that displays the image according to the determined display position of the image. Display,
The information processing apparatus according to claim 1. The display order management unit
Including an image recognition unit that acquires a background image to be displayed on the display unit, and performs image recognition processing on the acquired background image, thereby extracting a region in which the display of the image is prohibited in the background image;
In accordance with the extraction result of the image recognition unit, the image display region corresponding to the region in which image display is prohibited in the background image is stored in the storage unit in association with information indicating that display of the image is prohibited. ,
The information processing apparatus according to claim 2. The storage unit stores the number of times the function corresponding to the image has been executed as a history of execution of the function corresponding to the image,
The display order management unit determines an arrangement position for displaying the image based on the number of times of execution within a predetermined period among the functions.
The information processing apparatus according to claim 1. The storage unit stores, as a history of execution of the function corresponding to the image, an execution time when the function corresponding to the image is executed,
The display order management unit determines an arrangement position for displaying the image based on a length of execution time executed within a predetermined period among the functions.
The information processing apparatus according to claim 1. The display control unit
The one or more images are arranged in a matrix and displayed on the display unit;
The information processing apparatus according to claim 1. The information processing apparatus further includes:
An inclination sensor for detecting the inclination of the information processing apparatus;
The display control unit displays the image according to the detected inclination;
The information processing apparatus according to claim 1. A method for controlling display processing of an information processing apparatus,
The information processing apparatus is an image associated with the function of the information processing apparatus, and is configured to display a number of images equal to or less than a predetermined upper limit number on one screen, and the image selection operation A storage unit for storing a history of execution of the function corresponding to the image for each image,
The method
The information processing apparatus accepting an operation of selecting an image displayed on the display unit;
The information processing apparatus, based on the execution history of each function corresponding to each image, determining an arrangement position for displaying the image for each image;
The information processing apparatus includes a step of causing the display unit to display a number of images equal to or less than the predetermined upper limit number according to the determined arrangement position of the image display.
Method. A program for controlling display processing of an information processing apparatus,
The information processing apparatus is an image associated with the function of the information processing apparatus, and is configured to display a number of images equal to or less than a predetermined upper limit number on one screen, a processor, and the image A memory for storing, for each image, a history of execution of the function corresponding to the image by the selection operation of
The program is stored in the processor.
Receiving an operation of selecting an image displayed on the display unit;
Determining an arrangement position for displaying an image for each image based on an execution history of each function corresponding to each image;
Causing the display unit to display a number of images equal to or less than the predetermined upper limit number according to the determined arrangement position of the image display,
program.

Images