JP2019028945A - Program and method for controlling information processing apparatus - Google Patents

Abstract

To explain about icons depending on a user's level of understanding.SOLUTION: An information processing apparatus 100 comprises: a display 14 that can display a plurality of icons; a processor 11 that can execute a plurality of applications; an operation device 15 for a user to input an instruction; and an audio device 18 that emits sound. The processor 11 includes a control unit 32 that displays, on a display 14, explanation of one icon of the plurality of icons by text, and after the lapse of a predetermined time, executes the explanation of one icon by voice by using the audio device 18 or executes the explanation of one icon with moving images using the display 14.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an explanation of icons in an information processing apparatus.

In various information processing apparatuses such as a mobile phone or a smartphone, an icon for starting an application is generally displayed on a home screen. The user can start a corresponding application (hereinafter referred to as an application) using the icon. By the way, a user who is unfamiliar with the operation may not know the application or function of the application corresponding to the icon. Especially for elderly people, it is not easy to master a multifunctional information processing apparatus in which a plurality of applications are installed.
Japanese Patent Application Laid-Open No. 2004-151561 discloses a description of icon functions by voice and an explanation of icon functions by characters for users who are unfamiliar with the operation.

JP 2013-37706 A

By the way, even an elderly person can understand the function of an application that is used repeatedly. On the other hand, elderly people often cannot predict what they can do with apps they have never used. Furthermore, with regard to apps that have been used several times, with a little explanation, elderly people may be able to remember the functionality of the app. As described above, the degree of understanding of the function is greatly different for each icon.
However, in the conventional information processing apparatus, even if the icon can be described using characters or voice, the content of the description does not change depending on the situation. For this reason, there is a problem that the explanation of the icon that the user fully understands the function of the application is the same as the explanation of the icon that the user does not understand the function well.
The present invention has been made in view of the above-described circumstances, and an object of the present invention is to execute explanation of icons according to the degree of understanding of the user.

  In order to solve the above problems, a program according to a preferred aspect of the present invention includes a display device capable of displaying a plurality of icons, an operation device for a user to input an instruction, and an audio device that emits sound. A processor of an information processing apparatus capable of executing a plurality of applications, when a predetermined time elapses after a description of one icon of the plurality of icons is displayed as text on the display device, the audio device is used. Then, the description of the one icon is executed by voice or the control unit is caused to function as a control unit that executes the description of the one icon by a moving image using the display device.

  An information processing apparatus control method according to a preferred aspect of the present invention includes a display device capable of displaying a plurality of icons, an operation device for a user to input an instruction, and an audio device that emits sound. A method of controlling an information processing apparatus capable of executing the application, wherein the audio is detected when a predetermined time has elapsed since a description of one of the plurality of icons is displayed on the display device as text. The explanation of the one icon is executed by voice using the device, or the explanation of the one icon is executed by the moving image on the display device.

  According to the present invention, explanation of icons can be executed according to the degree of understanding of the user.

It is a block diagram which shows the structure of the information processing apparatus which concerns on 1st Embodiment of this invention. It is a block diagram which shows the functional structure of the information processing apparatus which concerns on 1st Embodiment. It is explanatory drawing which shows an example of the content of a usage history table. It is explanatory drawing which shows an example of the content of the operation history table. It is explanatory drawing which shows an example of a home screen. It is a flowchart which shows the content of the description process of an icon. It is explanatory drawing which shows an example of the content of an explanatory table. It is explanatory drawing which shows an example of the home screen on which the icon was displayed. It is explanatory drawing which shows an example of a home screen by which the description of an icon and a text is displayed. It is explanatory drawing which shows an example of a home screen in the process which progresses to description of the 2nd audio | voice after description of the 1st audio | voice. It is explanatory drawing which shows an example of the home screen on which two icons were displayed. It is explanatory drawing which shows the description of the text with respect to two icons and the 2nd icon, and shows an example of a home screen. It is a flowchart which shows the content of the interruption process. It is explanatory drawing which shows an example of the explanatory table used for 2nd Embodiment. It is a flowchart which shows the content of the selection process of the sound data in 2nd Embodiment. It is a flowchart which shows the processing content of the description of the icon by the sound in 3rd Embodiment. It is explanatory drawing which shows an example of the relationship between the count value and explanatory speed concerning 3rd Embodiment. It is a flowchart which shows the content of the selection process of the sound data which concerns on 4th Embodiment. It is a flowchart which shows the processing content of the description of the icon by the sound which concerns on 5th Embodiment. It is explanatory drawing which shows an example of the relationship between the calculated time and speed which concerns on 5th Embodiment. It is a flowchart which shows the content of the selection process of the sound data which concerns on 6th Embodiment. It is a flowchart which shows the processing content of the description of the icon by the sound which concerns on 7th Embodiment. It is explanatory drawing which shows an example of the relationship between the frequency | count of operation and speed which concerns on 7th Embodiment.

<1. First Embodiment>
FIG. 1 is a block diagram illustrating a hardware configuration of the information processing apparatus 100 according to the first embodiment of the present invention. The information processing apparatus 100 is a portable information processing apparatus such as a mobile phone, a smartphone, or a tablet terminal. As illustrated in FIG. 1, the information processing apparatus 100 includes a processing device 11, a storage device 12, a communication device 13, a display device 14, an operation device 15, a GPS device 16, a timing device 17, and an audio device 18. It is realized by. Each element of the information processing apparatus 100 is connected to each other by a single bus or a plurality of buses. Note that the term “apparatus” in the present application may be replaced with other terms such as a circuit, a device, or a unit. In addition, each element of the information processing apparatus 100 may be configured by a single device or a plurality of devices, and some elements of the information processing apparatus 100 may be omitted.

  The processing device 11 is a processor that controls the entire information processing device 100, and includes, for example, a single chip or a plurality of chips. The processing device 11 includes, for example, a central processing unit (CPU) including an interface with peripheral devices, an arithmetic device, a register, and the like. Note that some or all of the functions of the processing device 11 are realized by hardware such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). May be. The processing device 11 executes various processes in parallel or sequentially.

  The storage device 12 is a recording medium readable by the processing device 11, and includes a plurality of programs executed by the processing device 11, various data used by the processing device 11, a use history table TBLa, an operation history table TBLb, and an explanation. Store table TBLc. The storage device 12 includes, for example, one or more types of storage circuits such as a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and a RAM (Random Access Memory). Although details of the usage history table TBLa will be described later, a usage history of an application program (hereinafter referred to as “application”) is stored therein. Further, the operation history table TBLb stores the operation date and time, operation buttons, and related icons in association with each other.

  Further, as will be described later, in the present embodiment, the function of the icon will be described with text and voice. The explanation table TBLc stores icon identification information, text data used for explanation, and sound data used for explanation in association with each other.

  The communication device 13 is a device that communicates with another device via a communication network such as a mobile communication network or the Internet. The communication device 13 is also expressed as, for example, a network device, a network controller, a network card, or a communication module. For example, an application received by the communication device 13 from a distribution server (not shown) via a communication network is stored in the storage device 12.

  The display device 14 displays various images under the control of the processing device 11. For example, various display panels such as a liquid crystal display panel and an organic EL display panel are preferably used as the display device 14.

  The operating device 15 is a device for inputting user instructions. The operation device 15 receives an operation by a user. Specifically, the operation device 15 accepts an operation for inputting codes such as numbers and letters and an operation for selecting an icon displayed on the display device 14. For example, a touch panel that detects contact with the display surface of the display device 14 is suitable as the operation device 15. The operation device 15 may include a plurality of operators that can be operated by the user.

  The GPS device 16 receives radio waves from a plurality of satellites and generates position information from the received radio waves. The position information may be in any format as long as the position can be specified. The position information indicates, for example, the latitude and longitude of the information processing apparatus 100. In this example, it is exemplified that the position information is obtained from the GPS device 16, but the information processing apparatus 100 may acquire the position information by any method. For example, the position information may be acquired using a cell ID assigned to a base station that is a communication destination of the information processing apparatus 100. Further, when the information processing apparatus 100 communicates with a wireless LAN access point, a database in which an identification address (MAC address) on the network assigned to the access point is associated with an actual address (position) is referred to. Position information may be acquired.

The timing device 17 generates date / time information indicating the current date / time. Specifically, date information is generated by counting pulse signals obtained by dividing a clock signal generated by a crystal oscillator or the like. The date / time information includes time information and date information. The time information indicates time. Time means the time of day. For example, it is 11:10:30, and does not include the date. The timing device 17 generates date / time information, but only time information may be used.
The audio device 18 includes a DA converter, an amplifier, and a speaker. In the audio device 18, the sound data is subjected to an analog signal by a DA converter, the analog signal is amplified by an amplifier, the amplified analog signal is supplied to the speaker, and the sound is emitted from the speaker.

  FIG. 2 is a block diagram that focuses on the functions of the information processing apparatus 100. A plurality of functions (history management unit 31 and control unit 32) illustrated in FIG. 2 are realized by the processing device 11 executing the program stored in the storage device 12.

  The history management unit 31 manages the usage history and operation history of the used application. Specifically, the history management unit 31 stores the used date and time, the used application name, the operation content, and the used location in the usage history table TBLa in association with each other. Further, the history management unit 31 stores the operation button, the operation date and time, and the related icon in association with each other in the operation history table TBLb.

FIG. 3A shows an example of the stored contents of the usage history table TBLa. The usage history table TBLa stores a plurality of usage histories. One usage history includes a set of date and time used, application name used, operation content, and location used. In the example shown in the figure, usage histories R1 to R5 are stored in the usage history table TBLa. For example, the use history R5 indicates that a route between Tokyo Hamamatsu was searched using a traffic application on June 25, 2017. Further, the usage history R5 indicates that the traffic application was used at latitude 35.704749 degrees and longitude 139.759653 degrees (Hongo, Bunkyo-ku, Tokyo).
FIG. 3B shows an example of the operation history table TBLb. As shown in this figure, the operation history table TBLb stores a plurality of operation histories. One operation history includes a set of operation date and time, operation buttons, and related icons. The operation history r3 indicates that the unlocking operation was performed at 14:24 on July 10, 2017.

  Returning to FIG. The control unit 32 displays various screens on the display device 14 based on the operation signal output from the operation device 15, and the control unit 32 controls the audio device 18 to output various sounds.

  In this embodiment, after the information processing apparatus 100 is activated, the home screen is displayed on the display device 14 when the user releases the lock. On the home screen, a plurality of icons are displayed corresponding to a plurality of applications installed in the information processing apparatus 100.

FIG. 4 shows an example of the home screen. The home screen in this example includes a map application icon X1, a weather application icon X2, a transportation application icon X3, a mail application icon X4, a news application icon X5, a phone application icon X6, a camera application icon X7, And an album application icon X8.
Further, the home screen is provided with a first button B1 for designating returning to the previous operation and a second button B2 for designating proceeding to the next operation.

  In the present embodiment, icons X1 to X8 are displayed on the home screen in the order of icon X1 → icon X2 →... Icon X8. Further, for each of the icons X1 to X8, the corresponding application is explained, and when the explanation is finished, the next icon is displayed. That is, first, one of the plurality of icons is displayed on the home screen, and explanation thereof is made.

Next, the operation of this embodiment will be described. FIG. 5 is a flowchart showing the contents of the icon explanation process. First, when detecting that the user has released the lock based on the operation signal output from the operation device 15, the processing device 11 displays a home screen without an icon on the display device 14 (step Sa <b> 0).
Next, the processing apparatus 11 adds one icon to the home screen (step Sa1). For example, if the map application icon X1 shown in FIG. 4 is added, the home screen is as shown in FIG.

Next, the processing device 11 displays the description of the icon on the display device 14 as text (step Sa2). Specifically, the processing device 11 reads text data of an icon to be explained from the explanation table TBLc, converts it into image data, and outputs it to the display device 14.
FIG. 6 shows an example of the explanation table TBLc. In this example, the icon identification information of the icon X1 is “x001”, the icon identification information of the icon X2 is “x002”, and the icon identification information of the icon X3 is “x003”.

  For example, when the icon to be explained is the icon X1 shown in FIG. 7, the home screen to which the explanation using the text is added is shown in FIG. In this case, the processor 11 reads the text data Dt1 from the explanation table TBLc. As shown in FIG. 8, in the display field A1 on the right side of the icon X1, the text “You can check the route to the destination and information on nearby shops.” Is displayed. This text is based on the text data Dt1. An elderly person may not be able to imagine the function of the map application even by looking at the shape of the icon X1, but the outline of the map application can be communicated to the elderly person by displaying text.

  Returning to FIG. When the process of step Sa2 ends, the processing device 11 determines whether or not a predetermined time has elapsed since the description of the icon was displayed on the display device 14 as text (step Sa3). When the predetermined time is exceeded, the processing device 11 executes the first explanation using sound. Specifically, the processing device 11 reads out sound data corresponding to an icon to be explained from the explanation table TBLc and outputs it to the audio device 18. For example, when the icon to be described is the icon X1 shown in FIG. 8, the processing device 11 reads out the sound data Ds11 shown in FIG. 6 and outputs it to the audio device 18.

  As described above, in the present embodiment, the condition for executing the first explanation by voice is that a predetermined time elapses after the explanation of the text is displayed. For this reason, stepwise explanations can be given to the user. For example, a user who has never used a map application can hear a more detailed explanation by voice. On the other hand, a user who has used the map application and knows how to use can press the second button B2 to skip the explanation by voice and proceed to the explanation of the next icon. In this example, the text explanation and the voice explanation are not executed at the same time, so the user can consider whether or not the voice explanation is received during a predetermined time.

  Next, the processing device 11 causes the display device 14 to display an image for confirming whether detailed description is required (step Sa5). For example, as shown in FIG. 9, the display field A2 positioned below the display field A1 displays “Do you want to explain in more detail?” So that the user operates the third button B3 or the fourth button B4. Prompt.

  Next, the processing device 11 determines whether or not the user has selected further explanation (step Sa6). When the user selects further explanation, for example, when the user presses the third button B3 shown in FIG. 9, the processing device 11 executes the second explanation of the icon using sound (step Sa7). . Specifically, the processing device 11 reads out sound data corresponding to an icon to be explained from the explanation table TBLc and outputs it to the audio device 18. For example, when the user presses the third button B3 shown in FIG. 9, for example, the icon to be described is the icon X1, and the icon identification information is “x001”. Therefore, the processing device 11 reads out the sound data Ds21 shown in FIG. 6 and outputs it to the audio device 18.

  When the process of step Sa7 ends or when the determination result of step Sa6 is negative, the processing device 11 determines whether or not the explanation of all the icons has been completed (step Sa8). When the description of all icons is completed, the determination result in step Sa8 is “YES”, and the processing device 11 ends the icon description process.

On the other hand, if there is an icon that has not been described, the determination result in step Sa8 is “NO”, the processing device 11 specifies one icon that is not displayed on the home screen (step Sa9), and the process returns to step Sa1. .
For example, when the identified icon is the icon X2 corresponding to the weather application, first, as shown in FIG. 10, the home screen to which the icon X2 is added is displayed, and then the text is explained as shown in FIG. It is displayed in the display column A3. This text is generated based on the text data Dt2 shown in FIG.

  Next, interrupt processing will be described. FIG. 12 is a flowchart showing the contents of the interrupt process. In the present embodiment, interrupt processing is executed at a predetermined interval (for example, 50 ms). First, the processing device 11 determines whether or not the first button B1 is pressed based on the operation signal output from the operation device 15 (step Sb1). The first button B1 is used to designate returning to the previous operation as described above. If the first button B1 is pressed, the determination result in step Sb1 is “YES”, and the processing device 11 determines whether or not the first button B1 is pressed before the description using text. (Step Sb2). Specifically, the processing device 11 determines whether or not it is before step Sa2 shown in FIG.

  If it is before the description using text, the determination result in step Sb2 is “YES”, and the processing device 11 stores the depression of the first button B1 in association with the immediately preceding icon in the operation history table TBLb ( Step Sb21). Further, the processing device 11 returns the processing to the description using the text for the immediately preceding icon. For example, as shown in FIG. 10, when the icon X1 and the icon X2 are displayed, but the first button B1 is pressed in a state before the description using the text is performed on the icon X2, the processing device 11 The process returns to the description using the text of the icon X1 (see FIG. 8). Specifically, the processing device 11 returns the processing to step Sa2 in the icon explanation processing shown in FIG. As a result, the user can receive the explanation again for the icon immediately before the explanation of the text and the voice has already ended.

  On the other hand, if the operation of the first button B1 is after the description using text, the determination result in step Sb2 is “NO”, and the processing device 11 displays the pressing of the first button B1 and the most recently added icon. The associated information is stored in the operation history table TBLb (step Sb22). Further, the processing device 11 returns the processing to the first explanation of the voice. Specifically, the processing device 11 returns the processing to step Sa4 in the icon explanation processing shown in FIG. As a result, the user can receive a voice explanation from the beginning even if the first voice explanation is completed.

  Next, when the first button B1 is not pressed and the determination result in step Sb1 is “NO”, the processing device 11 outputs whether or not the second button B2 is pressed from the operation device 15. A determination is made based on the operation signal (step Sb5). If the second button B2 is not pressed, the determination result is “NO”, and the process waits until the next interrupt timing.

  On the other hand, if the second button B2 is pressed and the determination result in step Sb5 is “YES”, the processing device 11 advances the icon explanation process to step Sa8 shown in FIG. For example, when the icon X1 is displayed on the home screen as shown in FIG. 7 and the explanation using the text has not started, or the explanation using the text of the icon X1 is shown as shown in FIG. If the second button B2 is pressed when the description of the icon X2 has not been started, the description of the icon X1 ends, and the description shifts to the description of the icon X2.

According to the first embodiment, the description of the icon can be performed by combining text and voice, so that even an elderly person who is not good at understanding the sentence can understand the function of the icon by voice. It becomes possible.
In addition, after a description using the text, when a predetermined time elapses, the description by voice is started. However, a user who can understand the function of the application by the description of the text can operate the second button B2 to operate the following. You can move to the explanation of the icon. Therefore, the explanation of the icon can be provided step by step, and the user can shorten the time for receiving the explanation.
In addition, the explanation of the voice is divided into the first time and the second time. When the first explanation is finished, the user is asked whether or not to receive the second explanation. Depending on the degree of understanding, the description of the icon can be changed.

<2. Second Embodiment>
The explanation time of the voice in the first embodiment is the same if it is the same icon, whereas the explanation of the voice according to the second embodiment is based on the past user's operation device 15 even if the icon is the same. It differs in that it is changed based on the used instructions.
The information processing apparatus 100 according to the second embodiment uses the description table TBLd instead of the description table TBLc, and the information of the first embodiment shown in FIG. 1 except for the method of selecting sound data in the description by voice. This is the same as the processing apparatus 100.

FIG. 13 shows an example of the explanation table TBLd used in the second embodiment. As shown in this figure, the explanation table TBLd stores three pieces of sound data for the first explanation and three pieces of sound data for the second explanation in association with the icon identification information.
For example, sound data Ds11a, Ds11b, and Ds11c for the first explanation and sound data Ds21a, Ds21b, and Ds21c for the second explanation are stored in association with the icon identification information x001. Here, when the sound times based on the sound data Ds11a, Ds11b, and Ds11c are t11a, t11b, and t11c, and the sound times based on the sound data Ds21a, Ds21b, and Ds21c are t21a, t21b, and t21c, The formula holds.
t11a <t11b <t11c
t21a <t21b <t21c
That is, in the explanation table TBLd, three types of sound data having different explanation times are stored corresponding to each of the first explanation and the second explanation.

  In the second embodiment, sound data is selected according to the number of times the application is used. FIG. 14 is a flowchart showing the contents of the sound data selection process. First, the processing device 11 (control unit 32) specifies an icon to be described (step Sc1). Next, the processing apparatus 11 counts the number of application usage histories corresponding to the identified icon (step Sc2). Specifically, the processing device 11 refers to the usage history table TBLa, counts the number of usage histories of the application corresponding to the identified icon, and obtains the count value N.

  Thereafter, the processing device 11 selects sound data corresponding to the count value N (step Sc3). When the count value N is N = 0, the processing device 11 selects the sound data having the longest audio description. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11c is selected in the first explanation of the voice, and the sound data Ds21c is selected in the second explanation of the voice.

  When the count value N is 1 ≦ N ≦ 3, the sound data having the middle voice description length is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11b is selected in the first explanation of the voice, and the sound data Ds21b is selected in the second explanation of the voice.

  When the count value N is 4 ≦ N, the sound data having the shortest audio description length is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11a is selected in the first explanation of the voice, and the sound data Ds21a is selected in the second explanation of the voice.

  The larger the number of times the application is used, the more familiar the user is with the operation of the application. Therefore, even if the explanation by voice is short, the user can easily understand the function of the application corresponding to the icon. According to the present embodiment, since the sound data is selected so that the explanation time of the voice becomes shorter as the number of times the application is used, the explanation of the icon can be executed according to the degree of understanding of the user.

<3. Third Embodiment>
In the second embodiment described above, the sound data used for the description of the sound is selected according to the number of times the application is used. In the third embodiment, the speed of the sound is changed according to the number of times the application is used.
The information processing apparatus 100 according to the third embodiment is the same as that shown in FIG. 1 except that the processing apparatus 11 (the control unit 32) sets the sound reproduction speed for the audio apparatus 18 according to the number of times the application is used. The configuration is the same as the information processing apparatus 100 of the embodiment.
FIG. 15 is a flowchart showing the processing contents of the description of the icon by voice. Steps Sd1 and Sd2 refer to the usage history table TBLa as in Steps Sc1 and Sc2 shown in FIG. 14 described above, count the number of usage histories of the application corresponding to the identified icon, and count value N Have gained.

  Thereafter, the processing device 11 reproduces the sound at a speed corresponding to the count value N (step Sd3). Specifically, the processing device 11 specifies a sound reproduction speed for the audio device 18. An example of the relationship between the count value N and the explanation speed is shown in FIG. In this example, when the count value N is 0 ≦ N ≦ 2, playback is 1 × speed, when the count value N is 3 ≦ N ≦ 5, playback is 1.1 × speed, and when the count value N is 6 ≦ N , Playback at 1.4 times speed.

  As the number of times the application is used increases, the user is used to the operation. Therefore, even if the speed of explanation by voice increases, the user can easily understand the function of the application corresponding to the icon. According to this embodiment, since the voice playback speed is set to be faster as the number of times the application is used, the explanation of the icons can be executed according to the degree of understanding of the user.

<4. Fourth Embodiment>
The information processing apparatus 100 according to the second embodiment changes the audio explanation time by selecting sound data according to the number of times the application is used. In contrast, in the information processing apparatus 100 according to the fourth embodiment, after the icon is displayed on the display device 14, the processing device 11 instructs the user to operate the second button B2 to display the next icon. The description of the icon is changed according to the time until the reception.
The information processing apparatus 100 according to the fourth embodiment is the same as that of the second embodiment except for the process of selecting sound data.

  FIG. 17 is a flowchart showing the contents of sound data selection processing according to the fourth embodiment. First, the processing device 11 (control unit 32) specifies an icon to be explained (step Se1). Next, the processing device 11 refers to the operation history table TBL and calculates the time from when the icon is displayed until the second button B2 is pressed (step Se2). In this example, the past operation of the second button B2 closest to the present at the time of explaining the icon is specified. However, an average may be calculated for a plurality of operations, and the time from when the icon is displayed until the second button B2 is pressed may be specified.

  Thereafter, the processing device 11 selects sound data corresponding to the calculated time (step Se3). When the calculated time T is less than 15 seconds, the processing device 11 selects sound data having the longest audio description. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11c is selected in the first explanation of the voice, and the sound data Ds21c is selected in the second explanation of the voice.

  If the calculated time T is not less than 15 seconds and less than 30 seconds, the sound data having the middle voice description length is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11b is selected in the first explanation of the voice, and the sound data Ds21b is selected in the second explanation of the voice.

  If the calculated time T is 30 seconds or longer, the sound data with the shortest audio description is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11a is selected in the first explanation of the voice, and the sound data Ds21a is selected in the second explanation of the voice.

  With the icon displayed on the home screen, the shorter the time it takes for the user to operate the second button B2, the shorter the user wants to explain the icon and go to the next icon explanation. I can guess. In such a case, the user is often used to the operation for the application corresponding to the icon. Therefore, if the time until the user operates the second button B2 in a state where the icon is displayed on the home screen is short, the user understands the function of the application corresponding to the icon even if the voice explanation is short. Is easy. According to the present embodiment, the sound data is selected such that the shorter the calculated time is, the shorter the sound explanation time is, so that the explanation of the icon can be executed according to the degree of understanding of the user.

<5. Fifth Embodiment>
The information processing apparatus 100 according to the third embodiment changes the voice explanation speed according to the number of times the application is used. In contrast, in the information processing apparatus 100 according to the fifth embodiment, after the icon is displayed on the display device 14, the processing device 11 instructs the user to operate the second button B2 to display the next icon. The voice explanation speed is changed according to the time until the reception.
The information processing apparatus 100 according to the fifth embodiment is the same as that of the third embodiment except for the process of selecting sound data.

  FIG. 18 is a flowchart showing the processing contents of the explanation of the icon by voice. In step Sf1 and step Sf2, as in step Se1 and step Se2 shown in FIG. 17 described above, the time from when the icon is displayed until the second button B2 is pressed is referred to by referring to the operation history table TBLb. Calculated.

  Thereafter, the processing device 11 reproduces the sound at a speed corresponding to the calculated time (step Sf3). Specifically, the processing device 11 designates a sound reproduction speed for the audio device. An example of the relationship between the calculated time and speed is shown in FIG. In this example, when the calculated time T is T <15, playback is 1.4 times faster, and when the calculated time T is 15 ≦ T <30, playback is 1.1 times faster, and the calculated time T is 30 ≦ 30. In the case of T, playback at 1 × speed is performed.

  In a state where the icon is displayed on the home screen, the shorter the time until the user operates the second button B2, the more often the user is used to the operation corresponding to the icon. Therefore, if the calculated time is short, it is easy for the user to understand the function of the application corresponding to the icon even if the voice explanation speed is high. According to this embodiment, since the sound is reproduced so that the explanation speed of the voice becomes faster as the calculated time is shorter, the explanation speed of the icon can be changed according to the degree of understanding of the user.

<6. Sixth Embodiment>
In the information processing apparatus 100 according to the fourth embodiment and the fifth embodiment, the processing apparatus 11 displays an icon on the display apparatus 14 and then the user operates the second button B2 to display the next icon. The explanation of the icon by voice was changed according to the time to accept.
On the other hand, the information processing apparatus 100 according to the sixth embodiment changes the description of the icon by voice according to the number of operations of the first button B1 that causes the description of one icon to be executed again.

The information processing apparatus 100 according to the sixth embodiment is the same as that of the fourth embodiment except for the process of selecting sound data.
FIG. 20 is a flowchart showing the contents of sound data selection processing according to the sixth embodiment. First, the processing device 11 (control unit 32) specifies an icon to be described (step Sg1). Next, the processing device 11 refers to the operation history table TBLb, counts the operation history of the first button B1 in relation to the specified icon, and specifies the number of operations (step Sg2).

  Thereafter, the processing device 11 selects sound data corresponding to the number of operations K (step Se3). When the number of operations K is 5 or more, the processing device 11 selects sound data having the longest audio description. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11c is selected in the first explanation of the voice, and the sound data Ds21c is selected in the second explanation of the voice.

  When the number of operations K is 2 times or more and less than 5 times, the sound data having the middle voice description length is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11b is selected in the first explanation of the voice, and the sound data Ds21b is selected in the second explanation of the voice.

  If the number of operations K is less than 2, the sound data with the shortest audio description length is selected. For example, when the map application is an application corresponding to the specified icon, the sound data Ds11a is selected in the first explanation of the voice, and the sound data Ds21a is selected in the second explanation of the voice.

  The user operates the first button B1 with the icon displayed on the home screen when he wants to hear the explanation of the icon again. Therefore, the application corresponding to the icon with a large number of operations of the first button B1 often does not allow the user to understand the contents of the application. In the present embodiment, since the description of the icon using the voice is changed according to the number of times the user instructs to execute the description of the icon again, the description of the icon is executed according to the degree of understanding of the user. be able to.

<7. Seventh Embodiment>
The information processing apparatus 100 according to the sixth embodiment changes the audio explanation time according to the number of operations of the first button B1. In contrast, the information processing apparatus 100 according to the seventh embodiment changes the voice explanation speed in accordance with the number of operations of the first button B1.
The information processing apparatus 100 according to the seventh embodiment is the same as that of the sixth embodiment except for the process of selecting sound data.

  FIG. 21 is a flowchart showing the processing contents of the description of the icon by voice. In step Sh1 and step Sh2, similarly to step Sg1 and step Sg2 shown in FIG. 20 described above, the operation history table TBLb is referred to, and the operation history of the first button B1 is counted in relation to the specified icon. The number of times K is specified.

  Thereafter, the processing device 11 reproduces a sound at a speed corresponding to the number of operations K (step Sh3). Specifically, the processing device 11 designates a sound reproduction speed for the audio device. An example of the relationship between the number of operations K and the speed is shown in FIG. In this example, when the number of operations K is K = 0, playback is performed at 1.4 times speed, when the number of operations K is K = 1, playback is performed at 1.1 times speed, and when the number of operations K is 2 ≦ K, 1 Double speed playback.

  In a state where the icon is displayed on the home screen, the smaller the number of operations K the user operates the first button B1, the more often the user is used to the operation corresponding to the icon. Therefore, if the number of operations K is small, the user can easily understand the function of the application corresponding to the icon even if the explanation speed by voice is fast. According to the present embodiment, the sound is reproduced so that the voice explanation speed becomes faster as the number of operations K is smaller. Therefore, the icon explanation speed can be changed according to the degree of understanding of the user.

<8. Modification>
The present invention is not limited to the embodiments exemplified above. Specific modifications are exemplified below. Two or more aspects arbitrarily selected from the following examples may be merged.

(1) In each of the above embodiments, when a predetermined time has elapsed, the first explanation using voice is executed (see FIG. 1), but the present invention is not limited to this. For example, when the second button B2 is not operated even after a predetermined time has elapsed, the processing device 11 displays a screen that prompts the user to select whether or not a more detailed explanation is desired as shown in FIG. When the user desires, the first explanation by voice may be executed.
Further, the explanation of the icons was explained by displaying the text, and then the explanation of the icons was executed using voice. The present invention is not limited to this, and may be described with moving images instead of sounds.
In this case, moving image data may be used in place of the sound data of each embodiment described above. The control unit 32 expands the compressed moving image data as necessary, and supplies the expanded moving image data to the display device 14. In the second embodiment and the like described above, sound data respectively corresponding to explanation times by a plurality of voices is stored in the explanation table TBLd. However, moving image data respectively corresponding to explanation times by a plurality of videos is stored instead of sound data. That's fine. Then, the moving image data may be selected based on past instructions input by the user using the operation device 15.
That is, the control unit 32 causes the display device 14 to execute the icon description by displaying the moving image when a predetermined time has elapsed after the description of the icon is displayed on the display device 14 as text.

  Further, in the third embodiment, the fifth embodiment, and the seventh embodiment described above, the speed at which sound is reproduced is changed. However, when moving image data is used instead of sound data, What is necessary is just to change the reproduction speed of a moving image.

  Further, in the second embodiment and the like described above, the explanation of the voice is divided into the first time and the second time, but one of them may be explained by the voice and the other may be explained by the moving image. In particular, it is preferable that the first explanation is a sound and the second explanation is a moving image. In the reproduction of moving images, the processing load is heavier than the reproduction of sound, and the current consumption is large. A user's understanding may be obtained by the first audio explanation, and the second explanation may be unnecessary. In such a case, the processing load on the information processing apparatus 100 can be reduced and the power consumption can be reduced.

(2) In each above-mentioned form and modification, it is preferred that control part 32 reflect use history in explanation using a voice or animation. First, in the case of a moving image, moving image data in which an actual operation screen is recorded as a usage history is generated and stored in the usage history table TBLa. The moving image data may be read from the usage history table TBLa and reproduced. For example, it is assumed that an elderly person starts a map application in a grandchild's house and searches for a route to the house. In this case, after starting the application, first the home address is input for the route search, then the search instruction is input, and as a result, the route search result screen is obtained. This is reproduced in the video. Since the use history is a history that the user himself has used the application in the past, there is an advantage that the user's understanding deepens.
Also, if you want to reflect the usage history in the explanation using voice, refer to the usage history, for example, “We checked the weather in Hamamatsu yesterday.” It is preferable that the sound data is taken in.

(3) In each of the above-described embodiments, the user's instruction to display the next icon is input in a state where one icon is displayed on the display device 14 by pressing the second button B2. Is not limited to this. Any method may be used as long as a user instruction can be input. For example, input by voice may be used. In this case, the controller device 15 includes a sound interface.

(4) In the above-described embodiments, after the first end of the voice, the user is prompted to input whether to execute the second description (see FIG. 9). However, the present invention is not limited to this. For example, when the second button B2 is not operated within a certain time after the first explanation is completed, the second explanation may be executed.

(5) In each form mentioned above, the control part 32 may change the time of the description using an audio | voice or a moving image according to a user's attribute. User attributes are, for example, personal information such as the user's age, gender, family structure, and hobbies. For example, even if it is an elderly person over 65 years old, if the hobby is photography, there is a high possibility that the function of the app can be sufficiently understood without a long explanation for the camera app. In addition, understanding tends to decline gradually as the age increases. In other words, it is possible to estimate the degree of understanding of the user with respect to the application of one icon based on the user attribute. On the other hand, the explanation time and the explanation speed are preferably determined according to the degree of understanding of the user's app.

  Therefore, each element of the user attribute is stored in advance in the storage device 12 as a profile. The control unit 32 acquires each element of the attribute of the user, converts each element into a numerical value, and substitutes the converted numerical value into an evaluation formula that evaluates understanding of the application to acquire an evaluation value. Then, the control unit 32 may determine the explanation time and the explanation speed based on the evaluation value.

(6) In each of the above-described embodiments, the processing device 11 determines the explanation time using audio or moving images, but the user may be allowed to input in advance. For example, on a setting screen on which various settings can be made, one of candidates such as “short”, “normal”, and “long” may be selected. In this case, the control unit 32 sets a description time using audio or a moving image in accordance with a user instruction.

(7) In each of the above embodiments, a portable information processing device such as a mobile phone or a smartphone has been exemplified as the information processing device 100. However, a specific form of the information processing device 100 is arbitrary, It is not limited to the illustration. For example, a portable or stationary personal computer may be used as the information processing apparatus 100.

(8) In each of the above-described embodiments, the storage device 12 is a recording medium that can be read by the processing device 11 and is exemplified by a ROM, a RAM, and the like. Disk, Blu-ray (registered trademark) disk, smart card, flash memory device (eg, card, stick, key drive), CD-ROM (Compact Disc-ROM), register, removable disk, hard disk, floppy (registered trademark) A) a disk, magnetic strip, database, server or other suitable storage medium. In addition, the program may be transmitted from a network via a telecommunication line. Further, the program may be transmitted from a communication network via an electric communication line. The base station may include an input device such as an input key and an output device such as a display.

(9) Each form mentioned above is LTE (Long Term Evolution), LTE-A (LTE-Advanced), SUPER 3G, IMT-Advanced, 4G, 5G, FRA (Future Radio Access), W-CDMA (registered trademark). , GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi), IEEE 802.16 (WiMAX), IEEE 802.20, UWB (Ultra-WideBand), Bluetooth (registered trademark) ), A system using other appropriate systems, and / or a next-generation system extended based on these systems.

(10) In each of the above-described embodiments, the specific operation performed by the base station (for example, specification of position information by the base station) may be performed by the upper node in some cases. In a network composed of one or more network nodes having a base station, various operations performed for communication with a terminal may be performed by the base station and / or other network nodes other than the base station (e.g., Obviously, this can be done by MME or S-GW, but not limited to these. Although the case where there is one network node other than the base station in the above is illustrated, a combination of a plurality of other network nodes (for example, MME and S-GW) may be used.

(11) In each of the above embodiments, the information and signals described may be represented using any of a variety of different technologies. For example, data, commands, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these May be represented by a combination of
Note that the terms described in this specification and / or terms necessary for understanding this specification may be replaced with terms having the same or similar meaning.

(12) In each of the above-described forms, input / output information or the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or additionally written. The output information or the like may be deleted. The input information or the like may be transmitted to another device.

(13) In each of the above-described embodiments, the determination may be performed by a value (0 or 1) represented by 1 bit, or may be performed by a true / false value (Boolean: true or false). The comparison may be performed by numerical comparison (for example, comparison with a predetermined value).

(14) In the flowcharts exemplified in the above embodiments, the order of the steps may be changed. That is, the order of each process in the preferred embodiment of the present invention is not limited to a specific order.

(15) Each function illustrated in FIG. 2 is realized by any combination of hardware and software. Each function may be realized by a single device, or may be realized by two or more devices configured separately from each other.

(16) The program exemplified in each of the above-described forms, regardless of whether it is called software, firmware, middleware, microcode, hardware description language, or another name, is an instruction, instruction set, code, code segment, It should be interpreted broadly to mean program code, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures or functions, etc.
Also, software, instructions, etc. may be transmitted / received via a transmission medium. For example, software may use websites, servers, or other devices using wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission media.

(17) In the above embodiments, the terms “system” and “network” are used interchangeably.

(18) In each of the above-described configurations, the base station can accommodate one or a plurality of (for example, three) cells (also referred to as sectors). When the base station accommodates a plurality of cells, the entire coverage area of the base station can be divided into a plurality of smaller areas, and each smaller area can be divided into a base station subsystem (for example, an indoor small base station RRH: Remote). Communication service can also be provided by Radio Head). The term “cell” or “sector” refers to part or all of the coverage area of a base station and / or base station subsystem that provides communication services in this coverage. Further, the terms “base station”, “eNB”, “cell”, and “sector” may be used interchangeably herein. A base station may also be referred to in terms such as a fixed station, NodeB, eNodeB (eNB), access point, femtocell, small cell, and the like.

(19) In each embodiment described above, the information processing apparatus 100 includes a case where it is a mobile station. A mobile station is defined by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless It may also be called terminal, remote terminal, handset, user agent, mobile client, client, or some other appropriate terminology.

(20) In each of the foregoing forms, the term “connected”, or any variation thereof, means any direct or indirect connection or coupling between two or more elements and It can include the presence of one or more intermediate elements between two “connected” elements. The connection between the elements may be physical, logical, or a combination thereof. As used herein, the two elements are radio frequency by using one or more wires, cables and / or printed electrical connections, and as some non-limiting and non-inclusive examples By using electromagnetic energy, such as electromagnetic energy having wavelengths in the region, the microwave region and the light (both visible and invisible) region can be considered “connected” to each other.

(21) In each of the above-described embodiments, the description “based on” does not mean “based only on”, unless otherwise specified. In other words, the phrase “based on” means both “based only on” and “based at least on.”

(22) As long as “including”, “comprising”, and variations thereof are used in this specification or the claims, these terms are similar to the term “comprising”. It is intended to be comprehensive. Furthermore, the term “or” as used herein or in the claims is not intended to be an exclusive OR.

(23) Throughout this application, if articles are added by translation, for example, a, an and the in English, these articles are clearly not otherwise indicated by context, Includes multiple.

(24) It will be apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented as modifications and changes without departing from the spirit and scope of the present invention determined based on the description of the scope of claims. Accordingly, the description herein is for illustrative purposes and does not have any limiting meaning to the present invention. Moreover, you may combine the some aspect selected from the aspect illustrated in this specification.

(25) In each of the above-described embodiments, the display time of the text for displaying the explanation of the icon may be changed depending on the usage frequency of the app, the time until the second button B2 is operated, the sex, or the age.
The application is not limited to the pudding installation, and may be downloaded.
For the downloaded application, the processing device 11 may search for the description on the Internet and generate description data such as text data, audio data, and moving image data used for explaining the icon.
In addition, text data, audio data, and moving image data may be incorporated in the application, or the processing device 11 may acquire the data from a predetermined server via the Internet.
In addition, the processing device 11 accesses the download site of the application to acquire text data that explains the contents, summarizes this, uses a simple description for text display, automatically reads out the detailed description, and uses voice An explanation may be executed.

DESCRIPTION OF SYMBOLS 100 ... Information processing apparatus, 11 ... Processing apparatus, 12 ... Memory | storage device, 13 ... Communication apparatus, 14 ... Display apparatus, 15 ... Operation apparatus, 16 ... GPS apparatus, 17 ... Time measuring apparatus, 18 ... Audio apparatus, 31 ... History management 32, control unit, TBLa ... usage history table, TBLb ... operation history table, TBLc, TBLd ... description table, X1-X8 ... icon, B1 ... first button, B2 ... second button.

Claims (10)

A processor of an information processing apparatus that includes a display device capable of displaying a plurality of icons, an operation device for a user to input instructions, and an audio device that emits sound, and that can execute a plurality of applications,
When a predetermined time elapses after the description of one of the plurality of icons is displayed as text on the display device, the description of the one icon is executed by voice using the audio device, or the display As a control unit for executing the explanation of the one icon with a video using the device,
A program to function. The description of the one icon using the sound or the moving image includes a first description and a second description.
The controller is
After the first explanation is executed, if the user instructs the execution of the second explanation using the operation device, the second explanation is executed.
The program according to claim 1.   The said control part changes the time of description of the said one icon using the said audio | voice or the said moving image based on the past instruction | indication which the said user input using the said operating device. The listed program.   The said control part changes the speed of description of the said one icon using the said audio | voice or the said moving image based on the past instruction | indication which the said user input using the said operating device. The listed program.   The program according to claim 3 or 4, wherein the past instruction input by the user using the operation device is a use history of the plurality of applications. The past instruction input by the user using the operation device is an instruction of the user to display the next icon in a state where the one icon is displayed on the display device,
The control unit uses the voice or the moving image depending on a time from when the one icon is displayed on the display device until an instruction of the user to display the next icon is input. Change the description of one icon,
The program according to claim 3 or 4, characterized by the above. The past instruction input by the user using the operation device is an instruction of the user that causes the explanation of the one icon to be executed again,
The control unit changes the description of the one icon using the voice or the moving image according to the number of instructions of the user that causes the description of the one icon to be executed again.
The program according to claim 3 or 4, characterized by the above.   The program according to claim 1, wherein the control unit changes a description time using the voice or the moving image according to the attribute of the user.   The program according to any one of claims 1 to 8, wherein the control unit reflects a use history in the description using the voice or the moving image. A display device capable of displaying a plurality of icons, an operation device for a user to input instructions, and an audio device that emits sound, and a control method for an information processing device capable of executing a plurality of applications,
Detecting that a predetermined time has elapsed since the description of one of the plurality of icons is displayed as text on the display device;
Causing the audio device to execute the description of the one icon by voice, or causing the display device to execute the description of the one icon by moving image;
A method for controlling an information processing apparatus.

Images