JP2008090454A - Gui generation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate GUI which is excellent in operability and convenience in order to support the operation of GUI by a user. <P>SOLUTION: In this device to be operated by a user while referring to GUI to be displayed on a display screen, an action detection part 8 detects a remote operation by a user or an action such as the movement of the line of sight of a user, and a circumstance judgement part 9 specifies a GUI site considered by the user on the GUI based on the detection result of an action detection part. Also, the level of attention to each GUI site by the user is decided according to the gazing time of each GUI site or the use frequency of each GUI site by the user. Then, a circumstance judgement part changes the array of the GUI site, the size of the GUI site, the character size of the GUI site, and the character font of the GUI site or the like for reconfiguring the GUI so that the GUI site whose use frequency by the user is high can be displayed so as to be emphasized according to the level of attention to each GUI site by the user. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a GUI generation apparatus that provides a GUI in a device operated using a graphical user interface (GUI).

  In recent years, devices called PCs (Personal Computers) and digital home appliances are rapidly spreading. In many cases, these devices are configured to be operated using a GUI. It can be said that the adoption of the GUI is one of the reasons that it is impossible to operate a multifunction device only with a function direct button provided on the device main body or a remote controller (remote controller).

  For example, many multifunctional devices are aimed at remote controls that seem to be easy to use by reducing the buttons on the remote control as much as possible. The operation of the multi-function device by the remote controller with few buttons is performed by, for example, a function menu GUI displayed on a screen such as a display. Specifically, in the function menu GUI on the screen, the GUI cursor is moved by the up / down / left / right buttons, the enter button, and the return button of the remote controller, and operations such as function selection and function execution are performed.

  However, in the above case, the remote control has a reduced number of buttons and looks easy to use. However, many function GUI parts (for example, function selection buttons displayed on the GUI screen) are displayed on the screen, and the menu is displayed. It will be composed of multiple layers. As a result, there arises a problem that the operation of the GUI screen by the user is complicated and difficult (that is, a problem that the convenience of the GUI is lowered).

  Also, even if the user can learn complicated GUI screen operations, there are a large number of function GUI parts displayed on one screen, or there are functions frequently used by the user at a very deep menu hierarchy. In this case, the user is forced to press a large number of remote control buttons, and there is a problem that a great stress is placed on the user. This is an unavoidable problem as long as a device equipped with a GUI having a usability problem is used continuously.

Further, for example, Patent Document 1 below discloses a method of adaptively changing the display area on the screen based on the user's device usage status. In this patent document 1, a gaze tracking device capable of tracking the user's line of sight to the display (where the user is looking on the display) is installed, and the gaze area on the screen by the user is monitored, The user's gaze area is determined as an area in which the user is interested, and the gaze area is enlarged and displayed, thereby ensuring the visibility of the display content.
Japanese Patent Laid-Open No. 10-78845 (FIGS. 2, 11, 12, 13)

  However, according to the method disclosed in Patent Document 1, it is possible to ensure the visibility of the user by enlarging a part of the content information, while improving the convenience for the user's operation (GUI There is no mention of (enhancing usability). That is, with the method disclosed in Patent Document 1, it is possible to display content with excellent visibility, but it is impossible to improve the operability and convenience of the GUI.

  In view of the above problems, an object of the present invention is to provide a GUI generation apparatus that generates a GUI excellent in operability and convenience in order to assist a user in operating a GUI.

In order to achieve the above object, according to the present invention, an operation performed by a user on a predetermined device using a GUI screen displayed on a display screen, or a behavior detection means for detecting the behavior of a user who is operating When,
Based on the detection result by the detection means, the GUI part that the user is paying attention on the GUI screen is specified, and the GUI part array is arranged so that the specified GUI part is highlighted and displayed. A situation determination means for changing one or more display parameters of the size of the GUI part, the character size of the GUI part, and the character font of the GUI part;
GUI generation means for generating the GUI screen including the GUI part based on the display parameter changed by the situation determination means;
Display means for displaying the GUI screen generated by the GUI generation means on the display screen;
A GUI generation apparatus is provided.

In order to achieve the above object, according to the present invention, the GUI generation device can be connected via a network, and has been changed by the situation determination unit of the GUI generation device according to claim 1. Network connection means capable of acquiring the display parameters;
GUI generating means for generating the GUI screen including the GUI part based on the display parameter acquired by the network connecting means;
Display means for displaying the GUI screen generated by the GUI generation means on the display screen;
A GUI generation apparatus is provided.

In order to achieve the above object, according to the present invention, a remote control operation performed by a user on a predetermined device using a GUI screen displayed on a display screen, and a behavior detection unit that detects a user's line of sight ,
A timer that outputs a time signal including time information;
Based on the time signal supplied from the timer, a time during which the user does not perform a remote control operation exceeds a predetermined no-operation setting time, and a time during which the user is gazing at a specific part of the display screen When it is determined that the predetermined gaze setting time is not reached, it is determined whether or not the user is confused about the operation of the GUI screen. If the user is confused about the operation of the GUI screen, the display A situation determination means for deciding to explain the operation method of the GUI screen on the screen;
GUI guide means for creating GUI guide information for explaining the operation method of the GUI screen on the display screen when the situation determination means determines to explain the operation method of the GUI screen on the display screen;
Informing means for informing the GUI guide information created by the GUI guide means,
A GUI generation apparatus is provided.

In order to achieve the above object, according to the present invention, behavior detecting means for detecting a remote control operation performed by a user on a predetermined device using a GUI screen displayed on a display screen,
A timer that outputs a time signal including time information;
An operation pattern storage means in which operation pattern information indicating a normal operation flow performed in the operation of the GUI screen is stored in advance;
Based on the time signal supplied from the timer, when it is determined that a time during which the user does not perform a remote control operation exceeds a predetermined no-operation set time, the remote control operation by the user is performed by the operation pattern storage unit. If the remote control operation by the user deviates from the normal operation flow, it is determined whether or not the normal operation flow indicated by the operation pattern information stored in the , A situation determination means for determining to explain the operation method of the GUI screen on the display screen;
GUI guide means for creating GUI guide information for explaining the operation method of the GUI screen on the display screen when the situation determination means determines to explain the operation method of the GUI screen on the display screen;
Informing means for informing the GUI guide information created by the GUI guide means,
A GUI generation apparatus is provided.

  The GUI generation apparatus of the present invention has an effect of generating a GUI that is excellent in operability and convenience because it supports the GUI operation by the user. In addition, by generating and displaying a GUI adapted to the user's device operation, there is an effect that a GUI operation environment suitable for the user can be provided. In particular, it improves the operability and convenience of GUI operations by generating a GUI according to the user's behavior history (operation history) or explaining the GUI operation when the user is at a loss. Has the effect of

  Hereinafter, first to fifth embodiments of the present invention will be described with reference to the drawings. In addition, the GUI production | generation apparatus in the 1st-5th embodiment of this invention is for improving the convenience of the user who concerns on arbitrary GUI. The GUI generation apparatus according to the first to fifth embodiments of the present invention is incorporated in, for example, a recorder or PC that records a broadcast program, and performs processing related to a GUI for operating the recorder or the PC. Is possible.

<First Embodiment>
First, a first embodiment of the present invention will be described. Initially, the structure of the GUI production | generation apparatus in the 1st Embodiment of this invention is demonstrated. FIG. 3 is a block diagram illustrating an example of a GUI generation device according to the first embodiment of this invention.

  The GUI generation device illustrated in FIG. 3 includes a behavior detection unit 8, a state determination unit 9, a GUI generation unit 10, a GUI display unit 11, and a parameter storage unit 20. The behavior detection unit 8 has a function of detecting user behavior related to the operation of the GUI generation device by the user. The behavior detection unit 8 has a function of detecting user behavior such as remote control operation, face orientation, line of sight, blink, utterance, and the like. The user's action is not limited to the above-described remote control operation, face direction, line of sight, blink, utterance, etc., and may be any other user action.

  For example, the behavior detection unit 8 performs remote control operation based on a signal (signal received by the remote control light receiving unit of the GUI generation device main body) generated from the remote control by the user's operation and the screen state of the GUI display unit 10 that changes accordingly. It is possible to record operation logs.

  In addition, in order to detect a user's behavior such as a line of sight, a blink or an utterance in the behavior detection unit 8, as shown in FIG. 1 or FIG. 2, a device (or a GUI generation device) in which a GUI generation device is incorporated. It is possible to use the camera 3 and the microphone 4 installed in the main body) or the remote control. For example, regarding the line of sight, it is possible to detect where the user is looking on the screen using a known line-of-sight detection technique. It is also possible to detect a user's blink by a gaze detection technique or simple camera image processing.

  The user's voice can be obtained by canceling the television voice from the signal input to the microphone 4 using a known active control technique. Alternatively, it is possible to detect the user's uttered voice from the signal input to the microphone 4 using a known voice recognition technique. In addition, regarding the method of detecting the orientation of the user's face and other user's actions, it is possible to use a conventional detection method corresponding to each action.

  Further, the situation determination unit 9 extracts the user's characteristic behavior from the data supplied from the behavior detection unit 8, and based on the extracted user's characteristic behavior, the GUI that has been displayed so far is extracted. It has a function to determine whether to reconfigure. Furthermore, the situation determination unit 9 determines the change contents (change parameters for setting the reconfigured GUI) when the GUI is reconfigured. The change content determined by the situation determination unit 9 is supplied to the GUI generation unit 10. The situation determination unit 9 can also record a change parameter for GUI reconfiguration in the parameter storage unit 20 based on the user's characteristic behavior.

  Further, the GUI generation unit 10 has a function of changing and generating a GUI based on the content of the change when the GUI reconfiguration is determined by the situation determination unit 9. The GUI display unit 11 has a function of displaying the GUI generated by the GUI generation unit 10.

  Next, the operation of the GUI generation device according to the first embodiment of the present invention will be described. FIG. 4 is a flowchart showing an example of the operation of the GUI generation device according to the first embodiment of the present invention.

  In FIG. 4, first, the behavior detecting unit 8 starts a user behavior detecting process (step S <b> 101). Next, it is determined whether or not the GUI operation screen is displayed on the GUI display unit 11 and the GUI generation apparatus is in a state in which the GUI operation is possible by the user (step S102).

  When the GUI operation screen is displayed on the GUI display unit 11, the situation determination unit 9 determines whether or not the user is paying attention to a specific part on the GUI operation screen (step S103). When there is no particular attention site on the GUI operation screen by the user, the detection process of the user's action (user operation, user's line of sight, face orientation, etc.) is continued.

  On the other hand, when it is determined that the user is paying attention to a certain part on the GUI operation screen, the situation determination unit 9 re-arranges the GUI part, displays the GUI part size, Change parameters such as character size and character font (for example, character decoration) are determined, and the GUI generation unit 10 generates a GUI based on the determined change parameters (step S104). Then, the GUI generated by the GUI generation unit 10 is transferred to the GUI display unit 11, and GUI redisplay is performed by the GUI display unit 11 (step S105).

  Note that the processing of the GUI generation unit 10 and the GUI display unit 11 may be performed in real time during the user's operation. However, if the GUI operation screen changes one after another during the user's operation, the user will be confused. Since there is a fear, the newly generated GUI may be reflected once the user's operation is finished. In this case, for example, when the change parameter determined by the situation determination unit 9 is recorded in the parameter storage unit 20 and the GUI operation screen is closed once and the same GUI operation screen is displayed again, the change parameter is based on this change parameter. The changed GUI (a newly generated GUI) may be reflected and displayed. Further, it is also possible to display the changed GUI (a newly generated GUI) by reflecting it at a predetermined timing (for example, the next day).

  In the above-described operation, the GUI is reconfigured based on the user's action in one user operation. However, the user's action related to a plurality of user operations is accumulated, and the user in the user operation is stored. It is also possible to change the GUI by judging the tendency of the action. Thereby, for example, the GUI part is arranged or changed so that a GUI part that is frequently selected by the user can be easily selected by the user.

  Next, a specific example relating to the change of the GUI display will be described with reference to FIGS. FIG. 12 is a diagram showing an example of a GUI operation screen before reconfiguration according to the first embodiment of the present invention, and FIG. 13 is a GUI after reconfiguration according to the first embodiment of the present invention. It is a figure which shows an example of an operation screen. 12 and 13 show a screen (reservation-detail setting screen) for making detailed settings related to program reservation. This reservation-detail setting screen allows you to set the recording destination, overwrite recording setting, recording mode setting, bilingual audio (main audio / sub audio) setting, disc compatibility setting, genre setting, sports extension and drama. Extension can be set.

  The screen shown in FIG. 12 is a reservation-detail setting screen in which the action of a specific user is not reflected, and the function GUI part for selecting each function based on the initial setting at the time of shipment is even on the screen. Is arranged.

  On the other hand, the screen illustrated in FIG. 13 is a screen in which convenience is improved in consideration of user behavior in the screen illustrated in FIG. 12. In the screen shown in FIG. 13, a function GUI part (a recording destination setting, a bilingual voice setting, an overwrite recording setting, a sports extension and a drama extension setting, which are likely to be selected by a user operation, is displayed. The five functional GUI parts) have a display that can be easily selected by the user as compared with the other functional GUI parts. Specifically, the five function GUI parts that are likely to be selected in the user's operation are arranged on the left side (and the upper side) of the screen that is easily noticed by the user, and the GUI part size is also larger than before the change. It has become. Furthermore, the character size in these five function GUI parts is also increased, and the character style is also changed to bold so that the display settings are easily changed by the user. This makes it possible to reconfigure the GUI so that a functional GUI part that tends to be selected in the user's operation is easily displayed to the user's eyes.

  As described above, according to the first embodiment of the present invention, the user's behavior (object of interest of the user and device operation by the user) is monitored, and the user pays attention on the GUI operation screen. If there is a part, a GUI based on the user's operation tendency and habit is automatically generated by regenerating the GUI so that the target part is highlighted and displayed, and the GUI is more convenient. Can be provided to the user. In particular, according to the first embodiment of the present invention, it is possible to improve the visibility of text displayed on the GUI part, and to make the GUI part suitable for the user (according to the user's operation stick) as a component. The GUI operation screen can be configured, and a GUI operation screen having a GUI part arrangement suitable for the user (according to the user's operation habit) can be configured. Yes, the GUI operation efficiency is improved.

<Second Embodiment>
Next, a second embodiment of the present invention will be described. First, the configuration of the GUI generation device according to the second embodiment of the present invention will be described. FIG. 5 is a block diagram illustrating an example of a GUI generation apparatus according to the second embodiment of the present invention.

  The GUI generation device illustrated in FIG. 5 includes a behavior detection unit 8, a state determination unit 9, a GUI generation unit 10, a GUI display unit 11, a timer 12, a GUI guide unit 13, and a parameter storage unit 20.

  The behavior detection unit 8, the GUI generation unit 10, the GUI display unit 11, and the parameter storage unit 20 illustrated in FIG. 5 have the same functions as the behavior detection unit 8 illustrated in FIG. Then, explanation is omitted.

  On the other hand, the situation determination unit 9 shown in FIG. 5 basically has the same function as the situation determination unit 9 shown in FIG. And determining whether to reconfigure the GUI using the time related to the user's action (time related to the user operation) as a criterion.

  For example, the situation determination unit 9 measures the time during which the user does not operate the remote control (no operation time) based on the user's action supplied from the action detection unit 8 and the time measured by the timer 12, and the no operation time Can be instructed to create guide information such as a description of a GUI part focused on by the user and a description of an operation method. .

  The timer 12 has a function of measuring time for the situation determination unit 9 to determine the user situation from the data obtained by detecting the user's behavior. For example, the timer 12 has a function of measuring time and supplying the time information to the situation determination unit 9. Further, the GUI guide unit 13 has a function of generating guide information for assisting the user's operation such as explanation of each GUI part and explanation of the operation method. This guide information may be, for example, text displayed on the GUI display unit 11 or may be text-to-speech sound output in addition to text display. Further, the guide information may be, for example, a still image or a moving image displayed on the GUI display unit 11.

  Next, the operation of the GUI generation device according to the second embodiment of the present invention will be described. FIG. 6 is a flowchart showing an example of the operation of the GUI generation device according to the second embodiment of the present invention. Here, an operation in the case where the situation determination unit 9 determines whether to notify the GUI guide information to the user based on the user's no-operation time will be described.

  In FIG. 6, first, the behavior detecting unit 8 starts a user behavior detecting process (step S <b> 201). Next, a GUI operation screen is displayed on the GUI display unit 11, and it is determined whether or not the GUI generation apparatus is in a state in which the GUI operation can be performed by the user (step S202).

  When the GUI operation screen is displayed on the GUI display unit 11, the situation determination unit 9 monitors the user's no-operation time and determines whether or not the user's no-operation time has exceeded a predetermined set time ( Step S203). If the no-operation time exceeds a predetermined set time, the situation determination unit 9 determines whether or not the user is paying attention to a specific part on the GUI operation screen (step S204).

  When it is determined that the user is paying attention to a certain part on the GUI operation screen, for example, the user is considered to have read the specific content, and the situation determination unit 9 highlights the attention part and displays it. As described above, change parameters such as rearrangement of GUI parts, GUI part size, character size, character font (for example, character decoration) are determined, and the GUI generation unit 10 generates a GUI based on the determined change parameters ( Step S205). Then, the GUI generated by the GUI generation unit 10 is transferred to the GUI display unit 11, and GUI redisplay is performed by the GUI display unit 11 (step S206). Note that the GUI redisplay in step S206 may be performed in real time as described above, or GUI reconstruction based on the change parameter may be performed when the same GUI operation screen is displayed later. .

  In addition, when there is no particular area of interest on the GUI operation screen by the user, the user is lost in the GUI operation, and is unable to operate for a longer time than the predetermined set time, and the eyes are swimming. Therefore, the guide information is created and notified (GUI operation guide processing) for explaining the GUI operation screen to the user (step S207).

  In the GUI operation guide process in step S207, the GUI parts are described in the order in which the GUI parts are described in order from the GUI part having a long gaze stop time based on the information of the user's eye movement, for example. Also good. Even when the GUI operation guide process is started, if the user performs an operation such as selection of a function GUI part, the GUI operation guide process is terminated halfway and the user's GUI operation is followed. It is desirable to perform processing.

  As described above, according to the second embodiment of the present invention, the user's behavior (object interest of the user or device operation by the user) is monitored, for example, the time when the user is not performing the remote control operation. If the user's eye is long, it is determined that the user is confused by the GUI operation, and further, if there is no part that the user is particularly interested in on the GUI operation screen, it is determined that the user's eyes are swimming Is possible. For example, when the user is lost in the GUI operation and the user's eyes are swimming, the GUI operation is supported by providing the user with an explanation of the GUI operation screen and each GUI part. It is possible to improve the GUI operation efficiency.

<Third Embodiment>
Next, a third embodiment of the present invention will be described. First, the configuration of the GUI generation device according to the third embodiment of the present invention will be described. FIG. 7 is a block diagram illustrating an example of a GUI generation apparatus according to the third embodiment of the present invention.

  The GUI generation apparatus illustrated in FIG. 7 further includes a pattern storage unit 21 in addition to the GUI generation apparatus illustrated in FIG. The pattern storage unit 21 stores in advance typical operation patterns (information indicating the flow of operations that can be normally performed) on each of the arbitrary GUI operation screens. The situation determination unit 9 stores the operation patterns. It is possible to refer to it.

  Further, the situation determination unit 9 further includes a user behavior history (for example, a line-of-sight movement history, a remote control operation history, etc.) on a specific GUI operation screen obtained from the behavior detection unit 8 and a specific storage obtained from the pattern storage unit 21 A function for instructing the GUI guide unit 13 to create and notify the guide information when matching with the operation pattern on the GUI operation screen and the user's behavior is greatly deviated from the operation pattern that is typically low is provided. is doing.

  Next, the operation of the GUI generation device according to the third embodiment of the present invention will be described. FIG. 8 is a flowchart showing an example of the operation of the GUI generation device according to the third embodiment of the present invention.

  In FIG. 8, first, the behavior detection unit 8 starts a user behavior detection process (step S <b> 301). Next, it is determined whether or not the GUI operation screen is displayed on the GUI display unit 11 and the GUI generation apparatus is in a state in which the GUI operation can be performed by the user (step S302).

  When the GUI operation screen is displayed on the GUI display unit 11, the situation determination unit 9 monitors the user's no-operation time and determines whether or not the user's no-operation time has exceeded a predetermined set time ( Step S303). When the no-operation time exceeds a predetermined set time, the situation determination unit 9 determines whether or not the user is paying attention to a specific part on the GUI operation screen (step S304).

  When it is determined that the user is paying attention to a certain part on the GUI operation screen, for example, the user is considered to have read the specific content, and the situation determination unit 9 highlights the attention part and displays it. As described above, change parameters such as rearrangement of GUI parts, GUI part size, character size, character font (for example, character decoration) are determined, and the GUI generation unit 10 generates a GUI based on the determined change parameters ( Step S305). Then, the GUI generated by the GUI generation unit 10 is transferred to the GUI display unit 11, and GUI redisplay is performed by the GUI display unit 11 (step S306). Note that the GUI redisplay in step S306 may be performed in real time as described above, or GUI reconstruction based on the change parameter may be performed when the same GUI operation screen is displayed later. .

  In addition, when there is no particular area of interest on the GUI operation screen by the user, the user is lost in the GUI operation, and is unable to operate for a longer time than the predetermined set time, and the eyes are swimming. Therefore, the guide information is generated and notified (GUI operation guide processing) for explaining the GUI operation screen to the user (step S307).

  On the other hand, if the no-operation time is equal to or shorter than the predetermined set time in step S303, the user's operation pattern obtained from the user's remote control operation history, the user's line-of-sight movement history, and the like, and the pattern storage unit 21 Are compared with the operation patterns related to the normal operation stored in the table (step S308). When the user's operation pattern matches the general operation pattern stored in the pattern storage unit 21, it is considered that the user's operation is being performed smoothly. The configuration is not performed and the process ends. At this time, the process may proceed to step S305 to reconfigure a GUI that emphasizes the function GUI part related to the operation expected to be performed next, for example.

  If the user's operation pattern and the operation flow pattern stored in the pattern storage unit 21 do not match, it is assumed that the user is in a state of trial and error due to the GUI operation. Then, creation and notification (GUI operation guide processing) of guide information for explaining the GUI operation screen is performed (step S307).

  As described above, according to the third embodiment of the present invention, the user's behavior (the object of interest of the user and the device operation by the user) is monitored, for example, the time when the user is not performing the remote control operation. If it is short (when the user is performing remote control operations), the user's remote control operations and eye movement history (user operation patterns) are collected, and these user operation patterns deviate significantly from general operation patterns. In such a case, it is possible to determine that the user is confused with the operation through trial and error. If the user is confused about the operation through trial and error, the GUI operation is supported by providing the user with an explanation of the GUI operation screen and each GUI part, and the GUI operation efficiency is improved. It becomes possible.

<Fourth embodiment>
Next, a fourth embodiment of the present invention will be described. First, the configuration of the GUI generation device according to the fourth embodiment of the present invention will be described. FIG. 9 is a block diagram showing an example of a GUI generation apparatus according to the fourth embodiment of the present invention.

  The GUI generation device illustrated in FIG. 9 further includes an individual user action accumulation unit 22 in addition to the GUI generation device illustrated in FIG. The individual user action accumulation unit 22 has a function of accumulating action data such as remote control operations, face orientations, line of sight, blinks, and utterances of each user in the GUI operation. It is possible to refer to the action data of each user. In addition, when there are a plurality of users who use a device in which the GUI generation device is incorporated, for example, each user is managed with identification information (ID), and behavior data of each user is accumulated independently. Is desirable.

  Further, the situation determination unit 9 further has a function of reconfiguring the GUI based on user behavior data stored in the individual user behavior accumulation unit 22.

  Next, the operation of the GUI generation device according to the fourth embodiment of the present invention will be described. FIG. 10 is a flowchart showing an example of the operation of the GUI generation device according to the fourth embodiment of the present invention.

  In FIG. 10, first, the behavior detection unit 8 starts a user behavior detection process (step S <b> 401). Next, it is determined whether or not the GUI operation screen is displayed on the GUI display unit 11 and the GUI generation apparatus is in a state in which the GUI operation can be performed by the user (step S402).

  When the GUI operation screen is displayed on the GUI display unit 11, the situation determination unit 9 accumulates the user behavior detected in step S401 in the individual user behavior accumulation unit 22 (step S403). Further, the situation determination unit 9 monitors the user's no-operation time, and determines whether or not the user's no-operation time has exceeded a predetermined set time (step S404). When the no-operation time exceeds a predetermined set time, the situation determination unit 9 determines whether or not the user is paying attention to a specific part on the GUI operation screen (step S405).

  When it is determined that the user is paying attention to a certain part on the GUI operation screen, for example, the user is considered to have read the specific content, and the situation determination unit 9 highlights the attention part and displays it. As described above, change parameters such as rearrangement of GUI parts, GUI part size, character size, character font (for example, character decoration) are determined, and the GUI generation unit 10 generates a GUI based on the determined change parameters ( Step S406). At this time, the situation determination unit 9 generates a GUI reflecting the user behavior accumulated in step S403.

  For example, it is assumed that the GUI generation apparatus illustrated in FIG. 9 is incorporated in a recorder, and there are a plurality of methods for dubbing a program recorded in the recorder onto a recording medium. Specifically, it is necessary to perform a plurality of settings when dubbing a program, and a plurality of dubbing settings exist depending on a combination of these plurality of setting items. On the other hand, with respect to such setting items, each user usually has his or her favorite setting, and in practice, the user always performs the same setting. That is, the user always has only one operation flow. Tend to do.

  By referring to the user's behavior stored in the individual user behavior accumulating unit 22, the rearrangement of each GUI site, the GUI site size so as to induce a specific operation flow that is always used by the user as described above. It is possible to change the character size and the character font. Specifically, with respect to an operation flow (functional GUI part) that is not used at all in past operations, or that a GUI part that tends to be selected next is highlighted on the next GUI operation screen, It is possible to make it inconspicuous or hide it on the GUI operation screen.

  When there are a plurality of users who use the device, it is desirable to manage the behavior data of each user and store it in the individual user behavior accumulation unit 22. Accordingly, it is possible to reconfigure and provide a GUI suitable for each user in accordance with the use of each user based on the behavior of each user. In addition, for example, when a plurality of users use the device at the same time, the behavior data of each user is referred to, and the GUI is changed so that only the operation flow (functional GUI part) common to each user is emphasized. You may go.

  Then, the GUI generated by the GUI generation unit 10 is transferred to the GUI display unit 11, and GUI redisplay is performed by the GUI display unit 11 (step S407). Note that the GUI re-display in step S407 may be performed in real time as described above, or GUI reconfiguration based on the change parameter may be performed when the same GUI operation screen is displayed later. .

  In addition, when there is no particular area of interest on the GUI operation screen by the user, the user is lost in the GUI operation, and is unable to operate for a longer time than the predetermined set time, and the eyes are swimming. Thus, the guide information is generated and notified (GUI operation guide process) for explaining the GUI operation screen to the user (step S408).

  On the other hand, if the no-operation time is less than or equal to the predetermined set time in step S404, the user operation pattern obtained from the user's remote control operation history, the user's line-of-sight movement history, and the like, and the pattern storage unit 21 Are compared with the operation patterns related to the normal operation stored in the table (step S409). When the user's operation pattern matches the general operation pattern stored in the pattern storage unit 21, it is considered that the user's operation is being performed smoothly. The configuration is not performed and the process ends. At this time, the process may proceed to step S406 to reconfigure a GUI that emphasizes a functional GUI part related to an operation expected to be performed next, for example.

  If the user's operation pattern and the operation flow pattern stored in the pattern storage unit 21 do not match, it is assumed that the user is in a state of trial and error due to the GUI operation. Then, creation and notification (GUI operation guide processing) of guide information for explaining the GUI operation screen is performed (step S408).

  As described above, according to the fourth embodiment of the present invention, by accumulating user behavior and device operation data, information such as user habits and preferences (癖) and living environment can be obtained. Device usage data can be obtained, and a GUI suitable for the user's usage can be provided. In addition, when there are a plurality of users who use the device, it is possible to provide a GUI suitable for each user by storing each user's action data (operation history, etc.) independently for each user. . It is also possible to provide a GUI in which only the part related to the common behavior (operation flow) of the behavior data of each user is changed.

<Fifth embodiment>
Next, a fifth embodiment of the present invention will be described. The configuration of the GUI generation apparatus according to the fifth embodiment of the present invention will be described below. FIG. 11 is a block diagram showing an example of a GUI generation apparatus according to the fifth embodiment of the present invention.

  The GUI generation device illustrated in FIG. 11 further includes a display selection unit 23 in addition to the GUI generation device illustrated in FIG. 9, and the individual user action accumulation unit 22 via the network 24. It is configured to be able to accumulate action data.

  The display selection unit 23 is an interface for allowing the user to determine whether to display the GUI generated by the GUI generation unit 10 (whether to use the changed GUI). Thus, when the automatically reconfigured GUI is displayed on the GUI display unit 11, the user can give an evaluation to the GUI. For example, this evaluation may be fed back to the action data stored in the individual user action storage unit 22 and used to generate a GUI more optimal for the user.

  In addition, user action data can be stored in the individual user action storage unit 22 via the network 24. When the network 24 is, for example, a user's home network (private network), for example, the user's behavior data can be shared with other devices of the user. Further, when the network 24 is connected to the Internet, it is possible to acquire and store data from an ergonomic database in which a large amount of user behavior data is collected. In addition, by capturing design screen data of general persons and experts regarding the GUI operation screen via the network 24, it is also possible to use these data for GUI generation.

  In addition, display parameters and other settings of a GUI (GUI suitable for the user) generated by the GUI generation apparatus can be output to the outside through the network 24. As a result, even in any external device (for example, a user-owned device connected to the home network in the home network environment), it is suitable for the user by taking in the settings related to the GUI obtained by the GUI generation device. It is possible to easily realize the GUI.

  As described above, according to the fifth embodiment of the present invention, unnecessary user changes can be prevented by adding a user's evaluation to the automatically reconfigured GUI. It is possible to provide a GUI that suits the usage and preference of. Further, by connecting the individual user action storage unit 22 to the network 24, it is possible to share user action data in a home network environment, and for example, it is applied to GUI reconfiguration in other devices in the network 24. It is also possible. This makes it possible to unify all the devices used by the user in the home network environment into a GUI environment suitable for the user, thereby reducing the burden of newly learning how to use the device. In addition, by connecting to the Internet as the network 24, information relating to ergonomic databases and GUI operability can be widely taken in and used during GUI generation processing, thereby reducing GUI usability problems. It is possible to prevent a GUI having at least a usability problem from being generated. Furthermore, it is possible to provide a friendly GUI suitable for the user's preference by capturing data such as a GUI screen design and a novel operation flow by a general person or an expert arranged on the Internet.

  In addition, although the outline | summary of this invention is demonstrated based on the 1st-5th embodiment of this invention here, this invention is not limited to these embodiment. Here, the applied GUI generation apparatus according to the present invention is represented by a functional block diagram, but the function represented by each block can be realized by hardware and / or software (program). Furthermore, although the operation of the applied GUI generation apparatus according to the present invention is represented by a flowchart here, part or all of these flowcharts can be realized by software (program).

  The present invention supports the operation of the GUI by the user, and thus has the effect of being able to generate a GUI that is excellent in operability and convenience, and can be applied to a GUI generation technique. In addition, the GUI generated by the GUI generation apparatus according to the present invention can be applied to any device that requires a GUI operation, and can improve the operability and convenience of the GUI.

It is a figure which shows an example of the apparatus which can implement | achieve the function of the GUI production | generation apparatus which concerns on this invention. It is a figure which shows an example of the remote control which can implement | achieve the function of the GUI production | generation apparatus which concerns on this invention. It is a block diagram which shows an example of the GUI production | generation apparatus in the 1st Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the GUI production | generation apparatus in the 1st Embodiment of this invention. It is a block diagram which shows an example of the GUI production | generation apparatus in the 2nd Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the GUI production | generation apparatus in the 2nd Embodiment of this invention. It is a block diagram which shows an example of the GUI production | generation apparatus in the 3rd Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the GUI production | generation apparatus in the 3rd Embodiment of this invention. It is a block diagram which shows an example of the GUI production | generation apparatus in the 4th Embodiment of this invention. It is a flowchart which shows an example of operation | movement of the GUI production | generation apparatus in the 4th Embodiment of this invention. It is a block diagram which shows an example of the GUI production | generation apparatus in the 5th Embodiment of this invention. It is a figure which shows an example of the GUI operation screen before the reconstruction which concerns on the 1st Embodiment of this invention. It is a figure which shows an example of the GUI operation screen after the reconstruction which concerns on the 1st Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Television 2 Recorder 3 Camera 4 Microphone 5 Liquid crystal panel 6 Remote control 8 Action detection part 9 Situation judgment part 10 GUI production | generation part 11 GUI display part 12 Timer 13 GUI guide part 20 Parameter storage part 21 Pattern storage part 22 Individual user action storage part 23 Display selection unit 24 Network

Claims (4)

Action detecting means for detecting an operation performed by a user on a predetermined device using a GUI screen displayed on the display screen, or an action of the user who is operating;
Based on the detection result by the detection means, the GUI part that the user is paying attention on the GUI screen is specified, and the GUI part array is arranged so that the specified GUI part is highlighted and displayed. A situation determination means for changing one or more display parameters of the size of the GUI part, the character size of the GUI part, and the character font of the GUI part;
GUI generation means for generating the GUI screen including the GUI part based on the display parameter changed by the situation determination means;
Display means for displaying the GUI screen generated by the GUI generation means on the display screen;
A GUI generation device. A network connection that can be connected to the GUI generation device according to claim 1 via a network and that can acquire the display parameter changed by the status determination unit of the GUI generation device according to claim 1. Means,
GUI generating means for generating the GUI screen including the GUI part based on the display parameter acquired by the network connecting means;
Display means for displaying the GUI screen generated by the GUI generation means on the display screen;
A GUI generation device. Action detecting means for detecting a remote control operation performed by a user on a predetermined device and a user's line of sight using a GUI screen displayed on a display screen;
A timer that outputs a time signal including time information;
Based on the time signal supplied from the timer, a time during which the user does not perform a remote control operation exceeds a predetermined no-operation setting time, and a time during which the user is gazing at a specific part of the display screen When it is determined that the predetermined gaze setting time is not reached, it is determined whether or not the user is confused about the operation of the GUI screen. If the user is confused about the operation of the GUI screen, the display A situation determination means for deciding to explain the operation method of the GUI screen on the screen;
GUI guide means for creating GUI guide information for explaining the operation method of the GUI screen on the display screen when the situation determination means determines to explain the operation method of the GUI screen on the display screen;
Informing means for informing the GUI guide information created by the GUI guide means,
A GUI generation device. Action detecting means for detecting a remote control operation performed by a user on a predetermined device using a GUI screen displayed on the display screen;
A timer that outputs a time signal including time information;
An operation pattern storage means in which operation pattern information indicating a normal operation flow performed in the operation of the GUI screen is stored in advance;
Based on the time signal supplied from the timer, when it is determined that a time during which the user does not perform a remote control operation exceeds a predetermined no-operation set time, the remote control operation by the user is performed by the operation pattern storage unit. If the remote control operation by the user deviates from the normal operation flow, it is determined whether or not the normal operation flow indicated by the operation pattern information stored in the , A situation determination means for determining to explain the operation method of the GUI screen on the display screen;
GUI guide means for creating GUI guide information for explaining the operation method of the GUI screen on the display screen when the situation determination means determines to explain the operation method of the GUI screen on the display screen;
Informing means for informing the GUI guide information created by the GUI guide means,
A GUI generation device.

Images