WO2010061520A1 - 操作支援装置及びその方法 - Google Patents
操作支援装置及びその方法 Download PDFInfo
- Publication number
- WO2010061520A1 WO2010061520A1 PCT/JP2009/005535 JP2009005535W WO2010061520A1 WO 2010061520 A1 WO2010061520 A1 WO 2010061520A1 JP 2009005535 W JP2009005535 W JP 2009005535W WO 2010061520 A1 WO2010061520 A1 WO 2010061520A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- selection
- user
- item
- history
- load
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 52
- 238000003860 storage Methods 0.000 claims abstract description 56
- 238000004364 calculation method Methods 0.000 claims abstract description 52
- 238000003825 pressing Methods 0.000 claims description 24
- 230000008859 change Effects 0.000 claims description 11
- 230000006870 function Effects 0.000 description 202
- 238000010586 diagram Methods 0.000 description 30
- 238000012545 processing Methods 0.000 description 29
- 230000008569 process Effects 0.000 description 16
- 239000013598 vector Substances 0.000 description 16
- 230000009471 action Effects 0.000 description 13
- 238000012986 modification Methods 0.000 description 13
- 230000004048 modification Effects 0.000 description 13
- 238000004590 computer program Methods 0.000 description 12
- 238000012790 confirmation Methods 0.000 description 5
- 239000000284 extract Substances 0.000 description 5
- 230000006399 behavior Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000004883 computer application Methods 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000000877 morphologic effect Effects 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000010845 search algorithm Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
- G06F3/04895—Guidance during keyboard input operation, e.g. prompting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/453—Help systems
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/4147—PVR [Personal Video Recorder]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47214—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
Definitions
- the present invention relates to an operation support apparatus and method for a device having various functions such as a computer that executes an application program, an electrical appliance, or an AV (Audio / Visual) device.
- the present invention relates to an operation support apparatus and method for estimating a user's target function from a user's operation history and using the estimation result to assist the user's operation.
- a technique for supporting user operations using the user operation history has been proposed.
- a help display device has been proposed that searches for a function highly relevant to a key operation input made through trial and error and presents an operation description related to the function (see, for example, Patent Document 1).
- the target function is estimated using the operation history until immediately before the user makes an operation support request. This is based on the assumption that the user performs an operation related to the target function until immediately before making an operation support request.
- the user examines the possibility of reaching the target function for the operation that has not yet been performed, prioritizes the operation, and executes from the operation with the higher priority .
- the user stops examining the possibility of reaching the target function for each operation, and performs the operation as desired.
- the operation performed randomly the user does not examine the possibility.
- the operation is performed while considering that the relationship with the target function is low. For this reason, in the following, an operation performed randomly is also described as a non-thought operation.
- the present invention has been made to solve the above-described problem, and even when a user makes an operation support request after performing a random operation, the operation history performed by the user is determined and deleted. It is an object of the present invention to provide an operation support apparatus and an operation support method capable of providing a user with more appropriate operation support by presenting a target function with high estimation accuracy to the user.
- the present invention considers that a non-thought operation performed without considering the possibility of reaching the target function, or that the relevance to the target function is low, and the user is more optimal for thinking in a non-thought operation performed at random. It is based on the idea of performing an operation with a small operation load rather than selecting an operation.
- An operation support apparatus is an operation support apparatus that supports an operation of a device for a user, and an operation history storage unit that stores a history of selection operations performed by the user for executing the function of the device; For the selection operation stored in the operation history storage unit, the operation load of the user when performing the selection operation is determined based on the selection operation and another selection operation before the selection operation included in the history. For the operation load calculation unit to be calculated and the selection operation stored in the operation history storage unit, the smaller the operation load of the user calculated by the operation load calculation unit, the more the selection operation A no-thought operation determination unit that determines whether or not the selection operation is the no-thought operation by determining that the selection operation is a no-thought operation that is performed randomly. Serial based on the selection operation history said excluding the determined selection operation to be no thoughts operated without thinking operation determination unit, and an operation support portion for supporting the operation on the user.
- the operation load is calculated for each selection operation from the history of the user's selection operation, and the selection operation with a small operation load is determined as a non-thought operation. For this reason, it is possible to estimate a function intended by the user, excluding a non-thought operation that causes a decrease in the accuracy of function estimation. Therefore, it is possible to estimate the target function with high accuracy and to perform more appropriate operation support for the user.
- the present invention can be realized not only as an operation support apparatus including such a characteristic processing unit, but also as an operation support method using a characteristic processing unit included in the operation support apparatus as a step. Can do. It can also be realized as a program that causes a computer to execute characteristic steps included in the operation support method. Such a program can be distributed via a recording medium such as a CD-ROM (Compact Disc-Read Only Memory) or a communication network such as the Internet.
- a recording medium such as a CD-ROM (Compact Disc-Read Only Memory) or a communication network such as the Internet.
- the operation history used for purpose estimation is performed without considering the possibility that the user can reach the target function, or the user has a low relationship with the target function. It is possible to delete unthinking operations performed while thinking. For this reason, it is possible to estimate the purpose with higher accuracy and to perform appropriate operation support for the user.
- FIG. 1 is a functional block diagram showing the configuration of the operation support apparatus according to the embodiment of the present invention.
- FIG. 2 is a flowchart showing main operations performed by the user in the embodiment of the present invention.
- FIG. 3 is a flowchart showing main processing executed by the operation support apparatus according to the embodiment of the present invention.
- FIG. 4 is a diagram showing a data example of screen information stored in the screen information storage unit in the embodiment of the present invention.
- FIG. 5 is a diagram showing an example of a screen of the recording device in the embodiment of the present invention.
- FIG. 6 is a diagram illustrating an example of operation history data stored in the operation history storage unit according to the embodiment of the present invention.
- FIG. 7 is a diagram showing a menu hierarchy example of the function selection screen in the embodiment of the present invention.
- FIG. 1 is a functional block diagram showing the configuration of the operation support apparatus according to the embodiment of the present invention.
- FIG. 2 is a flowchart showing main operations performed by the user in the embodiment of the present
- FIG. 8 is a diagram showing a screen change corresponding to the operation history in the embodiment of the present invention.
- FIG. 9A is a diagram showing an example of operation history data stored in the operation history storage unit in the embodiment of the present invention.
- FIG. 9B is a diagram showing an example of a function selection screen for explaining the operation history shown in FIG. 9A.
- FIG. 10 is a diagram illustrating an example of operation history data stored in the operation history storage unit according to the embodiment of the present invention.
- FIG. 11 is a diagram showing an example of the design of the remote controller according to the embodiment of the present invention.
- FIG. 12 is a flowchart showing the processing of the operation load calculation unit in the embodiment of the present invention.
- FIG. 13 is a diagram illustrating an example of operation history data stored in the operation history storage unit according to the embodiment of the present invention.
- FIG. 14 is a diagram illustrating an example of operation history data stored in the operation history storage unit according to the embodiment of the present invention.
- FIG. 15 is a flowchart illustrating processing executed by the non-thought operation determination unit according to the embodiment of the present invention.
- FIG. 16 is a diagram illustrating an example of operation history data stored in the operation history storage unit according to the embodiment of the present invention.
- FIG. 17 is a diagram illustrating an example of operation history data stored in the purpose estimation target function storage unit according to the embodiment of the present invention.
- FIG. 18 is a diagram showing an example of data used for purpose estimation in the embodiment of the present invention.
- FIG. 19A is a diagram showing an example of a screen output in the operation support in the embodiment of the present invention.
- FIG. 19B is a diagram showing an example of a screen output in the operation support in the embodiment of the present invention.
- FIG. 19C is a diagram showing an example of a screen output in the operation support in the embodiment of the present invention.
- FIG. 20 is a diagram showing an example of a screen output in the operation support in the embodiment of the present invention.
- FIG. 21 is a diagram illustrating an example of an operation screen of a device that uses the pointing device as an input unit according to the first modification of the embodiment of the present invention.
- FIG. 22 is a diagram showing an example of operation history data stored in the operation history storage unit in the first modification of the embodiment of the present invention.
- FIG. 23A is a first diagram for illustrating an operation load in Modification 1 of the embodiment of the present invention.
- FIG. 23B is a second diagram for illustrating the operation load in the first modification of the embodiment of the present invention.
- FIG. 24 is a flowchart showing main operations of the user in the second modification of the embodiment of the present invention.
- FIG. 25 is a flowchart showing main processing of the operation support apparatus in Modification 2 of the embodiment of the present invention.
- FIG. 26A is a diagram showing an example of a screen output in the operation support in the second modification of the embodiment of the present invention.
- FIG. 26B is a diagram showing an example of a screen output in the operation support in the second modification of the embodiment of the present invention.
- remote controller when a user who operates a recording device using a remote controller (hereinafter referred to as “remote controller”) cannot reach the target function and makes an operation support request, the menu items up to that point (menu screen)
- selection history The operation of estimating the user's target function from the selection operation history displayed above and the button selection operation history (hereinafter referred to as “selection history”) and providing operation support to the user will be described. . Note that the selection operation does not include a movement operation such as movement of the cursor.
- FIG. 1 is a block diagram showing a configuration of an operation support apparatus according to an embodiment of the present invention.
- the operation support device 100 is a device that supports a user operation on a recording device that records a television program.
- the operation support apparatus 100 includes a user operation input unit 101, a recording device operation execution unit 102, a screen information storage unit 103, an operation history storage unit 104, a timer 105, and an operation load calculation unit 106.
- the operation support apparatus 100 further includes a non-thought operation determination unit 107, an operation support unit 112, and an output unit 111.
- the recording device may be provided in the operation support apparatus 100 or may be provided separately from the operation support apparatus 100.
- the operation history storage unit 104, the operation load calculation unit 106, the no-thought operation determination unit 107, and the operation support unit 112 are essential components in the present invention.
- the other components are preferably components that are equipped. This is because the presence of essential components makes it possible to discriminate and delete the history of operations that have been performed at random. This is because more appropriate operation support can be provided to the user by presenting the target function with high estimation accuracy to the user.
- the user operation input unit 101 is configured by a remote control or a touch panel, and is a processing unit that receives an operation input from the user to the recording device.
- the screen information storage unit 103 is a storage device that stores various screen information including the screen information of the operation screen of the recording device.
- the screen information on the operation screen of the recording device is information indicating a process or display screen executed by the recording device in response to an operation input. A specific example of the screen information will be described later.
- the recording device operation execution unit 102 is a processing unit that executes the operation of the recording device based on the operation input from the user received by the user operation input unit 101. At that time, the recording device operation execution unit 102 refers to the screen information stored in the screen information storage unit 103 and specifies a function to be executed in response to an operation input or a screen to be displayed.
- the operation history storage unit 104 is a storage device that stores a history of selection operations performed in order to execute a device function by a user. That is, the operation history storage unit 104 stores the operation history associated with the time information at the time of input and the state of the recording device, including the operation for selecting the function of the recording device, accepted by the user operation input unit 101. It is a storage device.
- Timer 105 is a processing unit that acquires the current time.
- the operation load calculation unit 106 is a processing unit that calculates the load of each operation of the user using the operation history stored in the operation history storage unit 104. That is, the operation load calculation unit 106 determines the user's operation load when performing the selection operation for the selection operation stored in the operation history storage unit 104 rather than the selection operation and the selection operation included in the history. Calculation is performed using the previous other selection operation.
- the unthinking operation determination unit 107 is a processing unit that determines whether or not the user's operation is an operation performed randomly (non-thought operation) according to the operation load of each operation.
- the unthinking operation determination unit 107 deletes the operation determined to be the unthinking operation from the operation history of the target for target estimation. That is, regarding the selection operation stored in the operation history storage unit 104, the unthinking operation determination unit 107 performs the selection operation gradually as the user's operation load calculated by the operation load calculation unit 106 decreases. By determining that the selected operation is a non-thought operation, it is determined whether or not the selection operation is a non-thought operation.
- the operation support unit 112 is a processing unit that supports an operation for a user based on a history of selection operations excluding a selection operation determined as a non-thought operation by the non-thought operation determination unit 107.
- the operation support unit 112 includes an objective function estimation unit 108, an objective estimation target function storage unit 109, and an operation support determination unit 110.
- the purpose estimation target function storage unit 109 is a storage device that stores information regarding a function that is a target of target estimation (hereinafter referred to as a “target estimation target function”).
- the objective function estimation unit 108 is a processing unit that estimates a function intended by the user. That is, the objective function estimation unit 108 uses the operation history in which the no-thought operation is deleted by the no-thought operation determination unit 107 and the information on the objective estimation target function stored in the objective estimation target function storage unit 109, Prioritize each function that is the target of purpose estimation.
- the target function estimation unit 108 estimates each function as a function intended by the user as a function having a higher order.
- the operation support determination unit 110 is a processing unit that determines an operation support method for the user based on the result of ranking the functions.
- the output unit 111 is a processing unit that displays an execution result for the operation of the recording device executed by the recording device operation execution unit 102 and displays the operation support method determined by the operation support determination unit 110.
- the output unit 111 is a display such as a television. Note that an output unit that displays the execution result for the operation of the recording device and an output unit that displays the determined operation support method may be provided separately. For example, the execution result of the normal recording device operation is output from the television, but the operation support for the user may be output from the display of the mobile phone.
- FIG. 2 is a flowchart showing a user operation procedure.
- FIG. 3 is a flowchart illustrating a processing procedure of the operation support apparatus 100.
- the user operates the operation support apparatus 100 with the aim of achieving the target function (S201). For example, a user who wants to reserve a program for 2 hours from 7 o'clock at night is displayed on the operation or output unit 111 of a button on a remote control (hereinafter referred to as “remote control button”) to execute a recording reservation. Select the menu item on the selected menu screen.
- a remote control hereinafter referred to as “remote control button”
- the user can execute the target function without any problems. Even if the user does not know the operation procedure, the target function may be executed by selecting a remote control button that the user thinks is correct or a menu item displayed on the output unit 111.
- the user can execute the target function in this way when the operation procedure for executing the target function expected by the user is equal to the operation procedure for the function designed by the system developer.
- the user causes the operation support apparatus 100 to execute the target function without receiving operation support. For a user who wants to make a recording reservation as described above, if there is a remote control button or menu item labeled “Recording time setting”, the user can reach the target function without hesitation.
- the recording device operation execution unit 102 determines whether or not the user has requested the operation support apparatus 100 for operation support (S203). .
- the user requests operation support by an action such as pressing a guide button (for example, “? Button”) on the remote controller.
- the user receives operation support from the operation support apparatus 100 (S204). For example, the operation support apparatus 100 displays a candidate list of target functions of the user in response to a support request from the user. When the user selects a target function, the operation support apparatus 100 displays information such as menu selection necessary for reaching the target function on the output unit 111.
- the user who knows how to reach the target function by the operation support from the operation support determination unit 110 causes the recording device operation execution unit 102 to execute the target function (S205).
- the recording device operation execution unit 102 waits for a user operation input from the user operation input unit 101 (S301).
- the recording device operation execution unit 102 uses the operation input of the user input from the user operation input unit 101 as an operation history, associates this operation history with the screen information stored in the screen information storage unit 103, and operates the operation history.
- the data is stored in the storage unit 104 (S302).
- the “screen name” is the name of the screen displayed when operating the recording device.
- the screen name “select function” is the name given to the menu screen as shown in FIG. It is.
- the screen information is information including six items 401 to 406.
- An item 401 indicates an item number and indicates the position of the menu item.
- An item 402 indicates an item name.
- Item 403 indicates to which item number the menu item is moved when the “Up” button is pressed.
- the item 404 indicates to which item number the menu item is moved when the “down” button is pressed.
- the selection state moves to the item number “7” when the “up” button is pressed. For this reason, the menu item with the item name “to other functions” is selected.
- the menu item with the item name “Play Navi” with the item number “1” is in the selected state
- the item name “Reserve from the program guide” with the item number “2” is displayed.
- the menu item is selected.
- the items after the item 405 indicate which remote control button is pressed and where the selected state changes.
- information indicating which screen to move to is described because the selection state moves to another screen by pressing the remote control button.
- each item describes information about which menu item to move to if the destination screen is a menu screen.
- the screen name of the destination is described before the symbol “@”, and the item number of the menu item to be selected on the screen of the destination is described after the symbol “@”. . More specifically, when the menu item with the item name “Play Navi” with the item number “1” is in a selected state, when the “Enter” button on the remote control is pressed, the menu screen with the screen name “Play Navi” is displayed. Move to. In the menu screen, the menu item having the item name “1” is selected.
- the operation history includes items 601 to 607.
- Each record including items 601 to 607 indicates one operation.
- An item 601 indicates an operation number, and a continuous number is assigned to each operation. This operation number is reset at a fixed timing such as when the device is activated.
- An item 602 indicates the time of the operation performed by the user.
- An item 603 indicates the screen name of the screen displayed before the operation performed by the user.
- An item 604 indicates the name of a menu item that has been selected before the user operates it (selected state item name).
- An item 605 indicates an operation performed by the user, and indicates a remote control button selected at the time of the operation.
- the item 606 indicates which menu hierarchy the operation of the item 605 has been performed on.
- a state where the screen of the recording device is not displayed in the activated state of the recording device is defined as the 0th layer.
- the state in which the screen is displayed by pressing any remote control button from the 0th layer is defined as the 1st layer.
- a state in which another screen is displayed by performing an operation defined in the screen displayed in the first layer is defined as the second layer.
- An example of the menu hierarchy is shown in FIG.
- an operation of pressing the button “select function” on the remote control is an operation in the 0th hierarchy.
- the operation of selecting “Night reservation” which is one of the menu items displayed on the “function selection” screen displayed is an operation in one layer.
- the operation of selecting “Recording time setting” which is one of the menu items displayed on the “Night reservation” screen displayed as a result is an operation in two layers.
- Item 607 indicates a trial number.
- An operation in which the user goes down the menu hierarchy, determines that there is no target function ahead, and returns to a higher hierarchy to search for the function again is expressed as a trial.
- An item 607 is a number representing a break in trial units. According to the example of FIG. 6, the user searches for a function while pressing the up / down / left / right button on the “program guide” screen up to the operation number “6”, but determines that the target function cannot be achieved on this screen, The function search is performed again by pressing the “function selection” button. For this reason, it is determined that the operation number “7” is another trial.
- the operation of operation number “1” and operation number “2” in FIG. 6 will be described with reference to FIG.
- the operation history of the operation number “1” in FIG. 6 indicates an operation in which the “function selection” button on the remote control is pressed on the “TV display” screen as shown in FIG.
- the screen of the recording device is not displayed on the “TV display” screen.
- the display hierarchy is 0 hierarchy.
- the operation screen of the recording device is not displayed on the television.
- the selection state item name before the operation indicated in the item 604 is “none”.
- the operation history of the operation number “2” in FIG. 6 indicates an operation in which the user presses the “down” button on the remote control in a state where the “function selection” screen is displayed as shown in FIG. 8B.
- the “menu selection” screen displayed when the “function selection” button is pressed is “playback navigation” at the top and the menu item “reservation from the program guide” is displayed below it. ”,“ Reservation confirmation ”, etc.
- the “Select function” button is pressed, the top item “Playback Navi” is in the selected state.
- the menu screen selection state is one item below. Move to “Reserve from Program Guide”. This is the user operation performed with the operation number “2”.
- FIG. 9A shows an operation history in which only items selected by the user are extracted from the operation history as shown in FIG.
- the operation history includes items 801 to 803.
- An item 801 indicates a selection number.
- An item 802 indicates an item selected by the user.
- This selection item is acquired as follows. That is, using the screen information shown in FIG. 4, whether the user is selecting an item on the screen or whether an item on the remote control button, ie, a label attached to the remote control button is selected. To be judged. According to this determination result, an appropriate selection item is acquired. For example, when the user selects the up / down button on the remote controller on a menu selectable screen, this is an operation for moving the cursor to a target item, not a selection item.
- the recording device operation execution unit 102 acquires the item selected in the menu as the selection item instead of “OK” that is the label of the remote control button. To do. More specifically, when the “decision” button is pressed in the operation number “3” of the item 605 in FIG. 6, “reservation from the program guide” that is the selection state item indicated by the item 604 is acquired. An item 803 is a trial number corresponding to the item 607 in FIG.
- 9A may be stored in the operation history storage unit 104 in addition to the operation history shown in FIG.
- the recording device operation execution unit 102 determines whether or not the operation input input from the user operation input unit 101 is a request for operation support (S303).
- the recording device operation execution unit 102 determines whether or not the operation input is a function execution operation (S304).
- the recording device operation execution unit 102 executes the function of the recording device (S310).
- the recording device operation execution unit 102 executes the operation of the recording device (S305). After that, the process returns to S301 and enters a standby state for user operation input.
- the operation support apparatus 100 When the operation input input from the user operation input unit 101 is a request for operation support (YES in S303), the operation support apparatus 100 tries to execute the target function by executing the processing described below. Extract the operation history that seems to have been mistaken. In addition, the operation support apparatus 100 performs a process of performing operation support by estimating a user's target function based on the extracted operation history.
- the operation history considered to have been trial and error is extracted as follows. For example, an operation that is considered to be a trial and error is searched from the operation history for the function that was executed immediately before the operation support request. All the operations from the retrieved operation that is considered to be trial and error until the operation support is requested are extracted as the operation history that is considered to have been trial and error.
- the operation history that is considered to have been trial and error is an operation history that has been operated but not realized, for example, an operation history performed between an operation support request and the function executed most recently. Obtained by extraction.
- the operation load calculation unit 106 calculates the operation load of the user using the operation history stored in the operation history storage unit 104 and the screen information stored in the screen information storage unit 103 (S306). .
- the operation target in the present embodiment is a recording device operated by a remote controller, but the selection action includes selection of a menu item on the screen and remote control button selection. Both are actions of pressing the remote control button, but since the operation target is different, the calculation method of the operation load is also different.
- an operation load calculation method in selecting a menu item using the remote controller will be described first, and then an operation load calculation method in remote control button selection will be described.
- FIG. 9A is a diagram illustrating an example of an operation history
- FIG. 9B is a diagram illustrating an example of a function selection screen for explaining the operation history illustrated in FIG. 9A.
- the numbers in the function selection screen shown in FIG. 9B correspond to the operation history selection numbers shown in FIG. 9A and indicate the positions of the selection items in the function selection screen.
- the operation history shown in FIG. 9A includes the following operation history.
- the operation history shown in FIG. 9A is an operation history when such an operation is repeated.
- the function selection button indicated by the selection number “5” is an operation for displaying the initial state of the function selection screen.
- the operation load calculation unit 106 calculates the value of each item of data as shown in FIG. 10 using the operation history information stored in the operation history storage unit 104, quantifies the operation load, and the operation history storage unit 104.
- the data shown in FIG. 10 includes items 801, 802, and 903 to 907. Items 801 and 802 are the same as items 801 and 802 in FIG. 9A, respectively.
- Item 903 is an item indicating a screen initialization operation. An operation for initializing the screen is indicated by 1, and other operations are indicated by 0. When an operation for initializing the screen is performed, the selection item that is normally selected is often the option that is positioned at the top of the screen.
- the remote control button is pressed during an action in which the selection item indicated by the next selection number is selected from the state in which the previous selection item is in the selected state (hereinafter referred to as “selection item moving action”). It is the number of times. The number of times the remote control button has been pressed does not include the number of times the “OK” button used to select a selection item has been pressed. For example, when the “function selection” button with the selection number “1” is pressed, the screen shown in FIG. 5 is displayed, and the item in the selected state is “reproduction navigation”.
- selection number “3” indicates that “just recording” has been reached by pressing the remote control button nine times from “reservation from program guide” of selection number “2”.
- the number of times the remote control button has been pressed does not include the number of times the “OK” button has been pressed, but may include the number of times the “OK” button has been pressed.
- the value of the item 904 is set to -1.
- the case where the remote control button is selected as a selection item is, for example, a case where the “function selection” button is pressed to display a function selection screen. This is also the case of pressing a “play” button for playing the content.
- Item 905 is the number of types of remote control buttons pressed during the selection item moving action. For example, when the selection item moving action is performed only with the “down” button on the remote controller, the number of button types indicated by the item 905 is one. Also, if the user is at a loss during the selection item moving action and presses the “up” and “down” buttons to move the selected item up and down, the number of button types is two. For example, it is possible to move from “reservation from program guide” with selection number “2” to “perfect recording” with selection number “3” by pressing the “down” button six times. However, since the user is at a loss when selecting and changes the moving direction of the selection item once by pressing the “up” button once, the number of pressing required for the selection item moving action is eight.
- Item 906 indicates whether there is a change between the type of the button pressed last in the previous selection item movement action and the button pressed first in the current selection item movement action. When there is a change, the value of the item 906 is set to 1, and when there is no change, the value of the item 906 is set to 0. For example, even in the act of pressing a button once, pressing “down” in the previous operation, then pressing “down”, pressing “down” in the previous operation, then pressing “up” Therefore, the operation load is based on the idea that the latter is larger.
- the button here does not include the “OK” button.
- Item 907 is the result of calculating the operation load using the information of items 904 to 906.
- the operation load is quantified by simply adding the values of all items (items 904 to 906), but processing such as weighting may be performed. Note that when the remote control button is selected as a selection item rather than an operation on the menu screen as in the above-described item 904, it is set to ⁇ 1 to distinguish it from others.
- the operation load calculation unit 106 extracts the operation of the user pressing the remote control button as a selection item from the operation history as shown in FIG. 6, and creates an operation history for remote control operation as shown in FIG. 13 (S1101).
- the operation history includes items 1201 and 1202.
- An item 1201 indicates a selection number.
- An item 1202 indicates a selection item.
- An item 1202 uses a label attached to the remote control button as a selection item.
- the operation load calculation unit 106 determines whether the operation being performed is a screen operation from the screen information and the type of the remote control button. When it is determined that the operation is a screen operation, the operation histories are collectively recorded as “menu operation” like the selection numbers “2” and “4”. More specifically, when a button such as “up”, “down”, “left”, “right”, “decision”, or “return” is pressed on the function selection screen, the operation load calculation unit 106 performs a menu operation. Judge that there is.
- the operation load calculation unit 106 determines whether each selection item included in the operation history for remote control operation is a selection item in an operation in which the remote control button is continuously pressed as a selection item (S1102). More specifically, when one of the selection items before and after the selection item to be determined is not “menu operation” or “operation support request”, the selection item to be determined is a continuous remote control button press. Judge. For example, in the case of the remote control operation history shown in FIG. 13, it is determined that the remote control button is continuously pressed from the selection number “5” to the selection number “8”.
- the operation load calculation unit 106 has a large operation load on the selection item. (S1105).
- the process proceeds to S1103.
- the operation load calculation unit 106 determines whether or not the selection item to be determined is a selection item in an operation in which a button of the same group is continuously pressed on the remote controller (S1103). More specifically, the operation load calculation unit 106 determines whether the selection item to be determined is a button in the same group as one of the selection items before and after the selection item.
- the buttons of the same group may be determined in advance by the developer, or may be determined automatically using the number, shape, color, and arrangement of the buttons. For example, when three or more buttons having the same shape are included within a certain distance, the buttons may be defined as the same group. In the case of such a definition, in the remote control of FIG.
- this step for example, in the case of the operation history for remote control operation shown in FIG. 13, it is determined that the operation from the operation number “6” to the operation number “8” is a selection item when the buttons of the same group are continuously pressed.
- the operation load calculation unit 106 determines that the operation load of the selection item is large. (S1105).
- the operation load calculation unit 106 determines that the operation load of the selection item is small. (S1104).
- FIG. 14 shows the result of determining the operation load for the remote control operation history shown in FIG. 13 by this processing.
- An item 1303 is an operation load, and 1 is assigned to an operation determined to have a large operation load, and 0 is assigned to an operation determined to have a small operation load. Further, -1 is assigned to the operation that the user has requested to support the operation by pressing the guide button on the remote controller in order to distinguish it from others.
- the non-thought operation determination unit 107 classifies the operation history using the operation load for each operation calculated in the operation load calculation process (S306) (S307).
- the purpose of the classification is performed without considering the possibility that the user can reach the target function from the operation history used for the purpose estimation, or while the user considers that the relationship with the target function is low. This is to delete the thinking operation. Therefore, the unthinking operation determination unit 107 classifies whether the operation history is a no-thought operation.
- FIG. 15 is a flowchart of the operation history classification process (S307) in the menu item selection using the remote control by the non-thought operation determination unit 107.
- the unthinking operation determination unit 107 acquires, for example, data shown in FIG. 10 calculated in the operation load calculation process (S306) (S1401).
- the unthinking operation determination unit 107 corrects the number of operations and the operation load included in the acquired data illustrated in FIG. 10 using the operation history illustrated in FIG. 6 (S1402). Specifically, the number of pressings required for the moving action between the selection items is calculated by ignoring selection items that have been selected more than a certain number of times in the operation history to be estimated. For example, in FIG. 10, it is necessary to press twice in order to move from “reproduction navigation” of selection number “6” to “reservation confirmation” of selection number “7”. However, from FIG. 6, “Reserve from program guide” between “Reproduction Navi” and “Reservation confirmation” is an item already selected in the selection number “2” in FIG. 10.
- the number of presses required to move from “reproduction navigation” to “reservation confirmation” is calculated while ignoring “reservation from program guide”. Also, the operation load is corrected in accordance with the correction of the number of presses. This is because an already selected item is less likely to be selected again, and thus an already selected item is ignored.
- FIG. 16 shows an example of data obtained by adding the result reflecting the above correction to the data of FIG.
- the data shown in FIG. 16 is obtained by adding items 1508 and 1509 to the data shown in FIG.
- An item 1508 indicates the number of presses after the number of presses indicated in the item 904 is corrected.
- An item 1509 indicates an operation load after the operation load indicated in the item 907 is corrected.
- the unthinking operation determination unit 107 performs the following processing for each operation whose operation load is corrected in this way, and determines whether or not the operation is a no-thought operation.
- the unthinking operation determination unit 107 compares each operation load reflecting the correction with a threshold value (S1403). When the operation load of the operation to be determined is larger than the threshold (NO in S1403), the unthinking operation determination unit 107 determines that the operation is a thinking operation and is not a non-thinking operation (S1406).
- the unthinking operation determination unit 107 acquires the value of the operation load in the operation before and after the operation to be determined, and checks whether the operation below the threshold is in the front or back (S1404). This means that it is determined whether or not an operation with an operation load equal to or less than a threshold value continues twice or more. If the operation with the operation load equal to or less than the threshold value is not continued twice or more (NO in S1404), the no-think operation determination unit 107 determines that the operation to be determined is an operation having thought and not a no-thought operation (S1406). ). If an operation with an operation load equal to or less than the threshold value continues twice or more (YES in S1401), the process proceeds to S1405.
- the processing of S1404 may not be performed for each operation. That is, it may be determined whether the operation load is equal to or less than a threshold value for all operations.
- the unthinking operation determination unit 107 may extract an operation in which the operation below the threshold is continued twice or more using the result, and may perform the process of S1405 on the operation history in which the operation is continued twice or more. .
- the continuous frequency used for determination by S1404 was set to 2 times, the frequency
- the unthinking operation determination unit 107 determines whether or not the operation sequence that is extracted from the processing of S1404 and the operation load is continuous with a threshold value equal to or less than the threshold is a selected sequence in the same group (S1405).
- the selection series in the same group is a set of similar menu items determined by the common degree, similarity or layout of words included in the menu items.
- the word “setting” is included in both “broadcast setting” and “initial setting” (since the semantic similarity between the words included in the menu item is large). ) Or the same group.
- “reservation from program guide”, “reservation confirmation”, “search of program guide”, and “input G code” classified as “reserve” in the layout may be the same group.
- the information may be classified into groups using information such as the top position of the menu or the type, size or color of the font. For example, menu items having the same horizontal position may be grouped, and menu items having the same font size or color may be grouped.
- the non-thought operation determination unit 107 compares the group of menu items defined in this way with the operation sequence extracted by the processing of S1404.
- the unthinking operation determination unit 107 determines whether the operation sequence is included in one group according to the comparison result (S1405). When the operation sequence is included in one group (YES in S1405), the unthinking operation determination unit 107 determines that the operation to be determined is not a non-thinking operation (S1406). On the other hand, when the operation sequence is not included in one group (NO in S1405), that is, when an operation across groups is performed, the no-thought operation determination unit 107 determines that the operation to be determined is a no-thought operation. (S1407).
- a method of determining whether or not the operation is a non-thought operation based on the similarity of each selection item in the selection history is conceivable.
- word set 2 words included in the selection items of each operation history extracted by the processing of S1404 are extracted (a set of extracted words is referred to as word set 2). Then, an index word / document matrix is created from a text corpus such as a manual. Each word is expressed as a vector (Non-patent document: Kita et al .: Information search algorithm, Kyoritsu Publishing, pp 60-63), and the word vectors included in the word set 1 and the word set 2 are added. Thus, a vector corresponding to each word set is created, and the semantic similarity is calculated by comparing both vectors.
- the classification divided in S306 is used as it is, and the operation determined to have a small operation load is determined to be a non-thought operation. For example, in the case of the operation history data of FIG. 14, it is determined that the selection number “6” to the selection number “8” are non-thought operations.
- the objective function estimation unit 108 uses each selection history stored in the operation history storage unit 104 excluding the unthinking operation to store each function stored in the objective estimation target function storage unit 109. Ranking is performed for. Thereby, the target function is estimated (S308).
- FIG. 17 shows a specific example of data related to the purpose estimation target function stored in the purpose estimation target function storage unit 109.
- the data includes items 1601 to 1603.
- An item 1601 indicates a function number of each function.
- An item 1602 shows a function expression of each function, and the function expression is a document expressing the function in a short word as shown in the table of contents of the manual.
- An item 1603 indicates a word used for describing each function in the manual.
- the word in this item 1603 is a morphological analysis of a manual text document. For example, specific parts of speech such as nouns, verbs and adverbs.
- the objective function estimation unit 108 extracts an operation history that is not a non-thought operation used for purpose estimation from the operation history classified by the no-thought operation determination unit 107.
- the objective function estimation unit 108 further extracts words used in each selected word.
- the extraction method is performed by morphological analysis as described above.
- FIG. 18 shows an example of data obtained by extracting selection items used for purpose estimation from the operation history shown in FIG. 16 and extracting words used in the extracted selection items.
- the data includes items 1701 to 1703. Items 1701 and 1702 correspond to the operation history items 801 and 802 shown in FIG. 9A. An item 1703 indicates a word used in the selection item shown in the item 1702. Note that the “function selection” of the selection number “5” in the operation history shown in FIG. 16 is a screen initialization operation, and the subsequent operation is a non-thought operation, so this selection item is not used for purpose estimation. .
- the objective function estimation unit calculates the similarity between all the functions stored in the objective estimation target function storage unit 109 and the selection items used for the extracted objective estimation, and ranks the functions. .
- the similarity between each function and the selection item selected by the user is calculated from the similarity between the word used for explaining the function and the use word used in the selection item. In the simplest method, the number of common words is counted, and the degree of similarity is calculated by assuming that the more similar the number of common words, the more similar.
- each function is represented as a document set, and an index word / document matrix is created from the document set to express each function as a vector. Further, the selection item is expressed as a vector as a search question vector. A method of calculating the similarity between the function expressed in vector and the selected item may be used.
- the operation support determination unit 110 determines an operation support method using the functions ranked by the target function estimation unit 108 and outputs the operation support method to the output unit 111 (S309).
- the output unit 111 may be the same as a terminal such as a television from which the operation screen of the recording device is output, or may be a terminal different from the terminal from which the operation screen of the recording device is output, such as a mobile phone.
- 19A to 19C show examples of operation support screens.
- the operation support determination unit 110 arranges the functions in descending order of the estimated score.
- the operation support determination unit 110 causes the output unit 111 to display the function expression of each function arranged (the function expression described in the data item 1602 in FIG. 17) as illustrated in FIG. 19A.
- FIG. 19A words that are strongly related to the user's input history are highlighted and displayed so that the user can easily understand what criteria the operation support apparatus 100 uses to obtain the estimation result.
- a manual regarding the function is displayed as shown in FIG. 19B.
- the information displayed when a function is selected is not limited to the related page of the manual.
- a screen created in advance for operation support or a moving image may be displayed, or a screen of a recording device that can execute the function may be displayed.
- the number of operations used for purpose estimation and the number of operations not used may be displayed before operation support. At this time, whether or not to display may be determined according to the number of operations that are not used. For example, when the number of operations (non-thinking operations) that are not used for purpose estimation is greater than the threshold value, an effect of shortening the user's confusion time from the next time can be expected by making the presentation as shown in FIG. 19C.
- FIG. 20 shows an example of the operation support screen when the operation load is calculated as described above and the operation history used for estimating the target function is not extracted using the result.
- the target function is estimated using all the selection items of the data shown in FIG. For this reason, the function related to “play” and “dubbing” selected by the unthinking operation is estimated to be higher, and as a result, the function related to the recording reservation, which is the function intended by the user, is estimated to be lower. If the target function of the user is estimated at the lower level, the user has to look for more functions to find the target function in order to search for the function, which increases the burden on the user.
- the recording device operation execution unit 102 executes the target function of the recording device instructed by the user based on the operation support result (S310).
- the operation support apparatus can delete a no-thought operation that causes a decrease in accuracy of target function estimation from an operation history used for target function estimation.
- This unthinking operation is an operation performed without considering the possibility that the user can reach the target function, or an operation performed while the user thinks that the relationship with the target function is low.
- a target function estimation is possible only using operation which a user thinks that a relationship with a target function is high. Therefore, the target function can be estimated with higher accuracy, and appropriate operation support can be provided to the user.
- Modification 1 the recording device operated by the remote controller has been described as an operation target.
- the present invention can also be applied to a device whose input device is a pointing device such as a touch panel.
- the items stored in the operation history storage unit 104 and the operation load calculation method performed by the operation load calculation unit 106 are different from the above embodiment.
- this modification only a device-specific process that uses a pointing device as an input, which is a difference from the above embodiment, will be described.
- FIG. 21 shows an example of an operation screen of a device using a pointing device as an input means.
- the icons “icon1” to “icon12” and the icons “iconA” to “iconD” indicate icons that can be selected by the user. When the user selects one of the icons, a screen corresponding to each icon is displayed.
- FIG. 22 shows an example of selection history data stored in the operation history storage unit 104.
- the operation history data includes the following operation history. That is, the user selects the icon on the screen shown in FIG. However, the user determines that there is no appropriate information on the screen displayed as a result, and the screen shown in FIG. 21 is displayed again by an operation such as “return”, and another icon is selected. This is an operation history when such an operation is repeated.
- the operation history shown in FIG. 22 includes items 2101 to 2106.
- An item 2101 indicates a selection number assigned a number every time an icon is selected.
- An item 2102 indicates the name of the selected icon.
- An item 2103 indicates the coordinates of the selected icon and is represented by a two-dimensional vector.
- An item 2104 is a movement distance necessary for movement from the previously selected icon to the next selected icon as a target. Specifically, the movement distance in the operation of the selection number “2” when the icon “icon8” is selected is the distance between the previously selected icon “icon1” and the currently selected icon “icon8”. The distance is a distance between the center coordinates of the icons, for example.
- Item 2105 indicates a movement operation vector.
- the movement operation vector is calculated by subtracting the coordinates of the icon previously selected from the coordinates of the selected icon as a target.
- the movement operation vector indicates a trajectory in which the user moves the pointer, and a mouse, a finger, a pen, or the like can be considered as the user's pointer.
- Item 2106 indicates a cosine measure.
- the cosine scale is a cosine value of an angle formed by the moving operation vector of the selected icon as a target and the moving operation vector of the icon previously selected.
- the cosine scale corresponding to the icon “icon7” is a cosine value of an angle formed by the moving operation vector of the icon “icon8” selected immediately before and the moving operation vector of the icon “icon7”.
- the operation load calculation unit 106 calculates the operation load using the movement distance indicated by the item 2104 and the cosine scale indicated by the item 2106 in the operation history data as shown in FIG. More specifically, the operation load calculation unit 106 calculates the operation load by adding a value obtained by multiplying the movement distance by ⁇ and a value obtained by multiplying the cosine scale by ⁇ ( ⁇ and ⁇ are both positive real numbers). . This is based on the idea that the longer the pointer travel distance, the greater the burden on the user. Further, it is based on the idea that the greater the angle between the pointer movement required for the previous operation and the pointer movement required for the current operation, the greater the burden on the user. For example, the moving distance of the pointer shown in FIG.
- the movement of the pointer shown in FIG. 23A (b) is longer than the moving distance of the pointer shown in FIG. 23A (a). For this reason, the movement of the pointer shown in FIG. 23A (b) has a relatively larger operation load than the movement of the pointer shown in FIG. 23A (a). Further, when the change in the movement direction of the pointer shown in FIG. 23B (a) is compared with the change in the movement direction of the pointer shown in FIG. 23B (b), the latter has a larger change in the movement direction. For this reason, the movement of the pointer shown in FIG. 23B (b) has a relatively larger operation load than the movement of the pointer shown in FIG. 23B (a). However, depending on the position of the icon, the movement direction of the pointer may have to be changed.
- the operation load is calculated in the unthinking operation determination unit 107. Similar to the above embodiment, in S1403 of FIG. 15, the operation load is compared with a predetermined threshold value, the number of consecutive operations is calculated, and it is determined whether or not the operation is a selection within the same group. Thus, it is determined whether or not the operation is a non-thought operation.
- Modification 2 In the embodiment described above, the operation support for the user using the estimation of the target function is performed based on the user operation support request. However, the operation support device may detect that the user has started the unthinking operation, and the operation support may be provided to the user at an early timing.
- FIG. 24 shows a user operation procedure when the operation support device performs operation support
- FIG. 25 shows a processing procedure of the operation support device.
- each process will be described with a focus on differences from FIGS. 2 and 3.
- the calculation method of operation load and the extraction method of unthinking operation are the same as that of the said embodiment, the description is not repeated.
- the operation support device proposes operation support (S2203).
- the user receives operation support from the operation support apparatus 100 (S204).
- the user executes a target function based on the operation support (S205).
- the operation support apparatus 100 calculates an operation load every time a user input is received (S306), and detects a non-thought operation (S2404). If it is determined that the target operation is not a non-thought operation (NO in S2404), the operation support apparatus 100 performs a normal device operation operation (S304, S305, S310). If it is determined that the target operation is a non-thought operation (YES in S2404), the target function is estimated using the operation history excluding the non-thought operation (S308), and operation support is proposed to the user. (S2408).
- FIG. 26A and FIG. 26B show examples of screens at the time of operation support proposal.
- FIG. 26A is an example of a screen that displays a message prompting the user to press a guide button on the remote controller
- FIG. 26B is an example of a screen that displays the title of the estimated function. If one function is presented as shown in FIG. 26B and the operation support for the information of the display function can be performed by one operation, the operation support with less burden on the user is obtained. However, if the presented function is not a function intended by the user, the burden on the user increases.
- the reliability of the target function estimation result may be calculated to determine which function is to be displayed, or to control the number of functions to be displayed.
- the reliability may be calculated using the number of selection items used for estimating the target function, the number of words included in the selection items, the appearance frequency of the words on the manual, and the like.
- the calculation may be performed using the degree of similarity or the distribution of similarity between each function and the operation sequence calculated in the target function estimation process.
- the present invention can be applied to devices having a selection-type interface that estimates a user's purpose using a user's operation history. Therefore, the present invention can be used not only in the recording device described in the above embodiment, but also in various devices such as a mobile phone, a car navigation system, or a music / video player. Very big.
- the operation support apparatus supports the user's operation on the recording device
- the operation support target device is not limited to the recording device, and may be other devices as long as the operation is performed by the user.
- it may be a video playback device that plays back video or an audio playback device that plays back audio.
- the operation support device may be specifically configured as a computer system including a microprocessor, ROM, RAM, hard disk drive, display unit, keyboard, mouse, and the like.
- a computer program is stored in the RAM or hard disk drive.
- the operation support apparatus achieves its functions by the microprocessor operating according to the computer program.
- the computer program is configured by combining a plurality of instruction codes indicating instructions for the computer in order to achieve a predetermined function.
- the system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip, and specifically, a computer system including a microprocessor, ROM, RAM, and the like. .
- a computer program is stored in the RAM.
- the system LSI achieves its functions by the microprocessor operating according to the computer program.
- a part or all of the constituent elements constituting the operation support apparatus may be configured by an IC card or a single module that can be attached to and detached from the operation support apparatus.
- the IC card or module is a computer system that includes a microprocessor, ROM, RAM, and the like.
- the IC card or the module may include the super multifunctional LSI described above.
- the IC card or the module achieves its function by the microprocessor operating according to the computer program. This IC card or this module may have tamper resistance.
- the present invention may be the method described above. Further, the present invention may be a computer program that realizes these methods by a computer, or may be a digital signal composed of the computer program.
- the present invention may be the computer program or the digital signal recorded on a computer-readable recording medium.
- a computer-readable recording medium For example, it may be recorded on a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, or DVD-RAM. Further, it may be recorded on a BD (Blu-ray Disc (registered trademark)), a semiconductor memory, or the like. Further, the digital signal may be recorded on these recording media.
- the computer program or the digital signal may be transmitted via an electric communication line, a wireless or wired communication line, a network represented by the Internet, a data broadcast, or the like.
- the present invention may also be a computer system including a microprocessor and a memory.
- the memory may store the computer program, and the microprocessor may operate according to the computer program.
- program or the digital signal may be recorded on the recording medium and transferred to be carried out by another independent computer system. Further, the program or the digital signal may be transferred via the network or the like to be executed by another independent computer system.
- the present invention estimates, for example, a user's target function from a user's operation history for a device having various functions such as a computer application, an electrical appliance, or an AV device, and uses the result to determine the user's function.
- the present invention can be applied to an operation support device that supports operations.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
- Input From Keyboards Or The Like (AREA)
Abstract
Description
上記実施の形態において、リモコンで操作する録画機器を操作対象として説明を行ったが、入力デバイスがタッチパネルなどのポインティングデバイスである機器に対しても、本発明は適用可能である。ポインティングデバイスを入力とする機器に対しては、操作履歴記憶部104に記憶される項目と、操作負荷算出部106で行う操作負荷の算出方法とが上記実施の形態と異なる。本変形例では、上記実施の形態との差異であるポインティングデバイスを入力とする機器特有の処理のみを説明する。
上記実施の形態において、目的機能の推定を用いたユーザへの操作支援は、ユーザの操作支援要求に基づいて行われた。しかし、ユーザが無思考操作を開始したことを操作支援装置が検出し、早いタイミングでユーザへ操作支援を行っても良い。
101 ユーザ操作入力部
102 録画機器操作実行部
103 画面情報記憶部
104 操作履歴記憶部
105 タイマー
106 操作負荷算出部
107 無思考操作判定部
108 目的機能推定部
109 目的推定対象機能記憶部
110 操作支援決定部
111 出力部
112 操作支援部
Claims (20)
- ユーザに対して機器の操作支援を行なう操作支援装置であって、
前記ユーザによる前記機器の機能を実行するために行う選択操作の履歴を記憶する操作履歴記憶部と、
前記操作履歴記憶部に記憶されている前記選択操作について、当該選択操作を行なう際の前記ユーザの操作負荷を、当該選択操作と前記履歴に含まれる当該選択操作よりも前の他の選択操作とを用いて、算出する操作負荷算出部と、
前記操作履歴記憶部に記憶されている前記選択操作について、前記操作負荷算出部で算出された前記ユーザの前記操作負荷が小さいほど、当該選択操作が手当たり次第に行なわれた操作である無思考操作であると判断することにより、当該選択操作が前記無思考操作であるか否かを判定する無思考操作判定部と、
前記無思考操作判定部で前記無思考操作であると判定された選択操作を除いた前記選択操作の履歴に基づいて、前記ユーザに対して操作を支援する操作支援部と
を備える操作支援装置。 - 前記ユーザによる前記機器の機能を実行するために行う選択操作は、メニュー項目選択型のインタフェースにおけるメニュー項目の選択操作であり、
前記操作負荷算出部は、前記選択操作について、前記他の選択操作と当該選択操作との間で必要とされる前記ユーザの操作である選択項目移動操作において、(i)当該選択項目移動操作を行なうために必要としたボタンの押下数、(ii)当該選択項目移動操作を行なうために押下されたボタンの種類数、および(iii)当該選択項目移動操作の最初に押下されたボタンと前回の選択項目移動操作の最後に押下されたボタンとの間の変化情報のうちの少なくとも1つを用いて、前記操作負荷を算出する
請求項1記載の操作支援装置。 - 前記操作負荷算出部は、前記選択項目移動操作を行なうために必要としたボタンの押下数が多いほど大きくなるように、前記操作負荷を算出する
請求項2記載の操作支援装置。 - 前記操作負荷算出部は、前記選択項目移動操作を行なうために押下されたボタンの種類数が多いほど大きくなるように、前記操作負荷を算出する
請求項2記載の操作支援装置。 - 前記操作負荷算出部は、前記選択項目移動操作の最初に押下されたボタンと前記前回の選択項目移動操作の最後に押下されたボタンとの間の変化が大きいほど大きくなるように、前記操作負荷を算出する
請求項2記載の操作支援装置。 - 前記操作負荷算出部は、さらに、前記ボタンの押下数を、過去に一定回数以上選択された前記機器の機能を実行するための選択項目を無視し、前記選択項目移動操作を行なうために必要としたボタンの押下数に修正する
請求項2~5のいずれか1項に記載の操作支援装置。 - 前記無思考操作判定部は、前記操作履歴記憶部に記憶されている前記選択操作について、前記操作負荷算出部で算出された前記ユーザの前記操作負荷が所定の閾値よりも大きい場合に、当該選択操作が前記無思考操作ではないと判定する
請求項1~6のいずれか1項に記載の操作支援装置。 - 前記ユーザによる前記機器の機能を実行するために行う選択操作は、メニュー項目選択型のインタフェースにおけるメニュー項目の選択操作であり、
前記無思考操作判定部は、さらに、メニュー選択画面に表示されるメニュー項目に対して行われたグループ化に従い、前記操作履歴記憶部に記憶されている前記履歴に含まれる前記選択操作について、当該選択操作と前記履歴に含まれる当該選択操作よりも前の他の選択操作とが同一のグループに属している場合に、当該選択操作が前記無思考操作ではないと判定する
請求項1~7のいずれか1項に記載の操作支援装置。 - 前記グループ化は、前記メニュー選択画面におけるメニュー項目の配置情報およびメニュー項目のフォント情報のうちの少なくとも1つを利用して行われる
請求項8記載の操作支援装置。 - 前記グループ化は、前記メニュー選択画面におけるメニュー項目に含まれる単語間の意味的類似度を利用して行われる
請求項8記載の操作支援装置。 - 前記無思考操作判定部は、前記操作履歴記憶部に記憶されている前記履歴に含まれる前記選択操作について、前記操作負荷算出部で算出された前記ユーザの前記操作負荷が小さく、かつ、より小さな前記操作負荷が連続しているほど、当該選択操作が前記無思考操作であると判断することにより、当該選択操作が前記無思考操作であるか否かを判定する
請求項1~6のいずれか1項に記載の操作支援装置。 - 前記ユーザによる前記機器の機能を実行するために行う選択操作は、前記機器を操作するためのリモートコントローラに設けられた、前記機器の機能に対応付けられたボタンの選択操作であり、
前記操作負荷算出部は、前記リモートコントローラに設けられたボタンを当該ボタンの形状情報、色情報および配置情報のうちの少なくとも1つを用いてグループ化した際に、同一グループ内のボタンが連続的に押下されている場合は、グループを跨ってボタンが押下されている場合に比べて小さくなるように、前記操作負荷を算出する
請求項1記載の操作支援装置。 - 前記ユーザによる前記機器の機能を実行するために行う選択操作は、前記機器を操作するためのポインティングデバイス上での選択操作であり、
前記操作負荷算出部は、(i)前記選択操作と前記他の選択操作との間に必要とするポインタの移動距離、および(ii)前記選択操作に必要としたポインタの移動軌跡と前記他の選択操作に必要としたポインタの移動軌跡とのなす角度のうちの少なくとも1つを用いて、前記操作負荷を算出する
請求項1記載の操作支援装置。 - 前記操作負荷算出部は、前記ポインタの移動距離が長いほど大きくなるように、前記操作負荷を算出する
請求項13記載の操作支援装置。 - 前記操作負荷算出部は、前記なす角度が大きいほど大きくなるように、前記操作負荷を算出する
請求項13記載の操作支援装置。 - 前記無思考操作判定部は、さらに、前記操作履歴記憶部に記憶されている前記履歴に含まれる前記選択操作について、当該選択操作に含まれる単語と前記履歴に含まれる当該選択操作よりも前の他の選択操作に含まれる単語との間の意味的類似度を算出し、算出された前記意味的類似度が大きいほど無思考操作でないと判定する
請求項1記載の操作支援装置。 - 前記操作支援部は、さらに、前記無思考操作と分類された選択操作の数に応じたメッセージを表示する
請求項1~16のいずれか1項に記載の操作支援装置。 - 前記操作負荷算出部は、前記ユーザによる選択操作が行なわれる度に、当該選択操作の操作負荷を算出し、
前記無思考操作判定部は、前記ユーザによる選択操作が行なわれる度に、当該選択操作が無思考操作であるか否かを判定し、
前記操作支援部は、前記ユーザによる選択操作が無思考操作であると判定された場合に、当該無思考操作であると判定された前記選択操作を除いた前記選択操作の履歴に基づいて、前記ユーザに対して操作を支援する
請求項1記載の操作支援装置。 - コンピュータにより、ユーザに対して機器の操作支援を行なう操作支援方法であって、
操作履歴記憶部に記憶されている前記ユーザによる前記機器の機能実行するために行う選択操作について、当該選択操作を行なう際の前記ユーザの操作負荷を、当該選択操作と前記履歴に含まれる当該選択操作よりも前の他の選択操作とを用いて、算出し、
前記選択操作について、前記操作負荷算出部で算出された前記ユーザの前記操作負荷が小さいほど、当該選択操作が手当たり次第に行なわれた操作である無思考操作であると判断することにより、当該選択操作が前記無思考操作であるか否かを判定し、
前記無思考操作であると判定された選択操作を除いた前記選択操作の履歴に基づいて、前記ユーザに対して操作を支援する
操作支援方法。 - ユーザに対して機器の操作支援を行なうコンピュータ実行可能なプログラムであって、
コンピュータに、
操作履歴記憶部に記憶されている前記ユーザによる前記機器の機能実行するために行う選択操作について、当該選択操作を行なう際の前記ユーザの操作負荷を、当該選択操作と前記履歴に含まれる当該選択操作よりも前の他の選択操作とを用いて、算出させ、
前記選択操作について、前記操作負荷算出部で算出された前記ユーザの前記操作負荷が小さいほど、当該選択操作が手当たり次第に行なわれた操作である無思考操作であると判断することにより、当該選択操作が前記無思考操作であるか否かを判定させ、
前記無思考操作であると判定された選択操作を除いた前記選択操作の履歴に基づいて、前記ユーザに対して操作を支援させる
プログラム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010511846A JP4571234B2 (ja) | 2008-11-25 | 2009-10-22 | 操作支援装置及びその方法 |
US12/865,919 US8438479B2 (en) | 2008-11-25 | 2009-10-22 | Operation support apparatus and method of the same |
CN2009801200360A CN102047213A (zh) | 2008-11-25 | 2009-10-22 | 操作支援装置以及其方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008300206 | 2008-11-25 | ||
JP2008-300206 | 2008-11-25 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010061520A1 true WO2010061520A1 (ja) | 2010-06-03 |
Family
ID=42225412
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/005535 WO2010061520A1 (ja) | 2008-11-25 | 2009-10-22 | 操作支援装置及びその方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US8438479B2 (ja) |
JP (2) | JP4571234B2 (ja) |
CN (1) | CN102047213A (ja) |
WO (1) | WO2010061520A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014102634A (ja) * | 2012-11-19 | 2014-06-05 | Nippon Telegr & Teleph Corp <Ntt> | ユーザ操作支援方法およびその装置 |
JPWO2020189028A1 (ja) * | 2019-03-20 | 2020-09-24 |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011145386A (ja) * | 2010-01-13 | 2011-07-28 | Fuji Xerox Co Ltd | 表示制御装置、表示装置及びプログラム |
US9311061B2 (en) * | 2011-02-10 | 2016-04-12 | International Business Machines Corporation | Designing task execution order based on location of the task icons within a graphical user interface |
USD777739S1 (en) * | 2014-02-21 | 2017-01-31 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
USD784373S1 (en) * | 2014-02-21 | 2017-04-18 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9934507B2 (en) | 2014-08-11 | 2018-04-03 | International Business Machines Corporation | Mapping user actions to historical paths to determine a predicted endpoint |
US20160241904A1 (en) * | 2015-02-12 | 2016-08-18 | Kabushiki Kaisha Toshiba | Electronic Device, Electronic Device Control Method and Electronic Device Control System |
WO2017026002A1 (ja) * | 2015-08-07 | 2017-02-16 | 株式会社日立製作所 | 監視装置、監視方法、および監視プログラム |
WO2020059428A1 (ja) * | 2018-09-21 | 2020-03-26 | 株式会社Nttドコモ | 情報処理装置及びヒント提供方法 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09101935A (ja) * | 1995-10-06 | 1997-04-15 | Fujitsu Ltd | 利用者の操作行動に適応する応答制御方法およびシステム |
JPH11203006A (ja) * | 1998-01-20 | 1999-07-30 | Fujitsu Ltd | ユーザ状況推定装置 |
JP2000231429A (ja) * | 1999-02-09 | 2000-08-22 | Fuji Xerox Co Ltd | ヘルプ情報提供装置 |
JP2006163988A (ja) * | 2004-12-09 | 2006-06-22 | Canon Inc | 情報処理装置 |
JP2008084172A (ja) * | 2006-09-28 | 2008-04-10 | Toshiba Corp | 映像記録・再生装置 |
WO2008059710A1 (fr) * | 2006-11-15 | 2008-05-22 | Panasonic Corporation | Dispositif de support d'opération et procédé de support d'opération |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
USRE37431E1 (en) * | 1990-08-02 | 2001-10-30 | Ast Research, Inc. | Intelligent help system |
JP3488525B2 (ja) * | 1994-12-13 | 2004-01-19 | 富士通株式会社 | ヘルプ画面表示方法およびヘルプ画面表示装置 |
JPH1131190A (ja) | 1997-05-13 | 1999-02-02 | Hitachi Ltd | 電子マネーカード、電子マネー入出金機及び電子マネーカード編集装置 |
DE69821545T2 (de) | 1997-05-13 | 2004-12-23 | Hitachi, Ltd. | Elektronische Geldkarte, Empfangs-/Auszahlungsmaschine für elektronisches Geld und Editiervorrichtung für eine elektronische Geldkarte |
JPH11231998A (ja) | 1998-02-13 | 1999-08-27 | Sharp Corp | ヘルプ表示装置及びヘルプ表示プログラムを記録した媒体 |
US6340977B1 (en) * | 1999-05-07 | 2002-01-22 | Philip Lui | System and method for dynamic assistance in software applications using behavior and host application models |
US7228329B2 (en) * | 2002-12-31 | 2007-06-05 | Sap Ag | Methods and systems for providing guidance using case-based reasoning |
US7480064B2 (en) * | 2003-03-31 | 2009-01-20 | Ricoh Company | Method and system for providing updated help and solution information at a printing device |
JP4510431B2 (ja) * | 2003-11-26 | 2010-07-21 | キヤノン株式会社 | ジョブ処理システム及びジョブ処理システムの制御方法及びプログラム及び記憶媒体及びジョブ処理装置 |
US7221885B2 (en) | 2003-11-26 | 2007-05-22 | Canon Kabushiki Kaisha | Image forming device, system, control method, program and memory medium utilizing operation history |
JP2006344018A (ja) | 2005-06-09 | 2006-12-21 | Hitachi Systems & Services Ltd | 操作支援システム |
CN100373936C (zh) | 2005-08-09 | 2008-03-05 | 深圳市同洲电子股份有限公司 | 动态演示机顶盒操作指导的装置和方法 |
TW200801513A (en) | 2006-06-29 | 2008-01-01 | Fermiscan Australia Pty Ltd | Improved process |
JP2008269119A (ja) | 2007-04-18 | 2008-11-06 | Hitachi Ltd | 情報処理装置 |
-
2009
- 2009-10-22 US US12/865,919 patent/US8438479B2/en not_active Expired - Fee Related
- 2009-10-22 CN CN2009801200360A patent/CN102047213A/zh active Pending
- 2009-10-22 WO PCT/JP2009/005535 patent/WO2010061520A1/ja active Application Filing
- 2009-10-22 JP JP2010511846A patent/JP4571234B2/ja active Active
-
2010
- 2010-06-10 JP JP2010133347A patent/JP4653251B2/ja active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH09101935A (ja) * | 1995-10-06 | 1997-04-15 | Fujitsu Ltd | 利用者の操作行動に適応する応答制御方法およびシステム |
JPH11203006A (ja) * | 1998-01-20 | 1999-07-30 | Fujitsu Ltd | ユーザ状況推定装置 |
JP2000231429A (ja) * | 1999-02-09 | 2000-08-22 | Fuji Xerox Co Ltd | ヘルプ情報提供装置 |
JP2006163988A (ja) * | 2004-12-09 | 2006-06-22 | Canon Inc | 情報処理装置 |
JP2008084172A (ja) * | 2006-09-28 | 2008-04-10 | Toshiba Corp | 映像記録・再生装置 |
WO2008059710A1 (fr) * | 2006-11-15 | 2008-05-22 | Panasonic Corporation | Dispositif de support d'opération et procédé de support d'opération |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014102634A (ja) * | 2012-11-19 | 2014-06-05 | Nippon Telegr & Teleph Corp <Ntt> | ユーザ操作支援方法およびその装置 |
JPWO2020189028A1 (ja) * | 2019-03-20 | 2020-09-24 | ||
WO2020189028A1 (ja) * | 2019-03-20 | 2020-09-24 | 株式会社Nttドコモ | 情報処理装置 |
JP7374990B2 (ja) | 2019-03-20 | 2023-11-07 | 株式会社Nttドコモ | 情報処理装置 |
Also Published As
Publication number | Publication date |
---|---|
JP4571234B2 (ja) | 2010-10-27 |
US8438479B2 (en) | 2013-05-07 |
JP4653251B2 (ja) | 2011-03-16 |
CN102047213A (zh) | 2011-05-04 |
JPWO2010061520A1 (ja) | 2012-04-19 |
US20100333022A1 (en) | 2010-12-30 |
JP2010192004A (ja) | 2010-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4571234B2 (ja) | 操作支援装置及びその方法 | |
US20200341999A1 (en) | Process and Apparatus for Selecting An Item From A Database | |
KR102262453B1 (ko) | 텍스트 예측용 이모지 | |
US7590948B2 (en) | Display information selection apparatus and method, program and recording medium | |
TWI241511B (en) | Alphanumeric keyboard input system using a game controller | |
KR101967036B1 (ko) | 비디오 콘텐츠를 검색하는 방법들, 시스템들, 및 매체들 | |
JP4536637B2 (ja) | 情報散策装置及び方法、プログラム並びに記録媒体 | |
JP4609544B2 (ja) | 情報処理装置、情報処理システムおよび情報処理方法 | |
JP4382155B2 (ja) | 操作支援装置及びその方法 | |
US20080007570A1 (en) | Digital Content Playback | |
US20110304649A1 (en) | Character selection | |
JP4308315B2 (ja) | 目的推定装置および目的推定方法 | |
US20120131460A1 (en) | Playlist Creation | |
US20180275756A1 (en) | System And Method Of Controlling Based On A Button Having Multiple Layers Of Pressure | |
JP4542206B2 (ja) | 操作支援装置及び操作支援方法 | |
JP5129999B2 (ja) | 目的推定装置、目的推定方法およびプログラム | |
JP5349433B2 (ja) | 情報提示装置、方法およびプログラム | |
JP6136987B2 (ja) | データ検索装置 | |
CN112839251A (zh) | 一种电视及其与用户的交互方法 | |
JP6592960B2 (ja) | 情報処理装置、情報処理方法およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980120036.0 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010511846 Country of ref document: JP |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09828770 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12865919 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09828770 Country of ref document: EP Kind code of ref document: A1 |