JP2003209710A - User interface apparatus, remote operation apparatus, and user interface method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user interface apparatus by which a user can easily implement input operation using keys. <P>SOLUTION: Upon receipt of a control signal issued through depression of a key 202 instructing start of remote control operations from a remote control device 102 (step S701), a digital information storage device 101 generates menu configuration information to select functions on the basis of the received control signal and transmits the information to a television receiver 103. Thus, the television receiver 103 displays a menu for function selection and also displays a key layout of the remote control device 102 on a television screen. The television receiver 103 displays the key layout while attaching a function name corresponding to the function selection to each key (step S702). <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a user interface device, a remote control device and a user interface method.

[0002]

2. Description of the Related Art At present, a television receiver (hereinafter, referred to as a television) is a typical example of an apparatus for performing remote control. The remote controller (hereinafter, remote control) of this TV is provided with a numeric keypad (for channel selection) and cursor keys (for volume). When you operate the remote control, a bar that indicates the specified channel number and volume level is displayed. Is displayed on the TV screen. The display contents are updated at any time in accordance with the operation of the remote controller so that the user can recognize the operation status.

Recently, a device for browsing the Internet using a television screen and a device for displaying character information on a television screen and transmitting / receiving an electronic mail have appeared. In the case of such an apparatus, the remote controller is used to input characters such as addresses and mail contents.
For example, a cursor key or Jog Stick Dial is provided on the remote control, a screen key composed of a character array is displayed on the TV screen, and the cursor is moved to the required character on the screen key and characters are repeatedly confirmed. The method of inputting is used.

As another character input method, a personal computer (hereinafter referred to as a personal computer) is used as a remote controller.
There is a method of inputting characters by providing necessary character keys like the keyboard of, and pressing the character key corresponding to the character to be input. According to this method, the user first presses a character key while looking at the remote controller, and then repeats the operation of confirming and confirming the character input on the television screen, thereby inputting the character.

[0005]

However, in the above-mentioned method of displaying the screen key on the TV screen and operating the cursor key of the remote controller or the jog stick dial to input characters, a large amount of characters cannot be input. It takes a long time. For example, when creating an e-mail document, it is assumed that a large amount of characters will be input. In that case, select the character,
The cursor movement of the screen key must be repeated until it is confirmed. That is, it is necessary to operate the keys of the remote controller a plurality of times to input one character. If it is necessary to move the cursor vertically and horizontally five times to input one hiragana character, about 1000 key operations are required to create a 200-character hiragana document. Furthermore, in inputting Japanese, it is also necessary to perform kana-kanji conversion, so this operation method requires a very troublesome operation for the user.

Further, in the case of inputting characters using a remote controller provided with character keys, if the remote control device can directly input a desired character, a large number of characters can be input with a small number of key operations. It can be carried out. However, the number of character keys increases, and the remote control device increases in size. Furthermore, if the user becomes accustomed to key input and is able to input the key by a so-called blind touch with only the tactile sensation of the finger, the user can perform the desired input operation only by looking at the TV screen without looking at the key on the remote control device. It is possible to do. However, it takes a considerable amount of time for the user to be able to input a key only by the feel of the finger.

Further, in a digital storage device for storing various types of audiovisual information (AV information) in various formats, a display method and an application differ depending on the format and method of the stored information. For example, when a still image and a moving image are compared, there is a difference in how to use each AV information, and it is desired to operate a method suitable for each application. Therefore, it is necessary to provide various function keys depending on the application, but if the remote controller is provided with function keys and character keys, the remote controller becomes large. In this case, it is difficult to select a place to put a large remote controller in the room where the TV is placed.

It is an object of the present invention to provide a user interface device, a remote operation device and a user interface method that can easily perform an input operation using a key.

[0009]

The invention according to claim 1 is
A user interface device for remotely controlling a device connectable to a display device for displaying images, the remote interface having a plurality of keys and transmitting a corresponding control signal in response to the plurality of key operations. Means, receiving means for receiving a control signal issued from the remote operation means, and control means for operating the corresponding device in response to the control signal received by the receiving means. The means displays a key layout image showing a key arrangement of the plurality of keys on the display device, when the control signal issued by the specific key operation of the remote operation means is received by the receiving means. And

According to a second aspect of the present invention, in the user interface device according to the first aspect, the control means displays the key layout image and a key name image indicating a function name of each key of the remote control means. It is characterized by being displayed on the device.

According to a third aspect of the present invention, in the user interface device according to the second aspect, the device has setting means for setting a plurality of modes including a video reproduction mode and an internet browsing mode, and the set mode. And a mode executing means for executing
The function name of each key of the remote control means is changed according to the set mode type, and a key name image showing the changed function name is displayed on the display device.

The invention according to claim 4 is the invention according to claim 2 or 3.
In the user interface device described in the above, the control means, when the receiving means receives a control signal issued by the operation of any one of the plurality of keys from the remote operation means, the key layout displayed on the display device. It is characterized in that the display form of the key portion corresponding to the operated key in the video is changed.

According to a fifth aspect of the present invention, in the user interface device according to the fourth aspect, the control means is issued by the receiving means by a specific key operation from the remote operation means while the key layout image is being displayed. When the received remote control signal is received, the display of the key layout image is stopped by the received control signal.

According to a sixth aspect of the present invention, in the user interface device according to the fourth aspect, the control means controls the control signal from the remote control means for a predetermined period while the key layout image is being displayed. The display of the key layout image is stopped when it is not continuously received.

The invention according to claim 7 is the invention according to claims 1 to 6.
In the user interface device according to any one of items 1 to 3, the remote operation means has a keyboard surface on which the plurality of keys are arranged and a recognition portion which is recognizable by a touch of a human finger is formed. However, the plurality of keys are arranged around the recognition part with the recognition part as a reference.

The invention according to claim 8 is the invention according to claims 1 to 7.
In the user interface device according to any one of items 1 to 3, the remote operation means is connected to a first member having two keyboard surfaces each provided with a key and the first member so as to be folded. And a second member having one keyboard surface provided with keys, the first member being in a folded state with respect to the second member, the first member One of the keyboard surfaces of the member is exposed to the outside so that the other keyboard surface faces the keyboard surface of the second member, and the first member with respect to the second member. In the opened state, the other of the keyboard surface of the first member and the second keyboard surface have a two-fold structure in which they are exposed to the outside so that they can be operated.

According to a ninth aspect of the present invention, in the user interface device according to the eighth aspect, the remote operation means is configured such that when the first member is folded over the second member, When only the operation of a key provided on one side of the keyboard surface of the first member is accepted and the first member is opened with respect to the second member, the first member Only the operation of the key provided on each of the second keyboard surface and the second keyboard surface is accepted.

According to a tenth aspect of the present invention, in the user interface device according to the ninth aspect, whether the remote control means is in a state in which the first member is folded over the second member or not. The control unit includes a detection unit that detects whether the first member is open with respect to the second member, and a transmission unit that transmits a detection signal indicating a detection result of the detection unit. The means, when the receiving means receives the detection signal, displays a key layout image showing a key arrangement of keys that can be operated by the remote operation means according to a state indicated by the received detection signal. And

According to an eleventh aspect of the present invention, in the user interface device according to any one of the first to seventh aspects, the remote operation means is provided with a main body having a key on an upper surface and a key. And an extended keyboard housed in the main body so that it can be pulled out, and the extended keyboard is pulled out from the main body to a position where the key can be operated.

According to a twelfth aspect of the present invention, in the user interface device according to the eleventh aspect, the remote control means is in a state in which the extended keyboard is pulled out from the main body or housed in the main body. There is a detection means for detecting whether there is, and a transmission means for transmitting a detection signal indicating the detection result of the detection means, the control means,
When the receiving unit receives the detection signal, a key layout image showing a key arrangement of operable keys in the remote operation unit according to the state indicated by the received detection signal is displayed.

According to a thirteenth aspect of the present invention, there is provided a remote control device for remotely controlling the device, the remote control device having a keyboard surface on which a plurality of keys are arranged, and the device according to the plurality of key operations. It has a control signal generating means for issuing a control signal for remote control and a transmitting means for transmitting the issued control signal, and the keyboard surface has a recognition part recognizable by the feel of a human finger. It is characterized in that the plurality of keys are arranged around the key based on the recognition part.

According to a fourteenth aspect of the present invention, in the remote control device according to the thirteenth aspect, a first member having two keyboard surfaces each provided with a key and the first member are provided.
A second member having one keyboard surface on which keys are provided, the first member being folded over the second member. When in the state, one of the keyboard surfaces of the first member is exposed to the outside so that it can be operated, and the other keyboard surface faces the keyboard surface of the second member. When the member is opened with respect to the second member, the other half of the keyboard surface of the first member and the second keyboard surface are operably exposed to the outside from the folded structure. It is characterized by

According to a fifteenth aspect of the present invention, in the remote control device according to the fourteenth aspect, the control signal issuing means is in a state in which the first member is folded over the second member. , When only the operation of a key provided on one side of the keyboard surface of the first member is accepted and the first member is opened with respect to the second member, It is characterized in that only the operation of a key provided on each of the second keyboard surface and the other of the keyboard surfaces of the member is accepted.

According to a sixteenth aspect of the present invention, in the remote control device according to the fifteenth aspect, whether the first member is folded over the second member or the first member is It is characterized in that it has a detection means for detecting whether the second member is open and a detection signal transmission means for transmitting a detection signal indicating the detection result of the detection means.

According to a seventeenth aspect of the present invention, in the remote control device according to the thirteenth aspect, there is provided a main body having a key on an upper surface thereof, and an extended keyboard provided with the key and retractably housed in the main body. The extended keyboard is pulled out from the main body to a position where the key can be operated.

The invention according to claim 18 is the remote control device according to claim 17, wherein the detection is made to detect whether the extended keyboard is pulled out from the main body or housed in the main body. Means and a detection signal transmitting means for transmitting a detection signal indicating the detection result of the detecting means.

According to a nineteenth aspect of the present invention, there is provided a user interface method for remotely operating a device connectable to a display device for displaying an image, wherein the plurality of keys are operated by remote operation means having a plurality of keys. Transmitting a corresponding control signal in response to an operation, receiving a control signal issued from the remote control means, and performing a corresponding operation of the device according to the received control signal, When a control signal issued by a specific key operation of the remote operation means is received, a key layout image showing a key arrangement of the plurality of keys is displayed on the display device.

According to a twentieth aspect of the present invention, in the user interface method according to the nineteenth aspect, a step of displaying a key name image showing a function name of each key of the remote control means on the display device together with the key layout image. It is characterized by having.

According to a twenty-first aspect of the present invention, in the user interface method according to the twentieth aspect, the device sets a plurality of modes including a video reproduction mode and an Internet browsing mode, and the set mode. And a mode executing means for executing the operation, changing the function name of each key of the remote operation means according to the type of the set mode, and displaying the key name image showing the changed function name on the display device. It is characterized by displaying in.

According to a twenty-second aspect of the present invention, in the user interface method according to the nineteenth or eighteenth aspect, the display device receives the control signal issued by the operation of any one of the plurality of keys from the remote operation means. The display form of the key portion corresponding to the operated key in the key layout image displayed in is changed.

According to a twenty-third aspect of the present invention, in the user interface method according to the twenty-second aspect, when a remote operation signal issued by a specific key operation is received from the remote operation means while the key layout image is displayed, And a step of stopping the display of the key layout image according to the received control signal.

According to a twenty-fourth aspect of the present invention, in the user interface method according to the twenty-second aspect, when the control signal from the remote control means is not continuously received for a predetermined period while the key layout image is displayed, the key is displayed. The feature is that the display of the layout image is stopped.

According to a twenty-fifth aspect of the present invention, in the user interface method according to any one of the nineteenth to twenty-fourth aspects, the remote operation means is provided with the plurality of keys, and a finger of a person It has a keyboard surface on which a recognition site that can be recognized by touch is formed, and the plurality of keys are arranged around the recognition site based on the recognition site.

According to a twenty-sixth aspect of the present invention, in the user interface method according to any one of the nineteenth to twenty-fifth aspects, the remote operation means has a first keyboard surface provided with two keys. Members of
A second member having one keyboard surface on which a key is provided, the first member being connected so as to be folded, and the first member being folded with respect to the second member. In the overlapped state, one of the keyboard surfaces of the first member is exposed to the outside so that the keyboard surface of the first member can be operated, and the other keyboard surface faces the keyboard surface of the second member. When the first member is open with respect to the second member, the first member
The other of the keyboard surfaces of the member and the second keyboard surface have a two-fold structure in which they are exposed to the outside so that they can be operated.

According to a twenty-seventh aspect of the present invention, in the user interface method according to the twenty-sixth aspect, when the remote operation means is in a state in which the first member is folded over the second member, When only the operation of a key provided on one side of the keyboard surface of the first member is accepted and the first member is opened with respect to the second member, the first member Only the operation of the key provided on each of the second keyboard surface and the second keyboard surface is accepted.

According to a twenty-eighth aspect of the present invention, in the user interface method according to the twenty-seventh aspect, whether the remote operation means is in a state in which the first member is folded over the second member or not. The detecting means has a detecting means for detecting whether the first member is in an opened state with respect to the second member, and a transmitting means for transmitting a detection signal indicating a detection result of the detecting means. When the signal is received, the method further comprises the step of displaying a key layout image showing a key arrangement of keys that can be operated by the remote operation means according to the state indicated by the received detection signal.

According to a twenty-ninth aspect of the present invention, in the user interface method according to any one of the nineteenth to twenty-fifth aspects, the remote operation means is provided with a main body having a key on its upper surface, and a key. And an extended keyboard housed in the main body so that it can be pulled out, and the extended keyboard is pulled out from the main body to a position where the key can be operated.

According to a thirtieth aspect of the present invention, in the user interface method according to the twenty-ninth aspect, the remote control means is in a state in which the extended keyboard is pulled out from the main body or housed in the main body. The remote controller according to the state indicated by the received detection signal has a detection means for detecting whether there is any and a transmission means for transmitting a detection signal indicating the detection result of the detection means. It is characterized by including a step of displaying a key layout image showing a key arrangement of operable keys in the operation means.

[0039]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 schematically shows a state in which a digital information storage device equipped with a user interface device according to a first embodiment of the present invention and a peripheral device are connected. It is a figure.

As shown in FIG. 1, the digital information storage device 101 is connected to an IP network (Internet) 106, which is an interface for connecting AV (audiovisual) devices such as a digital video camera 104 and a digital camera 105. And an interface for connecting the television 103 used as a display device. Further, the digital information storage device 101 has a function of storing various AV information such as moving images and still images recorded by AV equipment in a storage means such as a hard disk, and searching, selecting, browsing, and reproducing the stored AV information. It has a function of performing, and a function of transmitting / receiving an electronic mail and browsing the Web using a TV screen. All operations related to these functions are performed by the remote controller (hereinafter, referred to as remote controller) 102. The remote controller 102 transmits a control signal to the digital information storage device 101 by wireless communication using infrared rays as a communication medium, and remotely controls the digital information storage device 101.

Next, the external structure of the remote controller 102 will be described with reference to FIG. FIG. 2 is a diagram showing an external configuration diagram of the remote controller shown in FIG.

In the remote controller 102, as shown in FIG. 2, convex recognition units 203 which can be recognized by the feel of a finger are formed at four positions on the upper surface thereof, and the recognition units 20 are recognized.
A plurality of keys 201 are arranged around the area 3. As a result, the user can identify and select the keys arranged around the recognition unit 203 by moving his / her finger with each recognition unit 203 as a reference point, and the user does not have to look at the remote controller 102. Also, an input environment in which the desired key 201 can be easily input is provided. Further, a key 202 for instructing the start of remote control operation and a key 204 for instructing the end of remote control operation are provided on the upper surface of the remote control 102.

Next, an example of each function of the digital information storage device 101 will be described with reference to FIGS. 3 and 4. 3 is a diagram showing an example of a screen displayed on the television by the Web browsing function of the digital information storage device of FIG. 1, and FIG. 4 is a diagram showing an example of a screen displayed on the television by the reproduction function of the digital information storage device of FIG. Is.

As described above, the digital information storage device 101 has the function of browsing the Internet on the Web. When this function is executed, a screen 301 for web browsing shown in FIG. 3 is displayed on the television 103. On this screen 301, the key layout 30
2 is displayed. The key layout 302 represents the key arrangement of the remote controller 102, and each key on the key layout 302 is given a corresponding function name. This function name is a function name assigned to each key of the remote controller 102 according to the function currently being executed. In the case of this web browsing function, each key of the remote controller 102 has a symbol, a numeral, an alphabet key necessary for inputting a web page address,
It is assigned to a cursor key or the like for scrolling or jumping the screen of the Web page.

The user selects the key layout 30 at the bottom left of the screen.
While looking at 2, operate the remote controller 102 at hand with a finger to input an address in the address input field 303 on the screen, or a desired Web displayed on the WEB screen 304, for example.
Browse web pages by scrolling or jumping. At this time, the user is
A key layout 302 displayed on the TV screen is displayed every time a key on the remote controller 102 is pressed so that the operation performed on the TV screen can be confirmed at any time.
The color of the key portion corresponding to the pressed key of the remote controller 102 inside is changed and displayed.

Further, when executing the functions of searching, selecting, browsing, and reproducing the moving image stored in the digital information storage device 102, the screen 40 shown in FIG.
1 is displayed. On this screen 401, a key layout 402 is displayed at the bottom left of the screen, and this key layout 402 represents the key arrangement of the remote controller 102. Each key on this key layout 302 has a moving image currently being executed. The function names assigned are assigned according to the functions of searching, selecting, browsing, and reproducing.
In this case, each key of the remote controller 102 is represented by a symbol, a number, and a key necessary for inputting a moving image file name, and symbols for performing operations such as playing, stopping, pausing, forwarding, and returning of a moving image. It is assigned to the cursor keys and the cursor keys for scrolling and zooming up the video screen.

The user selects the key layout 40 at the bottom left of the screen.
While watching 2, the remote controller 102 at hand is operated with a finger, for example, an input is made in the moving image file name input field 403 on the screen, a desired moving image file is read out, and the moving image file read out on the moving image screen 404 is reproduced. , Stop, pause, defer, rewind, or scroll or zoom up to browse video files. At this time, a key corresponding to the pressed key on the remote controller 120 in the key layout 402 displayed on the TV screen so that the user can check the operation performed on the remote controller 102 on the TV screen at any time. The part is displayed with its color changed.

Next, the functional configuration of the digital information storage device 101 will be described with reference to FIG. FIG. 5 is FIG.
3 is a block diagram showing a functional configuration of the digital information storage device of FIG. Here, the arrows in the drawing represent the flow of each signal, the thick solid line indicates various kinds of information, and the thin solid line indicates a control signal.

As shown in FIG. 5, the digital information storage device 101 includes a control unit 501 and a remote control reception I / F unit 5.
Have 02. The control unit 501 uses the IP network I /
F unit 503, AV equipment I / F unit 504, memory unit 50
5, each block of the TV image generation unit 506 and the TV output I / F unit 507 is controlled. Further, the control unit 501 has a built-in clock function, and each block 5 uses this clock function.
The timer is used to notify the time from 03 to 507 and to control the operation.

The remote control reception I / F unit 502 is an interface for receiving a control signal from the remote control 102, and the control signal received from the remote control 102 is sent to the control unit 50.
Send to 1. In the present embodiment, the remote controller 10
A control signal is transmitted from the infrared ray communication device 2 from the remote controller 2, and after receiving the control signal transmitted from the remote controller 02, the control signal is demodulated and sent to the control unit 501. Remote control 102
If any key is pressed by the user,
A control signal corresponding to the pressed key is transmitted.

The IP network I / F unit 503 uses the IP
It is an interface for connecting to a network (Internet) 106. In this embodiment, the IP network I / F unit 503 is composed of a modem and a terminal adapter, and the IP network 106 is connected via a telephone line.
Is used to connect with. We on the Internet
b When browsing or sending / receiving electronic mail, the IP network I / F unit 503 makes a dial-up connection to a predetermined provider, and after the connection is completed, packetized information is sent / received. In addition, IP network 1
All information sent to and received from the memory unit 506 is exchanged with the memory unit 505, and this exchange is performed according to an instruction from the control unit 501.

The AV device I / F section 504 is an interface for connecting the digital information storage device 101 to various AV devices. In this embodiment, the AV device I / F
As the unit 504, a USB (Universal Serial Bus) or a PC
MCIA (Personal Computer Memory Card International
The AV device I / F unit 504 uses slots conforming to the
It has a function of connecting a device and receiving AV information. In addition, all the AV information received by the AV device I / F unit 504 is sent to the memory unit 505 so that the control unit 50 can receive the AV information.
Controlled by 1.

The memory unit 505 stores or temporarily stores all data and information handled by the digital information storage device 101. In the present embodiment, this memory unit 505 is divided into some storage areas. For example, an information storage area that always stores setting data and various AV information, and can be newly added or deleted by a user's operation, a temporary storage area that temporarily stores image information when browsing the Web. , Remote controller 102 corresponding to each function
Key function name information (for example, 302 in FIG. 3 and 4 in FIG. 4)
02) is stored. Of the information stored in the memory unit 505, the television 103
The information to be output to is selected by the control of the control unit 501, and the selected information is input to the TV image generation unit 506.

The TV image generation unit 506 combines various information input from the memory unit 505 to generate screen configuration information such as the screen 301 shown in FIG. 3 or the screen 401 shown in FIG. It is converted into video information that can be displayed on the TV and output to the TV output I / F unit 507. In the present embodiment, when changing the screen configuration of the television, the control unit 50
1 detects the user's remote control operation and reflects the content of the operation in the memory unit 505 or the TV image generation unit 506, so that the screen configuration of the television 103 can be updated at any time by the user's remote control operation. . Further, when changing the function itself to be used, the control unit 501 detects the user's remote control operation and reflects the content of the operation in all the functional blocks, so that the function used by the user's remote control operation can be performed at any time. It is possible to update.

The TV output I / F unit 507 is an interface for outputting the video information sent from the TV image generation unit 506 to the television 103. In the present embodiment, the TV output I / F unit 507 is provided with audio and video so that the digital information storage device 101 and the television 103 are connected by a cable with pin plugs for independent audio and video. A terminal corresponding to each pin jack is provided.

Next, the internal structure of the remote controller 102 will be described with reference to FIG. FIG. 6 shows the remote controller 1 of FIG.
2 is a block diagram showing an internal configuration of 02. FIG.

As shown in FIG. 6, the remote controller 102 includes a key key pad 601, a key input detection unit 602, a remote control transmission I / F unit 603, and a remote control state detection unit 604.
Have and. The keypad 601 is the key 2 shown in FIG.
It is composed of 01, 202 and 204.

The key input detection unit 602 detects the key on the keypad 601 pressed by the user, and sends the information corresponding to the pressed key to the remote control transmission I / F unit 603. Here, the key input detection unit 602 detects a key input by an electric method in which electricity flows or does not flow when the key is pressed, and therefore, it continues to detect it while the key is pressed. Is configured. Further, even when a plurality of keys are pressed, it can be detected, and the information is also sent to the remote control transmission I / F unit 603 as in the above. Further, the key detection input unit 602 sends the information from the remote control status detection unit 604 to the remote control transmission I / F unit 603.

The remote control transmission I / F unit 603 modulates the key information sent from the key input detection unit 602 and the status information sent from the remote control status detection unit 604, and sends a control signal using infrared rays as a communication medium. As mentioned above,
While the key of the remote controller 102 is being pressed, the key input detection unit 602 continuously sends the key information to the remote controller transmission I / F unit 603. Therefore, in the remote control transmission I / F unit 603, the control signal is continuously transmitted to the digital information storage device 101 as long as the key information is continuously input.

The remote control status detecting unit 604 detects a change in status such as, for example, a status of battery exhaustion, and the detection result is input to the key input detecting unit 602.

Next, the operation of the present digital information storage device will be described with reference to FIGS. 7 to 9 are flowcharts showing the operation of the digital information storage device of FIG. Here, an operation of searching and reproducing a moving image file stored in the digital information storage device 101 using the television screen, and the digital information storage device 1
01 is connected to the Internet and displays and browses a Web page on the television screen.

The television 103 is in a state in which the input of image and sound is switched to the digital information storage device 101 side, and the digital information storage device 101 displays on the television 103 the initial screen immediately after the power is turned on. It is in the state of outputting to (standby). In this case, since no function of the digital information storage device 101 has been activated, the key layout of the remote controller 102 is not displayed on the TV screen.

In such a state, as shown in FIG. 7, first, in step 701, reception of a control signal issued by pressing the key 202 for instructing the start of remote control operation is waited for, and the key 202 is handled. When the control signal is received, in step 702, menu screen configuration information for selecting a function is generated based on the received control signal and is sent to the television 103. This allows the TV screen to
A menu screen for selecting a function is displayed, and a key layout of the remote controller 102 is displayed. Each key of the displayed key layout is displayed with a function name corresponding to the function selection. Here, when the user presses a key for selecting a desired function, a control signal corresponding to the pressed key is transmitted.

Then, in step S703, the remote controller 1
Based on the control signal from 02, it is determined whether or not the Internet connection, which is one of the functions selectable on the menu screen, has been selected. Here, if the Internet connection is selected, the process proceeds to step S801 in FIG. 8 described later. On the other hand, when the Internet connection is not connected, the process proceeds to step S704.

At step 704, it is determined whether or not the moving image search / playback is selected based on the control signal from the remote controller 102. Here, when the moving image search / playback is selected, the process proceeds to step S901 in FIG. 9 described later. On the other hand, when the moving image search / playback is not selected, it is determined in step S705 whether the control signal from the remote controller 102 is a control signal issued by pressing the key 203 for instructing the end of remote controller operation. . Here, when the control signal from the remote controller 102 is the control signal corresponding to the key 203, it is determined that the remote controller operation is completed, and the process returns to step S701. On the other hand, remote controller 1
When the control signal from 02 is not the control signal corresponding to the key 203, it is determined that the remote control operation is not ended, the process returns to step S703, and the user operates the remote control 10
The process is repeated until the 2 key is pressed.

When it is determined in step S703 that the Internet connection is selected, as shown in FIG. 8, first, in step S801, a dial-up connection is performed through the IP network I / F unit 503 to connect to the Internet 106. To do. Then, step S8
At 02, a web page set in advance is connected, information of this web page is acquired, and transmitted to the television 103. As a result, the screen 301 as shown in FIG. 3 is displayed on the television screen. A key layout 302 is displayed on this screen 301. Here, each key 201 of the remote controller 102 is assigned as an alphabet key or a cursor key for operating an address input, a jump or movement of a Web page, etc., and thus corresponds to each key on the key layout 302. The name of the function assigned to the key is added and displayed.

Next, in step S803, it is determined whether or not the input to the address input field 303 on the screen 301 has been selected in order to move from the currently displayed web page to another web page. Here, when the cursor is moved to the position of the address input field 303, it is determined that the address input is selected, and the process proceeds to step S804. In step S804, the address input field 30
The alphanumeric corresponding to the key pressed to input the address to 3 (corresponding to the key in which alphanumeric characters are displayed) is input in the address input field 303, and the key pressed in the key layout 302 Change the display color of the corresponding key. For example, if you enter the alphanumeric "c",
By pressing the key on the remote controller 102 corresponding to the key labeled "abc" on the key layout 302 three times, the alphanumeric "c" is selected and input. At this time, in the address input field 303, the character display changes in the order of “a” → “b” → “c” every time the key is pressed. In addition, “a” on the key layout 302
The display color of the key with the name “bc” changes to a different color each time the corresponding remote control key is pressed, so that the key operation state of the remote control 102 can be easily recognized.

Next, in step S805, it is determined whether or not to clear the characters input in the address input field 303. Here, for example, the remote controller 102 corresponding to the key marked with the symbol "←" on the key layout 302 after the characters are input in step S804.
If the key is pressed, it is determined that the instruction to clear the character has been given, and the process proceeds to step S807. On the other hand, when the key of the remote controller 102 corresponding to the key with the symbol “→” on the key layout 302 is pressed after the character is input in step S804, the input character It is determined that the confirmation has been instructed, and step S806
Proceed to. In step S807, the above step S804
The characters entered in step S803 are erased, and the process returns to step S803. This makes it possible to input the character again. In step S806, the entered characters are confirmed,
The procedure returns to step S803. This makes it possible to input the character again.

If it is determined in step S803 that the address is not input, it is determined in step S808 whether the remote control operation such as scrolling the currently displayed Web page or returning to the previous page is performed. To judge. Here, when such a remote control operation is performed,
In step S809, the display content is updated according to the remote control operation. For example, move the cursor on the TV screen 301 to the position on the WEB screen 304 and move the key layout 3
02 remote controller 102 corresponding to the key indicating the cursor
When the key is pressed, a process of scrolling the WEB screen 304 is performed. For example, when the key of the remote controller 102 corresponding to the key with the symbol “↓” in the key layout 302 is pressed, the WEB screen 304 scrolls downward. On the contrary, when the key of the remote controller 102 corresponding to the key with the symbol “↑” in the key layout 302 is pressed, the WEB screen scrolls upward. Then, the process proceeds to step S810.

On the other hand, when the remote control operation such as scrolling the currently displayed Web page or returning to the previous page is not performed, the above step S
809 is skipped and the process proceeds to step S810.

In step S810, it is determined whether or not to terminate the Internet connection (Web browsing). Here, for example, “↑”, “↓” in the key layout 302
When the keys of the remote controller 102 corresponding to the keys marked with are pressed at the same time, it is determined that the Internet connection (Web browsing) is terminated, and step S8
At 11, the process of disconnecting the dial-up connection is performed to disconnect the Internet connection. Then, returning to step S702 in FIG. 7, the television screen is switched to the menu screen. On the other hand, the remote controller 102 corresponding to each of the keys marked with "↑" and "↓"
Unless the key is operated simultaneously, it is determined that the browsing of the Web page is continued, and the process returns to step S803.

When it is determined in step S704 that the moving image search / playback is selected, as shown in FIG. 9, first, in step S901, a screen 401 for searching and playing back the moving image file stored in the memory unit 505 is displayed. (Shown in FIG. 4) is displayed on the television 103. A key layout 402 is displayed on this screen 401. Here, each key of the remote controller 102 is used to input a file name to search for a moving image file, and to play, stop, pause, forward, rewind the read moving image file,
Alternatively, it is assigned as a key for scrolling or zooming up, and to indicate that, each key on the key layout 402 is displayed with a corresponding symbol key or the like.

Next, in step S902, it is determined whether or not the input of the file name of the moving image file to be searched has been completed in order to search the moving image file. Here, for example, the cursor on the TV screen is the file name input field 403.
When the key of the remote controller 102 corresponding to the key with the number on the key layout 402 is pressed to the position of, the number corresponding to the pressed key is input in the file name input field 403, and the key is pressed. The display color of the key corresponding to the pressed key of the remote controller 102 in the layout 402 is changed. Then, when the input of the file name is not completed, the process proceeds to step S903, the entered character is confirmed or erased, and the process returns to step S902. In this way, the input of characters, the confirmation and the deletion thereof are repeated, and the file name of the moving image file is input. The detailed file name input method is described in step S80 above.
It shall be performed according to the procedure shown in 4-S807.

When the input of the file name of the moving image file is completed, in step S904, the moving image file stored in the memory unit 505 is searched using the decided file name as a keyword. This search start is instructed by, for example, simultaneously pressing the keys of the remote controller 102 corresponding to the keys marked with "<" and ">" in the key layout 402.

Next, in step S905, the key layout 402 is searched and read according to whether or not the key (moving image reproduction key) of the remote controller 102 corresponding to the key with the symbol “Δ” is pressed. It is determined whether or not the issued moving image file is reproduced. At this time, the first image of the read moving image file is displayed as a still image on the moving image screen 404 of the screen 401. Then, when the moving image reproduction key is pressed, step S9
At 06, the reproduction of the moving image is started from the still image displayed on the moving image screen 404.

Then, in step S907, the display of the key layout 402 and the file name input field 403 is erased, and it is determined whether or not there is an instruction to display the moving image screen 404 on the television screen in full screen. The instruction at this time is, for example, “←”, “→” in the key layout 402.
It is issued by simultaneously pressing the keys of the remote controller 102 corresponding to the keys with the symbols. If there is the above instruction, step S
At 909, the display of the key layout 402 and the file name input field 403 is erased, and the moving image screen 404 is displayed in full screen on the television screen. Then, in step S91
Go to 0.

On the other hand, if there is no such instruction, it is determined in step S908 whether or not the time of the timer started at the same time as the reproduction of the moving image has exceeded the preset time. This timer can set an arbitrary time. Here, when the timer time has passed the preset time, in step S909, the display of the key layout 402 and the file name input field 403 is turned off, and the moving image screen 404 is displayed in full screen on the television screen. Then, the process proceeds to step S910. On the other hand, when the timer time has not passed the preset time, it is determined in step S910 whether there is an instruction to stop the reproduction of the moving image file. Here, when the key of the remote controller 102 corresponding to the key with the symbol "■" in the key layout 402 is pressed, an instruction to stop the reproduction is issued.

When the stop of the reproduction is instructed by pressing the key, the reproduction of the moving image is stopped, the screen 401 including the key layout 402 shown in FIG. 4 is displayed, and the moving image screen 404 is reproduced in step S911. Move to a state where the first image of the movie file is displayed as a still image. Then, in step S912, it is determined whether or not to end the moving image reproduction. Here, for example, the key layout 40
When the keys of the remote controller 102 corresponding to the keys marked with "↑" and "↓" in 2 are pressed at the same time, it is determined that the search and reproduction of the moving image file are ended, and the above step S702 is performed. Return and switch the TV screen to the menu screen. On the contrary, unless the above key operation is performed, it is determined to continue searching and playing the video file,
The procedure returns to step S902.

If it is determined in step S905 that the moving image playback key is not pressed, it is determined in step S912 whether or not to end the search and playback of the moving image file.

As described above, in this embodiment, the key layout of the remote controller 102 is displayed on the TV screen, and the function names of the keys corresponding to the respective operation modes are given to the respective keys in the key layout of the TV screen. When the key 102 is pressed, the corresponding key portion in the key layout displayed on the TV screen is displayed in a different color. Therefore, the user can operate the keys on the remote controller 102 while watching the TV screen. You can Further, since the remote controller 102 is provided with a recognition unit that can be recognized by the touch of a human finger, and keys are arranged around the recognition unit, the user does not look at the keys on the remote control and It becomes possible to recognize the key arrangement only by feeling, and it is possible to easily select and operate a desired key. Especially when you need to input a large amount of characters, such as when creating an email,
The method according to the present embodiment uses the cursor keys on the remote controller or the jog stick dial to move the cursor on the screen key displayed on the TV screen to input characters, and thus the method using the remote controller 102 The number of key operations can be significantly reduced, which is excellent in terms of time and operability.

Further, it is possible to select display / non-display of the key layout on the TV screen by operating the remote controller 102 as required. Be effective.

Further, by providing a timer function inside the digital information storage device 101, display / non-display of the key layout can be temporally switched.

In this embodiment, the remote controller 102
Although the shape of the recognition unit provided in the above is convex, the shape is not limited to this, and any shape such as a concave shape can be used as long as it can be recognized by the feel of a human finger. Good.

(Second Embodiment) Next, a second embodiment suitable for the present invention will be described with reference to FIG. FIG. 10 is a diagram showing an appearance and an opened state of a remote controller used in a user interface device according to a second preferred embodiment of the present invention.

In the present embodiment, as shown in FIG. 10, a remote controller 102 having a two-fold structure is used. The remote controller 102 includes an upper plate 102a and a lower plate 102b.
And the upper plate 102a is foldably connected to the lower plate 102b. Two recognition units 1003 that can be recognized by the feel of a finger are formed on the upper surface of the upper plate 102a, and a plurality of keys 1001 are arranged around each recognition unit 1003. Also, the upper plate 102
A key 1002 for instructing start of remote control operation and a key 1004 for instructing end of remote control operation are provided on the upper surface of a. Further, on the lower surface of the upper plate 102a, similarly to the upper surface, two recognition units 1010 and a plurality of keys 1 arranged around the recognition units 1010, respectively.
And 009 are provided.

On the surface of the lower plate 102b facing the upper plate 102a, two recognition units 1007, a plurality of keys 1005 arranged around each recognition unit 1005, and a remote control operation start instruction. A key 1006 and a key 1008 for instructing the end of remote control operation are provided.

In the remote controller 102, the upper plate 102a is folded with respect to the lower plate 102b (see FIG. 10).
When it is in the left diagram of the inside), the operation of each key 1001, 1002, 1004 provided on the upper surface of the upper plate 102a can be accepted.

On the other hand, the upper plate 102a is replaced by the lower plate 102b.
Each key 1 provided on the lower surface of the upper plate 102a when in a state of being opened with respect to the right side (the right diagram in FIG. 10).
The operation of 009 and the operation of each key 1005, 1006, 1008 provided on the lower plate 102b are enabled, and the operation of these keys is accepted. In this state, the operation of each key 1001, 1002, 1004 provided on the upper surface of the upper plate 102a cannot be accepted. In this way, when the upper plate 102a is opened with respect to the lower plate 102b, the number of operable keys is determined by the upper plate 102a.
Is doubled as compared with the case where is folded with respect to the lower plate 102b.

Further, in the remote controller 102, the upper plate 102a is changed to the lower plate 102 by the remote controller state detection unit 604.
It is configured to detect whether it is folded or opened with respect to b, and transmit the detection signal. The digital information storage device 101 side receives the detection signal transmitted from the remote controller 102 and recognizes the state of the remote controller 102 based on this detection signal. Then, according to the state of the remote controller 102 (whether the upper plate 102a is folded or opened with respect to the lower plate 102b), a key layout showing an array of operable keys is displayed on the television screen. .

As described above, in the present embodiment, the remote controller 102 is folded in two so that, for example, when browsing a Web page on the Internet, the remote controller 102 is used in a folded state. W
When entering the address of the eb page, use the remote control 1
The number of keys can be increased according to the contents of the input operation such as opening 02, and the input operation environment using the keys can be improved. For example, when browsing a Web page, the number of keys required for remote control operation is small, and by reducing the number of keys, the possibility of erroneous operation is further reduced. On the other hand, in character input such as address input of a Web page, the number of keys is increased, and the operability of character input can be improved.

(Third Embodiment) Next, a third preferred embodiment of the present invention will be described with reference to FIG. FIG. 11 is a diagram showing an external configuration diagram of a remote controller used in the user interface device according to the third preferred embodiment of the present invention.

In this embodiment, as shown in FIG. 11, the extended keyboard 11 is constructed so that it can be pulled out.
A remote control 102 having 00 is used. In the remote controller 102, two recognition units 1103 that can be recognized by the feel of a finger are formed on the upper surface of the main body.
A plurality of keys 1101 are arranged around the area 103. The extended keyboard 1100 is housed in the main body so that it can be pulled out.
One recognition unit 1106 and a plurality of keys 1105 arranged around each recognition unit 1106 are provided (see the right diagram of FIG. 11).

In the remote controller 102, when the extended keyboard 1100 is pulled out from the main body, each key 1105 provided on the extended keyboard 1100.
Becomes an operable state, and the number of operable keys is twice as large as that in a state where the extended keyboard 1100 is housed.

Further, in the remote controller 102, the remote controller status detecting unit 604 is configured to detect whether the extended keyboard 110 is pulled out or housed, and transmit the detection signal. On the digital information storage device side, the detection signal transmitted from the remote controller 102 is received, and the state of the remote controller 102 is recognized based on this detection signal. Then, according to the state of the remote controller 102 (whether the extended keyboard 110 is pulled out or housed), a key layout showing an array of operable keys is displayed on the television screen.

Therefore, in this embodiment, the same effect as that of the above-described second embodiment can be obtained.

[0097]

As described above, according to the user interface device and method of the present invention, when the control signal issued by the specific key operation of the remote operation means is received, the key arrangement of the plurality of keys is changed. Since the key layout image shown is displayed on the display device, the input operation using the keys can be easily performed.

Further, according to the remote control device of the present invention, a plurality of keys are arranged and a keyboard surface having a recognition portion which can be recognized by the feel of a human finger is formed. Are arranged around the recognition site as a reference, the user can recognize the key layout only by the feeling of the finger without looking at the keys on the remote control means, and the desired position can be easily obtained. Keys can be selected and operated.

[Brief description of drawings]

FIG. 1 is a diagram schematically showing a state in which a digital information storage device equipped with a user interface device according to a first preferred embodiment of the present invention and a peripheral device are connected.

FIG. 2 is a diagram showing an external configuration diagram of the remote controller shown in FIG.

3 is a diagram showing an example of a screen displayed on a television by a Web browsing function of the digital information storage device of FIG.

4 is a diagram showing an example of a screen displayed on a television by a reproduction function of the digital information storage device of FIG.

5 is a block diagram showing a functional configuration of the digital information storage device of FIG. 1. FIG.

6 is a block diagram showing an internal configuration of a remote controller 102 of FIG.

7 is a flowchart showing an operation of the digital information storage device of FIG.

8 is a flowchart showing the operation of the digital information storage device of FIG.

9 is a flowchart showing an operation of the digital information storage device of FIG.

FIG. 10 is a diagram showing an external appearance and an open state of a remote controller used in a user interface device according to a second preferred embodiment of the present invention.

FIG. 11 is a diagram showing an external configuration diagram of a remote controller used in a user interface device according to a third preferred embodiment of the present invention.

[Explanation of Codes] 101 Digital Information Storage Device 102 Remote Control 103 Television 201, 202, 204, 1001, 1002, 100
4,1005,1006,1008,1101,110
2, 1104 keys 202, 1003, 1007, 1103 recognition 302, 402 key layout 501 control unit 502 remote control reception I / F unit 503 IP network I / F unit 504 AV equipment I / F unit 505 memory unit 506 TV image generation unit 507 TV output I / F unit 602 Key input detection unit 603 Remote control transmission I / F unit 604 Remote control status detection unit

Continued front page    F-term (reference) 5B020 CC00 CC11 DD02 FF51 FF53                 5C056 DA08 EA06                 5E501 AA02 AA20 AB06 BA05 CC02                       CC06                 5K048 AA04 BA01 DB04 DC07 EB02                       EB06 EB07 EB11 EB12 EB15                       FA07 FB10 FB15 FB16 FC03                       HA01 HA13 HA21

Claims (30)

[Claims] 1. A user interface device for remotely operating a device connectable to a display device for displaying an image, comprising a plurality of keys, and corresponding control signals in response to the plurality of key operations. Remote control means for transmitting a control signal, a reception means for receiving a control signal issued from the remote control means, and a control means for operating the corresponding device according to the control signal received by the reception means. When the control unit receives a control signal issued by a specific key operation of the remote operation unit by the receiving unit, the control unit displays a key layout image showing a key arrangement of the plurality of keys on the display device. A user interface device characterized by displaying. 2. The user interface according to claim 1, wherein the control unit displays a key name image showing a function name of each key of the remote operation unit on the display device together with the key layout image. apparatus. 3. The apparatus includes a setting unit that sets a plurality of modes including a video reproduction mode and an Internet browsing mode, and a mode execution unit that executes the set mode, and the control unit includes: 3. The function name of each key of the remote control means is changed according to the type of the set mode, and a key name image showing the changed function name is displayed on the display device. User interface device as described. 4. The key layout image displayed on the display device when the control means receives a control signal issued by the operation of any one of the plurality of keys from the remote control means by the receiving means. 4. The user interface device according to claim 2, wherein a display form of a key portion corresponding to the operated key of is changed. 5. The control means, when the receiving means receives a remote control signal issued by a specific key operation from the remote control means while the key layout image is being displayed, the control means receives the remote control signal. The user interface device according to claim 4, wherein the display of the key layout image is stopped. 6. The control means stops the display of the key layout video when the receiving means does not continuously receive the control signal from the remote control means for a predetermined period during the display of the key layout video. The user interface device according to claim 4, characterized in that 7. The remote operation means has a keyboard surface on which the plurality of keys are arranged, and a recognition portion which can be recognized by the feel of a human finger is formed. 7. The recognition site is arranged around the recognition site as a reference, according to claim 1.
User interface device. 8. The remote operation means is connected to a first member having two keyboard surfaces each provided with a key, and is connected so that the first member can be folded.
Second having one keyboard surface provided with keys
When the first member is folded over the second member, one of the keyboard surfaces of the first member is exposed to the outside so that it can be operated. The other keyboard surface is in a state of facing the keyboard surface of the second member, and the first member is the second member.
And a second keyboard surface of the first member and the second keyboard surface of the first member that are exposed to the outside so that they can be operated. The user interface device according to any one of claims 1 to 7. 9. The remote control means is provided on one of the keyboard surfaces of the first member when the first member is folded over the second member. Only when the first member is opened with respect to the second member, the second member is provided on each of the other keyboard surface of the first member and the second keyboard surface. 9. The user interface device according to claim 8, wherein the user interface device receives only the operation of a key that is set. 10. The remote control means is configured such that the first member is folded over the second member or the first member is opened with respect to the second member. The detection means for detecting whether or not there is a state, and the transmission means for transmitting the detection signal indicating the detection result of the detection means, the control means, when the receiving means receives the detection signal, 10. The user interface device according to claim 9, wherein a key layout image showing a key arrangement of keys that can be operated by the remote operation means in accordance with a state indicated by the detected signal is displayed. 11. The remote control means includes a main body having a key provided on an upper surface thereof, and an extended keyboard provided with the key and retractably housed in the main body. The user interface device according to claim 1, wherein the user interface device is pulled out from the main body to an operable position. 12. The remote control means includes a detection means for detecting whether the extended keyboard is pulled out from the main body or stored in the main body.
Transmission means for transmitting a detection signal indicating the detection result of the detection means, and the control means, when the reception means receives the detection signal, the remote control unit according to the state indicated by the received detection signal. The user interface device according to claim 11, wherein a key layout image showing a key layout of keys operable by the operation means is displayed. 13. A remote control device for remotely operating a device, comprising a keyboard surface on which a plurality of keys are arranged, and a control for remotely operating the device according to the plurality of key operations. It has a control signal generating means for issuing a signal, and a transmitting means for transmitting the issued control signal, the keyboard surface is formed with a recognition site recognizable by the feel of a human finger, The remote control device is characterized in that the key is arranged around the key based on the recognition part. 14. A first member having two keyboard surfaces each provided with a key, and one keyboard surface having the keys connected to each other so that the first member is folded and folded. A second member, and when the first member is in a folded state with respect to the second member, one of the keyboard surfaces of the first member is placed outside so as to be operable. When exposed, the other keyboard surface is in a state of facing the keyboard surface of the second member, and the first member is in a state of being opened with respect to the second member, the first keyboard 14. The remote control device according to claim 13, wherein the other of the keyboard surfaces of the member and the second keyboard surface have a two-fold structure in which they are exposed to the outside so that they can be operated. 15. The control signal issuing means is provided on one of keyboard surfaces of the first member when the first member is in a folded state with respect to the second member. When only the operation of the key is received and the first member is opened with respect to the second member, the other of the keyboard surfaces of the first member and the second keyboard surface are 15. The remote operation device according to claim 14, wherein only the operation of a provided key is accepted. 16. Whether the first member is folded over the second member or the first member is opened relative to the second member. 16. The remote control device according to claim 15, further comprising detection means for detecting and detection signal transmission means for transmitting a detection signal indicating a detection result of the detection means. 17. A main body having a key on the upper surface,
14. An extension keyboard provided with a key and retractably housed in the main body, wherein the extension keyboard is withdrawn from the main body to a position at which the key can be operated. Remote control device. 18. A detection unit that detects whether the extended keyboard is pulled out from the main body or is stored in the main body, and a detection signal indicating a detection result of the detection unit is transmitted. 18. The remote control device according to claim 17, further comprising a detection signal transmitting unit. 19. A user interface method for remotely controlling a device connectable to a display device for displaying an image, the method comprising a remote operation means having a plurality of keys corresponding to the plurality of key operations. A step of transmitting a control signal, a step of receiving a control signal issued from the remote operation means, a step of operating the device corresponding to the received control signal, and a specification of the remote operation means. Receiving a control signal issued by the key operation of (1), displaying a key layout image showing a key arrangement of the plurality of keys on the display device. 20. The user interface method according to claim 19, further comprising the step of displaying a key name image indicating a function name of each key of the remote control means on the display device together with the key layout image. 21. The apparatus has a setting means for setting a plurality of modes including a video reproduction mode and an internet browsing mode, and a mode execution means for executing the set mode, wherein the set mode is set. 21. The user interface method according to claim 20, wherein the function name of each key of the remote control means is changed according to the type of the key, and a key name image showing the changed function name is displayed on the display device. . 22. When receiving a control signal issued by the operation of any one of the plurality of keys from the remote operation means, it corresponds to the operated key in the key layout image displayed on the display device. 19. The user interface method according to claim 19, wherein the display form of the key portion is changed. 23. While the key layout image is being displayed,
23. The user according to claim 22, further comprising the step of stopping the display of the key layout image according to the received control signal when a remote operation signal issued by a specific key operation is received from the remote operation means. Interface method. 24. While the key layout image is being displayed,
23. The user interface method according to claim 22, wherein when the control signal from the remote control means is not continuously received for a predetermined period, the display of the key layout image is stopped. 25. The remote control means has a keyboard surface on which the plurality of keys are arranged and a recognition portion which can be recognized by the feel of a human finger is formed. The user interface method according to any one of claims 19 to 24, wherein the user interface method is arranged around the recognition site as a reference. 26. The remote control means is connected to a first member having two keyboard surfaces, each of which is provided with a key, and the first member so that the first member can be folded.
Second having one keyboard surface provided with keys
When the first member is folded over the second member, one of the keyboard surfaces of the first member is exposed to the outside so that it can be operated. The other keyboard surface is in a state of facing the keyboard surface of the second member, and the first member is the second member.
And a second keyboard surface of the first member and the second keyboard surface of the first member that are exposed to the outside so that they can be operated. The user interface method according to any one of claims 19 to 25. 27. The remote control means is provided on one of the keyboard surfaces of the first member when the first member is in a folded state with respect to the second member. Only when the first member is opened with respect to the second member, the second member is provided on each of the other keyboard surface of the first member and the second keyboard surface. 27. The user interface method according to claim 26, wherein only the operation of a key that has been activated is accepted. 28. The remote control means is configured such that the first member is folded over the second member or the first member is opened with respect to the second member. And a transmitting unit that transmits a detection signal indicating the detection result of the detecting unit, and when the detection signal is received, the detection unit determines whether the received detection signal corresponds to the state indicated by the received detection signal. 28. The user interface method according to claim 27, further comprising the step of displaying a key layout image showing a key arrangement of keys that can be operated by the remote operation means. 29. The remote control means has a main body having a key provided on an upper surface thereof, and an expansion keyboard provided with the key and retractably housed in the main body. Is pulled out from the main body to an operable position.
5. The user interface method according to any one of 5 above. 30. The remote control means includes a detection means for detecting whether the extended keyboard is pulled out from the main body or stored in the main body.
A key of an operable key in the remote operation means according to the state indicated by the received detection signal when the detection signal is received. 30. The user interface method according to claim 29, further comprising the step of displaying a key layout image showing the arrangement.