JP2007058569A - Electronic equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation device for operating a button by viewing the button display image of electronic equipment without viewing any button of an operation part. <P>SOLUTION: An operation part is provided with a plurality of buttons, and it is detected that at least one of those buttons has been touched, and that at least one of those touched buttons has been depressed. The buttons of the operation part are displayed at a display part, and when it is detected that the button has been touched, the display of the button displayed at the display part is changed based on the detection output. When at least one of the touched buttons is depressed, processing corresponding to the button is executed based on the detection output. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an electronic device including an operation unit including a plurality of operators and a display unit, and more particularly to an electronic device that displays images of the plurality of operators on the display unit.

As devices become more sophisticated, such as televisions, video decks, car navigation systems, and personal computers, the operation of electronic devices becomes more complicated and the number of operation buttons increases. Therefore, it becomes difficult to operate a button for using a desired function. In order to reduce the number of operation buttons, for example, a plurality of functions are assigned to one button, and the function of the button is switched according to the type of operation. Since the function of the button is switched in this way, the function assigned to the button cannot be understood, and the button operation procedure becomes longer. For this reason, the button function is indicated near the button, but the button notation must be observed when operating the button. Some display a plurality of button functions on a display screen of an electronic device and select a button with a cursor. However, for those who are not familiar with cursor operation, the operation of the cursor is complicated and difficult.
There are many electronic devices that are operated by a remote controller. However, the number of remote controller devices increases, and the correspondence between the electronic device and the remote controller may not be understood.
Patent Document 1 discloses an invention in which when a user touches a button for device operation, information associated with the button is displayed on the display means of the device, and after confirming the content, the button is pressed to operate. is doing.
JP 2000-278374 A

Japanese Patent Application Laid-Open No. 2004-228561 displays a function operated by a button on a display unit of the device, but does not know where the button is. Therefore, you have to find and operate buttons, learn button positions as you become accustomed, and operate buttons by groping.
The present invention eliminates such inconvenience, and provides an electronic device that combines an operation unit and a device display unit. The user can view the button display screen of the device without looking at the buttons on the operation unit. An electronic device capable of operating a button is provided.

An electronic device according to the present invention includes an operation unit including a plurality of operators, a first detection processing unit that detects that at least one of the operators is selected, and at least one of the selected operators. Based on the output of the 2nd detection processing part which detects having been operated, the display part which displays a plurality of these operation elements, and the 1st detection processing part, the display of the operation element displayed on the display part is carried out. A display processing unit to be changed and an operation execution unit that executes a process corresponding to the operation element based on an output of the second detection processing unit are provided to solve the problem.
In the electronic device of the present invention, when the first detection processing unit detects that a plurality of operators are selected, the display processing unit displays the operators corresponding to the selected operators. It is something to change.
In the electronic device of the present invention, the first detection processing unit detects that a plurality of operators are selected, and the second detection processing unit detects that at least one of the selected operators is operated. When the operation is detected, the operation execution unit executes processing corresponding to the selected plurality of operators.

The electronic device according to the present invention further includes a switching unit that switches processing corresponding to each operation element, and the display processing unit displays the operation element displayed on the display unit based on the output of the switching unit. It is good to switch.
The electronic device according to the present invention further includes a display change unit that changes a display position or a display size of the operation element, and the display processing unit performs an operation displayed on the display unit based on an output of the display change unit. It is preferable to change the display position or display size of the child.
The electronic apparatus according to the present invention further includes an operation procedure storage unit that stores an operation procedure of an operator for realizing a desired process, and the display processing unit is configured according to the operation procedure stored in the operation procedure storage unit. It is preferable to sequentially change the display of the operation elements displayed on the display unit.

  The electronic device according to the present invention includes a remote control device and an electronic device, and includes an operation unit including a plurality of operation elements, a first detection processing unit that detects that at least one of the operation elements is selected, and the selected one. A second detection processing unit that detects that at least one of the operators has been operated, and a transmission unit that transmits the output of the first detection processing unit and the output of the second detection processing unit. The electronic device is displayed on the display unit based on the output of the receiving unit that receives the transmission signal from the remote control device, the display unit that displays the plurality of controls, and the first detection processing unit. A display processing unit that changes the display of the operation element, and an operation execution unit that executes a process corresponding to the operation element based on the output of the second detection processing unit.

The present invention is also a remote control device, comprising: an operation unit including a plurality of operation elements; a first detection processing unit that detects that at least one of the operation elements is selected; and the selected operation element. A second detection processing unit that detects that at least one of the second detection processing unit is operated, and a transmission unit that transmits the output of the first detection processing unit and the output of the second detection processing unit to the electronic device.
According to another aspect of the invention, at least one of a receiving unit that receives a transmission signal from a remote control device, a display unit that displays a plurality of controls of the remote control device, and an operator of the remote control device is selected. Based on the output of the first detection processing unit that is output when the operation is performed, at least one of the display processing unit that changes the display of the operation unit displayed on the display unit and the selected operation unit is operated And an operation execution unit that executes a process corresponding to the operation element based on the output of the second detection processing unit that is sometimes output.

  The electronic device according to the present invention includes a display unit that displays a plurality of controls, and an operation displayed on the display unit based on an output of a first detection processing unit that detects that at least one of the controls is selected. A process corresponding to the manipulator is executed based on an output of a display processing unit that changes the display of the child and a second detection processing unit that detects that at least one of the selected manipulators has been operated. The operation execution unit that performs the operation can be operated while looking at the display state of the buttons displayed on the display screen of the device, and can be operated without looking at the buttons of the operation unit at hand.

Further, the electronic device of the present invention changes the display of the operation element displayed on the display unit by the output of the first detection processing unit, and executes the process corresponding to the operation unit by the output of the second detection processing unit. The operation of the operator can be divided into a first operation and a second operation. Thus, since the first operation is displayed on the display screen of the device before the second operation by the operation member, the operation image displayed on the display screen of the electronic device without looking at the operation member of the operation unit at hand. The position of the finger can be recognized by looking at, and then the second operation can be performed. Further, since the operation can be performed while looking at the operation image displayed on the display screen of the electronic device, the operation can be performed even in a car, for example, when the periphery of the operation unit is dark. Accordingly, it is not necessary to provide a lighting device in the operation unit or use of the lighting device is reduced, so that battery consumption of the electronic device can be reduced.
In particular, according to the present invention, the first detection processing means is a contact detection means for detecting the contact of the operating element, and detects that the first stage detection means for detecting the first stage depression or the depression by a weak pressure. It is a weak pressure detection means. The second detection means is a push-down detection means for detecting the push-down of the operating element, a second-stage detection means for detecting the push-down of the second stage, or a strong pressure detection means for detecting that the push-down is performed with a strong pressure. . Accordingly, various operators such as switches, buttons, levers, and touch switches can be used as the operators. In particular, in the present invention, it is preferable to use a push button as the operation element.

In the electronic device of the present invention, when the first detection processing unit detects that a plurality of operators are selected, the display processing unit changes the display of the operators corresponding to the selected operators. , It is possible to know the simultaneously operated controls.
In the electronic device of the present invention, the first detection processing unit detects that a plurality of operators are selected, and the second detection processing unit detects that at least one of the selected operators is operated. If detected, the operation execution unit executes a process corresponding to the selected plurality of operators, so that the process can be changed according to the number of operated operators and various displays or processes can be performed. .
For example, when one operator is touched and one operator is pressed, normal processing is performed. However, when the number of operators detected by the first detection processing unit is different from the number of operators detected by the second detection processing unit, a process different from the normal process can be performed. That is, when a plurality of operating elements are touched and one of the operating elements is pressed, a process of displaying a confirmation screen as to which of the touching operating elements has been pressed is performed. In addition, when the “1” operator and the “2” operator are touched and the two operators are pressed down or when either “1” or “2” is operated, one channel 2 screens of 2 channels are displayed. When the “input switching” operation element and the “2” operation element are touched and the two operation elements are pressed down, the input is switched to the video 2 input. Further, when the number of operated operators is 3, the screen may be three screens, or when the number is four, the screens may be four screens.
Also, among multiple operated controls, identify controls with a large contact area, controls with a large size, controls with a large contact pressure, or preset operators with high importance or high priority. And may be processed. Also, the detection outputs of a plurality of operators can be used.

The electronic device of the present invention further includes a switching unit that switches processing corresponding to each operation element, and the display processing unit switches display of the operation element displayed on the display unit based on an output of the switching unit. Therefore, one operator can be used by switching to a plurality of functions, and the number of operators can be reduced. You can also see the functions of the controls by looking at the display screen, and you can operate without looking at the controls at hand.
The electronic device according to the present invention further includes a display change unit that changes a display position or a display size of the operation element, and the display processing unit performs an operation displayed on the display unit based on an output of the display change unit. Since the display position or display size of the child is changed, it can be changed to a position or size that does not overlap the display screen of the electronic device, and the operator can be displayed at a position or size that does not interfere with the display of the electronic device. .
The electronic apparatus according to the present invention further includes an operation procedure storage unit that stores an operation procedure of an operator for realizing a desired process, and the display processing unit is configured according to the operation procedure stored in the operation procedure storage unit. Since the display of the operation elements displayed on the display unit is sequentially changed and the operation of the operation elements is guided, it is possible to sequentially guide the user to a button operation with a long procedure or a complicated button operation.

In addition, the electronic device according to the present invention can display whether or not the operator can be used according to the output of the target device switching unit provided in the operation unit, thereby facilitating the operation of the operator. Only usable operators can be displayed, and the number of operators in the operation unit can be reduced. An unusable operator may be displayed small, lightly displayed, or not displayed.
In addition, the electronic device of the present invention can be provided with a function display character enlargement display means or a reduction display means, and can be sized to be easily viewed by the user.
The electronic device according to the present invention may further include a contact time measuring unit of the operation element, and the display of the operation element may be changed or the processing may be changed according to the time when the user is in contact with the operation element. it can.

  The operating device of the electronic device according to the present invention includes a plurality of operating elements in the operating unit, a first detection processing unit that processes an output from the first detecting unit that detects a first operation in each operating element, The second detection processing unit that processes the output is provided in the second detection unit that detects the second operation. The electronic device includes a display unit that displays the plurality of operating elements, a display processing unit that changes a display state of the displayed operating element based on an output of the first detection processing unit, and a second detection processing unit. And an operation execution unit that executes processing corresponding to the operation element based on the output.

Here, the operator is a button provided in the operation unit and operated by the user. The first detection unit is a contact detection unit of the operation element, and is means for detecting that the user has touched the button like a touch sensor. The second detection unit is a pressing detection unit that detects that the operating element is pressed down, and is a contact point that contacts when the user presses the button down. Alternatively, the first detection unit may be a first step detection unit that detects the first step depression of the button, and the second detection unit may be a second step detection unit that detects the second step depression of the button. The first detection unit may be a first detection unit that detects the first press of the button, and the second detection unit may be a second detection unit that detects the second press of the button. The first detection unit is a first time detection unit that detects pressing of the button for a first predetermined time, and the second detection unit is a second time detection unit that detects pressing of the button for a second predetermined time. But you can. Also, it is a weak pressure detecting means that detects the pressing pressure of the button and detects when the button is pressed with a weak pressure as a first detection, and a strong pressure detecting means that detects when the button is pressed with a strong pressure as a second detection. Good. The output of the first detection unit is received by the first detection processing unit, and the output obtained from the plurality of operators is processed to detect which operator is the first operation. The output of the second detection unit is received by the second detection processing unit, and the output obtained from the plurality of operators is processed to detect which operator is the second operation.
The display processing unit is a means for controlling the display image of the operation unit, and includes a memory, an OSD (on Screen Display) control unit, and an adder. This is the part where images are superimposed.

(Embodiment 1)
Embodiment 1 is a portable terminal device with a television, and a block diagram is shown in FIG.
The portable terminal device with a television of the present invention includes a television portion 100 and an operation unit 200. The television section 100 has a tuner 1, and the output of the tuner 1 is displayed on the display unit 3 through the adder 2. The display unit 3 is a liquid crystal display device, a plasma display device, an organic EL display device, a CRT display device, or the like. The television portion 100 has a television memory 4 and stores image data of the operation unit for display on the display unit 3. The adder 2 synthesizes the output of the tuner 1 and the output of the OSD control unit 5 and displays them on the display unit 3. Alternatively, the output from the tuner 1 and the output from the display control unit 6 are combined and displayed. The output of the tuner 1 is a television video signal. The output of the OSD control unit 5 is an image signal of the operation unit.
The television section 100 further includes a display control unit 6 and receives an operation signal from the operation unit 200. As for the operation signal from the operation unit 200, the display control unit 6 controls the OSD control unit 5 to change the image display of the operation unit, and the TV tuner 1 is controlled to switch the channel or switch the input signal. Or mute the audio output, switch to sub audio, input characters, or control the TV. The television portion 100 may have other configurations.

The operation unit 200 includes a plurality of operators. There are various types of operation elements. Here, a push button type operation element will be described. The operation unit 200 includes a button detection unit 11 in which a plurality of buttons are arranged, a button analysis unit 12, and a control unit 13.
Each button of the button detection unit 11 includes a first detection unit 14 and a second detection unit 15. The 1st detection part 14 is a button contact detection part, for example, detects that a user contacted the button surface, for example, is a touch sensor. The second detection unit 15 is, for example, a button press detection unit, and is a contact that contacts the button or a short circuit by a conductor provided in the button when the button is pressed by the user. The first detection unit 14 may be a touch sensor, and the second detection unit 15 may be a means other than the push-down detection unit. The following description will be made assuming that the first detection unit 14 is a button contact detection unit and a button press-down detection unit.

The button analysis unit 12 identifies the position of the button selected by the button detection unit 11, distinguishes the outputs of the button contact detection unit and the button press detection unit, and outputs a button contact output. Is provided. A second detection processing unit 17 that identifies the position of the button operated by the button detection unit 11 and distinguishes the outputs of the button contact detection unit and the button press detection unit and outputs a button operation output is provided. In addition, the button analysis unit 12 incorporates a contact time measurement unit 18 to measure the user's button contact time.
The control unit 13 includes a button operation guide memory 19 and outputs a signal for guiding the user's button operation.
The configuration of the mobile terminal device with a TV according to the first embodiment is as described above, but this configuration is an example, and the TV memory 4 and the button operation guide memory 19 may be stored in the same storage unit. Moreover, the 1st detection part 14 and the 2nd detection part 15 may be comprised integrally with the button detection part 11, and the display control part 6 and the control part 13 may be the same. Further, the adder 2 and the OSD control unit 5 may be changed to other devices.

(Embodiment 2)
The second embodiment includes a television 300 installed at home or the like, a video deck 400, and a remote controller 500 for operating them, and a block diagram is shown in FIG. The TV 300 is an object of the present invention, and an outline of a general configuration will be described. The television 300 has a tuner 21 and a video input terminal 22. One video input signal of the tuner 21 or the video input terminal 22 is selectively switched by the multiplexer 23 and displayed on the display unit 24. The display unit 24 is a liquid crystal display device, a plasma display device, an organic EL display device, a CRT display device, or the like. The display unit 24 displays an image of the operation unit of the remote control on the display screen. The television 300 has a television memory 25 and stores image data of the operation unit to be displayed on the display unit 24. The adder 27 combines the output of the multiplexer 23 and the output of the OSD control unit 26 and displays the result on the display unit 24. The output of the tuner 21 is a television video signal. The output of the OSD control unit 26 is an image signal of the operation unit. The output of the remote controller 500 is a user's button operation signal, a first detection processing signal processed by detecting the first operation of the user, and a second detection processing signal processed by detecting the second operation. It is.
The television 300 further includes a remote control light receiving unit 28 that receives light emitted from the light emitting unit 44 of the remote control 500 and converts it into an electrical signal. The received light signal is output to the TV control unit 29, and the TV control unit 29 controls the OSD control unit 26 to change the image of the operation unit, and the TV tuner 21 is controlled to switch the channel. Switch signals, mute audio output, switch to sub-audio, input characters, control TV. The television may have other configurations.

The video deck 400 is also an ordinary video deck, and an outline of a general configuration will be described. The video deck 400 includes a video tuner 31 and is output to the video input terminal 22 of the television 300 via the video output unit 32. The recording / playback unit 33 records the video signal obtained from the tuner 31 on a recording medium such as a video tape, a hard disk, a magnetic disk, an optical disk, or a semiconductor memory, or plays back the video signal from the recording medium. The video deck 400 includes a video memory 35, and the OSD control unit 36 reads the video memory 35 in accordance with an instruction from the remote controller 500, superimposes it on the video signal by the adder 37, and outputs the video signal to the video output unit 32.
The video deck further includes a remote control light receiving unit 39, which receives light emitted from the light emitting unit 44 of the remote control 500 and converts it into an electrical signal. The light reception signal output from the remote control light receiving unit 39 is output to the video control unit 38, and the video control unit 38 controls the OSD control unit 36 to change the image of the operation unit, or the video tuner 31 and the video recording unit. Control the playback unit 33 to switch channels, switch to recording / playback / fast forward / rewind, change to reservation mode, input characters, and control the video deck 400. The video deck 400 may have other configurations.

The remote controller 500 includes a button detection unit 41 in which a plurality of buttons are arranged, a button analysis unit 42, a remote control control unit 43, and a light emitting unit 44.
Each button of the button detection unit 41 includes a first detection unit 45 and a second detection unit 46. The 1st detection part 45 is a button contact detection part, for example, detects that a user contacted the button surface, for example, is a touch sensor. The second detection unit 46 is a button press detection unit, and is a contact that contacts the button or a short circuit by a conductor provided in the button when the button is pressed by the user. The first detection unit may be a touch sensor, and the second detection unit may be a means other than the pressing detection unit. The button contact detection unit and the button pressing detection unit will be described below.
The button analysis unit 42 identifies the position of the button operated by the button operation unit 41, distinguishes the outputs of the button contact detection unit and the button press detection unit, and outputs a first contact processing unit 47 that outputs a button contact output. Prepare. A second detection processing unit 48 that identifies the position of the button operated by the button detection unit 41, distinguishes the outputs of the button contact detection unit and the button press detection unit, and outputs a button operation output. Moreover, the contact time measurement part 49 is incorporated and a user's button contact time is measured.
The remote control unit 43 includes a television memory 50, a video deck memory 51, and a button operation guide memory 52. The button control unit 53 controls the reading operation of the television memory 50, the video deck memory 51, and the button operation guide memory 52 based on the output of the button analysis unit 42, and outputs a remote control signal corresponding to the user's remote control button operation. To control.
The light emitting unit 44 receives an output from the button control unit 53 and causes a light emitting element such as an LED or a laser to emit light.
Not only wireless control using light, but also wireless control using RF signals and wired control using electrical signals may be performed.

(Button layout of the operation unit)
The buttons of the operation unit 200 of the first embodiment or the remote controller 500 of the second embodiment are arranged as shown in FIG. 3, for example. The remote control has buttons “B1” to “B12” arranged in four horizontal rows and three vertical rows with numbers “1” to “12” and letters “a” to “wa”, “°” and “symbol”, and “TV power”. Button B13, "VTR power" button B14, "TV / VTR switching" button B15, "Channel selection + or fast forward" button B16, "Channel selection-or rewind" button B17, and "Enter" button B18 "Record" button B19, "Play" button B20, "Stop" button B21, "Menu" button B22, "Low volume" button B23, "High volume" button B24, and "CATV" button B25, “voice switching” button B26, “mute” button B27, “screen switching” button B28, and “screen size” button B29. In the first embodiment or the second embodiment, the above button arrangement is provided. However, it is not necessary to provide all of these buttons, and more buttons may be provided. Further, the arrangement is also arbitrary.

As shown in FIG. 4, the television memory 4 of the first embodiment, the television memory 25 of the television 300 of the second embodiment, and the television memory 50 of the remote controller 500 are arranged with each button arrangement (button ID) and the television in the normal state. Alternatively, the relationship between the operation of the video deck and the character input mode is stored as a table.
Further, as shown in FIG. 5, the video memory 35 of the video deck 400 and the video memory 51 of the remote controller 500 have each button arrangement (button ID), normal operation, operation of the TV or VCR, and character input mode. Are stored as a table.
Further, as shown in FIG. 6, the button operation guidance memory 52 of the remote controller 500 stores an operation guidance large title, an operation guidance title, an operation guidance selection item, and a management code as a table. FIG. 6 shows an example of a video deck operation guidance memory, which is also provided with a television operation guidance memory (not shown).

(flowchart)
Next, a flowchart of the operating device of the present invention will be described with reference to FIG. The first embodiment is different from the first embodiment in that the operation unit and the display unit are in one casing in a portable terminal with a television, whereas the second embodiment is different in that light is communicated between the television 300 or the video deck 400 and the remote controller 500. However, since the other operation parts are the same, the flowchart will be described in common. Hereinafter, the portable terminal device with a television and the television 300 are referred to as an electronic device or a device.
First, in step S1, the electronic device is turned on for the first time. “First time” refers to the period from when the main power switch of the electronic device is turned on until the image of the operation unit is displayed on the display screen of the electronic device. When the electronic device is turned on, the image of the operation unit is displayed. Is set as follows. The image of the operation unit is displayed in the same arrangement as the button arrangement of the actual operation unit 200 or the remote controller 500 as shown in FIG. When displaying the image of the operation unit on the display screen of the electronic device, the image of the operation unit may be displayed so as to overlap the display image of the electronic device (such as a television image), or the display image of the electronic device and the operation unit The operation image may be displayed semi-transparent (alpha blending function) so that both images can be seen, or the screen may be divided and displayed until the operation is completed. When the operation is completed, the display image of the electronic device may be changed.
Next, in step S2, while watching the operation image displayed on the display screen of the device, the device selection button of the operation unit, that is, the TV / VTR switching button B15 is operated to select television or video. The television and video can be switched to television or video each time the TV / VTR switching button B15 is pressed.

  When the TV of the TV / VTR switching button B15 is depressed, the television control unit 6 or 29 recognizes that the television is switched to the television, reads the television memory 4 or 25, and displays the television operation image on the display screen. To do. FIG. 8A shows a television operation image, and FIG. 8B shows an operation unit. In the operation image for television, buttons necessary for the operation of the television are displayed brightly or in a conspicuous color, and other buttons are displayed in a dim or inconspicuous color. Alternatively, other buttons may be turned off. Buttons necessary for TV operation are numbers 1 to 12, TV power supply, CATV, TV / VTR switching, channel selection +, channel selection-, volume up, volume down, decision, voice switching, mute, screen switching, screen size The menu. It is not necessary to display all these buttons, and the display may be further reduced. In addition to these buttons, buttons necessary for television operation may be displayed.

When a video deck is selected, the video control unit 38 recognizes that the video has been switched, reads the video memory 35, and displays the video operation image on the television display screen via the video output unit 32. To do. FIG. 9A shows a video operation image, and FIG. 9B shows an operation unit. In the video operation image, buttons necessary for video operation are displayed brightly, and other buttons are displayed dimly. Alternatively, other buttons may be turned off. Buttons necessary for video operation are numbers 1 to 12, VTR power, TV / VTR switching, fast forward, rewind, volume up, volume down, enter, voice switch, mute, screen switch, screen size, menu, recording, Play and stop. It is not necessary to display all these buttons, and the display may be further reduced. In addition to these buttons, buttons necessary for video may be displayed.
When switched to video, the television operation image is erased and the video operation image is displayed. When switched to television, the video operation image is erased and the television operation image is displayed.

Next, the user selects an operation mode in step S3. Each time the menu button B22 on the operation unit is pressed, the operation mode is switched between the normal state “with display”, “operation guidance”, and “without display”, and one of these is selected.
When the “no display” mode is selected, it means that it is not necessary to display the operation image. If the operation image is displayed, the operation image is deleted and the process ends. When the operation guidance mode is selected, the process proceeds to step S6 and the operation guidance mode is started. The operation guidance mode will be described later.
If “displayed” is selected, the process proceeds to step S4. In step S4, the contact time measurement unit 18 or 49 of the button analysis unit 12 or 42 measures the output of the button contact detection unit, and determines whether or not the user has touched the button of the operation unit for a predetermined time or more. The certain time is a time when the user is assumed to be confused about the button operation. For example, 0 to 5 seconds are set in advance. Preferably it is 3 seconds or more. If there is no contact for a certain period of time, the process ends.
If it has been in contact for a certain time or longer, the process proceeds to step S5. In step S5, the button analysis unit 12 or 42 determines which of the buttons on the operation unit is in contact. Then, the button that the user is touching is displayed on the display screen of the device so that it can be identified. For example, only the button in contact with the display blinks, the display is brightened, or the color is changed. At this time, the identification display method may be different depending on whether the button in contact with the user is a button that can be used to operate the device or a button that cannot be used. If the button is disabled, the identification display may not be performed.

Details of steps S3 to S5 will be described with reference to the flowchart of FIG.
When display (normal) is selected in step S3, the process proceeds to step S4. In step S4, the button detection unit 11 or 41 detects the contact position of the button and the contact time measurement unit 18 or 49 is 5 seconds or longer. It is determined whether or not they are in contact. If it is less than 5 seconds, the process returns to step S4. If it is determined that the contact has been made for 5 seconds or longer, the position of the button in contact with the button analysis unit 12 or 42 is identified in step S4a, and the button in contact with the display screen of the device is identified and displayed. Next, in step S5, it is determined whether or not the button on the operation unit has been pressed. If the button is not depressed, the process returns to step S4. If the button is pressed, it is determined whether or not the button pressed in step S5a is a screen switching button. If the pressed button is not a screen switching button, the process proceeds to step S5b.

In step S5b, it is determined whether or not the pressed button is an effective button for operating the device. When a button effective for operating the device is pressed, the control unit 6 or 29 of the device processes the button in step S5c, and activates the OSD control unit 5 or 26 to identify and display the operation button. To do. Then, the process returns to step S4. In addition, you may make it progress to step S5e, without returning to step S4. If a button that is not valid for device operation is operated in step S5b, the process proceeds to step S5d, a message indicating that the button cannot be used is displayed, and the process returns to step S4. For example, “the button is not valid” is displayed as an unusable message. Instead of the message display or together with the message display, processing different from the normal processing of the button may be performed. For example, when the playback button, the recording button, or the stop button is operated when switching to a television, the user should operate the button by performing processing different from the original processing in which the sound is changed to sub audio. Make sure it ’s not a button. Or emit a warning sound.
If the screen switching button is pressed in step S5a, the operation image display is erased from the device display screen in step S5e, and the operation image display ends.

(Operation guide)
Next, the case where the operation guidance mode is selected in step S3 and the process proceeds to step S6 in the operation guidance mode will be described with reference to the flowchart of FIG.
First, when the operation guidance mode is entered in step S6 in FIG. 7, the operation guidance memory 19 is read out in the first embodiment, and the operation guidance memory 52 of the remote controller 500 is read out in the second embodiment, and the operation guidance is started in step S11 in FIG. Is done. In the next step S12, the operation guidance large title is displayed on the display screen of the device. As shown in FIG. 6, the operation guidance large title includes “record a TV”, “view a recorded program”, “reserve recording”, and the like. In the case of the television in the first embodiment, in the case of the television in the second embodiment, an operation guidance large title in the case of car navigation is not shown here, but guidance items according to the operation order of the devices can be considered.
When one of the operation guide large titles is selected in step S12, the process proceeds to step S13, and the operation guide title corresponding to the selected operation guide large title is displayed on the display screen of the device. There are nine titles during operation guidance as shown in FIG. When the user selects one desired title from the displayed titles during operation guidance, in the next step S14, a small operation guidance title is displayed on the display screen of the device.
In this example, “Record TV” is selected for the large operation guidance title, “Record TV” is selected for the title in the operation guidance, and “Record TV” is selected for the small operation guidance title. Further explanation will be given. When “Record TV” is selected in step S14, the management code shown in the rightmost column of FIG. 6 is 1-1, and therefore, the selection item whose management code is 1-1 or less is read. The selection item whose management code is 1-1 is the memory contents at the time of executing “record TV” as shown in FIG.

Next, in step S15, the value of the variable n is set to 1. A variable n is a pointer for designating a management code shown in FIG. The memory contents shown in FIG. 12 are incremented by one for each determination button operation, and the memory contents are sequentially displayed. FIG. 12 shows that the last digit of the management code 1-1-1 corresponds to the variable n and is sequentially carried up.
In step S16, the memory contents read from the operation guidance memory shown in FIG. 12 are displayed on the display screen. On the display screen, the target button to be operated is displayed in red, for example, and the button for moving to the next procedure or the button for ending the operation guidance is displayed in blue. Non-buttons are displayed in light gray. In this way, the button to be operated is represented by the color. Note that red, blue, and gray are examples, and any color may be used. Further, the identification display may be made by the size or shape of the button. Next, when the user touches the button, the button analysis unit 12 or 42 detects the touched button position in step S17.

  If the user touches the button to be operated at step S18, the button is identified and displayed on the display screen by flashing red. When the user touches a button for shifting to the next procedure or a button for ending the operation guidance, the button is displayed by blinking blue. In step S19, it is determined whether or not the button is pressed. If the button is not pressed, the process returns to step S17. If the button has been pressed, it is next determined in step S20 whether the pressed button is a decision button. If the determination button is not pressed, the process proceeds to step S21, and it is determined whether or not the pressed button is a screen switching button. If it is not a screen switching button, it is determined in step S22 whether or not the button is an operable button. If it is an operable button, in step S23, the normal control of the button is performed by the device controller, memory, and OSD controller. Processing is performed and the button is displayed, and the process returns to step S17. At this time, a sound such as “ping pong” may be generated. If it is an unusable button, an unusable message is displayed in step S24, and the process returns to step S17. The message is, for example, “The button is not valid”. At the same time, a “boo” sound may be sounded to indicate that it cannot be used.

If the determination button is pressed in step S20, 1 is added to the value of the variable n in the next step S25, and the memory content of the next management code in FIG. 12 is read. It is determined whether or not the read content is the end of all operation procedures (step S26). If it is finished, the process ends here. If it is not finished, the process returns to step S16.
If the screen switching button is pressed in step S21, the display of the operation image is erased in step S27, and the operation guidance ends.
As described above, when the button of the operation unit is pressed down and the processing of the button is performed, after step S5 or the operation guidance mode, step S6, is turned on again (step S7), FIG. As shown in step S8, “XXX mode is selected. Do you want to change it? Is selected, and the operation mode is selected in step S3. When the operation mode is selected, the process proceeds to step S4 or step S6, and so on.

  FIG. 13 is a diagram for explaining an operation image displayed on the display screen in order to explain the operation guidance steps in steps S16 to S20. FIG. 13 is a diagram for explaining the procedure for recording a television program. In step S16 of FIG. 11, the management code 1-1-1 of FIG. 12 is read, and the TV / VTR switching button with the button ID 15 is displayed in red, the decision button with the button ID 18 and the screen switching button with the button ID 28 are displayed in blue. It is controlled as follows. In FIG. 12, the color (red, blue) is described after the button name. Accordingly, as shown in FIG. 13A, the TV / VTR switching button is displayed in red, indicating that the button should be operated now. In the drawing, it is shown by oblique hatching. The decision button is displayed in blue, indicating that it is a button for shifting to the next procedure. In the drawing, vertical and horizontal hatching is shown. Other buttons are dimmed.

  When the user touches the decision button in step S17, the button position is detected by the button analysis unit 12 or 42, and the button is displayed by blinking blue in step S18. In step S19, it is determined whether or not the button has been pressed. If the button has been pressed, the process proceeds to step S20, where it is determined whether or not the pressed button is a determination button. The management code is incremented by one, and the management code 1-1-2 in FIG. 12 is read out. In the next step S26, the content of the read management code 1-1-2 is not the end of all the operation procedures but “select a channel”, so the process returns to step S16. In step S16, control is performed so that the channel selection + button and the channel selection-button are displayed in red, and the determination button and the screen switching button are displayed in blue. Therefore, as shown in FIG. 13B, the channel selection + button and the channel selection-button are displayed in red, and the decision button and the screen switching button are displayed in blue.

Next, when the determination button is touched in step S17, the position is detected, and in step S18, the blue of the determination button is blinked and displayed. Next, in step S19, it is determined whether or not the button is pressed. If the button is pressed, the process proceeds to step S20. If the enter button is pressed, the process proceeds to step S25. In step S25, the management code is incremented by one, and the management code 1-1-3 in FIG. 12 is read.
Since the read contents are not the end of all the operation procedures but “press the record button”, the process returns to step S16 to control the record button to be displayed in red and the enter button and the screen switching button to be displayed in blue. Therefore, as shown in FIG. 13C, the recording button is displayed in red, and the enter button and the screen switching button are displayed in blue.
Further, step S16 to step S20, step S25, and step S26 are repeated. When the management code is incremented by one in step S25 and the management code 1-1-4 in FIG. 12 is read out, the content is “end”, and thus this flow ends.

  As described above, the color of the target button to be operated next can be changed and displayed on the operation image, and the user's button operation can be guided. Therefore, the user can see the operation image, press the button to be operated next, and know how much and in what direction the finger should be moved without looking at the button at hand. In addition, even when the previous button is next to the next button, move your finger in the direction of the next button, and the button between the previous button and the next button When the button is touched, the button is identified and displayed, so that the direction and distance to move the finger are not mistaken. Further, when the button to be operated next is touched, the button is identified and displayed, and the button is pressed after confirming the display, so that the operation is not mistaken.

(Operation image 1)
FIG. 14 is a diagram for explaining the display of the operation image displayed on the display screen of the device when the button is pressed. The button arrangement of the operation unit and the operation image of the device are the same as those shown in FIG. 8, but in FIG. 14, it is further displayed on which button the user puts his hand. That is, in FIG. 14, the operation unit is switched to the television, and the display screen of the device displays the television operation image. When the user is now touching the TV power button of the operation unit, the TV power button of the operation image and the character image indicating the function of the button are displayed blinking. In this way, the display screen displays the TV operation image, while the VTR power button, the record button, the play button, and the stop button related to the operation of the VCR are displayed lightly, and the characters of fast forward and rewind are also lightly displayed. . These buttons and characters are displayed lightly, and if the user's fingertip touches these buttons, the position of the fingertip can be displayed by blinking the button or character. A warning sound may be emitted.
As described above, when the user touches the button on the operation unit, the touched button in the operation image is displayed in a blinking manner, so that the user can know the button position of the operation unit at hand from the operation image of the device, and therefore the operation The operation unit can be operated while viewing the operation image of the device without looking at the buttons on the unit.

(Operation image 2)
FIG. 15 is a diagram for explaining a case where the operation image is enlarged or reduced or moved.
When the “switch screen” button is pressed and then a triangular button indicating a high volume or a low volume is pressed, the OSD control unit enlarges or reduces the operation image. Thereby, the operation image can be made large so that the user can easily see it, or can be made small so as not to hide the display of the device. In enlarging or reducing, when a button with a triangular mark indicating high volume or low volume is kept pressed, the image is continuously enlarged or reduced.
When the display position of the operation image of the device is moved, it can be moved up, down, left and right by simultaneously pressing the “screen switching” button and “Δ”, “▽”, “?”, “?”. Accordingly, the operation image can be operated by moving the operation image to a position that does not interfere with the display of the device.
As described above, since the size and display position of the operation image can be arbitrarily changed, it is possible to prevent the operation image from getting in the way when viewing the display on the display screen of the device.

(Operation image 3)
FIG. 16 enlarges and displays the operation image button when the button is touched, and displays the touched button function. FIG. 16 shows that the TV power button of the operation image is displayed in an enlarged manner because the TV power button of the operation unit has been touched. As described above, since the touching button is enlarged and displayed before the button is pressed down, it is possible to easily confirm the position of the finger on the operation unit, and it is possible to operate without looking at the operation unit at hand. When the button is touched, the button image is displayed, so that the finger position can be confirmed before the button is pressed down.

(Operation image 4)
FIG. 17 is a diagram illustrating a case where a plurality of buttons are touched. When the user's finger touches a plurality of buttons on the operation unit, the button analysis unit 12 or 42 of the operation unit determines the size of the contact area, the height of the contact pressure, the button size, or the importance of each button set in advance. Alternatively, the priority order should be determined and the button with the larger contact area, the higher contact pressure, the larger size, the important button or the higher priority button flashing at high speed will be processed. Is displayed. Buttons having a smaller contact area, a lower contact pressure, a smaller size, an unimportant one, and a lower priority button may be displayed blinking at a low speed so that button processing is not performed.
Further, when the push detection unit outputs a plurality of button detections, the OSD control unit can change the display state of the detected plurality of buttons to notify the simultaneously operated buttons.

In the electronic device of the present invention, when the contact detection unit or the push-down detection unit detects a plurality of buttons, the processing corresponding to the plurality of buttons is performed. Display or processing can be performed. For example, when one button is touched and one button is pressed, normal processing is performed, and when the contact detection unit and the pressing detection unit detect a different number of buttons, processing different from the normal processing is performed. be able to. In other words, when a button is touched and one button is pressed, a confirmation screen is displayed as to which of the touched buttons is pressed, and the “1” button and “2” button are touched. When the two buttons are pressed down, the two-channel split display of 1 channel and 2 channels is performed, or the “input switch” button and the “2” button are touched. When the lowering operation is performed, switching to video 2 input (video display from a second video input unit (not shown)) can be performed. Further, when the number of operated buttons is three, the display may be divided into three screens, or when the number is four, the display may be divided into four screens.
In addition, after the contact detection unit detects the contact of a plurality of buttons, if the depression detection unit detects the depression of any of the buttons, it is assumed that all of the plurality of buttons are depressed. It may be.

It is a block diagram of the portable terminal device with a television. It is a block diagram of a television, video, and remote control. It is a figure explaining the button of a remote control. It is a figure explaining the table of the memory for televisions. It is a figure explaining the table of the memory for videos. It is a figure explaining the table of operation guidance memory. It is a flowchart figure of an electronic device. It is a figure explaining the remote control and the remote control image for television. It is a figure explaining the remote control and the remote control image for video. FIG. 7 is a detailed flowchart of steps S3 to S5 in FIG. It is a flowchart figure of operation guidance mode. It is a figure explaining the table of the operation guidance selection item memory. It is a figure explaining the remote control image at the time of operation guidance mode. It is a figure explaining the relationship between operation of a remote control, and a remote control image. It is a figure explaining the case where a remote control and a remote control image are expanded, reduced, or moved. It is a figure explaining the relationship between operation of a remote control, and a remote control image. It is a figure explaining the case where two or more buttons of a remote control are touched, and a remote control image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Television part 200 Operation part 300 Television 400 Video 500 Remote control 3 Television part display part 4 Television memory 11 Button detection part 12 Button analysis part 16 First detection processing part 17 Second detection processing part 24 Television display part 25 Television use Memory 41 Button detection unit 42 Button analysis unit 43 Remote control unit 45 Button contact detection unit 46 Button press detection unit 47 First detection processing unit 48 of remote control Second detection processing unit 50 of remote control TV memory 51 of remote control 51 Video of remote control Memory 52 Operation guidance memory

Claims (9)

An operation unit including a plurality of operators;
A first detection processing unit for detecting that at least one of the operators is selected;
A second detection processing unit for detecting that at least one of the selected operators is operated;
A display unit for displaying the plurality of controls;
A display processing unit that changes a display of the operation element displayed on the display unit based on an output of the first detection processing unit;
An electronic apparatus comprising: an operation execution unit that executes a process corresponding to the operation element based on an output of the second detection processing unit.   When the first detection processing unit detects that a plurality of operators are selected, the display processing unit changes a display of the operators corresponding to the plurality of selected operators. Item 2. The electronic device according to Item 1.   When the first detection processing unit detects that a plurality of operators are selected, and the second detection processing unit detects that at least one of the selected operators is operated, the operation is executed. The electronic device according to claim 1, wherein the unit executes a process corresponding to the plurality of selected operators. A switching unit for switching processing corresponding to each of the operators;
4. The electronic device according to claim 1, wherein the display processing unit switches display of an operation element displayed on the display unit based on an output of the switching unit. 5. A display change unit for changing the display position or display size of the operation element;
5. The display unit according to claim 1, wherein the display processing unit changes a display position or a display size of an operator displayed on the display unit based on an output of the display change unit. Electronic devices. An operation procedure storage unit for storing an operation procedure of an operator for realizing a desired process;
The said display process part changes the display of the operation element displayed on the display part one by one according to the operation procedure memorize | stored in the said operation procedure memory | storage part, The any one of Claim 1 thru | or 5 characterized by the above-mentioned. Electronic devices. An operation unit having a plurality of operators, a first detection processing unit for detecting that at least one of the operators is selected, and detecting that at least one of the selected operators is operated A remote control device comprising: a second detection processing unit; and a transmission unit that transmits the output of the first detection processing unit and the output of the second detection processing unit;
Based on the output of the receiving unit that receives the transmission signal from the remote control device, the display unit that displays the plurality of controls, and the output of the first detection processing unit, the display of the controls displayed on the display unit An electronic apparatus comprising: a display processing unit to be changed; and an electronic device including an operation execution unit that executes a process corresponding to an operation element based on an output of the second detection processing unit.   An operation unit having a plurality of operators, a first detection processing unit for detecting that at least one of the operators is selected, and detecting that at least one of the selected operators is operated A remote control device comprising: a second detection processing unit; and a transmission unit that transmits the output of the first detection processing unit and the output of the second detection processing unit to an electronic device.   A receiving unit that receives a transmission signal from the remote control device; a display unit that displays a plurality of controls of the remote control device; and a first detection processing unit that outputs when at least one of the controls of the remote control device is selected. Based on the output, the display processing unit that changes the display of the operation element displayed on the display unit and the output of the second detection processing unit that outputs when at least one of the selected operation elements is operated. And an operation execution unit that executes processing corresponding to the operation element.

Images