JP6377307B2 - User interface control device and user interface control method - Google Patents

Description

  The present invention relates to control of a user interface (hereinafter referred to as “UI”), and more particularly to control of a UI (hereinafter referred to as “screen UI”) on a screen of a display device.

  In recent years, operation input devices for electronic devices have been diversified. For example, an operation input device of a television receiver includes a remote controller (so-called “full remote control”) capable of operating almost all the functions of the television receiver, and among the functions of the television receiver. A remote controller (a so-called “simple remote controller”) capable of operating only a part of the functions, a camera for gesture input, a microphone for voice input, or the like is used. In addition, a technique has been developed in which dedicated application software is installed in a portable information terminal such as a smartphone so that the portable information terminal functions as a remote controller (hereinafter referred to as “remote controller”).

  Further, in an electronic apparatus having a plurality of types of operation input devices, when an operation input device used for operation input (hereinafter referred to as “operation input device for operation input”) is changed, a screen UI is displayed in accordance with the change. A technique for switching has been developed (see, for example, Patent Document 1 or Patent Document 2).

  Patent Document 1 discloses a vehicle-mounted navigation device having a touch panel, a remote controller, and a voice input microphone. The in-vehicle navigation device of Patent Document 1 switches the mode of the display screen according to the change when the operation input device for operation input is changed (see the summary of Patent Document 1, FIG. 1 and the like).

  Patent Document 2 discloses an information processing apparatus having a remote controller, a mouse, and a keyboard. When the operation input device for operation input is changed, the information processing device of Patent Literature 2 switches a graphical user interface (Graphical User Interface, GUI) in accordance with the change (summary and diagram of Patent Literature 2). 1 etc.).

JP 2004-252820 A JP 2007-66057 A

  In each of the devices disclosed in Patent Documents 1 and 2, when the operation input device for operation input is changed, the screen UI is switched according to the change. When switching the screen UI, these devices do not have a means for telling the operator the correspondence between the screen before switching and the screen after switching, and there is a problem that it is difficult for the operator to grasp the correspondence. . As a result, for example, when the screen UI is switched, there is a problem in that the operator cannot grasp the current operation state on the screen after switching, which hinders smooth operation.

  The present invention has been made to solve the above-described problems. When switching the screen UI according to the change of the operation input device, the correspondence between the screen before switching and the screen after switching is visually determined. It is an object of the present invention to provide a user interface control device and a user interface control method that can be displayed in an easily understandable manner.

A user interface control device according to the present invention is a user interface control device for an electronic device that can be operated by a plurality of types of operation input devices, and the operation input device for operation input is changed from the first operation input device to the second operation input device. When the user interface on the screen of the display device is changed from the first user interface to the second user interface, and a switching necessity determination unit that determines whether to switch the user interface. The intermediate screen generating unit for generating an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface, and an animation display using the intermediate screen, the screen of the display device is displayed. User who switches from the first screen to the second screen A Heather interface switching unit, the first user interface is a user interface corresponding to the operation method of the first operation input device, the second user interface, the user interface corresponding to the operation method of the second operation input unit In addition, the first user interface is a user interface corresponding to the limitation of the operation content by the first operation input device, and the second user interface is a user corresponding to the limitation of the operation content by the second operation input device. The switching necessity determination unit is an interface, the first user interface setting information indicating the operation method of the first operation input device, the limitation of the operation content by the first operation input device, the operation method of the second operation input device, and Operation contents by the second operation input device It compares the second user interface setting information that indicates a restriction, but determines whether or not to switch the user interface using the result of the comparison.

A user interface control method according to the present invention is a user interface control method for an electronic device that can be operated by a plurality of types of operation input devices, wherein the switching necessity determination unit is configured such that the operation input device for operation input is the first operation input A step of determining whether or not to switch the user interface on the screen of the display device from the first user interface to the second user interface when the device is changed to the second operation input device; A step of generating an intermediate screen between a first screen based on the first user interface and a second screen based on the second user interface when the determination unit determines to switch the user interface; Animation display using More, and a step of switching to a second screen the screen of the display device from the first screen, the first user interface is a user interface corresponding to the operation method of the first operation input device, the second user interface, the 2 is a user interface corresponding to an operation method of the operation input device, the first user interface is further a user interface corresponding to restriction of operation contents by the first operation input device, and the second user interface is further 2 is a user interface corresponding to the restriction of the operation content by the operation input device, and the switching necessity determination unit sets the first user interface setting indicating the operation method of the first operation input device and the restriction of the operation content by the first operation input device. Information and how to operate the second operation input device And the second operation input unit is compared with the second user interface setting information that indicates a limit of the operation content by, those determines whether to switch the user interface using the result of the comparison.

  According to the user interface control device and the user interface control method of the present invention, when the screen UI is switched according to the change of the operation input device, an intermediate screen between the screen before switching and the screen after switching is generated, and the screen is displayed by animation display. Switch. As a result, the correspondence between the screen before switching and the screen after switching can be displayed in a visually easy-to-understand manner.

It is a functional block diagram which shows the principal part of the electronic device which concerns on Embodiment 1 of this invention. It is a hardware block diagram which shows the principal part of the electronic device which concerns on Embodiment 1 of this invention. It is another hardware block diagram which shows the principal part of the electronic device which concerns on Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the electronic device which concerns on Embodiment 1 of this invention. It is explanatory drawing which shows an example of the 1st screen which concerns on Embodiment 1 of this invention. It is explanatory drawing which shows an example of the 2nd screen which concerns on Embodiment 1 of this invention. FIG. 7A is an explanatory diagram showing an example of the first screen according to Embodiment 1 of the present invention. FIG. 7B is an explanatory diagram showing an example of an intermediate screen according to Embodiment 1 of the present invention. FIG. 7C is an explanatory diagram showing an example of a second screen according to Embodiment 1 of the present invention. It is a functional block diagram which shows the principal part of the other electronic device which concerns on Embodiment 1 of this invention. It is explanatory drawing which shows an example of the 1st screen which concerns on Embodiment 2 of this invention. It is explanatory drawing which shows an example of the 2nd screen which concerns on Embodiment 2 of this invention. FIG. 11A is an explanatory diagram showing an example of the first screen according to Embodiment 2 of the present invention. 11B and 11C are explanatory diagrams illustrating an example of an intermediate screen according to Embodiment 2 of the present invention. FIG. 11D is an explanatory diagram showing an example of a second screen according to Embodiment 2 of the present invention. It is a functional block diagram which shows the principal part of the other electronic device which concerns on Embodiment 2 of this invention. It is explanatory drawing which shows an example of the 1st screen which concerns on Embodiment 3 of this invention. It is explanatory drawing which shows an example of the 2nd screen which concerns on Embodiment 3 of this invention. FIG. 15A is an explanatory diagram showing an example of a first screen according to Embodiment 3 of the present invention. FIG. 15B is an explanatory diagram showing an example of an intermediate screen according to Embodiment 3 of the present invention. FIG. 15C is an explanatory diagram showing an example of a second screen according to Embodiment 3 of the present invention. It is a functional block diagram which shows the principal part of the other electronic device which concerns on Embodiment 3 of this invention. It is a functional block diagram which shows the principal part of the other electronic device which concerns on Embodiment 3 of this invention.

  Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.

Embodiment 1 FIG.
FIG. 1 is a functional block diagram showing the main part of the electronic apparatus according to Embodiment 1 of the present invention. FIG. 2 is a hardware configuration diagram showing a main part of the electronic device according to Embodiment 1 of the present invention. FIG. 3 is another hardware configuration diagram showing the main part of the electronic apparatus according to Embodiment 1 of the present invention. With reference to FIGS. 1 to 3, a user interface control apparatus (hereinafter referred to as “UI control apparatus”) 100 according to the first embodiment will be described focusing on an example applied to an electronic apparatus 1 including a television receiver. .

  The first display device 2 is configured by a display such as a liquid crystal display, an organic EL (Electro Luminescence) display, a plasma display, or a cathode ray tube display. The first display device 2 may be provided integrally with the electronic device 1, or may be provided on a separate member from the electronic device 1.

  The full remote control 3 has a plurality of physical keys including direction keys, and accepts an operation input by pressing this physical key. The simple remote controller 4 has at least one physical key and accepts an operation input by pressing this physical key.

  The gesture input device 5 has a camera for photographing an operator of the electronic device 1 (hereinafter simply referred to as “operator”). The gesture input device 5 executes an image recognition process on an image captured by the camera, and receives an operation input by a gesture such as a hand sign or a hand movement.

  The voice input device 6 has a microphone for acquiring voice uttered by the operator. The voice input device 6 performs voice recognition processing on the voice acquired by the microphone and accepts voice operation input.

  The portable information terminal 7 is configured by, for example, a smartphone or a tablet computer. The portable information terminal 7 is installed with dedicated application software, and functions as a remote control for the television receiver.

  That is, the portable information terminal 7 includes the second display control unit 8, the second display device 9, and the touch panel 10. The second display control unit 8 controls the screen of the second display device 9. The second display device 9 is configured by a display such as a liquid crystal display or an organic EL display, and has a lower resolution than the first display device 2. The touch panel 10 is configured integrally with the second display device 9. The portable information terminal 7 receives the operation input to the touch panel 10 in a state where the second display control unit 8 displays a screen corresponding to the function of the remote control on the second display device 9, and thereby the function of the remote control is achieved. To fulfill.

  The full remote control 3, the simple remote control 4, the gesture input device 5, the voice input device 6, and the portable information terminal 7 constitute an operation input device 11. That is, the electronic device 1 shown in FIG. 1 has one each of five types of operation input devices.

  When each operation input device 11 starts to input an operation to the operation input device 11, a signal indicating the operation input device 11 (hereinafter referred to as an “operation start signal”) is transmitted to the electronic device by wireless communication or wired communication. 1 is transmitted. Each operation input device 11 transmits a signal indicating the content of the operation (hereinafter referred to as an “operation content signal”) to the electronic apparatus 1 by wireless communication or wired communication when an operation to the operation input device 11 is input. To do.

  The operation signal receiving unit 21 receives the operation start signal and the operation content signal transmitted from the operation input device 11. The operation signal receiving unit 21 outputs the received operation start signal to the UI control device 100 and outputs the received operation content signal to the first display control unit 22.

  The first display control unit 22 controls the screen of the first display device 2 in accordance with the operation content indicated by the operation content signal input from the operation signal receiving unit 21. Hereinafter, the first display control unit 22 and the second display control unit 8 may be collectively referred to simply as “display control unit”. Further, the first display device 2 and the second display device 9 may be simply referred to as “display device”.

  The user interface setting information storage unit (hereinafter referred to as “UI setting information storage unit”) 23 stores information (hereinafter referred to as “UI setting information”) used for setting the screen UI of the display devices 2 and 9. To do. The UI setting information indicates, for example, the operation method of each operation input device 11, the limitation of the operation content by each operation input device 11, and the display devices 2 and 9 used for the operation of each operation input device 11. It is. These pieces of information are stored for each operation input device 11 in a table-like data structure, for example.

  For example, the operation method of the full remote control 3 uses a plurality of physical keys including direction keys. The full remote controller 3 can perform detailed setting operations using a plurality of physical keys, and can perform detailed direction operations using direction keys. The first display device 2 is used for the operation of the full remote control 3. Therefore, the UI setting information corresponding to the full remote control 3 indicates that the operation method uses a physical key, that there is no restriction on the operation content, and that the first display device 2 is used for the operation. It is.

  The operation method of the gesture input device 5 is based on gesture input. The gesture input device 5 can only perform a rough setting operation by hand sign, and can only perform a rough direction operation by hand movement. The first display device 2 is used for the operation of the gesture input device 5. Therefore, the UI setting information corresponding to the gesture input device 5 is that the operation method is based on gesture input, the operation content is limited to a rough operation, and the first display device 2 is used for the operation. Is shown.

  The operation method of the voice input device 6 is by voice input. The voice input device 6 cannot be used for a direction operation, and cannot be used for an operation that requires a high response speed. The first display device 2 is used for the operation of the voice input device 6. Therefore, the UI setting information corresponding to the voice input device 6 cannot be used for the operation method by voice input, the direction operation and the operation requiring a high response speed, and the first display device 2. Is used for operation.

  The operation method of the portable information terminal 7 uses the touch panel 10 that is configured integrally with the second display device 9. The portable information terminal 7 can perform the same operation as the full remote control 3 using the second display device 9 and the touch panel 10. The second display device 9 is used for the operation of the portable information terminal 7. Therefore, the UI setting information corresponding to the portable information terminal 7 indicates that the operation method is that using the touch panel 10, the operation content is not limited, and the second display device 9 is used for the operation. Is.

  Furthermore, the UI setting information indicates the resolution of each of the display devices 2 and 9 in addition to the above information corresponding to each operation input device 11. The UI setting information may be stored in advance when the electronic device 1 is manufactured or shipped, or may be received from the operation input device 11 after the electronic device 1 is shipped.

  The UI control device 100 determines the operation input device 11 for operation input using the operation start signal input from the operation signal receiving unit 21. The UI control device 100 acquires UI setting information corresponding to the operation input device 11 for operation input and UI setting information indicating the resolution of the display devices 2 and 9 from the UI setting information storage unit 23. is there. The UI control device 100 sets the screen UI of the display devices 2 and 9 using the acquired UI setting information.

  That is, the UI control device 100 sets the screen UI of the first display device 2 when the operation input device 11 for operation input is the full remote control 3, the simple remote control 4, the gesture input device 5, or the voice input device 6. This screen UI includes the operation method of the full remote control 3, the simple remote control 4, the gesture input device 5 or the voice input device 6, the restriction of the operation contents by the full remote control 3, the simple remote control 4, the gesture input device 5 or the voice input device 6, and It is a screen UI corresponding to the resolution of the first display device 2 and the like.

  In addition, when the operation input device 11 for operation input is the portable information terminal 7, the UI control device 100 sets the screen UI of the second display device 9. This screen UI is a screen UI corresponding to the operation method of the portable information terminal 7, the limitation of the operation content by the portable information terminal 7, the resolution of the second display device 9, and the like.

  The first display control unit 22 controls the screen of the first display device 2 based on the screen UI set by the UI control device 100. The second display control unit 8 controls the screen of the second display device 9 based on the screen UI set by the UI control device 100.

  Here, the UI control apparatus 100 includes a change presence / absence determination unit 24, a switching necessity determination unit 25, an intermediate screen generation unit 26, and a user interface switching unit (hereinafter referred to as “UI switching unit”) 27.

  The change presence / absence determination unit 24 uses the operation start signal input from the operation signal reception unit 21 to determine whether or not the operation input device 11 for operation input has been changed. When the operation input device 11 for operation input is changed, the change presence / absence determination unit 24 needs to switch between an operation start signal indicating the operation input device 11 before the change and an operation start signal indicating the operation input device 11 after the change. This is output to the rejection determination unit 25.

  Hereinafter, when the operation input device 11 for operation input is changed, the operation input device 11 before the change is referred to as a “first operation input device”, and the operation input device 11 after the change is a “second operation input device”. That's it.

  When the operation input device 11 for operation input is changed, the switching necessity determination unit 25 uses the operation start signal input from the change presence / absence determination unit 24 to switch the first operation input device and the second operation input device. Judgment. The switching necessity determination unit 25 includes UI setting information corresponding to the first operation input device (hereinafter referred to as “first UI setting information”) and UI setting information corresponding to the second operation input device (hereinafter referred to as “first”. 2 UI setting information ”) from the UI setting information storage unit 23. The switching necessity determination unit 25 determines whether to switch the screen UIs of the display devices 2 and 9 using the first UI setting information and the second UI setting information.

  Specifically, for example, the switching necessity determination unit 25 compares the content of the first UI setting information with the content of the second UI setting information. When the operation method of the first operation input device is different from the operation method of the second operation input device, the switching necessity determination unit 25 limits the operation content by the first operation input device and the operation content by the second operation input device. The display UI is switched, or the display devices 2 and 9 used for the operation of the first operation input device are different from the display devices 2 and 9 used for the operation of the second operation input device. Is determined. When it is determined that the screen UI is to be switched, the switching necessity determination unit 25 outputs the first UI setting information and the second UI setting information to the intermediate screen generation unit 26.

  Hereinafter, when the screen UIs of the display devices 2 and 9 are switched, the screen UI before switching is referred to as “first UI”, and the screen UI after switching is referred to as “second UI”.

  When the switching necessity determination unit 25 determines to switch the screen UI, the intermediate screen generation unit 26 receives the first UI setting information, the second UI setting information, and the UI setting information input from the switching necessity determination unit 25. Using the UI setting information indicating the resolution of the display devices 2 and 9 acquired from the storage unit 23 and the information regarding the screen being displayed acquired from the display control units 8 and 22, a screen based on the first UI (hereinafter referred to as “first” One screen ") and a screen based on the second UI (hereinafter referred to as" second screen ") are generated (hereinafter referred to as" intermediate screen "). The intermediate screen generation unit 26 outputs the generated intermediate screen to the UI switching unit 27.

  That is, when the first operation input device is the full remote control 3, the simple remote control 4, the gesture input device 5, or the voice input device 6, the first display control unit 22 displays the first screen immediately before switching the screen UI. It is a screen displayed on the device 2. In this case, the first UI is a method of operating the full remote controller 3, simple remote controller 4, gesture input device 5 or voice input device 6, and restriction of operation contents by the full remote controller 3, simple remote controller 4, gesture input device 5 or voice input device 6. , And a screen UI corresponding to the resolution of the first display device 2 and the like.

  When the first operation input device is the portable information terminal 7, the first screen is a screen that the second display control unit 8 displays on the second display device 9 immediately before switching the screen UI. In this case, the first UI is a screen UI corresponding to the operation method of the portable information terminal 7, the limitation of the operation content by the portable information terminal 7, the resolution of the second display device 9, and the like.

  When the second operation input device is the full remote control 3, the simple remote control 4, the gesture input device 5, or the voice input device 6, the first display control unit 22 displays the first screen immediately after the screen UI is switched. It is a screen displayed on the apparatus 2. In this case, the second UI is a method of operating the full remote control 3, simple remote control 4, gesture input device 5 or voice input device 6, and restriction of operation contents by the full remote control 3, simple remote control 4, gesture input device 5 or voice input device 6. , And a screen UI corresponding to the resolution of the first display device 2 and the like.

  When the second operation input is the portable information terminal 7, the second screen is a screen that the second display control unit 8 displays on the second display device 9 immediately after switching the screen UI. In this case, the second UI is a screen UI corresponding to the operation method of the portable information terminal 7, the limitation of the operation content by the portable information terminal 7, the resolution of the second display device 9, and the like.

  The intermediate screen is one or more intermediate screens in a so-called “animation display” in which the screens of the display devices 2 and 9 are smoothly switched from the first screen to the second screen.

  That is, when both the first screen and the second screen are screens displayed on the first display device 2, the intermediate screen generation unit 26 generates one or more intermediate screens for the first display device 2. In this case, the intermediate screen for the first display device 2 is an intermediate screen in which the screen of the first display device 2 is smoothly switched from the first screen to the second screen.

  In addition, when the first screen is a screen displayed on the first display device 2 and the second screen is a screen displayed on the second display device 9, the intermediate screen generation unit 26 includes the first display device. One or more intermediate screens for 2 and one or more intermediate screens for the second display device 9 are respectively generated. In this case, the intermediate screen for the first display device 2 is an intermediate screen in which the screen of the first display device 2 smoothly switches from the first screen to another screen (for example, a black screen). The intermediate screen for the second display device 9 is an intermediate screen in which the screen of the second display device 9 is smoothly switched from another screen (for example, a black screen) to the second screen.

  In addition, when the first screen is a screen displayed on the second display device 9 and the second screen is a screen displayed on the first display device 2, the intermediate screen generation unit 26 selects the second display device. One or more intermediate screens for 9 and one or more intermediate screens for the first display device 2 are respectively generated. In this case, the intermediate screen for the second display device 9 is an intermediate screen in which the screen of the second display device 9 is smoothly switched from the first screen to another screen (for example, a black screen). The intermediate screen for the first display device 2 is an intermediate screen in which the screen of the first display device 2 smoothly switches from another screen (for example, a black screen) to the second screen.

  The UI switching unit 27 switches the screens of the display devices 2 and 9 from the first screen to the second screen by animation display using the intermediate screen input from the intermediate screen generation unit 26.

  That is, when both the first screen and the second screen are screens displayed on the first display device 2, the UI switching unit 27 sequentially displays the intermediate screen for the first display device 2 on the first display control unit 22. Output. The UI switching unit 27 instructs the first display control unit 22 to sequentially display the intermediate screen for the first display device 2 on the first display device 2. As a result, the screen of the first display device 2 is switched from the first screen to the second screen by animation display.

  In addition, when the first screen is a screen displayed on the first display device 2 and the second screen is a screen displayed on the second display device 9, the UI switching unit 27 displays the first display device 2. The intermediate screen for the second display device 9 is sequentially output to the first display control unit 22 and the intermediate screen for the second display device 9 is sequentially output to the second display control unit 8. The UI switching unit 27 instructs the first display control unit 22 to sequentially display the intermediate screen for the first display device 2 on the first display device 2, and the second intermediate screen for the second display device 9 is displayed on the second screen. The second display control unit 8 is instructed to sequentially display on the display device 9. As a result, the screen of the first display device 2 is switched from the first screen to another screen by the animation display, and the screen of the second display device 9 is switched from the other screen to the second screen by the animation display.

  In addition, when the first screen is a screen displayed on the second display device 9 and the second screen is a screen displayed on the first display device 2, the UI switching unit 27 displays the second display device 9. The intermediate screen for the first display device 2 is sequentially output to the second display control unit 8, and the intermediate screen for the first display device 2 is sequentially output to the first display control unit 22. The UI switching unit 27 instructs the second display control unit 8 to sequentially display the intermediate screen for the second display device 9 on the second display device 9, and also displays the intermediate screen for the first display device 2 as the first screen. The first display control unit 22 is instructed to sequentially display on the display device 2. As a result, the screen of the second display device 9 is switched from the first screen to another screen by the animation display, and the screen of the first display device 2 is switched from the other screen to the second screen by the animation display.

  The operation signal receiving unit 21, the first display control unit 22, the UI setting information storage unit 23, and the UI control device 100 constitute a main part of the electronic device 1.

  FIG. 2 shows an example of a hardware configuration of a main part of the electronic device 1. The operation signal receiving unit 21 illustrated in FIG. 1 includes a dedicated receiver 41. The UI setting information storage unit 23 illustrated in FIG. 1 includes a memory 42. The memory 42 stores programs for realizing the functions of the display control unit 22, the change presence / absence determination unit 24, the switching necessity determination unit 25, the intermediate screen generation unit 26, and the UI switching unit 27 illustrated in FIG. ing. When the processor 43 reads and executes the program stored in the memory 42, the display control unit 22, the change presence / absence determination unit 24, the switching necessity determination unit 25, the intermediate screen generation unit 26, and the UI switching unit 27 illustrated in FIG. The function is realized.

  The memory 42 is, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), or an EEPROM (Electrically Erasable Programmable Memory). An optical disk or a magneto-optical disk is used. The processor 43 is configured by, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), a microcontroller, or a microprocessor.

  FIG. 3 shows another example of the hardware configuration of the main part of the electronic device 1. The display control unit 22, the change presence / absence determination unit 24, the switching necessity determination unit 25, the intermediate screen generation unit 26 and the UI switching unit 27 illustrated in FIG. 1 are configured by a dedicated processing circuit 44. The processing circuit 44 is, for example, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a system LSI (Large-Scale Integration), or a combination thereof.

  1 may be realized by the processing circuit 44. The display control unit 22, the change presence / absence determination unit 24, the switching necessity determination unit 25, the intermediate screen generation unit 26, and the UI switching unit 27 illustrated in FIG. The functions of the respective units may be collectively realized by the processing circuit 44. Further, some of the functions of the display control unit 22, the change presence / absence determination unit 24, the switching necessity determination unit 25, the intermediate screen generation unit 26, and the UI switching unit 27 illustrated in FIG. 43, and the remaining functions may be realized by the processing circuit 44 shown in FIG.

  Next, with reference to the flowchart of FIG. 4, the operation of the electronic device 1 will be described focusing on the operation of the UI control device 100.

  First, in step ST1, the operation signal receiving unit 21 receives an operation start signal. The operation signal receiving unit 21 outputs the received operation start signal to the UI control device 100.

  Next, in step ST2, the change presence / absence determination unit 24 determines whether or not the operation input device 11 for operation input has been changed using the operation start signal input from the operation signal reception unit 21 in step ST1. .

  Specifically, for example, the change presence / absence determining unit 24 operates the operation start signal input from the operation signal receiving unit 21 in the previous step ST1 and the operation start signal input from the operation signal receiving unit 21 in the previous step ST1. And compare. When the two operation start signals indicate the same operation input device 11, the change presence / absence determination unit 24 determines that the operation input device 11 for operation input has not been changed. On the other hand, when the two operation start signals indicate different operation input devices 11, the change presence / absence determination unit 24 determines that the operation input device 11 for operation input has been changed.

  When the operation input device 11 for operation input is not changed (step ST2 “NO”), the processing of the electronic device 1 returns to step ST1. On the other hand, when the operation input device 11 for operation input is changed (step ST2 “YES”), the change presence / absence determination unit 24 starts an operation start signal indicating the first operation input device and an operation start indicating the second operation input device. The signal is output to the switching necessity determination unit 25.

  Next, in step ST3, the switching necessity determination unit 25 determines the first operation input device and the second operation input device using the operation start signal input from the change presence / absence determination unit 24 in step ST2. The switching necessity determination unit 25 acquires the first UI setting information corresponding to the first operation input device and the second UI setting information corresponding to the second operation input device from the UI setting information storage unit 23.

  Next, in step ST4, the switching necessity determination unit 25 determines whether to switch the screen UI of the display devices 2 and 9 using the first UI setting information and the second UI setting information acquired in step ST3. To do.

  Specifically, for example, the switching necessity determination unit 25 compares the content of the first UI setting information with the content of the second UI setting information. When the operation method of the first operation input device is different from the operation method of the second operation input device, the switching necessity determination unit 25 limits the operation content by the first operation input device and the operation content by the second operation input device. The display UI is switched, or the display devices 2 and 9 used for the operation of the first operation input device are different from the display devices 2 and 9 used for the operation of the second operation input device. Is determined. On the other hand, the operation method of the first operation input device and the operation method of the second operation input device are the same, and the restriction of the operation content by the first operation input device and the restriction of the operation content by the second operation input device are the same. When the display devices 2 and 9 used for the operation of the first operation input device are the same as the display devices 2 and 9 used for the operation of the second operation input device, the switching necessity determination unit 25 displays the screen. It is determined that the UI is not switched.

  When the screen UI is not switched (step ST4 “NO”), the processing of the electronic device 1 returns to step ST1. On the other hand, when the screen UI is switched (step ST4 “YES”), the switching necessity determination unit 25 outputs the first UI setting information and the second UI setting information to the intermediate screen generation unit 26.

  Next, in step ST5, the intermediate screen generating unit 26 acquires various types of information used for generating the intermediate screen. Specifically, for example, the intermediate screen generation unit 26 acquires UI setting information indicating the resolution of the display devices 2 and 9 from the UI setting information storage unit 23. Further, the intermediate screen generation unit 26 acquires information regarding the screen being displayed from the display control units 8 and 22.

  Next, in step ST6, the intermediate screen generation unit 26 uses the first UI setting information and the second UI setting information input from the switching necessity determination unit 25 in step ST4 and the various information acquired in step ST5. Then, an intermediate image between the first screen based on the first UI and the second screen based on the second UI is generated. The intermediate screen generation unit 26 outputs the generated intermediate image to the UI switching unit 27.

  Next, in step ST7, the UI switching unit 27 uses the intermediate screen input from the intermediate screen generation unit 26 in step ST6 to change the screens of the display devices 2 and 9 from the first screen to the second screen by animation display. Switch.

  That is, when both the first screen and the second screen are screens displayed on the first display device 2, the UI switching unit 27 sequentially displays the intermediate screen for the first display device 2 on the first display control unit 22. Output. The UI switching unit 27 instructs the first display control unit 22 to sequentially display the intermediate screen for the first display device 2 on the first display device 2.

  Alternatively, when the first screen is a screen displayed on the first display device 2 and the second screen is a screen displayed on the second display device 9, the UI switching unit 27 is configured to display the first display device 2. Intermediate screens are sequentially output to the first display control unit 22, and intermediate screens for the second display device 9 are sequentially output to the second display control unit 8. The UI switching unit 27 instructs the first display control unit 22 to sequentially display the intermediate screen for the first display device 2 on the first display device 2, and the second intermediate screen for the second display device 9 is displayed on the second screen. The second display control unit 8 is instructed to sequentially display on the display device 9.

  Alternatively, when the first screen is a screen displayed on the second display device 9 and the second screen is a screen displayed on the first display device 2, the UI switching unit 27 is configured to display the second display device 9. Intermediate screens are sequentially output to the second display control unit 8 and intermediate screens for the first display device 2 are sequentially output to the first display control unit 22. The UI switching unit 27 instructs the second display control unit 8 to sequentially display the intermediate screen for the second display device 9 on the second display device 9, and also displays the intermediate screen for the first display device 2 as the first screen. The first display control unit 22 is instructed to sequentially display on the display device 2.

  By the process of step ST7, the screens of the display devices 2 and 9 are switched from the first screen to the second screen by animation display. After step ST7, the first display control unit 22 causes the first display control unit 22 to display a screen based on the second UI, or the second display control unit 8 causes the second display control unit 8 to display a screen based on the second UI. The display process is continuously executed.

  Next, a specific example of animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the gesture input device 5 will be described with reference to FIGS.

  The electronic device 1 is configured by a television receiver integrated with a hard disk recorder, and has a function of recording a received program (so-called “recording function”) and a function of playing back a recorded program (so-called “playback function”). )have. In the playback function, the first display control unit 22 causes the first display device 2 to display a screen for selecting a program to be played back from a plurality of recorded programs.

  In the initial state, the full remote control 3 is set to the operation input device 11 for operation input. As described above, the operation method of the full remote controller 3 uses a plurality of physical keys including direction keys. The full remote controller 3 can perform detailed setting operations using a plurality of physical keys, and can perform detailed direction operations using direction keys. The first display device 2 is used for the operation of the full remote control 3. The screen UI corresponding to these contents is, for example, a screen in which thumbnail images corresponding to each program are arranged in a tile shape so that any one of the thumbnail images can be selected by pressing a direction key.

FIG. 5 shows an example of the first screen based on the screen UI. As shown in FIG. 5, the first screen A ₁ is a screen thumbnail image B corresponding to each program are arranged like tiles. By pressing a direction key provided on the full remote control 3, any one of the plurality of thumbnail images B can be selected. In the example of FIG. 5, a state in which the thumbnail images B _S which is arranged at the center portion of the first screen A ₁ is selected and displayed by other thumbnail image B different colors.

  In contrast, it is assumed that the operation input device 11 for operation input is changed from the full remote control 3 to the gesture input device 5. As described above, the operation method of the gesture input device 5 is based on gesture input. The gesture input device 5 can only perform a rough setting operation by hand sign, and can only perform a rough direction operation by hand movement. The first display device 2 is used for the operation of the gesture input device 5. The screen UI corresponding to these contents is, for example, a screen on which only some thumbnail images of a plurality of thumbnail images arranged in a horizontal row are displayed, depending on the movement of the operator's hand. The thumbnail image can be scrolled in the horizontal direction, and the thumbnail image arranged at the center of the screen is always selected.

FIG. 6 shows an example of the second screen based on the screen UI. As shown in FIG. 6, the second screen A ₂ is a screen for only a part of the thumbnail images B of the plurality of thumbnail images B arranged in a row is displayed. These thumbnail images B can be scrolled horizontally in accordance with the movement of the operator's hand. Of the three thumbnail images B displayed on the second screen A _2, a state in which the thumbnail images B _S which is arranged at the center portion of the second screen A ₂ is always selected.

Figure animation from the first screen A ₁ shown in 5 to the second screen A ₂ shown in FIG. 6, for example, a display that gradually expands the area including the thumbnail image B _S selected. FIG. 7 shows an example of the animation display. Incidentally, FIG. 7, for simplicity of explanation, the intermediate screen generation unit 26 indicates an example of generating only one intermediate screen A _M.

Figure 7A shows a first screen _{A 1} similar to FIG. 5. Intermediate screen A _M shown in FIG. 7B is made of an enlarged area C ₁ including the thumbnail images B _S of the first screen A ₁ shown in FIG. 7A on the entire screen. The second screen A ₂ shown in FIG. 7C is made of an enlarged area C _M including the thumbnail images B _S of the intermediate screen A _M shown in FIG. 7B the entire screen. The area C ₁ is an area having a predetermined size, and the area _CM is an area having the same size as the area C ₁ .

The first screen A ₁ and the second screen A ₂ are both, is a screen for selecting a reproduction object program in reproduction function. That is, the second screen A ₂ is a screen corresponding to the first screen A ₁ same functions as. The first screen A ₁ and the second screen A ₂ is a screen in a state where the same thumbnail image B _S is selected. That is, the second screen A ₂ is a screen corresponding to the same operating conditions as the first screen A _1.

When the screen of the first display device 2 is switched from the first screen A ₁ to the second screen A ₂ by the animation display shown in FIG. 7, the correspondence between the first screen A ₁ and the second screen A ₂ is visually determined. It can be displayed clearly. As a result, the operator can second screen A ₂ is grasped unconsciously that the screen corresponding to the same function and the same operating conditions as the first screen A _1, to continue the smooth operation .

  A specific example of the animation display when the operation input device 11 for operation input is changed from the simple remote controller 4 to the gesture input device 5 is the same as that shown in FIG.

  Further, a specific example of the animation display when the operation input device 11 for operation input is changed from the gesture input device 5 to the full remote controller 3 or the simple remote controller 4 is obtained by reversing the animation display shown in FIG. That is, since it is the same as that which a screen changes in order of FIG. 7C, FIG. 7B, and FIG.

  A specific example of the animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the portable information terminal 7 will be described later in a second embodiment. A specific example of the animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the voice input device 6 will be described later in a third embodiment.

  Further, the first screen is not limited to the examples shown in FIGS. 5 and 7A. The first screen may be a screen corresponding to any function as long as the electronic device 1 has the function. The first screen may be a screen corresponding to any operation state in the function.

  Further, the second screen is not limited to the examples shown in FIGS. 6 and 7C. The second screen may be a screen corresponding to a function different from the first screen. In this case, it is possible to display visually that the second screen is a screen corresponding to a function different from the first screen by animation display. The second screen may be a screen corresponding to an operation state different from the first screen in a screen corresponding to the same function as the first screen. In this case, it is possible to display visually that the second screen is a screen corresponding to an operation state different from the first screen by animation display.

  Further, the operation input device 11 is not limited to the full remote control 3, the simple remote control 4, the gesture input device 5, the voice input device 6, and the portable information terminal 7. The number of operation input devices 11 is not limited to five, and the number of operation input devices 11 of each type is not limited to one.

  For example, the gesture input device 5 may be configured integrally with the portable information terminal 7. The voice input device 6 may be configured integrally with the portable information terminal 7. The voice input device 6 may be integrated with the full remote controller 3 or the simple remote controller 4.

  Further, the operation input device 11 may include a plurality of portable information terminals 7. In this case, the resolution of the second display device 9 provided in each portable information terminal 7 may be different.

  Further, the operation input device 11 may include another electronic device different from the electronic device 1. The other electronic device is configured by, for example, a television receiver, a personal computer, or a computer dedicated to video games. The other electronic device includes a second display control unit 8 and a second display device 9 as with the portable information terminal 7. The second display device 9 provided in the other electronic device may have a higher resolution than the second display device 9 provided in the portable information terminal 7.

  Further, the electronic device 1 is not limited to a television receiver. The UI control device 100 can be applied to any electronic device 1 as long as it can be operated by a plurality of types of operation input devices 11.

  Also, the UI setting information corresponding to each operation input device 11 is used for the operation method of each operation input device 11, the limitation of the operation content by each operation input device 11, and the operation of each operation input device 11. Only a part of the display devices 2 and 9 may be shown.

  For example, when all the operation input devices 11 do not have the second display device 9, the UI setting information corresponding to each operation input device 11 indicates only the operation method of each operation input device 11. Also good. In this case, the first UI is a screen UI corresponding to the operation method of the first operation input device, and the second UI is a screen UI corresponding to the operation method of the second operation input device. The switching necessity determination unit 25 compares the content of the first UI setting information with the content of the second UI setting information, and the operation method of the first operation input device is different from the operation method of the second operation input device. In this case, it is determined that the screen UI is switched.

  Alternatively, when all the operation input devices 11 do not have the second display device 9, the UI setting information corresponding to each operation input device 11 includes the operation method of each operation input device 11 and each operation input device. 11 may only indicate the limitation of the operation content. In this case, the first UI is a screen UI corresponding to the operation method of the first operation input device and the limitation of the operation content by the first operation input device, and the second UI is the operation method of the second operation input device and the second operation input device. 6 is a screen UI corresponding to the restriction of the operation content by. The switching necessity determination unit 25 compares the content of the first UI setting information with the content of the second UI setting information, and the operation method of the first operation input device is different from the operation method of the second operation input device. In the case where the limitation of the operation content by the first operation input device is different from the limitation of the operation content by the second operation input device, it is determined that the screen UI is switched.

  Alternatively, when at least one operation input device 11 includes the second display device 9, the UI setting information corresponding to each operation input device 11 includes the operation method of each operation input device 11 and each operation input device. Only the display devices 2 and 9 used for the operation of 11 may be shown. In this case, the first UI is a screen UI corresponding to the operation method of the first operation input device and the resolution of the display devices 2 and 9 used for the operation of the first operation input device, and the second UI is the operation of the second operation input device. It is screen UI corresponding to the resolution of the display apparatuses 2 and 9 used for operation of a method and a 2nd operation input device. The switching necessity determination unit 25 compares the content of the first UI setting information with the content of the second UI setting information, and the operation method of the first operation input device is different from the operation method of the second operation input device. If the display devices 2 and 9 used for the operation of the first operation input device are different from the display devices 2 and 9 used for the operation of the second operation input device, it is determined that the screen UI is switched.

  Thus, by reducing the content of the UI setting information corresponding to each operation input device 11, the data amount of the UI setting information can be reduced. On the other hand, by increasing the content of the UI setting information corresponding to each operation input device 11, it is possible to set a screen UI that is more suitable for the operation environment of the electronic device 1.

  FIG. 1 shows an example in which the UI control device 100 and the UI setting information storage unit 23 are provided in the electronic device 1. However, the UI control device 100 and the UI setting information storage unit 23 are outside the electronic device 1. It may be provided. Specifically, for example, the UI control device 100 and the UI setting information storage unit 23 may be provided in a server device that can communicate with the electronic device 1 and the portable information terminal 7. In this case, the server apparatus having the UI control apparatus 100 communicates with the electronic device 1 and the portable information terminal 7 as appropriate, so that processing similar to the flowchart shown in FIG. 4 is executed.

  Further, the UI control apparatus 100 may include an attribute detection unit 28 and an operation assisting unit 29 as shown in FIG.

  The attribute detection unit 28 detects the attribute of the operator using the sensor 12 provided in the electronic device 1. The operation assisting unit 29 determines whether or not the operation input device 11 for operation input is set to the gesture input device 5 using the operation start signal input from the operation signal receiving unit 21. When the operation input device 11 for operation input is set to the gesture input device 5, the operation auxiliary unit 29 assists an operation by gesture input according to the attribute of the operator (hereinafter referred to as “operation auxiliary image”). .). The operation assisting unit 29 instructs the first display control unit 22 to display the operation assisting image on the first display device 2.

  Specifically, for example, the sensor 12 is configured by a camera that photographs the operator. The attribute detection unit 28 performs image recognition processing on an image captured by the camera, and detects attributes such as whether the operator is a child or whether the operator is an elderly person. When the operator is a child or an elderly person, for example, the operation assisting unit 29 causes the first display device 2 to display an arrow-shaped operation assisting image indicating a direction that can be operated by a gesture input. The operation auxiliary image is displayed by being superimposed on a screen such as the first screen, the second screen, or the intermediate screen.

  That is, when the operation input device 11 for operation input is changed from the full remote control 3 or the simple remote control 4 to the gesture input device 5, the operation auxiliary unit 29 is displayed on the intermediate screen (FIG. 7B) and the second screen (FIG. 7C). The operation assistance image is displayed by superimposing. Thereafter, the operation assisting unit 29 continues the process of displaying the operation assisting image superimposed on the screen based on the second UI.

  On the other hand, when the operation input device 11 for operation input is changed from the gesture input device 5 to the full remote controller 3 or the simple remote controller 4, the operation auxiliary unit 29 displays an operation auxiliary image superimposed on the screen based on the first UI. Continuing from the processing, the operation auxiliary image is displayed superimposed on the first screen (FIG. 7C) and the intermediate screen (FIG. 7B). Thereafter, when the second screen (FIG. 7A) is displayed on the first display device 2, the operation assisting unit 29 ends the process of displaying the operation assisting image.

  As described above, the UI control apparatus 100 according to the first embodiment is the UI control apparatus 100 for the electronic apparatus 1 that can be operated by a plurality of types of operation input apparatuses 11, and the operation input apparatus 11 for operation input is the first. When the operation input device is changed from the first operation input device to the second operation input device, a switching necessity determination unit 25 for determining whether or not to switch the screen UI of the display devices 2 and 9 from the first UI to the second UI, and a necessity determination for switching. When it is determined by the unit 25 to switch the screen UI, the intermediate screen generating unit 26 that generates an intermediate screen between the first screen based on the first UI and the second screen based on the second UI, and animation display using the intermediate screen And a UI switching unit 27 for switching the screens of the display devices 2 and 9 from the first screen to the second screen. When the screen UI is switched in accordance with the change of the operation input device 11, the correspondence between the first screen and the second screen can be displayed visually and intelligibly from the animation display. As a result, the operator can unintentionally grasp the correspondence between the first screen and the second screen, and can continue the operation smoothly.

  The second screen is a screen corresponding to the same function as the first screen. From the animation display, it is possible to display visually that the second screen is a screen corresponding to the same function as the first screen.

  The second screen is a screen corresponding to the same operation state as the first screen. From the animation display, it is possible to display visually that the second screen is a screen corresponding to the same operation state as the first screen.

  The first UI is a screen UI corresponding to the operation method of the first operation input device, and the second UI is a screen UI corresponding to the operation method of the second operation input device. Thereby, before and after switching the screen UI, an operation environment suitable for the operation method of the operation input device 11 (using a physical button, using gesture input, using voice input, using the touch panel 10 or the like). Can be provided.

  Further, the switching necessity determination unit 25 compares the first UI setting information indicating the operation method of the first operation input device with the second UI setting information indicating the operation method of the second operation input device, and compares the information. Whether or not to switch the screen UI is determined using the result. Thereby, based on the operation method of the operation input apparatus 11, it can be determined whether the screen UI of the display apparatuses 2 and 9 is switched.

  The first UI is a screen UI corresponding to the restriction of the operation content by the first operation input device, and the second UI is a screen UI corresponding to the restriction of the operation content by the second operation input device. Thereby, before and after switching the screen UI, the operation content by the operation input device 11 is limited (there is no restriction, only a rough operation is possible, and the direction operation and the operation requiring a high response rate are used. It is possible to provide an operating environment suitable for such as

  The switching necessity determination unit 25 also includes a first UI setting information indicating an operation method of the first operation input device and a restriction on an operation content by the first operation input device, an operation method of the second operation input device, and a second operation. The second UI setting information indicating the limitation of the operation content by the input device is compared, and it is determined whether or not to switch the screen UI using the result of the comparison. As a result, it is possible to determine whether or not to switch the screen UI of the display devices 2 and 9 based on the operation method of the operation input device 11 and the restriction of the operation content by the operation input device 11.

  The display devices 2 and 9 are configured by a plurality of display devices 2 and 9 having different resolutions, and the first UI corresponds to the resolution of the display devices 2 and 9 used for the operation of the first operation input device. The second UI is a screen UI corresponding to the resolution of the display devices 2 and 9 used for the operation of the second operation input device. Accordingly, it is possible to provide an operation environment suitable for the resolution of the display devices 2 and 9 used for the operation of the operation input device 11 before and after switching the screen UI.

  In addition, the switching necessity determination unit 25 includes an operation method of the first operation input device, first UI setting information indicating the display devices 2 and 9 used for the operation of the first operation input device, and an operation of the second operation input device. The method and the second UI setting information indicating the display devices 2 and 9 used for the operation of the second operation input device are compared, and it is determined whether to switch the screen UI using the result of the comparison. Accordingly, it is possible to determine whether or not to switch the screen UI of the display devices 2 and 9 based on the operation method of the operation input device 11 and the display devices 2 and 9 used for the operation of the operation input device 11.

  The operation method of the second operation input device is based on gesture input. In this case, the correspondence relationship between the first screen and the second screen can be visually and easily displayed by the animation display illustrated in FIG.

  In addition, the UI control device 100 includes an operation assisting unit 29 that displays an operation assisting image that assists an operation by gesture input in a superimposed manner on the intermediate screen and the second screen according to the attribute of the operator. Thereby, for example, when the operator's attribute is a child or an elderly person, it is possible to display an arrow-like operation auxiliary image indicating a direction in which the operator can input and assist the operation by the gesture input.

  The operation method of the first operation input device is based on gesture input. In this case, the correspondence relationship between the first screen and the second screen can be visually and easily displayed by the animation display obtained by reversing the animation display illustrated in FIG. 7 in terms of time.

  In addition, the UI control device 100 includes an operation assisting unit 29 that displays an operation assisting image that assists an operation by gesture input in a superimposed manner on the first screen and the intermediate screen according to the attribute of the operator. Thereby, for example, when the operator's attribute is a child or an elderly person, it is possible to display an arrow-like operation auxiliary image indicating a direction in which the operator can input and assist the operation by the gesture input.

  The user interface control method (hereinafter referred to as “UI control method”) according to the first embodiment is a UI control method for the electronic device 1 that can be operated by a plurality of types of operation input devices 11, and determines whether or not switching is necessary. Whether the unit 25 switches the screen UI of the display devices 2 and 9 from the first UI to the second UI when the operation input device 11 for operation input is changed from the first operation input device to the second operation input device. When the determination step (step ST4) and the intermediate screen generation unit 26 determine that the switching UI is to be switched by the switching necessity determination unit 25, the first screen based on the first UI and the second screen based on the second UI The step of generating the intermediate screen (step ST6), and the UI switching unit 27 changes the screens of the display devices 2 and 9 from the first screen to the second screen by animation display using the intermediate screen. Ri replaced and a step (step ST7). When the screen UI is switched in accordance with the change of the operation input device 11, the correspondence between the first screen and the second screen can be displayed visually and intelligibly from the animation display.

Embodiment 2. FIG.
In the first embodiment, a specific example of the animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the gesture input device 5 has been described with reference to FIGS. In the second embodiment, a specific example of animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the portable information terminal 7 will be described with reference to FIGS. 9 to 11.

  The configurations of the electronic device 1, the first display device 2, and the operation input device 11 are the same as those described in the first embodiment with reference to FIGS. The description is omitted while being used. Moreover, since the operation of the electronic device 1 is the same as that described with reference to FIG. 4 in the first embodiment, the description is omitted while using FIG.

  The electronic device 1 is composed of a television receiver integrated with a hard disk recorder, and has a recording function and a playback function. In the playback function, the first display control unit 22 causes the first display device 2 to display a screen for selecting a program to be played back from a plurality of recorded programs.

In the initial state, the full remote control 3 is set to the operation input device 11 for operation input. FIG. 9 shows an example of the first screen based on the screen UI for the full remote control 3. The first screen A ₁ shown in FIG. 9 are the same screen as the first screen A ₁ shown in FIG. 5, the description thereof is omitted.

  On the other hand, it is assumed that the operation input device 11 for operation input is changed from the full remote control 3 to the portable information terminal 7. As described in the first embodiment, the operation method of the portable information terminal 7 uses the touch panel 10 configured integrally with the second display device 9. The portable information terminal 7 can perform the same operation as the full remote control 3 using the second display device 9 and the touch panel 10. The second display device 9 is used for the operation of the portable information terminal 7. The screen UI corresponding to these contents is one in which any thumbnail image can be freely selected by operating the touch panel 10 on a screen in which thumbnail images corresponding to each program are arranged in a tile shape, for example.

FIG. 10 shows an example of the second screen based on the screen UI. As shown in FIG. 10, the second screen A ₂ is a screen thumbnail image B corresponding to each program it is arranged like tiles. By operating the touch panel 10, any one of the plurality of thumbnail images B can be selected freely. In the example of FIG. 10, a state in which the thumbnail images B _S which is arranged at the center portion of the second screen A ₂ is selected, is displayed in another thumbnail image B with different colors.

Here, the second screen A ₂ shown in FIG. 10 is an enlarged view of a portion of the first screen A ₁ shown in FIG. The enlargement magnification is a value corresponding to the ratio of the resolution of the second display device 9 to the resolution of the first display device 2. Thus, it is possible in the second screen A ₂ are displayed large individual thumbnail images B, preventing selection erroneous operation of the touch panel 10.

Animation display from the first screen A ₁ shown in FIG. 9 to the second screen A ₂ in FIG. 2, for example, the screen of the first display device 2 slides on the second display device 9, then the second display device 9 enlarges a part of the screen displayed.

FIG. 11 shows an example of the animation display. In the initial state, as shown in FIG. 11A, the first display unit 2 are displayed first screen A ₁ is, the screen of the second display device 9 is black.

Next, as shown in FIG. 11B, the intermediate screen A _M1 is displayed on the first display device 2 and the intermediate screen A _M2 is displayed on the second display device 9. Intermediate screen A _M1 of the first display device 2, the first screen A ₁ corresponds to the middle of the screen is slid out towards the paper downward. In the figure, an arrow _{D M1} shows a first sliding direction of the screen _{A 1} in the first display device 2.
The intermediate screen A _M2 of the second display device 9, the first screen A ₁ corresponds to the middle of the screen is slid in from the paper upward. In the figure, an arrow D _M2 shows a first sliding direction of the screen A ₁ in the second display device 9.

Next, as shown in FIG. 11C, the screen of the first display device 2 becomes black, and the intermediate screen _AM3 is displayed on the second display device 9. Intermediate screen A _M3 of the second display device 9 corresponds to the screen in a state where slide-in of the first screen A ₁ is completed.

Then, as shown in FIG. 11D, the second screen _{A 2} is displayed on the second display device 9. The second screen A ₂ is one in which the region C _M including the thumbnail images B _S of the intermediate screen A _M3 becomes enlarged to fill the screen. The magnification of the enlargement is a value corresponding to the resolution ratio of the second display device 9 to the resolution of the first display device 2.

The first screen A ₁ and the second screen A ₂ are both, is a screen for selecting a reproduction object program in reproduction function. That is, the second screen A ₂ is a screen corresponding to the first screen A ₁ same functions as. The first screen A ₁ and the second screen A ₂ is a screen in a state where the same thumbnail image B _S is selected. That is, the second screen A ₂ is a screen corresponding to the same operating conditions as the first screen A _1.

When the screens of the display devices 2 and 9 are switched from the first screen A ₁ to the second screen A ₂ by the animation display shown in FIG. 11, the correspondence between the first screen A ₁ and the second screen A ₂ is visually determined. It can be displayed clearly. As a result, the operator can second screen A ₂ is grasped unconsciously that the screen corresponding to the same function and the same operating conditions as the first screen A _1, to continue the smooth operation .

  In addition, by aligning the slide-out direction in the first display device 2 and the slide-in direction in the second display device 9, it is visually confirmed that the screen of the first display device 2 has moved to the second display device 9. It can be displayed clearly. As a result, it is possible to prevent the operator from misunderstanding that the operation screen has disappeared.

  A specific example of the animation display when the operation input device 11 for operation input is changed from the simple remote controller 4 to the portable information terminal 7 is the same as that shown in FIG.

  Further, a specific example of the animation display when the operation input device 11 for operation input is changed from the portable information terminal 7 to the full remote controller 3 or the simple remote controller 4 is obtained by reversing the animation display shown in FIG. That is, since the screen is similar to the screen transition in the order of FIG. 11D, FIG. 11C, FIG. 11B, and FIG.

  In the first display device 2, the other screen after switching from the first screen or the other screen before switching to the second screen is not limited to the black screen. These other screens may be screens corresponding to other functions of the electronic device 1, for example.

  In the second display device 9, the other screen after switching from the first screen or the other screen before switching to the second screen is not limited to the black screen. These other screens may be screens corresponding to other functions of the portable information terminal 7, for example.

  Further, the sliding direction of the screen in the animation display is not limited to the vertical direction of the paper shown in FIG. The sliding direction may be a fixed direction set in advance, or may be set by the UI control device 100 when executing animation display. A functional block diagram in this case is shown in FIG.

  The position detection unit 30 uses the sensor 12 provided in the electronic device 1 when the portable information terminal 7 is set as the operation input device 11 for operation input, and uses the first display device 2 and the second display device 9. Is detected. Specifically, for example, when the first display device 2 is provided integrally with the electronic device 1, the sensor 12 is configured by a camera that captures an operator who has the portable information terminal 7. When the first display device 2 is provided as a separate member from the electronic device 1, the sensor 12 is configured by a camera that takes an image of the first display device 2 and the operator who holds the portable information terminal 7. The position detection unit 30 executes an image recognition process on the image captured by the camera, and detects the positional relationship between the first display device 2 and the second display device 9.

  The intermediate screen generation unit 26 sets the slide direction in the animation display according to the positional relationship detected by the position detection unit 30. That is, when the operation input device 11 for operation input is changed from the full remote control 3 or the simple remote control 4 to the portable information terminal 7, the intermediate screen generation unit 26 is directed from the first display device 2 to the second display device 9. Set the slide direction to. Thereby, irrespective of the positional relationship between the electronic device 1 and the portable information terminal 7, it can be displayed visually and easily that the screen of the first display device 2 has moved to the second display device 9. As a result, it is possible to prevent the operator from misunderstanding that the operation screen has disappeared.

  On the other hand, when the operation input device 11 for operation input is changed from the portable information terminal 7 to the full remote controller 3 or the simple remote controller 4, the intermediate screen generation unit 26 is directed from the second display device 9 to the first display device 2. Set the slide direction to. Thereby, irrespective of the positional relationship between the electronic device 1 and the portable information terminal 7, it can be displayed visually and easily that the screen of the second display device 9 has moved to the first display device 2. As a result, it is possible to prevent the operator from misunderstanding that the operation screen has disappeared.

  In addition, the electronic device 1 according to the second embodiment can employ various modifications similar to those described in the first embodiment. The UI control apparatus 100 according to the second embodiment can employ various modifications similar to those described in the first embodiment.

  As described above, the display devices 2 and 9 include the first display device 2 provided in the electronic apparatus 1 and the second display device 9 provided in the second operation input device, and the first screen is displayed. Is a screen displayed on the first display device 2, the second screen is a screen displayed on the second display device 9, and the operation method of the second operation input device is integrated with the second display device 9. The touch panel 10 configured as described above is used. When the second operation input device is the portable information terminal 7, the correspondence between the first screen and the second screen can be visually and easily displayed by the animation display illustrated in FIG.

  Further, the intermediate screen generation unit 26 generates an intermediate screen corresponding to the positional relationship between the first display device 2 and the second display device 9. Thereby, the slide direction can be set in the direction from the first display device 2 toward the second display device 9 regardless of the positional relationship between the electronic device 1 and the portable information terminal 7. As a result, the fact that the screen of the first display device 2 has moved to the second display device 9 can be displayed in a visually easy-to-understand manner.

  The display devices 2 and 9 include a first display device 2 provided in the electronic apparatus 1 and a second display device 9 provided in the first operation input device, and the first screen is the second screen. It is a screen displayed on the display device 9, and the second screen is a screen displayed on the first display device 2, and the operation method of the first operation input device is configured integrally with the second display device 9. The touch panel 10 is used. When the first operation input device is the portable information terminal 7, it is easy to visually understand the correspondence between the first screen and the second screen by displaying the animation illustrated in FIG. Can be displayed.

  Further, the intermediate screen generation unit 26 generates an intermediate screen corresponding to the positional relationship between the first display device 2 and the second display device 9. Thereby, irrespective of the positional relationship between the electronic device 1 and the portable information terminal 7, the slide direction can be set in the direction from the second display device 9 toward the first display device 2. As a result, the fact that the screen of the second display device 9 has moved to the first display device 2 can be displayed in a visually easy-to-understand manner.

Embodiment 3 FIG.
In the first embodiment, a specific example of the animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the gesture input device 5 has been described with reference to FIGS. In the third embodiment, a specific example of animation display when the operation input device 11 for operation input is changed from the full remote control 3 to the voice input device 6 will be described with reference to FIGS. 13 to 15.

  The configurations of the electronic device 1, the first display device 2, and the operation input device 11 are the same as those described in the first embodiment with reference to FIGS. The description is omitted while being used. Moreover, since the operation of the electronic device 1 is the same as that described with reference to FIG. 4 in the first embodiment, the description is omitted while using FIG.

  The electronic device 1 is composed of a television receiver integrated with a hard disk recorder, and has a recording function and a playback function. In the playback function, the first display control unit 22 causes the first display device 2 to display a screen for selecting a program to be played back from a plurality of recorded programs.

In the initial state, the full remote control 3 is set to the operation input device 11 for operation input. FIG. 13 shows an example of the first screen based on the screen UI for the full remote control 3. The first screen A ₁ shown in FIG. 13 are the same screen as the first screen A ₁ shown in FIG. 5, the description thereof is omitted.

  In contrast, it is assumed that the operation input device 11 for operation input is changed from the full remote control 3 to the voice input device 6. As described in the first embodiment, the operation method of the voice input device 6 is based on voice input. The voice input device 6 cannot be used for a direction operation, and cannot be used for an operation that requires a high response speed. The first display device 2 is used for the operation of the voice input device 6. The screen UI corresponding to these contents is, for example, any icon by voice input of a program name or the like on a screen in which icon images of a predetermined shape including characters indicating the program name or the like of each program are arranged in a tile shape. The image can be freely selected.

FIG. 14 shows an example of the second screen based on the screen UI. As shown in FIG. 14, the second screen A ₂ is a screen characters indicating a program name of each program (ABC, DEF, ......) icon image E comprising arranged in tiles. One of the plurality of icon images E can be selected by voice input of a program name or the like to the voice input device 6. In the example of FIG. 14, a state in which the second screen icon image E _S disposed in a central portion of the A ₂ is selected, it is displayed in a color different from the other icon image E.

The size and arrangement of the individual icon images E in the second screen A ₂ shown in FIG. 14 is similar to the size and arrangement of the individual thumbnail images B in the first screen A ₁ shown in FIG. 13. Animation display from the first screen A ₁ to the second screen A _2, for example, a display of changing the cross-fading individual thumbnail images B to the corresponding icon image E.

FIG. 15 shows an example of the animation display. Incidentally, FIG. 15, for simplicity of explanation, the intermediate screen generation unit 26 indicates an example of generating only one intermediate screen A _M. Figure 15A shows a first screen _{A 1} similar to FIG. 13. Figure 15C shows a second screen _{A 2} similar to FIG. 14. Figure 15B is first screen _{A 1} and shows an intermediate screen _{A M} between the second screen _{A 2.} The intermediate screen A _M is obtained by making each of the first screen A ₁ and the second screen A ₂ translucent and superimposing them on each other. That is, the animation display shown in FIG. 15 is a first display device 2 of the screen is switched from the first screen A ₁ by the cross-fade on the second screen A _2.

The first screen A ₁ and the second screen A ₂ are both, is a screen for selecting a reproduction object program in reproduction function. That is, the second screen A ₂ is a screen corresponding to the first screen A ₁ same functions as. The first screen A ₁ and the second screen A ₂ is a screen in a state where the thumbnail image B _S or icon image E _S corresponding to the same program is selected. That is, the second screen A ₂ is a screen corresponding to the same operating conditions as the first screen A _1.

When the screen of the first display device 2 is switched from the first screen A ₁ to the second screen A ₂ by the animation display shown in FIG. 15, the correspondence between the first screen A ₁ and the second screen A ₂ is visually determined. It can be displayed clearly. As a result, the operator can second screen A ₂ is grasped unconsciously that the screen corresponding to the same function and the same operating conditions as the first screen A _1, to continue the smooth operation .

  A specific example of the animation display when the operation input device 11 for operation input is changed from the simple remote controller 4 to the voice input device 6 is the same as that shown in FIG.

  Further, a specific example of the animation display when the operation input device 11 for operation input is changed from the voice input device 6 to the full remote controller 3 or the simple remote controller 4 is obtained by reversing the animation display shown in FIG. That is, since the screen transitions in the order of FIG. 15C, FIG. 15B, and FIG. 15A, illustration and description are omitted.

  Further, the UI control apparatus 100 may include an attribute detection unit 28 and a first character form setting unit 31 as shown in FIG.

  The attribute detection unit 28 detects the attribute of the operator using the sensor 12 provided in the electronic device 1. Specific examples of the attribute detection unit 28 and the sensor 12 are the same as those described in the first embodiment with reference to FIG.

  The first character form setting unit 31 uses the operation start signal input from the operation signal receiving unit 21 to determine whether or not the operation input device 11 for operation input is set to the voice input device 6. is there. When the operation input device 11 for operation input is set to the voice input device 6, the first character mode setting unit 31 sets the character display mode in the icon image according to the attribute of the operator. . The first character mode setting unit 31 instructs the first display control unit 22 to display individual icon images on the first display device 2 in the set display mode.

  Specifically, for example, when the operator is a child, the first character form setting unit 31 converts the kanji included in the icon image into hiragana and displays it. Moreover, the 1st character aspect setting part 31 expands and displays the character contained in an icon image, when an operator is elderly people.

  That is, when the operation input device 11 for operation input is changed from the full remote control 3 or the simple remote control 4 to the voice input device 6, when the operator is a child, the first character form setting unit 31 displays the intermediate screen (FIG. 15B) and the kanji of each icon image on the second screen (FIG. 15C) are converted into hiragana and displayed. Thereafter, the first character form setting unit 31 continues the process of converting the kanji of each icon image on the screen based on the second UI into hiragana and displaying it.

  Further, when the operation input device 11 for operation input is changed from the full remote control 3 or the simple remote control 4 to the voice input device 6, when the operator is an elderly person, the first character mode setting unit 31 displays an intermediate screen ( The characters of the individual icon images in FIG. 15B) and the second screen (FIG. 15C) are enlarged and displayed. Thereafter, the first character form setting unit 31 continues the process of enlarging and displaying the characters of the individual icon images on the screen based on the second UI.

  In addition, when the operation input device 11 for operation input is changed from the voice input device 6 to the full remote controller 3 or the simple remote controller 4, when the operator is a child, the first character form setting unit 31 is based on the first UI. Continuing from the process of displaying the kanji of the individual icon images on the screen as hiragana, the kanji of the individual icon images on the first screen (FIG. 15C) and the intermediate screen (FIG. 15B) is converted into hiragana and displayed. Thereafter, when the second screen (FIG. 15A) is displayed on the first display device 2, the first character form setting unit 31 ends the process.

  When the operation input device 11 for operation input is changed from the voice input device 6 to the full remote controller 3 or the simple remote controller 4, if the operator is an elderly person, the first character mode setting unit 31 sets the first UI. Continuing from the process of enlarging and displaying the characters of the individual icon images on the base screen, the characters of the individual icon images on the first screen (FIG. 15C) and the intermediate screen (FIG. 15B) are enlarged and displayed. Thereafter, when the second screen (FIG. 15A) is displayed on the first display device 2, the first character form setting unit 31 ends the process.

  Alternatively, the UI control apparatus 100 may include a distance detection unit 32 and a second character mode setting unit 33 as shown in FIG.

  The distance detection unit 32 detects the distance between the first display device 2 and the operator using the sensor 12 provided in the electronic device 1. Specifically, for example, when the first display device 2 is provided integrally with the electronic device 1, the sensor 12 is configured by a camera that photographs the operator. On the other hand, when the first display device 2 is provided as a separate member from the electronic device 1, the sensor 12 is configured by an operator and a camera that photographs the first display device 2. The distance detection unit 32 performs image recognition processing on the image captured by the camera, and detects the distance between the first display device 2 and the operator.

  The second character mode setting unit 33 determines whether or not the operation input device 11 for operation input is set to the voice input device 6 using the operation start signal input from the operation signal receiving unit 21. is there. When the operation input device 11 for operation input is set to the voice input device 6, the second character mode setting unit 33 displays the character display mode in each icon image according to the distance detected by the distance detection unit 32. Is set.

  Specifically, for example, the second character mode setting unit 33 changes the size of the character according to the distance. That is, when the operation input device 11 for operation input is changed from the full remote controller 3 or the simple remote controller 4 to the voice input device 6, the second character mode setting unit 33 displays the intermediate screen (FIG. 15B) and the second screen (FIG. 15). The character size of each icon image in 15C) is changed according to the distance. Thereafter, the second character mode setting unit 33 changes the character size of each icon image on the screen based on the second UI according to the distance.

  When the operation input device 11 for operation input is changed from the voice input device 6 to the full remote controller 3 or the simple remote controller 4, the second character mode setting unit 33 displays the characters of the individual icon images on the screen based on the first UI. Continuing from the process of changing the size of the icon according to the distance, the size of the characters of the individual icon images on the first screen (FIG. 15C) and the intermediate screen (FIG. 15B) is changed according to the distance. Thereafter, when the second screen (FIG. 15A) is displayed on the first display device 2, the second character form setting unit 33 ends the process.

  When the first character mode setting unit 31 or the second character mode setting unit 33 sets the character display mode in the icon image, the readability of the character can be improved.

  In addition, the electronic device 1 according to the third embodiment can employ various modifications similar to those described in the first embodiment. The UI control apparatus 100 according to the third embodiment can employ various modifications similar to those described in the first embodiment.

  As described above, the operation method of the second operation input device is based on voice input. When the second operation input device is the voice input device 6, the correspondence between the first screen and the second screen can be displayed visually and easily by the animation display illustrated in FIG. 15.

  Further, the intermediate screen and the second screen are screens including character display, and the UI control device 100 includes a first character mode setting unit 31 that sets a character display mode in the character display according to the attribute of the operator. . Thereby, the readability of the characters on the intermediate screen and the second screen can be improved.

  The intermediate screen and the second screen are screens including character display, and the UI control device 100 sets the character display mode in the character display according to the distance between the display device 2 and the operator. A setting unit 33 is provided. Thereby, the readability of the characters on the intermediate screen and the second screen can be improved.

  The operation method of the first operation input device is based on voice input. When the first operation input device is the voice input device 6, the correspondence between the first screen and the second screen can be visually easily understood by displaying the animation illustrated in FIG. Can be displayed.

  In addition, the first screen and the intermediate screen are screens including character display, and the UI control device 100 includes a first character mode setting unit 31 that sets a character display mode in the character display according to the attribute of the operator. . Thereby, the readability of the characters on the first screen and the intermediate screen can be improved.

  In addition, the first screen and the intermediate screen are screens including character display, and the UI control device 100 sets the character display mode in the character display according to the distance between the display device 2 and the operator. A setting unit 33 is provided. Thereby, the readability of the characters on the first screen and the intermediate screen can be improved.

  In the present invention, within the scope of the invention, any combination of the embodiments, or any modification of any component in each embodiment, or omission of any component in each embodiment is possible. .

  The UI control device of the present invention can be used for control of a screen UI in an electronic apparatus having a plurality of types of operation input devices, for example, a television receiver.

  DESCRIPTION OF SYMBOLS 1 Electronic device, 1st display apparatus, 3 Full remote control, 4 Simple remote control, 5 Gesture input device, 6 Voice input device, 7 Personal digital assistant, 8 Second display control part, 9 Second display apparatus, 10 Touch panel, 11 Operation input device, 12 sensors, 21 operation signal receiving unit, 22 first display control unit, 23 UI setting information storage unit, 24 change presence / absence determination unit, 25 switching necessity determination unit, 26 intermediate screen generation unit, 27 UI switching Unit, 28 attribute detection unit, 29 operation assist unit, 30 position detection unit, 31 first character mode setting unit, 32 distance detection unit, 33 second character mode setting unit, 41 receiver, 42 memory, 43 processor, 44 processing Circuit, 100 UI controller.

Claims (13)

A user interface control device for an electronic device that can be operated by a plurality of types of operation input devices,
When the operation input device for operation input is changed from the first operation input device to the second operation input device, it is determined whether or not the user interface on the screen of the display device is switched from the first user interface to the second user interface. A switching necessity determination unit to perform,
An intermediate screen generation unit that generates an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface when the switching necessity determination unit determines to switch the user interface. When,
A user interface switching unit that switches the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
With
The first user interface is the user interface corresponding to an operation method of the first operation input device;
The second user interface is the user interface corresponding to an operation method of the second operation input device;
The first user interface is the user interface corresponding to the limitation of the operation content by the first operation input device,
The second user interface is the user interface corresponding to the limitation of the operation content by the second operation input device,
The switching necessity determination unit includes an operation method of the first operation input device, first user interface setting information indicating restriction of operation contents by the first operation input device, an operation method of the second operation input device, and compares the second user interface setting information that indicates a limit of the operation content according to the second operation input device, you and judging whether to switch the user interface using the result of the comparison Yu over Heather interface controller. A user interface control device for an electronic device that can be operated by a plurality of types of operation input devices,
When the operation input device for operation input is changed from the first operation input device to the second operation input device, it is determined whether or not the user interface on the screen of the display device is switched from the first user interface to the second user interface. A switching necessity determination unit to perform,
An intermediate screen generation unit that generates an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface when the switching necessity determination unit determines to switch the user interface. When,
A user interface switching unit that switches the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
With
The first user interface is the user interface corresponding to an operation method of the first operation input device;
The second user interface is the user interface corresponding to an operation method of the second operation input device;
The display device is composed of a plurality of the display devices having different resolutions,
The first user interface is the user interface corresponding to the resolution of the display device used for operation of the first operation input device;
The second user interface is the user interface corresponding to the resolution of the display device used for operating the second operation input device;
The switching necessity determination unit includes an operation method of the first operation input device, first user interface setting information indicating the display device used for the operation of the first operation input device, and the second operation input device. The operation method and the second user interface setting information indicating the display device used for the operation of the second operation input device are compared, and it is determined whether or not the user interface is switched using the comparison result. features and to Ruyu over-user interface controller that. A user interface control device for an electronic device that can be operated by a plurality of types of operation input devices,
When the operation input device for operation input is changed from the first operation input device to the second operation input device, it is determined whether or not the user interface on the screen of the display device is switched from the first user interface to the second user interface. A switching necessity determination unit to perform,
An intermediate screen generation unit that generates an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface when the switching necessity determination unit determines to switch the user interface. When,
A user interface switching unit that switches the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
With
The first user interface is the user interface corresponding to an operation method of the first operation input device;
The second user interface is the user interface corresponding to an operation method of the second operation input device;
The display device is composed of a plurality of the display devices having different resolutions,
The first user interface is the user interface corresponding to the resolution of the display device used for operation of the first operation input device;
The second user interface is the user interface corresponding to the resolution of the display device used for operating the second operation input device;
The plurality of display devices are a first display device provided in the electronic device and a second display device provided in the second operation input device,
The first screen is a screen displayed on the first display device, and the second screen is a screen displayed on the second display device;
The operation method of the second operation input device uses a touch panel configured integrally with the second display device,
It said intermediate screen generation unit, the first display device and the second display device and the positional relationship the intermediate screen features and to Ruyu over-user interface controller to generate a corresponding to the. 4. The user interface control device according to claim 1, wherein the second screen is a screen corresponding to the same function as the first screen. 5. The user interface control device according to claim 4 , wherein the second screen is a screen corresponding to the same operation state as the first screen. 3. The user interface control device according to claim 1, wherein the operation method of the second operation input device is based on gesture input. The user according to claim 6, further comprising an operation assisting unit that displays an operation assisting image for assisting an operation by the gesture input on the intermediate screen and the second screen according to an attribute of the operator. Interface controller. The user interface control device according to any one of claims 1 to 5, wherein the operation method of the second operation input device is by voice input. The intermediate screen and the second screen are screens including character display,
The user interface control device according to claim 8 , further comprising a first character mode setting unit that sets a character display mode in the character display according to an attribute of the operator. The intermediate screen and the second screen are screens including character display,
The user interface control device according to claim 8 , further comprising a second character mode setting unit that sets a character display mode in the character display according to a distance between the display device and an operator.   A user interface control method for an electronic device that can be operated by a plurality of types of operation input devices,
  When the operation input device for operation input is changed from the first operation input device to the second operation input device, the switching necessity determination unit changes the user interface on the screen of the display device from the first user interface to the second user interface. Determining whether to switch to,
  When the intermediate screen generation unit determines that the user interface is to be switched by the switching necessity determination unit, an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface is displayed. Generating step;
  The user interface switching unit switching the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
  With
  The first user interface is the user interface corresponding to an operation method of the first operation input device;
  The second user interface is the user interface corresponding to an operation method of the second operation input device;
  The first user interface is the user interface corresponding to the limitation of the operation content by the first operation input device,
  The second user interface is the user interface corresponding to the limitation of the operation content by the second operation input device,
  The switching necessity determination unit includes an operation method of the first operation input device, first user interface setting information indicating a restriction on an operation content by the first operation input device, an operation method of the second operation input device, and A user who compares the second user interface setting information indicating the limitation of the operation content by the second operation input device and determines whether or not to switch the user interface using the result of the comparison Interface control method.   A user interface control method for an electronic device that can be operated by a plurality of types of operation input devices,
  When the operation input device for operation input is changed from the first operation input device to the second operation input device, the switching necessity determination unit changes the user interface on the screen of the display device from the first user interface to the second user interface. Determining whether to switch to,
  When the intermediate screen generation unit determines that the user interface is to be switched by the switching necessity determination unit, an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface is displayed. Generating step;
  The user interface switching unit switching the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
  With
  The first user interface is the user interface corresponding to an operation method of the first operation input device;
  The second user interface is the user interface corresponding to an operation method of the second operation input device;
  The display device is composed of a plurality of the display devices having different resolutions,
  The first user interface is the user interface corresponding to the resolution of the display device used for operation of the first operation input device;
  The second user interface is the user interface corresponding to the resolution of the display device used for operating the second operation input device;
  The switching necessity determination unit includes an operation method of the first operation input device, first user interface setting information indicating the display device used for the operation of the first operation input device, and the second operation input device. The operation method and the second user interface setting information indicating the display device used for the operation of the second operation input device are compared, and it is determined whether or not the user interface is switched using the comparison result. A user interface control method characterized by the above.   A user interface control method for an electronic device that can be operated by a plurality of types of operation input devices,
  When the operation input device for operation input is changed from the first operation input device to the second operation input device, the switching necessity determination unit changes the user interface on the screen of the display device from the first user interface to the second user interface. Determining whether to switch to,
  When the intermediate screen generation unit determines that the user interface is to be switched by the switching necessity determination unit, an intermediate screen between the first screen based on the first user interface and the second screen based on the second user interface is displayed. Generating step;
  The user interface switching unit switching the screen of the display device from the first screen to the second screen by an animation display using the intermediate screen;
  With
  The first user interface is the user interface corresponding to an operation method of the first operation input device;
  The second user interface is the user interface corresponding to an operation method of the second operation input device;
  The display device is composed of a plurality of the display devices having different resolutions,
  The first user interface is the user interface corresponding to the resolution of the display device used for operation of the first operation input device;
  The second user interface is the user interface corresponding to the resolution of the display device used for operating the second operation input device;
  The plurality of display devices are a first display device provided in the electronic device and a second display device provided in the second operation input device,
  The first screen is a screen displayed on the first display device, and the second screen is a screen displayed on the second display device;
  The operation method of the second operation input device uses a touch panel configured integrally with the second display device,
  The user interface control method, wherein the intermediate screen generation unit generates the intermediate screen according to a positional relationship between the first display device and the second display device.

Images