JP2009220772A - Remote operation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote operation device capable of executing the easily understandable operation without impairing the design even when the number of operational apparatuses is increased. <P>SOLUTION: The remote operation device for receiving the selection of an icon corresponding to an on-vehicle apparatus to be operated from a plurality of icons corresponding to the on-vehicle apparatuses and displayed on a main display unit 1 displays the operational image on the on-vehicle apparatus corresponding to the selected icon on a sub display unit 22. The operation of the on-vehicle apparatus on the operational image displayed on the sub display unit 22 is received by a dial switch 23. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a remote control device that selects a displayed object and executes a process associated with the object.

Patent Document 1 discloses an operation panel in which an operation switch is projected on the back side of a transparent panel surface having a device for detecting the approach or contact of a finger in order to simplify an operation part for operating an air conditioner device, an audio device, and the like. Are listed. The operation panel described in Patent Document 1 projects the corresponding operation switch on the back side of the panel surface only when the operation is possible. Accordingly, since the operation switch is not projected when the operation cannot be performed, the panel surface becomes a surface that does not exist, and a simple design that does not feel the presence of the operation switch is realized.
JP 2005-228563 A

  Incidentally, in recent years, monitors for car navigation devices, air conditioner devices, audio devices, and the like are installed in the vicinity of so-called instrument panels or center consoles. For this reason, as the number of devices to be installed increases, the number of operation switches for each device also increases. As a result, there is a problem that the design around the instrument panel deteriorates and the operation becomes difficult to understand. In order to solve such a problem, even if each operation switch is projected on the panel surface as in Patent Document 1, as the number of operation switches increases, the number of panels and devices to be projected increase. Problems such as securing the installation space for each device are newly generated.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a remote control device capable of easy-to-understand operation without impairing design even when the number of operation devices is increased. There is to do.

  A remote control device according to a first aspect of the present invention is a remote control device that accepts selection of an object corresponding to an in-vehicle device to be operated from a plurality of objects that are associated with the in-vehicle device and displayed on the first display means. A second display unit that displays an image related to the in-vehicle device corresponding to the received object, and an operation reception unit that receives an operation of the in-vehicle device related to the image displayed on the second display unit.

  In the first invention, the remote control device receives the selection of the object displayed on the first display means and associated with the in-vehicle device by the selection receiving means at a position away from the first display means. Then, the remote operation device displays an image relating to the in-vehicle device corresponding to the object for which the selection has been received on the second display means at a remote position, and the operation receiving means performs an operation on the image displayed on the second display means. Accept.

  A remote operation device according to a second invention is the remote operation device according to the first invention, an operation surface having a concave portion or a convex portion, and a position detection means for detecting a position of an object within a predetermined range from the concave portion or the convex portion of the operation surface, The apparatus further comprises selection means for selecting an object based on a plurality of positions detected by the position detection means at different timings.

  In the second aspect of the invention, the remote control device provides a concave portion or a convex portion on the operation surface, and detects the position of an object within a predetermined range from the concave portion or the convex portion. Then, an object is selected based on a plurality of positions detected at different timings.

  According to a third aspect of the present invention, in the remote control device according to the second aspect, the first display means displays an object whose position and / or size can be changed, and is based on the position detected by the position detection means at different timings. The position and / or size of the object is changed.

  In the third invention, the remote control device displays the position and / or size of the object on the first display means so that the position and / or size of the object can be changed, and the position and / or size of the object based on the positions detected at different timings. change.

  A remote control device according to a fourth invention is the remote control device according to any one of the first to third inventions, wherein a plurality of groups obtained by classification based on operation contents of the in-vehicle device are associated with each object. The first display means is configured to display selectable operation contents classified as an object for which selection has been accepted, and further includes selection accepting means for accepting selection of the operation contents displayed on the first display means. The second display means is configured to display an image related to the operation content received by the selection receiving means.

  In the fourth invention, the remote control device displays a plurality of groups obtained by classification based on the operation content of the in-vehicle device in association with each of the objects so that the operation content can be selected. And the image regarding the operation content which received selection is displayed.

  The remote control device according to a fifth aspect of the present invention is the remote control device according to any one of the second to fourth aspects, wherein the position detecting means is configured to detect a contact position when an object contacts the concave portion or the convex portion. It is characterized by.

  In the fifth invention, the remote control device detects a contact position when the object comes into contact with the concave portion or the convex portion. Then, an object is selected based on a plurality of positions detected based on positions detected at different timings.

  The remote control device according to a sixth aspect of the present invention is the remote control device according to any one of the second to fifth aspects, wherein the position detection unit includes an imaging unit that images the concave portion or the convex portion. The present invention is characterized in that an object within a predetermined range of the convex portion is imaged and the position of the object is detected based on the imaging result.

  In a sixth aspect of the invention, the remote control device captures an image of an object along the recess by capturing an image of the recess with an imaging unit, and detects the position of the object based on the imaging result. Then, an object is selected based on a plurality of positions detected at different timings.

  A remote control device according to a seventh invention is the remote control device according to the sixth invention, wherein the imaging means is capable of imaging infrared rays, and the position detecting means further includes an irradiation means for irradiating the infrared rays while dispersing the infrared rays in the recesses. In addition, the present invention is characterized in that a position where infrared rays are blocked by an object is detected from an imaging result obtained by the imaging means.

  In the seventh aspect of the invention, the remote control device irradiates the infrared rays while dispersing the infrared rays in the concave portion, and detects the position where the infrared rays are blocked by the object from the imaging result obtained by the imaging means capable of imaging infrared rays. Then, an object is selected based on a plurality of positions detected at different timings.

  According to the present invention, an object displayed on the first display means and associated with an in-vehicle device can be selected at a distant position. In addition, an image corresponding to the object can be displayed at the selected position. In-vehicle devices are associated with the objects, and even when the in-vehicle devices increase, it is sufficient to increase the number of objects to be displayed, and the design is not impaired. Further, since the operation method is the same, the operation becomes easy to understand.

  Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.

(First embodiment)
First, a first embodiment of the present invention will be described. FIG. 1 is a schematic diagram of the inside of a vehicle on which the operation device of the present embodiment is mounted. The upper part of FIG. 1 shows the front part of the vehicle, and the lower part of FIG. 1 is an enlarged view of an operation panel provided on the front part.

  The operation device is a device for operating a device provided in the vehicle, for example, an audio device such as a car navigation device, an air conditioner, a CD (Compact Disk), and an FM / AM radio, and an in-vehicle device such as a television. The operation device includes a main display unit (first display means) 1 and an operation panel 2.

  FIG. 2 is a schematic diagram for explaining the positional relationship between the main display unit 1 and the operation panel 2. As shown in FIG. 2, the main display unit 1 and the operation panel 2 are provided at positions separated from each other.

  The main display unit 1 is provided on the back side (front window side) of the interior part (hereinafter referred to as the dashboard 100) in front of the front seat under the front window of the vehicle. The main display unit 1 is provided at a position where a driver and a passenger seated in the passenger seat (hereinafter referred to as a user) are visible and cannot be operated because the hand cannot reach when seated. ing. A plurality of icons (objects) are displayed on the main display unit 1. Each icon is associated with the above-described in-vehicle device, and the user can operate each device by selecting the icon with the operation panel 2. For example, the user can perform operations (playback, fast forward, rewind, volume adjustment, etc.) of “CD” by selecting an icon corresponding to “CD”.

  The operation panel 2 is a portion (hereinafter referred to as the center console 101) provided between the driver's seat and the passenger seat, and is provided at a position where the user can operate while seated. The operation panel 2 can perform operations such as selection of icons displayed on the main display unit 1 and switching of display modes. Therefore, the user can operate the main display unit 1 at a position away from the main display unit 1 by the operation panel 2.

  As illustrated in FIG. 1, the operation panel 2 includes an operation pad 21, a sub display unit (second display unit) 22, and a dial switch (operation reception unit) 23. The operation pad 21 is provided on the upper portion of the operation panel 2, and includes a selection unit 21a, a substantially rectangular determination unit 21b having an arc at one end, and a columnar convex portion 21c provided at the approximate center of the selection unit 21a. It is comprised by. The selection unit 21a has a circular shape, and the determination unit 21b is provided below the selection unit 21a so as to protrude downward from the selection unit 21a.

  The selection unit 21a and the determination unit 21b are formed so as to be recessed toward the back side. The convex part 21c is provided in the approximate center of the circular part of the selection part 21a. As a result, a groove (concave portion) that allows the user to trace the finger is formed around the convex portion 21c. Such a groove is provided with a sensor (not shown) that detects the touch of the user's finger so that the icon displayed on the main display unit 1 moves in conjunction with the movement of the finger that the user traces. It has become. Details will be described later.

  The sub display unit 22 is provided below the operation pad 21 and has a donut-shaped display surface. A dial switch 23 capable of rotating 360 degrees is provided at the central portion of the sub display unit 22. Although the display mode of the sub display unit 22 will be described in detail later, when an icon is selected by the operation pad 21, the sub display unit 22 displays an operation image corresponding to the selected icon. For example, when the icon associated with “CD” is selected by the operation pad 21, the sub display unit 22 displays an image corresponding to an operation of reproducing “CD”, an operation of skipping a track, and the like.

  The dial switch 23 is an operation switch for selecting an operation image displayed on the sub display unit 22. The dial switch 23 selects the operation image displayed on the sub display unit 22, that is, the operation image displayed on the outer periphery of the dial switch 23. The dial switch 23 is provided with a mark 23a for grasping the rotational position during rotation. By aligning the mark 23a with the operation image displayed on the sub display unit 22, each operation image is selected. The dial switch 23 is configured to be rotated by a predetermined angle in order to give an operational feeling when rotating.

  FIG. 3 is a block diagram illustrating a configuration of the operating device according to the present embodiment.

  The operation device 10 includes a control unit 3, a memory 4, an input / output unit 5, and an operation unit 6 in addition to the main display unit 1 and the operation panel 2 described above.

  The control unit 3 is a microcomputer having a CPU (Central Processing Unit) that performs arithmetic processing and the like, and controls the main display unit 1 and the operation panel 2 to control the entire operation device 10. The control unit 3 performs arithmetic processing according to various commands and executes processing described later. The memory 4 is a non-volatile memory such as an EPROM (Erasable Programmable ROM), and stores various data and programs necessary for the processing of the control unit 3.

  The main display unit 1 is display-controlled by the control unit 3 and displays a plurality of icons associated with each device included in the vehicle, for example, the car navigation device 11, the audio device 12, the air conditioning device 13, and the like.

  As described above, the operation panel 2 includes the operation pad 21, the sub display unit 22, and the dial switch 23. The operation pad 21 has a sheet-like electrostatic touch sensor (position detecting means) 21S. When the user presses the surface of the operation pad 21, the pressed position (hereinafter referred to as a pressed position). It is comprised so that the electrostatic capacitance of may change. Further, when detecting a change in capacitance, the touch sensor 21S specifies which position of the touch sensor 21S has changed, and acquires position data of the specified position, that is, a pressed position. The acquired position data is output to the control unit 3. The control unit 3 controls the main display unit 1 based on the position data output from the touch sensor 21S, and displays the icons in a variable manner.

  The sub display unit 22 is controlled by the control unit 3 and displays an operation image corresponding to the icon selected by the operation pad 21. The dial switch 23 detects the position of the mark 23 a and outputs it to the control unit 3. The control unit 3 executes processing corresponding to the operation image displayed at the position of the mark 23a based on the position of the mark 23a and the operation image displayed on the sub display unit 22.

  The input / output unit 5 is connected to devices included in the vehicle, the car navigation device 11, the audio device 12, the air conditioner 13, and the like, and inputs and outputs data necessary for controlling various devices. The operation unit 6 includes an operation switch such as a power switch and functions as a user interface between the user and the operation device 10. For example, the operation unit 6 receives a start or stop operation of the operation device 10 by a user operation.

  Next, the display mode and operation method of the operation device will be described.

  4A and 4B are schematic diagrams for explaining the operation method of the operating device according to the present embodiment, in which FIG. 4A shows before the icon selection, and FIG. 4B shows after the icon selection. In FIG. 4, the left diagram is a schematic diagram showing the main display unit 1, and the right diagram is a schematic diagram showing the operation panel 2. Also, the arrows shown in the figure are not actually displayed.

  The main display unit 1 displays a plurality of icons (objects) 39 associated with various devices included in the vehicle. Each icon 39 is circular, and the name of the device associated with each icon is displayed inside the circle. For example, an icon associated with a CD device displays a character “CD” inside the circle, and an icon corresponding to a car navigation device displays a character “Navi” inside the circle. The icons 39 are arranged at substantially equal intervals on the circumference of the ellipse, and the icon 39 located at the approximate center of the screen is larger than the others and displayed gradually smaller along the circumference of the ellipse. Thereby, it can be set as the display mode as if each icon 39 was arrange | positioned in three-dimensional space.

  The user can move the icon 39 displayed on the main display unit 1 by tracing his / her finger along the operation pad 21 of the operation panel 2. For example, each icon 39 moves clockwise on the circumference of the ellipse by tracing the finger of the selection part 21a of the operation pad 21 in the right direction along the convex part 21c. When the icon 39 corresponding to the desired device is located at the approximate center of the screen and the display becomes the largest, the user can select the icon 39 by sliding his / her finger on the determination unit 21b.

  For example, a case where the “CD” icon is selected in FIG. 4 will be described. Since the icon 39 displayed in the forefront of the main display unit 1 is “TV”, the user traces the operation pad 21 with his / her finger, rotates the icon 39, and brings the “CD” icon to the approximate center of the screen. Move. Then, by sliding a finger on the determination unit 21b of the operation pad 21, the selection of the “CD” icon, that is, the operation of the “CD” device can be started.

  As a result, the user can move and select each icon in the same manner as the operation of his / her finger, and can operate without looking at the operation pad 21. Accordingly, it is possible to install the main display unit 1 and the operation panel 2 at positions apart from each other without deteriorating operability, and the limited space of the vehicle can be used effectively.

  When an icon is selected on the main display unit 1, an operation image for operating the CD device is displayed on the sub display unit 22. Specifically, an image for playing and stopping the CD, an image for skipping to the next track, an image for returning to the previous track, and an image for repeat playback are displayed on the sub display unit 22. That is, it is possible to display the operation screen of the device selected on the main display unit 1 at a position away from the user on the operation panel 2 at the user's hand. Then, the user rotates the dial switch 23 and aligns the mark 23a with the operation image corresponding to the desired operation, thereby executing the function. By displaying only a detailed screen of the operation required by the user at hand, an operation that is easy for the user to understand is possible.

  Next, the operation of the controller device will be described. FIG. 5 is a flowchart showing the operation of the controller device. The flowchart of FIG. 5 is executed by the control unit 3 when the operating device is turned on or when the vehicle engine is started.

  The control unit 3 first performs initialization (S1). For example, the control unit 3 performs processing necessary for the initial operation, such as erasing the stored contents of a memory such as a RAM and displaying a startup screen on the main display unit 1. Next, as shown in FIG. 4A, the control unit 3 displays a plurality of icons 39 on the main display unit 1 (S2).

  The control unit 3 detects whether the operation pad 21 detects the user's finger and determines whether the finger is positioned on the selection unit 21a (S3). When the detected finger is positioned on the selection unit 21a (S3: YES), the control unit 3 controls the main display unit 1 in conjunction with the user's finger to display the icon 39 in a variable manner (S4). . Specifically, when the user traces the finger in the right direction, the control unit 3 moves each icon 39 clockwise around the circumference of the ellipse. As a result, the user can operate the icon without looking at the operation panel 2.

  Next, the control unit 3 determines whether or not the user's finger has moved from the selection unit 21a to the determination unit 21b (S5). If it has not moved to the determination part 21b (S5: NO), the control part 3 will continue the process after S3. If it has moved to the determination part 21b (S5: YES), the control part 3 will display an operation image on the sub display part 22 (S6). For example, the control unit 3 detects a device corresponding to the icon 39 that is located at the approximate center of the screen of the main display unit 1 and has the largest display, and displays an operation image corresponding to the detected device on the sub display unit 22. indicate. Thereafter, the control unit 3 moves the process to S7.

  On the other hand, when the user's finger is not positioned on the selection unit 21a in S3 (S3: NO), the control unit 3 determines whether or not an operation image is displayed on the sub display unit 22 (S10). In S3, even when the operation pad 21 detects the user's finger and the finger is positioned on the determination unit 21b, the control unit 3 executes the process of S10.

  When the operation image is not displayed on the sub display unit 22 (S10: NO), the control unit 3 executes the processes after S3. When the operation image is displayed on the sub display unit 22 (S10: YES), the control unit 3 executes the processes after S7.

  In S7, the control unit 3 determines whether or not the dial switch 23 has been operated (S7). When it is not operated (S7: NO), the control part 3 returns a process to S3. When the dial switch 23 is operated (S7: YES), the control unit 3 executes the process selected by the dial switch 23 (S8). Specifically, the control unit 3 acquires the position of the mark 23 a detected by the dial switch 23. And the control part 3 performs the process corresponding to the operation image currently displayed on the position. For example, in FIG. 4, when the mark 23 a is located in an image for playing and stopping a CD, the control unit 3 sends an audio device 12 to the audio device 12 so as to play or stop the CD. Output a signal.

  Thereafter, the control unit 3 determines whether or not the end operation has been received from the operation unit 6 or the operation device is also ended by stopping the engine of the vehicle (S9), and when it is ended (S9: YES). This operation is finished. When not ending (S9: NO), control part 3 continues processing after S3.

  As described above, in the present embodiment, a plurality of devices such as audio devices can be operated by a single operation device. Then, by displaying only the operation screen of the device that the user wants to operate at hand, the operation screen of another device is not displayed, so that the user can easily perform an operation.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. The present embodiment is different from the first embodiment in the display mode of the main display unit 1 and the operation method by the operation panel 2. Only the differences will be described below. In addition, about the same member etc., the code | symbol same as 1st Embodiment is used, and description is abbreviate | omitted.

  6A and 6B are schematic diagrams for explaining the operation method of the operating device according to the present embodiment. FIG. 6A shows a case where a sub icon is displayed, and FIG. 6B shows a case where the sub icon is hidden. Show the case.

  Similar to the first embodiment, the main display unit 1 displays a plurality of icons associated with various devices included in the vehicle (hereinafter referred to as a main icon 40) as if they were arranged in a three-dimensional space. The The user can move the plurality of main icons 40 by tracing a finger along the operation pad 21 of the operation panel 2.

  As shown in FIG. 6A, when the desired main icon 40 is located at the approximate center of the screen (in the figure, the main icon 40 of “air conditioner”) and the display becomes the largest, the user decides The main icon 40 can be selected by sliding a finger on the part 21b. At this time, when the device associated with the selected main icon 40 has a plurality of operations, the sub-icon 41 corresponding to the selected main icon 40 is displayed on the main display unit 1. Each operation of the device is associated with the sub icon 41. For example, the air conditioner can perform operations such as temperature adjustment, air volume adjustment, and wind direction adjustment. For this reason, when the main icon 40 of an air conditioner is selected, a sub icon 41 associated with each operation such as temperature adjustment is displayed on the main display unit 1.

  The sub icon 41 is also displayed as if it was arranged in a three-dimensional space, and the user can move the sub icon 41 by tracing his / her finger along the operation pad 21. When the sub icon 41 is located at the approximate center of the screen and the display becomes the largest, the user can select the sub icon 41 by sliding his / her finger on the determination unit 21b. At this time, an operation image corresponding to the sub icon 41 is displayed on the sub display unit 22.

  As described above, even when the operation on the device is divided into multiple stages, only the image of the operation desired by the user can be displayed on the operation panel 2 at hand. As a result, the operation on each device can be made simple and clear, and there is no need to newly provide a display unit for displaying an image of the operation at each stage.

  When erasing the sub-icon 41, as shown in FIG. 6B, the sub-icon 41 can be erased by sliding the finger from the determination unit 21b to the selection unit 21a, and the finger is traced along the operation pad 21. Thus, the main icon 40 can be moved. That is, since the operation can be canceled in an operation mode opposite to the icon determination operation, an easy-to-understand operation can be provided to the user.

  FIG. 7 is a schematic diagram for explaining a display mode of the sub display unit 22.

  In FIG. 6A, for example, when the temperature adjustment sub-icon 41 is selected, as shown in FIG. 7A, an operation image for selecting the temperature is displayed on the sub-display unit 22. When the wind direction adjustment sub-icon 41 is selected, an operation image for selecting the wind direction is displayed on the sub-display unit 22 as shown in FIG. When the air volume adjustment sub-icon 41 is selected, an operation image for selecting the air volume is displayed on the sub-display unit 22 as shown in FIG. The user can operate each operation image by aligning the mark 23 a of the dial switch 23 with the operation image displayed on the sub display unit 22.

  Next, the operation of the operating device according to the present embodiment will be described. FIG. 8 is a flowchart showing the operation of the controller device.

  The control unit 3 first initializes (S21), and displays a plurality of main icons 40 on the main display unit 1 as shown in FIG. 6B (S22). The control unit 3 determines whether or not the operation pad 21 detects the user's finger and the finger is positioned on the selection unit 21a (S23). When the detected finger is positioned on the selection unit 21a (S23: YES), the control unit 3 controls the main display unit 1 in conjunction with the user's finger to display the main icon 40 in a variable manner (S24). ). Specifically, when the user traces the finger in the right direction, the control unit 3 moves each main icon 40 clockwise around the circumference of the ellipse.

  Next, the control unit 3 determines whether or not the user's finger has moved from the selection unit 21a to the determination unit 21b (S25). If it has not moved to the determination part 21b (S25: NO), the control part 3 will continue the process after S23. If it moves to the determination part 21b (S25: YES), as shown to Fig.6 (a), the some sub icon 41 will be displayed on the main display part 1 (S26).

  The control unit 3 detects whether or not the operation pad 21 detects the user's finger and the finger is positioned on the selection unit 21a (S27). When the detected finger is positioned on the selection unit 21a (S27: YES), the control unit 3 controls the main display unit 1 in conjunction with the finger traced by the user to display the sub-icon 41 in a variable manner (S28). ). Specifically, when the user traces the finger in the right direction, the control unit 3 moves each sub icon 41 clockwise around the circumference of the ellipse.

  The control unit 3 determines whether or not the user's finger has moved from the selection unit 21a to the determination unit 21b (S29). If it has not moved to the determination part 21b (S29: NO), the control part 3 will continue the process after S27. If it has moved to the determination part 21b (S29: YES), the control part 3 will display an operation image on the sub display part 22 (S30). For example, the control unit 3 detects a device associated with the sub-icon 41 that is located at the approximate center at the bottom of the screen of the main display unit 1 and has the largest display, and displays an operation image corresponding to the detected device. Displayed on the sub display unit 22.

  On the other hand, when the user's finger is not positioned on the selection unit 21a in S23 (S23: NO), the control unit 3 determines whether or not an operation image is displayed on the sub display unit 22 (S31). In S23, even when the operation pad 21 detects the user's finger and the finger is positioned on the determination unit 21b, the control unit 3 executes the process of S31.

  When the operation image is not displayed on the sub display unit 22 (S31: NO), the control unit 3 executes the processing after S23. When the operation image is displayed on the sub display unit 22 (S31: YES), the control unit 3 executes the processes after S34.

  In S27, when the detected finger is not positioned on the selection unit 21a (S27: NO), the control unit 3 determines whether the detected finger is positioned on the determination unit 21b and moved from the determination unit 21b to the selection unit 21a. Is determined (S32). When the finger is moved from the determination unit 21b to the selection unit 21a (S32: YES), the control unit 3 erases the sub icon 41 displayed on the main display unit 1 as shown in FIG. S33), the processing after S23 is continued. When the finger has not moved from the determination unit 21b to the selection unit 21a (S32: NO), the control unit 3 continues the processing after S31.

  Next, the control unit 3 determines whether or not the dial switch 23 has been operated (S34). When it is not operated (S34: NO), the control part 3 determines whether the sub icon 41 is displayed on the main display part 1 (S35). When the sub icon 41 is displayed (S35: YES), the control unit 3 continues the processing from S27. When the sub icon 41 is not displayed (S35: NO), the control unit 3 continues the processing from S23.

  When the dial switch 23 is operated (S34: YES), the control unit 3 executes the process selected by the dial switch 23 (S36). Specifically, the control unit 3 acquires the position of the mark 23 a detected by the dial switch 23. And the control part 3 performs the process matched with the icon currently displayed on the position. For example, in FIG. 7A, when the mark 23 a is located at 20 degrees, the control unit 3 sets the air conditioner 13 to 20 degrees from the input / output unit 5 to the air conditioner 13. Output a signal.

  Thereafter, the control unit 3 determines whether or not an end operation has been accepted (S37), and when the end operation has been accepted (S37: YES), this operation ends. When the end operation has not been received (S37: NO), the control unit 3 continues the processes after S35.

  Thus, even when the operation of the device is divided into multiple stages, a desired operation image can be displayed on the operation panel 2 at the user's hand without increasing the display unit.

(Third embodiment)
Next, a third embodiment of the present invention will be described. The present embodiment is different from the first and second embodiments in which the method for detecting the user's finger is to detect the user's finger using the sheet-like electrostatic touch sensor 21S. Only the differences will be described below. In addition, about the same member etc., the code | symbol same as 1st and 2nd embodiment is used, and description is abbreviate | omitted.

  9 and 10 are schematic diagrams for explaining a method of detecting a user's finger on the operation pad 21. FIG. FIG. 11 is a block diagram showing the configuration of the operating device according to the present embodiment.

  The operation device according to the present embodiment further includes an imaging camera (imaging means) 30, and is installed on the ceiling of the vehicle so that at least the operation pad 21 of the operation panel 2 enters the imaging area, as shown in FIG. Yes. The installed imaging camera 30 is a so-called infrared camera capable of infrared imaging. Further, the operating device includes a light emitting diode (irradiating means) 31 and a reflecting material 32 as shown in FIG. The light emitting diode 31 is provided in the vicinity of the operation pad 21, and the reflective material 32 is provided so as to surround a groove formed in the operation pad 21 such as the convex portion 21 c. The light emitting diode 31 may be provided so as to irradiate the operation pad 21 from the lateral side or may be provided from the lower side. Infrared rays irradiated from the light emitting diodes 31 are dispersed by the reflecting material 32, and countless infrared rays exist in the grooves of the operation pad 21.

  The imaging camera 30 images the operation pad 21 and outputs the imaging result to the control unit 3. When the user operates the operation pad 21, infrared rays are blocked by the user's finger. Then, by imaging the operation pad 21 with the imaging camera 30, an imaging result in a state where infrared rays are blocked can be obtained. Thereby, the control part 3 can detect the position of a user's finger | toe from an imaging result.

  As in the first and second embodiments, when the user's finger is detected by the touch sensor 21S, it may not be detected if the user is wearing gloves or the like. Therefore, by detecting the position and movement of the user's finger using the imaging camera 30 and infrared rays, the position relative to the operation pad 21 is possible even when the user is wearing a glove or a ballpoint pen instead of a finger. Can be detected.

  Note that the position of the user's finger may be detected by performing image processing on image data obtained by imaging with the imaging camera 30 without using infrared rays.

  Since the operation device according to the present embodiment is the same as that of the first or second embodiment, the description thereof is omitted.

  As described above, the operation device of the present invention receives selection of a plurality of icons displayed on the main display unit 1 by the operation pad 21 at a position away from the main display unit 1. And the process matched with the icon which received selection is performed. An operation image provided at a distant position and corresponding to the icon for which the operation pad 21 has received selection is displayed on the sub display unit 22, and an operation on the displayed operation image is received by the dial switch 23.

  In the above-described embodiment, the car navigation device 11, the audio device 12, the air conditioner 13, and the like are connected to the operation device, and each device is operated by the operation device. You may make it mount an apparatus. Moreover, the display mode of the main display unit 1 and the sub display unit 22 and the operation method of the operating device are not limited to the display mode of the above-described embodiment, and can be appropriately changed.

  The preferred embodiments of the present invention have been specifically described above, but each configuration, display mode, operation method, operation, and the like can be appropriately changed and are not limited to the above-described embodiments.

It is a schematic diagram inside the vehicle carrying the operating device of 1st Embodiment. It is a schematic diagram for demonstrating the positional relationship of a main display part and an operation panel. It is a block diagram which shows the structure of the operating device which concerns on 1st Embodiment. It is a schematic diagram for demonstrating the operating method of the operating device which concerns on 1st Embodiment, (a) shows before icon selection, (b) has shown after icon selection. It is a flowchart which shows operation | movement of an operating device (1st Embodiment). It is a schematic diagram for demonstrating the operating method of the operating device which concerns on 2nd Embodiment, (a) shows the case where a sub icon is displayed, (b) shows the case where a sub icon is not displayed. It is a schematic diagram for demonstrating the display mode of a sub display part. It is a flowchart which shows operation | movement of an operating device (2nd Embodiment). It is a schematic diagram for demonstrating the detection method of a user's finger | toe in an operation pad. It is a schematic diagram for demonstrating the detection method of a user's finger | toe in an operation pad. It is a block diagram which shows the structure of the operating device which concerns on 3rd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Main display part 2 Operation panel 21 Operation pad 21a Selection part 21b Determination part 21c Convex part 22 Sub display part 23 Dial switch

Claims (7)

In a remote control device that receives selection of an object corresponding to an in-vehicle device to be operated from a plurality of objects that are associated with the in-vehicle device and displayed on the first display means.
Second display means for displaying an image relating to the in-vehicle device corresponding to the selected object;
An operation receiving means for receiving an operation of an in-vehicle device relating to an image displayed on the second display means. An operation surface having a concave portion or a convex portion;
Position detecting means for detecting the position of an object within a predetermined range from the concave portion or convex portion of the operation surface;
The remote control device according to claim 1, further comprising selection means for selecting an object based on a plurality of positions detected by the position detection means at different timings. The first display means includes
Display objects with variable position and / or size,
The remote control device according to claim 2, wherein the position detection unit is configured to change the position and / or size of the object based on positions detected at different timings. A plurality of groups obtained by classification based on the operation content of the in-vehicle device are associated with each object,
The first display means includes
It is configured to display selectable operations that are classified as objects that have been selected,
Selection receiving means for receiving selection of the operation content displayed on the first display means,
The second display means includes
The remote operation device according to any one of claims 1 to 3, wherein the selection receiving unit is configured to display an image related to an operation content received by the selection. The position detecting means includes
The remote control device according to any one of claims 2 to 4, wherein a contact position when an object contacts the concave portion or the convex portion is detected. The position detecting means includes
Having an imaging means for imaging the concave portion or the convex portion,
6. The structure according to claim 2, wherein the imaging means captures an object within a predetermined range of the concave portion or the convex portion, and detects the position of the object based on the imaging result. The remote control device described in 1. The imaging means is capable of infrared imaging,
The position detecting means includes
Irradiation means for irradiating with the infrared rays dispersed in the recess,
The remote control device according to claim 6, wherein a position where infrared rays are blocked by an object is detected from an imaging result obtained by the imaging means.

Images