WO2024004132A1 - Dispositif de fonctionnement, et procédé de commande et programme de commande associés - Google Patents

Dispositif de fonctionnement, et procédé de commande et programme de commande associés Download PDF

Info

Publication number
WO2024004132A1
WO2024004132A1 PCT/JP2022/026207 JP2022026207W WO2024004132A1 WO 2024004132 A1 WO2024004132 A1 WO 2024004132A1 JP 2022026207 W JP2022026207 W JP 2022026207W WO 2024004132 A1 WO2024004132 A1 WO 2024004132A1
Authority
WO
WIPO (PCT)
Prior art keywords
capacitance
area
push switch
physical
physical operation
Prior art date
Application number
PCT/JP2022/026207
Other languages
English (en)
Japanese (ja)
Inventor
則夫 五島
英一郎 鬼頭
尚 永井
拓 青山
Original Assignee
株式会社レスターエレクトロニクス
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社レスターエレクトロニクス filed Critical 株式会社レスターエレクトロニクス
Priority to PCT/JP2022/026207 priority Critical patent/WO2024004132A1/fr
Priority to JP2022540975A priority patent/JP7161083B1/ja
Priority to JP2022164982A priority patent/JP2024006867A/ja
Publication of WO2024004132A1 publication Critical patent/WO2024004132A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0362—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to an operation device, its control method, and control program.
  • Patent Document 1 discloses a technology in which a mechanical actuator such as a switch, dial, or slider is placed on a touch sensing device to configure an input control device.
  • a mechanical actuator such as a switch, dial, or slider
  • Non-contact touch sensing using capacitance has also been suggested.
  • An object of the present invention is to provide a technology that solves the above problems.
  • the device includes: A display panel that has an operation detection function and an image display function using changes in capacitance; a physical operation unit that is attached to the surface of the display panel and whose position and/or orientation change at least one of the user's operations; a control unit that detects a change in at least one of the position and orientation of the physical operation unit using a capacitance value;
  • An operation device comprising: The operation device is an operation device that detects a change in the capacitance with different capacitance sensitivities in a first area on the display panel where the physical operation unit is attached and a second area other than the first area.
  • the method according to the present invention includes: A display panel that has an operation detection function and an image display function using changes in capacitance; a physical operation unit that is attached to the surface of the display panel and whose position and/or orientation change at least one of the user's operations; a control unit that detects a change in at least one of the position and orientation of the physical operation unit using a capacitance value;
  • a method for controlling an operation device comprising: a first detection step of detecting a change in the capacitance with a first capacitance sensitivity in a first area on the display panel where the physical operation unit is attached; a second detection step of detecting a change in the capacitance with a second capacitance sensitivity different from the first capacitance sensitivity in a second region other than the first region; This is a method of controlling an operation device including.
  • the program according to the present invention A display panel that has an operation detection function and an image display function using changes in capacitance; a physical operation unit that is attached to the surface of the display panel and whose position and/or orientation change at least one of the user's operations; a control unit that detects a change in at least one of the position and orientation of the physical operation unit using a capacitance value;
  • a control program for an operation device comprising: a first detection step of detecting a change in the capacitance with a first capacitance sensitivity in a first area on the display panel where the physical operation unit is attached; a second detection step of detecting a change in the capacitance with a second capacitance sensitivity different from the first capacitance sensitivity in a second region other than the first region;
  • a display panel to which a physical operation unit is attached can be effectively controlled.
  • FIG. 1 is a block diagram showing the configuration of an operation device according to the first embodiment.
  • FIG. 2 is a block diagram showing the configuration of an operation device according to a second embodiment.
  • FIG. 7 is a diagram illustrating different capacitance sensitivities between a region of a physical operation section and a region outside the physical operation section according to the second embodiment.
  • FIG. 7 is a diagram illustrating a dial in a region of a physical operation unit according to a second embodiment.
  • FIG. 7 is a diagram showing the configuration of an area database according to a second embodiment.
  • FIG. 7 is a diagram showing the configuration of a physical operation unit database according to a second embodiment.
  • FIG. 2 is a block diagram showing a hardware configuration of a control unit according to a second embodiment.
  • FIG. 7 is a flowchart showing a processing procedure of a control unit according to a second embodiment.
  • 7 is a flowchart showing the procedure of panel setting processing according to the second embodiment.
  • 7 is a flowchart showing the procedure of input determination processing according to the second embodiment.
  • 7 is a flowchart showing a procedure of operation instruction/display processing according to the second embodiment. It is a figure explaining contact and pushing of a push switch concerning a 3rd embodiment. It is a figure explaining contact and pushing of a push switch concerning a 3rd embodiment.
  • FIG. 7 is a diagram illustrating a slider in a region of a physical operation unit according to a third embodiment.
  • FIG. 7 is a diagram illustrating a rocker switch in a region of a physical operation unit according to a third embodiment.
  • FIG. 7 is a diagram showing the configuration of an area database according to a third embodiment.
  • FIG. 7 is a diagram showing the configuration of a physical operation unit database according to a third embodiment.
  • 12 is a flowchart showing the procedure of panel setting processing according to a third embodiment.
  • 12 is a flowchart illustrating a procedure of input determination processing according to a third embodiment.
  • 12 is a flowchart showing the procedure of operation instruction/display processing according to the third embodiment. It is a figure explaining approach, contact, and pushing of a push switch concerning a 4th embodiment. It is a figure explaining approach, contact, and pushing of a push switch concerning a 4th embodiment. It is a figure showing the composition of the field database concerning a 4th embodiment.
  • FIG. 1 is a diagram showing the configuration of an area database according to a third embodiment.
  • FIG. 7 is a diagram showing the configuration of a physical operation unit database according to a third embodiment.
  • 12 is a flowchart showing the procedure of panel setting processing according to
  • FIG. 7 is a diagram showing the configuration of a physical operation unit database according to a fourth embodiment.
  • 12 is a flowchart illustrating the steps of input determination processing and operation instruction/display processing according to the fourth embodiment.
  • FIG. 7 is a diagram illustrating an operation during calibration of an operation device according to a fifth embodiment. It is a figure showing the composition of the area database concerning a 5th embodiment.
  • 13 is a flowchart showing the procedure of panel setting processing according to the fifth embodiment.
  • 12 is a flowchart illustrating a procedure for calibration processing for areas other than the physical operation unit according to the fifth embodiment.
  • 12 is a flowchart illustrating a procedure for calibrating an area of a physical operation unit according to a fifth embodiment.
  • FIG. 7 is a block diagram showing a system configuration using an operation device according to a sixth embodiment.
  • FIG. 7 is a diagram showing the configuration of a physical operation unit database for use in multiple fields according to a sixth embodiment.
  • FIG. 12 is a diagram showing a system configuration in which an operation device according to a sixth embodiment is mounted on a car.
  • FIG. 7 is a diagram showing a system configuration in which an operation device according to a sixth embodiment is used in the medical field.
  • FIG. 7 is a diagram showing a system configuration in which an operation device according to a sixth embodiment is embedded in a wall.
  • the operation device 100 is a device through which a user performs operation input.
  • the operation device 100 includes a display panel 101, a physical operation section 102, and a control section 103.
  • the display panel 101 has an operation detection function and an image display function using changes in capacitance.
  • the physical operation unit 102 is attached to the surface of the display panel 101, and at least one of its position and orientation changes according to a user's operation.
  • the control unit 103 detects a change in at least one of the position and orientation of the physical operation unit 102 using the capacitance value. Then, the change in capacitance is detected with different capacitance sensitivities in a first region 111 to which the physical operation unit 102 is attached and a second region 112 other than the first region 111 on the display panel 101. .
  • FIG. 2 is a block diagram showing the functional configuration of the operation device 200 according to this embodiment.
  • the operation device 200 according to this embodiment includes a display panel 210, a dial 250 and a push switch 260 as a physical operation unit attached to the surface of the display panel 210, and a control unit 220.
  • the control unit 220 controls a threshold value for converting a change in capacitance in the display panel 210 into an on/off digital signal and/or an amplification degree of the detected capacitance according to an area on the display panel 210. do. Specifically, various user operations are recognized using different threshold values and/or amplification degrees in different regions.
  • the area on the display panel 210 includes a dial area where the dial 250 is attached, a push switch area where the push switch 260 is attached, and a touch area (an area where no physical operation unit is provided). It can be divided into three types.
  • the capacitance sensitivity in the dial area is lower than the capacitance sensitivity in the push switch area.
  • the capacitive sensitivity of the touch area is even lower than that of the dial area. That is, in the touch area, a touch operation by a user can be detected with high accuracy by detecting a change in a predetermined capacitance. In the dial area, smaller changes in capacitance can be detected than in the touch area, making it possible to accurately detect dial operations.
  • the dial may be a rotary knob with a push switch in the center, and in that case, the capacitance sensitivity may be made equal between the dial area and the push switch area.
  • the display panel 210 has a surface cover 211, a dielectric layer 213 for detecting the value of capacitance, and an LCE layer (or LED layer) 214 for display.
  • Physical operation section 212 includes a push switch and a dial. Note that the physical operation section 212 may include a slider.
  • the control unit 220 determines the operation input by the user's finger based on the potential detected from the dielectric layer 213, instructs the execution of the operation according to the operation input, and transmits the operation details and operation results to the LCE layer 214 of the display panel 210. to be displayed.
  • the control unit 220 includes an area database 221, a physical operation unit database 222, a determination area separation unit 223, a physical operation area operation determination unit 224, an operation outside the physical operation area determination unit 225, an operation instruction unit 226, and a display An instruction section 227 is provided.
  • the area database 221 stores information about areas on the display panel 210 where physical operation units are attached and areas where physical operation units are not attached.
  • the physical operation unit database 222 stores operation details corresponding to the position of the physical operation unit in the area. Note that the area database 221 and the physical operation unit database 222 may be stored in advance, or may be stored based on user settings from the setting unit 230. Further, the area database 221 and the physical operation unit database 222 may store information together, rather than separately.
  • the determination area separation unit 223 acquires the current detected from the dielectric layer 213 together with the XY coordinates of the display panel 210, and determines whether the physical operation unit is attached or not attached based on information from the area database 221. or separate.
  • the physical operation area operation determination section 224 detects an operation on the physical operation section based on information from the physical operation section database 222.
  • the physical operation area outside operation determination unit 225 detects an operation outside the physical operation area.
  • the change in capacitance from the dielectric layer 213 may be detected by the control section 220, or the control section 220 may acquire output data from a detection section separate from the control section 220.
  • the operation instruction unit 226 instructs the operation execution unit 240 to execute the operation according to the determination results of the physical operation area operation determination unit 224 and the physical operation area outside operation determination unit 225.
  • the display instruction unit 227 instructs the LCE layer 214 to display the operation according to the determination results of the physical operation area operation determination unit 224 and the physical operation area outside operation determination unit 225, or to display the operation result.
  • FIG. 3A is a diagram illustrating the difference in capacitance sensitivity between an area with a physical operation unit and an area without a physical operation unit.
  • the control unit 220 selects at least one of the amplification degree and the threshold related to the sensitivity of the capacitance used in the physical operation unit area to which the physical operation unit is attached, and the amplification degree and threshold value used in the area outside the physical operation unit area. At least one of the amplification degree and the threshold value used in the region is adjusted to a different value.
  • the sensitivity of the dial area is less than or equal to the sensitivity of the push switch area and higher than the sensitivity of the touch area.
  • FIG. 3A shows capacitance detection results 311 in the push switch area, capacitance detection results 321 in the dial area, and areas where there is no physical operation unit (that is, an area that directly touches the display panel, an area outside the physical operation area).
  • the detection results 331 of the capacitance also referred to as 331) are shown.
  • Push switch 260, dial 250, and panel surface 211 differ in the position of the user's finger (distance and height from the dielectric) during operation.
  • the capacitance detection result is, conversely, Push switch area detection result 311 ⁇ Dial area detection result 321 ⁇ The detection result 331 is outside the physical operation unit area.
  • the degree of amplification of the detected capacitance is set so that the push switch area ⁇ dial area>outside the physical operation unit area.
  • the correspondence between the operation position after amplification and the output corresponding to the capacitance is a graph 313 for the push switch position, a graph 323 for the dial position, and a graph 332 for the area outside the physical operation area (outside the area for the physical operation area is (no amplification).
  • the threshold value for the push switch area (Sh1a), the threshold value for the dial area (Sh1b), and the threshold value outside the physical operation area (Sh2) are such that the presence or absence of operation can be accurately determined from the output after amplification, and , it is desirable to set it to a value that is less affected by noise.
  • the threshold value (Sh1a), the threshold value (Sh1b), and the threshold value (Sh2) may be the same.
  • the threshold value for determining whether there is a user operation is Push switch area threshold (Sh1a) ⁇ Dial area threshold (Sh1b) ⁇ Threshold outside the physical operation area (Sh2) is set to In other words, capacitance sensitivity, as opposed to threshold, Sensitivity of the push switch area>sensitivity of the dial area>sensitivity outside the physical operation area.
  • the combination of amplification degree and threshold value for each region is set according to the position of the user's finger during operation. For example, it is desirable to set the sensitivity of the push switch area ⁇ the sensitivity of the dial area>the sensitivity outside the physical operation unit area.
  • FIG. 3B is a diagram illustrating the operation of the dial 250.
  • the dial 250 includes a non-dielectric dial base portion 351 fixed to the panel surface 211 of the display panel 210 and a non-dielectric dial upper portion 352 rotatably disposed on the dial base portion 351.
  • the positions of the two peaks (above the threshold) corresponding to the approach of the finger change, as shown in the detection result 321 shown on the right side.
  • the amount of operation of the dial 250 is detected from the rotation angle. Note that the operation speed may be detected from the peak rotation speed.
  • FIG. 4A is a diagram showing the configuration of the area database 221 according to this embodiment.
  • the area database 221 includes a determination area separation unit 223 and a physical operation area operation determination unit 224 in order to detect user operations with different capacitance sensitivities in areas where the physical operation unit is attached and areas where the physical operation unit is not attached.
  • the amplification degree and threshold value used by the physical operation area operation determination unit 225 are stored.
  • the area database 221 stores operation types 412 in association with areas 411.
  • push switches and dials are stored as operation types 412 in the physical operation area.
  • a set of amplification degree 413 and threshold value 414 that provide different capacitance sensitivities is stored.
  • the amplification degree 413 is, for example, "2.0" in a push switch region where the output corresponding to a change in capacitance is small, and "1.5” in a digital region where the output corresponding to a change in capacitance is medium.
  • "1.0" is stored outside the physical operation area where the output corresponding to the change in capacitance is large.
  • the threshold value 414 stores a threshold value Th1a for push switch determination, a threshold value Th1b for dial determination, and a threshold value Th2 for determination outside the physical operation area.
  • Th1a for push switch determination
  • Th1b for dial determination
  • Th2 for determination outside the physical operation area.
  • the threshold value Th1a ⁇ threshold value Th1b ⁇ threshold value Th2.
  • FIG. 4B is a diagram showing the configuration of the physical operation unit database 222 according to this embodiment.
  • the area database 221 is used by the physical operation area operation determination unit 224 to determine the type of physical operation (push switch or dial) attached to the physical operation unit based on the position where a change in capacitance is detected. memorize the information that is displayed. Note that in FIG. 4B, the last alphabetical character listed for each physical operation type is added to distinguish cases where the same physical operation type has different corresponding processing contents. The same applies to the subsequent physical operation unit database.
  • the physical operation unit database 222 stores physical operation types 422 in association with areas 421.
  • push switches and dials are stored as physical operation types 422.
  • This information 424, processing contents 425 corresponding to the physical operation type 422 and position information 432, and device operation contents 426 are stored.
  • the device operation content 426 is information indicating what operation the connected device performs when each physical operation section is operated.
  • FIG. 5 is a block diagram showing the hardware configuration of the control unit 220 according to this embodiment. Note that FIG. 5 also shows the display panel 210, setting section 230, and operation execution section 240. Note that in FIG. 5, the same reference numerals are given to the same components as in FIG. 2, and redundant explanation will be omitted.
  • a CPU (Central Processing Unit) 510 is a processor for arithmetic control, and realizes the functional components of FIG. 5 by executing a program. There may be one or more CPUs 510.
  • a ROM (Read Only Memory) 520 stores fixed data and programs such as initial data and programs.
  • a RAM (Random Access Memory) 540 is a random access memory that the CPU 510 uses as a temporary storage work area.
  • the RAM 540 has an area reserved for storing data necessary to implement this embodiment.
  • the capacitance acquisition information 541 is information regarding capacitance acquired from the dielectric layer (capacitance detection section) 213 of the display panel 210 and includes the XY coordinates on the display panel 210.
  • the physical operation area parameters 542 are parameters used in the area where the physical operation section is attached, and include the area coordinates of the physical operation area, the amplification degree and the threshold value to be used.
  • the physical operation determination result 543 is a determination result determined using a threshold value within the physical operation area.
  • the physical operation instruction/display data 544 is data instructing a physical operation corresponding to the physical operation determination result 543 determined based on a threshold within the physical operation area, and corresponding display data.
  • the parameters for outside the physical operation area 545 are parameters used in an area to which no physical operation unit is attached, and include area coordinates other than the physical operation area, an amplification degree, and a threshold value to be used.
  • the non-physical operation determination result 546 is a determination result determined using a threshold value outside the physical operation area.
  • the non-physical operation instruction/display data 544 is data instructing a physical operation corresponding to the non-physical operation determination result 546 determined by a threshold value outside the physical operation area, and the corresponding display data.
  • the storage 550 stores a database and various parameters used by the CPU 510, as well as the following data or programs necessary to realize this embodiment.
  • the area database 221 stores data having the configuration shown in FIG. 4A.
  • the physical operation unit database 222 stores data having the configuration shown in FIG. 4B.
  • the operation device control program 551 is a program that controls the entire operation device 200.
  • the panel setting module 552 is a module for setting the operation area on the display panel 210.
  • the input determination module 553 is a module that determines the user's operational input on the display panel 210.
  • the operation instruction/display module 554 is a module that instructs the execution of an operation corresponding to the determined user operation input and controls the display of the operation or the display of the execution result.
  • the input/output interface 560 interfaces the control unit 220 with external devices and peripheral devices.
  • the setting unit 230 and the operation execution unit 240 (which may be located in another device) are connected.
  • the display panel interface 570 connects the control section 220 to the capacitance detection section (dielectric layer) 213 and display section (LCE layer or LED layer) 214 of the display panel 210.
  • FIG. 6 is a flowchart showing the processing procedure of the control unit 220 according to this embodiment. This flowchart is executed by the CPU 510 in FIG. 5 using the RAM 540, and implements the components of the control unit 220 in FIG.
  • step S601 the control unit 220 executes panel setting processing to set the operation area on the display panel 210.
  • step S603 the control unit 220 executes an input determination process to determine the user's operation input on the display panel 210.
  • step S605 the control unit 220 instructs the execution of the operation corresponding to the determined user operation input, and executes an operation instruction/display process to control the display of the operation or the display of the execution result.
  • FIG. 7A is a flowchart showing the procedure of panel setting processing S601 according to this embodiment.
  • step S711 the control unit 220 obtains and sets (memorizes) the area arrangement on the display panel 210.
  • the control unit 220 acquires the area (XY coordinates) other than the physical operation unit on the display panel 210 and stores it together with the amplification degree and the threshold value. Note that if existing processing is used in areas other than the physical operation section, the amplification degree may not be provided.
  • the control unit 220 acquires the position (XY coordinates) and operation type of the physical operation unit on the display panel 210 and stores them together with the amplification degree and the threshold value.
  • FIG. 7B is a flowchart showing the procedure of input determination processing S603 according to this embodiment.
  • step S721 the control unit 220 acquires the capacitance at each position (XY coordinates) on the display panel 210.
  • step S723 the control unit 220 waits to determine whether a change in capacitance has occurred. If a change in capacitance has occurred, the control unit 220 determines in step S724 whether the location where the change in capacitance has occurred is in the area of the physical operation unit. If it is determined that it is within the area of the physical operation unit, the control unit 220 determines in step S725 whether the position where the change in capacitance has occurred is in the area of the push switch or the area of the dial. If it is in the push switch region, the control unit 220 amplifies the output corresponding to the change in capacitance in step S726.
  • step S728 the control unit 220 determines whether the change in capacitance is greater than or equal to the threshold Th1a. If the change in capacitance is less than the threshold Th1a, the control unit 220 determines that "there is no physical operation by the user" in step S732. On the other hand, if the change in capacitance is equal to or greater than the threshold Th1a, the control unit 220 determines in step S729 that there is a physical operation by the user, and stores the operation execution instruction and operation display instruction corresponding to the push switch position. .
  • step S725 If the determination in step S725 is in the dial area, the control unit 220 amplifies the output corresponding to the change in capacitance in step S727. Then, in step S730, the control unit 220 determines whether the change in capacitance is equal to or greater than a threshold Th1b (Th2>Th1b>Th1a if there is no amplification). If the change in capacitance is less than the threshold Th1b, the control unit 220 determines in step S732 that there is no physical operation by the user.
  • Th1b Th2>Th1b>Th1a if there is no amplification
  • the control unit 220 determines in step S731 that there is a physical operation by the user, and stores the operation execution instruction and operation display instruction corresponding to the dial rotation angle. .
  • step S725 If it is determined in step S725 that the area is outside the area of the physical operation unit, the control unit 220 determines in step S733 whether the change in capacitance is greater than or equal to the threshold Th2 (if there is no amplification, Th2>Th1b>Th1a). Determine. If the change in capacitance is less than the threshold Th2, the control unit 220 determines in step S737 that “there is no operation by the user outside the physical operation unit area”. On the other hand, if the change in capacitance is equal to or greater than the threshold Th2, the control unit 220 determines in step S735 that "the user has performed an operation outside the physical operation unit area" and stores the determination position along with the determination position.
  • Th2 if there is no amplification, Th2>Th1b>Th1a.
  • FIG. 7C is a flowchart showing the procedure of operation instruction/display processing S605 according to this embodiment.
  • step S751 the control unit 220 determines whether the operation area is an area of the physical operation unit or an area other than the physical operation unit based on the determination result in the input determination process S603. If it is determined that the area is a physical operation unit area, the control unit 220 determines in step S752 whether it is a push switch position or a dial area using the determination result stored in input determination process S603. If it is in the push switch area, the control unit 220, in step S753, acquires the operating position from the determination result stored in input determination processing S603. Then, in step S755, the control unit 220 issues an execution instruction and a display instruction for the operation corresponding to the operation position.
  • step S757 acquires the operating position and rotation angle from the determination result stored in input determination processing S603. Then, an instruction to perform the operation and an instruction to display the operation corresponding to the operation position and rotation angle are given.
  • step S751 If it is determined in step S751 that the area is a region other than the physical operation unit, the control unit 220, in step S781, acquires the operation position from the determination result stored in input determination processing S603. Then, an instruction to perform an operation corresponding to the operation position and an instruction to display are issued.
  • the operation device differs from the second embodiment in that it has two levels of operation input in the same physical operation section (push switch) and includes a slider as the physical operation section.
  • a contact state in which the surface of the push switch is contacted and a depressed state in which the push switch is pushed in are distinguished by capacitance.
  • the user's finger slides over multiple push switches, and the user's finger slides while pressing multiple push switches. Make it work as a slider.
  • the other configurations and operations are the same as those in the second embodiment, so the same configurations and operations are given the same reference numerals and detailed explanation thereof will be omitted.
  • FIGS. 8A and 8B are diagrams illustrating contact and depression of the push switch according to this embodiment.
  • a contact state in which the surface of the push switch is contacted and a depressed state in which the push switch is pushed in are distinguished based on the difference in detected capacitance.
  • FIG. 8A the same reference numerals are attached to the same components as in FIG. 3A, and redundant explanation will be omitted.
  • FIG. 8A shows the capacitance detection result 311 when a finger touches a push switch in the push switch area of the physical operation unit area, which corresponds to a user operation, and the capacitance when the push switch is pressed. Detection results 811 are shown.
  • the distance from the surface of the dielectric layer 213 is the distance at the time of contact with the push switch>the distance at the time of pressing the push switch, and conversely, the detection output is the distance at the time of contact with the push switch. Output ⁇ Output when push switch is pressed.
  • the threshold value 813 for determining the operation level of the user operation from the amplified output to the push switch is as follows: Threshold for touching the push switch (Sh1a) ⁇ Threshold for pressing the push switch (Sh1c) It is set so that In other words, the capacitance sensitivity between contact and depression of a push switch is opposite to the threshold value. The sensitivity of touching the push switch is greater than the sensitivity of pressing the push switch.
  • FIG. 8B is a diagram illustrating operation determination with the horizontal axis representing the change in capacitance due to contact and depression of the push switch, and the vertical axis representing the output from the dielectric layer 213 corresponding to the change in capacitance. . Note that in FIG. 8B, the broken line is the output before amplification, and the solid line is the output after amplification with an amplification degree of 2.0.
  • a threshold (Sh1a) is set at the output level at which the point 821 where the user's finger touches the push switch is determined.
  • the threshold value (Sh1c) is set at the output level at which the point 822 at which the user's finger presses the push switch is determined. Below the threshold (Sh1a) is the range that is recognized as non-contact, above the threshold (Sh1a) and below the threshold (Sh1c) is the range that is recognized as contact, and above the threshold (Sh1c) is the range that is recognized as pushing. It is.
  • FIG. 8C is a diagram illustrating sliders 831 to 833 in the area of the physical operation unit according to the present embodiment.
  • the slider 831 has a plurality of transparent push switches.
  • the switch When a user's finger slides on a plurality of transparent push switches, the switch as a whole functions as a slider. Further, since this push switch is of a transmission type (transparent material), it is possible to visually check the display screen of the display panel 210.
  • a state in which the user's finger simply touches and slides on the multiple transparent push switches, and a state in which the user's finger slides while pressing the multiple transparent push switches in order are determined in different steps.
  • the parameters may be changed continuously. Alternatively, the volume of audio playback, etc. may be controlled by sliding a finger while touching a plurality of transparent push switches and detecting the slider amount. Furthermore, by pressing a transparent push switch, a value corresponding to the detected slider amount can be set or determined.
  • the slider 832 functions as a slider when the user's finger slides on one transparent bar without contacting or in contact with it, and the display screen of the display panel 210 becomes transparent.
  • a value corresponding to the slider amount is set or determined, and further processing related to the slider is performed. Execute.
  • the slider 833 is a slider configured to slide an acrylic slider having an acrylic button on a rubber hinge, and allows the display screen of the display panel 210 to be directly viewed. Also in the slider 833, when the finger leaves the acrylic slider or when the acrylic slider stops at the same position for a predetermined time or more, a value corresponding to the slider amount is set or determined, and further processing related to the slider is performed. Execute.
  • FIG. 8D is a diagram illustrating a rocker switch in the area of the physical operation unit according to the present embodiment.
  • the sensitivity is set to be able to detect a change in capacitance when the operation button surface is pressed with a finger and moved from a position far away to a position close to the display panel.
  • the capacitance threshold is the capacitance when the finger on the operation button surface is located at a far distance from the display panel, and the capacitance when the finger on the operation button surface is pressed with a finger and the finger is at a position close to the display panel.
  • the capacitance is set midway between the case and the capacitance.
  • the top surface 841 of the rocker switch in FIG. 8D shows the ON and OFF setting operations of the rocker switch.
  • Rocker switch cross section 842 in FIG. 8D is a side view of the rocker switch, with the rubber binge sandwiched between the acrylic button that the finger contacts and the cover lens of the capacitive touch sensor.
  • the rubber binge is compressed and the finger approaches the capacitive touch sensor.
  • a detection signal is input to a hard or soft flip-flop (not shown), and is stored corresponding to the pressed position of the rocker switch ON/OFF.
  • Capacitance detection 843 in FIG. 8D shows the relationship between the threshold value Sh1f for detecting ON/OFF of the rocker switch and the capacitance output. Note that the threshold value Sh1f can be adjusted depending on the size and shape of the rocker switch, and the existing rocker switch can be used as is.
  • FIG. 9A is a diagram showing the configuration of the area database 921 according to this embodiment.
  • the area database 921 is replaced with the area database 221 in FIG. 2 in this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 4A, and redundant explanation will be omitted.
  • the area database 921 stores a plurality of operation levels 913 and amplification degrees 914 corresponding to the type of physical operation unit, especially each push switch. Then, different threshold values 915 are stored corresponding to each operation level 913.
  • a threshold value (TH1c: Th1c>Th1a) for determining a push operation is stored separately from a threshold value (Th1a) for determining a contact operation.
  • Th1a threshold value for determining a contact operation.
  • Th1f between contact and depression is stored in the rocker switch.
  • a threshold value Th1f between contact and depression is stored.
  • a threshold value Th1a or Th1b or other appropriate threshold value is stored depending on the distance from the surface of the dielectric layer of the sliding finger.
  • the slider 831 in FIG. 8C stores a threshold value Th1a for contacting the push switch and a threshold value Th1c for pressing the push switch.
  • FIG. 9B is a diagram showing the configuration of the physical operation unit database 922 according to this embodiment.
  • the physical operation unit database 922 is replaced with the physical operation unit database 222 in FIG. 2 in this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 4B, and overlapping explanation will be omitted.
  • the physical operation unit database 922 stores a plurality of operation levels 925 for each operation type, particularly for each push switch. Then, different corresponding processing contents 926 are stored corresponding to each operation level.
  • the corresponding process content 926 stores selection or notification of a process in response to a touch, and stores setting (determine and execute) a process in response to a push operation. Further, in the case of a rocker switch, corresponding processing content 926 is turned ON or OFF in accordance with the position changed from contact to depression in operation level 925.
  • the physical operation unit database 922 is a rotary knob with a push switch in the center, and stores the push switch inside the dial when operating the dial.
  • the corresponding process content 926 corresponds to the rotation angle of the dial to the input numerical value, and the push switch in the input dial to the setting of the input numerical value and execution using it.
  • contact and push are stored as the operation level 925, and a setting value (movement amount) and setting (execution) are stored in the corresponding processing details 926.
  • device operation details 927 are stored that indicate what operations the connected devices perform when each of the physical operation units is operated.
  • the combinations of physical operation types 422 and the plurality of operation levels 925 are not limited to those shown in FIG. 9B, and various combinations can be realized.
  • Control unit processing procedure> The processing procedure of the control unit 220 is the same as the flowchart shown in FIG. 6, so redundant explanation will be omitted.
  • FIG. 10A is a flowchart illustrating the procedure of panel setting processing S601 according to the present embodiment, which is replaced with FIG. 7A. Note that in FIG. 10A, steps similar to those in FIG. 7A are given the same step numbers, and redundant explanation will be omitted.
  • step S1015 the control unit 220 acquires the position (XY coordinates) of the physical operation unit on the display panel and the operation type, and stores them together with the amplification degree corresponding to the operation type and the threshold value corresponding to the operation level.
  • FIG. 10B is a flowchart illustrating the procedure of input determination processing S603 according to this embodiment, which is replaced with FIG. 7B. Note that in FIG. 10B, steps similar to those in FIG. 7B are given the same step numbers, and redundant explanation will be omitted.
  • step S1027 the control unit 220 determines whether the position of the change in the area of the physical operation unit is a push switch area, a dial area, or a slider area. If the change in capacitance is greater than or equal to the threshold (Th1a) in the push switch region, the control unit 220 determines in step S1029 whether or not the capacitance is greater than or equal to the threshold (Th1c), which is greater than the threshold (Th1a). do. If the change in capacitance is equal to or greater than the threshold value (Th1c), the control unit 220 determines that the push switch has been pressed in, and stores the push switch position and the depression in step S1030. On the other hand, if the change in capacitance is less than the threshold value (Th1c), the control unit 220 determines that the push switch has been touched, and stores the push switch position and the contact operation in step S1031.
  • step S1027 If it is determined in step S1027 that it is in the area of the slider 831, the control unit 220 amplifies the output corresponding to the change in capacitance in step S1032. Then, in step S1033, the control unit 220 determines whether the change in capacitance is equal to or greater than a threshold value (Th1a). If the change in capacitance is less than the threshold (Th1a), the control unit 220 proceeds to step S732 and determines that there is no physical operation. If the change in capacitance is equal to or greater than the threshold value (Th1a), the control unit 220 stores the position and movement distance of the slider in step S1035.
  • Th1a a threshold value
  • step S1037 the control unit 220 determines whether the change in capacitance is greater than or equal to a threshold value (Th1c). If the change in capacitance is less than the threshold (Th1c), the control unit 220 returns to step S1033 and tracks the movement of the slider. If the change in capacitance becomes equal to or greater than the threshold value (Th1c), the control unit 220 determines that the slider has ended and stores the push-in position in step S1039. Note that in FIG. 10B, only the slider 831 is illustrated to avoid complexity. In the sliders 832 and 833, this can be achieved by setting the threshold values in steps S1033 and S1039 to corresponding values. Furthermore, if the movement speed is to influence the operation, the movement speed is also derived and stored.
  • FIG. 10C is a flowchart illustrating the procedure of operation instruction/display processing S605 according to the present embodiment, which is replaced with FIG. 7C. Note that in FIG. 10C, steps similar to those in FIG. 7BC are given the same step numbers, and redundant explanation will be omitted.
  • step S1052 the control unit 220 reads the determination result of the input determination process in FIG. 10B and determines whether the physical operation is a push switch, a dial, or a slider. If it is determined that the switch is a push switch, in step S1054, the control unit 220 reads the determination result of the input determination process in FIG. 10B and determines whether the user's operation is a touch or a push. If the user's operation is a touch, the control unit 220 instructs to select and display the operation corresponding to the operation position in step S1055. On the other hand, if the user's operation is a push, the control unit 220 instructs to execute and display the operation corresponding to the operation position in step S1056. Note that, although contact is defined as operation selection or notification, and pressing is defined as execution of the selected operation, the setting of the operation content is not limited thereto.
  • step S1052 If it is determined in step S1052 that it is a slider, the control unit 220 acquires the operation position and movement distance from the determination result of the input determination process in FIG. 10B in step S1057. Then, in step S1059, the control unit 220 issues an operation execution instruction and a display instruction corresponding to the operation position and movement distance. Note that processing such as an operation of sliding a finger upward on a slider and an operation of pressing and sliding a plurality of push switches will be omitted because the flowchart will be complicated.
  • multiple operation instructions can be generated by one physical operation. For example, different operation instructions can be generated depending on whether a push switch is touched or pressed.
  • sliders with various configurations can be set on the physical operation section. With respect to the slider, different operation instructions can be generated depending on whether the user's finger slides above the slider or when the user's finger slides by touching or pressing the slider.
  • the operation device differs from the second and third embodiments in that the same physical operation unit (push switch) has three or more levels of operation input.
  • Operation inputs of level 3 or higher include a state in which a finger approaches above a push switch, a state in which a finger contacts a push switch, and a state in which the push switch is pressed.
  • the push switch may be bonded to the display panel.
  • the other configurations and operations are the same as those in the second embodiment or the third embodiment, so the same configurations and operations are given the same reference numerals and detailed explanation thereof will be omitted.
  • FIGS. 11A and 11B are diagrams illustrating approach, contact, and depression of the push switch according to the fourth embodiment.
  • the same reference numerals are attached to the same components as in FIGS. 3A and 8A, and redundant explanation will be omitted.
  • FIG. 11A additionally shows a capacitance detection connection 1111 when a finger approaches a push switch at the push switch position in the physical operation area corresponding to a user operation.
  • the influence of the user's finger on the dielectric layer 213 is such that the distance from the surface of the dielectric layer 213 is larger than the distance when approaching the push switch>distance when touching the push switch>the push switch. This is the distance when pushing. Therefore, the magnitude of the detection output is conversely as follows: output when approaching the push switch ⁇ output when touching the push switch ⁇ output when pushing the push switch.
  • the threshold 1113 for determining the operation level of the user's operation on the push switch from the output after amplification is as follows: Threshold for approaching the push switch (Sh1d) ⁇ Threshold for contacting the push switch (Sh1a) ⁇ Pushing the push switch is set to the threshold value (Sh1c). That is, the capacitance sensitivity of approaching, touching, and pressing the push switch is considered to be the opposite of the threshold value, as follows: sensitivity of approaching the push switch>sensitivity of touching the push switch>sensitivity of pressing the push switch.
  • FIG. 11B is a diagram illustrating an operation determination in which the horizontal axis represents the change in capacitance when approaching, touching, and pressing the push switch, and the vertical axis represents the output from the dielectric layer 213.
  • the same reference numerals are attached to the same components as in FIG. 8B, and redundant explanation will be omitted. Note that in FIG. 11B, the broken line is the output before amplification, and the solid line is the output after amplification with an amplification degree of 3.0.
  • a threshold (Sh1d) is set at the output level at which it is determined that the user's finger approaches the push switch 1123. be done. Further, it is clear that a threshold value (Sh1e) is set at the output level at which the point 1124 where the push switch is bonded to the surface of the display panel 210 is determined. Below the threshold (Sh1d) is the range recognized as OFF, above the threshold (Sh1d) and below the threshold (Sh1a) is the range recognized as approaching, and above the threshold (Sh1a) and below the threshold (Sh1c) is recognized as contact. This is the range.
  • the range above the threshold value (Sh1c) and below the threshold value (Sh1e) is the range that is recognized as pushing, and the range that exceeds the threshold value (Sh1e) is the range that is recognized as ON.
  • FIG. 11B also shows that the range (822) from the threshold value (Sh1a) to the threshold value (Sh1e) (822) is not a push event but a push state, and continuous analog input is possible. Note that in the operation of the slider in which the user's finger slides upward in the third embodiment, the slide operation can be realized by setting the amplification degree and the threshold value, similar to the state in which the user's finger approaches the push switch. .
  • FIG. 12A is a diagram showing the configuration of the area database 1221 according to this embodiment.
  • the area database 1221 is replaced with the area database 221 in FIG. 2 in this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 4A, and redundant explanation will be omitted.
  • the area database 1221 stores a plurality of operation levels 1213 for each operation type, particularly for each push switch. An amplification degree 1214 is stored corresponding to the magnitude of capacitance for each type of operation. Then, different threshold values 1215 are stored corresponding to each operation level.
  • a threshold value for determining an approach operation (Th1d: Th1c>Th1a>Th1d) is stored separately from a threshold value for determining a contact operation (Th1a) and a threshold value for determining a pushing operation (TH1c: Th1c>Th1a).
  • a threshold value for determining whether the fourth push switch is turned on (adhesive) to the display panel may be stored. Furthermore, when inputting with the slider by approach rather than contact, Th1d is stored as the threshold value 1215 corresponding to the approach of the operation level 1213. In addition, when inputting a setting value by approaching and sliding a finger on the slider and setting or determining by touching or pressing, the approach and touching/pressing are stored in the operation level 1213, and the corresponding threshold value 1215 is Th1d. and memorize Th1a/Th1c.
  • FIG. 12B is a diagram showing the configuration of the physical operation unit database 1222 according to this embodiment.
  • the physical operation unit database 1222 is replaced with the physical operation unit database 222 in FIG. 2 in this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 4B, and redundant explanation will be omitted.
  • the physical operation unit database 1222 stores a plurality of operation levels 1225 for each operation type, especially for each push switch. Then, different distinguishable display colors, brightness, etc. 1226 and corresponding processing contents 1227 that change in accordance with each operation level are stored.
  • the display color and brightness 1226 stores, for example, yellow or low brightness in response to approach, green or medium brightness in response to contact, and red or high brightness in response to a push operation.
  • the response process content 1227 stores a selection preparation process in response to approach, a process selection or notification in response to contact, and a process setting (determine and execute) in response to push operation.
  • setting values are input by bringing fingers close together and sliding them.
  • yellow/low brightness is stored in the display color/brightness 1226
  • a set value is input in the corresponding processing content 1227.
  • red/high brightness is stored in the display color/brightness 1226
  • settings (execution) using the set values are stored in the corresponding process content 1227.
  • device operation details 1228 are stored that indicate what operations the connected devices perform when each of the physical operation units is operated.
  • Control unit processing procedure> The processing procedure of the control unit 220 is the same as the flowchart shown in FIG. 6, so redundant explanation will be omitted. Further, the panel setting process of this embodiment can be assumed from FIG. 7A and FIG. 10A, so the details will be omitted.
  • FIG. 13 is a flowchart showing the steps of input determination processing S603 and operation instruction/display processing S605 according to the present embodiment, which are replaced with FIGS. 7B and 10B or FIGS. 7C and 10C. Note that in FIG. 13, steps similar to those in FIGS. 7B and 10B or FIGS. 7C and 10C are omitted from the drawing to avoid complexity, but similar processing is performed.
  • FIG. 13 only shows a flowchart of the processing procedure related to the push switch, the processing procedure for other physical operation units can be easily performed by setting the threshold value to a value appropriate for the physical operation unit. I'll omit it because it's easy to imagine.
  • step S1327 the control unit 220 determines whether the change in capacitance is greater than or equal to a threshold value (Th1d). If it is determined that the change in capacitance is less than the threshold value (Th1d), the control unit 220 proceeds to step S732, and determines that there is no physical operation.
  • Th1d a threshold value
  • the control unit 220 determines whether the change in capacitance is greater than or equal to the threshold value (Th1a) in step S728, and is less than the threshold value (Th1a), the control unit 220 determines that the push switch is approaching, and stores the push switch position and approach in step S1332.
  • step S1354 the control unit 220 determines whether the push switch is approached, touched, or pressed based on the determination result of the input determination process S603 of this embodiment. If the determination result is approach, the control unit 220 issues an operation preparation instruction and a display instruction corresponding to the operation position in step S1357.
  • Th1e threshold value
  • multiple operation instructions can be generated by one physical operation.
  • three or more different operation instructions can be generated by approaching, touching, and pressing a push switch.
  • the operation device according to the present embodiment has capacitance sensitivity that detects changes in dielectric capacitance of each area or physical operation section before using the operation device. They differ in terms of calibration. That is, the capacitance sensitivity for detecting a change in capacitance in at least one of the type of physical operation section attached to the physical operation section area and outside the physical operation section area is adjusted by input from the user.
  • the parameters related to capacitance sensitivity, amplification and/or threshold are calibrated to enable stable and accurate operation from the operating device.
  • the other configurations and operations are the same as those in the second embodiment or the fourth embodiment, so the same configurations and operations are given the same reference numerals and detailed explanation thereof will be omitted.
  • FIG. 14A is a diagram illustrating an operation during calibration of the operation device according to the present embodiment.
  • FIG. 14A shows a user interface for an operation during calibration on the display panel 210 of the operation device 200 in FIG. 2.
  • FIG. 14A the same reference numerals are attached to the same components as in FIG. 2, and redundant explanation will be omitted.
  • the screen 1400 of the display panel 210 displays the fact that calibration has started, and a button for selecting the calibration target area or target physical operation unit.
  • the buttons include a button 1401 that instructs calibration outside the physical operation area, and a button 1405 that instructs calibration of a three-step input (approach, contact, push) push switch in the physical operation area. .
  • the display screen changes to a screen 1410, and a comment or voice instruction saying "Please touch outside the physical operation section" is output.
  • the area 1411 outside the area of the physical operation unit to be operated is displayed in a distinguishable color, the user can clearly see the touch position and can prevent operation failures.
  • the display screen transitions to a screen 1420 that displays a graph showing the change in the detected capacitance and the amplification factor, which is a parameter for calibration. and buttons for inputting increases and decreases from the threshold value are displayed.
  • the user repeatedly touches the surface outside the physical operation unit area 1411 while looking at the graph and inputting increases/decreases to the amplification degree and threshold value, so that the user's touch on the outside area 1411 of the physical operation unit is stable and accurate.
  • the amplification degree and threshold value can be set to allow detection.
  • a comment or voice instruction saying "Adjustment outside the physical operation unit has been completed” is output.
  • the outside of the physical operation section area 1430 is displayed in a different color from the outside of the physical operation section area 1411, it is possible to clearly indicate to the user that the adjustment has been completed. Note that in FIG.
  • the user's touch on the outside of the physical operation unit area 1411 was explained as an example, but when setting different input operations for approaching and touching the outside of the physical operation unit area 1411, the approach operation and the touch
  • the amplification degree and threshold value must be set so that stable and accurate detection can be achieved during operation.
  • the display screen changes to a screen 1450, and when the surface of the three-stage push switch is touched, the message "Touched the target push button” is displayed. A comment or voice instruction "Please do so.” is output.
  • the display screen transitions to a screen 1460 that displays a graph showing changes in the detected capacitance and inputs for increasing or decreasing the amplification degree and threshold value, which are parameters for calibration. button will be displayed.
  • the threshold values can be adjusted as an approach threshold value, a contact threshold value, and a push threshold value.
  • the user inputs increases and decreases between the amplification degree and the threshold value while looking at the graph, and repeats the approach operation, contact operation, and push operation of the 3-stage push switch, thereby stabilizing the user's operation input to the 3-stage push switch.
  • the amplification degree and each threshold value can be set to allow accurate detection. When the appropriate settings for the amplification degree and each threshold value are completed, a comment or voice instruction saying "Adjustment of the target push switch has been completed" is output.
  • FIG. 14B is a diagram showing the configuration of the area database 1421 according to this embodiment.
  • the area database 1421 is used in place of FIGS. 4A, 9A, and 12A.
  • the same reference numerals are attached to the same components in steps similar to those in FIGS. 4A, 9A, and 12A, and redundant explanation will be omitted.
  • the area database 1421 stores a calibrated appropriate amplification degree 1414 and a threshold value 1415 in association with the operation level 913 of each operation unit type.
  • the calibrated amplification degree suitable for push switch i is "3.1” and the threshold value is "Th1a- ⁇ ”.
  • the calibrated amplification degree suitable for the push switch n is "2.9”.
  • the threshold for detecting approach is "Th1d- ⁇ ”
  • the threshold for detecting contact is "Th1a+ ⁇ ”
  • the threshold for detecting approach is "Th1d ⁇ 0".
  • the appropriate calibrated amplification degree of the touch panel area outside the physical operation area is "0.8" and the threshold value is "Th2-c".
  • FIG. 14C is a flowchart showing the procedure of panel setting processing S601 according to this embodiment.
  • FIG. 14C is executed interchangeably with FIG. 7A. Note that in FIG. 14C, steps similar to those in FIG. 7A are given the same step numbers, and redundant explanation will be omitted.
  • step S1412 the control unit 220 executes calibration processing of the amplification degree and threshold value in areas other than the physical operation unit. Further, in step S1414, the control unit 220 executes calibration processing of the amplification degree and threshold value in the physical operation unit area.
  • FIG. 15A is a flowchart showing the procedure of calibration processing S1412 for the area outside the physical operation unit according to the present embodiment.
  • the control unit 220 sets default parameters (amplification value and threshold value) in step S1510. Note that this default parameter is set to a value that allows operation input to the operation device 200 from the display panel 210 based on the physical properties of the display panel 210 and the like.
  • step S1511 the control unit 220 determines whether the parameters are to be adjusted by the user. If it is determined that the parameters are to be adjusted by the user, the process advances to step S1513. If it is not determined that the parameters are to be adjusted by the user, the process advances to step S1531, and it is determined whether the parameters are to be adjusted by the device (control unit). If it is determined that the parameters should be adjusted by the device, the process advances to step S1533. Note that information regarding whether or not to adjust the parameters may be stored in advance in the control unit or may be selected by the user.
  • step S1513 the control unit 220 distinguishably indicates an area other than the physical operation unit and instructs the user to perform an operation. Then, in step S1515, the control unit 220 waits for the user to input an operation to an area other than the physical operation unit. If there is an operation input by the user to an area other than the physical operation section, the control section 220 acquires and displays the change in capacitance due to the operation input in step S1517, and displays the retained parameters, initially the default parameters, Outputs the judgment result of the input operation. In step S1519, the control unit 220 determines whether a parameter update has been input by the user. If a parameter update is input by the user, the control unit 220 returns to step S1513 and repeats the process.
  • control unit 220 determines that the appropriate parameters have been set, and registers the latest updated parameters in the region database 221 in step S1521. Then, in step S1523, the control unit 220 determines whether there is any other operation on an area other than the physical operation unit whose parameters are desired to be adjusted. If there is another operation, the control unit 220 returns to step S1513 and repeats the process.
  • step S1533 the control unit 220 distinguishably indicates the target operation unit (such as a push switch or dial) in the physical operation unit area and instructs the user to operate it. Then, in step S1535, the control unit 220 waits for the user to input an operation to the target operation unit in the physical operation unit area. If there is an operation input by the user to the target operation unit in the physical operation unit area, the control unit 220 acquires the change in capacitance due to the operation input in step S1537, and sets the held parameters, initially the default parameters, outputs the judgment result of the input operation, and derives the parameters by analyzing the judgment result. Control unit 220 determines whether appropriate parameters have been derived in step S1539.
  • the target operation unit such as a push switch or dial
  • control unit 220 If appropriate parameters are not derived, the control unit 220 returns to step S1533 and repeats the process. On the other hand, if appropriate parameters have been derived, the control unit 220 registers the derived appropriate parameters in the area database 221 in step S1541. Then, in step S1543, the control unit 220 determines whether there is any other operation on an area other than the physical operation unit whose parameters are desired to be adjusted. If there is another operation, the control unit 220 returns to step S1533 and repeats the process.
  • FIG. 15B is a flowchart showing the procedure of the physical operation unit area calibration process S1414 according to the present embodiment.
  • step S1551 the control unit 220 waits for input of the type of operation unit (type of push switch, type of slider, etc.) in the physical operation unit. If the type of operation unit is input, the control unit 220 sets default parameters (amplification value and threshold value) for the target type of operation unit in step S1553.
  • the type of operation unit type of push switch, type of slider, etc.
  • step S1561 the control unit 220 determines whether the parameters are to be adjusted by the user. If it is determined that the parameters are to be adjusted by the user, the process advances to step S1563. If it is not determined that the parameters are to be adjusted by the user, the process advances to step S1581, and it is determined whether or not the parameters are to be adjusted by the device (control unit). If it is determined that the parameters should be adjusted by the device, the process advances to step S1583. Note that information regarding whether or not to adjust the parameters may be stored in advance in the control unit or may be selected by the user.
  • step S1563 the control unit 220 distinguishably indicates the target operation unit in the physical operation unit area and instructs the user to perform the operation. Then, in step S1565, the control unit 220 waits for the user to input an operation to the target operation unit. If there is an operation input by the user to the target operation unit, the control unit 220 acquires and displays the change in capacitance due to the operation input in step S1567, and performs the input operation using the retained parameters, initially default parameters. Outputs the judgment result. In step S1569, the control unit 220 determines whether a parameter update has been input by the user. If a parameter update is input by the user, the control unit 220 returns to step S1563 and repeats the process.
  • the control unit 220 determines that the appropriate parameters have been set, and registers the latest updated parameters in the region database 221 in step S1571. Then, in step S1573, the control unit 220 determines whether the same type of operation unit has another state. For example, in the case of a three-stage push switch, parameters are adjusted for three states: an approach state, a contact state, and a pressed state. If there is another state, the control unit 220 returns to step S1563 and repeats the process. If there is no other state, the control unit 220 determines in step S1575 whether there is another type of operation unit for adjusting the parameter. If there is another type of operation unit, the control unit 220 returns to step S1551 and waits for input of another type of operation unit.
  • the control unit 220 determines that the appropriate parameters have been set, and registers the latest updated parameters in the region database 221 in step S1571. Then, in step S1573, the control unit 220 determines whether the same type of operation unit has another state. For example, in the case of
  • step S1583 the control unit 220 returns to step S1583 and repeats the process.
  • the control unit 220 registers the derived appropriate parameters in the area database 221 in step S1591. Then, in step S1593, the control unit 220 determines whether the same type of operation unit has another state. For example, in the case of a three-stage push switch, parameters are adjusted for three states: approach state, contact state, and pressed state. If there is another state, the control unit 220 returns to step S1583 and repeats the process. If there is no other state, the control unit 220 determines in step S1595 whether there is another type of operation unit that adjusts the parameter. If there is another type of operation unit, the control unit 220 returns to step S1551 and waits for input of another type of operation unit.
  • stable and accurate operation input can be performed from an operation device using capacitance.
  • the field of application of the above-mentioned operation device will be explained.
  • the above-mentioned operation devices are, for example, audio mixers, automobile operation panels, medical information viewing monitors, machine tool operation sections, construction machinery/ship operation sections, amusement equipment operation sections such as game consoles, computers and computer peripherals, etc. It can be applied to equipment operation parts and ticket vending machines for railways, ships, etc.
  • necessary types of operation parts such as dials and switches can be freely arranged at desired positions on the display panel, and the operation accuracy and role of each operation part can be set by software.
  • a push switch installed as a physical operation part can be used to select a song (melody) or rhythm
  • a dial can be used to set the volume and tempo of the entire song
  • a slider can be used to This is the control panel for setting the volume and rhythm of the part. It also serves as an operation unit for disconnecting, connecting, and combining melodies, volumes, and rhythms.
  • the push switch is used to turn ON/OFF the speaker or air conditioner
  • the dial or slider is used to adjust the air conditioner temperature and air volume, select or scroll the car navigation map, etc. becomes.
  • FIG. 16 is a block diagram showing the configuration of a system 1600 using the operation device according to this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 2, and redundant explanation will be omitted.
  • FIG. 16 shows a configuration in which the execution result of the instructed operation is output to various peripheral devices from the input/output interface 1610 via the operation execution section 240 that receives the operation instruction from the control section 220.
  • an audio output unit 1611, a spurt glass (HMD) 1612, a head-up display 1613, and the like are connected to peripheral devices to realize audio output and screen display of operation instruction results.
  • HMD spurt glass
  • FIG. 17 is a diagram showing the configuration of a physical operation unit database 1722 for use in multiple fields according to this embodiment.
  • the same reference numerals are attached to the same components as in FIG. 4B, and redundant explanation will be omitted.
  • physical operation unit databases 1723 and 1724 are prepared corresponding to each field of use 1711.
  • the physical operation unit database 1723 is used, and the corresponding processing details 1727 include controlling the operation device so that operation instructions related to the car navigation system can be given.
  • the physical operation unit database 1724 is used, and the corresponding processing details 1728 control the operation device so that operation instructions related to medical care can be given by nurses and doctors.
  • FIG. 18A is a diagram showing a configuration example in which the operation device according to the present embodiment is applied to a car navigation system 1810 mounted on a car.
  • FIG. 18B is a diagram showing a configuration example in which the operation device according to this embodiment is applied to a medical processing system 1820 used in the medical field.
  • FIG. 18B shows an operation device 1821 for operation according to this embodiment and a main display 1822 for displaying operation results.
  • the field of application of the operation device according to the present embodiment is not limited to the above example, and includes, for example, application to the operation section of industrial equipment, application to the operation section of construction machinery and marine equipment, application to the operation section of game consoles, etc.
  • Possible applications include application to the operation section of amusement equipment, application to the operation section of computers (PCs) and computer peripheral devices (HID devices), etc.
  • FIG. 18C is a diagram showing system configurations 1830 and 1840 in which the operation device according to this embodiment is embedded in a wall.
  • a system configuration 1830 is an example in which the operation device of this embodiment is embedded in a wall and used for, for example, digital signage. Further, a system configuration 1840 is an example in which the operation device of this embodiment is embedded in a wall and used for indoor environmental adjustment, home appliance adjustment, etc. It may also be used as a communication screen with the outside world.
  • the operation device can be effectively applied to ticket vending machines at stations, etc. For example, by attaching a transparent push switch as a physical operation part to a single display panel, and displaying the fare and destination on the display where the transparent push switch is attached, it is possible to change or update the fare at the ticket vending machine. This can be easily achieved by installing a transparent push switch and changing or updating the software.
  • the operation device can be applied to operation units in various fields.
  • push switches, rocker switches, dials, and sliders are used as examples of physical operation units that are attached to the display panel. Any physical operation component whose movement can be detected as a change in capacitance or a movement in a changed position may be used. Furthermore, since differences in the size and shape of the physical operation section can be accommodated by adjusting the amplification degree and threshold value (adjusting the sensitivity) in this embodiment, the existing physical operation section can be used as is.
  • the surface of the display panel is described as being flat, but it may be a convex curved surface or a concave curved surface. Further, it is also possible to bend the area where the physical operation section is attached and the area where the physical operation section is not attached at a predetermined angle.
  • the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention is also applicable when an information processing program that implements the functions of the embodiments is supplied to a system or device and executed by a built-in processor.
  • a program installed on a computer a medium storing the program, a server for downloading the program, and a processor executing the program are also included in the technical scope of the present invention.
  • a non-transitory computer readable medium storing at least a program that causes a computer to execute the processing steps included in the embodiments described above is within the technical scope of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Switches That Are Operated By Magnetic Or Electric Fields (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

L'invention concerne un dispositif de fonctionnement comprenant : un écran d'affichage ayant une région à laquelle une partie de fonctionnement physique est fixée et ayant une fonction de détection de fonctionnement et une fonction d'affichage d'image qui utilisent des changements de capacité statique afin de commander efficacement des régions autres qu'une certaine région ; une partie de fonctionnement physique qui est fixée à la surface de l'écran d'affichage et dont la position et/ou l'orientation est modifiée par une opération d'un utilisateur ; et une unité de commande qui utilise les valeurs de capacité statique pour détecter un changement dans la position et/ou l'orientation de la partie de fonctionnement physique, les changements de capacité statique étant détectés avec différentes sensibilités de capacité statique dans la première région dans laquelle la partie de fonctionnement physique est fixée et une seconde région différente de la première région sur l'écran d'affichage.
PCT/JP2022/026207 2022-06-30 2022-06-30 Dispositif de fonctionnement, et procédé de commande et programme de commande associés WO2024004132A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/JP2022/026207 WO2024004132A1 (fr) 2022-06-30 2022-06-30 Dispositif de fonctionnement, et procédé de commande et programme de commande associés
JP2022540975A JP7161083B1 (ja) 2022-06-30 2022-06-30 オペレーションデバイスおよびその制御方法と制御プログラム
JP2022164982A JP2024006867A (ja) 2022-06-30 2022-10-13 オペレーションデバイスおよびその制御方法と制御プログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/026207 WO2024004132A1 (fr) 2022-06-30 2022-06-30 Dispositif de fonctionnement, et procédé de commande et programme de commande associés

Publications (1)

Publication Number Publication Date
WO2024004132A1 true WO2024004132A1 (fr) 2024-01-04

Family

ID=83742534

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/026207 WO2024004132A1 (fr) 2022-06-30 2022-06-30 Dispositif de fonctionnement, et procédé de commande et programme de commande associés

Country Status (2)

Country Link
JP (2) JP7161083B1 (fr)
WO (1) WO2024004132A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012242924A (ja) * 2011-05-17 2012-12-10 Nissan Motor Co Ltd タッチパネル装置およびタッチパネル装置の制御方法
JP6532631B1 (ja) * 2018-10-15 2019-06-19 三菱電機株式会社 タッチパネル入力装置、タッチパネル入力方法、及びプログラム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6754673B2 (ja) * 2016-11-02 2020-09-16 池上通信機株式会社 トグルスイッチ付き電子機器
JP2020077223A (ja) * 2018-11-08 2020-05-21 株式会社Ｎｓｃ タッチパネル装置
US11188161B2 (en) * 2019-08-20 2021-11-30 Synaptics Incorporated Automative knob sensing device
JP7377757B2 (ja) * 2020-03-30 2023-11-10 株式会社ユーシン 操作つまみ装置
JP2022077785A (ja) * 2020-11-12 2022-05-24 株式会社ジャパンディスプレイ 入力検出システム及び入力支援装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012242924A (ja) * 2011-05-17 2012-12-10 Nissan Motor Co Ltd タッチパネル装置およびタッチパネル装置の制御方法
JP6532631B1 (ja) * 2018-10-15 2019-06-19 三菱電機株式会社 タッチパネル入力装置、タッチパネル入力方法、及びプログラム

Also Published As

Publication number Publication date
JP2024006867A (ja) 2024-01-17
JPWO2024004132A1 (fr) 2024-01-04
JP7161083B1 (ja) 2022-10-25

Similar Documents

Publication Publication Date Title
US10753814B2 (en) Piezoresistive sensors and sensor arrays
US8681112B2 (en) Apparatus and method for touch screen user interface for electronic devices part IC
US10055046B2 (en) Touch-sensitive electronic apparatus for media applications, and methods therefor
EP2474891A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations, et programme
US20110227947A1 (en) Multi-Touch User Interface Interaction
US11281326B2 (en) Touch encoder, touch panel, and input method editor with integrated development environment and methods thereof
EP1621989A2 (fr) Ecran tactile pour applications media et procédés correspondants
EP2686758A2 (fr) Améliorations apportées à une interface utilisateur de dispositif d'entrée
WO2010027803A1 (fr) Détection de gestes omnidirectionnels
JP2006268665A (ja) カーソル移動装置、カーソルの移動方法、プログラムおよび記録媒体
JP2012003404A (ja) 情報表示装置
WO2024004132A1 (fr) Dispositif de fonctionnement, et procédé de commande et programme de commande associés
US7924265B2 (en) System and method for emulating wheel-style, rocker-style, or wheel-and-rocker style navigation with an analog pointing device
US20200183580A1 (en) Touch-sensitive input with custom virtual device regions
JP2014153951A (ja) タッチ式入力システムおよび入力制御方法
US20060170711A1 (en) Input device
US10474108B2 (en) Magnetic sensor array for crown rotation
WO2010105631A2 (fr) Système, procédé et dispositif d'entrée informatique

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2022540975

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22949405

Country of ref document: EP

Kind code of ref document: A1