JP2013117891A - User interface device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To be able to improve both of diversity and operability in operable scenes.SOLUTION: A user interface device includes: a capacitance type touch sensor 40a for detecting a variation in potential applied to the surface of a monitor screen; a light detection type touch sensor 40b for detecting a variation in light volume irradiating the surface of the monitor screen; an underwater sensor 48 for detecting that a current position of a digital camera 10 is under water; a CPU 28 for starting the touch sensor 40a and stopping the touch sensor 40b according to non-detection of the underwater sensor 48, and starting the touch sensor 40b according to detection of the underwater sensor 48, thus executing different processing according to a detection mode of the touch sensors 40a and/or 40b turned on and off.

Description

  The present invention relates to a user interface device, and more particularly, to a user interface device that executes different processes depending on a touch operation mode.

  An example of this type of device is disclosed in Patent Document 1. According to this background art, the waterproof underwater housing is prepared for detachably storing information equipment. A plurality of operation buttons are arranged on a touch panel provided in the information device. The light detection pen outputs modulated light from the outside of the underwater housing. The plurality of light receiving elements are provided within the same viewing angle as the plurality of operation buttons arranged on the touch panel, and receive the modulated light output from the light detection pen. A detection unit provided in the information device detects an operation button within the same viewing angle as the light receiving element that receives the modulated light from the plurality of operation buttons. When the information device is removed from the underwater housing, the operation button is detected by paying attention to the shadow of the operation unit having a shape similar to that of the light output pen.

JP 2010-191608 A

  However, in the background art, the operation button is detected based on the outputs of the plurality of light receiving elements both when the information device is stored in the underwater housing and when the information device is removed from the underwater housing. For this reason, there is a limit to the detection accuracy of the operation buttons and the operability.

  Therefore, a main object of the present invention is to provide a user interface device capable of enhancing both the diversity of operable scenes and the operability.

  A user interface device according to the present invention (10: reference numeral corresponding to the embodiment; the same applies hereinafter) detects a change in potential applied to the operation surface (SCR) and / or a change in pressure applied to the operation surface. Detection means (40a), second detection means (40b) for detecting a change in the amount of light applied to the operation surface, third detection means (48) for detecting that the current position satisfies a predetermined condition, and third detection means First control means (S3, S13 to S15) for starting the first detection means and stopping the second detection means in response to non-detection of the second, and starting the second detection means in response to detection by the third detection means Second control means (S3, S11) and processing means (S29 to S31, S25 to S41) for executing different processes depending on the detection mode of the first detection means and / or the second detection means.

  Preferably, a stop means (S9) for stopping the first detection means in relation to the processing of the second control means is further provided.

  Preferably, an imaging means (20) for outputting an electronic image corresponding to the optical image captured on the imaging surface is further provided, and the processing means is a setting adjustment means (S31) for adjusting settings of the imaging means, and the imaging means. Recording means (S37, S41) for recording the electronic image output from the.

  Preferably, each target object of the first detection unit and the second detection unit corresponds to a change caused by a finger touching the operation surface.

  Preferably, the predetermined condition includes a first environmental condition that the current position is underwater.

  Preferably, the predetermined condition includes a second environmental condition that the altitude of the current position exceeds a reference.

  The operation control program according to the present invention includes a first detection means (40a) for detecting a change in potential applied to the operation surface (SCR) and / or a change in pressure applied to the operation surface, and the amount of light applied to the operation surface. A third detection is provided to the processor (28) of the user interface device (10) including the second detection means (40b) for detecting a change and the third detection means (48) for detecting that the current position satisfies a predetermined condition. A first control step (S3, S13 to S15) for starting the first detection means and stopping the second detection means in response to non-detection of the means, and a second detection means in response to detection by the third detection means In order to execute the second control step (S3, S11) to be activated and the processing steps (S29 to S31, S25 to S41) for executing different processes depending on the detection mode of the first detection means and / or the second detection means This is an operation control program.

  The motion control method according to the present invention includes a first detection means (40a) for detecting a change in potential applied to the operation surface (SCR) and / or a change in pressure applied to the operation surface, An operation control method executed by a user interface device (10) comprising second detection means (40b) for detecting a change and third detection means (48) for detecting that the current position satisfies a predetermined condition. The first control step (S3, S13 to S15) for starting the first detection means and stopping the second detection means in response to the non-detection of the third detection means, and the first control step corresponding to the detection of the third detection means 2nd control step (S3, S11) for activating the two detection means, and processing steps (S29 to S31, S25 to S41) for executing different processes according to the detection mode of the first detection means and / or the second detection means Is provided.

  The external control program according to the present invention includes a first detection means (40a) for detecting a change in potential applied to the operation surface (SCR) and / or a change in pressure applied to the operation surface, and the amount of light applied to the operation surface. Second detection means (40b) for detecting a change, third detection means (48) for detecting that the current position satisfies a predetermined condition, and a processor for executing processing according to an internal control program stored in the memory (50) An external control program supplied to the user interface device (10) comprising (28), wherein the first detection means is activated and the second detection means is stopped in response to non-detection of the third detection means. A control step (S3, S13 to S15), a second control step (S3, S11) for starting the second detection means in response to detection by the third detection means, and the first detection means and / or the second detection means. Processing that executes different processing depending on the detection mode For execution by the processor step of (S29 ~ S31, S25 ~ S41) in cooperation with the internal control program, which is an external control program.

  A user interface device (10) according to the present invention is irradiated with a first detection means (40a) for detecting a change in potential applied to the operation surface (SCR) and / or a change in pressure applied to the operation surface. A second detection means (40b) for detecting a change in the amount of light to be detected, a third detection means (48) for detecting that the current position satisfies a predetermined condition, a capture means (52) for capturing an external control program, and a capture means A user interface device including a processor (28) that executes processing according to a fetched external control program and an internal control program stored in a memory (50), wherein the external control program is not detected by the third detection means. Correspondingly, a first control step (S3, S13 to S15) for starting the first detecting means and stopping the second detecting means, and a second control for starting the second detecting means in response to the detection of the third detecting means. Step (S3, S11) and processing steps (S29 to S31, S25 to S41) for executing different processes depending on the detection mode of the first detection means and / or the second detection means are executed in cooperation with the internal control program It corresponds to the program to do.

  According to the present invention, at a position deviating from the predetermined condition, a user operation is detected by paying attention to a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface. On the other hand, at a position satisfying the predetermined condition, a user operation is detected by paying attention to a change in the amount of light irradiated on the operation surface. As a result, it is possible to enhance both the diversity of the operable scenes and the operability.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

It is a block diagram which shows the basic composition of one Example of this invention. It is a block diagram which shows the structure of one Example of this invention. FIG. 3 is an illustrative view showing one example of a mapping state of an SDRAM applied to the embodiment in FIG. 2; It is an illustration figure which shows an example of the icon displayed on the LCD monitor applied to the FIG. 2 Example. It is a flowchart which shows a part of operation | movement of CPU applied to the FIG. 2 Example. It is a flowchart which shows a part of other operation | movement of CPU applied to the FIG. 2 Example. It is a block diagram which shows the structure of the other Example of this invention.

Embodiments of the present invention will be described below with reference to the drawings.
[Basic configuration]

  Referring to FIG. 1, the user interface device of this embodiment is basically configured as follows. The first detection means 1 detects a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface. The second detection unit 2 detects a change in the amount of light irradiated on the operation surface. The third detection means 3 detects that the current position satisfies a predetermined condition. The first control unit 4 activates the first detection unit 1 and stops the second detection unit 2 in response to the non-detection of the third detection unit 3. The second control unit 5 activates the second detection unit 2 in response to the detection by the third detection unit 3. The processing unit 6 executes different processes depending on the detection mode of the first detection unit 1 and / or the second detection unit 2.

Therefore, at a position outside the predetermined condition, a user operation is detected by paying attention to a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface. On the other hand, at a position satisfying the predetermined condition, a user operation is detected by paying attention to a change in the amount of light irradiated on the operation surface. As a result, it is possible to enhance both the diversity of the operable scenes and the operability.
[Example]

  Referring to FIG. 2, the digital camera 10 of this embodiment includes a zoom lens 12, a focus lens 14 and an aperture unit 16 driven by drivers 18a, 18b and 18c, respectively. The optical image that has passed through these members is irradiated onto the imaging surface of the imager 20 and subjected to photoelectric conversion. Thereby, a charge corresponding to the optical image is generated.

  When the power is turned on, the CPU 28 instructs the driver 18d to repeat the exposure operation and the charge readout operation under the imaging task in order to start the moving image capturing process. The CPU 28 also gives a moving image display command to the LCD driver 38 under the imaging task in order to start the moving image display process. The moving image display command describes identification information for identifying a display target.

  In response to a vertical synchronization signal Vsync periodically generated from an SG (Signal Generator) (not shown), the driver 18d exposes the imaging surface and reads out charges generated on the imaging surface in a raster scanning manner. From the imager 20, raw image data based on the read charges is periodically output.

  The preprocessing circuit 22 performs processing such as digital clamping, pixel defect correction, and gain control on the raw image data output from the imager 20. The raw image data subjected to these processes is written into the raw image area 32a (see FIG. 3) of the SDRAM 32 through the memory control circuit 30.

  The post-processing circuit 34 reads the raw image data stored in the raw image area 32a through the memory control circuit 30, and performs color separation processing, white balance adjustment processing, and YUV conversion processing on the read raw image data. The YUV format image data thus generated is written into the YUV image area 32b (see FIG. 3) of the SDRAM 32 by the memory control circuit 30.

  The identification information described in the moving image display command indicates the image data thus written in the YUV image area 32b. The LCD driver 36 repeatedly reads the image data stored in the YUV image area 32b through the memory control circuit 30, and drives the LCD monitor 38 based on the read image data. As a result, a real-time moving image (through image) representing the scene captured on the imaging surface is displayed on the monitor screen.

  An evaluation area (not shown) is assigned to the center of the imaging surface. In addition to the above-described processing, the preprocessing circuit 22 shown in FIG. 2 executes simple RGB conversion processing that simply converts raw image data into RGB data.

  The AE evaluation circuit 24 integrates RGB data belonging to the evaluation area among the RGB data generated by the preprocessing circuit 22 every time the vertical synchronization signal Vsync is generated. Further, the AF evaluation circuit 26 integrates the high frequency components of the RGB data belonging to the evaluation area EVA among the RGB data generated by the preprocessing circuit 22 every time the vertical synchronization signal Vsync is generated. The integral value calculated by the AE evaluation circuit 24 is given to the CPU 28 as an AE evaluation value, and the integral value calculated by the AF evaluation circuit 26 is given to the CPU 28 as an AF evaluation value.

  The LCD monitor 38 is provided with a capacitance type touch sensor 40a and a light detection type touch sensor 40b. In relation to the operation of the touch sensors 40a and 40b, the CPU 28 gives an icon display command to the LCD driver 36 under a user interface setting task. The LCD driver 36 that has received the command displays the icons IC1 to IC3 in OSD on the monitor screen SCR in the manner shown in FIG. Here, the icon IC1 corresponds to an icon for receiving an imaging operation, and the icons IC2 to IC3 correspond to icons for receiving a zoom operation.

  Both touch sensors 40a and 40b are provided to detect an operator's touch operation on the monitor screen SCR. However, the touch sensor 40a detects a touch operation by paying attention to a change in potential applied to the surface of the monitor screen SCR, and the touch sensor 40b pays attention to a change in the amount of light applied to the surface of the monitor screen SCR. Is detected. When the operator's finger touches the monitor screen SCR, the contact position of the finger is specified by the touch sensors 40a and / or 40b, and a detection signal describing the position information indicating the specified contact position is given to the CPU.

  Unless a detection signal is given, the CPU 28 executes a simple AE process based on the AE evaluation value output from the AE evaluation circuit 24 under the imaging task, and calculates an appropriate EV value. The aperture amount and exposure time that define the calculated appropriate EV value are set in the drivers 18c and 18d, whereby the brightness of the through image is roughly adjusted.

  When a detection signal is given from the touch sensor 40a and / or 40b and the position information described in the detection signal corresponds to the display position of the icon IC2 or IC3, the CPU 26 considers that the zoom operation has been performed and zooms in. Command the driver 18a to move the lens 12. The zoom lens 12 moves in the zoom-in direction in response to the touch of the icon IC2, and moves in the zoom-out direction in response to the touch of the icon IC3. As a result, the magnification of the through image changes.

  When a detection signal is given from the touch sensor 40a and / or 40b and the touch position described in the detection signal corresponds to the display position of the icon IC1, the CPU 26 considers that an imaging operation has been performed and displays a moving image. The LCD driver 36 is instructed to interrupt the processing, that is, the data reading operation. The display on the LCD monitor 38 changes from a through image to a black image.

  When the moving image display process is interrupted, the CPU 26 executes a strict AE process referring to the AE evaluation value and an AF process referring to the AF evaluation value. As a result of the strict AE process, the aperture amount and the exposure time that define the optimum EV value are set in the drivers 18c and 18d. Thereby, the brightness of the through image is adjusted strictly. Further, as a result of the AF process, the focus lens 14 is placed at the focal point by the driver 18b. As a result, the sharpness of the through image is improved.

  When the AF process is completed, the CPU 26 executes a still image capturing process and gives a preview display command to the LCD driver 36. One frame of image data representing a scene at the time when the strict AF process is completed is saved from the YUV image area 32b to the still image area 32c (see FIG. 3) by the still image capturing process. In the preview display command, identification information indicating the image data thus saved in the still image area 32c is described as a display target. The LCD driver 36 reads the image data saved in the still image area 32c through the memory control circuit 30, and displays an image based on the read image data on the LCD monitor 38 as a preview image.

  Thereafter, the CPU 26 gives a recording command to the memory I / F 44. The memory I / F 44 reads the image data saved in the still image area 32c through the memory control circuit 30, and records the read image data on the recording medium 44 in a file format. The moving image display process (process for displaying a through image) described above is resumed after the recording process is completed.

  The underwater sensor 48 outputs a detection signal when the current position of the digital camera 10 is underwater. When the detection signal from the underwater sensor 48 is not output, the CPU 28 regards the current position as a position different from underwater (= in the air), stops the photodetection type touch sensor 40b, and detects the capacitive touch. The sensor 40a is activated. Further, when a detection signal is given from the underwater sensor 48, the CPU 28 considers that the current position is underwater, stops the capacitive touch sensor 40a, and activates the light detection touch sensor 40b.

  Therefore, in the air, a user operation is detected by paying attention to a change in potential applied to the surface of the monitor screen SCR. On the other hand, in water, a user operation is detected by paying attention to a change in the amount of light irradiated on the surface of the monitor screen SCR. As a result, it is possible to enhance both the diversity of the operable scenes and the operability.

  Note that when the digital camera 10 is operated while swimming in water, the amount of light applied to the monitor screen SCR may vary significantly according to changes in the environment in water. Therefore, in determining the touch operation based on the output of the photodetection type touch sensor 40b, attention is paid to the local light amount attenuation limited to the display positions of the icons IC1 to IC3. It is preferable to focus on the period of decay. For example, a process may be considered in which it is determined that a touch operation has been performed when a period in which the amount of light has attenuated in a limited manner at any one of the icons IC1 to IC3 continues for 3 seconds.

  The CPU 28 executes a plurality of tasks including the user interface setting task shown in FIG. 5 and the imaging task shown in FIG. 6 in parallel under the control of the multitask OS. Note that control programs corresponding to these tasks are stored in the flash memory 50.

  Referring to FIG. 5, in step S <b> 1, an icon display command is issued toward LCD driver 36. As a result, the icons IC1 to IC3 are displayed on the LCD monitor 38 in the OSD manner. In step S3, it is determined whether or not the current position of the digital camera 10 is underwater based on the output of the underwater sensor 48. If the determination result is YES, the process proceeds to step S5. If the determination result is NO, step S7 is performed. Proceed to

  In step S5, it is determined whether or not the capacitance type touch sensor 40a is being activated. In step S7, it is determined in step S9 whether or not the light detection type touch sensor 40b is being activated. If the determination result in step S5 or S7 is NO, the process returns to step S3. If the determination result in step S5 is YES, the process proceeds to step S9. If the determination result in step S7 is YES, the process proceeds to step S13.

  In step S9, the touch sensor 40a is stopped, and in step S11, the touch sensor 40b is activated. In step S13, the touch sensor 40b is stopped, and in step S15, the touch sensor 40a is activated. When the process of step S11 or S15 is completed, the process returns to step S3.

  Referring to FIG. 6, in step S21, the driver 18c is instructed to repeat the exposure operation and the charge readout operation in order to start the moving image capturing process. In step S23, a moving image display command is given to the LCD driver 36 to start the moving image display process. In the moving image display command, identification information indicating the image data written in the YUV image area 32b is described as a display target. As a result, a through image representing a scene captured on the imaging surface is displayed on the LCD monitor 38.

  In step S25, it is determined whether or not an imaging operation has been performed (whether or not the icon IC1 has been touched) based on the output of the touch sensors 40a and / or 40b. If the determination result is NO, the simple AE process is repeated in step S27. As a result, the brightness of the through image is roughly adjusted.

  When the simple AE process is completed, the process proceeds to step S29, where it is determined whether or not a zoom operation has been performed (whether or not the icon IC2 or IC3 has been touched) based on the output of the touch sensors 40a and / or 40b. If a determination result is NO, it will return to Step S25, and if a determination result is YES, it will progress to Step S31.

  In step S31, the zoom lens 12 is moved in the zoom-in direction in response to the touch of the icon IC2, and the zoom lens 12 is moved in the zoom-out direction in response to the touch of the icon IC3. As a result, the magnification of the through image changes. When the process of step S31 is completed, the process returns to step S25.

  When the determination result in step S25 is updated to YES, the process proceeds to step S33 to instruct the LCD driver 36 to interrupt the moving image display process, that is, the data reading operation. The display on the LCD monitor 38 changes from a through image to a black image. In the subsequent step S35, strict AE processing and AF processing are executed. The brightness of the through image is strictly adjusted by the strict AE process, and the sharpness of the through image is improved by the AF process.

  When the strict AF process is completed, a still image capturing process is executed in step S37. As a result, one frame of image data representing the scene at the time when the strict AF processing is completed is saved from the YUV image area 32b to the still image area 32c.

  In step S39, a preview display command is given to the LCD driver 36 in order to display a preview image on the LCD monitor 38. In the preview display command, identification information indicating the image data saved in the still image area 32c is described as a display target. As a result, an image based on the saved image data is displayed on the LCD monitor 38 as a preview image.

  When the process of step S39 is completed, the process proceeds to step S41, and a recording command is given to the memory I / F 44. The memory I / F 44 reads the image data saved in the still image area 32c through the memory control circuit 30, and records the read image data on the recording medium 46 in a file format. When the recording process is completed, the moving image display process is resumed in step S43, and then the process returns to step S25.

  As can be seen from the above description, the capacitance type touch sensor 40a detects a change in potential applied to the surface of the monitor screen SCR, and the light detection type touch sensor 40b irradiates the surface of the monitor screen SCR. The change of the emitted light quantity is detected. The underwater sensor 48 detects that the current position of the digital camera 10 is underwater (the current position satisfies a predetermined condition). The CPU 28 activates the touch sensor 40a and stops the touch sensor 40b in response to the non-detection of the underwater sensor 48 (S3, S13 to S15). The CPU 28 also activates the touch sensor 40b in response to detection by the underwater sensor 48 (S3, S11). The CPU 28 executes different processes according to the detection modes of the touch sensors 40a and / or 40b thus turned on / off (S29 to S31, S25 to S41).

  Therefore, at a position different from that in water, a user operation is detected by paying attention to a change in potential applied to the surface of the monitor screen SCR. On the other hand, in water, a user operation is detected by paying attention to a change in the amount of light irradiated on the surface of the monitor screen SCR. As a result, it is possible to enhance both the diversity of the operable scenes and the operability.

  In this embodiment, activation / deactivation of the touch sensors 40a and 40b is controlled depending on whether or not the current position is underwater. However, activation / deactivation of the touch sensors 40a and 40b may be controlled depending on whether or not the altitude of the current value exceeds the reference. In this case, preferably, an altitude sensor is provided instead of the underwater sensor 48 or together with the underwater sensor 48, the touch sensor 40a is activated and the touch sensor 40b is stopped when the altitude is below the reference, and the altitude exceeds the reference It is assumed that the touch sensor 40a is stopped and the touch sensor 40b is started. Thereby, for example, even when the user wears gloves and climbs a snowy mountain, the touch operation by the user is realized.

  In this embodiment, a capacitive touch sensor is used as a touch sensor that is activated in a place that deviates from the predetermined condition (= in the air and / or where the altitude falls below the reference). A pressure-sensitive touch sensor (pressure is detected by, for example, a matrix switch method, a resistive film method, or a surface acoustic wave method) may be employed instead of the touch sensor or together with the capacitive touch sensor. In this case, the pressure change applied to the monitor screen SCR by the touch operation is detected by the pressure-sensitive touch sensor. Furthermore, it is conceivable to employ an electromagnetic induction type touch sensor instead of the capacitance type or pressure sensitive type touch sensor.

  In this embodiment, the multitask OS and control programs corresponding to a plurality of tasks executed thereby are stored in the flash memory 50 in advance. However, as shown in FIG. 7, a communication I / F 52 is provided in the digital camera 10 and some control programs are prepared as internal control programs in the flash memory 50 from the beginning, while other part of the control programs are external control programs. May be acquired from an external server. In this case, the above-described operation is realized by cooperation of the internal control program and the external control program.

  Furthermore, in this embodiment, the processing executed by the CPU 28 is divided into a plurality of tasks as described above. However, each task may be further divided into a plurality of small tasks, and a part of the divided plurality of small tasks may be integrated with other tasks. Further, when each task is divided into a plurality of small tasks, all or part of the tasks may be acquired from an external server.

  In this embodiment, a digital camera is assumed. However, the present invention can be applied to any electronic device that executes different processes depending on a touch operation mode.

DESCRIPTION OF SYMBOLS 10 ... Digital camera 12 ... Zoom lens 16 ... Imager 22 ... Pre-processing circuit 28 ... CPU
34 ... Post-processing circuit 38 ... LCD monitor 40a ... Capacitive touch sensor 40b ... Light detection touch sensor 48 ... Underwater sensor

Claims (10)

First detection means for detecting a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface;
A second detection means for detecting a change in the amount of light applied to the operation surface;
Third detection means for detecting that the current position satisfies a predetermined condition;
First control means for activating the first detection means and stopping the second detection means in response to non-detection of the third detection means;
A second control unit that activates the second detection unit in response to detection by the third detection unit, and a process that executes different processing depending on the detection mode of the first detection unit and / or the second detection unit A user interface device comprising means.   The user interface device according to claim 1, further comprising a stopping unit that stops the first detection unit in association with processing of the second control unit. An image pickup means for outputting an electronic image corresponding to the optical image captured on the image pickup surface;
The user interface device according to claim 1, wherein the processing unit includes a setting adjustment unit that adjusts a setting of the imaging unit, and a recording unit that records an electronic image output from the imaging unit.   4. The user interface device according to claim 1, wherein each target object of the first detection unit and the second detection unit corresponds to a change caused by a finger touching the operation surface. 5.   The user interface device according to claim 1, wherein the predetermined condition includes a first environmental condition that a current position is underwater.   The user interface device according to claim 1, wherein the predetermined condition includes a second environmental condition that an altitude of a current position exceeds a reference. First detection means for detecting a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface;
A processor of a user interface device comprising: second detection means for detecting a change in the amount of light applied to the operation surface; and third detection means for detecting that the current position satisfies a predetermined condition,
A first control step of activating the first detection means and stopping the second detection means in response to non-detection of the third detection means;
A second control step of activating the second detection means in response to the detection of the third detection means, and a process of executing different processes depending on the detection mode of the first detection means and / or the second detection means An operation control program for executing steps. First detection means for detecting a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface;
An operation control method executed by a user interface device comprising: second detection means for detecting a change in the amount of light applied to the operation surface; and third detection means for detecting that the current position satisfies a predetermined condition. ,
A first control step of activating the first detection means and stopping the second detection means in response to non-detection of the third detection means;
A second control step of activating the second detection means in response to the detection of the third detection means, and a process of executing different processes depending on the detection mode of the first detection means and / or the second detection means An operation control method comprising steps. First detection means for detecting a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface;
A second detection means for detecting a change in the amount of light applied to the operation surface;
An external control program supplied to a user interface device comprising: third detection means for detecting that the current position satisfies a predetermined condition; and a processor for executing processing according to an internal control program stored in a memory,
A first control step of activating the first detection means and stopping the second detection means in response to non-detection of the third detection means;
A second control step of activating the second detection means in response to the detection of the third detection means, and a process of executing different processes depending on the detection mode of the first detection means and / or the second detection means An external control program for causing the processor to execute steps in cooperation with the internal control program. First detection means for detecting a change in potential applied to the operation surface and / or a change in pressure applied to the operation surface;
A second detection means for detecting a change in the amount of light applied to the operation surface;
Third detection means for detecting that the current position satisfies a predetermined condition;
A user interface device comprising: a capturing unit that captures an external control program; and a processor that executes processing according to the external control program captured by the capturing unit and the internal control program stored in a memory,
The external control program is
A first control step of activating the first detection means and stopping the second detection means in response to non-detection of the third detection means;
A second control step of activating the second detection means in response to the detection of the third detection means, and a process of executing different processes depending on the detection mode of the first detection means and / or the second detection means A user interface device corresponding to a program for executing steps in cooperation with the internal control program.

Images