KR100981268B1 - Touch screen apparatus using tactile sensors - Google Patents

Abstract

The present invention is a device that can provide a user with a more natural, realistic and various contact information by transmitting a reaction force reflecting the texture, strength and strength of the applied force applied by the pointing object to the user, the user using the pointing object A touch screen, which is a medium through which an acting force of the pointing object is applied to the device for inputting a position or an operation command, and a reaction force is transmitted accordingly; A tactile sensor positioned below the touch screen and configured to generate a predetermined signal by sensing an acting force; A controller for outputting a control signal for driving the actuator based on the signal of the tactile sensor and the position information of the acting force applied to the touch screen; And an actuator positioned below the touch screen and transmitting the reaction force to the touch screen based on a control signal, wherein the tactile sensor and the actuator are one unit and a plurality of units are arranged around an edge of the touch screen. Therefore, the present invention relates to a touch screen device using a tactile sensor, a driving method thereof, and a recording medium, wherein a user may sense a reaction force according to a corresponding position at a corresponding position when the action force is applied to the touch screen using a pointing object.

Tactile sensor, actuator, touch screen, tactile feedback, recording medium, working force, reaction force

Description

Touch screen apparatus using tactile sensors

The present invention relates to a touch screen device using a tactile sensor, and more particularly, by using a tactile sensor capable of accurately detecting contact information, a user uses a pointing object (eg, a user's finger or a PDA terminal). It relates to a touch screen device (hereinafter referred to as tactile feedback) that reflects the characteristics of the action force applied through a stylus tip (for example, tactile feedback), a driving method thereof, and a recording medium thereof. .

Humans interface with electromechanical devices in a variety of applications. Thus, there is a constant interest in interfaces that are more natural, easy to use, and capable of providing information. In addition, the tactile function of acquiring information of the surrounding environment through contact, that is, contact force, vibration, surface roughness, and temperature change due to thermal conductivity, is recognized as a next-generation information collection and information transmission medium.

As a device that interfaces with a user, there are touch screens used in various electronic / mechanical devices such as automated teller machines in banks, personal digital assistants, mobile phones, and the like. The touch screen can receive input data directly from the screen so that when the pointing object touches a character or a specific location on the screen (screen) without using a keyboard, the location can be detected and processed by the stored software. do.

The problem with conventional touchscreens is that there is no tactile feedback to experience the touch sensation provided to the user. In this regard, the tactile feedback touch control device shown in Immersion Corporation's tactile feedback and other touch control device for touch pads (application number 2001-7011968) uses only the actuator 20, and is applied to the touch screen. Regardless of the strength and / or texture of the force of the object 1, once a signal is generated by the pointing object, a force of a predetermined predetermined intensity is output to the touch control device.

1 is a side view of a conventional touch screen device. In such a configuration, there is a touch input device 10 in which a pointing object acts, and an actuator 20 exists below the touch input device 10. The actuator 20 outputs a force of a predetermined intensity that is preset / defined by a touch controller (not shown) that is separately present.

Conventional touchscreen devices can provide tactile feedback to the user, but this is feedback of a preset / defined intensity through programming. For example, if the cursor moves over an icon in the graphic environment, it outputs a pulse that can deliver 0.1 (N) force, and if the cursor moves over an element of a menu, it delivers 0.001 (N) force. The user can program the touch control device in advance by defining to output the fine vibration. Thereafter, if the user's pointing object moves to move the cursor on the icon in the graphic environment, a pulse that is capable of transmitting a force of 0.1 (N) already set / defined according to the program is output.

Therefore, the conventional touch screen device has a problem of inhibiting the diversity in the next-generation information collection and information transmission method that acquires information of the surrounding environment through contact, that is, contact force, vibration, surface roughness, temperature change due to thermal conductivity, and the like. have.

In addition, there is a problem that can not provide a more natural and realistic feedback that the human human needs.

Accordingly, the present invention was created to solve various problems occurring in the touch screen device as described above.

SUMMARY OF THE INVENTION An object of the present invention is a device for a user to input a position or operation command using a pointing object, the touch screen being a medium to which the acting force of the pointing object is applied and the reaction force is transmitted accordingly; A tactile sensor positioned below the touch screen and configured to generate a predetermined signal by sensing an acting force; A controller for outputting a predetermined control signal for driving the actuator based on the signal of the tactile sensor and the position information of the acting force applied to the touch screen; And an actuator positioned below the touch screen and transmitting a reaction force to the touch screen based on a control signal, wherein the tactile sensor and the actuator are one unit and a plurality of units are arranged around an edge of the touch screen. When a user applies a working force to the touch screen using a pointing object, the user can detect the reaction force reflected at the location by reflecting the strength and / or texture of the working force (for example, a soft feeling or a hard feeling). It's there to be.

The touch screen device using the tactile sensor as a specific means of the present invention for achieving the above object, as a device for the user to input the position or operation command using the pointing object, the action force of the pointing object is applied, A touch screen that is a medium through which reaction forces are transmitted;

A tactile sensor positioned below the touch screen and configured to generate a predetermined signal by sensing an acting force;

A controller for outputting a control signal for driving the actuator based on the signal of the tactile sensor and the position information of the acting force applied to the touch screen; And

Located in the lower portion of the touch screen, the actuator for transmitting a reaction force to the touch screen based on the control signal; consisting of, the tactile sensor and the actuator is a unit, a plurality of units are arranged around the edge of the touch screen When the action force is applied to the touch screen with the pointing object, the user may sense the reaction force according to the corresponding position.

In addition, the touch screen is characterized in that the touch screen used in any one of LCD, OLED, PDP and electronic ink display device.

In addition, the touch screen is characterized in that the flexible touch screen.

The actuator may be any one of a piezoelectric actuator, a voice coil actuator, and a polymer actuator.

In addition, the touch screen device may be used in any one of a personal digital assistant (PDA), a portable multimedia player (PMP), a mobile phone, a computer, and a portable computer.

In addition, the control signal is characterized in that based on the position information of the action force applied to the touch screen and the signal of the action force detected by the tactile sensor.

In addition, the control signal is characterized in that it is based on the relationship in which the frequency (f) and the amplitude (A) is inversely proportional.

Further, the control signal is characterized in that it is based on a relationship in which the amplitude A is variable based on the applied force when the frequency f is constant.

In addition, the relay multiplexer for sequentially detecting a signal for the action force detected by the plurality of tactile sensors is characterized in that it is further added.

In addition, when the user applies a plurality of acting forces in a multi-touch manner, the controller may control the plurality of control signals based on the signal of the tactile sensor for each acting force and the position information of each acting force applied to the touch screen. It is characterized by outputting.

The actuator may be driven only while the pointing object is in contact with the touch screen.

In addition, before the signal is applied to the controller, an amplifier for amplifying the signal of the tactile sensor to a predetermined size is further characterized in that it is added.

In addition, the amplification factor of the amplifier is characterized in that determined by [Equation 1].

A method of driving a touch screen device using a tactile sensor as a specific means of the present invention for achieving the above object, the step of applying a user force to the touch screen using a pointing object (S10);

Acquiring position information of the acting force applied to the touch screen (S12);

Detecting an actuation force by a tactile sensor around a lower portion of the touch screen to detect a predetermined signal (S20);

Generating a predetermined control signal for driving the actuator based on the signal of the tactile sensor and the position information of the action force applied to the touch screen (S30); And

In operation S40, a corresponding actuator constituting the unit with each of the tactile sensors sensing the signal of the acting force is transmitted to transmit the reaction force to the touch screen based on the control signal.

The actuator driving step S40 may include determining whether the pointing object is in contact with the touch screen (S41), driving the actuator when the pointing object is in contact with the determination result (S42), and determining the pointing object. If it is not in contact with the actuator, characterized in that it comprises a step (S43) for driving.

In addition, between the signal detection step (S20) and the control signal generation step (S30) of the tactile sensor, the amplification or noise removing step (S22) of the signal detected by the tactile sensor is further added.

In addition, the signal of each tactile sensor is characterized in that it has any one of the maximum value, the 3dB value and the average value of the signal detected by each tactile sensor.

In addition, when the user drags the pointing object in the step of applying the action force (S10), the position information acquisition step (S12) to the actuator driving step (S40) is repeated according to the position of the changing pointing object.

The recording medium of the touch screen device using the tactile sensor as a specific means of the present invention for achieving the above object is readable by a computer,

Program code for detecting whether a user applies a working force to the touch screen by using a pointing object;

Program code for storing position information of an acting force applied to the touch screen;

Program code for detecting the acting force by the tactile sensor to detect the predetermined force;

Program code for causing the controller to generate a predetermined control signal for driving the actuator based on the detection signal of the tactile sensor and the position information of the acting force applied to the touch screen; And

And a program code for driving the actuator to transmit the reaction force based on the control signal to the touch screen.

The touch screen device using the tactile sensor according to the present invention may provide the user with more natural, realistic and various contact information by outputting a reaction force proportional to the texture, strength, and the like of the action force of the pointing object to the user. In addition, the tactile feedback may be utilized as a new means and medium for the information delivery industry using information collection and communication.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The touch screen device using the tactile sensor of the present invention uses the tactile sensor shown in the 'Applicant's manufacturing method and signal processing device of the tactile sensor' of the same applicant No. 2006-83584. Before describing the configuration of the touch screen device using the tactile sensor of the present invention, first, the configuration and manufacturing process of the tactile sensor 230 as a main component used in the present invention will be described.

<Configuration of Tactile Sensor>

Figure 2 is a side view of the tactile sensor 230 used in the present invention, Figures 3a to 3j is a process diagram showing a manufacturing method of the tactile sensor 230.

As shown in FIG. 2, the tactile sensor 230 has a coating layer 102 and a metal layer 103 formed on the polymer film 101 having a predetermined thickness in order, and a resistor (on the metal layer 103). A top plate manufactured by forming 104; and a coating layer 112 and a metal layer 113 are sequentially formed on the polymer film 111 having a predetermined thickness, and formed by forming a resistor 114 on the metal layer 113. It consists of a lower plate, and comprises a spacer 115 so that the resistor 104 of the upper plate and the resistor 114 of the lower plate is opposed.

<Manufacturing process of tactile sensor>

Hereinafter, the manufacturing process of the tactile sensor used in the present invention will be described with reference to FIGS. 3A to 3J.

The tactile sensor first manufactures the upper plate through the process as shown in FIGS. 3A to 3D, and then manufactures the lower plate through the process as shown in FIGS. 3E to 3I, and then bonds the upper plate and the lower plate as shown in FIG. ) Will be manufactured.

Looking at this in more detail as follows.

First, referring to the manufacturing process of the upper plate, the coating layer 102 is formed by coating HD 4000, which is a polymer material, on the Kapton polyimide film 101 having a thickness of 125 μm as illustrated in FIG. 3A. Here, the coating layer 102 is preferably coated using a conventional spin coating equipment.

Next, as shown in FIG. 3c, the metal is deposited on the coating layer 102 to form the metal layer 103, and then a signal line is formed by using a lift-off process. The metal used herein is preferably one selected from the group consisting of titanium, nickel, and gold, and the metal layer 103 is preferably deposited using an E-beam or sputtering equipment.

Next, the resistor 104 is formed on the metal layer 103 as shown in FIG. 3D. Here, the resistor 104 preferably uses a reduced pressure ink or nichrome (Ni-Cr), and in the case of using a reduced pressure ink, after applying the reduced pressure ink using a screen printing method, the resistor 104 is formed, and the nichrome In this case, it is preferable to form a pattern of the resistor 104 through etching after nichrome is deposited using an e-beam or a sputtering equipment.

After the upper plate is manufactured by the same method as described above, the lower plate is manufactured by the same method as the upper plate.

Looking at the lower plate manufacturing process, the coating layer 112 is formed by coating the polymer material HD 4000 as shown in Figure 3f on the Kapton polyimide film 111 having a thickness of 50㎛ as shown in Figure 3e. The lower coating layer 112 is also preferably coated using a conventional spin coating equipment.

Next, as illustrated in FIG. 3G, the metal is deposited on the coating layer 112 to form the metal layer 113, and then a signal line is formed by using a lift-off process. It is preferable to use a metal selected from the group of titanium, nickel, and gold, and the metal layer 113 is preferably deposited using an E-beam or a sputtering equipment.

Next, as shown in FIG. 3H, the resistor 114 is formed on the metal layer 113. In this case, it is preferable to use a reduced pressure ink or nichrome (Ni-Cr) for the resistor 114, and in the case of using a reduced pressure ink, after applying the reduced pressure ink using a screen printing method, a resistor 114 is formed, and the nichrome In this case, it is preferable to form a pattern of the resistor 114 through etching after nichrome is deposited using an e-beam or a sputtering equipment.

Next, the spacer 115 is formed on the metal layer 113 except for the resistor 114 to have a predetermined thickness. In this case, it is preferable to use an insulating material for the spacer 115, and the thickness is 2.1 times higher than the thickness of the resistor 114 so that an air gap is formed when the upper plate and the lower plate are bonded to each other. If the air gap is formed too high, the minimum force magnitude to be measured becomes large, which may lower the measurement sensitivity and reduce the accuracy of detection. Therefore, it is preferable to set the air gap in consideration of this point.

When the upper plate and the lower plate is manufactured through the above process, the upper plate and the lower plate are brought into contact with each other by a bonding process such that the resistor of the upper plate and the resistor of the lower plate face each other. The bonded tactile sensor may indicate the sensitivity of the tactile sensor by measuring a change in resistivity according to the contact area of the nichrome resistor by an external force. The bonding method used herein is preferably bonded using a double-sided tape or using a heat-adhesive tape for film adhesion, and thus it is economical in terms of cost since it does not require a separate semiconductor process.

<Configuration of Touch Screen Device>

Hereinafter, the configuration of the touch screen device using the tactile sensor of the present invention will be described.

4 is a side view of the touch screen device using the tactile sensor of the present invention, and the controller 440 is omitted. 5 is a perspective view of a touch screen device using the present inventors tactile sensor. 6 shows a state in which a touch screen device using the tactile sensor of the present invention is installed on a PDA terminal.

In the configuration of the touch screen device using the tactile sensor of the present invention is a touch screen 210 is applied to the operating force (F _in ) by the pointing object (1) and the position information is located below the touch screen , A tactile sensor 230 that detects the acting force F _in and generates a predetermined signal, and a predetermined control signal for driving the actuator based on the signal of the tactile sensor and the position information of the acting force applied to the touch screen. There is a control unit 440 for outputting the actuator, and the actuator 220 is located in the lower portion of the touch screen, and driven to transmit the reaction force (F _out ) based on the control signal to the touch screen.

4 and 5 show that the actuator 220 is placed on top of the tactile sensor 230, the positions of the actuator 220 and the tactile sensor 230 may be interchanged. In addition, specific wiring of the actuator and the tactile sensor is an easy matter within the scope of those skilled in the art, and detailed description thereof will be omitted herein.

The tactile sensor 230 and the actuator 220 are one unit, and the plurality of units are preferably arranged around the edge of the touch screen as shown in FIG. 5. This is to avoid damaging the function of the display unit 212 of the touch screen.

The touch screen 210 is an input medium for position and operation command of a cursor or the like on the display based on the position of the pointing object 1 in contact with the touch screen 210.

The touch screen 210 may be a touch screen used in LCDs, OLEDs, PDPs, electronic ink displays, and the like, and may also be a flexible touch screen. Recognition of the location information of the pointing object 1 applied to the touch screen, and the LCD, OLED, PDP, electronic ink display device, etc. are well known to those skilled in the art, and detailed descriptions thereof will be omitted.

The tactile sensor 230 is positioned below the touch screen 210 and generates a signal for the action force F _in of the pointing object 1 applied to the touch screen 210. The configuration of the tactile sensor 230 is as described above.

The tactile sensor 230 is disposed around the edge of the touch screen 210 in order not to impair the function of the display unit 212 of the touch screen 210, and thus the actuator 220 is also arranged around the edge of the touch screen 210. Will be deployed. That is, as shown in FIG. 5, one tactile sensor 230 and one actuator 220 form one unit to form a plurality of units. In this case, as shown in FIG. 5, the tactile sensor 230 and the actuator 220 may be arranged in a shape that is enclosed once around the touch screen 210.

A plurality of units, that is, a plurality of tactile sensors 230 and the actuator 220 is arranged, even if the action force (F _in ) is applied to any of a plurality of points on the touch screen 210 can be driven. That is, the tactile sensor 230 capable of detecting the characteristic of the acting force F _in applied by the pointing objects 1, 1 'and the actuator 220 implementing the reaction force F _out at the corresponding position are provided in plurality. Because of this, the reaction force can be realized even in multi-touch.

The controller 440 generates a control signal based on the signal of the action force (F _in ) detected by the tactile sensor 230 and the position information of the action force applied to the touch screen, and generates the control signal to the actuator 220. Will output The control unit 440 is very small, it is preferable to use a MICOM or a dedicated chipset that can be easily embedded in a computer or a portable electronic communication device (PDA terminal, mobile phone, etc.).

In the controller 440, a control signal for driving the actuator should be generated so that the reaction force F _out is sufficiently transmitted through the touch screen. Thus, information necessary for generating the control signal is preprogrammed into a function or a lookup table. This is preferred. The programming content may be based on the relationship between the frequency f and the amplitude A shown in FIGS. 12A and 12B, which will be described in the following operation example.

The actuator 230 is positioned below the touch screen 210 and is driven to output various reaction forces F _out to the user. The actuator 220 may rotate, translate, linearly move, and the like. In particular, the rotational movement of the actuator 220 is preferably converted into a linear movement in consideration of the strength of the touch screen 210, vibrable displacement, and the like.

The actuator 220 includes a piezoelectric actuator, a voice coil actuator, a polymer actuator, and the like.

Since the piezoelectric actuator uses the deformation characteristics of the piezoelectric body induced by the electric field, the operation time is very short, about 0.1 ms, and the displacement precision is about 0.01 µm, which is excellent in the position control capability in the fine region, compared to the mechanical operation method. And since it can be thin and small, it can be used suitably for compact housings, such as a portable computer or an electronic / communication device (for example, PDA, mobile phone, etc.). Piezoelectric actuators also require very low power and are therefore useful for portable computers or electronic / communication devices that receive limited power (eg, portable batteries, etc.).

The voice coil actuator preferably comprises a coil and a magnet, in which current flows through the coil and interacts with the magnetic field of the magnet to generate a force on the variable portion of the actuator.

The polymer actuator is characterized in that it is composed of a polymer material having a lightweight, flexible and rich properties. The polymer actuator includes a polymer piezoelectric element using polyvinylidene fluoride, a conductive polymer actuator using an electronic conductive polymer, a gel actuator using a polymer gel, and the like. Due to the material properties of the polymer, the polymer actuator can be effectively used for a flexible touch screen.

7 is a block diagram of a drive for providing tactile feedback. Before the signal generated from the tactile sensor 230 having the signal line is applied to the controller 440, a relay multiplexer 420 and a multiplexer 420 sequentially detect signals of the acting force generated by the tactile sensor 230. Preferably, an amplifier 430 is further added to amplify the signal of 420 to a predetermined level.

Here, the amplifier 430 may be used a variety of amplifiers, such as analog amplifier, digital amplifier, voltage amplifier.

In addition, it is preferable to further add a noise removing unit (not shown, for example, a filter) for removing the noise contained in the signal generated by the tactile sensor. By eliminating the noise, efficiency in implementing the reaction force F _out can be achieved. The noise will be a signal that does not contribute to the realization of the reaction force (F _out ) (for example, a signal of a magnitude less than a certain level).

Digital amplifiers have low power consumption and small size, so they can be easily embedded in computers, portable electronics, etc., and can be manufactured as a single custom semiconductor. When using a digital amplifier, it is preferable to further add a converter (not shown: analog-to-digital convert (ADC) or digital-to-analog convert (DAC)) to convert the signal between the analog signal and the digital signal. .

<Organization of Recording Media>

Hereinafter, the recording medium of the touch screen device using the tactile sensor will be described. The recording medium includes a program code for detecting whether a user applies an operating force to the touch screen by using a pointing object, a program code for storing position information of the applied force applied to the touch screen, and a sensing force for the tactile sensor. Program code for detecting the signal as a predetermined signal, program code for causing the controller to generate a predetermined control signal for driving the actuator based on the signal of the tactile sensor and the position information of the applied force applied to the touch screen; A computer program is recorded that includes program code for driving an actuator to transmit a reaction force based on a control signal to a touch screen.

The computer program recorded on the recording medium plays a role of setting the direction of implementing the driving method of the touch screen device using the tactile sensor to be described below.

The recording medium may be a hard disk, a RAM device, a ROM device, a compact disk, a DVD, a CD-ROM, a magneto-optical disk, a floppy disk, a digital tape, a memory stick, etc., which may be embodied by a series of instructions that are read and executed by a computer. It can be achieved by the device and this is well known in the range of those skilled in the art and a detailed description thereof will be omitted.

<Operation of Touch Screen Device>

Hereinafter, a method of driving a touch screen device using the tactile sensor according to the present invention will be described as a preferred embodiment.

8 is a flowchart illustrating a method of driving a touch screen device using a tactile sensor. As a driving method, a user applies a working force using a pointing object to a touch screen of a touch screen device in which a tactile sensor and an actuator are arranged around an edge (S10) and acquires position information of the applied force applied to the touch screen. (S12) and detecting the acting force in the tactile sensor under the touch screen to generate and detect a predetermined signal (S20) and based on the signal of the tactile sensor and the position information of the acting force applied to the touch screen in the controller. It may be divided into a step (S30) of generating a predetermined control signal for driving the actuator and a step (S40) of driving the actuator to transfer the reaction force to the touch screen based on the control signal.

At this time, the step of obtaining the position information of the pointing object by the touch screen (S12) and the step of detecting the action force by the tactile sensor (S20) is not configured according to the time series flow, because the two steps The configuration may be changed. Since the touch screen obtains the position information of the pointing object in the same manner as the method for obtaining the position information of the pointing object on a normal touch screen, a description thereof will be omitted.

Hereinafter, a description will be given of the step (S20) of generating a predetermined signal by detecting the action force by the tactile sensor on the bottom of the touch screen. Preferably, as shown in FIG. 7, a relay multiplexer 420, an amplifier 430, and a noise canceller (not shown in the filter) are added before the signal is transmitted to the controller 440 to amplify or noise the signal. The control step S22 may be further added.

9 and 10A to 10D illustrate an example of generation of a signal in the tactile sensor when an acting force F _in is applied by the pointing object 1 on the touch screen.

When the acting force F _in by the pointing object 1 is applied to the point C on the touch screen 210, a signal for the acting force F _in is generated from the tactile sensor 230 arranged around the touch screen. do. Signals having different magnitudes are generated around the tactile sensors (a), (b), (c), and (d) located on the horizontal axis and the vertical axis of the point where the action force F _in is applied.

10A to 10D show the relative magnitudes of the signals detected by the tactile sensors for each position. The x-axis represents the relative position of the tactile sensor and the y-axis represents the magnitude of the signal. At the tactile sensor ((a), (b), which is located close to the point (C) where the working force (F _in ) is applied, a signal that is relatively larger than the tactile sensor ((c), (d)) at other points Will occur. That is, once the action force F _in is applied, the relevant signal is also detected in the tactile sensors located around the tactile sensors positioned on the horizontal axis and the vertical axis of the applied point.

The signal of each tactile sensor detected by the tactile sensor for each position is to have a constant value such as the maximum value, 3 dB value, average value, minimum value of the signal. In particular, in order to effectively transmit the reaction force, it is desirable that the signal of the tactile sensor on which it is based has a maximum value or a magnitude of 3 dB value. At this time, if the signal value of the tactile sensor at position (a) is set to 3 dB of the detected signal, the signals of the tactile sensor ((b), (c), (d), etc.) at other positions are also at the respective positions. It is desirable to have a size corresponding to the 3dB value of the signal detected at. This is because the control signal for driving the actuator can maintain the same conditions so that the characteristics of the acting force can be reflected and transmit a reaction force proportional thereto.

The detected signals are amplified to a predetermined level by an amplifier. In the following, with reference to Figure 11, the resistance of any of the touch sensor arranged on the peripheral edge of the touch screen, the touch sensor (R _nm: measuring the subject R _nm The resistance other than the resistance will be described with respect to the amplification of the signal generated in the diagram.

The voltage (V _in ) applied to the input line of the resistance (R _nm ) to be measured is applied to the negative (-) input terminal of the analog amplifier, and the input of the resistor not to be measured to the positive (+) input terminal (V ₊ ). Voltage is applied. V _{GND on} the input line of the resistance of the tactile sensor that is not measured Is applied, where V _GND And V ₊ are the same value.

(V _in : voltage of main input line connected to R _nm , V _out : output voltage of OPAMP, R _f : feedback resistance, R _nm : resistance to be measured in tactile sensor)

Here, the resistance value of the feedback resistor Rf connected between the output terminal of the analog amplifier 430 and the negative input terminal is set in consideration of the capability of the touch screen, which is a medium through which vibration generated by driving of the actuator is transmitted. desirable.

In the same manner as described above, signals detected by the plurality of tactile sensors are amplified.

Hereinafter, a description will be given of the generation step (S30) of the control signal for driving the actuator.

The control signal is a signal for driving the actuator and is based on the detection signal of the tactile sensor and the position information of the acting force applied to the touch screen. In addition, since the characteristics of the acting force is reflected and the reaction force proportional to the acting force should be transmitted to the user, the information on the acting force is obtained. In addition, as described above, a detection signal is generated at each tactile sensor with respect to the application of one action force F _in , and thus a plurality of control signals will be provided.

Parameters constituting the information of the control signal include amplitude (A) and frequency (f).

12A and 12B are graphs showing relative magnitudes of amplitude A and frequency f as information of a control signal for an applied force.

In the graph of Fig. 12A, the x-axis shows the working force, and the y-axis shows the amplitude A and the frequency f as information parameters of the control signal.

In one embodiment, the amplitude (A) and the frequency (f) are in inverse relationship in order to convey the texture, i.e. soft or hard feeling. In order to drive the actuator to which the control signal is transmitted to transmit a soft feeling (a) on the touch screen, the frequency f has a relatively small value and the amplitude A has a large value. On the contrary, to transmit a hard feeling ((b) area) on the touch screen, the frequency f has a relatively large value and the amplitude A has a small value.

As in Fig. 12A, in the graph of Fig. 12B, the x-axis shows the working force, and the y-axis shows the amplitude A and the frequency f as information parameters of the control signal. 12B illustrates a method of determining information of a control signal based on a relationship in which the amplitude A is variable when the frequency f is constant.

Therefore, it is preferable that the relationship between the amplitude A and the frequency f is preprogrammed in the controller 440.

In addition to the relationship between the amplitude A and the frequency f shown in FIGS. 12A and 12B, the information of the control signal can be diversified in various cases.

Hereinafter, the operation of driving the actuator on the basis of the control signal (S40) will be described. As described above, the control signals having information on the operating force F _in are applied to the actuators at the points where the detection signals of the tactile sensors, which are the basis of the control signals, are generated.

Subsequently, the actuators to which the control signal is applied are driven (translation, rotation, linear motion, etc.) at a predetermined frequency f and amplitude A. At this time, it is preferable to simultaneously drive the plurality of actuators based on the plurality of control signals generated by the application of a single acting force. The reaction force proportional to the action force applied by the pointing object is transmitted to the user by the superposition of vibrations generated when the plurality of actuators are simultaneously driven.

In addition, the actuator driving step (S40) is a step (S41) of determining whether the pointing object is in contact with the touch screen, driving the actuator when the pointing object is in contact with the determination result (S42) and the determination result pointing object is in contact If not, it is preferable that it consists of a step (S43) for deactivating the actuator.

As a result of determining whether the pointing object is in contact, when the pointing object 1, which can transmit the reaction force (F _out ), is not in contact with the pointing object, the reaction force (F _out ) becomes 0 [N] so that the power is turned on. You can save. This can contribute to power savings in the use of portable computers or mobile phones operated with portable batteries.

Such an operation may be performed by the controller 440 by a method of not outputting a control signal to the actuator.

The touch screen device using the tactile sensor of the present invention not only can transmit the reaction force according to the multi-touch by the above driving method, but also act as the pointing object moves in contact with the touch screen like the Apple iPhone. Reaction forces can also be transmitted when applied.

For example, when applying a plurality of acting forces in a multi-touch manner, the controller outputs a plurality of control signals based on the signal of the tactile sensor for each acting force and the position information of each acting force applied to the touch screen. The actuator to which the plurality of control signals are applied is driven based on the control signal.

For example, when the pointing object applies an acting force while drawing a trajectory while touching the touch screen (drags), the point of application of the acting force is changed, and thus the driving method of the touch screen device is repeatedly Happens. Therefore, when the acting force is continuously applied by dragging, the reaction force may be continuously transmitted to the position information acquiring step S12 to the actuator driving step S40 repeatedly.

The above technique is merely an example of signal processing according to a movement (drag) of a multi-touch or pointing object, and of course, signal processing is possible in various ways.

<Variation example>

In another embodiment, the touch screen device using the tactile sensor of the present invention is not only a personal digital assistant (PDA) described in the above embodiment, but also a portable multimedia player (PMP), a mobile phone, a portable computer, a computer (for example, a tablet). Monitors, automated teller machines in banks). FIG. 13 shows a state where the touch screen device using the tactile sensor of the present invention is installed in a mobile phone, FIG. 14 shows a state installed in a tablet monitor, and FIG. 15 shows a state installed in a portable multimedia player (PMP). This shows only an example in which the touch screen device using the tactile sensor of the present invention is installed in a mobile phone, a tablet monitor, and a portable multimedia player, but the position, utilization state, and the like are not limited thereto.

In another embodiment, the actuator 220 is a piezoelectric actuator, a voice coil actuator, a polymer actuator, as well as other types of actuators such as standard speakers, E-core actuators, solenoids, pagers, DC motors, stepping motors, and the like. Can be used.

Although the present invention has been described in connection with the above-mentioned preferred embodiments, it is possible to make various modifications or variations without departing from the spirit and scope of the invention. Accordingly, the appended claims will include such modifications and variations as long as they fall within the spirit of the invention.

The following drawings, which are attached in this specification, illustrate the preferred embodiments of the present specification, and together with the detailed description of the present invention, serve to further understand the technical spirit of the present invention. It should not be interpreted.

1 is a side view of a conventional touch screen device;

Figure 2 is a side view of the tactile sensor used in the present invention,

3a to 3j is a process chart showing a manufacturing method of the tactile sensor used in the present invention,

4 is a side view of a touch screen device using the haptic sensor of the present invention;

5 is a perspective view of a touch screen device using the present inventors tactile sensor,

6 is a state in which the touch screen device using the tactile sensor of the present invention is installed in the PDA terminal,

7 is a block diagram of a drive for providing tactile feedback;

8 is a flowchart of a method of driving a touch screen device using the tactile sensor according to the present invention;

9 illustrates an example of signal generation in a tactile sensor when an action force F _in is applied on a touch screen;

10a to 10d is a graph showing the magnitude of the signal for each position of the tactile sensor;

11 is a circuit diagram in which the signal of the tactile sensor is amplified by an amplifier;

12A and 12B are graphs showing a relationship between vibration parameters of an actuator according to an action force applied on a touch screen;

13 is a state in which the touch screen device using the tactile sensor of the present invention is installed in the mobile phone,

14 is a state in which the touch screen device using the tactile sensor of the present invention is installed in the tablet PC,

15 is a state diagram in which a touch screen device using the tactile sensor of the present invention is installed in a PMP.

<Explanation of symbols for the main parts of the drawings>

1,1 ': pointing object

210: touch screen

212: display unit

220: actuator

230: tactile sensor

40,240: reference plane

300: PDA terminal

301: icon

420: relay multiplexer

430 amplifier

440: control unit

500: mobile phone

600: tablet monitor

700: PMP

Claims (19)

An apparatus for a user to input a position or an operation command using a pointing object, the apparatus comprising: a flexible touch screen that is a medium on which an acting force of the pointing object is applied and a reaction force is transmitted accordingly; A tactile sensor positioned below the touch screen and configured to generate a predetermined signal by detecting the action force; A control unit for outputting a control signal for driving the following actuators based on the signal of the tactile sensor and the position information of the action force applied to the touch screen; And An actuator positioned below the touch screen and configured to transmit the reaction force to the touch screen based on the control signal; The actuator is any one of a piezoelectric actuator, a voice coil actuator, and a polymer actuator, The tactile sensor and the actuator are one unit, and a plurality of units are arranged around the edge of the touch screen. When the acting force is applied to the touch screen with the pointing object, the user applies the corresponding reaction force at the corresponding position. Touch screen device using a tactile sensor characterized in that it can detect. delete delete delete delete delete The method of claim 1, The control signal is an inversely proportional signal in which frequency f and amplitude A are inversely proportional. The reaction force is a touch screen device using a tactile sensor, characterized in that can be transmitted to the soft tactile and hard tactile sense based on the inverse signal. delete delete delete delete The method of claim 1, Before the signal is applied to the control unit, the touch screen device using a tactile sensor, characterized in that an amplifier for amplifying the signal of the tactile sensor to a predetermined size is further added. The method of claim 12, Amplification rate of the amplifier is a touch screen device using a tactile sensor, characterized in that determined by the following [Equation 1]. [Equation 1]

(V _in : Voltage of main input line connected to R ₀₁ , V _out : Output voltage, R _f : Feedback resistance, R _nm : Measurement target resistance in tactile sensor) delete delete delete delete delete delete

Images