TWI448931B - Indicated position detecting apparatus and indicated position detecting method - Google Patents

Description

Indicating position detecting device and indicating position detecting method [Reciprocal Reference for Related Applications]

The present invention is based on the conventional Japanese Patent Application No. 2009-238796, filed on Oct. 16, 2009, and the Japanese Patent Application No. 2009-254511, filed on Nov. 6, 2009. Japanese Patent Application No. 2010-052456, the entire disclosure of which is hereby incorporated by reference.

The present invention relates to techniques for detecting an indicated position on a display screen.

Conventionally, a device such as an LCM (Liquid Crystal Panel Module) or a CRT (cathode-ray tube) is used to instruct an arbitrary position in a display screen of a display device. Control panel. In the resistive film type touch panel, for example, a film is adhered to a surface of a glass surface as a base, and a transparent electrode grid called ITO (Indium Tin Oxide) is provided on an opposing surface of both the glass and the film. structure. In the touch panel, when the surface of the film side is pressed by a pen or a finger, the ITO is turned on at a position corresponding to the position, and therefore the position can be detected by measuring the voltage of the resistance portion corresponding to the indicated position (for example, Japan) JP-A-2009-48653).

In the resistive film type touch panel, it is indispensable to cover the display screen of the display device by the film provided with the electrode grid. This tends to cause a decrease in display characteristics of the LCM or the like.

One aspect of the indication position detecting device of the present invention includes: a display module having a display screen; and a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen to detect a contact sound to the display screen; The acquisition unit obtains a time difference of arrival of the contact sound between the two microphones for the combination of the two types of microphones, and a position information acquisition unit that derives the difference in time of arrival according to each of the arrival time differences obtained by the time difference acquisition unit A hyperbola of the microphone corresponding to the arrival time difference is used as a focal point, and an intersection of the two hyperbola derived is obtained as position information for generating the contact sound.

Further, another aspect of the pointing position detecting device of the present invention includes: a display module having a display screen; and a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen, and detecting from the display screen a command sound emitted by the three-dimensional space; a time difference acquisition unit that acquires an arrival time difference of the instruction sound between the two microphones for a combination of three types of microphones; and a position information acquisition unit that obtains a time difference acquisition unit Each of the acquired arrival time differences is derived from a hyperboloid having the microphone corresponding to the arrival time difference as a focus, and the intersection of the three hyperboloids derived is used as position information for emitting the indication sound.

Further, one aspect of the indication position detecting method of the present invention includes a time difference obtaining step of acquiring a combination of two types of microphones and acquiring two microphones among a plurality of microphones disposed apart from each other in an outer peripheral portion of the display screen. a difference in arrival time of the contact sound to detect a contact sound with respect to a display screen in the display module; and a position information obtaining step of deriving the difference in time according to each of the arrival time differences obtained in the time difference obtaining step The hyperbola of the aforementioned microphone corresponding to the time difference is used as the hyperbola of the focus, and the intersection of the two hyperbola derived is obtained as the position information for generating the contact sound.

Further, another aspect of the indication position detecting method of the present invention includes a time difference obtaining step of acquiring two microphones of four microphones that are disposed apart from each other on the outer peripheral portion of the display screen with respect to a combination of four types of microphones. a difference in arrival time between the contact sounds to detect a contact sound with respect to a display screen in the display module; and a position information obtaining step of deriving the difference in each of the aforementioned arrival time differences obtained in the time difference obtaining step The hyper-curve of the microphone corresponding to the arrival time difference is used as a focus, and position information for generating the contact sound is obtained based on the derived hyperbola.

Further, another aspect of the indication position detecting method of the present invention includes a time difference obtaining step of acquiring two microphones of a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen with respect to a combination of three types of microphones. a difference in arrival time between the indicator sounds to detect an indication sound emitted from a 3-dimensional space on a display screen in the display module; and a position information acquisition step in which each of the foregoing is obtained by the time difference acquisition step The arrival time difference is derived, and a hyperboloid with the aforementioned microphone corresponding to the arrival time difference is derived as a focal point, and the intersection of the three hyperboloids derived is obtained as position information for emitting the indication sound.

Further, another aspect of the indication position detecting method of the present invention includes a time difference obtaining step of acquiring two microphones of four microphones disposed apart from each other on an outer peripheral portion of the display screen for a combination of four types of microphones. a difference in arrival time between the aforementioned indicator sounds, to detect an indication sound emitted from a 3-dimensional space on the display screen in the display module; and a position information obtaining step according to each of the obtained in the aforementioned time difference obtaining step The aforementioned arrival time difference is derived by deriving a hyperboloid having the microphone corresponding to the arrival time difference as a focus, and obtaining position information for emitting the indication sound based on the derived hyperboloid.

The advantages of the invention will be set forth in the description which follows. The advantages of the present invention can be realized and obtained by the means and combinations particularly pointed out below.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in FIG

[First Embodiment]

Hereinafter, embodiments of the present invention will be described. Fig. 1 is a block diagram showing a first embodiment of the pointing position detecting device of the present invention.

The pointing position detecting device of the present embodiment is for detecting an arbitrary pointed position in the display screen of the LCM 1 for displaying characters or images. That is, the indicated position of the 2nd dimensional plane on the display screen is detected as the indicated position. The position detecting device is: LCM1, four microphones 2A, 2B, 2C, and 2D (see FIGS. 2A and 2B) provided on the display screen side of the LCM 1, the amplifier 3, the A/D converter 4, and the position acquisition. Part 5 is composed.

The LCM1 transmission type shown in FIG. 1 has two transparent glass substrates 11 and 12 on the front side and the back side, a liquid crystal 13 sealed between the glass substrates 11 and 12, and a glass substrate 11 attached thereto. 12 polarizing plates 14, 15 outside.

A pattern of transparent pixel electrodes 16 is formed on the inner surface of the back glass substrate 12, and a TFT (Thin Film Transistor) 17 is formed in each of the pixel electrodes 16 corresponding to the pixels. On the inner surface of the glass substrate 11 on the front side, a color filter 18 having a predetermined color arrangement and a transparent common electrode 19 are sequentially laminated to form a pattern.

The periphery of the polarizing plate 14 on the front side is covered by a frame cover 20 in which an opening of the display window 20a is formed. In the following description, a region recognizable by the display window 20a on the display surface (surface of the polarizing plate 14 on the front side) of the LCM 1 is referred to as a display screen 1a of the LCM 1. When the LCM 1 is used, a surface light source composed of a light guide plate or a backlight is provided on the back surface of the polarizing plate 15 on the back side. Further, a transparent protective cover may be provided in the display window 20a as needed. Further, the display screen 1a is formed in a rectangular shape.

On the other hand, the four microphones 2A, 2B, 2C, and 2D constituting the pointing position detecting device are disposed inside the display window 20a. Fig. 2A is a layout view of the microphones 2A, 2B, 2C, and 2D of the display screen 1a of the LCM 1. In the following description, each of the microphones is distinguished by referring to each of the microphones 2A, 2B, 2C, and 2D as the first to fourth microphones.

As shown in FIG. 2A, the first to fourth microphones 2A to 2D are arranged on the respective sides of the display screen 1a so as to be positioned on the outer peripheral portion of the display screen 1a. Specifically, the first to fourth microphones 2A to 2D are orthogonal to the center Q of the rectangular display screen 1a, and exist on a plane parallel to the display screen 1a, that is, in the same plane as the display screen 1a. The two straight lines L and M are arranged in pairs. In other words, the first and third microphones 2A and 2C are arranged in pairs on a straight line L parallel to the long side of the display screen 1a, and the second and fourth microphones 2B and 2D are arranged on the short side of the display screen 1a. The other parallel lines M are arranged in pairs.

Then, the first to fourth microphones 2A to 2D individually detect the instruction sounds generated at the arbitrary indication position P of the display screen 1a illustrated in FIG. 2B at different positions, and output them to the amplifier 3 as analog audio signals. .

The instruction sounds detected by the first to fourth microphones 2A to 2D are as shown in the first stylus pen 30 as indicated by the predetermined stylus 30, or the front end or the fingertip of the pen type. The sound produced on the surface of the display screen 1a. In other words, the instruction sounds detected by the first to fourth microphones 2A to 2D are contact sounds generated on the display screen 1a or the vicinity of the display screen 1a when the pointer indicates an arbitrary position on the display screen 1a.

The stylus 30 includes a sensor or a switch for sensing, for example, a situation of abutting against the display screen 1a, and a sound emitting unit such as a small speaker or a buzzer, which is connected to the display screen. On the front end side of the 1a, when the front end portion is sensed to abut on the display screen 1a, a periodic sound is emitted as a contact sound.

The amplifier 3 amplifies the analog audio signals output from the first to fourth microphones 2A to 2D, and the A/D converter 4 converts the audio signal amplified by the amplifier 3 into a digital signal.

The position acquisition unit 5 is configured by, for example, a microcomputer including a CPU (Central Processing Unit), a peripheral circuit such as an input/output interface, a memory in which a predetermined program is stored, and a work memory, and also functions as a time difference acquisition unit 5a of the present invention. And the function of the location information acquisition unit 5b. Further, the position obtaining unit 5 obtains an output signal (audio signal) from the first to fourth microphones 2A to 2D converted into a digital signal by the A/D converter 4, and obtains the sequence by the hyperbola method described later. The indicated position information of the source of the indication sound detected by the first to fourth microphones 2A to 2D is displayed, and the obtained instruction position information is supplied to another device.

As shown in FIG. 3, the position information acquired by the position acquisition unit 5 sets the specific angle of the display screen 1a (the lower left corner in FIG. 3) as the coordinate of the XY coordinate system of the origin O(0, 0). Position (x, y). The position acquisition unit 5 supplies an arbitrary object to the position information, and is, for example, a personal computer that controls information (character or video) displayed by the LCM 1.

Next, the order of acquisition of the coordinate position (x, y) in the position acquisition unit 5 will be described. The position acquisition unit 5 periodically acquires a change in the sound pressure level in the output signals of the first to fourth microphones 2A to 2D (which can also be fixedly obtained).

Fig. 4A is a diagram showing a change in the sound pressure level in the output signals of the first to fourth microphones 2A to 2D when the indication sound is detected, and the horizontal axis is time and the vertical axis is sound pressure level. In addition, the sound pressure level is based on the sound pressure level in a specific frequency band of the output signal in the pre-imaginary indicator sound.

Then, as shown in FIG. 4A, the position obtaining unit 5 obtains a peak when the sound pressure level in each of the first to fourth microphones 2A to 2D exhibits a peak with a slight time difference, that is, when the indicator sound is detected. The difference in arrival time of the indicator sound between the microphones paired with each other as previously described. That is, by obtaining the time difference unit 5a obtains the first and third microphone. 2A, 2C, the arrival time difference of sound indicated t _AC, second and fourth microphone 2B, 2D of the sound arrival time difference indicated t _BD.

Specifically, the time difference acquisition unit 5a counts the elapsed time from an arbitrary time point, and subtracts the elapsed time when the third microphone 2C detects the indication sound (the time at which the sound pressure level exhibits a peak). When the first microphone 2A detects the elapsed time of the pointing sound, the arrival time difference t _{AC on the} first and third microphones 2A and 2C is obtained.

Thus, the arrival time 2A, 2C side of the first and second difference microphone 3 is t _AC, indicating sound source of the sender (indicating position P) as shown in FIG. 3 as the ratio of the third microphone is closer to the first microphone 2C 2A The time becomes a positive value, and conversely, when it is closer to the third microphone 2C than the first microphone 2A, it becomes a negative value.

In addition, the time difference acquisition unit 5a acquires the second and fourth microphones 2B and 2D by subtracting the elapsed time when the second microphone 2B detects the indication sound by the elapsed time when the fourth microphone 2D detects the indication sound. The arrival time difference of the side is t _BD .

Therefore, the arrival time difference t _{BD on} the second and fourth microphones 2B and 2D is such that the source of the instruction sound (instruction position P) is closer to the second microphone than the fourth microphone 2D as illustrated in FIG. When it is 2B, it becomes a positive value, and conversely, when it is closer to the 4th microphone 2D than the 2nd microphone 2B, it becomes a negative value.

Here, the arrival time difference t _AC on the first and third microphones 2A and 2C side indicates the distance difference to the indication position P in each microphone, and similarly, the arrival time difference t on the second and fourth microphones 2B and 2D side. _BD is a difference in distance to the indicated position P in each microphone. That is, the absolute value of the value of the arrival time difference (t _AC , t _BD ) of the indicator sound between a set of microphones multiplied by the speed of sound is the distance difference up to the indicated position P between a group of microphones.

The point at which the difference between the distances from the first and third microphones 2A and 2C is constant is present on the hyperbola having the focus of both of the microphones 2A and 2C, and is similarly spaced from the second and fourth microphones 2B and 2D. A point where the difference in distance is a certain point exists on the hyperbola with both microphones 2A, 2C as the focus.

Therefore, as shown in FIG. 4B, a hyperbola (hereinafter referred to as a first hyperbola) 10s which is close to the side of the indication position P among the hyperbolas 10s and 10t having the first and third microphones 2A and 2C as the focus, and The intersection of the hyperbola (hereinafter referred to as the second hyperbola) 20s on the side of the hyperbola 20s and 20t in which the second and fourth microphones 2B and 2D are in focus is close to the indication position P, and is the instruction position P. One of the hyperbolas 10s, 10t and the other hyperbola 20s, 20t shown in Fig. 4B is only for convenience of display, and the shape or positional relationship of the hyperbola is actually different.

In the XY coordinate system, the hyperbola in which the two focal points exist on the x-axis is set to 2a when the distance difference between the two focal points and the hyperbola is set to 2c, and the distance between the two focal points is set to 2c. The following formula (1) is shown.

^{(Wherein, b 2 = c 2 -a 2} )

On the other hand, since the distance (L _x) 2A, 2C between the first and third microphone is known, (1) that the above formula, if the difference between the distance P is approaching the position indicated 2a _x, then the The hyperbola 10s and 10t having the first and third microphones 2A and 2C as focal points can be expressed by the following formula (2).

Here, C ₀ is the speed of sound, and t _AC is the time difference of arrival.

Similarly, since the distance (L _y ) between the second and fourth microphones 2B and 2D is known, it is known from the above formula (1) that when the distance difference to the indication position P is 2a _y , The hyperbola 20s and 20t which are the focal points of the second and fourth microphones 2B and 2D can be expressed by the following formula (3).

Here, t _BD is the arrival time difference.

Therefore, the position (x) of the indication position P on the x-axis and the position (y) on the y-axis as the source of the indication sound can be obtained by calculating the following equations (4) and (5), respectively.

Further, in the above formula (4), when a _x is a positive value, that is, when the arrival time difference t _AC is a positive value, the value of the first term on the right side is smaller than (L _x /2), so in terms of calculation results A position (x) on the first hyperbola 10s close to the first microphone 2A shown in FIG. 4B can be obtained. Conversely, when a _x is a negative value, that is, when the arrival time difference t _AC is a negative value, the value of the first term on the right side is greater than (L _x /2), so that the calculation result is close to the 4B chart. Position (x) on the hyperbola 10t of the third microphone 2C shown.

Similarly, in the above formula (5), when a _y is a positive value, that is, when the arrival time difference t _BD is a positive value, the value of the first item on the right side is smaller than (L _y /2), so in terms of calculation results A position (y) on the second hyperbola 20s close to the second microphone 2B shown in FIG. 4B can be obtained. Conversely, when a _y is a negative value, that is, when the arrival time difference t _BD is a negative value, the value of the first item on the right side is larger than (L _y /2), so that the calculation result is close to the 4B picture. The position (y) on the hyperbola 20t of the fourth microphone 2D shown.

Therefore, the position acquisition unit 5 calculates the arrival time difference (t _AC , t _BD ) of the instruction sound between the plurality of microphones by the time difference acquisition unit 5a, and calculates the equation (4) by the position information acquisition unit 5b. Equation (5), whereby the first hyperbola 10s with the first and third microphones 2A and 2C as the focus and the second and fourth microphones 2B and 2D as the focus are obtained as shown in FIG. 4B. 2 Coordinate position (x, y) of the intersection of the hyperbola 20s. That is, the coordinate position (x, y) of the arbitrary pointed position P is obtained. Next, the position acquisition unit 5 supplies the acquired coordinate position (x, y) as the instruction position information to the other device.

In other words, the pointing position detecting device according to the first embodiment includes a display module having a display screen, and a plurality of microphones are disposed apart from each other on an outer peripheral portion of the display screen to detect a contact sound to the display screen. The time difference acquisition unit obtains the arrival time difference of the contact sound between the two microphones in combination with the two types of microphones, and the position information acquisition unit derives each of the arrival time differences obtained by the time difference acquisition unit. A hyperbola having a focus on the microphone corresponding to the arrival time difference is obtained, and an intersection of the two hyperbola derived is obtained as position information for generating the contact sound.

When the stylus pen 30 or the like instructs an arbitrary position of the display screen 1a of the LCM 1 in the instruction position detecting device according to the first embodiment, the first to fourth microphones 2A to 2D detect the pointing position P. The indicator sound generated in the specific position is specified based on the arrival time difference of the indication sound between the microphones that are paired with each other. Therefore, it is not necessary to cover the display screen 1a with other members, so that the pointed position in the display screen 1a can be detected without lowering the display characteristics of the LCM 1.

Further, in the practice of the present invention, the configuration and the like of the pointing position detecting device described in the present embodiment can be changed as follows.

For example, the two straight lines L and M which are orthogonal to each other in the first to fourth microphones 2A to 2D may not necessarily exist in the same plane, and the two straight lines L and M may exist in parallel with each other. Different planes. Further, the two straight lines L, M may also exist in different planes that are not parallel to each other.

Further, as described in the present embodiment, it is convenient to calculate the coordinate position (x, y) of the pointing position P when the two straight lines L and M are orthogonal, but the display screen 1a is required to be projected on at least the display screen 1a. It is enough to form an intersection inside.

Further, as shown in FIG. 5, the first to fourth microphones 2A to 2D may be arranged at respective corners of the display screen 1a. In other words, the first to fourth microphones 2A to 2D may be arranged in pairs on a straight line L1 including one diagonal line of the display screen 1a and on a straight line M1 including the other diagonal line.

Further, the installation locations of the first to fourth microphones 2A to 2D in the LCM 1 are. The indicator sound generated in the vicinity of the display screen 1a or the display screen 1a can be sensed when the pointer instructs the arbitrary position of the display screen 1a, and can be appropriately changed. In other words, the first to fourth microphones 2A to 2D may be disposed at any position on the outer peripheral portion of the display screen 1a as long as they are separated from each other.

Further, in the present embodiment, the hyperbola (the first hyperbola 10s) having the first and third microphones 2A and 2C as the focus and the hyperbola with the second and fourth microphones 2B and 2D as the focus are detected ( The intersection of the two hyperbola which are different from the second hyperbola 20s) is the indicated position in the display screen 1a.

However, the two hyperbola which are different in the calculation target of the coordinate position (x, y) of the intersection point (indicating the position P) may be the first and fourth microphones 2A and 2D as shown in FIG. The hyperbolic curves 30s and 30t and the hyperbolas 40s and 40t having the second and third microphones 2B and 2C as focal points. In other words, the combination of a set of microphones to be hyperbolically calculated may be appropriately changed. For example, the arrival time difference of the indication sounds in the first and fourth microphones 2A and 2D, and the second and third microphones 2B may be used. The arrival time difference of the indicator sound in 2C is to specify the indication position P. Further, one of the hyperbola 30s, 30t and the other hyperbola 40s, 40t shown in Fig. 6 is similarly displayed as shown in Fig. 4B, and the shape or positional relationship of the hyperbola is actually different.

In addition, as shown in FIG. 5, the combination of the microphones to be subjected to the hyperbolic calculation is the same as in the case where the first to fourth microphones 2A to 2D are arranged at the respective corners of the display screen 1a, and the same can be employed. random combination.

Further, the position acquisition unit 5 can obtain the coordinate position of the arbitrary indication position P by the following processing different from the present embodiment when the instruction sound is detected by adding the function of the control unit and the correction unit in the present invention. (x, y).

For example, the position obtaining unit 5 calculates the coordinate position (x, y) of the intersection (indicative position P) of the two hyperbola shown in FIG. 4B in the order described in the embodiment, and obtains the calculation result as the 1 indicates the processing of location information. Then, the position obtaining unit 5 changes the combination of the microphones which are one of the hyperbolic calculation targets to another combination shown in FIG. 6, and calculates the two different pairs according to the same principle as the present embodiment. The coordinate position (x, y) of the intersection of the curve (indicating position P). In other words, the position acquisition unit 5 performs a calculation based on the difference in arrival time between the first and fourth microphones 2A and 2D and the arrival time difference between the second and third microphones 2B and 2C. The coordinate position (x, y) of the intersection of the hyperbola (indicating the position P) is obtained as the processing of the second indicated position information.

After that, the position obtaining unit 5 calculates the x coordinate of the point between the x coordinate and the second indicated position information in the first indicated position information, and obtains the calculation result as the corrected x coordinate. At the same time, the position obtaining unit 5 calculates the y coordinate of the point in the middle of the y coordinate in the first indicated position information and the y coordinate in the second indicated position information, and obtains the calculation result as the corrected y coordinate. In other words, the position acquisition unit 5 performs the process of correcting the first instruction position information by the second instruction position information, and obtaining the corrected x coordinate and the corrected y coordinate as the third instruction position information. Then, the position acquisition unit 5 supplies the corrected coordinate position (x, y) as the third instruction position information to the other device as the final instruction position information.

As described above, the first indication position information and the second indication position information are obtained by converting the combination of the group microphones which are the hyperbolic calculation targets, and the acquired first indication position information is corrected by the second indication position information. By obtaining the final instruction position information (third indication position information), the detection accuracy of the indication position on the display screen 1a can be improved.

Further, in the present embodiment, a configuration in which the detection position is detected using four microphones will be described. However, the number of microphones provided on the outer peripheral portion of the display screen 1a may be three. In the case where the detection of the pointed position is performed using three microphones, for example, the first group composed of the first microphone and the second microphone and the second group composed of the first microphone and the third microphone may be used. Two sets of microphone pairs as hyperbolic calculation objects.

Further, in the present embodiment, the coordinate position (x, y) of the XY coordinate system is used as the indication position information indicating an arbitrary indication position on the display screen 1a. However, in the practice of the present invention, only one set of microphones separated from each other may be disposed on the outer peripheral portion of the display screen 1a, and any of the display screens 1a may be determined based on the information of the hyperbola with a set of microphones as the focus. The information indicating the position of the position is used as the indication position information indicating the arbitrary indication position.

As information indicating a schematic position that can be determined based on information of a hyperbola having a set of microphones as a focus, for example, information indicating that any of the indicated positions is located in any of the upper half area and the lower half area of the display screen 1a Or, information indicating that any of the indicated positions is located in any of the left half area and the right half area of the display screen 1a.

Further, as information indicating a schematic position that can be determined based on information of a hyperbola having a set of microphones as a focus, for example, when the display screen 1a is divided into a plurality of squares in the vertical and horizontal directions, it indicates that there is any indicated position. Information about the specific squares (multiple squares) of the possibility.

In addition, the position acquisition unit 5 described in the present embodiment may be implemented by, for example, a microcomputer including any of the devices (including a personal computer).

Further, the indicator sounds detected by the first to fourth microphones 2A to 2D may be those having a characteristic in a frequency band of an audible range, or may have characteristics in a frequency band of a non-audible range.

Further, in the present embodiment, the pointing position detecting device for detecting an arbitrary pointing position on the display screen of the LCM 1 is described. However, the present invention may be used in addition to the LCM 1 in a display screen of another display device such as a CRT. Detection of any indicated position.

[Second Embodiment]

Fig. 7 is a schematic configuration diagram showing a second embodiment of the pointing position detecting device of the present invention. The embodiment of the present embodiment is an example of the case where the pointing position detecting device of the present invention is applied to the LCM 51 that protects the display screen by the protective cover 60.

As shown in Fig. 7, the LCM 51 is a transmissive type in which the liquid crystal panel 52 is attached to the polarizing plates 14 and 15 on the front side and the back side of the liquid crystal panel 52, and the brightness of the polarizing plate 15 is attached to the back side. The lift film 53 is configured such that the surface of the polarizing plate 14 on the front side is covered by the protective cover 60.

Although not shown in FIG. 7, the liquid crystal panel 52 is composed of two transparent glass substrates 11 and 12 described in the first embodiment, a liquid crystal 13 provided between the glass substrates 11 and 12, and a pixel electrode 16. The TFT 17, the color filter 18, and the common electrode 19 are formed.

The brightness enhancement film 53 is, for example, a PET (Poly Ethylene Terephtalate) film in which an acrylic resin is laminated, and the brightness of the liquid crystal panel 52 is condensed by collecting light emitted from a surface light source formed by a light guide plate or a backlight (not shown). Upgrade.

The polarizing plate 14 attached to the surface side of the liquid crystal panel 52 has a configuration as shown in Fig. 8A, Fig. 8B or Fig. 8C. For example, as shown in FIG. 8A, the polarizing plate 14 has a three-layer structure in which TAC (Tri Acetyl Cellulose) films 14b and 14b are attached to the PVA (Poly Vinyl Alcohol) film 14a to which polarizing performance is applied, and is reinforced. The liquid crystal panel 52 and the protective cover 60 are connected to each other by the transparent adhesive 14e.

Further, for example, as shown in FIG. 8B, the polarizing plate 14 has a two-layer structure in which the back surface of the PVA film 141 imparting polarizing performance is adhered to the TAC film 14b to be reinforced, and the liquid crystal panel 52 is bonded to the liquid crystal panel 52 by the transparent adhesive 14e. And the subsequent construction of the protective cover 60.

In addition, as shown in FIG. 8C, the polarizing plate 14 has a three-layer structure in which the PVA film 14a and the reinforcing TAC film 14b which impart polarizing performance are sequentially attached to the phase difference plate 14c, and the liquid crystal is adhered by the transparent adhesive 14e. The panel 52 and the protective cover 60 are constructed next.

The protective cover 60 is, for example, a transparent plate made of glass or plastic, and is attached to the polarizing plate 14 on the front side. Further, the protective cover 60 is fixed to the body or the casing of any device provided with the LCM 51, and has an area larger than the polarizing plate 14 on the surface side.

Then, in the present embodiment, the first and third microphones 2A shown in Fig. 7 are adhered to the back surface of the peripheral edge portion 60a of the protective cover 60 on the outer side of the peripheral edge of the polarizing plate 14 on the surface side. 2C, and 4 microphones composed of the 2nd and 4th microphones not shown in Fig. 7.

The position of the four microphones on the plane is the same as that of the first embodiment, and is located at the center of each side of the display screen of the LCM 51 (the surface of the polarizing plate 14 on the front side) (see FIG. 2A). However, the four microphones are arranged in pairs on two straight lines which are on the same plane facing the back side of the display screen of the LCM 51 (the surface of the polarizing plate 14 on the front side).

Further, in the present embodiment, the instructions are also configured by four microphones including the first and third microphones 2A and 2C, an amplifier 3 to which four microphones are connected, an A/D converter 4, and a position acquisition unit 5. Position detection device. Further, the amplifier 3, the A/D converter 4, and the position acquisition unit 5 have the same configuration and function as those of the first embodiment.

In the present embodiment which is configured as described above, when any position of the display screen of the LCM 51 is instructed by an indicator or a fingertip such as the stylus pen 30, it is provided by four on the back surface of the peripheral edge portion 60a of the protective cover 60. The microphone detects the indicator tone. Next, the position acquisition unit 5 calculates a coordinate position (x, y) belonging to the indicated position information indicating the source of the indication sound by the same method as in the first embodiment. Therefore, it is not necessary to cover the display screen of the LCM 51 with the film provided with the electrode grid, and the indication position in the display screen can be detected without lowering the display characteristics of the LCM 51.

According to the present embodiment, even when four microphones are provided on the back surface of the peripheral edge portion 60a of the protective cover 60, the four microphones can be placed on the outer peripheral portion of the display screen of the LCM 51 as in the first embodiment. Anywhere. For example, four microphones can also be arranged at each corner of the display screen (see Fig. 5). In addition, the four microphones may not necessarily be arranged on the same plane.

Further, as shown in the present embodiment, even when four microphones are provided on the back surface of the peripheral edge portion 60a of the protective cover 60, the position obtaining unit 5 calculates the coordinate position (x, y) indicating the source of the indication sound. The specific calculation method can employ various calculation methods described in the first embodiment. In addition, the position acquisition unit 5 may acquire the indicated position described in the first embodiment as the indicated position information indicating the source of the indication sound.

Further, the number of microphones provided on the back surface of the peripheral edge portion 60a of the protective cover 60 may be three.

On the other hand, in the LCM 51 shown in the present embodiment, the liquid crystal panel 52 is protected from the impact by the pointing finger or the fingertip by the protective cover 60 by the protective cover 60. Therefore, in the glass substrate constituting the liquid crystal panel 52, a thin one having a thickness of about 0.7 mm to 0.5 mm can be used. Further, if the protective cover 60 can secure a thickness of about 0.20 mm, the LCM 51 can be protected. Therefore, for example, when the thickness of the polarizing plates 14 and 15 is 0.17 mm and the brightness increasing film 53 is 0.06 mm, the entire thickness of the protective cover 60 and the LCM 51 can be formed to be about 2.0 mm to 1.60 mm.

[Third embodiment]

In the first embodiment and the second embodiment, the case where the instruction position on the second-order plane on the display screen is used as the instruction position is described. However, in the third embodiment, the detection is overlapped on the display screen. The space, that is, the case where the indicated position in the 3-dimensional space on the display screen is used as the pointing position will be described.

FIG. 9 is a view showing a configuration of the portable information terminal 100 having a configuration as a pointing position detecting device or a display device. The portable information terminal 100 includes various functions such as a schedule management function, a data reference function such as a dictionary, and a pen input function, and has the following configuration.

As shown in FIG. 9, the main body 102 of the portable information terminal 100 is horizontally long. On the surface of the main body 102, a horizontally long display unit 103 for displaying various kinds of information such as text information or video information, a power button 104, and use are provided. The plurality of operation keys 105a to 105e used when the portable information terminal 100 is operated.

Further, the first to fourth microphones 6A to 6D are provided on the outer peripheral portion of the display unit 103.

Fig. 10 is a cross-sectional view showing a schematic structure of the display unit 103. The display unit 103 is constituted by an LCM 31 that can perform color display. The LCM 31 is composed of two transparent glass substrates 32 and 33 on the front side and the back side, a liquid crystal 34 sealed between the two glass substrates 32 and 33, and polarizing plates 35 and 36 attached to the outer surfaces of the glass substrates 32 and 33, respectively. The light guide plate 37 and the light reflection sheet 38 provided on the back surface of the polarizing plate 36 on the back side are formed. In addition, a light source such as an LED (light emitting diode) is disposed on an outer peripheral portion of the light guide plate 37 (not shown).

A pattern of transparent pixel electrodes 39 is formed on the inner surface of the glass substrate 33 on the back side, and TFTs 40 are formed in portions of the pixel electrodes 39 corresponding to the pixels. On the inner surface of the glass substrate 32 on the front side, the color filter 41 having a predetermined color arrangement and the transparent common electrode 42 are sequentially laminated to form a pattern.

The periphery of the polarizing plate 35 on the front side of the LCM 31 is covered by a frame cover 43 constituting the surface of the body 2. The frame cover 43 is formed with an opening that exposes the display window 43a of the polarizing plate 35 on the front side, and the first to fourth microphones 6A to 6D are disposed inside the display window 43a. Further, in the portable information terminal 100, a rectangular area recognized by the display window 43a on the display surface of the LCM 31 (the surface of the polarizing plate 35 on the front side) is the display screen 31a.

As shown in FIG. 9, the first to fourth microphones 6A to 6D are orthogonal to each other on the center QQ of the display screen 31a, and are parallel to the display screen 31a, that is, the same as the display screen 31a. The two straight lines LL and MM existing on the plane are arranged in pairs. In other words, the first and third microphones 6A and 6C are arranged in pairs on the straight line LL parallel to the long side of the display screen 31a, and the second and fourth microphones 6B and 6D are on the short side of the display screen 31a. Parallel other lines MM are arranged in pairs. Here, Fig. 10 is a cross-sectional view along the straight line LL.

The first to fourth microphones 6A to 6D are for individually detecting the instruction sounds emitted by the stylus pen 70 shown in FIG. 10 prepared in the portable information terminal 100.

The stylus pen 70 is used when a user inputs text information or the like using the pen input function of the portable information terminal 100, and includes a pen-type main body 71 and a small push button switch 72 provided on the circumferential surface of the main body 71. Further, the push button switch 72 is an automatic recovery type that maintains the operating state only during the pressing by the user.

Inside the main body 71 (not shown) of the stylus pen 70, a small power source and a small speaker or a buzzer including a front end portion of the main body 71 and generating an instruction sound when the push button switch 72 is pressed are built therein. The indicator sound generation circuit of the sound emitting unit. Next, the stylus pen 70 is operated to periodically emit an instruction sound of a specific frequency band at a constant time interval (n times/second) while the push button switch 72 is being pressed.

Fig. 11 is a schematic block diagram showing the electrical configuration of the portable information terminal 100. The portable information terminal 100 includes a control unit 151, a ROM (Read Only Memory) 152, a flash memory 153, a key input unit 154, a drive circuit 155, and a signal processing unit 156. The LCM 31 is connected to the drive circuit 155, and the first to fourth microphones 6A to 6D are connected to the signal processing unit 156 via the amplifier 157.

The control unit 151 is composed of a CPU (Central Processing Unit) and its peripheral circuits. The control unit 151 controls the operation of the portable information terminal 100 in accordance with various control programs stored in the ROM 152, and functions as the time difference acquisition unit 151a and the position information acquisition unit 151b of the present invention. The control program is an essential software (OS: Operating System) that is indispensable for the control of the portable information terminal 100, and a plurality of application software for realizing the functions of the portable information terminal 100. In addition to the above-described control program, the ROM 152 stores various materials such as dictionary materials.

The flash memory 153 is a non-volatile semiconductor memory that stores setting data of the operation of the portable information terminal 100 or text information input by the user.

The key input unit 154 is a plurality of operation keys 105a to 105e shown in FIG. 9, and supplies an operation signal generated in response to an operation key operated by the user to the control unit 151.

The drive circuit 155 generates a drive signal for driving the LCM 31 according to an instruction from the control unit 151, and causes the display screen 31a to display predetermined text information or video information by supplying the generated drive signal to the LCM 31.

The signal processing unit 156 converts the output signals of the first to fourth microphones 6A to 6D amplified by the amplifier 157, that is, analog audio signals into digital signals, and performs filtering processing such as noise removal, and performs filtering processing. The subsequent audio signal is supplied to the control unit 151.

Next, in the portable information terminal 100, when the user uses the pen input function, the first to fourth microphones 6A to 6D detect the indication sound emitted by the stylus pen 70, and the control unit 151 acquires the indication sound. The indication position information of the position is indicated as the indication position of the transmission position of the indication sound indicated by the user with respect to the display screen 31a.

The instruction position information acquired by the control unit 151 indicates an arbitrary position in the three-dimensional space. That is, the indication position information is the coordinate position P(x, y, z) of the orthogonal coordinates as shown in FIG. 12A, and the lower left corner of the display screen 31a is set as the origin (0, 0, 0), and The long side of the display screen 31a is set to the x-axis, and the coordinate position when the short side of the display screen 31a is set to the y-axis. Here, FIG. 12B is a view showing coordinate positions of the first to fourth microphones 6A to 6D on the XY plane in the orthogonal coordinates.

Next, a method of obtaining the indicated position information in the control unit 151 will be described. When the stylus 70 emits an instruction sound at an arbitrary position, the phono is transmitted at a constant speed (sonic speed) in each direction. In this case, when there is a difference in the distance from the signal transmitting position of the indicator sound to the respective microphones of the first to fourth microphones 6A to 6D, if any two microphones are set as one set, the indicator sound is set between the respective groups of microphones. The arrival time will vary.

Fig. 13A is a diagram showing a change in the sound pressure level in the output signals of the first to fourth microphones 6A to 6D when the indicator sound is generated, and a difference in the arrival time of the indicator sound in each microphone of the predetermined complex array microphone. Figure. In Fig. 13A, the horizontal axis is time, the vertical axis is the sound pressure level, and the time (t _A , t _B , t _C , t _D ) at which the respective sound pressure levels reach the peak is the first to fourth microphones 6A to ～ The detection timing of the indication sound in 6D is the timing at which the indication sound arrives in the present embodiment. Further, the sound pressure level is a sound pressure level in a predetermined frequency band of the indication sound emitted by the stylus pen 70.

Further, in Fig. 13A, the arrival time difference of the indication sound between the microphones of the first and third microphones 6A and 6C is t _AC , and similarly formed by the second and fourth microphones 6B and 6D. The arrival time difference of the indicator sound between the set of microphones is t _BD , and the arrival time difference between the indicator sounds of the set of microphones formed by the first and fourth microphones 6A, 6D is t _AD .

Next, by multiplying the arrival time difference (t _AC , t _BD , t _AD ) of the indication sound between the respective sets of microphones by the speed of sound, a distance difference from the transmission position of the indicator sound between the respective sets of microphones can be obtained.

Here, the point in the space which is apart from the first and third microphones 6A and 6C by a certain distance is present in the hyperboloid (double-leaf hyperboloid) focusing on the first and third microphones 6A and 6C. Similarly, a point in a space having a certain distance difference from the second and fourth microphones 6B and 6D exists in a hyperboloid having the second and fourth microphones 6B and 6D as focal points. Further, a point in a space having a predetermined distance from the first and fourth microphones 6A and 6D exists in a hyperboloid having the first and fourth microphones 6A and 6D as focal points.

Therefore, the intersection of the hyperboloids with the respective sets of microphones as the focus is the position of the transmission of the indication sound, that is, the indicated position with respect to the display screen 31a. That is, Fig. 13B shows a slit when the respective hyperboloids having the respective sets of microphones as the focus are cut in a plane parallel to the display screen 31a, that is, a hyperbola. As shown in Fig. 13B, the first hyperboloid (hyperbola) 10p, 10q with the first and third microphones 6A, 6C as the focus, and the second hyperboloid with the second and fourth microphones 6B, 6D as the focus ( The hyperbola) 20p, 20q, and the intersection of the third hyperboloids (hyperbolic) 30p, 30q with the first and fourth microphones 6A, 6D as the focus become the indication position P. In addition, the 13B chart is only for the convenience of displaying each hyperboloid (hyperbolic), and the shape or positional relationship is actually different.

On the other hand, each hyperboloid focusing on each group of microphones can be represented by the following formula (6). However, Equation (6) is a general formula when the focus is present on the z-axis.

Further, since the distance (L _x ) between the first and third microphones 6A and 6C is known, when the distance difference to the pointed position P is 2a _x , the following expression can be obtained from the above formula (6) ( 7) is a numerical expression indicating the first hyperboloids 10p and 10q focusing on the first and third microphones 6A and 6C.

Similarly, since the distance (L _y ) between the second and fourth microphones 6B and 6D is known, when the distance difference to the pointing position P is 2a _y , the following expression can be obtained from the above formula (6). (8) A numerical expression indicating the second hyperboloids 20p and 20q having the second and fourth microphones 6B and 6D as the focus.

On the other hand, it is assumed that the first and fourth microphones 6A and 6D are located on the x-axis, and the first microphone 6A is located at the origin (0, 0, 0), and the distance between the first and fourth microphones 6A and 6D is set. the distance (x), indicating the approaching position P is set to a distance difference 2a _xy, as represented by the above formula (6) can be obtained by the following formula (9) in the first and fourth microphones 6A, 6D as the virtual focus of The form of the hyperboloid.

Further, the coordinate position (x, y, z) of each point of the hyperboloid existing in the above imaginary can be converted into the first and fourth microphones 6A, 6D as the focus by using the following formula (10) for conversion. The coordinate position (x, y, z) in the actual third hyperboloids 30p, 30q.

Therefore, from the equations (9) and (10), the following equation (11) can be obtained as a equation representing the third hyperboloids 30p and 30q having the first and fourth microphones 6A and 6D as the focus.

Therefore, the coordinate positions (x, y, z) satisfying all the equations (7), (8), and (11) are the intersections of the hyperboloids with the focus of each group of microphones as the focal point, and become the transmission position of the indicator sound. That is, the coordinate position (x, y, z) of any indicated position P with respect to the display screen 31a.

However, for example if the difference in arrival time for each group of microphones _{(t AC, t BD, t} AD) there is an error, due to the difference in distance to the sender indicating the location of the sound between the groups microphone distance (2a _x, 2a _y, 2a _xy ) also produces an error, so the coordinate positions (x, y, z) satisfying all equations (7), (8), and (11) cannot be obtained.

Therefore, in the control unit 151, the coordinate position (x, y, z) of the arbitrary indication position P, that is, the position information is obtained, by using the following formula (12).

n={F(x,y,z)} ² +{G(x,y,z)} ² +{H(x,y,z)} ²

among them,

F(x, y, z) = (left) - (right) of equation (6)

G(x, y, z) = (left) - (right) of equation (6)

H(x, y, z) = (left) - (right) of equation (6) ... (12)

The above formula (12) is a distance difference (2a _x , 2a _y , 2a) which is obtained from the arrival time difference (t _AC , t _BD , t _AD ) of each group of microphones and the position of the sounding of the indicator sound between each group of microphones. _When there is no error in _xy ), the operation result (n) becomes a discriminant of 0 (specific value).

The specific sequence when the control unit 151 acquires the position information is as follows. That is, in the control unit 151, the coordinate values of (0, 0, 0) to (L _x , L _y , L _z ) are sequentially substituted in the coordinate value (x, y, z) of the above formula (12). The calculation result (n) is obtained separately. Here, the z coordinate (L _z ) in the coordinate values (L _x , L _y , L _z ) is predetermined as the maximum coordinate position of the detection range in the z-axis indicating the position. In other words, the control unit 15 obtains the coordinate values of the points of the three-dimensional space in a certain range above the display screen 31a in order to substitute the coordinate values (x, y, z) of the equation (12). Results (n). Next, the control unit 151 obtains the coordinate value (x, y, z) when the calculation result (n) is the minimum as the indication position information.

However, in the portable information terminal 100, three types of operation modes, such as a soft key mode, a brush mode, and a line drawing mode, are prepared in advance as an operation mode for using the pen input function, and when the pen input function is used, the user can set any desired as needed. Action mode. The soft key mode is an operation mode prepared for inputting characters or symbols, and the brush mode and the line drawing mode are operation modes prepared for inputting a line graph.

Then, in the portable information terminal 100, when the three types of operation modes are set, the control unit 151 also functions as the time difference acquisition unit 151a and the position information acquisition unit 151b of the present invention, and also functions as a display. The functions of the control unit 151c and the input processing unit 151d.

Hereinafter, the operation content of the specific acquisition order of the indicated position information by the control unit 151 when the pen input function is used by the user in the portable information terminal 100 will be described.

(softkey mode)

First, the operation of the portable information terminal 100 when the user sets the soft key mode will be described. 14 and 15 are flowcharts showing the processing contents of the control unit 151, and Fig. 16 is a view showing the operation of the stylus pen 70 in the soft key mode setting and the display screen of the LCM 31 in response to the operation of the stylus pen 70. An explanatory diagram of an example of a change in display content in 31a.

As shown in Fig. 14, the control unit 151 starts the operation while setting the soft key mode, first starts the detection operation of the instruction sound emitted by the stylus pen 70, and causes the display screen 31a of the LCM 31 to display the sixteenth image. The soft key 501 is shown (step SA1).

Here, the detection operation of the instruction sound sequentially confirms the change of the sound pressure level of the output signals in the first to fourth microphones 6A to 6D, and the control unit 151 is before the start of the detection operation of the instruction sound. A count of the elapsed time used for the calculation of the arrival time difference of the indicator sound in each microphone of the illustrated complex array microphone.

Further, the soft key 501 is an image composed of a plurality of operation keys, and each operation key of the soft key 501 is assigned with a plurality of symbols such as an English letter or a dot or a period. The soft key 501 in the initial state displayed in step SA1 displays one of the English letters or symbols assigned to the respective operation buttons for each operation button. That is, as shown in Fig. 16, "A", "F", "K", "P", "U", and "Z" are displayed.

Further, although not shown in FIG. 16, each operation button 501a constituting the soft key 501 as shown in FIG. 17A indicates other English letters or symbols assigned to the respective operation buttons 501a in addition to the above-mentioned English letters. The guidance text ("A to E", "Z., -@", etc.) is displayed in a manner smaller than the above-mentioned English letters.

On the other hand, in each of the operation buttons 501a constituting the soft keys 501, a plurality of stages of operation positions are imaginarily provided in the pressing direction (the opposite direction to the z-axis direction), and the operation positions at the respective stages are assigned to be assigned the same One of the specific English letters or symbols of the operation button 501a is operated. For example, in each operation button 501a, a five-stage operation position is imaginarily provided, and as shown in FIG. 17B, "A" is assigned to the first layer operation position of the operation button 501a to which "A to E" is assigned, and "B" to "E" are assigned to the respective operation positions of the second to fifth layers. In other words, the control unit 151 displays the English letters or symbols assigned to the first layer operation positions of the respective operation buttons 501a by the respective operation buttons 501a of the soft keys 501 in the initial state.

In the following description, the English letters and symbols assigned to the respective layer positions of the operation buttons 501a are referred to as characters or the like.

After the processing of step SA1 is performed, the control unit 151 sequentially confirms whether or not the indication sound of the stylus pen 70 has been detected (step SA2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference.

Next, when the control unit 151 can confirm that the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference (step SA2: YES), it is determined that the indication sound can be detected at that point in time. The pointed position information indicating the pointed position belonging to the source of the indication sound, that is, the coordinate position (x, y, z) in the orthogonal coordinates shown in Fig. 12A is obtained by the method described above (step SA3).

Fig. 15 is a flow chart showing the procedure for obtaining the position information in the control unit 151. When the instruction position information is acquired, the control unit 151 sets the point at which the sound pressure level of the output signals of the first to fourth microphones 6A to 6D is peaked at the time point when the indication sound arrives in each microphone.

Next, the control unit 151 subtracts the elapsed time (t _A ) at the time when the first microphone 6A reaches the instruction sound by the elapsed time (tc) at the time when the third microphone 6C reaches the instruction sound, thereby obtaining the first sum. The arrival time difference t _AC of the indicator sounds in the third microphones 6A, 6C (step SA101).

Further, the control unit 151 obtains the elapsed time (t _B ) at the time when the second microphone 6B indicates the arrival of the sound by the elapsed time (t _D ) at the time when the fourth microphone 6D indicates the arrival of the sound. the second and fourth microphones 6B, 6D, the arrival time difference of sound indicated t _BD (step SA102).

Further, the control unit 151 obtains the elapsed time (t _A ) at the time point when the first microphone 6A indicates the arrival of the sound by subtracting the elapsed time (t _D ) at the time when the fourth microphone 6D indicates the arrival of the sound. 1 and 4 microphones 6A, 6D of the difference in arrival time indicator tone t _AD (step SA103).

Next, the control unit 151 sequentially sets coordinate positions of (0, 0, 0) to (L _x , L _y , L _z ) as coordinate positions of arbitrary points in the orthogonal coordinates shown in FIG. 12A ( The processing of x, y, z) (step SA104), the equation (12) of the discriminant described above, the substitution of the set coordinate position (x, y, z), and the steps SA101 to SA103 The arrival time difference (t _AC , t _BD , t _AD ) of each group of microphones is obtained, and the calculation result (n) is obtained (step SA105), and the obtained calculation result (n) and the set coordinate position (x, y, z) correspond to and are memorized in the internal memory (step SA106). Thereafter, the system control unit 151 repeatedly perform the processing until step SA104 ~ Step coordinate position (x, y, z) becomes _{(L x, L y, L} z) (step SA107: NO) the SA106.

Next, the control unit 151 stores the calculation result (n) when the coordinate position (x, y, z) is substituted for (L _x , L _y , L _z ) (step SA107: Yes), and confirms all the operations that are memorized. As a result, in (n), the coordinate position (x, y, z) at the time of the calculation result (n) of the minimum value is obtained, and the confirmed coordinate position (x, y, z) is obtained as the coordinate position indicating the pointed position, that is, the indication Location information (step SA108).

Here, the specific processing order of the coordinate position (x, y, z) at which the calculation result (n) of the equation (12) becomes the minimum value is arbitrary.

On the other hand, after acquiring the coordinate position (x, y, z) as the pointing position information, the control unit 151 returns to the processing shown in FIG. 14 and confirms that it corresponds to the acquired coordinate position (x, y, z). Whether or not the pointed position (x, y) in the display screen 31a is within the button area (step SA4). That is, the control unit 151 confirms whether or not the coordinate position (x, y) of the XY plane indicated by the acquired coordinate position (x, y, z) is included in the display area of any operation button 501a constituting the soft key 501. Inside.

Next, when the pointed position (x, y) in the display screen 31a is not in the button area (step SA4: NO), the control unit 151 returns to the processing of step SA2 without doing anything. Further, when the instruction position (x, y) in the display screen 31a is within the button area (step SA4: YES), the control unit 51 confirms whether or not the operation button corresponding to the instruction position (x, y) is already selected. The operation button in (step SA5).

At the beginning of the process, even if the pointed position (x, y) in the display screen 31a is within the button area, the operation button corresponding to the pointed position (x, y) is not the selected operation button (step SA5: NO). . Therefore, the control unit 151 first reversely displays the character or the like (the character or symbol of the first layer operation position) on the operation button at the position corresponding to the instruction position (x, y), and selects the operation button as the selection. The operation button is used to memorize the predetermined button identification information indicating the operation button in the internal memory (step SA6). Further, the control unit 151 stores the z coordinate of the coordinate position (x, y, z) acquired in step SA3 as the reference position in the z-axis direction (height direction) in the internal memory (step SA7), and immediately returns. Processing of step SA2.

Therefore, when the user moves the front end portion of the stylus pen 70 toward the "A to E" operation button while pressing the button switch 72, for example, the operation buttons of "A to E" are memorized as the selected operation. The button is pressed, and as shown in the state I of Fig. 16, the character of the "A" of the first layer is reversely displayed. At the same time, the position of the front end portion of the stylus pen 70 in the vertical direction is memorized.

Next, the control unit 151 acquires a new coordinate position (x, y, z) every time the instruction sound is detected (step SA2: YES) (step SA3). Next, when the new coordinate position (x, y, z) is acquired in step SA3, the control unit 151 sets the pointed position (x, y) in the display screen 31a in the button area (step SA4: YES). However, when the operation button corresponding to the indication position (x, y) is not the selected operation button, that is, when the operation button corresponding to the indication position (x, y) is changed to another operation button (step SA5: NO), The processing of steps SA6 and SA7 is performed again.

In other words, the control unit 151 is an operation button or the like that reversely displays the character being displayed on the position corresponding to the new instruction position (x, y), and uses the operation button as the selected operation button to indicate the operation. The predetermined key recognition information of the button is memorized in the internal memory (step SA6).

Further, the control unit 151 stores the z coordinate of the newly acquired coordinate position (x, y, z) as the reference position in the z-axis direction in the internal memory (step SA7).

Therefore, when the user presses the push button switch 72, for example, when the front end portion of the stylus pen 70 is moved from the operation button to which "A to E" is assigned to the operation button to which "K to O" is assigned, " The operation key of K to O" is memorized as the operation key selected, and as shown in the state II of Fig. 16, the character of the "K" of the first layer is reversely displayed. At the same time, the position of the front end portion of the stylus pen 70 in the vertical direction is memorized.

Further, when the new coordinate position (x, y, z) is acquired in step SA3, the control unit 151 sets the instruction position (x, y) in the display screen 31a in the button area (step SA4: YES). Further, when the operation button corresponding to the pointed position (x, y) is the selected operation button (step SA5: YES), it is confirmed whether or not there is a change in the z coordinate (step SA8).

If there is no change in the z coordinate (step SA8: NO), the control unit 151 immediately returns to the process of step SA2. Further, when the control unit 151 changes the z coordinate (step SA8: YES), the control unit 151 subtracts the value of the new z coordinate from the value of the z coordinate stored as the reference position, thereby calculating the indicated position (indicating sound). The amount of movement of the reference position stored in step SA7 in the downward direction is transmitted (step SA9). In the process of step SA9, the control unit 151 sets the amount of movement to 0 when the amount of movement is a negative value.

Next, the control unit 51 confirms whether or not the character or the like in the reverse display is a character or the like of the operation position (layer position) determined in advance in accordance with the amount of movement calculated in step SA9 (step SA10). In addition, the amount of movement and the layer position are presented each time the amount of movement is increased by a certain amount, and the operation position is increased by one layer.

Then, if the character or the like in the reverse display is a character or the like of the layer position corresponding to the calculated amount of movement (step SA10: YES), the control unit 151 returns to the processing of step SA2 without doing anything. On the other hand, if the character in the reverse display is not the character of the operation position corresponding to the calculated movement amount (step SA10: NO), the control unit 151 changes the character or the like in the reverse rotation to the amount corresponding to the movement amount. After the character or the like of the operation position is used (step SA11), the process returns to step SA2.

Therefore, when the user presses the push button switch 72 and moves the front end portion of the stylus pen 70 toward the upper side of the operation button to which "K to O" is assigned, the front end portion of the stylus pen 70 faces the display screen 31a side. When the predetermined amount is moved (lower side), as shown in the state III of Fig. 16, the character in the reverse rotation is changed from "K" to "N", for example.

On the other hand, the control unit 151 does not have an instruction sound while the processing of step SA2 and subsequent steps is repeated (step SA2: NO), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, continues to be longer than the stylus pen 70. When the transmission interval of the indicator sound is longer than the predetermined time (step SA12: YES), the following processing is performed.

First, the control unit 151 checks whether or not the pointed position (x, y) in the previous display screen 31a is within the button area (step SA13). When the previous instruction position (x, y) is in the button area (step SA13: YES), the control unit 151 displays the character or the like in the selected operation button display on the predetermined character input on the display screen 31a. Area (step SA14). That is, input processing of text information is performed.

Therefore, if the user stops the operation of pressing the push button switch 72 and stops the occurrence of the indication sound in the state shown in the state III of Fig. 16, for example, as shown in the state IV of Fig. 16, the display screen 31a is displayed. Enter the text of "N" in the predetermined text input area.

Further, when the control unit 151 is in the processing step SA13, when the previous instruction position (x, y) is not in the button area (step SA13: NO), after the soft key 501 is initialized, the soft key 501 is restored to After the same initial state as that displayed in step SA1 (step SA), the process returns to step SA2.

Thereafter, the control unit 151 repeatedly executes the processing in and after step SA2 while the user releases the soft key mode.

As described above, when the portable information terminal 100 sets the soft key mode when the pen input function is used, the user uses the stylus pen 70 to input a desired character or the like.

(brush mode)

Next, the operation of the portable information terminal 100 when the user sets the brush mode will be described. Fig. 18 is a flowchart showing the processing contents of the control unit 151, and Fig. 19 is a view showing the operation of the stylus pen 70 in the brush mode setting and the display content in the display screen 31a of the LCM 31 in response to the operation of the stylus pen 70. An illustration of an example of a change.

As shown in Fig. 18, the control unit 151 starts the operation while setting the writing brush mode, first starts the detection operation of the pointing sound emitted by the stylus pen 70, and sets the thickness (line width) of the line to be drawn to be The determined reference thickness (step SB1). Further, the detection operation of the indicator sound is the same as the case of the soft key mode, and the control unit 151 starts counting the time difference of the arrival of the indicator sound in each microphone of the complex array microphone described above when the detection operation of the instruction sound starts. The elapsed time used in the calculation.

After the processing of step SB1 is performed, the control unit 151 sequentially checks whether or not the indication sound of the stylus pen 70 has been detected (step SB2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference.

When the control unit 151 can confirm that the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference, it is determined that the indicator sound can be detected at that time (step SB2: YES). The above-described processing shown in FIG. 15 acquires the indicated position information indicating the pointed position belonging to the source of the indication sound, that is, the coordinate position (x, y, z) in the orthogonal coordinates shown in FIG. 12A (step SB3).

Next, the control unit 151 confirms whether or not the coordinate position (x, y) of the XY plane displayed by the acquired coordinate position (x, y, z) is in the position on the display screen 31a (step SB4).

When the pointed position (x, y) is not in the display screen 31a (step SB4: NO), the control unit 151 returns to the processing of step SB2 without doing anything. Further, when the indication position (x, y) is within the display screen 31a (step SB4: YES), the control unit 151 further confirms whether or not the drawing is in progress (step SB5). Further, the confirmation in step SB5 is performed by confirming whether or not the internal memory stores a drawing flag to be described later.

At the beginning of the process start, even if the pointed position (x, y) is within the display screen 31a, it is not in the state of drawing (step SB5: NO). Therefore, the control unit 151 first stores the z coordinate of the coordinate position (x, y, z) acquired in step SB3 as the reference position in the z-axis direction (height direction) in the internal memory (step SB6).

Further, the control unit 151 stores the instruction position (x, y) in the display screen 31a as the drawing position in the internal memory, and sets the drawing flag indicating the drawing (step SB7). In addition, the setting of the flag is to describe the processing of the flag in the internal memory. Then, the control unit 151 displays the start point at the instruction position (x, y) in the display screen 31a (step SB8), and temporarily returns to the process of step SB2.

That is, when the user presses the push button switch 72 in a state where the front end portion of the stylus pen 70 is positioned above the desired position of the display screen 31a, as shown in the state I of Fig. 19, on the display screen 31a The desired position shows the starting point S. At the same time, the indicated position (x, y) in the display screen 31a and the position in the upper and lower directions of the front end portion of the stylus pen 70 are memorized.

Next, the control unit 151 acquires a new coordinate position (x, y, z) every time the instruction sound is detected (step SB2: YES) (step SB3). Next, when the new coordinate position (x, y, z) is acquired in step SB3, the control unit 151 sets the coordinate position (x, y) of the XY plane to the position in the display screen 31a (step SB4: Yes), and In the drawing (step SB5: YES), the coordinate position (x, y) of the new XY plane is stored in the internal memory as the current drawing position (step SB9).

Then, the control section 151 performs the following processing. First, the control unit 151 confirms whether or not the z coordinate is changed (step SB10). Next, if the z coordinate is not changed (step SB10: NO), the control unit 151 immediately draws the current drawing position (x, y) and the current drawing position (x, y) in the display screen 31a, and draws the current drawing. The thickness of the position (x, y) is set to the thickness of the setting (step SB13).

On the other hand, the control unit 151 calculates the indication position (instruction sound) by subtracting the value of the new z coordinate from the value of the z coordinate stored as the reference position when the z coordinate is changed (step SB10: YES). The amount of movement of the reference position stored in step SB6 in the up and down direction in the transmission position) (step SB11). That is, the control unit 151 obtains a positive or negative value as the amount of movement.

Next, the control unit 151 increases or decreases the thickness of the line to be drawn in accordance with the calculated amount of movement (step SB12). In the process of step SB12, when the calculated movement amount is a positive value and the instruction position is moved downward from the reference position, the control unit 151 performs the thickness of the line to be drawn in accordance with the degree of the movement amount. Also have a rough setting. Further, in the processing of step SB12, when the calculated movement amount is a negative value and the instruction position is moved upward from the reference position, the control unit 151 performs the line thickness to be drawn in accordance with the degree of movement. The thickness should be set even fine.

Then, the control unit 151 draws between the previous drawing position (x, y) and the current drawing position (x, y) in the display screen 31a, and draws the thickness of the current drawing position (x, y) as the setting. Thick lines (step SB13). Thereafter, the control unit 151 temporarily returns to the processing of step SB2, and repeats the processing of steps SB9 to SB13 every time the instruction sound is detected while the indication sound is detectable.

Therefore, as shown in the state I of FIG. 19, after the start point S is displayed on the display screen 31a, for example, when the user presses the push button switch 72 while moving the stylus pen 70 (the front end portion) in the oblique lower right direction, As shown in the state II of Fig. 19, a line K which is gradually thicker toward the right from the starting point S is drawn on the display screen 31a. Further, when the user moves the stylus pen 70 in the obliquely upper right direction, as shown in the state III of Fig. 19, the thickness of the line K in the drawing is gradually thinned and extends to the right. That is, input processing of line graph information is performed.

On the other hand, the control unit 151 does not detect the indication sound while the processing of step SB2 and subsequent steps is repeated (step SB2: NO), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, the stylus pen 70 When the transmission interval of the indicator sound is longer than the predetermined time (step SB14: YES), the following processing is performed.

In other words, the control unit 151 restores the thickness of the line to be drawn to the reference thickness (step SB15), and sets the drawing flag to the OFF state (step SB16). The process of setting the drawing flag to the OFF state will depict the process in which the flag is erased by the internal memory. Thereafter, the control unit 151 returns to the processing of step SB2, and repeats the processing of step SB2 and subsequent steps while the user cancels the brush mode.

Therefore, after the user draws the desired line and temporarily stops the operation of pressing the push button switch 72 to stop the occurrence of the instruction sound, the button switch 72 is pressed again, whereby the drawing of the new line can be started.

As described above, when the pen input mode is set in the portable information terminal 100 when the pen input function is used, the user can draw a desired line by moving the stylus pen 70 in the vertical and horizontal directions with respect to the display screen 31a. At the same time, the user can move the stylus 70 up and down in the depiction of the line to change the thickness of the line. In other words, the user can draw a line, a character, or the like of a desired shape on the display screen 31a while adjusting the thickness of the line freely, in the same manner as when writing a line or a character with a brush.

(line drawing mode)

Next, the operation of the portable information terminal 100 when the user sets the line graph mode will be described. Fig. 20 is a flowchart showing the processing contents of the control unit 151, and Fig. 21 is a view showing the operation of the stylus pen 70 in the setting of the line graph mode, and the display screen 31a of the LCM 31 in response to the operation of the stylus pen 70. An explanatory diagram showing an example of a change in content.

As shown in Fig. 20, the control unit 151 starts the operation while setting the line graph mode, first starts the detection operation of the pointing sound emitted by the stylus pen 70, and sets the line thickness to be drawn as a predetermined reference. Thickness (step SC1). Further, the detection operation of the indicator sound is the same as in the case of the soft key mode and the brush mode, and the control unit 151 starts the time difference of the arrival of the indicator sound in each microphone of the complex array microphone described above at the time when the detection operation of the instruction sound starts. The count of elapsed time used in the calculation.

After the processing of step SC1 is performed, the control unit 151 sequentially confirms whether or not the indication sound of the stylus pen 70 can be detected (step SC2). In other words, the control unit 151 sequentially confirms whether or not the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference.

Next, when the control unit 151 can confirm that the sound pressure level of the output signals of the first to fourth microphones 6A to 6D exhibits a peak with a slight time difference, it is determined that the indication sound can be detected at that time (step SC2: Yes), The indicated position information indicating the indicated position belonging to the indication sound transmission position, that is, the coordinate position (x, y, z) in the orthogonal coordinate shown in FIG. 12A is obtained by the processing shown in FIG. (Step SC3).

Next, after the control unit 151 converts the z coordinate in the acquired coordinate position (x, y, z) into the y coordinate (step SC4), it is checked whether or not the converted coordinate position (x, y) is the display screen 31a. The position inside (step SC5).

If the converted coordinate position (x, y) is not in the display screen 31a (step SC5: NO), the control unit 151 returns to the processing of step SC2 without doing anything. Further, when the converted coordinate position (x, y) is within the display screen 31a (step SC5: YES), the control unit 15 further confirms whether or not the drawing is in progress (step SC6). In addition, the confirmation of step SC6 is performed by confirming whether or not the internal memory stores a flag to be described later.

At the beginning of the process start, even if the coordinate position (x, y) after the conversion is within the display screen 31a, it is not the state in the drawing (step SC6: NO). Therefore, the control unit 151 first stores the converted coordinate position (x, y) as the drawing position in the internal memory, and additionally sets the drawing flag indicating the drawing (step SC7). In addition, the setting of the flag is to depict the processing of the flag in the internal memory. Then, the control unit 151 displays the start point at the drawing position (x, y) in the display screen 31a (step SC8), and temporarily returns to the process of step SC2.

In other words, when the user presses the push button switch 72 while the front end portion of the stylus pen 70 is positioned above the desired position of the display screen 31a, as shown in the state I of FIG. 21, the starting point is displayed on the display screen 31a. S. At the same time, the drawing position (x, y) in the display screen 31a is memorized. However, unlike the case of the brush mode described above, since the vertical direction (y-axis direction) of the display screen 31a is the vertical direction (z-axis direction) of the three-dimensional space, for example, the front end portion of the stylus pen 70 abuts When the screen 31a is displayed, the display position of the start point S is a position that is in contact with the lower side of the display screen 31a.

Next, the control unit 151 acquires a new coordinate position (x, y, z) every time the instruction sound is detected (step SC2: YES) (step SC3), and obtains the obtained coordinate position (x, y, z). The z coordinate in the middle is converted to the y coordinate (step SC4).

Next, if the coordinate position (x, y) after the conversion is the position in the display screen 31a (step SC5: YES) and is in the drawing (step SC6: YES), the control unit 151 newly converts the converted coordinates. The position (x, y) is stored in the internal memory as the current drawing position (step SC9). Then, the control unit 151 draws a line connecting the previous drawing position (x, y) and the current drawing position (x, y) on the display screen 31a (step SC10).

Thereafter, the control unit 151 temporarily returns to the process of step SC2, and repeats the processes of steps SC4 to SC6, step SC9, and step SC10 each time the instruction sound is detected while the instruction sound is detectable.

Therefore, as shown in the state I of Fig. 21, after the start point S is displayed on the display screen 31a, for example, when the user presses the push button switch 72, the front end portion of the stylus pen 70 is oriented in a direction away from the display screen 31a ( When the upper portion is moved in a manner of drawing a spiral, the line K can be drawn on the display screen 31a in the order of the state II of the 21st drawing and the state III of the 21st drawing. That is, input processing of line graph information is performed.

That is, a line K indicating the trajectory of the tip end portion of the stylus pen 70 is drawn on the display screen 31a, and the line K is made to be parallel to the display screen 31a and coincides with the longitudinal direction (y-axis direction) of the display screen 31a. In the state in which observation is performed, that is, the line K in a state of being observed in a specific direction.

On the other hand, the control unit 151 cannot emit the instruction sound during the process of repeating the processing of step SC2 and subsequent steps (step SC2: NO), and the state in which the indication sound cannot be detected continues for a predetermined time or longer, that is, continues to be longer than the stylus pen 70. When the transmission interval of the indicator sound is longer than the predetermined time (step SC11: YES), the drawing flag is set to the OFF state (step SB16). The process of setting the drawing flag to the OFF state is a process of erasing the flag being erased by the internal memory. Thereafter, the control unit 151 returns to the processing of step SC2, and repeats the processing of step SC2 and subsequent steps until the user releases the line graph mode.

Therefore, after the user draws the desired line, the user temporarily stops the operation of pressing the button switch 72 to stop the signaling of the indicator sound, and then presses the button switch 72 again, whereby the drawing of the new line can be started.

As described above, when the portable information terminal 100 is set to the cable map mode when the pen input function is used, the user can move the stylus pen 70 on the upper side of the display screen 31a to the front end of the stylus pen 70. The portion corresponds to the movement trajectory of the 3-dimensional space, and a line graph indicating the shape when the movement trajectory is observed from a specific direction can be drawn.

In other words, the pointing position detecting device according to the third embodiment includes a display module having a display screen, and a plurality of microphones are disposed apart from each other on an outer peripheral portion of the display screen for detecting a three-dimensional element on the display screen. An indication sound generated by the space; the time difference acquisition unit acquires a time difference of arrival of the instruction sound between the two microphones in combination with the three types of microphones; and the position information acquisition unit is obtained by the time difference acquisition unit For each of the aforementioned arrival time differences, a hyperboloid with the aforementioned microphone corresponding to the arrival time difference is derived as a focal point, and the intersection of the three hyperboloids derived as the position is obtained as the position information for emitting the indication sound.

Next, in the portable information terminal 100 including the pointing position detecting device in the third embodiment, when the pen input function is used by the user, the touch is detected by the first to fourth microphones 6A to 6D. The instruction sound emitted by the pen 70 acquires the coordinate position (x, y, z) indicating the position of the front end portion of the stylus pen 70 belonging to the instruction sound transmission position based on the arrival time difference of the indication sound between the microphones of the groups. It is used as the indication position information indicating the indicated position on the display screen 31a.

Therefore, as shown in the case where the touch panel of the resistive film type is used to detect the pointed position on the display screen 31a, it is not necessary to cover the display screen 31a with other members. Therefore, the indicated position in the display screen 31a can be detected without degrading the display characteristics of the LCM 1.

Further, in the portable information terminal 100, in order to acquire the position information (x, y, z) of the third dimension as the pointing position information, the soft key 501 displayed on the display screen 31a in the soft key mode described above can be plural. A plurality of characters are assigned on one of the operation buttons. That is, the number of operation buttons displayed on the display screen 31a can be reduced as compared with the case where a character or the like is input by button selection on the screen using a general software keyboard. Therefore, by making the display area of the soft key 501 small, the display screen 31a can be effectively used when characters or the like can be input by the pen input function.

Further, in the above-described brush mode, as described above, the line thickness in the drawing of the display screen 31a is sequentially changed in response to the up and down movement of the stylus pen 70, thereby allowing the user to write lines or characters with a brush. The same feeling feels free to adjust the line thickness.

Further, in the aforementioned line graph mode, as described above, it is possible to correspond to the movement locus of the front end portion of the stylus pen 70 in the 3-dimensional space, and to draw a line graph indicating the shape when the movement locus is observed in a specific direction. Further, in the drawing operation of the online image, the user sequentially confirms the line graph (moving trajectory) caused by the viewpoint different from the actual viewpoint, thereby making it easier to display a slightly complicated three-dimensional shape line graph. Depiction.

In the implementation of the present invention, the configuration and the like of the portable information terminal 100 described in the present embodiment may be changed as follows.

For example, in the first to fourth microphones 6A to 6D, two straight lines LL and MM in which two sets of microphones are orthogonal to each other are disposed, and the two straight lines LL and MM may not exist in the same plane. Different planes parallel to each other. In addition, the two straight lines LL, MM may also exist in different planes that are not parallel to each other.

Further, as shown in the present embodiment, when the two straight lines LL and MM are orthogonal to each other, it is convenient to calculate the coordinate position (x, y, z) of the arbitrary indication position P on the display screen 31a, but two The straight lines LL and MM may be formed to intersect only in the display screen 31a at least when projected on the display screen 31a.

Further, the first to fourth microphones 6A to 6D may be arranged at respective corners of the display screen 31a as shown in FIG. In other words, the first to fourth microphones 6A to 6D may be arranged in pairs on the straight line L1 including the diagonal line of the display screen 31a and the straight line M1 including the other diagonal line.

Further, the first to fourth microphones 6A to 6D in the LCM 1 are provided so that when the user instructs an arbitrary position on the display screen 31a, the pointing sound emitted by the stylus pen 70 can be detected above the display screen 31a. Yes, it can be changed as appropriate. In other words, the first to fourth microphones 6A to 6D can be disposed at any position on the outer peripheral portion of the display screen 31a as long as they are separated from each other.

Further, in the present embodiment, the first to fourth microphones 6A to 6D are provided on the outer peripheral portion of the display screen 31a, and one of the three sets of microphones is set to one side of each of the other two sets of microphones. microphone. The first and fourth microphones 6A, 6D are also treated as a set of microphones.

However, for example, in addition to the first to fourth microphones 6A to 6D, the fifth microphone and the sixth microphone may be provided on the outer peripheral portion of the display screen 31a, thereby constituting two microphones that do not constitute other groups of microphones. A microphone of each of the three sets of microphones.

Further, for example, in addition to the first to fourth microphones 6A to 6D, the fifth microphone may be provided on the outer peripheral portion of the display screen 31a, and only one of the five microphones may be configured as two sets of microphones different from each other. To handle.

Further, only the first to third microphones 6A to 6C may be provided on the outer peripheral portion of the display screen 31a, and each of the three microphones may be configured to form one of the two sets of microphones and the other group. In other words, the first and second microphones 6A and 6B may be regarded as the first group, the second and third microphones 6B and 6C may be the second group, and the third and first microphones 6C and 6A may be regarded as the first group. 3 groups, to deal with separately.

Further, as described in the present embodiment, it is needless to say that four microphones of the first to fourth microphones 6A to 6D are provided on the outer peripheral portion of the display screen 31a, and five peripheral portions are provided on the outer peripheral portion of the display screen 31a as described above. In the case of a microphone or 6 microphones, any combination can be used for the combination of microphones of each group.

Further, even when three microphones, five microphones, or six microphones are provided on the outer peripheral portion of the display screen 31a, the specific arrangement of the microphones in the outer peripheral portion may be in any arrangement.

In addition, the control unit 151 can obtain the display screen 31a by using the following processing different from the present embodiment when the instruction sound is detected by adding the function of the position acquisition control unit and the correction unit of the present invention. Any of the coordinate positions (x, y, z) indicating the position P.

For example, the control unit 151 calculates the coordinate position (x, y, z) of the intersection point P of the three different hyperboloids shown in FIG. 13B in the order described in the embodiment, and obtains the calculation result as the first indication position. Processing of information. Next, the control unit 151 changes the third hyperboloids (hyperbolic) 30p and 30q having the first and fourth microphones 6A and 6D as the focus among the three hyperboloids, as shown in FIG. After the third microphones 6B and 6C are focused on the hyperboloids 40p and 40q, the coordinate positions (x, y, z) of the intersection points P of the three different hyperboloids are calculated in accordance with the same principle as the present embodiment.

In other words, the control unit 151 is configured to acquire the arrival time difference of the indicator sounds in each of the three sets of microphones formed by the other combination (the second combination) different from the combination (the first combination) in the present embodiment. The acquired arrival time difference of each group is calculated, and the coordinate position (x, y, z) of the intersection point P of the three hyperboloids is calculated, and the calculation result is obtained as the processing of the second indication position information. In addition, Fig. 23 is the same as Fig. 13B, and the shape or positional relationship is actually different only for the convenience of displaying each hyperboloid (hyperbolic).

Thereafter, the control unit 151 calculates the x coordinate of the point located between the x coordinate in the first indicated position information and the x coordinate in the second indicated position information, and obtains the calculation result as the corrected x coordinate. Similarly, the control unit 151 calculates the y coordinate of the point between the y coordinate in the first indicated position information and the y coordinate in the second indicated position information, and obtains the calculation result as the corrected y coordinate. Further, the control unit 51 calculates the z coordinate of the point located between the z coordinate in the first indicated position information and the z coordinate in the second indicated position information, and obtains the calculation result as the corrected z coordinate.

In other words, the control unit 151 corrects the first indication position information by the second indication position information, and obtains the coordinate position (x, y, z) formed by the coordinates of the corrected x, y, z as the third indication. The location information is obtained as the final indication location information.

As described above, when the combination of the microphones of the three sets of microphones is changed, the first indication position information and the second indication position information are obtained, and the obtained first indication position information is corrected by the second indication position information, thereby obtaining When the position information (third indication position information) is finally indicated, the detection accuracy of the indication position in the display screen 31a can be improved. Further, unlike the above example, when the first indication position information and the second indication position information are obtained, the combination of all the combined microphones of the three sets of microphones may be changed.

Further, in the present embodiment, when the position information is obtained by the control unit 151, the coordinate value (x, y, z) of the equation (12) is sequentially substituted into the third dimension indicating a certain range above the display screen 31a. The calculation result (n) is obtained by the coordinate value of each point of the space, and the coordinate value (x, y, z) when the calculation result (n) is the minimum is obtained as a configuration indicating the position information. However, an arbitrary method can be applied to the specific method of obtaining the position information (x, y, z) indicating the position information, that is, the intersection of the three hyperboloids (or the point at which the intersection can be determined).

On the other hand, the command sounds detected by the first to fourth microphones 6A to 6D may have characteristics in the frequency band of the audible range, or may have characteristics in the frequency band of the non-audible range. When the indicator sound is made to have a characteristic in the frequency band of the audible range, the user can be provided with a reliable operational feeling in the operation of the stylus pen 70. In addition, when the indicator sound is made to have a characteristic in the frequency band of the non-audible range, the user who is annoyed by the audible indication sound can provide a good operating environment, and the surrounding person can feel that the indication sound is noise. The bad situation disappeared.

Further, in the portable information terminal 100, in the detection mode of the indicator sound, the first detection mode in which the indication sound to be detected has a characteristic in the frequency band of the audible range, and the indication sound to be detected are in the non-detection The frequency band of the audible range has two detection modes such as the second detection mode of the characteristic, and the configuration of the detection mode of the instruction sound can be ensured by the user as needed. When the portable information terminal 100 secures the above configuration, the user can selectively use the indicator sound having the characteristic in the frequency band of the audible range and the frequency band emitted in the non-audible range according to the preference or the use environment. A characteristic sound is formed as a stylus.

In the present embodiment, when the soft key mode is set as the operation mode when the pen input function is used, the control unit 151 causes the display screen 31a of the LCM 31 to display the soft key 501 composed of a plurality of operation buttons. . However, in the soft key mode, if a plurality of stages of operation positions are imaginarily provided, the control unit 151 may be configured to display a single operation button on the display screen 31a.

Further, in the present embodiment, an example in which an English letter or a symbol is assigned to a plurality of operation buttons is shown as an example of the soft key 501. However, the soft keys 501 may be formed, for example, by dividing the numbers into a plurality of groups as assigners at the respective operation buttons.

Further, as long as the operation position corresponding to each stage of the allocation for the information in advance, the control unit 151 may LCM31 on the display screen 501 or the soft keys 31 _a single operation key is displayed, displaying additional information other than text information .

Further, in the present embodiment, when the line graph mode is set as the operation mode when the pen input function can be used, the control unit 151 is configured to display the line graph displayed on the display screen 31a of the LCM 31 so that the line of sight is parallel to the display screen 31a. And a line K of the trajectory of the front end portion of the stylus pen 70 in a state in which it is observed in the longitudinal direction (y-axis direction) of the display screen 31a. However, in the line graph mode, the control unit 51 may be configured such that the line graph displayed on the display screen 31a of the LCM 31 is, for example, a state in which the movement range of the end portion before the trajectory of the tip end portion of the stylus pen 70 is observed obliquely upward.

Further, the control unit 151 may not make the line graph displayed on the display screen 31a of the LCM 31 a single unit. In other words, for example, a line graph in a state where the trajectory of the tip end portion of the stylus pen 70 is viewed from the x-axis direction and a front end portion of the stylus pen 70 viewed from the y-axis direction may be simultaneously displayed on the display screen 31a of the LCM 31. Three kinds of line graphs, such as a line graph in the state of the trajectory and a line graph in a state in which the trajectory of the tip end portion of the stylus pen 70 is observed in the z-axis direction.

In the present embodiment, three types of operation modes, such as a soft key mode, a brush mode, and a line drawing mode, are prepared in advance as an operation mode for using the pen input function in the portable information terminal 100. However, in the portable information terminal 100, in addition to the three types of operation modes, other operation modes may be provided.

In the other operation mode, for example, the control unit 151 controls the operation mode or control of the other image or the like different from the soft key 501 displayed on the display screen 31a in response to the instruction position (instruction position information) of the display screen 31a. In the display screen 31a, in response to the pointed position (instructed position information) of the display screen 31a, the operation mode in which any other information (image information or text information) different from the line drawing is redisplayed is displayed.

Further, in the other operation mode described above, the control unit 151 may control the display position on the display screen 31a while continuously receiving the indication position information at a predetermined time interval in response to the transmission cycle of the indication sound in the stylus pen 70. The process of displaying an image or the like in the display or displaying the arbitrary information on the display screen 31a may be performed at any time when the position information is instructed.

In addition, in the present embodiment, the present invention is directed to a configuration including the configuration of the pointing position detecting device of the present invention and the display device of the present invention, and a pen that can input characters or lines using the stylus pen 70. The portable information terminal 100 of the input function will be described. However, the pointing position detecting device and the display device of the present invention may be assembled in other devices, and are not limited to the portable information terminal 100.

Further, of course, the coordinate position (x, y, z) indicating the position of the indication detected in the present invention, that is, the position of the indication sound in the three-dimensional space is not limited to the LCM 31 described in the embodiment. The indication position of the display screen may be any indicated position on the display screen of another display device such as a CRT other than the LCM1.

Other advantages and modifications will readily occur to those skilled in the art, and the scope of the present invention is not limited to the specific details and representative embodiments shown herein. Accordingly, various modifications may be made without departing from the spirit and scope of the general inventive concept as defined by the appended claims.

1. . . LCM

1a. . . Display

2A, 2B, 2C, 2D. . . microphone

3. . . Amplifier

4. . . A/D converter

5. . . Location acquisition department

5a. . . Time difference acquisition department

5b. . . Location Information Acquisition Department

6A~6D. . . microphone

10s, 10t, 20s, 20t. . . hyperbola

10p, 10q, 20p, 20q, 30p, 30q. . . Hyperboloid (hyperbolic)

11,12. . . glass substrate

13. . . liquid crystal

14,15. . . Polarizer

14a. . . PVA film

14b. . . TAC film

14c. . . Phase difference plate

14e. . . Transparent adhesive

16. . . Pixel electrode

17. . . TFT

18. . . Color filter

19. . . Common electrode

20. . . Frame cover

20a. . . Display window

30. . . Stylus

31. . . LCM

31a. . . Display

32, 33. . . glass substrate

34. . . liquid crystal

35, 36. . . Polarizer

37. . . Light guide

38. . . Light reflecting sheet

39. . . Pixel electrode

40. . . TFT

41. . . Color filter

42. . . Common electrode

43. . . Frame cover

43a. . . Display window

51. . . LCM

52. . . LCD panel

53. . . Brightness enhancement film

60. . . protection cap

60a. . . Peripheral part

70. . . Stylus

71. . . Ontology

72. . . power switch button

100. . . Portable information terminal

102. . . Ontology

103. . . Display department

104. . . Power button

105a～105e. . . Operation key

151. . . Control department

151a. . . Time difference acquisition department

151b. . . Location Information Acquisition Department

151c. . . Display control unit

151d. . . Input processing unit

152. . . ROM

153. . . Flash memory

154. . . Key input

155. . . Drive circuit

156. . . Signal processing unit

157. . . Amplifier

501a. . . Operation button

P. . . Indicating position

Fig. 1 is a view showing the configuration of an instruction position detecting device according to the first embodiment.

Fig. 2A is a layout view of each microphone in the first embodiment.

Fig. 2B is a layout view of each microphone in the first embodiment.

Fig. 3 is a view showing the coordinate position of each microphone in the first embodiment.

Fig. 4A is an explanatory view showing a method of acquiring the indicated position in the first embodiment.

Fig. 4B is an explanatory view showing a method of acquiring the indicated position in the first embodiment.

Fig. 5 is a layout view showing another arrangement example of each microphone in the first embodiment.

Fig. 6 is an explanatory view showing another combination of microphones which is one of the calculation targets of the hyperbola.

Fig. 7 is a view showing the configuration of the pointing position detecting device of the second embodiment.

Fig. 8A is an explanatory view showing an example of a specific structure of a polarizing plate.

Fig. 8B is an explanatory view showing an example of a specific structure of a polarizing plate.

Fig. 8C is an explanatory view showing an example of a specific structure of a polarizing plate.

Fig. 9 is a view showing the configuration of a portable information terminal of the third embodiment.

Fig. 10 is a cross-sectional view showing a schematic structure of a display unit in the third embodiment.

Fig. 11 is a schematic block diagram showing the electrical configuration of the portable information terminal in the third embodiment.

Fig. 12A is a view showing the position of any indicated position in the 3-dimensional space.

Fig. 12B is a view showing the coordinate position of the XY coordinate system of each microphone in the third embodiment.

Fig. 13A is an explanatory view showing a method of obtaining the indicated position information in the third embodiment.

Fig. 13B is an explanatory view showing a method of obtaining the indicated position information in the third embodiment.

Fig. 14 is a flow chart showing the processing contents in the soft key mode.

Fig. 15 is a flow chart showing the process of instructing the position information acquisition.

Fig. 16 is an explanatory diagram illustrating the operation of the portable information terminal in the soft key mode.

Fig. 17A is an explanatory diagram showing the details of the soft keys.

Fig. 17B is an explanatory diagram showing the details of the soft keys.

Figure 18 is a flow chart showing the processing contents in the brush mode.

Fig. 19 is an explanatory diagram showing the operation of the portable information terminal in the brush mode.

Figure 20 is a flow chart showing the processing contents in the line graph mode.

Fig. 21 is an explanatory diagram illustrating the operation of the portable information terminal in the line graph mode.

Fig. 22 is a view showing the arrangement of another arrangement example of the microphone in the third embodiment.

Figure 23 is an explanatory diagram showing other combinations of three sets of microphones.

1a. . . Display

2A, 2B, 2C, 2D. . . microphone

10s, 10t, 20s, 20t. . . hyperbola

P. . . Indicating position

Claims (13)

An indication position detecting device comprising: a display module having a display screen; and a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen, and detecting an indication sound emitted from a 3-dimensional space on the display screen a time difference obtaining unit that acquires three arrival time differences of the instruction sounds between the two microphones for the three combinations of the plurality of microphones, and a position information acquisition unit that derives and obtains the time difference acquisition unit The three hyperboloids corresponding to the three arrival time differences, each hyperboloid has a focus at the position of the two microphones in each of the three combinations of the plurality of microphones, and the intersection of the three hyperbolic curves derived is obtained. As the position information for emitting the aforementioned indication sound. The pointing position detecting device according to the first aspect of the invention, wherein the position information obtaining unit uses a program as a discriminant, and obtains a coordinate value that is an unknown number in the discriminant, and substitutes for indicating the upper side of the display screen. When the coordinate value of each point of the 3-dimensional space in the predetermined range is obtained, the coordinate value closest to the value of the specific value can be obtained, and the coordinate value is used as the position information for emitting the aforementioned indication sound, and the equation is set in the space representing the 3 dimensional space. The coordinate value of the point is an unknown number, and the coordinate value obtained by the intersection of the first hyperboloid and the intersection of the second hyperboloid and the third hyperboloid is obtained in the coordinate value. Specific value. The instruction position detecting device according to the first aspect of the invention, wherein the time difference acquisition unit acquires a difference in arrival time of the instruction sound between the first microphone and the third microphone as a first arrival time difference, and acquires the second microphone and the fourth microphone. The arrival time difference between the indication sounds is the second arrival time difference, and the arrival time difference of the instruction sound between the first microphone and the fourth microphone is obtained as a third arrival time difference, and the position information acquisition unit is based on the foregoing a first hyperboloid having the first microphone and the third microphone as a focus, and a second hyperboloid having the second microphone and the fourth microphone as a focus, based on the second arrival time difference, according to the first time difference 3, the arrival time difference is derived from the third hyperboloid having the first microphone and the fourth microphone as a focus, and the intersection of the first hyperboloid and the second hyperboloid and the third hyperboloid is obtained as position information for emitting the indication sound . The instruction position detecting device according to the third aspect of the invention, wherein the display screen is formed in a rectangular shape, and the first microphone and the third microphone are disposed such that the display screen is located between the first microphone and the third microphone. In the microphone, the second microphone and the fourth microphone are disposed such that the display screen is positioned between the second microphone and the fourth microphone. The instruction position detecting device according to claim 4, wherein the first microphone, the second microphone, the third microphone, and the foregoing The fourth microphone is disposed so as to correspond to the mutually different sides of the display screen. The instruction position detecting device according to the fourth aspect of the invention, wherein the first microphone, the second microphone, the third microphone, and the fourth microphone are disposed so as to correspond to different corners of the display screen. An indication position detecting method, comprising: a time difference obtaining step of acquiring three arrivals of the indication sound between two microphones of each of three combinations of microphones of a plurality of microphones disposed apart from each other on an outer peripheral portion of the display screen a time difference, detecting an indication sound emitted from a 3-dimensional space on a display screen in the display module; and a position information obtaining step of deriving 3 corresponding to the three arrival time differences obtained in the time difference obtaining step a hyperboloid, each hyperboloid having a focus at a position of the two microphones in each of the three combinations of the plurality of microphones, and obtaining an intersection of the derived three hyperboloids as position information for emitting the indication sound . The method for detecting a position of the item of claim 7 wherein the position information obtaining step uses a program as a discriminant, and wherein the coordinate value of the unknown is substituted into the upper portion of the display screen. When the coordinate value of each point of the 3-dimensional space in the predetermined range is obtained, the coordinate value closest to the value of the specific value can be obtained, and the coordinate value is used as the position information for emitting the aforementioned indication sound, and the equation is set to represent the 3rd dimension space. The coordinate value of the point in the interval is an unknown number, and when the coordinate value is used to represent the coordinate value of the first hyperboloid among the three hyperboloids and the intersection of the second hyperboloid and the third hyperboloid This particular value is available. The method for detecting an instructed position according to the seventh aspect of the invention, wherein the time difference obtaining step acquires a difference in arrival time of the indication sound between the first microphone and the third microphone as a first arrival time difference, and acquires the second microphone and the fourth microphone. The difference in arrival time between the indication sounds is the second arrival time difference, and the difference in arrival time of the instruction sound between the first microphone and the fourth microphone is obtained as a third arrival time difference; and the position information acquisition step is based on the first Deriving a time difference to derive a first hyperboloid having the first microphone and the third microphone as a focus, and deriving a second hyperboloid having the second microphone and the fourth microphone as a focus based on the second arrival time difference, according to the third The arrival time difference is derived from the third hyperboloid having the first microphone and the fourth microphone as a focus, and the intersection of the first hyperboloid and the second hyperboloid and the third hyperboloid is obtained as position information for emitting the instruction sound. An indication position detecting method includes a time difference obtaining step of acquiring four of the indication sounds between two microphones of each combination of four types of microphones of four microphones disposed apart from each other on an outer peripheral portion of the display screen The arrival time difference is used to detect the indication sound emitted from the 3-dimensional space on the display screen in the display module; and a position information obtaining step of deriving four hyperboloids corresponding to the four arrival time differences obtained in the time difference obtaining step, wherein each hyperboloid is the two of each of the four combinations of the plurality of microphones The position of the microphone has a focus, and position information for emitting the aforementioned indication sound is obtained based on the four hyperboloids derived. The method for detecting position of claim 10, wherein the position information obtaining step uses a program as a discriminant, and wherein the coordinate value of the unknown is substituted into the upper portion of the display screen. When the coordinate value of each point of the 3-dimensional space in the predetermined range is obtained, the coordinate value closest to the value of the specific value can be obtained, and the coordinate value is used as the position information for emitting the aforementioned indication sound, and the equation is set in the space representing the 3 dimensional space. The coordinate value of the point is an unknown number, and the coordinate value obtained by the intersection of the first hyperboloid and the intersection of the second hyperboloid and the third hyperboloid is obtained in the coordinate value. Specific value. The method for detecting an instructed position according to claim 10, wherein the time difference obtaining step includes: a first time difference obtaining step of obtaining a difference in arrival time of the indication sound between the first microphone and the third microphone as a first arrival time difference; The second time difference obtaining step acquires a difference in arrival time of the instruction sound between the second microphone and the fourth microphone as a second arrival time difference, and a third time difference obtaining step of acquiring the instruction between the first microphone and the fourth microphone The difference in arrival time of the sound as the third arrival time difference; and The fourth time difference obtaining step acquires a difference in arrival time of the instruction sound between the second microphone and the third microphone as a fourth arrival time difference. The method according to claim 12, wherein the position information obtaining step includes: a first hyperboloid deriving step of deriving the first microphone and the third microphone as a focus based on the first arrival time difference a hyperboloid; a second hyperboloid deriving step of deriving a second hyperboloid with the second microphone and the fourth microphone as a focus based on the second arrival time difference; and a third hyperboloid deriving step, which is derived based on the third arrival time difference a third hyperboloid having the first microphone and the fourth microphone as a focus; and a fourth hyperboloid deriving step of deriving a fourth hyperboloid having the second microphone and the third microphone as a focus based on the fourth arrival time difference a first position information obtaining step of deriving the intersection of the first hyperboloid and the second hyperboloid and the third hyperboloid as a first position; and a second position information obtaining step of deriving the first hyperboloid and the second The intersection of the hyperboloid and the fourth hyperboloid is the second position; and the correction step is to obtain the intermediate position between the first position and the second position As the position information for emitting the aforementioned indication sound.