JP2009071438A - Display integrated type touch panel apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display integrated type touch panel apparatus of a cellular phone or a PDA or the like, capable of assisting a user so as to surely remove stains when the user cleans the stains on a touch panel. <P>SOLUTION: The cellular phone 100 used together with a full screen liquid crystal touch panel 104 includes: a contact number-of-times storage processing part 352 for updating the number of times of contact of respective coordinates on the touch panel 108; a stain information display processing part 356 for displaying the distribution and strength of estimated stains as areas of various colors on a liquid crystal display device 106; a stain information deletion processing part 358 for performing the processing of re-displaying stain information on the liquid crystal display device 206; and a sound effect generation processing part 362 for selecting a sound effect from a sound effect storage part 364 and outputting it from a speaker 110 through an audio I/F 290. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a display-integrated touch panel device, and in particular, in a device that is frequently used daily such as a mobile phone and a PDA (Personal Digital Assistant), has a function of assisting the user when the user cleans dirt due to a touch operation. The present invention relates to a display integrated touch panel device.

  In recent years, personal portable information terminals such as mobile phones and PDAs have become more sophisticated and multifunctional. Along with these improvements in performance, various contents that can be used on portable information terminals, such as electronic books, games, or video playback using analog or so-called one-segment broadcasting services, are rapidly increasing. In order for the user to fully enjoy these various contents, it is required to enlarge the screen for displaying the contents to some extent.

  Therefore, many products have been developed that have the largest possible screen size while being portable. Even under such circumstances, the development of products using a display-integrated touch panel device that can display the entire screen while pursuing the size of the screen is also underway.

  Such display-integrated touch panel devices are generally formed by stacking electronic, electrostatic, optical, and ultrasonic touch panels on a display device such as a liquid crystal display (LCD). . In such a display-integrated touch panel device, the user's finger usually touches a desired position on the touch panel screen, and coordinates of the position are input to the device. In a display-integrated touch panel device based on such an operation, for example, a position where the number of touches such as a finger touches is greater, a dirt such as a fingerprint adheres to the touch panel, making it difficult to see the screen. This problem is unavoidable in a display-integrated touch panel device. Moreover, in a graphical user interface, buttons that perform a certain function are often displayed at a certain position on the screen, and therefore, a specific position is often soiled more severely than other positions.

In order to deal with these problems, Patent Document 1 provides an operation mode called “cleaning mode”. When the cleaning mode is turned on, no input is accepted for a certain period of time after that, and the background is black and the dirt on the touch panel is made conspicuous to notify that the cleaning mode is in progress. . At that time, the elapsed time after entering the cleaning mode is notified.
JP 2004-355078 A

  However, the following problems have been pointed out in the technique disclosed in Patent Document 1.

  (1) According to the technique described in Patent Document 1, a display for conspicuous dirt on the touch panel is performed for a certain time after the cleaning mode is activated. Therefore, erroneous input is prevented from occurring by invalidating the input to the apparatus for a certain time after the cleaning mode is activated. However, when making the stains conspicuous by using a method such as a black background, the user relies heavily on the user's vision, and the user does not always correctly grasp the stains. There is a need for assistive technology that can more reliably wipe off dirt.

  (2) In the technique described in Patent Document 1, the cleaning mode is automatically canceled when a certain time elapses after the cleaning mode is activated. That is, only a predetermined time can be secured as the cleaning time. For this reason, when a lot of dirt is attached, or when it is necessary to carefully clean over time, it is necessary to repeat the cleaning mode and the normal mode multiple times. This mode switching operation is troublesome for the user.

  As is clear from the above description, the technique described in Patent Document 1 has a problem that it is not possible to reliably find dirt, check after cleaning, and the like. As a result, the cleaning operation is a repeated discovery of dirt and cleaning, and the cleaning operation cannot be performed happily.

  Therefore, an object of the present invention is to provide a display-integrated touch panel device that can assist the user so that the user can remove the dirt more reliably when the user cleans the dirt on the touch panel.

  Another object of the present invention is to provide a display that can assist the user and make the cleaning work more enjoyable so that the user can remove the dirt more reliably when the user cleans the dirt on the touch panel. It is to provide a body type touch panel device.

  Still another object of the present invention is to provide a display-integrated display that can estimate the location and degree of dirt and present it to the user so that the dirt can be removed more reliably when the user cleans the dirt on the touch panel. A touch panel device is provided.

  A display-integrated touch panel device according to a first aspect of the present invention includes a display unit and a touch panel that is arranged on the display surface of the display unit and outputs coordinates of the contact position when contacted by an operator. The integrated touch panel device can operate by switching between a first mode and a second mode different from the first mode. The display-integrated touch panel device further includes display means for displaying an image for cleaning the display surface on the display surface when the first mode is switched to the second mode, and the second mode. In the second mode to the area for the image displayed by the display means in the area having a predetermined relationship with the coordinates on the display surface based on the coordinates of the contact position output by the touch panel during the operation by Image changing means for making a predetermined change depending on the number of times of contact.

  The display means displays an image of dirt for prompting the user for cleaning on the display surface when the mode is switched from the first mode to the second mode. In the second mode, it is possible to present which part on the touch panel should be cleaned even if the user does not rely on the user's own vision. Further, when the user wipes the touch panel with a cloth or the like, the touch panel outputs the coordinates of the place where the cloth touches the touch panel. The image changing means changes the dirt image displayed by the display means based on the number of times the user has touched the touch panel in the second mode in an area having a predetermined relationship with the coordinates output by the touch panel. Therefore, the image changing means can estimate the location and degree of dirt from the number of times of touching the touch panel, and present the progress of cleaning on the touch panel to the user. The user can more reliably remove the stain on the touch panel based on the presented image without depending on the user's own vision. As a result, it is possible to provide a display-integrated touch panel device that can assist the user so that the user can remove the dirt more reliably when the user cleans the dirt on the touch panel.

  Preferably, the display surface is divided into a plurality of divided regions. The image changing means stores a contact count storage means for storing the contact counts of a plurality of divided regions based on the output of the touch panel, and a first table for associating the contact counts with one of a plurality of types of images. Based on the coordinates of the contact position output from the touch panel during the operation in the first table storage means and the second mode, the first table and the contact count of each divided area stored in the contact count storage means are used. The image updating means for updating the image displayed in the divided area included in the area with an image corresponding to the number of times of contact in the divided area, and the touch position output by the touch panel during the operation in the second mode Based on these coordinates, the number of contacts during operation in the second mode among the divided regions included in the region is determined using the number of contacts in each divided region stored in the contact number storage means. And means for erasing the image displayed on the divided regions is greater than the number defined order.

  In the second mode, the device stores how many times the user has touched the divided area on the touch panel, and displays a dirty image according to the number of times of contact. In the second mode, the device erases a dirty image if the number of times of contact exceeds a predetermined number. Therefore, if a dirty image is displayed on the display surface, the user recognizes how much the progress of the displayed portion is being cleaned, and how much more cleaning is required for the portion. Can be determined. In the second mode, if the displayed dirt image is erased as a result of cleaning, it can be recognized that the divided area has been sufficiently cleaned. As a result, it is possible to provide a display-integrated touch panel device that can estimate the location and degree of dirt and present it to the user so that the dirt can be removed more reliably when the user cleans the dirt on the touch panel. Can do.

  More preferably, the display surface is divided into a plurality of divided regions. The display-integrated touch panel device further includes a contact count storage means for storing the contact counts of the plurality of divided areas, and a touch count storage means when the touch panel outputs coordinates of the contact position during the operation in the first mode. And a contact number adding means for adding a predetermined number to the contact number of the divided area corresponding to the coordinates. When the display means is switched from the first mode to the second mode, an image for cleaning the display surface is displayed on the display surface based on the contact count of each divided area stored by the contact count storage means. Includes a time-dependent display means for displaying.

  In the first mode, as the number of times the user's finger touches the touch panel increases, dirt such as fingerprints adheres to the touch panel, making it difficult to see the screen. The contact number adding means adds the contact number of the contacted area each time the user's finger touches the touch panel during the operation in the first mode, and stores it in the contact number storage means. The number-dependent display means displays an image of dirt on the display surface based on the number of times of contact of each divided area when switching from the first mode to the second mode. Therefore, when switching from the first mode to the second mode, the user knows where on the touch panel the dirt is accumulated from the dirt image displayed by the number-dependent display means. Can be cleaned. As a result, it is possible to provide a display-integrated touch panel device that can estimate the location and degree of dirt and present it to the user so that the dirt can be removed more reliably when the user cleans the dirt on the touch panel. Can do.

  More preferably, the number-of-times display means determines the number of contacts in advance using the number of contacts in each divided area stored by the number-of-contacts storage when the first mode is switched to the second mode. Dirt image display means for displaying an image for cleaning the display surface is included in the divided areas larger than the given number.

  The dirty image display means displays a dirty image only in the divided areas where the number of times of contact is larger than a predetermined number. That is, the divided areas whose number of contacts is equal to or less than the predetermined number are not dirty, and the divided areas larger than the predetermined number are considered dirty. When the user switches from the first mode to the second mode, the user recognizes that the portion where the image is displayed should be cleaned, and does not clean the unclean portion. Therefore, it is possible to clean without waste.

  More preferably, when the touch panel outputs the coordinates of the contact position during the operation in the second mode, the image changing means is stored in the contact count storage means and in the area in a predetermined relationship with the coordinates. Using the means for setting a predetermined number for the number of contact of the divided areas included and the number of times of contact of each divided area stored by the contact number storage means during the operation in the second mode, A dirty image erasing unit for erasing an image displayed in the divided region that is included in the region and in which a predetermined number of contact times is set with respect to the image displayed by the display unit .

  A predetermined number is set in the divided area of the portion once wiped with a cloth or the like by the user, and the dirt image displayed in the divided area is deleted, so that the cleaning of the divided area is completed. Can be notified to the user, and the progress of the cleaning can be presented.

  More preferably, when the touch panel outputs coordinates during the operation in the second mode, the image changing means is stored in the contact count storage means and included in the area in an area having a predetermined relationship with the coordinates. A contact number subtraction means for subtracting a predetermined number from the contact number of the area and storing it in the contact number storage means, and each division stored in the contact number storage means during operation in the second mode A number-dependent formula for making a predetermined change depending on the number of times of contact in the second mode of the divided area included in the region, with respect to the image displayed by the number-dependent display means using the number of times of contact of the region Image changing means.

  The contact frequency subtraction means subtracts the contact frequency of the divided area of the portion once wiped with a cloth or the like by the user. The number-dependent image changing means displays a dirt image on the display surface according to the subtracted number of contacts. Therefore, if a dirty image is displayed on the display surface, the user recognizes how much the progress of the displayed portion is being cleaned, and how much more cleaning is required for the portion. Can be determined.

  More preferably, the display-integrated touch panel device further includes second table storage means for storing a second table that associates the number of times of contact with one of a plurality of types of images for cleaning the display surface. The number-dependent display means uses the second table and the number of contacts of each divided area stored by the number-of-contacts storage means when switching from the first mode to the second mode. Each includes a dirt image display means for displaying an image of the second table corresponding to the number of times of contact.

  More preferably, the number-of-times-dependent image changing means uses the second table and the number of contact times of each divided area stored by the contact number storage means during the operation in the second mode, by the smear image display means. For the displayed image, each of the divided areas included in the area includes a dirty image changing means for displaying an image of the second table corresponding to the number of times of contact in the second mode of the divided area.

  More preferably, the display-integrated touch panel device further uses a contact count of each divided area stored by the contact count storage means to set a plurality of divided areas in which the total number of contacts is larger than a predetermined number. Includes a dirt distribution area storage means for extracting and storing as a dirt distribution area. The frequency-dependent display means is stored by the dirt distribution area storage means using the contact count of each divided area stored by the contact count storage means when the first mode is switched to the second mode. Character display means for displaying a character for cleaning the display surface according to the total number of times of contact of the divided areas included in the dirt distribution area is included on the dirt distribution area. The number-dependent image changing means is included in the area for the character displayed by the character display means using the number of times of contact of each divided area stored in the number-of-contacts storage means during the operation in the second mode. Character changing means for making a predetermined change depending on the number of times of contact in the second mode of the divided area.

  During the operation in the second mode, a dirt distribution area is extracted and a character is displayed on the dirt distribution area. The character is changed as cleaning progresses. The user can perform cleaning while watching the change of the character, and can bring about a change in the work of cleaning the display surface which becomes monotonous. As a result, when the user cleans the dirt on the touch panel, the display-integrated touch panel device that can assist the user so that the dirt can be removed more reliably and can make the cleaning work more enjoyable. Can be provided.

  More preferably, the character changing means uses the number of times of contact of each divided area stored in the number-of-contacts storage means and the dirt distribution area stored in the dirt distribution area storage means during the operation in the second mode. Thus, the dirt in which the total number of contacts is smaller than a predetermined number is obtained by updating the number of contacts of the divided areas included in the area in the second mode with respect to the character displayed by the character display means. Character erasing means for erasing characters displayed on the distribution area, contact count of each divided area stored in the contact count storage means during operation in the second mode, and dirt distribution area storage means Using the stored dirt distribution area, the dirt distribution on the dirt distribution area where the character has not yet been displayed since the start of the second mode. And a character additional display means for displaying the character corresponding to the sum of the number of contacts divided regions included in each band.

  If the user cleans the dirt distribution area where the character is displayed, and the number of contacts on the dirt distribution area is reduced and the character is erased, the user knows that the cleaning on the dirt distribution area has been completed. It can be recognized that another dirt distribution region should be cleaned. Further, the character addition display means displays a character corresponding to the total number of contact times of the dirt distribution area on the dirt distribution area where the character has not been displayed since the start of the second mode. Then, it is possible to clean while grasping how dirty the dirt distribution area is.

  More preferably, the character addition display means displays the number of contacts in each divided area stored in the contact count storage means and the dirt distribution area stored in the dirt distribution area storage means during the operation in the second mode. And means for displaying a character corresponding to the sum on the dirt distribution area where the total number of contacts is the smallest among the dirt distribution areas where the character has not yet been displayed since the start of the second mode. .

  Since the characters corresponding to the total number of contacts are displayed in order from the dirt distribution area with the smallest total number of contacts, it is difficult for the user to wipe off the dirt gradually. Can be cleaned and can reduce boredom.

  The display-integrated touch panel device further includes a third table storage means for storing a third table for associating the number of times of contact with one of a plurality of types of sound effects, and the third table during operation in the second mode. And a sound effect output means for outputting a sound effect corresponding to the contact number of each divided area using the contact number of each divided area stored by the contact number storage means.

  During operation in the second mode, one of a plurality of sound effects is output according to the number of touches, so that the user can proceed with cleaning while recognizing the progress of cleaning.

  More preferably, the display-integrated touch panel device further includes a sound effect storage means for storing the sound effect, and a contact frequency of each divided area stored by the sound effect and the contact frequency storage means when operating in the second mode. And a sound effect sound volume changing means for changing the sound effect sound volume in accordance with the total number of contacts in each divided area and outputting the sound effect.

  During operation in the second mode, the volume of the sound effect is changed according to the number of times of contact and output, so that the user can proceed with cleaning while recognizing the progress of cleaning.

  More preferably, the image changing means is displayed by the contact area extracting means and the display means for determining a set of coordinates whose distance from the coordinates of the contact position output by the touch panel is smaller than a predetermined value as an area. Means for making a predetermined change on the image depending on the number of times the area is touched in the second mode.

  Since the contact area extraction unit extracts a set of coordinates based on the coordinates of the contact position as an area, the contact area is estimated as a part where the user actually touched the touch panel, and the number of times the area has been touched with respect to a stain image Based on the above, a predetermined change can be made.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the embodiments, the same parts are denoted by the same reference numerals. Their functions and names are also the same. Therefore, detailed description thereof will not be repeated.

[First Embodiment]
<Appearance and configuration of mobile phone 100>
FIG. 1 is a plan view showing the appearance of a mobile phone 100 having a display-integrated touch panel device according to a first embodiment of the present invention. Referring to FIG. 1, a mobile phone 100 includes a housing 102 having a flat rectangular parallelepiped shape, a liquid crystal display device 106 disposed on almost the entire upper surface of the housing 102, and a capacitance stacked on the liquid crystal display device 106. A full-screen liquid crystal touch panel 104 that is a display device integrated touch panel, a speaker 110 disposed above the full-screen liquid crystal touch panel 104 on the top surface of the housing 102, and a full screen on the top surface of the housing 102. And a microphone 112 disposed on the lower side of the liquid crystal touch panel 104.

  In the present embodiment, full-screen liquid crystal touch panel 104 has a function of outputting position information on the assumption that the position is designated by the user when the user touches an arbitrary position on the liquid crystal display screen.

  In the present embodiment, mobile phone 100 is provided with two operation modes, a normal mode and a cleaning mode.

  Here, the “normal mode” refers to normal functions of the mobile phone 100 such as telephone number input, outgoing call, telephone call, or reception by touching an input key arranged on the full-screen liquid crystal touch panel 104. The state to be made. In this normal mode, information for estimating the distribution and degree of dirt on the full-screen liquid crystal touch panel is accumulated from the usage status by the user.

  The “cleaning mode” is an operation mode that assists the user in cleaning the screen of the full-screen liquid crystal touch panel. In the cleaning mode in the present embodiment, first, the distribution and the degree of dirt estimated from the use state of the normal mode are displayed on the liquid crystal display device 106 as a pattern consisting of shading. After that, when the user wipes the screen of the full-screen liquid crystal touch panel 104 with a cloth based on the displayed dirt, the operation is detected and the remaining degree of dirt on the full-screen liquid crystal touch panel 104 is estimated. Along with this, the display of the distribution of dirt on the screen is also changed. As a result, the user can efficiently remove the dirt attached on the screen of the full-screen liquid crystal touch panel 104. In this case, since the process of removing the dirt can be visually confirmed, there is an effect that the cleaning operation is not so boring for the user.

<Outline of dirt removal method>
Details of the hardware configuration of the mobile phone 100 will be described later. First, an apparent operation of the mobile phone 100 when removing dirt on the full-screen liquid crystal touch panel 104 will be described. In order to realize the above-described cleaning mode, the cellular phone 100 has a function of accumulating the number of contacts on the full-screen liquid crystal touch panel 104 by the user for each contact location, and there is contact not only in the contact location but also in the vicinity. As a thing, it has the function which accumulates the frequency | count of a contact, and the function which displays on the liquid crystal display device 106 distribution and the grade of the estimated dirt based on the accumulated frequency | count of contact. Hereinafter, these will be sequentially described.

(Outline of contact count storage system)
In the present embodiment, when the user is operating the mobile phone 100 in the normal mode, the contamination on the touch panel 108 is estimated based on information on how many times the user touches the touch panel 108 with which finger. To do. For this purpose, in the normal mode, the number of times of contact by the user is accumulated for each predetermined area on the touch panel 108, and the number of times is stored in a memory in the mobile phone 100. Details of the memory of the mobile phone 100 will be described later.

  In the normal mode, the number of contacts is recorded as follows.

  2A to 2C show the full-screen liquid crystal touch panel 104 of the mobile phone 100. FIG. Referring to FIG. 2A, a plurality of characters and symbols are displayed on liquid crystal display device 106 of full-screen liquid crystal touch panel 104. In the normal mode, the user touches the position of characters and symbols on the full-screen liquid crystal touch panel 104 with the finger 140 in order to execute the normal function of the mobile phone 100.

  Referring to FIG. 2B, when touch panel 108 is touched at the position of finger 140 shown in FIG. 2A, touch panel 108 detects a position 142 of the touched location and outputs coordinates 144 thereof. The coordinate system defined on the full-screen liquid crystal touch panel 104 has an origin O at the upper left of the full-screen liquid crystal touch panel 104, a horizontal direction right from the origin O is a positive direction of the X axis 148, and a lower vertical direction is the Y axis 150. The direction is positive.

  FIG. 2C shows an area 146 detected as an area touched by a finger, centering on a position 142 (see FIG. 2B) where the user's finger 140 touches on the full-screen liquid crystal touch panel 104. Show. The numbers in parentheses of coordinates 144 (100 and 500) represent the X and Y coordinates of position 142, respectively. As described above, in the present embodiment, it is assumed that there is a touch with a finger including not only the coordinate point output from the full-screen liquid crystal touch panel 104 as a contact position but also a predetermined area around it. This is because the tip of a human finger is soft, and contact with the full-screen liquid crystal touch panel 104 is performed in a certain area.

FIG. 3 is an enlarged view of the region 146 shown in FIG. Referring to FIG. 3, contact position 142 detected on touch panel 108 is a square dot region. The contact surface of the full-screen liquid crystal touch panel 104 is divided into such square dot areas. Coordinates are assigned to each of the dot areas as shown by coordinates 144 in FIG. In the following description, the maximum value of the X coordinate is X _max and the maximum value of the Y coordinate is Y _max . X _max and Y _max are integers greater than 0. An integer greater than 0 and less than or equal to X _max and an integer greater than 0 and less than or equal to Y _max are assigned to the X coordinate and Y coordinate of the dot area, respectively.

  Table 1 shows an example of information on the number of contact times of each coordinate stored in the memory of the mobile phone 100. Hereinafter, the memory for storing the number of times of contact is referred to as “contact number memory”.

テーブル１の列名には、全画面液晶タッチパネル１０４上のＸ座標の最小値〜最大値までの値である１〜Ｘ_ｍａｘが、左から右に昇順で配置されており、行名には、Ｙ座標の最小値〜最大値までの値である１〜Ｙ_ｍａｘが上から下に昇順で配置されている。ｘを１〜Ｘ_ｍａｘの範囲の数とし、ｙを１〜Ｙ_ｍａｘの範囲の数とする。テーブル１の行列において、列名がｘである列と、行名がｙである行とが交差する箇所に、座標（ｘ，ｙ）の接触回数を記憶する。テーブル１に示す状態では、座標（１００，５００）の接触回数は１であり、それ以外の座標の接触回数は０であることが示されている。

In the column names of Table 1, 1 to X _max that are values from the minimum value to the maximum value of the X coordinate on the full-screen liquid crystal touch panel 104 are arranged in ascending order from left to right. 1 to Y _max which are values from the minimum value to the maximum value of the Y coordinate are arranged in ascending order from top to bottom. The x be the number of range _{1 to X max,} the number of range y of _{1 to Y max.} In the matrix of Table 1, the number of times the coordinate (x, y) is touched is stored at a location where a column whose column name is x and a row whose row name is y intersect. In the state shown in Table 1, it is indicated that the number of contacts at coordinates (100, 500) is 1, and the number of contacts at other coordinates is 0.

  When the user uses the normal mode of the cellular phone 100 for the first time, a value of 0 is set for the number of times of contact of all coordinates in the table 1.

  Referring to FIG. 2C again, as described above, the finger 140 is in contact with the touch panel 108 not in one point but in an area having a certain size such as the area 146. When the dot area of one coordinate detected by the touch panel 108 is much smaller than the area 146, not only the number of contact of the detected dot area of the coordinate 144 but also the dot area in the area 146 as described above. The number of contacts should be added.

  Therefore, in the present embodiment, using the contact area determination method described below, the area actually touched by the user is estimated from the coordinates detected by the touch panel 108, and the contact count of the estimated coordinates is added. . This contact area determination method will be described later.

  In the contact count storage method, the contact count addition process is repeated each time the user's finger 140 touches the touch panel 108 in the normal mode, and the contact count information of each coordinate shown in Table 1 is updated and stored in the contact count memory. Let

(Outline of contact area determination method)
In the present embodiment, when the coordinates of the contact position (x ₀ , y ₀ ) are given using the coordinates of the contact position and a predetermined distance R that defines the limit of the contact area, there is a simultaneous contact. The determined area is obtained as follows. That is, coordinates (x, y) such that | x−x ₀ | + | y−y ₀ | <= R is extracted from the arrangement of dot areas on the touch panel 108, and these are extracted as coordinates (x ₀ , When there is a contact with y ₀ ), it is determined that the region has been in contact with at the same time. However, x, x ₀ ε {1,..., X _max }, y, y ₀ ε {1,..., Y _max }.

Hereinafter, for convenience, when the two coordinates on the full-screen liquid crystal touch panel 104 are (x ₁ , y ₁ ) and (x ₂ , y ₂ ), respectively, the “movement distance” of the two coordinates is represented by | x ₁ −x ₂ | + | y ₁ −y ₂ |

FIG. 3 also shows an example of the contact area extracted based on the coordinates of the position 142 and the distance R. A bidirectional arrow 162 indicates the length of the distance R in the coordinate system on the full-screen liquid crystal touch panel 104. In the example shown in FIG. 3, R = 3. Assuming that the coordinates of the position 142 are (x ₀ , y ₀ ), as a region 146 where contact has occurred, in addition to the position 142, (x ₀ , y ₀ -3), (x ₀ −1, y ₀ −2), _{(x 0, y 0 -2)} , (x 0 + 1, y 0 -2), (x 0 -2, y 0 -1), (x 0 -1, y 0 -1), (x 0, y _{0 -1), (x 0 +} 1, y 0 -1), (x 0 + 2, y 0 -1), (x 0 -3, y 0), (x 0 -2, y 0), (x 0 −1, y ₀ ), (x ₀ +1, y ₀ ), (x ₀ +2, y ₀ ), (x ₀ +3, y ₀ ), (x ₀ −2, y ₀ +1), (x ₀ −1) _{, y 0 +1), (x} 0, y 0 +1), (x 0 + 1, y 0 +1), (x 0 + 2, y 0 +1), (x 0 -1, y 0 +2), (x 0, _{y 0 +2), (x 0} + 1, y 0 +2), and x _{0, y 0} +3) of 24 sets of coordinates are extracted. Then, 1 is added to the number of contacts in all these areas.

(Outline of estimated dirt display method)
Mobile phone 100 according to the present embodiment operates as follows when the mode is changed from the normal mode to the cleaning mode. First, based on the contents stored in the contact count memory, the estimated distribution of dirt and its degree (hereinafter referred to as “estimated dirt”) are displayed on the liquid crystal display device 106. Hereinafter, a method for displaying estimated dirt will be described.

  FIG. 4 is a diagram showing a display color table 180 for representing the degree of contamination according to the number of times of contact of each coordinate on the full-screen liquid crystal touch panel 104. Referring to FIG. 4, at each coordinate on full-screen liquid crystal touch panel 104, display color 182 is displayed when the number of contacts is 1 to 20, display color 184 is displayed when the number of contacts is 21 to 40, and the number of contacts is 41. At this time, the display color 186 is displayed on the liquid crystal display device 106.

  FIG. 5 shows an example of the distribution of dirt displayed on the liquid crystal display device 106. Referring to FIG. 5, dirty areas 200, 202, and 204 are displayed on liquid crystal display device 106. The area 200 is an area of coordinates where the number of contacts is 41 or more. This area is displayed in display color 186. An area 202 is an area of coordinates where the number of times of contact is 21 to 40. This area is displayed in display color 184. An area 204 is an area of coordinates where the number of times of contact is 1 to 20. This area is displayed in display color 182. On the full-screen liquid crystal touch panel 104, the area other than the area 200, the area 202, and the area 204 is a coordinate area where the number of times of contact is 0, and characters, symbols, and the like used in the normal mode are unchanged in the area. Is displayed.

  Such a display can be easily performed by superimposing an image showing the distribution and degree of dirt on the display image in the normal mode.

(Outline of dirt information deletion method)
After the estimated dirt is displayed on the liquid crystal display device 106 by the dirt information display method, the user cleans the touch panel 108 by wiping it with a cloth. Hereinafter, how the display of dirt on the liquid crystal display device 106 changes in the mobile phone 100 according to the present embodiment due to the user's action will be described.

  When the number of contacts is stored, when the user touches the touch panel 108, the number of contacts for each coordinate in the table 1 is added. On the other hand, at the time of deleting dirt information, when contact is detected, the contact count of the corresponding coordinate is subtracted. Further, when the dirt information is deleted, each time the number of touches of each coordinate changes, the table shown in FIG. 4 is referred to, the display color is changed according to the number of touches, and the dirt area is restored on the liquid crystal display device 106. indicate.

  The cloth comes into contact with the touch panel 108 by cleaning with the cloth. This contact position is detected by the touch panel 108. Depending on the number of times of detection, the number of times of contact at each coordinate is subtracted. Therefore, if the number of times of contact of each coordinate in the cleaning mode increases, the display color for the stain on the liquid crystal display device 106 is reduced, and at the same time, an effect for removing the stain on the touch panel 108 is achieved. . At this time, the user can feel the effect that the screen display changes and the dirt is removed each time cleaning is performed.

  FIG. 6A is a diagram showing the estimated dirt displayed on the liquid crystal display device 106 when the dirt information display method is shifted to the dirt information deletion method in the cleaning mode, and FIG. Are the same.

  FIG. 6B shows a liquid crystal display device when the user cleans the display so that the number of contacts in all coordinates of the region 200 and the region 202 is 1 to 20 from the display of the estimated dirt in FIG. FIG. In FIG. 6B, an area 206 is an area having coordinates of 1 to 20 on the liquid crystal display device 106 and is displayed in the display color 182.

  FIG. 6C shows the estimated dirt displayed in FIG. 6B on the liquid crystal display device 106 when the user wipes the touch panel 108 with a cloth in accordance with the wiping locus 210 for removing the dirt. An estimated dirt area 208 is shown. In FIG. 6C, an area 208 is an area composed of coordinates with a contact count of 1 to 20 on the liquid crystal display device 106 and is displayed in the display color 182.

  Further, when the user repeats cleaning and the estimated dirt in the area 208 is completely removed, the mobile phone 100 ends the cleaning mode and shifts to the normal mode. That is, the mobile phone 100 ends the cleaning mode when all the values in the contact count memory corresponding to the area 208 become zero.

(Outline of sound effect generation method)
When the user is cleaning full-screen liquid crystal touch panel 104 in the cleaning mode, mobile phone 100 according to the present embodiment generates a sound effect according to how much estimated dirt has been deleted. Hereinafter, a method for generating sound effects will be described.

  Table 2 shows an example of sound effects generated by the mobile phone 100 in accordance with the degree of deletion of estimated dirt.

テーブル２に示されるように、全画面液晶タッチパネル１０４上の全座標の接触回数の総和に基づいて、携帯電話機１００が発する効果音を設定する。接触回数の総和が多いほど、汚れのひどい物を掃除していることを想起させるような効果音を設定し、接触回数の総和が少ないほど、汚れのかるい物を掃除していることを想起させるような効果音を設定する。このように効果音を発生することにより、ユーザは、実際に液晶表示装置１０６の表示面から汚れを効果的に除去しているように感ずることができ、掃除が楽しく感じられるという効果が期待できる。

As shown in Table 2, the sound effect emitted by the mobile phone 100 is set based on the total number of touches of all coordinates on the full-screen liquid crystal touch panel 104. The higher the total number of contacts, the more effective the sound is set to remind you that you are cleaning dirty objects. The smaller the total number of contacts, the more you are cleaning dirty objects. Set sound effects. By generating sound effects in this way, the user can feel as if the dirt has been effectively removed from the display surface of the liquid crystal display device 106, and the effect that cleaning can be enjoyed can be expected. .

  FIGS. 7A to 7C are diagrams showing examples in which the mobile phone 100 emits sound effects in accordance with the display of dirt on the liquid crystal display device 106. The display of dirt is shown in FIG. To (C). 7A to 7C, the total number of contact times of all coordinates is 601 or more, 301 to 600, and 1 to 300, respectively. As shown in FIG. 7, sound effects corresponding to these contact times are emitted from the speaker 110.

<Hardware configuration of mobile phone 100>
FIG. 8 is a block diagram showing the electrical configuration of mobile phone 100 according to the present embodiment. Referring to FIG. 8, a mobile phone 100 includes a speaker 110, a microphone 112, a full-screen liquid crystal touch panel 104 (liquid crystal display device 106 and touch panel 108), an antenna 280, and a mobile phone casing 102 (see FIG. 1). Vibration unit 284, ringer 286, initial setting value of mobile phone 100, computer program for deleting estimated dirt (hereinafter, the computer program is simply referred to as “program”), and various applications. Using a non-volatile memory 288 for storing programs and the like, a speaker 110, a microphone 112, a full-screen liquid crystal touch panel 104, an antenna 280, a vibration unit 284, a ringer 286, and a memory 288, Launch the application To view those of the output on the display surface of the liquid crystal display device 106, and a control circuit 282 for realizing a function of receiving or user input from the touch panel 108. One of the programs executed by the control circuit 282 is a program for executing the above-described calculation processing of the number of times of contact, and the other one assists the user in removing dirt by executing input and display in the cleaning mode. It is a program to do.

  The control circuit 282 includes an incoming signal detection unit 298, a line closing unit 296, an RF (Radio Frequency) processing unit 294, an audio interface (audio I / F) 290, a baseband processing unit 292, and a communication control. Part 300.

  The incoming signal detection unit 298 detects the presence / absence of an incoming call from another mobile communication terminal or the like at another site based on the signal received from the base station via the antenna 280 and outputs an incoming call detection signal.

  The line closing unit 296 controls on / off of the communication line via the antenna 280 in response to a predetermined control signal.

  The RF processing unit 294 controls the strength of signals transmitted to and received from the base station via the line closing unit 296 and the antenna 280.

  The baseband processing unit 292 performs predetermined signal processing on a signal given to the RF processing unit 294 and a signal received via the RF processing unit 294 in order to exchange a safe signal with the base station.

  The audio I / F 290 includes a DA (Digital-to-Analog) converter and an AD (Analog-to-Digital) converter, and performs audio input / output via the microphone 112 and the speaker 110.

  The communication control unit 300 includes an audio I / F 290, a baseband processing unit 292, an RF processing unit 294, and a line closing unit 296 in the control circuit 282, a full-screen liquid crystal touch panel 104, a vibration unit 284, a ringer outside the control circuit 282. By controlling the 286 and the incoming signal detection unit 298, a call is made in response to a request from the user or an incoming call is processed, so that voice communication between the user and another portable communication terminal or the like is performed. Or performing character communication, or processing for assisting the removal of dirt on the full-screen liquid crystal touch panel 104.

  The communication control unit 300 is substantially a computer, and is realized by a CPU (Central Processing Unit) and software executed by the CPU. In the present embodiment, this software is stored in the memory 288, and is appropriately read out and executed by the communication control unit 300. Although details are not described in this embodiment, the contents of the memory 288 can be rewritten, whereby various functions can be upgraded and added by the mobile phone 100.

(Configuration of communication control unit 300)
FIG. 9 is a block diagram showing details of the dirt removal support processing unit 350 among the processes realized by the communication control unit 300. Referring to FIG. 9, dirt removal support processing unit 350 functions by communication between full-screen liquid crystal touch panel 104 and memory 288.

(Configuration of memory 288)
Referring to FIG. 9, a memory 288 includes a contact number storage unit 354 corresponding to the contact number memory shown in Table 1, a display color storage unit 360 for storing display colors shown in FIG. A sound effect storage unit 364 for storing sound data of a sound, a parameter storage unit 368 for storing parameters for processing of dirt removal support, and a variable used internally by a program for assistance of dirt removal Includes an internal variable storage unit 366.
The variables stored in the internal variable storage unit 366 include the previous contact coordinates for storing the coordinates of the previous touch on the full-screen liquid crystal touch panel 104. Details thereof will be described later.

(Configuration of the dirt removal support processing unit 350)
When the coordinate information detected by the touch panel 108 is received from the touch panel 108 in the normal mode, the dirt removal support processing unit 350 is based on the coordinate information and the parameter R stored in the parameter storage unit 368, thereby determining the contact area. The contact region is extracted by the contact number storage processing unit 352 for updating the contact number of each coordinate in the extracted contact region stored in the contact number storage unit 354 and the cleaning mode is switched. Sometimes, the contact count storage unit 354 and the display color storage unit 360 are referred to, and based on the information stored therein, the estimated stain distribution and intensity are displayed as regions of various colors on the liquid crystal display device 106. And a dirt information display processing unit 356. The parameter R represents the minimum amount of finger movement for determining that there has been a substantial movement of the finger during dragging. Therefore, the parameter R is hereinafter referred to as “minimum movement amount”.

  In response to receiving coordinate information detected by the touch panel 108 from the touch panel 108 when the user wipes the touch panel 108 with a cloth in the cleaning mode, the dirt removal support processing unit 350 further stores the coordinate information and parameters. The contact area is extracted based on the minimum movement amount R ′ stored in the unit 368, and the contact count of each coordinate of the extracted contact area stored in the contact count storage unit 354 is subtracted, and the contact of each coordinate is determined. The display color corresponding to the number of times is acquired from the display color storage unit 360, and the stain information deletion processing unit 358 for performing the process of causing the liquid crystal display device 106 to redisplay the stain information, and the stain information deletion processing unit 358 in the cleaning mode. Every time the number of touches is updated, the sum of the number of touches of all coordinates is calculated and the sound effect corresponding to the sum is stored as a sound effect. 364 selected via the audio I / F 290 in the and a sound effect producing section 362 for outputting from the speaker 110.

  In addition, the dirt removal support processing unit 350 further cleans from the parameter input instruction unit 370 for updating the values of the parameters in the parameter storage unit 368 and the normal mode by the dialog with the user using the full-screen liquid crystal touch panel 104. A cleaning mode switching instruction unit 372 for switching to the mode is included.

  Default values are determined in advance for each parameter in the parameter storage unit 368. However, when the user specifies the value of each parameter using the parameter input instruction unit 370, the value of each parameter in the parameter storage unit 368 is updated to the specified value.

<Software Configuration of Mobile Phone 100>
10 to 14 show a control structure of a program executed by the mobile phone 100 in a flowchart format. By executing this program by the communication control unit 300 which is substantially a computer, the dirt removal support processing unit 350 of the mobile phone 100 is realized.

(Program structure for the contact count storage processing unit 352)
FIG. 10 is a flowchart showing a control structure of a program for realizing the function of the contact count storage processing unit 352. Referring to FIG. 10, in step 400, a variable representing the previous contact coordinates in internal variable storage unit 366 shown in FIG. 9 is initialized. The previous contact coordinates are variables for storing the coordinates recorded as the previous contact position when the user's finger is dragging on the full-screen liquid crystal touch panel 104. In the present embodiment, when the contact position is moving, the coordinates are not recorded one by one, and it is considered that the movement has occurred only when moving beyond a certain fixed amount (minimum moving amount R). . Therefore, it is necessary to store the coordinates of the previous contact position in this way.

  In step 402, it is determined whether or not contact coordinates are received from the touch panel 108. If the determination result is YES, the process proceeds to step 404. If the determination result is NO, the process returns to step 402.

  In step 404, the received coordinate information is based on the start of contact, or the movement distance between the coordinate detected in step 402 and the previous contact coordinate is the minimum movement amount R stored in the parameter storage unit 368 shown in FIG. Determine if greater than. The contact start means a change from a state in which the user's finger is not touching the full-screen liquid crystal touch panel 104 to a touched state. That is, it means that the state where there is no output of contact coordinates from the touch panel 108 is changed to a state where there is an output. If the determination result is YES, the process proceeds to step 406, and otherwise, the process proceeds to step 402.

  In step 406, the contact coordinates received in step 402 are substituted into a variable indicating the previous contact coordinates. Subsequently, in step 408, based on the previous contact coordinates and the minimum movement amount R stored in step 406, the contact area coordinates are extracted by the already described contact area determination method. Subsequently, in step 410, the contact count storage unit 354 is referred to, and 1 is added to each of the contact counts of all the coordinates of the contact area extracted in step 408. Thereafter, control returns to step 402.

(Program structure for the dirt information display processing unit 356)
FIG. 11 is a flowchart showing a program control structure when the function of the dirt information display processing unit 356 is realized by a computer program. Referring to FIG. 11, in step 440, 0 is substituted for each of variables X and Y indicating the update position of the contact count, and the process proceeds to step 442.

  In step 442, the contact count storage unit 354 is referred to and it is determined whether or not the contact count of the coordinates (X, Y) is greater than zero. If the determination result is YES, the process proceeds to step 444, and otherwise, the process proceeds to step 454.

  In step 444, it is determined whether or not the number of touches of the coordinates (X, Y) is smaller than 20. If the determination result is YES, the process proceeds to step 452, and otherwise, the process proceeds to step 446.

  In step 446, it is determined whether or not the number of contact times of the coordinates (X, Y) is 20 or more and less than 40. If the determination result is YES, the process proceeds to step 450, and otherwise, the process proceeds to step 448.

  In Steps 448, 450, and 452, the display color storage unit 360 is referred to, and the display colors 186, 184, and 182 shown in FIG. 4 are selected, and the process proceeds to Step 454.

  In step 454, the display color selected in step 448, step 450, or step 452 is displayed in the dot area of coordinates (X, Y) on the liquid crystal display device 106, and the process proceeds to step 456.

In step 456, the variable X is equal to or greater than the constant _{X max.} If the determination result is YES, the process proceeds to step 458, and otherwise, the process proceeds to step 460.

  In step 458, 1 is added to the current value of variable Y, and 0 is substituted into variable X. Control continues to step 462.

  On the other hand, in step 460, 1 is added to the current value of the variable X, and the process returns to step 442.

In step 462, the variable Y is equal to or greater than a constant _{Y max.} If the determination result is YES, the process ends, otherwise the process returns to step 442.

(Program structure for the dirt information deletion processing unit 358)
12 and 13 are flowcharts showing the control structure of the program for realizing the function of the dirt information deletion processing unit 358.

  Referring to FIG. 12, in step 482, as in step 400 shown in FIG. 10, a variable indicating the previous contact coordinates is initialized and the process proceeds to step 484.

  In step 484, it is determined whether or not contact coordinates are received from the touch panel 108, as in step 402 shown in FIG. If the determination result is YES, the process proceeds to step 486, and otherwise, the process returns to step 484.

  In step 486, as in step 404 shown in FIG. 10, it is determined whether the state has changed from the state without contact to the state with contact, or the distance from the previous contact coordinate to the current contact coordinate is greater than the parameter R ′. To do. If the determination result is YES, the process proceeds to step 488, and otherwise, the process returns to step 484. The parameter R ′ represents the minimum movement amount of the contact position for considering that the contact position of the cloth for cleaning is substantially moved when dragging in the cleaning mode. Hereinafter, in this specification, the parameter R ′ is referred to as “minimum moving distance during deletion”.

  In step 488, as in step 406 shown in FIG. 10, the coordinate value received in step 484 is substituted for the variable representing the previous contact coordinates, and the flow proceeds to step 490.

  In step 490, similar to step 408 shown in FIG. 10, based on the previous contact coordinates and the minimum movement amount R ′ stored in step 488, the contact region coordinates are extracted by the contact region determination method described above. Then, it progresses to step 491.

  In step 491, the first dot in the contact area is selected as preparation for updating the number of times of contact for all coordinates in the contact area.

  Subsequently, in step 492, it is determined whether or not the update processing of the number of times of contact has been completed for all dots in the contact area. If the determination result is YES, the process proceeds to step 487, and otherwise, the process proceeds to step 494.

  In step 494, the contact count storage unit 354 is referred to, and it is determined whether or not the contact count of the currently referred coordinates in the contact area extracted in step 490 is greater than 40. If the determination result is YES, the process proceeds to step 495, and otherwise, the process proceeds to step 496.

  In step 496, the contact count storage unit 354 is referred to, and it is determined whether or not the contact count of the coordinates currently referred to in the contact area coordinates extracted in step 490 is greater than 20. If the determination result is YES, the process proceeds to step 497, and otherwise, the process proceeds to step 498.

  In step 498, the display of the dirt corresponding to the coordinate currently referred to among the contact area coordinates is deleted from the liquid crystal display device 106. At the same time, the contact count storage unit 354 is referenced to update the contact count of the currently referenced coordinate to 0, and the process proceeds to step 499.

  On the other hand, in step 497, the contact count storage unit 354 is referred to, and the contact count corresponding to the currently referenced coordinates is updated to 20. At the same time, the display color storage unit 360 is referred to obtain a display color 182 corresponding to the number of times of contact = 20, and the display color 182 is displayed in the dot area of the currently referred coordinates on the liquid crystal display device 106. Then, the process proceeds to Step 499.

  In step 495, the number of contacts corresponding to the currently referred coordinates stored in the contact count storage unit 354 is updated to 40. At the same time, the display color storage unit 360 is referred to obtain the display color 184 corresponding to the number of times of contact = 40, and the display color 184 is displayed in the dot area of the currently referenced coordinates on the liquid crystal display device 106. Go to step 499.

  In step 499, coordinates that have not yet been processed among the contact area coordinates are selected as the next processing target, and the process returns to step 492.

  On the other hand, if it is determined in step 492 that the processing has been completed for all the coordinates of the contact area, in step 487, the sum of the number of contact times of all the coordinates stored in the contact number storage unit 354 is calculated, It is determined whether or not the sum is zero. If the determination result is YES, the process proceeds to step 500 in FIG. 13, and otherwise, the process proceeds to step 489.

  In step 489, a signal for instructing the sound effect output process is transmitted to the program for realizing the sound effect generation processing unit 362 with the sum of the number of contacts of all coordinates as an argument, and the process returns to step 484.

  Referring to FIG. 13, in step 500, as in step 402 shown in FIG. 10, it is determined whether or not contact coordinates are received from touch panel. If the determination result is YES, the process returns to step 500, and otherwise, the process proceeds to step 502.

  In step 502, the cellular phone 100 is shifted from the cleaning mode to the normal mode, and the process is terminated.

(Program structure for sound effect generation processing unit 362)
FIG. 14 is a flowchart showing a control structure of a program routine for realizing the function of the sound effect generation processing unit 362.

  Referring to FIG. 14, in step 510, referring to the sound effect storage unit 364, a sound effect corresponding to the sum of the number of touches of all coordinates is selected. In the following step 512, the sound effect selected in step 510 is output from the speaker 110 via the audio I / F 290. Thereafter, the process returns to the original routine.

<Operation>
With reference to FIGS. 9 to 14, mobile phone 100 according to the present embodiment operates as follows. The contact count storage unit 354 is initialized. That is, an area corresponding to the contact count storage unit 354 is secured in the memory 288, and 0 is written as the contact count of all coordinates. The display color storage unit 360 stores in advance display colors corresponding to the range of the number of contacts as shown in FIG. In the sound effect storage unit 364, as shown in Table 2, sound effects corresponding to the sum of the number of contact times of all coordinates are stored in advance.

  When the user turns on the power switch of the mobile phone 100, as shown in FIG. 1, the mobile phone 100 starts up in the normal mode, and displays numeric keys and the like used in the normal mobile phone on the liquid crystal display device 106. At the same time, the contact count storage processing unit 352 is also activated in the mobile phone 100. Default values are preset for the minimum movement amounts R and R ′ in the parameter storage unit 368. However, the user can freely set these values by the parameter input instruction unit 370.

  It is assumed that the user's finger touches any position on the touch panel 108 from a state where the touch panel 108 is not touched. The touch panel 108 illustrated in FIG. 8 detects the position touched by the user, and transmits the coordinates of the detected position to the contact count storage processing unit 352. When receiving the coordinates from the touch panel 108, the contact count storage processing unit 352 estimates the contact area of the user's finger based on the received coordinates and the minimum movement amount R by the above-described contact area determination method. The contact count storage processing unit 352 adds 1 to the contact count of each coordinate of the estimated contact area in the contact count storage unit 354. When the state of no contact is changed to the state of contact, the position coordinates output from the touch panel 108 are stored in the variable indicating the previous contact coordinates.

  When the user's finger moves while touching the touch panel 108 (drag), the touch panel 108 detects the coordinates of the end of the drag and transmits it to the contact count storage unit 354. The coordinates of the starting point of the drag are stored in a variable indicating the previous contact coordinates. The contact count storage processing unit 352 determines whether the movement distance between the previous contact coordinates and the coordinates received from the touch panel 108 is greater than the minimum movement amount R. No processing is performed. If the movement distance is greater than the minimum movement amount R, the contact count storage processing unit 352 uses the contact area determination method described above based on the received coordinates and the minimum movement amount R to determine the portion of the part that the user's finger actually touched. Estimate the contact area. The contact count storage processing unit 352 refers to the contact count storage unit 354 and adds 1 to the estimated contact count of each coordinate of the contact area.

  The contact count storage processing unit 352 repeats the above process during the normal mode.

  When the user activates the cleaning mode using the cleaning mode switching instruction unit 372, the mobile phone 100 operates as follows. First, when the cleaning mode is activated, the processing of the contact count storage processing unit 352 is terminated.

  After confirming that the dirt information display processing unit 356 has shifted to the cleaning mode, referring to the contact count storage unit 354 and the display color storage unit 360, as shown in FIG. In order to indicate the distribution of estimated dirt and its intensity on the coordinate dot area, a display color corresponding to the number of contact times of each coordinate is displayed. However, characters and symbols used in the normal mode are displayed as they are in the dot area where the number of times of contact is zero.

  After the estimated dirt is displayed on the liquid crystal display device 106, the user starts cleaning the touch panel 108.

  Simultaneously with the transition to the cleaning mode, the dirt information deletion processing unit 358 executes the following processing. In order for the user to clean the touch panel 108 by wiping it with a cloth or the like, it is assumed that the cloth has changed from a state where the touch panel 108 is not touched to a state where the touch panel 108 is touched. The touch panel 108 detects the coordinates of the position touched by the cloth and transmits the coordinates to the dirt information deletion processing unit 358. At this time, the dirt information deletion processing unit 358 substitutes the coordinates of the contact position in the variable indicating the previous contact coordinates.

  Based on the coordinates received from the touch panel 108 and the minimum movement amount R ′, the dirt information deletion processing unit 358 estimates the contact area of the part actually touched by the contact area determination method described above. The dirt information deletion processing unit 358 further refers to the contact count storage unit 354 so as to update the contact count of each coordinate of the estimated contact area to a smaller number, and according to the updated contact count, The display color of the contact area on the liquid crystal display device 106 is changed. Specifically, the dirt information deletion processing unit 358 operates as follows.

  That is, the dirt information deletion processing unit 358 refers to the contact number storage unit 354 and the display color storage unit 360, and if the contact number of a certain coordinate in the contact area is greater than 40, converts the contact number of the coordinate to 40. To do. The dirt information deletion processing unit 358 further displays the display color 184 shown in FIG. 4 in the dot area of the coordinates on the liquid crystal display device 106. If the number of contacts at a certain coordinate in the contact area is 40 or less and greater than 20, the dirt information deletion processing unit 358 converts the number of contacts at the coordinate to 20 and puts it in the dot area of the coordinate on the liquid crystal display device 106. The display color 182 shown in FIG. 4 is displayed. On the other hand, if the number of contacts at a certain coordinate in the contact area is 20 or less, the stain information deletion processing unit 358 converts the number of contacts at the coordinate to 0 and removes the stain from the dot area at the coordinate on the liquid crystal display device 106. Delete the display color for

  When the user drags the cloth, the dirt information deletion processing unit 358 operates as follows. The drag start position is stored as a variable indicating the previous contact coordinates at the start of contact (step 488). When the cloth is dragged, the touch panel 108 detects the coordinates of the end of the drag and transmits the detected coordinates to the contact count storage unit 354. The contact count storage unit 354 determines whether or not the movement distance between the previous contact coordinates and the coordinates received from the touch panel 108 is greater than the minimum movement amount R ′ (step 486), and the movement distance is equal to or less than the minimum movement amount R ′. If so, no processing is performed (NO in step 486). If the movement distance is larger than the minimum movement amount R (YES in step 486), the coordinates output from the touch panel 108 at this time are substituted into a variable indicating the previous contact position (step 488 in FIG. 12). Further, the dirt information deletion processing unit 358 estimates the contact area of the portion actually touched by the cloth based on the received coordinates and the minimum movement amount R ′, and extracts the coordinates (step 490). The dirt information deletion processing unit 358 refers to the contact count storage unit 354 to update the contact count of each coordinate of the extracted contact area to a smaller number, and correspondingly the contact on the liquid crystal display device 106. The display color of the dot area is changed (steps 492 to 499 in FIG. 12).

  Thereafter, the dirt information deletion processing unit 358 refers to the contact count storage unit 354 and determines whether or not the sum of the contact counts of all coordinates is 0 (step 487 in FIG. 12). If the sum is not 0 (NO in step 487), the dirt information deletion processing unit 358 instructs the sound effect generation processing unit 362 to perform a sound effect output process using the sum of the number of contacts as an argument.

  When the sound effect generation processing unit 362 receives an instruction to output a sound effect from the dirt information deletion processing unit 358, the sound effect corresponding to the total number of times of contact is received from the sound effect storage unit 364 based on the total number of times of contact of all coordinates. Is transmitted to the audio I / F 290 as a sound signal and output from the speaker 110.

  On the other hand, in the above-described step 487, if the sum of the number of contact times of all coordinates is 0, the estimated dirt is erased from the liquid crystal display device 106. The dirt information deletion processing unit 358 determines whether or not the cloth is touching the touch panel 108 (step 500 in FIG. 13). If not touched (NO in step 500), the cleaning mode ends, and the mobile phone 100 is turned off. Switch to normal mode. If touched, the dirt information deletion processing unit 358 continues the processing as it is. That is, while the user wipes the touch panel 108 using a cloth, the mobile phone 100 operates in the cleaning mode, all estimated dirt is removed, and returns to the normal mode when the cloth is released from the touch panel 108.

<Effect of the first embodiment>
By using the mobile phone 100 according to the present embodiment, the mobile phone 100 can store information for estimating dirt as the number of times of contact, thereby presenting the distribution of dirt and the degree of dirt to the user. . The user can clean the touch panel 108 using the dirt distribution and the degree of dirt displayed on the screen. At this time, the mobile phone 100 presents information such as the remaining dirt level and the position of forgetting cleaning to the user in an easy-to-understand manner, so that the user can efficiently clean the touch panel 108. Since the mobile phone 100 determines the end of cleaning, the user does not have to worry about whether or not to end the cleaning by himself / herself. Furthermore, since the mobile phone 100 generates sound effects according to the progress of the cleaning, the user can enjoy cleaning while realizing that the screen is clean.

[Second Embodiment]
The appearance configuration of the mobile phone 600 to which the display-integrated touch panel device according to the second embodiment of the present invention is applied is substantially the same as the appearance configuration of the mobile phone 100 according to the first embodiment shown in FIG. is there. However, in the cleaning mode of the mobile phone 100 according to the first embodiment, in place of the function for supporting the dirt removal by the display color, a function for supporting the dirt removal by the character display is provided. Different from the mobile phone 100 shown in FIG.

<Outline of dirt removal method>
Details of the hardware configuration of the mobile phone 600 according to the second embodiment will be described later. First, a method for removing dirt on the full-screen liquid crystal touch panel 104 will be described.

(Outline of contact count storage system)
In the present embodiment, the mobile phone 600 stores the number of contacts of each coordinate on the full-screen liquid crystal touch panel 104 by the same contact number storage method as that of the first embodiment while operating in the normal mode. Therefore, information on the number of contact times of each coordinate shown in Table 1 is stored in the memory of the mobile phone 600.

(Outline of stain distribution information storage system)
In the present embodiment, when shifting from the normal mode to the cleaning mode, the distribution information of dirt on the full-screen liquid crystal touch panel 104 is stored based on the number of times of contact of each coordinate stored in the normal mode. The significance of this method will be clarified by a dirt information deletion method by character display described later.

  FIGS. 15A to 15C are diagrams for explaining a method for acquiring the distribution information of dirt on the full-screen liquid crystal touch panel 104.

Referring to FIG. 15A, as indicated by an arrow 544, the length from the left end to the right end in the horizontal direction of full-screen liquid crystal touch panel 104 is _Xmax . As indicated by an arrow 546, the length from the upper end to the lower end in the vertical direction of the full-screen liquid crystal touch panel 104 is _Ymax .

As indicated by an arrow 530, when the horizontal length 544 of the full-screen liquid crystal touch panel 104 is equally divided by α (α is an integer of 2 or more), one division width is X _max / α. As indicated by an arrow 532, when the vertical length 546 of the full-screen liquid crystal touch panel 104 is divided into β equal parts (β is an integer of 2 or more), the length of one division width is Y _max / β It is. It is assumed that α and β are predetermined in the memory of the mobile phone 600 by default values or values specified by the user.

In the dirt distribution information storage method according to the present embodiment, each region having a width of X _max / α and a height of Y _max / β is set as a processing target. As shown in FIGS. 15 (A) to (C), for all the regions obtained by moving the width by X _max / 2α and the height by Y _max / 2β, the following units are used as units. The stain is calculated as follows. In the following description, the upper left point of each area is referred to as the base point of that area.

  For each of the above-described regions (for example, the region 534 in FIG. 15A, the region 536 in FIG. 15B, the region 540 in FIG. 15C, etc.) The sum total of the number of contact times of the coordinates included in 534 is calculated. Based on this result, the central coordinates of the area 534 and the total number of contact times are stored in the memory of the mobile phone 600.

  Table 3 shows an example of the center coordinates of the region stored in the above processing and the total number of contact times. In Table 3, the area ID is identification information for specifying each area. In this embodiment, sequential numbers such as 1, 2, 3,. If one row on the full-screen liquid crystal touch panel 104 has (2α-1) regions as described above and (2β-1) regions as described above for one column, the region ID is 1. It can take up to (2α-1) × (2β-1). The dirt flag is a flag for indicating whether or not the corresponding area is noticeable. A method for specifying the dirt flag will be described later.

  As shown in Table 3, the information storing the area ID, the center coordinates, the total number of contacts, and the dirt flag for the area referred to on the full-screen liquid crystal touch panel 104 is referred to as “dirt distribution information”.

  By repeating the above-described processing until the reference area reaches the bottom line of the full-screen liquid crystal touch panel 104, the table 3 having the area IDs of 1 to (2α-1) × (2β-1) can be obtained. When the table 3 is created for the first time, the value of the dirt flag is “OFF”.

（キャラクタ表示による汚れ情報削除方式の概略）
本実施の形態では、汚れ分布情報に基づいて、接触回数が特に多い領域にキャラクタを表示する。その結果、表示された領域の汚れが顕著であることをユーザに示し、その領域を特に掃除するべきであることを促す。以下に、キャラクタ表示による汚れ情報削除方式の概略について説明する。

(Outline of dirt information deletion method by character display)
In the present embodiment, a character is displayed in an area where the number of contacts is particularly large based on the dirt distribution information. As a result, the user is shown that the displayed area is very dirty, and urges that the area should be cleaned. The outline of the dirt information deletion method based on character display will be described below.

  16 (A) to 16 (F) and FIGS. 17 (A) to 17 (F) show the estimated dirt display by the character display and the user wipes the touch panel 108 with a cloth in the present embodiment. It is a figure explaining the method of removing the character adhering on the touchscreen 108. FIG.

  By referring to the dirt distribution information shown in Table 3, it is possible to extract a region where the sum of the number of contacts is larger than a certain value. A certain value can be set arbitrarily, but here the value is 200. In other words, in the present embodiment, a region where the total number of times of contact is greater than 200 is a region where dirt is conspicuous.

  Referring to FIG. 16A, it is assumed that a region 560, a region 562, a region 564, a region 566, a region 568, and a region 578 are extracted as regions where dirt is conspicuous. The example of the sum total of the contact frequency of each coordinate contained in each area | region at this time is shown. In the table 4, in addition to the total number of contact times, the order of the degree of contamination is also stored. In the present embodiment, the order of the degree of contamination is such that areas are sorted in ascending order of the total number of contacts, and assigned in order of 1, 2, etc. from the top. That is, the lower the degree of dirt, the lower the degree of dirt, and the higher the degree of dirt, the higher the degree of dirt.

本実施の形態においては、掃除モードでは、汚れが顕著な領域として抽出された領域にキャラクタを表示する。汚れの情報を表示するためのキャラクタは、図１６（Ｂ）、（Ｄ），（Ｆ），並びに図１７（Ｂ），（Ｃ），（Ｅ）及び（Ｆ）において、キャラクタ５７０，５７４，５７６，５８０，５８２，５８４及び５８６により示されるように、複数ある。また、接触回数の総和に応じて、例えば図１６（Ｂ）及び（Ｆ）のキャラクタ５７０及び５７６、並びに図１７（Ｃ）及び（Ｅ）のキャラクタ５８２及び５８４のように、キャラクタのサイズを変えて表示する。

In the present embodiment, in the cleaning mode, a character is displayed in a region extracted as a region where dirt is remarkable. Characters for displaying dirt information are characters 570, 574, and FIGS. 17B, 17C, 17E, and 17F. There are a plurality as indicated by 576, 580, 582, 584 and 586. Further, according to the total number of times of contact, the character size is changed, for example, characters 570 and 576 in FIGS. 16B and 16F and characters 582 and 584 in FIGS. 17C and 17E. To display.

  Hereinafter, a character size selection method and a plurality of character selection methods will be described based on the order of the degree of contamination in each region and the total number of times of contact.

(Character size selection method)
Referring to FIG. 18, there are three sizes of characters 701, 704, and 708 displayed on liquid crystal display device 106. The vertical sizes A, B, and C of these characters 701, 704, and 708 (respective lengths are indicated by 700, 702, and 706) are A <B <C.

  Table 5 shows examples of character sizes displayed in accordance with the range of the total number of touches.

掃除モードでは、テーブル５にしたがい、各領域の接触回数の総和に対応したサイズで各キャラクタを表示する。

In the cleaning mode, according to the table 5, each character is displayed in a size corresponding to the total number of contacts in each area.

(Character selection method)
Referring to FIG. 19, in the present embodiment, two types of characters 722 and 724 are used as characters to be displayed in accordance with the range of the degree of dirt. In FIG. 19, the symbol γ is a number obtained by dividing the number of regions extracted as having significant dirt by two. The decimal part is carried forward. In the example shown in Table 4, since the number of extracted regions is 6 because contamination is remarkable, γ = 3.

  Referring to FIG. 19, for each area of table 4, when the rank degree of dirt is 1 or more and γ or less, character 722 is displayed at the position of that area, and character 724 is displayed in an area where the rank is higher than γ. indicate. The size of the character display is as shown in Table 5.

  In the present embodiment, in the cleaning mode, characters are displayed in order from the region with the lowest degree of dirt, and when the user cleans the region by wiping the region, the character at that position is erased. Then, the same process is performed on the region with the next highest degree of contamination. By repeating such processing, cleaning of all areas having a large degree of contamination is executed.

  Specifically, cleaning support processing is performed in the following procedure. First, a character is displayed in an area 564 where the degree of dirt is 1 as shown in FIG. Referring to Table 4, since the total number of contact times is 250 in area 564, the character size in area 564 is A. Further, the character 722 is selected because the order of the degree of dirt is 1 and is equal to or less than γ (= 3).

  On the other hand, as shown in FIG. 16C, the user cleans the cloth 572 by wiping the area 564 where the character 570 is displayed. In the cleaning mode, the number of contacts at the contacted position is updated to a smaller value in the same manner as in the first embodiment. The character size is reduced according to the sum of the number of contact times of the coordinates included in the area 564, and the character is eventually erased. The user cleans area 564 until character 570 is hidden.

  Referring to FIG. 16D, next, a size A character 574 is displayed in an area 562 where the degree of contamination is 2. In this case, the type and size of the character are determined by the method described above.

  Referring to FIG. 16E, the user cleans area 562 with cloth 572, and reduces the total number of times of contact in area 562 until it becomes smaller than 200, which is a constant value. The character 574 is not displayed.

  Referring to FIG. 16F, next, a size B character 576 is displayed in an area 566 where the degree of dirt is 3 in order.

  Referring to FIG. 17A, the user cleans area 566 with cloth 572, and reduces the total number of contact times of area 566 in the dirt distribution information until it becomes smaller than 500.

  Referring to FIG. 17B, in table 5, when the range of the total number of contact times is 201 to 500, the character size is displayed as A. Therefore, instead of character 576, the character of size A is displayed. 580 is displayed in area 566.

  Referring to FIG. 17C, the user further cleans area 566 with cloth 572, and reduces the total number of contact times of area 564 in the dirt distribution information until it becomes smaller than 200, which is a constant value. The character 580 is not displayed. Next, a size C character 582 is displayed in an area 560 where the order of the degree of dirt is 4.

  Referring to FIG. 17D, the user cleans area 560 with cloth 572, and reduces the total number of contact times of area 560 in the dirt distribution information to 700 or less.

  Referring to FIG. 17E, in Table 5, when the range of the total number of times of contact is from 501 to 700, the character size is displayed as B. Therefore, instead of the character 582, the character of size B is displayed. 584 is displayed in area 560.

  Referring to FIG. 17F, the user further cleans area 560 where character 584 is displayed with cloth 572, and reduces the total number of times of contact in area 560 to 500 or less. Instead of the character 584, a size A character 586 is displayed in the area 560.

  The user further cleans the area 560 and the character 586 is hidden. Furthermore, when the user cleans the characters in the remaining area extracted in the table 4 until they are not displayed, the mobile phone 600 ends the cleaning mode and shifts to the normal mode.

<Hardware configuration of mobile phone 600>
The hardware configuration of mobile phone 600 according to the present embodiment is the same as the hardware configuration of mobile phone 100 according to the first embodiment shown in FIG. However, the mobile phone 600 according to the present embodiment is the first embodiment in that the information stored in the memory 288 is information and a program used for realizing the dirt removal support function by character display. This is different from the mobile phone 100 according to the above.

(Configuration of memory 288)
The memory 288 is the same as that shown in FIG. 9 in terms of hardware, and includes a similar contact count storage unit 354. In the present embodiment, the memory 288 further stores area IDs, center coordinates, total number of touches, and dirt distribution information for the dirt flag referred to on the full-screen liquid crystal touch panel 104 shown in FIG. A dirt distribution information storage unit 762 that functions as a work area for performing the processing, a character storage unit 764 for storing a character to be displayed in an area where dirt is conspicuous on the full-screen liquid crystal touch panel 104 as shown in FIG. As shown in FIG. 4, a character size storage unit 766 for storing the character size corresponding to the sum of the number of times of contact of each area on the full-screen liquid crystal touch panel 104, and a parameter for the dirt removal support processing by character display are stored. A parameter storage unit 770 for performing image capturing and a function for supporting dirt removal by character display Including an internal variable storage unit 768 for storing the internal variables used by the program to present.

(Configuration of the dirt removal support processing unit 744)
FIG. 20 is a block diagram showing the configuration of the stain removal support processing unit 744 realized by the communication control unit 300 shown in FIG. 8 executing a program for realizing the stain removal support function according to the present embodiment. Show. Referring to FIG. 20, dirt removal support processing unit 744 functions by communication between full-screen liquid crystal touch panel 104 and memory 288.

  The dirt removal support processing unit 744 includes a contact count storage processing unit 352, a parameter input instruction unit 370, and a cleaning mode switching instruction unit 372 similar to those shown in FIG.

  As the values of the parameters in the parameter storage unit 770, default values are determined in advance. However, when the user designates the value of each parameter by operating the touch panel 108 using the parameter input instruction unit 370, the value of each parameter in the parameter storage unit 770 is updated to the designated value.

  The dirt removal support processing unit 744 is further referred to on the full-screen liquid crystal touch panel 104 as shown in FIG. 15 with reference to the contact count storage unit 354 when the operation mode of the mobile phone 600 is switched to the cleaning mode. A stain distribution information generation processing unit 746 for generating stain distribution information as shown in Table 3 and storing the generated stain distribution information in the stain distribution information storage unit 762, and a stain distribution information generation processing unit. After the process of 746 is completed, the information stored in the dirt distribution information storage unit 762, the character storage unit 764, and the character size storage unit 766 is referred to according to the degree of dirt in the area on the full-screen liquid crystal touch panel 104. Among the areas determined to be markedly contaminated, a predetermined area is classified into a type according to the order of the degree of dirt and the degree of dirt in the area, and In response to the user wiping the touch panel 108 with a cloth or the like in the cleaning mode in response to the user displaying the character in the cleaning mode. And a dirt information deletion processing unit 750 for changing the size or deleting the size.

  The dirt information deletion processing unit 750 receives coordinate information from the touch panel 108 when the user wipes a character displayed in a certain area on the touch panel 108 with a cloth by the character display processing unit 748. The dirt information deletion processing unit 750 extracts a contact area based on the coordinate information and the minimum movement amount R ′ stored in the parameter storage unit 770 by a method similar to the contact area determination method described above. Further, the dirt information deletion processing unit 750 updates the contact count of the region corresponding to the extracted contact region stored in the contact count storage unit 354 to a smaller number, and the updated content of the contact count storage unit 354 The dirt distribution information storage unit 762 is updated based on the above. The dirt information deletion processing unit 750 refers to the character size stored in the character size storage unit 766 and the stored content of the updated dirt distribution information storage unit 762, and the character information currently displayed on the liquid crystal display device 106. Make the size smaller. In this way, the dirt information deletion processing unit 750 repeats the above processing until the size of the character displayed on the liquid crystal display device 106 is not displayed.

  The parameter storage unit 770 includes the minimum movement amounts R and R ′ similar to those used in the first embodiment, and the horizontal and vertical divisions of the full-screen liquid crystal touch panel 104 described with reference to FIG. The numbers α and β are included.

<Software configuration of mobile phone 600>
FIGS. 21 to 24 show a control structure of a program executed by the mobile phone 600 in a flowchart format. The communication control unit 300, which is substantially a computer, executes this program, thereby realizing the dirt removal support processing unit 744 of the mobile phone 600.

(Program structure for the dirt information generation processing unit 746)
FIG. 21 is a flowchart showing a control structure of a program when the function of the dirt distribution information generation processing unit 746 is realized by a computer program. In this program, a variable C indicating the region ID to be processed and variables Kx and Ky indicating the X coordinate and the Y coordinate of the base point of the region to be processed are used.

Referring to FIG. 21, in step 790, it clears the stored contents of the soiled distribution information storage unit 762, variable C, _{K X,} and _{K Y} respectively 1,0, and 0 is substituted.

In step 796, the contact count of each coordinate stored in the contact count storage unit 354 is referred to, and the sum of the contact counts of all coordinates included in the area having the area ID represented by the variable C is calculated. Subsequently, in step 798, an entry including the area ID relating to this area, its center coordinates, the total number of touches of all coordinates in the area, and the value of the dirt flag is added to the dirt distribution information storage unit 762. The value of C is used as the value of the area ID. The central coordinates are (K _X + X _max / (2α), K _Y + Y _max / (2β)). The total number of contacts is calculated in step 796. Here, the value of the dirt flag is OFF. After this, control proceeds to step 800.

In Step 800, it is determined whether or not the variable K _X is the same as X _max −X _max / α. If the determination result is YES, it means that the currently processed area has reached the right end on the full-screen liquid crystal touch panel 104. If the determination result here is YES, the process proceeds to step 804, and otherwise, the process proceeds to step 802.

In step 802, it adds 1 to the variable C, and adds the _X max / _(2α) to the variable _{K X.} Thereafter, the process returns to step 794.

On the other hand, in step 804, the variable _{K Y} determines whether the same or not as the _{Y max -Y} max / _β. If the determination result is YES, it indicates that the currently processed area has reached the lower end on the full-screen liquid crystal touch panel 104. Therefore, if the determination result is YES, the process ends, otherwise the process proceeds to step 806.

In step 806, adds 1 to the variable C, 0 is assigned to variable _{K X,} adds the _{Y max} / beta in the variable _{K Y.} Thereafter, control returns to step 794.

(Program structure for character display processing unit 748)
22 and 23 are flowcharts showing a control structure of a program for realizing the function of the character display processing unit 748. FIG. 22 shows the first half, and FIG. 23 shows the second half. In this program, a variable C indicating an area ID and a variable D indicating the number of areas determined to be significantly dirty (the number of dirty areas) are used.

  Referring to FIG. 22, in step 810, 1 is substituted into variables C and D. In the subsequent step 814, the total number of contact times of coordinates in the region of region ID = C is acquired from the dirt distribution information storage unit 762, and whether the value is greater than the contact number threshold value (200 in this embodiment). Determine whether or not. If the determination result is YES, the process proceeds to step 816, and otherwise, the process proceeds to step 820.

  In step 816, 1 is added to the current value of the variable D, and the stain flag in the row of region ID = C is changed to ON in the stain distribution information stored in the stain distribution information storage unit 762. Thereafter, control proceeds to step 818.

In step 818, it is determined whether or not the value of the variable C is (2α-1) (2β-1) or less. The total number of areas is (2α-1) (2β-1). If the determination result is YES, it indicates that it is not determined whether or not the stain is remarkable for all areas. Therefore, if the determination result is YES, the process proceeds to step 820, and otherwise, the process proceeds to step 822.
In step 822, D / 2 is substituted for variable γ, and the process proceeds to step 824.

  γ is a threshold value for selecting the character shown in FIG. If the rank of the dirt level is γ or less, the character 722 shown in FIG. 19 is displayed, and if it is larger than γ, the character 724 is displayed.

  The counter I of the internal variable storage unit 768 is used as an index of the array variable generated in the subsequent steps.

  On the other hand, in step 820, 1 is added to the variable C. Thereafter, control returns to step 814.

  Table 6 shows an example of dirt distribution information stored in the dirt distribution information storage unit 762 when the processing of FIG. 22 is performed. In the example of Table 6, α = 2 and β = 3.

テーブル６を参照して、この実施の形態によれば、接触回数の総和が２００より大きい領域（領域ＩＤ＝２〜６及び９）の汚れフラグがＯＮとなる。

Referring to Table 6, according to this embodiment, the contamination flag of the region (region ID = 2 to 6 and 9) in which the total number of times of contact is larger than 200 is turned ON.

  In step 824, the dirt distribution information storage unit 762 is referred to extract data in the area where the dirt flag is ON, and the extracted information is stored as “processing dirt information”.

  Table 7 shows the processing dirt information when the process of step 824 is executed on the table 6.

ステップ８２６では、処理用汚れ情報の全ての領域のデータを接触回数の総和の昇順で並び換え、先頭から最後までの領域ＩＤを、それぞれＳ［１］〜Ｓ［Ｄ］の配列変数に記憶し、図２３のステップ８２８に進む。テーブル８は、テーブル７に対してステップ８２６の処理を実行した後のＳ［１］〜Ｓ［Ｄ］（Ｄ＝６）に記憶されるものの例を示す。

In step 826, the data of all areas of the processing dirt information is rearranged in ascending order of the total number of contacts, and the area IDs from the top to the end are stored in the array variables S [1] to S [D], respectively. Then, the process proceeds to Step 828 in FIG. Table 8 shows an example of what is stored in S [1] to S [D] (D = 6) after the processing of Step 826 is performed on Table 7.

図２３を参照して、ステップ８２８では、以下の繰返し処理の制御のための変数Ｉに１を代入する。続くステップ８３０では、キャラクタ記憶部７６４を参照して、変数Ｉがγ以下であればキャラクタ７２２を選択し、変数Ｉがγより大きければキャラクタ７２４を選択する。この後制御はステップ８３２に進む。

Referring to FIG. 23, in step 828, 1 is assigned to variable I for control of the following iterative process. In the subsequent step 830, the character storage unit 764 is referenced to select the character 722 if the variable I is less than or equal to γ, and select the character 724 if the variable I is greater than γ. Thereafter, the control proceeds to step 832.

  In step 832, referring to the dirt distribution information storage unit 762 and the character size storage unit 766, the size of the character displayed in the region having the region ID = S [I] is set to the sum of the number of contact times of the coordinates in this region. Decide accordingly.

  In step 834, it is determined whether or not the variable I is not equal to 1. Control proceeds to step 836 when variable I is not equal to 1, otherwise to step 838.

  In step 836, the effect of moving the character image from the previous display position of the character to the current display position is executed. Thereafter, the process proceeds to Step 838.

  In step 838, the character determined in step 830 is displayed in the size determined in step 832 at the center coordinates of the region of region ID = S [I]. Control continues to step 840.

  In step 840, a stain deletion processing program corresponding to the stain information deletion processing unit 750 is activated and waits until the end of the processing. When the dirt information deletion process ends, the control proceeds to step 842.

  In step 842, 1 is added to the current value of variable I. In the following step 844, it is determined whether or not the value of the variable I is less than or equal to the value of the variable D. If the determination result is YES, the process returns to step 830, otherwise the process ends.

(Program configuration for the dirt information deletion processing unit 750)
FIG. 24 is a flowchart showing a control structure of a program routine for realizing a dirt information deletion process corresponding to the function of the dirt information deletion processing unit 750. In FIG. 24, the same reference numerals are assigned to steps in which the same processing as that shown in FIG. 12 is executed.

  Referring to FIG. 24, this routine includes steps 482, 484, 486, 488 and 490 similar to those shown in FIG. By these processes, when contact is detected without touching the touch panel 108, and when a movement larger than the minimum movement amount R ′ is detected from the previous contact coordinates during dragging, the following process is executed. Is done. That is, the coordinates of the new contact position are stored in a variable representing the previous contact coordinates (step 488), and the coordinates of the contact area including the position where the contact has occurred are extracted (step 490). After step 490, control proceeds to step 872.

  In step 872, the contact count storage unit 354 is referred to, and the contact count of each coordinate in the contact area extracted in step 870 is subtracted by one. However, at this time, if the value of the number of times of contact is smaller than 0, it is set to 0. In the subsequent step 874, based on the updated value of the contact count storage unit 354, the sum of the contact counts of the coordinate positions in the region of region ID = S [I] is calculated, and the contents of the dirt distribution information storage unit 762 are stored. Update.

  In the following step 876, the updated value of the dirt distribution information storage unit 762 is used, and the character size corresponding to the total number of contact times of the coordinate position in the region of region ID = S [I] is obtained from the character size storage unit 766. get.

  In the following step 878, it is determined whether or not the character size acquired in step 876 is 0 (not displayed). If the determination result is YES, the process exits and returns to step 842 in FIG. Otherwise, go to step 880.

  In step 880, it is determined whether or not the character size acquired in step 876 is the same as the character size currently displayed on the liquid crystal display device 106. If the determination result is YES, the process returns to step 484, and otherwise, the process proceeds to step 882.

  In step 882, the character displayed on the liquid crystal display device 106 is erased, and the character is displayed again in the size acquired in step 876. Thereafter, control returns to step 484.

<Operation>
Referring to FIG. 20, mobile phone 600 according to the present embodiment operates as follows. In the contact count storage unit 354, 0 is set in advance as the contact count of all the coordinates of the table as shown in Table 1. Nothing is stored in the dirt distribution information storage unit 762. In the character storage unit 764, two characters are stored in advance as shown in FIG. In the character size storage unit 766, as shown in the table 5, the character size corresponding to the total range of the total number of touches is stored in advance.

  Default values are preset for the minimum movement amounts R and R ′, the horizontal division number α, and the vertical division number β in the parameter storage unit 770, but the user can freely set the values using the parameter input instruction unit 370. Can be set to

  The operation from when the user activates the mobile phone 600 to when the cleaning mode switching instruction unit 372 activates the cleaning mode is the same as the operation of the mobile phone 100 according to the first embodiment. By the operation of the contact count storage processing unit 352 during this period, the contact count storage unit 354 stores the contact count of each coordinate of the touch panel 108. Hereinafter, in mobile phone 600 according to the present embodiment, an operation after the cleaning mode is activated will be described.

  After shifting to the cleaning mode, the mobile phone 600 activates the dirt distribution information generation processing unit 746. The dirt distribution information generation processing unit 746 refers to the contact count storage unit 354, and places it on the full-screen liquid crystal touch panel 104 as in the areas 534, 536, and 540 shown in FIGS. The total sum of the number of contacts in each area is calculated in all the specified areas. As shown in Table 3, the dirt distribution information generation processing unit 746 causes the dirt distribution information storage unit 762 to store data in which the area ID, the center coordinates, the total number of touches, and the dirt flag of each area are set. At this time, the dirt flag is set to OFF in all areas.

  When the processing of the dirt distribution information generation processing unit 746 ends, the character display processing unit 748 is activated. The character display processing unit 748 refers to the dirt distribution information storage unit 762 and determines an area where the sum of the number of contacts is larger than the threshold value of the number of contacts (200 in the present embodiment) as an area where the dirt is remarkable. As shown in Table 7, the dirt distribution information of the area where the dirt is remarkable is extracted as the dirt information for processing, and is sorted and arranged in ascending order of the number of contact times. The character display processing unit 748 displays the character with the type and size corresponding to the number of times of contact and the order of the region at the center coordinates of the region where the total number of times of contact is the smallest among the processing dirt information (FIG. 23). , Steps 828 and 830).

  The character to be displayed is selected as follows. The character display processing unit 748 selects the character 722 shown in FIG. 19 if the order of the regions to be displayed is smaller than half of the total number of regions of processing dirt information, and selects the character 724 if larger than half. To do.

  The character size is determined as follows. That is, the character display processing unit 748 displays no size, size A, size when the total number of touches in the area where the character is to be displayed is 200 or less, and is divided into 201-500, 501-700, and 701 or more. Select B and size C. To determine this size, the character size storage unit 766 shown in Table 5 is referred to. When this display is completed, the dirt information deletion processing unit 750 starts its operation.

  After the character is displayed on the liquid crystal display device 106, the user starts cleaning the touch panel 108.

  It is assumed that the user's cloth has changed from a state where the user's cloth is not touching the touch panel 108 to a state where it is touched. The touch panel 108 detects the coordinates of the position touched by the cloth and transmits the coordinates to the dirt information deletion processing unit 750. Based on the coordinates received from the touch panel 108 and the minimum movement amount R ′, the dirt information deletion processing unit 750 estimates the contact area of the part actually touched by the contact area determination method described above, and the estimated contact The contact count storage unit 354 is updated by subtracting 1 from the contact count of each coordinate in the region. At this time, the coordinates of the position where the cloth is detected are stored in the previous contact coordinates.

  On the other hand, when the cloth touches the touch panel 108 and then moves while touching the touch panel 108 without being separated from the touch panel 108, the touch panel 108 detects the coordinates of the dragged position and detects the dirt information deletion processing unit. Continue sending to 750. The dirt information deletion processing unit 750 determines whether the distance between the previous contact coordinates and the coordinates received from the touch panel 108 is greater than the minimum movement amount R ′, and if the movement distance is equal to or less than the minimum movement amount R ′. , Do nothing. If the movement distance is larger than the minimum movement amount R ′, the dirt information deletion processing unit 750 uses the contact area determination method described above based on the received coordinates and the minimum movement amount R ′ to actually touch the portion ( Estimate the contact area. The dirt information deletion processing unit 750 updates the contact number storage unit 354 by subtracting 1 from the contact number of each coordinate corresponding to the estimated contact area in the contact number storage unit 354.

  The dirt information deletion processing unit 750 refers to the updated contact number storage unit 354, recalculates the total number of contact times of all coordinates in the region being processed, and updates the dirt distribution information storage unit 762 with the value. To do. The dirt information deletion processing unit 750 refers to the updated dirt distribution information storage unit 762 to acquire the total number of times of contact in the processing target area, and refers to the character size storage unit 766 to determine the total number of times of contact. Get the size of the character according to the value. When the acquired size is 0 (not displayed), the dirt information deletion processing unit 750 ends the process for the processing target area. If the acquired size is not 0 (not displayed) but is equal to the size of the currently displayed character, the dirt information deletion processing unit 750 does nothing, waits for the next coordinate output from the touch panel 108, and waits for the next coordinate output. Perform processing. On the other hand, when the size of the newly acquired character is not equal to the size of the currently displayed character, the dirt information deletion processing unit 750 deletes the current character display, A character is prepared, an effect of moving the character is performed, and the character is displayed on the processing target area. Thereafter, the dirt information deletion processing unit 750 returns to a state of waiting for the next coordinate output from the touch panel 108.

  When the dirt information deletion processing unit 750 finishes the dirt information processing for the area, the character display processing unit 748 selects the area with the next highest total number of touches, and repeats the above process. Then, when the above process is completed for all the areas determined to be significantly contaminated, the character display processing unit 748 ends the process. As a result, the mobile phone 600 ends the cleaning mode and shifts to the normal mode.

<Effects of Second Embodiment>
According to mobile phone 600 according to the present embodiment, characters are displayed one by one in order from a non-dirty area in a markedly dirty area, so that the user can efficiently clean. Become. In addition, since the mobile phone 600 displays the strength of dirt based on the character type and the character size, the user can easily perceive how much the cleaning is progressing. Furthermore, since the mobile phone 600 provides the user with a game-like sensation of erasing the character, the user can perform cleaning while reducing boredom that has been regarded as a problem in the past.

<Modification of Second Embodiment>
In the second embodiment, the process of displaying and erasing in order from the least contaminated area in the most noticeable area is performed. However, the present invention is not limited to such an embodiment. Obviously, it is up to you how to deal with areas that are heavily soiled, for example, characters may be displayed in order from those that are heavily soiled, or at random from areas that are heavily soiled. A character may be displayed by selecting an area. In the above embodiment, the processing of the next region is executed only after the processing of one region is completed. However, the present invention is not limited to such an embodiment. For example, characters may be displayed in two or more areas at a time, and the order of processing may be left to the user.

[Third Embodiment]
In the first embodiment described above, the estimated distribution of estimated dirt is displayed on the full-screen liquid crystal touch panel 104 when the cleaning mode is activated. In the second embodiment, when the cleaning mode is activated, characters are displayed in order in a region where dirt is considered to be remarkable, and cleaning is performed by deleting the displayed characters. However, the present invention is not limited to such an embodiment. For example, there may be an embodiment in which cleaning is not considered complete unless the entire surface of the full-screen liquid crystal touch panel 104 is properly wiped. This third embodiment relates to such an embodiment.

<Appearance of mobile phone 900>
The appearance of the mobile phone 900 to which the display-integrated touch panel device according to the third embodiment of the present invention is applied is the same as that of the mobile phone 100 according to the first embodiment shown in FIG. The hardware configuration of the mobile phone 900 according to the third embodiment is also the same as the hardware configuration of the mobile phone according to the first and second embodiments. The difference is in the structure of the computer program executed by the mobile phone 900.

<Outline of dirt removal method>
First, a method for removing dirt on full-screen liquid crystal touch panel 104 in mobile phone 900 according to the present embodiment will be described. The mobile phone 900 has a function of displaying dirt information on the entire surface of the liquid crystal display device 106 in order to realize the cleaning mode.

  When the cellular phone 900 according to the present embodiment operates in the normal mode, each time the user touches the touch panel 108 as in the first and second embodiments, The process of adding the number of contact times of coordinates is not performed. Instead, in all the coordinate positions on the full-screen liquid crystal touch panel 104 in the cleaning mode, it is considered that the cleaning has been completed when it is wiped with a cloth at least five times.

(Outline of dirt information display / deletion method)
FIGS. 25A to 25H show transition of display in the cleaning mode in mobile phone 900 according to the present embodiment.

  FIG. 25A shows the appearance of the mobile phone 900 in the normal mode. In the normal mode, the mobile phone 900 has the same appearance as the mobile phone 100 and the mobile phone 600 according to the first and second embodiments.

  FIG. 25B shows a display example of the liquid crystal display device 106 when the mobile phone 900 shifts from the normal mode to the cleaning mode. In this embodiment mode, as shown in FIG. 25B, when the mode is changed to the cleaning mode, first, a black area 910 that reminds of dirt is displayed on the entire surface of the liquid crystal display device 106. In this state, the user starts wiping the touch panel 108 using the cloth 902.

  As shown in FIG. 25C, the display of the area 906 wiped by the user is changed so that the brightness is higher than that of the first area 910. Further, as shown in FIG. 25D, when the user wipes the area 906 using the cloth 902, the area is displayed with higher brightness than the area 906, as shown by the area 908 in FIG. The Thereafter, when the user further wipes the full-screen liquid crystal touch panel 104 with the cloth 902 as shown in FIG. 25 (F), the area corresponding to the dirt is erased leaving a part of the area 914 as shown in FIG. 25 (G). The screen in the normal mode is displayed below it. By cleaning the area 914 with the cloth 902, the display changes partially transparent. As a result, a normal display screen appears with a narrower area 916 left as shown in FIG. When the dirty display of almost all coordinates on the liquid crystal display device 106 is erased and the normal screen is displayed on the entire screen, the mobile phone 900 returns from the cleaning mode to the normal mode.

  In this embodiment, in order to realize the above-described movement, when the cleaning mode is set, a value of the number of times of contact = 4 is set for all coordinates on the full-screen liquid crystal touch panel 104, and thereafter, the cloth touches each coordinate. Decrease the number of contacts by one each time. Then, as the number of times of contact decreases, a stain is displayed on the liquid crystal display device 106 using a display color that is closer to transparency.

  FIG. 26 is a diagram showing a display color table 920 for representing the degree of contamination. In the present embodiment, the display color 922 is displayed when the number of contacts at a certain coordinate position is 4, the display color 924 is displayed when the number of contacts is 3, the display color 926 is displayed when the number of contacts is 2, and the number of contacts is 1. In this case, the display color 928 is displayed. When the number of times of contact is 0, it is not displayed. As a result, the display image of the normal mode displayed below is displayed.

<Hardware configuration of mobile phone 900>
As described above, the hardware configuration of mobile phone 900 according to the present embodiment is the same as the hardware configuration of mobile phone 100 according to the first embodiment shown in FIG. However, the mobile phone 900 according to the present embodiment is shown in FIG. 9 in that the information stored in the memory 288 is information and a program used for realizing the dirt removal support function according to the present embodiment. It is different from the mobile phone 100 shown.

<Functional configuration of mobile phone 900>
FIG. 27 shows a functional configuration of mobile phone 900 according to the present embodiment in block diagram form. Referring to FIG. 27, mobile phone 900 according to the present embodiment uses full-screen liquid crystal touch panel 104, memory 288, full-screen liquid crystal touch panel 104, and memory 288 to realize the above-described cleaning mode. And a dirt removal support processing unit 934. The dirt removal support processing unit 934 is realized by the communication control unit 300 according to the first embodiment shown in FIG. 9 executing a program to be described later.

(Configuration of memory 288)
Before describing the configuration of the dirt removal support processing unit 934, the configuration of the storage area of the memory 288 used for realizing the function of the dirt removal support processing unit 934 will be described.

  Similarly to the one shown in FIG. 9, the memory 288 is a contact number storage unit 354 for storing the number of times of contact calculated for each coordinate on the touch panel 108, according to the number of times of contact as shown in FIG. 26. A display color storage unit 944 for storing display colors, a parameter storage unit 946 for storing user-designable parameters used for realizing the functions of the dirt removal support processing unit 934, and a program to be described later are internally provided. An internal variable storage unit 948 used as a variable storage area is included. In the present embodiment, the number of contacts stored in the contact count storage unit 354 is not updated in the normal mode. The contact count stored in the contact count storage unit 354 is set to the initial contact count (= 4) when the cleaning mode is set as will be described later, and is decremented by 1 each time it is determined that there is a cloth contact during the cleaning mode. Is done.

  The parameters stored in the parameter storage unit 946 are the minimum movement amount R ′ of the contact position during cleaning, which is also used in the first and second embodiments, the initial contact count set at each coordinate position at the start of the cleaning mode, and A contact number threshold value that is a threshold value of the total number of contact times in the cleaning mode for ending the cleaning mode and shifting to the normal mode is included.

  In the above description of the outline of the dirt removal method, 4 is set as the initial value of the number of contacts for all coordinates in the contact number memory. However, as is apparent from the above description, any number of 1 to 4 can be set. Note that the upper limit is 4 here, as shown in FIG. 26, there are four display colors stored in the display color storage unit 944, and these correspond to the contact counts of 1 to 4, respectively. This is because it is set. Therefore, if the display color is 5 or more, the initial value of the number of contacts can be 5 or more accordingly.

  In the present embodiment, a contact frequency threshold is used for the transition from the cleaning mode to the normal mode. When the user is cleaning the touch panel 108 in the cleaning mode, the mobile phone 900 calculates the sum of the remaining number of contacts of all coordinates on the full-screen liquid crystal touch panel 104. This sum becomes smaller as cleaning progresses. The calculated sum is compared with the contact count threshold value, and if the sum is greater than the contact count threshold value, the mobile phone 900 continues the cleaning mode, otherwise ends the cleaning mode and returns to the normal mode. Migrate to

  The internal variable whose area is secured in the internal variable storage unit 948 includes the previous contact coordinates similar to the previous contact coordinates in the internal variable storage unit 366 shown in FIG.

(Configuration of the dirt removal support processing unit 934)
Referring to FIG. 27, dirt removal support processing unit 934 responds to the number of initial contacts prepared according to the coordinates of touch panel 108 when the operation mode of mobile phone 900 is switched from the normal mode to the cleaning mode. The display color is acquired from the display color storage unit 944, and the stain information display processing unit 936 for displaying the stain on the liquid crystal display device 106, and in the cleaning mode, an operation of wiping the touch panel 108 by the user is detected and the touch panel is detected. The contact area is estimated based on the coordinates output from 108 and the minimum movement amount R ′ stored in the parameter storage unit 368, and each coordinate in the extracted contact area stored in the contact count storage unit 354 is stored. A process of subtracting the number of times of contact, acquiring a display color corresponding to the number of times of contact of each coordinate from the display color storage unit 360, and causing the liquid crystal display device 106 to redisplay the dirt information. A dirt information deletion processing unit 938 for executing the processing, and a parameter input instruction unit 370 and a cleaning mode switching instruction unit 372 similar to those in the first and second embodiments are included.

  As the values of the parameters in the parameter storage unit 946, default values are determined in advance. For example, in the present embodiment, the default value of the initial contact number = 4 is defined as the default. However, the user can also specify the value of each parameter using the parameter input instruction unit 370.

<Software configuration of mobile phone 900>
28 and 29 show a control structure of a program executed by the mobile phone 900 in a flowchart format. By executing the program by the communication control unit 300 which is substantially a computer, the dirt removal support processing unit 934 of the mobile phone 900 is realized.

(Program structure for the dirt information display processing unit 936)
FIG. 28 is a flowchart showing a control structure of a program that realizes the function of the dirt information display processing unit 936. Referring to FIG. 28, this program refers to the display color storage unit 944, acquires the display color corresponding to the initial number of contacts in the parameter storage unit 946, and acquires the display color in all coordinates on the liquid crystal display device 106. Step 962 for displaying the display color is executed subsequent to step 962, and the number of contacts of all coordinates on the full-screen liquid crystal touch panel 104 in the contact number storage unit 354 is updated with the initial number of contacts (= 4). Step 964. When step 964 ends, the program ends.

(Program structure for the dirt information deletion processing unit 938)
FIG. 29 is a flowchart illustrating a control structure of a program that implements the dirt information deletion processing unit 938. Referring to FIG. 29, this program is executed in response to step 970 that waits until contact coordinates are received from touch panel 108, and in response to determination that contact coordinates are received from touch panel 108 in step 970. Step 972 for determining whether or not the state has changed from a state in which there is no contact to a state in which contact has occurred, or whether the movement distance from the previous contact coordinates to the contact coordinates received this time is greater than the minimum movement amount R ′. If the determination result is NO in Step 972, control returns to Step 970.

  This program is further executed when the determination result in step 972 is YES, and is executed subsequent to step 974 and step 974 in which the value of the current contact coordinate received in step 970 is substituted for the variable representing the previous contact coordinate. Using the same contact determination method as in the first embodiment, step 976 for extracting the coordinates of the contact area, and subsequent to step 976, all the coordinates in the contact area extracted in step 976 are extracted. Step 978 for executing a process of subtracting 1 from the number of contacts stored in the number-of-contacts storage unit 354, and the number of contacts for each coordinate stored in the number-of-contacts storage unit 354 and display color storage are executed following step 978. In accordance with the display color stored in the unit 944, the display color corresponding to the number of times of contact is displayed on each coordinate of the liquid crystal display device 106. And a step 980 to execute the management. The processing in step 976 is the same as that in step 408 in FIG. 10 in the first embodiment, but is stored in parameter storage unit 946 shown in FIG. 27 instead of minimum movement amount R. It differs from the processing in step 408 in FIG. 10 in that the minimum movement amount R ′ is used.

  This program is further executed after step 980, and with reference to the contact count storage unit 354, it is determined whether or not the sum of the contact counts of all coordinates is equal to or less than the aforementioned contact count threshold value, and according to the determination result. Step 982 for branching control is included. If the determination result in step 982 is NO, the control returns to step 970.

  This program is further executed in response to the determination result in step 982 being YES, and in the same manner as in step 970, the program waits until the touch coordinates are received from the touch panel 108, and in step 984, the touch coordinates are received from the touch panel 108. Step 986 is executed in response to the determination that it has been received, ends the cleaning mode, changes the operation mode of the mobile phone 900 to the normal mode, and ends the process.

<Operation>
Referring to FIG. 27, mobile phone 900 according to the present embodiment operates as follows. In the display color storage unit 944, display colors corresponding to the number of times of contact are stored in advance as shown in FIG. It is assumed that appropriate values such as default values are set in advance for the minimum movement amount R ′, the initial contact number, and the contact number threshold value in the parameter storage unit 946. In this embodiment, it is assumed that 4 is set as the initial contact count.

  When the user activates the cellular phone 900, the cellular phone 900 enters the normal mode, and the cellular phone 100 displays the numeric keys and the like used in the ordinary cellular phone on the liquid crystal display device 106, as shown in FIG. .

  When the user activates the cleaning mode by the cleaning mode switching instruction unit 372, the dirt information display processing unit 936 refers to the display color storage unit 944, and the initial contact count (= 4) from the display color table as shown in FIG. ) Is acquired, and this display color is displayed in the dot area of all coordinates on the liquid crystal display device 106 as shown in FIG. Thereafter, the dirt information display processing unit 936 sets the initial contact number value (= 4) to the contact number of all coordinates on the full-screen liquid crystal touch panel 104 in the contact number storage unit 354. In response to this, the dirt information deletion processing unit 938 starts operation.

  After the display color is displayed on the liquid crystal display device 106, the user starts cleaning the touch panel 108.

  It is assumed that the cloth is touched from the state where the touch panel 108 is not touched. The touch panel 108 detects the coordinates of the position touched by the cloth, and transmits the coordinates (contact coordinates) to the dirt information deletion processing unit 938. Based on the contact coordinates and the minimum movement amount R ′ stored in the memory 288, the dirt information deletion processing unit 938 uses a contact area determination method similar to that of the first embodiment to determine the portion of the part actually touched by the cloth. Estimate the contact area. The dirt information deletion processing unit 938 further subtracts 1 from the number of contacts of the coordinates in the contact count storage unit 354 for each coordinate of the contact area estimated in this way. The dirt information deletion processing unit 938 stores the contact coordinates at this time as the previous contact coordinates.

  On the other hand, when the cloth touches the touch panel 108 and then moves so as not to leave the surface of the touch panel 108, the dirt information deletion processing unit 938 operates as follows. In this case, the coordinates of the starting edge of the drag are stored in the previous contact coordinates. The dirt information deletion processing unit 938 determines whether or not the distance between the contact coordinates received from the touch panel 108 and the previous contact coordinates is greater than the minimum movement amount R ′. If this distance is less than or equal to the minimum movement amount R ′, the dirt information deletion processing unit 938 does not perform any processing and waits for the next output from the touch panel 108. If this distance is larger than the minimum movement amount R ′, the dirt information deletion processing unit 938 uses the above-described contact area determination method based on the received coordinates and the minimum movement amount R ′ to determine the portion of the portion that the cloth actually touches. Estimate the contact area. The dirt information deletion processing unit 938 subtracts 1 from the contact number of each coordinate of the estimated contact area in the contact number storage unit 354.

  The dirt information deletion processing unit 938 refers to the display color storage unit 944 and the updated contact count storage unit 354, and displays the display color corresponding to the contact count of each coordinate on the coordinates of the contact area on the liquid crystal display device 106. Is displayed.

  The dirt information deletion processing unit 938 refers to the contact count storage unit 354 every time the display on the liquid crystal display device 106 is redisplayed, calculates the sum of the contact counts of all coordinates, and the sum is equal to or smaller than the contact count threshold value. It is determined whether or not. If the sum is equal to or smaller than the contact count threshold value, the dirt information deletion processing unit 938 determines whether or not the cloth is touching the touch panel 108. Switch to mode. If touched, the dirt information deletion processing unit 938 continues the processing as it is.

<Effect of the third embodiment>
In mobile phone 900 according to the present embodiment, in the cleaning mode, a display of dirt is displayed at all coordinates on full-screen liquid crystal touch panel 104, and it can be easily confirmed whether or not they have been wiped. Therefore, the user can clean the entire screen evenly.

[Modification]
The embodiment described above relates to a mobile phone. However, the present invention is not necessarily applicable only to a mobile phone, and can be applied to a display-integrated touch panel device in general. Further, the position information output device for the touch panel may be a non-contact type. For example, a pointing device using infrared rays, a pointing device using a magnetic sensor, or the like can be used.

  In this embodiment, when a user touches the screen, a touch panel that outputs position information of the part is used. However, an apparatus for outputting position information is not limited to a device that detects such contact. In addition to a capacitance change detection device such as a capacitive touch panel, a pressure detection device or a device using infrared rays may be used.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim of the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are included. Including.

It is a figure which shows the external appearance of the mobile telephone 100 which concerns on the 1st Embodiment of this invention. It is a figure for demonstrating the outline of the contact frequency memory | storage system based on 1st Embodiment. FIG. 3 is a diagram showing in detail a region around a position 142 in FIG. 2. In a dirt information display system concerning a 1st embodiment, it is a figure showing a display color according to the number of times of contact of each coordinate. It is a figure for demonstrating the outline of the dirt information display system based on 1st Embodiment. It is a figure for demonstrating the outline of the dirt information deletion method based on 1st Embodiment. It is a figure for demonstrating the outline of the stain | pollution | contamination deletion degree sound effect generation system based on 1st Embodiment. 2 is a block diagram showing a hardware configuration of a mobile phone 100. FIG. FIG. 9 is a block diagram of the full-screen liquid crystal touch panel 104, the memory 288, and the communication control unit 300 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the contact frequency storage process part 352 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the dirt information display process part 356 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the dirt information deletion process part 358 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the dirt information deletion process part 358 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the sound effect generation process part 362 of FIG. It is a figure which divides | segments the full-screen liquid crystal touch panel 104 into a rectangular area in the stain distribution information storage system which concerns on the 2nd Embodiment of this invention. It is a figure for demonstrating the outline of the dirt information deletion method by a character display based on 2nd Embodiment. It is a figure for demonstrating the outline of the dirt information deletion method by a character display based on 2nd Embodiment. In the character display according to dirt distribution information based on 2nd Embodiment, it is the figure which divided and displayed the character to be displayed in three sizes. In the character display according to dirt distribution information concerning a 2nd embodiment, it is a figure showing the example of the character displayed according to the order of the degree of dirt. It is a block diagram of full screen liquid crystal touch panel 104, memory 288, and dirt removal support processing unit 744 of mobile phone 600 according to the second embodiment. FIG. 21 is a flowchart illustrating a control structure of a computer program that realizes a dirt distribution information generation processing unit 746 in FIG. 20. FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the character display process part 748 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the character display process part 748 of FIG. FIG. 21 is a flowchart illustrating a control structure of a computer program that realizes a dirt information deletion processing unit 750 in FIG. 20. FIG. It is a figure for demonstrating the outline of the dirt information display and deletion system based on 3rd Embodiment. It is a figure which shows the display color according to the frequency | count of contact of each coordinate in the dirt information display and deletion system which concerns on 3rd Embodiment. It is a block diagram of full screen liquid crystal touch panel 104, memory 288, and dirt removal support processing part 934 of cellular phone 900 concerning a 3rd embodiment. It is a flowchart which shows the control structure of the computer program which implement | achieves the dirt information display process part 936 of FIG. It is a flowchart which shows the control structure of the computer program which implement | achieves the dirt information deletion process part 938 of FIG.

Explanation of symbols

  100, 600, 900 mobile phone, 102 housing, 104 full-screen liquid crystal touch panel, 106 liquid crystal display device, 108 touch panel, 110 speaker, 112 microphone, 140 fingers, 142 contacted position, 144 coordinates, 146 contact area, 280 antenna, 282 control circuit, 284 vibration unit, 286 ringer, 288 memory, 290 audio I / F, 292 baseband processing unit, 294 RF processing unit, 296 line closing unit, 298 incoming signal detection unit, 300 communication control unit, 350, 744, 934 Dirt removal support processing unit, 352 Contact number storage processing unit, 354 Contact number storage unit, 356, 936 Dirt information display processing unit, 358, 750, 938 Dirt information deletion processing unit, 360, 944 display color storage unit, 362 Sound effect generator 364 Sound effect storage unit, 366, 768, 948 Internal variable storage unit, 368, 770, 946 Parameter storage unit, 370 Parameter input instruction unit, 372 Cleaning mode switching instruction unit, 746 Dirt distribution information generation processing unit, 748 Character display Processing unit, 762 Dirt distribution information storage unit, 764 Character storage unit, 766 Character size storage unit

Claims (14)

A display-integrated touch panel device including a display unit and a touch panel that is arranged on a display surface of the display unit and outputs coordinates of the contact position when there is contact by an operator,
The display-integrated touch panel device can operate by switching between a first mode and a second mode different from the first mode,
The display-integrated touch panel device further includes:
Display means for displaying an image for cleaning the display surface on the display surface when the first mode is switched to the second mode;
During the operation in the second mode, based on the coordinates of the contact position output from the touch panel, the image displayed by the display unit on the display surface in a region having a predetermined relationship with the coordinates. And an image change means for making a predetermined change depending on the number of times of contact in the second mode with respect to the region. The display surface is divided into a plurality of divided regions,
The image changing means includes
Based on the output of the touch panel, a contact count storage means for storing the contact count of the plurality of divided areas;
First table storage means for storing a first table for associating the number of times of contact with one of a plurality of types of images;
Based on the coordinates of the contact position output by the touch panel during the operation in the second mode, the first table and the number of times of contact of each divided area stored in the number of times of contact storage means are used to determine the area. Image updating means for updating an image displayed in the divided area included in the image with an image corresponding to the number of times of contact of each of the divided areas;
During the operation in the second mode, based on the coordinates of the contact position output from the touch panel, the number of contacts in each divided region stored in the contact number storage unit is used to determine the number of divided regions included in the region. 2. The display-integrated touch panel according to claim 1, further comprising: means for erasing an image displayed in the divided area in which the number of times of contact during the operation in the second mode exceeds a predetermined number. apparatus. The display surface is divided into a plurality of divided regions,
The display-integrated touch panel device further includes:
Contact number storage means for storing the number of contact times of the plurality of divided regions;
When the touch panel outputs the coordinates of the contact position during the operation in the first mode, a predetermined number is added to the number of contacts in the divided area stored in the contact number storage means and corresponding to the coordinates. Contact number adding means for performing,
The display means includes
When the display mode is switched from the first mode to the second mode, the display surface is cleaned on the display surface based on the contact number of each divided area stored by the contact number storage unit. The display-integrated touch panel device according to claim 1, further comprising a number-dependent display means for displaying an image. The frequency-dependent display means is
When switching from the first mode to the second mode, using the number of times of contact of each divided area stored by the contact number storage means, the number of contacts is larger than a predetermined number. The display-integrated touch panel device according to claim 3, further comprising a dirt image display means for displaying an image for cleaning the display surface. The image changing means includes
When the touch panel outputs the coordinates of the contact position during the operation in the second mode, in the area having the predetermined relationship with the coordinates, the divided area is stored in the contact number storage means and included in the area Means for setting a predetermined number of contact times;
When operating in the second mode, using the contact count of each divided area stored by the contact count storage means, the image displayed by the dirt image display means is included in the area, and 5. The display-integrated touch panel device according to claim 4, further comprising: a dirty image erasing unit for erasing an image displayed in the divided area in which the predetermined number is set as the number of times of contact. The image changing means includes
When the touch panel outputs the coordinates during the operation in the second mode, in the area having the predetermined relationship with the coordinates, the contact of the divided area included in the area is stored in the contact number storage unit. A contact number subtracting means for subtracting a predetermined number from the number of times and storing it in the contact number storage means;
When the operation is performed in the second mode, the number of times of contact of each divided area stored in the number-of-contacts storage means is included in the area with respect to the image displayed by the number-dependent display means. 4. The display-integrated touch panel device according to claim 3, further comprising number-dependent image change means for making a predetermined change depending on the number of touches in the second mode of the divided area. The display-integrated touch panel device further includes second table storage means for storing a second table that associates the number of times of contact with one of a plurality of types of images for cleaning the display surface,
The number-dependent display means displays the second table and the number of contact times of each divided area stored by the contact number storage means when the first mode is switched to the second mode. The display-integrated touch panel device according to claim 6, further comprising: a dirt image display means for displaying an image of the second table corresponding to the number of times of contact in each of the divided areas.   The number-dependent image changing means uses the second table and the number of contact times of each divided area stored by the contact number storage means when operating in the second mode, and the dirt image display means. The dirty image change for displaying the image of the second table corresponding to the number of times of contact in the second mode of the divided area in each of the divided areas included in the area with respect to the image displayed by The display-integrated touch panel device according to claim 7, further comprising means. The display-integrated touch panel device further stains a set of a plurality of divided areas in which the total number of contacts is larger than a predetermined number using the number of contacts of each divided area stored by the contact number storage unit. Including a dirt distribution area storage means for extracting and storing as a distribution area;
The number-dependent display means uses the contact count of each divided area stored by the contact count storage means when the first mode is switched to the second mode to store the dirt distribution area storage. Character display means for displaying a character for cleaning the display surface according to the total number of contact times of the divided areas included in the dirt distribution area on the dirt distribution area stored by the means;
The number-dependent image changing means uses the number of times of contact of each divided area stored in the number-of-contacts storage means for the character displayed by the character display means during the operation in the second mode. The display-integrated touch panel device according to claim 6, further comprising character changing means for making a predetermined change depending on the number of times of contact in the second mode of the divided area included in the area. The character changing means is
During the operation in the second mode, the character display means using the contact count of each divided area stored in the contact count storage means and the dirt distribution area stored in the dirt distribution area storage means On the dirt distribution area where the total number of times of contact is smaller than a predetermined number by updating the number of times of contact of the divided areas included in the area in the second mode with respect to the character displayed by Character erasing means for erasing the character displayed on the screen,
During the operation in the second mode, using the contact count of each divided area stored in the contact count storage means and the dirt distribution area stored in the dirt distribution area storage means, the second Character addition display means for displaying a character corresponding to the total number of times of contact of the divided areas included in each of the dirt distribution areas on the dirt distribution area where characters are not yet displayed since the start of the mode, The display-integrated touch panel device according to claim 9.   The character addition display means includes the number of contacts in each divided area stored in the contact count storage means and the dirt distribution area stored in the dirt distribution area storage means during the operation in the second mode. And means for displaying a character corresponding to the total on the dirt distribution area where the total number of contacts is the smallest among the dirt distribution areas where the character has not yet been displayed since the start of the second mode. The display-integrated touch panel device according to claim 10, comprising: The display-integrated touch panel device further includes:
A third table storage means for storing a third table for associating the number of times of contact with one of a plurality of types of sound effects;
To output a sound effect corresponding to the number of contacts in each divided region using the third table and the number of contacts in each divided region stored by the contact number storage means during the operation in the second mode. The display-integrated touch panel device according to any one of claims 6 to 11, further comprising: The display-integrated touch panel device further includes:
Sound effect storage means for storing the sound effect;
During the operation in the second mode, using the sound effect and the contact number of each divided area stored by the contact number storage means, the volume of the sound effect is adjusted according to the total number of contact times of each divided area. The display-integrated touch panel device according to any one of claims 6 to 11, further comprising sound effect volume changing means for changing and outputting the sound effect. The image changing means includes
A contact area extracting means for determining a set of coordinates whose distance from the coordinates of the contact position output by the touch panel is smaller than a predetermined value as the area;
2. The display-integrated touch panel according to claim 1, further comprising: a unit configured to make a predetermined change depending on the number of times of contact in the second mode with respect to the region with respect to the image displayed by the display unit. apparatus.

Images