JP5975183B2 - Display device - Google Patents

Description

  The present invention relates to a display device including a touch panel including a sensor that detects contact of a user's finger and a frame, and a control circuit that controls display contents of a display unit in accordance with a user's touch operation received by the touch panel. Is.

  2. Description of the Related Art Conventionally, a portable terminal is known that includes a touch panel that detects contact of a user's finger and a control circuit that controls display content of a display unit such as a liquid crystal display in accordance with a user's touch operation received by the touch panel. .

  For example, a mobile electronic device (portable terminal) shown in Patent Literature 1 includes a touch screen in which a touch panel and a display unit are integrated, and a module (control circuit) that controls display content of the touch screen.

  In the portable terminal shown in Patent Literature 1, the control circuit enlarges or reduces the content (image) displayed on the display unit by receiving a double tap operation, a pinch-out operation, and a pinch-in operation on the touch panel. However, the double tap operation is an operation in which a short touch operation is performed twice in succession. The pinch-out operation is an operation that widens between two touch positions. The pinch-in operation is an operation for narrowing between two touch positions.

  In a pinch-out operation or a pinch-in operation, the mobile terminal displays an image with an enlargement or reduction at a magnification according to the distance between touch positions. In addition, when the mobile terminal receives a double tap operation, the mobile terminal executes either an enlarged display or a reduced display of the image in a predetermined size.

JP 2011-159291 A

  However, in the pinch-out operation and the pinch-in operation, the size of the image is finely adjusted according to the distance between the two touch positions. Therefore, in the pinch-out operation and the pinch-in operation, it is difficult to switch the image display size to a desired size.

  In general, a double tap operation may be erroneously recognized as a single tap operation. Furthermore, the mobile terminal cannot distinguish whether the user is instructing to enlarge or reduce the image by a double tap operation.

  Therefore, an object of the present invention is to provide a display device that can switch the display size of an image displayed on a display unit to a desired size.

  The display device according to the present invention includes a position detection unit that detects a plurality of positions at which a touch operation on the operation surface is performed, a press operation detection unit that detects a press operation on the operation surface, and the plurality of positions detected by the position detection unit. A distance calculation unit that calculates a distance between the positions, a display control unit, a display unit that displays an image according to the control of the display control unit, and a storage unit that stores information on the display size of the image.

  The display control unit corresponds to the display size information read from the storage unit when the distance calculated by the distance calculation unit changes and the pressing operation detection unit detects a pressing operation. Change the display size of.

  The position detection means detects an operation of the user trying to touch the operation reception unit as a touch operation. That is, the position detection means detects not only an actual contact with the operation receiving unit but also a non-contact touch operation. The non-contact touch operation is detected by, for example, providing a capacitive touch panel or an optical sensor in the operation receiving unit.

  The display size information includes, for example, the number of pixels corresponding to the display area of the display unit. The display size information is not limited to the number of pixels corresponding to the display area of the display unit, and may be a magnification based on the size of the current image.

  The display device of the present invention switches to the display size read from the storage unit when the pressing operation is performed and the distance between the touch positions is changed, that is, when the pressing operation and the pinch-out operation or the pinch-in operation are performed. To display the image. Therefore, the user can display an image with a desired display size by a pressing operation and a pinch-out operation or a pinch-in operation.

  When the pressing operation and the pinch-out operation or the pinch-in operation are performed, the display device finely adjusts the size of the image according to the distance between the touch positions as the first process, and the pinch-out operation or the pinch-in operation without the pressing operation is performed. When the operation is performed, the image may be displayed in a desired display size as the second process.

  In addition, the storage unit may store a plurality of pieces of information on the display size of the image, and the display control unit may read out display size information corresponding to the amount of change in the distance detected by the distance calculation unit.

  As a result, for example, as the user widens the touch positions, the image is enlarged and displayed in a stepwise manner in a double size, a triple size, and a quadruple size.

  Further, the pressing operation detection unit detects a pressing amount of the pressing operation, the storage unit stores a plurality of pieces of information on the display size of the image, and the display control unit detects the pressing operation detection unit. Information on the display size corresponding to the pressing amount may be read from the storage unit.

  Thereby, for example, the image is enlarged and displayed stepwise in a double size, a triple size, and a quadruple size in accordance with the pressing amount given from the user.

  The pressing operation detection means may include a piezoelectric film formed of a chiral polymer.

  Chiral polymers have a helical structure in the main chain. The chiral polymer generates an electric charge when the piezoelectric film is pressed. Since the piezoelectric properties of the chiral polymer are due to the molecular structure, no polling is required compared to a ferroelectric polymer such as PVDF (polyvinylidene fluoride).

  The chiral polymer may be polylactic acid, or the polylactic acid may be stretched in a uniaxial direction.

  Polylactic acid (PLA) has a high piezoelectric output constant among chiral polymers. In particular, L-type polylactic acid (PLLA) stretched in a uniaxial direction has a high piezoelectric output constant among polylactic acids. By using a material having a high piezoelectric output constant, the pressing operation detecting means can accept the pressing operation with high sensitivity. Polylactic acid has very little pyroelectricity, such as PVDF. Therefore, a piezoelectric film formed of polylactic acid is suitable as a configuration of a pressing operation detection unit that transmits the temperature of a finger.

  According to the present invention, the display device can display an image by switching to the display size desired by the user without the user performing fine adjustments only by the pinch-out operation or the pinch-in operation.

1 is an external perspective view of a mobile terminal 1 according to an embodiment of the present invention. (A) is AA sectional drawing of the portable terminal 1 which concerns on embodiment of this invention, (B) is a top view of the electrostatic sensor 12. FIG. It is a block diagram which shows a part of structure of the portable terminal 1 which concerns on embodiment of this invention. (A) is a figure which shows the example of a display of the display input part 10, (B) is a figure which shows the example which detects two touch positions. FIG. 4 is a diagram showing an enlargement operation for the mobile terminal 1. (A) is a figure which shows the content memorize | stored in the database 140, (B) is a figure which shows the example of a display after expansion operation with respect to the portable terminal 1. FIG. (A) And (B) is a figure which shows the example of a display after enlargement operation with respect to the portable terminal 1, or after reduction operation, respectively. 3 is a flowchart showing the operation of a control unit 14. 3 is a flowchart showing the operation of a control unit 14. It is a flowchart which shows the process which concerns on the modification of step S6. (A) And (B) is a figure for demonstrating the modification of the process of step S6, respectively.

  A mobile terminal 1 according to an embodiment of the present invention will be described with reference to FIGS. 1 to 3. FIG. 1 is an external perspective view of the mobile terminal 1. FIG. 2A is a cross-sectional view of the mobile terminal 1 taken along the line AA. FIG. 2B is a plan view of the electrostatic sensor 12. FIG. 3 is a block diagram illustrating a part of the configuration of the mobile terminal 1.

  As shown in FIG. 1, the mobile terminal 1 includes a housing 30 having a substantially rectangular parallelepiped shape. The surface of the housing 30 is open. In the following description, it is assumed that the X direction shown in FIG. 1 is the width direction of the housing 30, the Y direction is the height direction, and the Z direction is the thickness direction. Further, in the present embodiment, a case where the width of the housing 30 is shorter than the height of the housing 30 is shown. However, the housing 30 may have the same width and height, or the width may be longer than the height.

  The display input unit 10 is exposed to the outside through the opening of the housing 30. Thereby, the Z-side surface of the display input unit 10 becomes an operation surface.

  As shown in FIG. 2A, the housing 30 has the display input unit 10 and the arithmetic circuit module 40 disposed therein. The arithmetic circuit module 40 and the display input unit 10 are sequentially arranged in the thickness direction.

  As shown in FIG. 2A, the display input unit 10 includes a display unit 11, an electrostatic sensor 12, a piezoelectric sensor 20, and an insulating film 124. The display unit 11, the electrostatic sensor 12, and the piezoelectric sensor 20 have substantially the same shape as viewed from the front side of the housing 30.

  As shown in FIG. 2A, the display portion 11 includes a liquid crystal panel 111, a front polarizing plate 112, a back polarizing plate 113, and a backlight 114.

  The backlight 114, the back polarizing plate 113, the liquid crystal panel 111, the piezoelectric sensor 20, the insulating film 124, the electrostatic sensor 12, and the surface polarizing plate 112 are sequentially arranged in the thickness direction. However, the piezoelectric sensor 20 and the electrostatic sensor 12 may be disposed in reverse.

  As shown in FIGS. 2A and 2B, the electrostatic sensor 12 includes a base film 121, a plurality of capacitance detection electrodes 122, and a plurality of capacitance detection electrodes 123.

  The base film 121 is made of a material having translucency and a predetermined dielectric constant. Each of the plurality of capacitance detection electrodes 122 and the plurality of capacitance detection electrodes 123 has a long shape and is made of a light-transmitting conductive material. The plurality of capacitance detection electrodes 122 are arranged on the first main surface (the surface on the + Z side) of the base film 121 at a predetermined interval. The plurality of capacitance detection electrodes 123 are arrayed on the second main surface (the surface on the −Z side) of the base film 121 at a predetermined interval. The arrangement direction of the plurality of capacitance detection electrodes 122 and the arrangement direction of the plurality of capacitance detection electrodes 123 are approximately when viewed from the normal direction of the first main surface or the second main surface of the base film 121. It is set to be orthogonal.

  As the finger approaches the electrostatic sensor 12, the capacitance changes. Therefore, the position detection unit 13 detects the touch position by specifying a set of the capacitance detection electrode 122 and the capacitance detection electrode 123 whose capacitance has changed. The position detection unit 13 detects a plurality of touch positions by specifying a plurality of sets of the capacitance detection electrode 122 and the capacitance detection electrode 123 whose capacitance has changed. However, the change in capacitance can be detected even if the finger is not actually in contact with the surface polarizing plate 112. The touch position can be detected by using an optical sensor that detects the approach of the finger to the surface polarizing plate 112 instead of the electrostatic sensor 12.

  When the position detection unit 13 detects the touch position, the position detection unit 13 outputs information on the touch position to the control unit 14.

  As shown in FIG. 2A, the piezoelectric sensor 20 includes a piezoelectric film 201, a piezoelectric detection electrode 202, and a piezoelectric detection electrode 203.

  Each of the piezoelectric film 201, the piezoelectric detection electrode 202, and the piezoelectric detection electrode 203 has a flat film shape.

  The piezoelectric detection electrode 202 is formed on the first main surface (+ Z side surface) of the piezoelectric film 201. The piezoelectric detection electrode 203 is formed on the second main surface (the surface on the −Z side) of the piezoelectric film 201. The piezoelectric detection electrode 202 and the piezoelectric detection electrode 203 are formed of any one of an organic electrode mainly composed of ITO, ZnO, and polythiophene, an organic electrode mainly composed of polyaniline, a silver nanowire electrode, and a carbon nanotube electrode, respectively. , Has translucency.

  The piezoelectric film 201 is made of, for example, uniaxially stretched polylactic acid and has translucency. In addition, when the piezoelectric film 201 is pressed in the −Z direction, electric charges are generated on the first main surface and the second main surface. A potential difference between the piezoelectric detection electrode 202 and the piezoelectric detection electrode 203 is generated by generating charges on the first main surface and the second main surface of the piezoelectric film 201. The level of the potential difference (for example, mV) corresponds to the pressing amount (or the pressing amount, for example, several tens of μm) of the piezoelectric film 201. Therefore, by obtaining the level (mV) of the potential difference between the piezoelectric detection electrode 202 and the piezoelectric detection electrode 203, it is possible to obtain the presence / absence of a pressing operation on the piezoelectric sensor 20 and the pressing amount (μm).

  The piezoelectric sensor 20 outputs a potential difference between the piezoelectric detection electrode 202 and the piezoelectric detection electrode 203 as a sensor signal. The sensor signal output from the piezoelectric sensor 20 is input to the piezoelectric sensor result detection unit 21 as shown in FIG. The piezoelectric sensor result detection unit 21 obtains the level LSS (mV) of the input sensor signal. The piezoelectric sensor result detection unit 21 determines whether or not a pressing operation is performed on the piezoelectric sensor 20 according to the obtained level LSS. For example, if the level LSS is less than 20 mV, the piezoelectric sensor result detection unit 21 determines that no pressing operation is performed on the piezoelectric sensor 20 of the display input unit 10. If the level LSS is 20 mV or higher, the piezoelectric sensor result detection unit 21 determines that a pressing operation has been performed on the piezoelectric sensor 20 of the display input unit 10. Since the piezoelectric sensor result detection unit 21 determines the presence or absence of the pressing operation based on the threshold value, it is easy to distinguish the touch operation and the pressing operation on the display input unit 10. The piezoelectric sensor result detection unit 21 outputs information on the presence or absence of a pressing operation to the control unit 14. The piezoelectric sensor result detection unit 21 also outputs information on the level LSS (corresponding to the pressing amount) to the control unit 14.

  Returning to the description of the display unit 11, the light output from the backlight 114 sequentially passes through the rear polarizing plate 113, the liquid crystal panel 111, the piezoelectric sensor 20, the insulating film 124, the electrostatic sensor 12, and the front polarizing plate 112. The liquid crystal panel 111 transmits the received light as it is or with the vibration direction changed (polarized) as controlled by the display control unit 15. As described above, the display content of the display unit 11 is changed by controlling the backlight 114 and the liquid crystal panel 111.

  Since the piezoelectric sensor 20 has translucency, even if it is disposed on the + Z side with respect to the backlight 114, the transmission of light from the backlight 114 is not hindered.

  As described above, the control unit 14 is input with information on a touch position on the display input unit 10, information on the presence or absence of a pressing operation, and information on a level LSS (corresponding to a pressing amount). The control unit 14 performs various processes based on the input information. Information on processing related to display is output from the control unit 14 to the display control unit 15. The display control unit 15 controls the display input unit 10 (display unit 11) so that the display content corresponds to the processing information related to the display output by the control unit 14. That is, the portable terminal 1 implements a so-called GUI (; Graphical User Interface).

  With such a portable terminal 1, the following GUI can be realized.

  FIG. 4A is a diagram illustrating a display example of the display input unit 10. FIG. 4B is a diagram illustrating an example of detecting two touch positions. FIG. 5 is a diagram illustrating an enlargement operation on the mobile terminal 1. FIG. 6A is a diagram showing the contents stored in the database 140. FIGS. 6B, 7 </ b> A, and 7 </ b> B are diagrams illustrating display examples after the enlargement operation or the reduction operation on the mobile terminal 1, respectively. 8 and 9 are flowcharts showing the operation of the control unit 14.

  It is assumed that the control unit 14 performs the display shown in FIG. 4A at the start of the flowchart shown in FIG. That is, the display input unit 10 displays the image 901 at the start of the flowchart shown in FIG. The image 901 is not limited to a still image but may be a moving image.

  Here, the screen size is a size defined by the number of pixels of the width and height of the display area of the display input unit 10. The image size is a size unique to an image regardless of display, and is defined by the number of pixels of width and height. The display size of the image is a size defined by the number of pixels of the width and height at which the image is to be displayed. Therefore, the image size and the display size of the image are different when the image is enlarged or reduced.

  In the example shown in FIG. 4A, the screen size of the display input unit 10 is 1080 pixels in width (X direction) and 1920 pixels in height (Y direction). The image size of the image 901 is 675 pixels in width (X direction) and 1200 pixels in height (Y direction). The display size of the image 901 is the same as the image size of the image 901 in the example shown in FIG.

  The flowchart shown in FIG. 8 starts when the control unit 14 acquires information on a plurality of touch positions from the position detection unit 13 (start). Hereinafter, the operation of the control unit 14 will be described using the example shown in FIG.

  As shown in FIG. 4B, the user touches the display input unit 10 with the thumb TBRH of the right hand and the index finger FFRH of the right hand. Here, one of the touch positions is a touch position FTP, and the other touch position is a touch position STP.

  Then, the control unit 14 acquires information on coordinates (Fx, Fy) as information on the touch position FTP and information on coordinates (Sx, Sy) as information on the touch position STP from the position detection unit 13. However, the position detection unit 13 uses the coordinates (Fx, Fy) and the reference position S (0, 0) of the coordinates (Sx, Sy) as the −X direction and the −Y direction in the display area of the display input unit 10, for example. The position of the corner. Further, the position detection unit 13 sets the units of the coordinates (Fx, Fy) and the coordinates (Sx, Sy) as millimeters (mm). However, the reference position S may be any position in the display area of the display input unit 10, and the coordinate unit is not limited to millimeters (mm) and may be the number of pixels.

  First, the control unit 14 calculates a distance Dis between the two touch positions (S1). The distance Dis is a distance between the touch position FTP and the touch position STP. That is, the distance Dis (mm) is obtained by the following equation.

Dis = Sqrt ((Fx−Sx) ² + (Fy−Sy) ² )
However, Sqrt is a function that takes a square root.

  Next, the control unit 14 determines whether or not there is a pressing operation on the display input unit 10 (S2). More specifically, the control unit 14 acquires information on the presence or absence of a pressing operation from the piezoelectric sensor result detection unit 21 and determines whether or not there is a pressing operation. When it is determined that the pressing operation is performed on the display input unit 10 (S2: YES), the control unit 14 proceeds to step S3 and starts the display size switching process. When it is determined that the pressing operation is not performed on the display input unit 10 (S2: NO), the control unit 14 proceeds to step S10 and starts the display size changing process.

  Then, when the control unit 14 determines that the pressing operation is performed on the display input unit 10 (S2: YES), the control unit 14 acquires the touch position information from the position detection unit 13 again (S3).

  Then, the control unit 14 determines whether or not the touch position has changed (S4). More specifically, when the control unit 14 determines that any one of the touch positions acquired again has changed from the touch position acquired first (start time) (S4: YES), the control unit 14 proceeds to step S5. . If the control unit 14 determines that any one of the touch positions acquired again has not changed from the touch position acquired first (S4: NO), the control unit 14 returns to step S3 and continues until the touch position changes. The process of S3 and the process of step S4 are repeated. However, when the number of touch positions acquired again decreases from the number of touch positions acquired first, the control unit 14 finishes the repetition process of step S3 and step S4 and performs another operation input reception process. Also good.

  When the control unit 14 determines that the touch position has changed (S4: YES), the control unit 14 calculates a change amount Diff of the distance Dis (S5). The change amount Diff is a difference distance (mm) between the distance Dis and the distance Dis ′. The distance Dis ′ is a distance between the changed touch positions.

  Here, a processing example of steps S2 to S5 will be described with reference to FIG.

  Hereinafter, as shown in FIG. 5, the enlargement operation is a pinch that performs a pressing operation of pressing the display input unit 10 at the touch position FTP or the touch position STP, and releases the right thumb TBRH and the right index finger FFRH. It is assumed that the operation is an out operation. The touch position FTP changes to the touch position FTP ′ after the pinch-out operation, and the touch position STP changes to the touch position STP ′ after the pinch-out operation. However, the touch position FTP ′ is coordinates (Fx ′, Fy ′), and the touch position STP ′ is coordinates (Sx ′, Sy ′).

  When the user performs the enlargement operation illustrated in FIG. 5, the control unit 14 determines that the pressing operation is performed (S2: YES), and then displays the information on the touch position FTP ′ and the touch position STP ′. Obtained from the position detector 13 (S3), it is determined that each touch position has changed from the touch position FTP and the touch position STP (S4: YES).

  Then, the control unit 14 calculates the distance Dis ′ based on the touch position information acquired again in order to calculate the change amount Diff (S5). The calculation method of the distance Dis ′ is the same as the calculation method of the distance Dis.

  Then, the control unit 14 calculates the change amount Diff by subtracting the distance Dis from the distance Dis ′ (S5). The change amount Diff is a positive value in the enlargement operation shown in FIG.

  The example illustrated in FIG. 5 is an example of the enlargement operation, but the user may perform the reduction operation. The reduction operation is an operation of performing a pressing operation of pressing the display input unit 10 at the touch position FTP or the touch position STP, and performing a pinch-in operation of bringing the right thumb TBRH and the right index finger FFRH closer. In this case, a negative value is calculated as the change amount Diff.

  Returning to the description of the flowchart shown in FIG. 8, when the control unit 14 calculates the change amount Diff, the control unit 14 proceeds to step S <b> 6 and displays the image 901 with a display size corresponding to the calculated change amount Diff. More specifically, the control unit 14 refers to the database 140 with the calculated change amount Diff and specifies the display size of the image 901.

  As shown in FIG. 6A, the database 140 stores a change amount Diff (mm) and a display size in association with each other. The display size is defined by the number of pixels of width and height. The display size having a width of 1080 pixels and a height of 1920 pixels is the same as the screen size of the display input unit 10. The display size having a width of 2160 pixels and a height of 3840 pixels is twice as large as the width and height of the screen size of the display input unit 10 respectively. A display size having a width of 3240 pixels and a height of 5760 pixels has a width and a height that are three times the width and height of the screen size of the display input unit 10, respectively. A display size having a width of 540 pixels and a height of 960 pixels has a width and a height that are ½ times the width and height of the screen size of the display input unit 10, respectively. However, the display size is not limited to being defined by the number of pixels corresponding to the screen size of the display input unit 10, but may be defined by a magnification based on the width and height of the image size. Furthermore, the display size may be defined by a magnification based on the width and height of the current display size of the image 901.

  And the control part 14 outputs the information of the process which displays the image 901 by the specified display size to the display control part 15 (S6). Note that the control unit 14 may return to step S3 after step S6. Thereby, the user can continuously switch and display the display size of the image 901 by continuously performing the pinch-in operation or the pinch-out operation.

  A processing example of step S6 will be described with reference to FIG.

  When the change amount Diff is calculated to be 15 mm, the control unit 14 refers to the database 140 and specifies the display size of the image 901 as having a width of 1080 pixels and a height of 1920 pixels. That is, the specified display size is the same as the screen size of the display input unit 10.

  Then, the control unit 14 outputs information on processing for displaying the image 901 with the specified display size to the display control unit 15.

  Since the specified display size is larger than the image size of the image 901, the display control unit 15 performs a process of enlarging the image 901. The display control unit 15 can use a general processing method as the enlargement process. For example, the display control unit 15 performs a mathematical process as follows.

  Specifically, since the specified display size is 1080 pixels in width and the image size of the image 901 is 675 pixels in width, the display control unit 15 images 1.6 times (1080 pixels / 675 pixels). The width and height of 901 are expanded. As a result, the image 901 is enlarged and displayed with a width of 1080 pixels and a height of 1920 pixels. However, the control unit 14 may calculate the magnification of the enlarged display based on the heights of the display size and the image size. Further, the control unit 14 may calculate the magnification of the enlarged display by using both the width and the height of the display size and the image size.

  The display control unit 15 also performs a process of displaying the image 901 at the center of the display area of the display input unit 10 in addition to the enlargement process of the image 901. As a result, the image 901 is arranged and displayed so that the center position of the display size matches the center position of the display area of the display input unit 10. Then, the image 901 displays the image 901 in the entire display area of the display input unit 10 as shown in FIG. However, in the present embodiment, it is not essential to place the center position of the display size of the image 901 at the center position of the display area of the display input unit 10.

  When the control unit 14 calculates a larger amount of change Diff (30 mm) than the above example, the width and height of the screen size of the display input unit 10 are each doubled as shown in FIG. The image 901 is displayed with the large display size. However, in this case, only a part of the image 901 is displayed because the display size is larger than the screen size.

  The above is an example of the enlargement operation shown in FIG. 5. However, since the change amount Diff becomes a negative value (for example, −10 mm) when the reduction operation is performed in the mobile terminal 1, FIG. As shown, the image 901 is displayed with a display size that is ½ times the width and height of the screen size of the display input unit 10.

  In this way, the mobile terminal 1 executes the display size switching process. That is, the mobile terminal 1 switches and displays the display size of the image 901 according to the change amount Diff and the presence or absence of the pressing operation. Therefore, the user can quickly display the image 901 in a desired display size with the same operation feeling as the pinch-out operation or the pinch-in operation. However, calculating the change amount Diff is not an essential configuration of the present invention. The portable terminal 1 displays the image 901 with a display size of a predetermined size (for example, the same size as the screen size of the display input unit 10) only by accepting a pressing operation and determining that the change amount Diff is not 0 mm. May be.

  The enlargement operation and the reduction operation are clearly different because the movement directions of the right thumb TBRH and the right index finger FFRH are opposite to each other. The mobile terminal 1 executes the display size switching process according to clearly different enlargement operations and reduction operations. Accordingly, unlike the conventional double-tap operation, the mobile terminal 1 does not execute different processing (enlarged display or reduced display) by the same operation, and therefore can execute the process as intended by the user.

  When it is determined that the pressing operation is not performed on the display input unit 10 (S2: NO), the control unit 14 proceeds to step S10 and starts the display size changing process.

  The display size changing process is performed according to the flowchart shown in FIG. However, the processes in steps S13 to S15 are the same as the processes in steps S3 to S5, respectively. Therefore, description of the process of these steps is omitted. That is, the display size changing process is different from the display size switching process in step S16.

  In step S <b> 16, the display control unit 15 changes the display size of the image and displays it at a magnification that is proportional or inversely proportional to the change amount Diff.

  For example, the display control unit 15 uses the calculated change amount Diff to obtain the magnification m using the following equation.

m = Diff × k1 (Diff> 0)
m = k2 / Diff (Diff <0)
That is, the magnification m is a value obtained by multiplying the predetermined coefficient k1 and the change amount Diff when the change amount Diff is positive, and a value obtained by dividing the predetermined coefficient k2 by the change amount Diff when the change amount Diff is negative. It becomes. For example, the magnification m is a value proportional to the change amount Diff in the case of the enlargement operation shown in FIG. 5, and is a value inversely proportional to the change amount Diff in the case of the reduction operation.

  Then, the display control unit 15 sets the size obtained by multiplying the width and height of the image 901 by m times as the display size of the image 901.

  As described above, the mobile terminal 1 executes the display size changing process, and sequentially changes the display size of the image 901 at a magnification proportional to or inversely proportional to the amount of change in the distance between touch positions.

  The user switches the display size of the image 901 by performing an enlargement operation or a reduction operation on the display input unit 10 and performs only a pinch-out operation or a pinch-in operation on the display input unit 10 without pressing. Thus, the display size of the image 901 can be finely adjusted at a magnification proportional to or inversely proportional to the amount of change between touch positions in the operation.

  However, if the portable terminal 1 determines that the pressing operation is performed (S2: YES), the mobile terminal 1 performs a display size changing process (processing after step S13 in FIG. 9) and determines that the pressing operation is not performed (S2). : NO), display size switching processing (processing after step S3 in FIG. 8) may be performed.

  In addition, the portable terminal 1 uses the pressing operation as a trigger for starting the display size switching process (S2: YES), but uses a change in the distance between touch positions as a trigger for starting the display size switching process. If there is a pressing operation following the change in the distance between the touch positions, the image 901 may be displayed by switching to the image display size.

  In the above example, two touch positions FTP and touch position STP are detected, but three or more touch positions may be detected. When the control unit 14 acquires information about three or more touch positions from the position detection unit 13, the control unit 14 calculates a distance Dis between the touch positions. That is, the control unit 14 calculates a plurality of distances Dis. In this case, the control unit 14 calculates a plurality of distances Dis' again in step S5 or step S15. Then, the control unit 14 subtracts the sum of the plurality of distances Dis from the sum of the plurality of distances Dis ′ to calculate one change amount Diff. Then, in step S6 or step S16, the control unit 14 specifies the display size according to the change amount Diff. Note that since the change amount Diff corresponding to three or more touch positions may be larger than the change amount Diff of the two touch positions, it is desirable to average the number of touch positions.

  In the above example, the control unit 14 specifies a display size having a width of 1080 pixels and a height of 1920 pixels when the change amount Diff is 0 mm or more and less than 20 mm, and when the change amount Diff is 20 mm or more and less than 40 mm, Although the display size of 2160 pixels wide and 3840 pixels high is specified, the display size is specified according to the level LSS (corresponding to the pressing amount to the display input unit 10) without depending on the change amount Diff. Also good. In this case, the database 140 stores the level LSS size (mV) and the display size in association with each other.

  For example, when the control unit 14 determines that the pressing operation is performed on the display input unit 10 (S2: YES), the control unit 14 acquires information on the level LSS from the piezoelectric sensor result detection unit 21. And the control part 14 may specify the display size of the magnitude | size according to this level LSS with reference to the database 140 by the acquired level LSS (mV) (S6).

  Here, the piezoelectric film 201 will be described. The piezoelectric film 201 is a film formed from a chiral polymer. In this embodiment, polylactic acid (PLA), particularly L-type polylactic acid (PLLA) is used as the chiral polymer. PLLA is uniaxially stretched.

  PLLA is suitable for the piezoelectric sensor 20 because it belongs to a very high piezoelectric constant among polymers.

  Further, unlike other ferroelectric piezoelectric materials (such as PVDF), PLLA has no pyroelectricity. Therefore, the PLLA is suitable for a configuration in which the temperature of the finger is transmitted by a touch operation, like the piezoelectric sensor 20 of the display input unit 10.

  Further, PLLA is made of a chiral polymer, and therefore has a higher translucency than PVDF or the like. Therefore, the PLLA is suitable for a configuration in which the PLLA is disposed on the + Z side from the backlight 114 like the piezoelectric sensor 20 of the display input unit 10.

  However, it is not essential to use PLLA as the piezoelectric film 201 in the present embodiment. The piezoelectric sensor 20 may use a piezoelectric film 201 made of, for example, PVDF.

  Next, FIG. 10 is a flowchart showing a modification of the process of step S6 of the flowchart shown in FIG. FIG. 11A and FIG. 11B are diagrams for explaining modifications of the process of step S6 shown in FIG.

  In this modified example, as shown in FIG. 10, whether the image is enlarged or reduced based on the width of the specified display size according to the level LSS (corresponding to the pressing amount), or the specified display It differs from the processing shown in step S6 shown in FIG. 8 in that it is determined whether to enlarge or reduce the image using both the width and height of the size.

  However, the control part 14 shall acquire the information of the level LSS from the piezoelectric sensor result detection part 21 previously in step S2 of the flowchart shown in FIG. Further, it is assumed that the change amount Diff is calculated to be 15 mm in step S5.

  First, as shown in FIG. 10, the control unit 14 specifies a display size corresponding to the calculated change amount Diff (15 mm) (S61). The control unit 14 refers to the database 140 with the calculated change amount Diff, and specifies a display size having a width of 1080 pixels and a height of 1920 pixels.

  Next, the control unit 14 determines whether or not the acquired level LSS is, for example, 30 mV or more (S62). When the level LSS is, for example, 30 mV or higher (S62: YES), the control unit 14 proceeds to step S63. If the level LSS is less than 30 mV, for example (S62: NO), the control unit 14 proceeds to step S64.

  When the level LSS is, for example, 30 mV or higher (S62: YES), the control unit 14 performs an image enlargement process based on the specified width of the display size (S63).

The process of step S63 will be described using the example shown in FIGS . 11 (A) and 11 (B) .

  As described above, the screen size of the display input unit 10 is 1080 pixels in width and 1920 pixels in height. That is, the aspect ratio of the screen size of the display input unit 10 is 9:16.

Display input section 10, in the display example shown in FIG. 11 (A), an image is displayed 902. The image size of the image 902 is 600 pixels wide and 800 pixels high. That is, the aspect ratio of the image size of the image 902 is 3: 4, which is different from the aspect ratio of the screen size of the display input unit 10.

In the example shown in FIG. 11A , the display control unit 15 executes a process of enlarging and displaying the image 902 at 1.8 times (1080 pixels / 600 pixels). In this case, the display size of the image 902 is a size obtained by multiplying both the width and height of the image size by 1.8 times. Then, as shown in FIG. 11B , the display input unit 10 enlarges and displays the image 902 while maintaining the aspect ratio of the image size of the image 902. However, the display control unit 15 may obtain the magnification of the enlarged display using the height of the specified display size.

  When the acquired level LSS is less than 30 mV, for example (S62: NO), the display control unit 15 performs an enlargement process of the image 902 using both the width and height of the specified display size (S64).

In the example shown in FIG. 11A , the display control unit 15 enlarges the image 902 by making the width 1.8 times (1080 pixels / 600 pixels) and the height 2.4 times (1920 pixels / 800 pixels). Display size. Then, the display input unit 10 enlarges and displays the image 902 in the entire display area.

  As described above, this modification displays an enlarged image while maintaining or changing the aspect ratio according to the level LSS. Of course, this modification can also be implemented for reduced display.

DESCRIPTION OF SYMBOLS 1 ... Portable terminal 10 ... Display input part 11 ... Display part 12 ... Electrostatic sensor 13 ... Position detection part 14 ... Control part 15 ... Display control part 20 ... Piezoelectric sensor 21 ... Piezoelectric sensor result detection part 30 ... Case 40 ... Calculation Circuit module 111 ... Liquid crystal panel 112 ... Front polarizing plate 113 ... Back polarizing plate 114 ... Backlight 121 ... Base film 122, 123 ... Capacitance detection electrode 124 ... Insulating film 140 ... Database 201 ... Piezoelectric film 202, 203 ... Piezoelectric detection Electrodes 901, 902 ... Image

Claims (5)

Position detecting means for detecting a plurality of positions where a touch operation on the operation surface is performed;
Pressing operation detecting means for detecting a pressing operation on the operation surface;
A distance calculator that calculates distances between the plurality of positions detected by the position detector;
A display control unit;
A display unit for displaying an image according to the control of the display control unit;
A storage unit for storing information on a display size of the image;
With
The display control unit changes the display size of the image at a magnification proportional to the distance when the distance calculated by the distance calculation unit changes and the pressing operation detection unit detects the pressing operation. When the distance calculated by the distance calculation unit changes and the pressing operation detection unit does not detect the pressing operation, the display size of the image is changed according to the display size information read from the storage unit. To perform the second process
Display device. The storage unit stores a plurality of pieces of information about the display size of the image,
The display control unit reads information on a display size according to a distance change amount detected by the distance calculation unit.
The display device according to claim 1 . The information on the display size of the image includes the number of pixels corresponding to the display area of the display unit.
The display device according to claim 1 . The pressing operation detection means includes a piezoelectric film formed of a chiral polymer.
The display device according to claim 1 . The chiral polymer is polylactic acid stretched in a uniaxial direction.
The display device according to claim 4 .

Images