JP2018097711A - Program and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program and an information processor capable of protecting privacy without being viewed by others upon checking of an image displayed at a display part.SOLUTION: An information processor 10 executes image processing on an image to disable recognition of the image and displays the image at a display 16. A control part of the image processor determines contact strength upon contact of an indication body with a touch panel 14, and in accordance with the contact strength, controls a degree of the image processing which disables the recognition.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a program for displaying data on a display unit and an information processing apparatus.

  Conventionally, in a printing apparatus or a reading apparatus, an image such as a preview before printing or a scan result can be transmitted to an information processing apparatus having a touch panel such as a tablet terminal or a smartphone, and the image can be displayed on the screen of the information processing apparatus. . In order to prevent others from seeing an image with an information processing device, a technique is considered in which an operator inputs a password and performs authentication before displaying the image. (For example, see Patent Document 1)

JP 2007-221342 A

  However, in the related art, there is a problem that an image may be seen by another person while the image is being confirmed after the authentication by the password input is completed.

  The present invention has been made in view of the above circumstances, and an object thereof is a program installed in an information processing apparatus having a display unit and a touch panel, and is used when confirming an image displayed on the display unit. Another object of the present invention is to provide a program and an information processing apparatus that can protect privacy so that others cannot see it.

  A program disclosed in the present specification is a program that can be executed by a computer of an information processing apparatus including a display unit and a touch panel, and displays an image based on image data on the display unit. A display process to be performed, an identification process to execute an image process that makes the image unidentifiable, a determination process to determine the contact strength of the indicator with respect to the touch panel, and the non-identification process according to the contact strength And a reduction process for reducing the degree of the image processing.

  According to the above configuration, by changing the contact strength, it is possible to reduce the degree of image processing executed in the indistinguishable processing. Therefore, it is possible to achieve both the confirmation of the content of the image and the protection of privacy so that the image cannot be seen by others.

It is a block diagram of information processor 10 concerning an embodiment. It is a flowchart of an image display process. It is a flowchart of an opacity reduction process. It is a flowchart of a button press process. It is a flowchart of a reduction area determination process. It is a flowchart of a reduction degree determination process. It is a flowchart of a degree reduction process. It is a flowchart of a separation process. It is a flowchart of a limited opacity reduction process. It is a flowchart of a limited degree reduction process. It is an example of a display screen. It is an example of a display screen, (a) is when the contact strength is greater than or equal to the threshold, (b) is when the contact strength is less than the threshold, (c) is to move the indicator away from the screen after (a) (D) is a display screen when the indicator is moved away from the screen and brought into contact with a different place after (b). It is an example of a display screen when the indicator is moved while being in contact with the touch panel, and is a display screen when (a) the contact strength is greater than or equal to a threshold, and (b) the contact strength is less than the threshold. . It is an example of a display screen when a contact position is outside a preview area, (a) is a display screen when contact intensity is more than a threshold, and (b) is a display screen when contact intensity is less than a threshold. It is an example of a display screen, (a) is a display screen when there are two contact positions and the contact strength is greater than or equal to a threshold, and (b) is a display screen when there are two contact positions and the contact strength is less than the threshold. It is. It is an example of a display screen when a confidential area is included in a reduction area, (a) is a display screen when contact intensity is more than a threshold, and (b) is a display screen when contact intensity is less than a threshold. It is an example of a display screen when confidential information is included and the contact position is outside the preview area. It is an example of matching of a contact strength and a reduction degree. It is an example of an area | region table.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it is needless to say that the embodiment of the present invention can be changed as appropriate without departing from the gist of the present invention. For example, the execution order of each process described below can be changed as appropriate without departing from the scope of the present invention.

  In the present embodiment, the present invention is applied to an information display application program incorporated in the information processing apparatus 10. Examples of the information processing apparatus 10 include a smartphone, a tablet terminal, a mobile phone, and a PC.

  FIG. 1 shows a block diagram of an information processing apparatus 10 exemplified as the present embodiment. The information processing apparatus 10 mainly includes a CPU 12, a touch panel 14, a main camera 21, a communication interface (IF) 22, a biosensor 23, and a storage unit 24. Examples of the information processing apparatus 10 include a smartphone, a tablet terminal, a mobile phone, and a PC.

  The touch panel 14 includes a display 16, a position detection sensor 18, and a contact strength sensor 20. The display 16 displays various function information of the information processing apparatus 10. The position detection sensor 18 functions as the touch panel 14 by being configured integrally with the display 16. The position detection sensor 18 outputs to the CPU 12 a position signal corresponding to the position at which the indicator 34 (e.g., the operator's fingertip or stylus pen) contacts the display surface of the display 16. The position detection sensor 18 can simultaneously output position signals corresponding to a plurality of contact positions to the CPU 12. The contact strength sensor 20 outputs a contact strength signal corresponding to the contact strength (eg, contact force or pressure) to the touch panel 14. The contact strength sensor 20 is disposed integrally with or close to the touch panel 14. The main camera 21 is a camera mounted on the information processing apparatus 10. When the operator's finger touches the biological sensor 23, the biological sensor 23 outputs a biological signal corresponding to the fingerprint of the finger. The communication IF 22 performs wireless communication based on a cellular phone standard or a wireless LAN standard. Each component constituting the information processing apparatus 10 is connected to be communicable with each other through an input / output port.

  The CPU 12 executes processing according to the program 26 in the storage unit 24. Hereinafter, the CPU 12 that executes a program, such as the application 28 or the operating system 30, may be described simply by a program name.

  The storage unit 24 is configured by combining a RAM, a ROM, a flash memory, an HDD, a buffer included in the CPU 12, and the like. The storage unit 24 stores a program 26. The program 26 includes an application 28, an operating system 30, and a memory 32. The memory 32 stores information necessary for executing the application 28 (details will be described later, for example, an area table TB1, a threshold flag, a confidential flag, and biological information of the operator). The operating system (OS) 30 is a program that provides a function for displaying various images on the display 16 and a basic function used by the application 28. The operating system 30 is also a program that provides an API (abbreviation of application programming interface) for each application to instruct various hardware. The application 28 can be used by being installed in the information processing apparatus 10 by an operator or the like.

  The biometric information includes any information that can identify an individual, such as a fingerprint, a voiceprint, a face, an iris, and a vein. In the information processing apparatus 10 according to the present embodiment, a case where a fingerprint is specified by the biometric sensor 23 will be described. However, a voice print acquired by a microphone, a facial feature acquired from a captured image of the main camera 21, and eyeball shooting are performed. The iris information may be used as biological information.

  The storage unit 24 may be a computer-readable storage medium. A computer-readable storage medium is a non-transitory medium. Non-transitory media include recording media such as CD-ROM and DVD-ROM in addition to the above examples. A non-transitory medium is also a tangible medium. On the other hand, an electrical signal that carries a program downloaded from a server on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage. Not included in the media.

  In addition, “data” in the present specification refers to bits or bit strings that can be handled by a computer, and refers to data that can be handled without taking into account the meaning content indicated by each bit.

<Transition of display screen>
A screen displayed on the touch panel 14 by executing the application 28 will be described with reference to FIGS. 11 to 17. Details of the flow of the application 28 will be described later.

  When the application 28 is executed, a display screen as shown in FIG. 11 is displayed on the touch panel 14. The display screen includes a status display area A1 and an image display area A2. The status display area A1 is an area in which various statuses such as the remaining battery level are displayed. Various images are displayed by the application 28 in the image display area A2, and the operator operates the opacity of the displayed image C1. The display area A2 includes a preview area A3. In the preview area A3, the image C1 and the mask C2 are displayed so as to overlap each other so that the image C1 is the background and the mask C2 is the foreground. That is, the CPU 12 displays the image C1 on which the mask C2 is overlaid without excess or deficiency in the preview area A3. The preview area A3 is an example of a display area.

  Since the opaque mask C2 is superimposed on the image C1 without excess or deficiency, the operator cannot identify the contents of the image C1. First, the operator contacts the biometric sensor 23 with a finger and performs fingerprint authentication. If the authentication is successful, the opacity of the mask C2 can be reduced. When the operator touches the indicator 34 on the display screen of the touch panel 14, the opacity of the mask C2 depends on the contact strength in the reduction region D1 corresponding to the contact position B1 where the indicator 34 is brought into contact. Reduced. The reduction area D1 is an area where the opacity of the mask C2 is reduced and is determined according to the contact position B1.

  With reference to FIG. 12, a display screen in a case where the operator brings the indicator 34 away from the touch panel 14 after the indicator 34 has been brought into contact with the touch panel 14 will be described. When the contact strength of the indicator 34 is less than the threshold value, the opacity of the mask C2 in the reduction region D1 is reduced according to the contact strength. Thereafter, when the operator releases the indicator 34 from the touch panel 14, the opacity of the mask C2 in the reduction region D1 returns to 100%. When the contact strength is greater than or equal to the threshold value, the opacity of the mask C2 in the reduction area D1 is reduced to 0%, and further, outside the preview area A3 in the display area A2, the mask C2 of the image C1 in the reduction area D1. A button 35 that accepts an input for setting the opacity to 100% is displayed. Thereafter, when the operator releases the indicator 34 from the touch panel 14, the opacity in the reduced region D1 is maintained at 0%. Thereafter, when the operator presses the button 35, the opacity of the mask C2 in the reduction area D1 returns to 100%, and the display of the button 35 disappears. That is, after the contact with the contact strength on the threshold value, the opacity of the reduced region D1 is maintained at 0% until the button 35 is pressed. If there is a contact with a contact strength more than a threshold value a plurality of times before pressing the button 35, there will be a plurality of reduced regions D1 in which the opacity of the mask C2 is maintained at 0%, When the button 35 is pressed, the opacity of all the reduced areas D0 returns to 100%.

  With reference to FIG. 13, a display screen when the operator moves the touch panel 14 from the contact position B1 to the contact position B2 while keeping the indicator 34 in contact with the touch panel 14 will be described. When the contact strength at the contact position B1 before the movement is less than the threshold, the mask C2 outside the reduction area D2 according to the designated position B2 after the movement within the reduction area D1 according to the contact position B1 before the movement. The opacity is 100%. In the reduced region D2 corresponding to the contact position B2 after movement, the opacity of the mask C2 is reduced according to the contact strength. When the contact strength at the contact position B1 before the movement is equal to or higher than the threshold value, the opacity of the mask C2 in the reduced region D1 corresponding to the contact position B1 before the movement is maintained at 0%. In the reduced area D2 corresponding to the contact position B2 after movement, the opacity of the mask C2 in the reduction area D2 is reduced to 0% regardless of the contact strength at the contact position B2 after movement. In other words, once the contact 34 has been moved with the contact strength equal to or higher than the threshold without moving the indicator 34 from the touch panel 14, the reduction region D1 before the movement and the reduction region D2 after the movement are combined. The opacity of the mask C2 in D3 is reduced to 0%.

  With reference to FIG. 16, a display screen when the operator brings the indicator 34 into contact with the touch panel 14 when confidential information is included in the image data will be described. When the indicator 34 is moved away from the touch panel 14 after being touched with a contact strength of a threshold value or higher, or not moved away from the touch panel 14, the opacity of the mask C2 in the reduction region D1 is not maintained at 0%, but 100%. Return to. The button 35 is also not displayed. When confidential information is not included in the reduction area D1 that reduces the opacity of the mask C2, the opacity of the mask C2 in the reduction area D1 is reduced according to the contact strength. On the other hand, when the confidential information is included in the reduced area D1 for reducing the opacity of the mask C2, the mask C2 is only to the extent that the contents cannot be identified in the first area F1, which is an area where the reduced area D1 and the confidential area E1 overlap. The opacity of is not reduced. In the second area F2, which is an area that does not overlap with the confidential area E1 in the reduction area D1, the opacity is reduced according to the contact strength. Details of the confidential area E1 will be described later. When the reduction area is the entire preview area A3, the result is as shown in FIG. 17, and the first area F1 coincides with the confidential area E1.

<Operation of information processing apparatus>
The operation of the information processing apparatus 10 according to the present embodiment will be described with reference to the flowcharts of FIGS. The information processing apparatus 10 activates the application 28 based on an operator input. The CPU 12 reads the application 28 and starts overall control of the information processing apparatus 10. Thereby, an image display process is executed.

  In S100 of FIG. 2, the CPU 12 acquires image data to be displayed. The image data may be various data. For example, the image data may be generated by the application 28, may be selected by the operator from a plurality of image data stored in the storage unit 12, or image data of an image captured by the main camera 21. It may be print preview image data sent from a printing apparatus (not shown) connected through the communication IF 22 or sent from an image reading apparatus (not shown) connected through the communication IF 22. It may be scanned image data.

  In S101, the CPU 12 performs a masking process on the image C1 based on the image data. In the masking process, a mask C2 is created that has been subjected to image processing such as painting, mosaicing, and blurring so that the operator cannot identify the contents of the image C1 based on the image data to be displayed. The opacity of the mask C2 at this time is set to 100%. The process of S101 is an example of an indistinguishable process.

  In S102, the CPU 12 determines whether or not there is confidential information in the image C1 based on the image data acquired in S100. This determination can be made based on whether or not the recognized character and the keyword match after the character recognition in the image C1. The character recognition in the image C1 may be performed by any method. For example, each character pattern is stored in the memory 32 as a dictionary, and the CPU 12 compares the character image in the image C1 with the character pattern in the dictionary. Thus, character recognition in the image C1 can be executed. A keyword is a word consisting of a character string, and includes a name, address, telephone number, mobile phone number, date of birth, sex, educational background, work history, etc., which are confidential information, and is stored in the memory 32 as a keyword dictionary. Yes. The process of S102 is an example of a confidentiality determination process.

  In S102, when the CPU 12 makes an affirmative determination (S102: Yes), the CPU 12 determines the confidential area E1 including the confidential information in the image C1. Any method may be used for determining the confidential area. For example, the rectangular area surrounding the character that matches the keyword in S102 is determined as the confidential area E1 including the confidential information (S104). The process of S104 is an example of a confidential area determination process.

  In S105, the CPU 12 executes a confidential masking process. In the confidential masking process, a confidential mask C3 is created in which image processing similar to the masking process is executed only in the confidential area E1 determined in S104. At this time, the opacity in the confidential area E1 of the confidential mask C3 is set to 30% smaller than the opacity of the mask C2 created by the masking process. This degree is such a degree that the operator cannot identify the contents of the image C1. Although details will be described later, this degree matches the opacity when the contact intensity is less than the threshold and the reduction degree is maximum (the reduction degree is 70%).

  In S106, the CPU 12 sets the first value “ON” in the confidential flag. Thereafter, the process proceeds to S120.

  On the other hand, if the CPU 12 makes a negative determination in S102 (S102: No), the process proceeds to S120.

  In S120, the CPU 12 displays the display screen shown in FIG. The process of S120 is an example of a display process.

  In S <b> 123, the CPU 12 determines whether or not the operator's biometric information detected by the biometric sensor 23 matches the biometric information stored in the memory 32 in advance. This determination can be made by the CPU 12 detecting the biological information from the biological signal output by the biological sensor 23. If a negative determination is made (S123: No), S123 is executed again. That is, unless the biometric authentication is successful, the operator cannot reduce the opacity of the mask C2 created by the masking process. If the CPU 12 makes an affirmative determination in S123 (S123: Yes), the process proceeds to S126. In S126, the CPU 12 determines whether or not the first value “ON” is set in the confidential flag. If a negative determination is made (S126: No), the process proceeds to S130. If an affirmative determination is made (S126: Yes), the process proceeds to S1000. That is, the CPU 12 executes the opacity reduction process when there is no confidential information in the image C1, and executes the limited opacity reduction process when there is confidential information in the image C1. Here, first, the operation of the information processing apparatus 10 when confidential information is not included in the image C1 will be described.

<When confidential information is not included in the image>
In S130, the CPU 12 executes the opacity reduction process shown in FIG.

  In S140, the CPU 12 determines whether or not the contact position B1 is detected by the position detection sensor 18 in the display area A2. This determination can be made based on whether or not a position signal is output from the position detection sensor 18. The CPU 12 can detect a contact position B <b> 1 that is a coordinate value with which the indicator 34 is in contact with the position signal output from the position detection sensor 18. That is, the CPU 12 detects from the output from the position detection sensor 18 that the indicator 34 has touched the touch panel 14. If a negative determination is made (S140: No), S140 is executed again, and if an affirmative determination is made (S140: Yes), the process proceeds to S145.

  In S145, the CPU 12 executes a button pressing process. Details of the button pressing process will be described with reference to FIG. The process of S145 is an example of a reception process.

  In S146, the CPU 12 determines whether or not the button 35 is displayed. This determination can be made based on whether or not S390 has been executed. The process of S390 will be described later. When a negative determination is made (S146: No), the button pressing process is terminated, and when an affirmative determination is made (S146: Yes), the process proceeds to S147.

  In S147, the CPU 12 determines whether or not the contact position B1 is within the display area of the button 35. That is, it is determined whether or not the button 35 has been pressed. This determination can be made by comparing the contact position B1, which is a coordinate value with which the indicator 34 detected from the position detection sensor 18 is in contact, with the coordinate value of the display area of the button 35. When a negative determination is made (S147: No), the button pressing process is terminated, and when an affirmative determination is made (S147: Yes), the process proceeds to S148.

  In S148, the CPU 12 sets the opacity of the mask C2 to 100% in all the reduction areas D0 in the preview area A3. Subsequently, in S149, the button 35 is turned off. Thereafter, the button pressing process is terminated. That is, when the button 35 is pressed, the mask C2 is returned to the state created by the masking process. As a result, the display screen returns to the screen displayed on the touch panel 14 in S120. On the other hand, when a negative determination is made in S147 (S147: No), the button pressing process is terminated. Note that the determination in S147 may be whether or not a predetermined operation has been performed on the touch panel 14, such as a double tap that touches the touch panel twice or a long touch that touches continuously for a time equal to or longer than a threshold time. . In that case, S390 becomes unnecessary.

  After the button pressing process is completed, the process returns to FIG. 3 and proceeds to the process of S150. In S150, the CPU 12 determines whether or not the contact strength of the indicator 34 detected by the contact strength sensor 18 is equal to or greater than a threshold value. This determination can be made by comparing the contact strength detected by the contact strength signal output from the contact strength sensor 18 with a threshold value. If a negative determination is made (S150: No), the process proceeds to S170. When an affirmative determination is made (S150: Yes), the first value “ON” is set in the threshold flag (S160), and the process proceeds to S170.

  Note that the processing in S140 and S150 is an example of determination processing.

  In S170, the CPU 12 executes a reduction area determination process. The reduction area determination process is a process for determining a reduction area D1 corresponding to the contact position B1. Details of the reduction area determination process will be described with reference to FIG. The process of S170 is an example of a determination process.

  In S180, the CPU 12 determines whether or not the contact position B1 obtained by the position detection sensor 18 is within the preview area A3. This determination can be made using the coordinate value of the contact position B1 and the coordinate value of the image C1. If a negative determination is made (S180: No), the process proceeds to S210. In S210, the CPU 12 reads a calculation formula for determining the reduction area D1 from the area table TB1 stored in the memory 32. As shown in FIG. 19, when the contact position B1 is outside the preview area A3, the area table TB1 is associated with a calculation formula that uses the entire preview area A3 as a reduction area, as shown in FIG. In addition, the CPU 12 reads out this calculation formula and determines a reduction region D1 corresponding to the contact position B1. Thereafter, the reduction area determination process is terminated.

  On the other hand, if a positive determination is made in S180 (S180: Yes), the process proceeds to S190. In S190, when there is one contact position B1 obtained by the position detection sensor 18 (S190: one), the CPU 12 proceeds to the process of S200. In S <b> 200, the CPU 12 reads a calculation formula for determining the reduction area D <b> 1 from the area table TB <b> 1 stored in the memory 32. As shown in FIG. 19, when the contact position B1 is one point in the preview area A3, the area table TB1 is associated with an expression for calculating a rectangle whose contact position B1 is the midpoint of the lower side. ing. As shown in FIG. 12, the CPU 12 reads out this calculation formula and determines a reduction region D1 corresponding to the contact position B1. Thereafter, the reduction area determination process is terminated. Here, an example of a rectangle has been described. However, the reduction area may be a circle or an ellipse centered on the contact position B1, or a predetermined area that allows the operator to identify the contents of the image C2. Anything is fine.

  In S190, when there are two contact positions detected by the position detection sensor 18 (B1 and B2) (S190: two), the CPU 12 proceeds to the process of S220. In S220, the CPU 12 reads a calculation formula for determining the reduction area D1 from the area table TB1 stored in the memory 32. As shown in FIG. 19, when there are two contact positions B1 and B2, the area table TB1 is associated with an equation for calculating a rectangle having two contact positions B1 and B2 as diagonal lines. Yes. As shown in FIG. 15, the CPU 12 reads out this calculation formula and determines a reduction region D1 corresponding to the contact positions B1 and B2. Thereafter, the reduction area determination process is terminated.

  After the reduction area determination process is completed, the process returns to FIG. 3 and proceeds to the process of S230. In S230, the CPU 12 executes a reduction degree determination process. The reduction degree determination process is a process for determining a reduction degree that is a degree to reduce the opacity of the mask C2 in the reduction region D1. Details of the reduction degree determination process will be described with reference to FIG.

  In S240, the CPU 12 determines whether or not the first value “ON” is set in the threshold flag. If a negative determination is made (S240: No), the process proceeds to S270.

  In S <b> 270, the CPU 12 determines the degree of reduction according to the contact strength of the indicator 34 detected by the contact strength sensor 18. The CPU 12 can detect the contact strength with which the indicator 34 contacts the touch panel 14 based on the contact strength signal output from the contact strength sensor. When two contact positions B1 and B2 are detected, the degree of reduction is determined according to the contact intensity of the larger contact intensity detected by the contact intensity sensor 18 at the two contact positions B1 and B2. To do. The contact strength and the reduction degree are associated as shown in FIG. 18, and the reduction degree is determined according to the contact strength. When the contact strength is less than the threshold, the degree of reduction is 70%, and when the contact strength is greater than or equal to the threshold, the degree of reduction is 100%. Thereafter, the reduction degree determination process is terminated.

  On the other hand, if the CPU 12 makes an affirmative determination in S240 (S240: Yes), the process proceeds to S280. In S280, the CPU 12 determines the degree of reduction as 100% regardless of the contact strength of the indicator 34 detected by the contact strength sensor 18. Thereafter, the reduction degree determination process is terminated.

  After the reduction degree determination process ends, the process returns to FIG. 3 and proceeds to the process of S290. In S290, the CPU 12 executes a degree reduction process. The degree reduction process is a process in which the opacity of the mask C2 in the reduction area D1 is reduced in accordance with the reduction degree and displayed in the preview area A3. The details of the reduction degree determination process will be described with reference to FIG.

  In S300, the CPU 12 reduces the opacity of the mask C2. The opacity of the mask C2 is reduced according to the reduction area D1 determined by the reduction area determination process and the reduction degree determined by the reduction degree determination process. The opacity of the mask C2 is calculated by subtracting the degree of reduction from 100%, assuming that the opacity of the masking process executed in S110 is 100%. For example, when the degree of reduction is 0%, the opacity is 100%, and the opacity of the mask C2 does not change. When the degree of reduction is 70%, as shown in FIG. 12B, the opacity of the mask C2 is lowered to 30%. When the degree of reduction is 100%, as shown in FIG. 12A, the opacity of the mask C2 is lowered to 0%, and the operator can identify the contents of the image C1. The reduction of the opacity of the mask C2 means that a reduction degree is assigned to the alpha value representing the transparency of the image assigned to each pixel, but since this is a known method, detailed description thereof is omitted here. . The process of S300 is an example of a reduction process.

  In S320, the CPU 12 updates the display in the preview area A3 with the image C1 as the background and the mask C2 whose opacity has been reduced in S310 as the foreground.

  In S330, the CPU 12 determines whether or not the first value “ON” is set in the threshold flag. If a negative determination is made (S330: No), the process proceeds to S350.

  In S350, the CPU 12 sets the opacity in the reduction area D1 reduced in S300 in the mask C2 to 100%, and ends the degree reduction process.

  On the other hand, when the CPU 12 makes an affirmative determination in S330 (S330: Yes), the degree reduction process is terminated.

  After the degree reduction process is completed, the process returns to FIG. 3 and proceeds to the process of S360. In S <b> 360, the CPU 12 determines whether the indicator 34 has moved away from the touch panel 14. This determination can be made based on whether or not a position signal is output from the position detection sensor 18. If a negative determination is made (S360: No), the process returns to S150, and if an affirmative determination is made (S360: Yes), the process proceeds to S370.

  In S370, the CPU 12 executes the separation process. The details of the separation process will be described with reference to FIG.

  In S380, the CPU 12 determines whether or not the first value “ON” is set in the threshold flag. When a negative determination is made (S380: No), the separation process is terminated, and when an affirmative determination is made (S380: Yes), the process proceeds to S390.

  In S390, the CPU 12 displays a button 35 outside the preview area A3 in the image display area A2 that accepts input from the operator for setting the opacity of the mask C2 in all the reduction areas D0 to 100%.

  In S400, the CPU 12 sets the second value “OFF” in the threshold flag and ends the separation process.

  After the separation process is completed, the process returns to S140, and the opacity reduction process is repeatedly executed. When the CPU 12 receives an interrupt instruction for ending the application 28 based on the input from the operator, the CPU 12 ends the opacity reduction processing and the image display processing, and ends the execution of the application.

<When confidential information is included in the image>
Next, the operation of the information processing apparatus 10 when confidential information is included in the image C1 will be described.

  If the CPU 12 makes an affirmative determination in S126 of FIG. 2 (S126: Yes), the process proceeds to S1000. In S1000, the CPU 12 executes the limited opacity reduction process shown in FIG. In the following steps, the same steps as those in the opacity reduction process are assigned the same numbers, and description thereof is omitted.

  In S1010, the CPU 12 executes a limited degree reduction process. The details of the limited degree reduction process will be described with reference to FIG.

  Since S300 and S350 are steps for performing the same process as the opacity reduction process, a description thereof will be omitted. In S1020, the CPU 12 determines whether or not the contact strength of the indicator 34 detected by the contact strength sensor 18 is equal to or greater than a threshold value. This determination can be made by comparing the contact strength detected by the contact strength signal output from the contact strength sensor 18 with a threshold value. When a positive determination is made (S1020: Yes), the process proceeds to S1030. If a negative determination is made (S1020: No), the process proceeds to S1040.

  In S1030, the CPU 12 combines the confidential mask C3 and the mask C2. Specifically, the opacity of the mask C2 and the confidential mask C3 is compared, and the opacity of the confidential mask C3 is applied to an area where the opacity of the confidential mask C3 is larger, and the opacity of the mask C2 is greater. A synthetic mask C4 to which the opacity of the mask C2 is applied is created in the large area. That is, in the first area F1 where the reduced area D1 and the confidential area E1 overlap, the opacity of 30% of the confidential mask C3 is applied, and in the second area F2, which is the area outside the confidential area E1 in the reduced area D1, the degree is determined. The opacity of the mask C2 reduced based on the reduction degree determined by the process is applied, and the opacity of the mask C2 of 100% is applied to the area outside the reduced area D1 and also outside the confidential area E1. . The opacity applied in the first area F1 is an example of the first degree, and the opacity applied in the second area F2 is an example of the second degree.

  In S1040, if the mask C4 has been created, the CPU 12 updates the display in the preview area A3 with the image C1 as the background and the mask C4 created in S1020 as the foreground. If the mask C4 has not been created, the display in the preview area A3 is updated with the image C1 as the background and the mask C2 whose opacity has been reduced in S320 as the foreground.

<Operational effects of this embodiment>
According to the above embodiment, the opacity of the mask C2 displayed over the image C1 is reduced based on the degree of reduction according to the contact strength (S270). That is, by changing the contact strength, it is possible to reduce the degree of image processing executed in the masking process. Therefore, it is possible to achieve both the confirmation of the content of the image and the protection of privacy so that the image cannot be seen by others.

  When the contact strength is greater than or equal to the threshold (S150: Yes), the degree of reduction is determined to be 100%, that is, the maximum value (S280). Thereby, the content of the image C1 can be identified by adding the contact strength equal to or higher than the threshold.

  A reduction region D1 for reducing the opacity of the mask C2 is determined according to the contact position B1 to the touch panel 14 (S170). Thereby, through the contact of the indicator 34 with the touch panel 14, which region in the display region is determined as the reduction region D1 can be determined.

  If the contact position B1 to the touch panel 14 is outside the preview area A3 (S180: No), the reduction area D1 is determined as the entire preview area A3. Accordingly, it is possible to select whether the reduction area D1 is the entire preview area A3 or an area corresponding to the contact position B1 in the preview area A3 depending on the contact position B1. For this reason, it becomes easy to reflect the operator's intention as to which priority is given to the ease of checking the contents of the image C1 or the protection of privacy.

  If the number of touch positions on the touch panel 14 is two (S190: two), a rectangle having the two touch positions B1 and B2 as diagonal lines is determined as the reduction region D1. By adjusting the locations of the two contact positions B1 and B2, the size of the reduction region D1 can be determined. For this reason, it becomes easy to reflect the operator's intention as to which priority is given to the ease of checking the contents of the image C1 or the protection of privacy.

  If the contact strength is greater than or equal to the threshold (S330: Yes), the process (S350) for setting the opacity of the mask C2 in the reduced region D1 to 100% is not executed. That is, even if the indicator 34 is separated from the touch panel 14, the opacity in the reduction area D1 of the mask C2 is maintained while being reduced. Thereby, by making the indicator 34 contact the touch panel 14 with a contact strength equal to or higher than the threshold value, it is possible to maintain the degree of image processing in a plurality of areas while reducing the degree of image processing. Can do. For this reason, it becomes easy to reflect the operator's intention as to whether priority is given to ease of image content confirmation or privacy protection.

  When the contact strength is equal to or higher than the threshold value (S380: Yes), the button 35 is received in the image display area A2 to receive an input from the operator for setting the opacity of the mask C2 of the image C1 in the reduction area to 100%. Is displayed outside the preview area A3 (S390). When pressing of the button 35 is accepted from the operator (S430: Yes), the opacity of the mask C2 is set to 100% in all the reduction areas D0 (S440). Thereby, it is possible to make the reduction region D0 subjected to the reduction process indistinguishable at a timing suitable for the operator.

  When the confidential information is included in the image C1 (S102: Yes), even if the contact strength is equal to or higher than the threshold value, the process of setting the opacity of the mask C2 in the reduced region to 100% (S350) is executed. Therefore, in the highly confidential image C1, the content of the image C1 can be made more difficult to be seen by others.

  When the contact strength is greater than or equal to the threshold (S1020: Yes), the opacity 30% of the confidential mask C3 is applied in the first region F1 where the reduced region D1 and the confidential region E1 overlap (S1030). On the other hand, when the contact strength is less than the threshold value (S1020: No), the opacity reduced according to the contact strength is applied in the reduction region D1 of the mask C2 (S320). When the contact intensity is less than the threshold value, the maximum value of the degree of reduction is 70%, so the opacity of the mask C2 can be reduced only to 30%. This is the same as the opacity of the first region F1. That is, regardless of the magnitude of the contact strength, the opacity can be reduced only to 30% within the confidential area E1 where the image C1 cannot be identified. Therefore, confidential information is more difficult for others to see and privacy can be protected.

  Only when the biological information of the operator detected by the biological sensor 23 matches the biological information stored in advance in the memory 32 (S123: Yes), the opacity reduction process (S130) or the limited opacity reduction process (S1000). ). Therefore, an operator whose biometric information does not match cannot confirm the content of the image C1, and can protect privacy.

10 Information processing device 12 CPU
14 Touch Panel 18 Position Detection Sensor 20 Contact Strength Sensor 28 Application 32 Memory 34 Indicator 35 Button A2 Display Area A3 Preview Area B1, B2 Contact Position C1 Image C2 Mask D0, D1, D2, D3 Reduction Area E1 Confidential Area F1 First Area F2 second area

Claims (13)

A display unit;
A touch panel;
A program executable by a computer of an information processing apparatus comprising:
In the computer,
Display processing for displaying an image based on image data on the display unit;
An indistinguishable process for performing image processing in which the image becomes indistinguishable;
A determination process for determining the contact strength of the indicator with respect to the touch panel;
A reduction process for reducing the degree of the image processing executed in the indistinguishable process according to the contact strength,
A program characterized by having executed.   2. The degree of reduction of the image processing executed in the indistinguishable processing is set to a maximum value in the reduction processing when the contact strength determined in the determination processing is equal to or higher than a threshold value. The program described. In the determination process, the contact position of the indicator is further determined,
A determination process for determining a reduction area in the image, which is an area for executing the reduction process, according to the contact position;
The program according to claim 1, further causing the computer to execute the program.   The program according to claim 3, wherein when the contact position determined in the determination process is outside the display area of the image, the determination process determines the entire display area as the reduction area.   When there are two contact positions determined in the determination process, in the determination process, an area that is point symmetric at the midpoint of a line segment connecting the two contact positions is determined as the reduction area. The program according to claim 3 or 4, characterized by the above.   4. When there are two contact positions determined in the determination process, an area including the two contact positions on the outer periphery is determined as the reduction area in the determination process. Or the program of Claim 4. An accepting process for receiving a predetermined operation on the touch panel for executing the indistinguishable process in the reduced area in which the degree of the image processing is reduced by the reducing process;
The program according to claim 3, further causing the computer to execute the program.   The program according to any one of claims 3 to 7, wherein when the contact strength determined in the determination process is equal to or greater than a threshold value, the degree of the image processing reduced in the reduction process is maintained. A security determination process for determining whether confidential information is included in the image;
The program further causes the computer to execute
If it is determined in the confidentiality determination process that the confidential information is included in the image, even if the contact strength determined in the determination process is equal to or higher than a threshold, the degree of the image processing reduced by the reduction process is determined. The program according to claim 8, wherein the program is not maintained. A security determination process for determining whether confidential information is included in the image;
In the confidentiality determination process, when it is determined that confidential information is included, a confidential area determination process for determining a confidential area in the image including the confidential information;
The program further causes the computer to execute
When there is a first area where the confidential area determined in the confidential area determination process overlaps the reduced area determined in the determination process, in the reduction process, in the first area, the unidentifiable process is performed. The executed image processing is reduced to the first degree, and in the second area that does not overlap the confidential area within the reduced area, the image processing executed in the indistinguishable process is smaller than the first degree. 9. The program according to claim 3, wherein the program is reduced to a degree. A security determination process for determining whether confidential information is included in the image;
When it is determined that the confidential information is included in the confidentiality determination process, a confidential area determination process for determining a confidential area in the image including the confidential information;
The program further causes the computer to execute
If it is determined that the confidential information is included in the image in the confidentiality determination process, the degree of the image processing reduced by the reduction process is maintained even if the contact strength determined in the determination process is equal to or higher than a threshold value. Without
When there is a first area where the confidential area determined in the confidential area determination process overlaps the reduced area determined in the determination process, in the reduction process, in the reduced area and the confidential area In the second area that does not overlap, the image processing executed in the indistinguishable process is reduced to a first degree, and in the first area, the image processing executed in the indistinguishable process is smaller than the first degree. The program according to claim 8, wherein the program is reduced to a degree. The information processing apparatus further includes a biological sensor,
An acquisition process in which the biological sensor acquires biological information of the operator;
The program is further executed by the computer,
12. The program according to claim 1, wherein the reduction process is not executed when the biometric information acquired in the acquisition process does not match the biometric information of a preset operator. A display unit;
A touch panel;
A control unit;
An information processing apparatus comprising:
The controller is
An unidentifiable means for performing image processing in which the image becomes unidentifiable;
Display means for displaying an image based on image data on the display unit;
Determining means for determining the contact strength of the indicator with respect to the touch panel;
Reducing means for reducing the degree of the image processing executed in the indistinguishable processing according to the contact strength,
An information processing apparatus characterized by executing