JP6809137B2 - Programs, information processing devices, and control methods for information processing devices - Google Patents

Description

The technique disclosed in the present specification relates to a program or the like capable of appropriately acquiring a copy image of a display screen by an information processing apparatus when scrolling display is performed.

A technique is known in which when a trigger condition such as an error occurs, a screenshot image of the screen displayed when the trigger condition occurs is automatically acquired and sent to a specific server. By analyzing the content of the screenshot image, the error content and the like can be investigated in detail.

JP-A-2010-99211

Scroll display may be adopted in devices such as smartphones that have a small display screen area. In the scroll display, a part of the entire image is cut out and displayed as a display image. Then, when the screenshot image is acquired when the trigger condition occurs, only the screenshot image of the display image can be acquired. That is, it is not possible to acquire an image in which all of the entire image is copied.

The program disclosed in the present specification is a program that can be read by a computer of an information processing apparatus provided with a display unit, and at least a part of the first image is cut out and cut out by the computer as a second image. The first display process of displaying the second image on the display unit, the first display process of performing scroll display by moving the position of the display frame of the second image on the first image according to the user input, and It is displayed on the display unit according to the first predetermined condition determination process for determining whether or not the first predetermined condition is satisfied and the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. The first acquisition process of acquiring a copy image of the second image, and the copy image of the non-display range of the display range of the first image other than the range cut out by the second image. It is characterized in that the second acquisition process to be acquired is executed.

According to the above configuration, in the case where the scroll display for cutting out at least a part of the first image as the second image is adopted, the copy image obtained by copying the second image is obtained according to the satisfaction of the first predetermined condition. Can be obtained. Then, it is possible to acquire a copy image showing a non-display range which is a range other than the range cut out in the second image in the display range of the first image. This makes it possible to acquire a copy image of the entire first image.

The configuration of the communication system is shown. The operation flow diagram of the print application 21a is shown. The operation flow diagram of the print application 21a is shown. The operation flow diagram of the print application 21a is shown. The operation flow diagram of the print application 21a is shown. It is a figure which shows an example of the setting image. A display example of the setting screen is shown. It is a figure which shows an example of the setting image. It is a figure which shows an example of the screenshot image. It is a figure which shows an example of the screenshot image. It is a figure which shows an example of the screenshot image. It is a figure which shows an example of the setting image.

(Communication system configuration)
FIG. 1 shows a block diagram of a communication system 1 exemplified as an embodiment according to the present application. The communication system 1 includes a mobile phone 10, a multifunction device 110, an access point 62, a web server 100, and a base station 61. The access point 62 is a known relay device.

The web server 100 can communicate with the mobile phone 10 via the Internet 70 and the base station 61. The web server 100 is a server for analyzing the contents of the screenshot data transmitted from the mobile phone 10. The multifunction device 110 can communicate with the mobile phone 10 via wireless communication 202 and 201.

The mobile phone 10 is a mobile phone equipped with an iOS (registered trademark of Cisco Systems, Inc.) platform. The mobile phone 10 mainly includes a CPU 11, a storage unit 12, a button input unit 17, a touch panel 18, a mobile phone interface 20, a wireless LAN interface 22, and a camera unit 27. The CPU 11 controls each function according to a program stored in the storage unit 12, various signals transmitted and received via the mobile phone I / F 20, and the like. Further, the CPU 11 functions as various means by reading the program. In this specification, the interface may be referred to as "I / F".

The mobile phone I / F 20 performs wireless communication 210 with the base station 61. The wireless communication 210 may be a cellular wireless communication such as 3G or 4G. The wireless LAN_I / F22 communicates with the access point 62 via the wireless communication 202. The button input unit 17 is a physical key for executing each function of the mobile phone 10. The touch panel 18 has a function of displaying various functional information of the mobile phone 10 and detecting contact or proximity of an indicator.

The storage unit 12 includes a program 21 and a print application storage area 43. The storage unit 12 may be configured by combining a RAM, a ROM, a flash memory, a hard disk, and the like.

The program 21 includes a printing application 21a and an operating system 21g (hereinafter, referred to as OS 21g). OS21g is the OS of the iOS platform. The print application 21a is an application for iOS. In this specification, the application may be abbreviated as "application".

The print application 21a is an application for causing the multifunction device 110 to perform printing. The print application 21a may be downloaded and installed on the mobile phone 10 from the web server 100 on the Internet 70. Alternatively, the print application 21a may be stored in the media shipped together with the multifunction device 110 and installed on the mobile phone 10 from the media.

OS21g is a program that provides basic functions used in the printing application 21a. The OS 21g also has a function of controlling the activation of the print application 21a and a function of managing the transfer of various data. Further, the OS 21g has a function of controlling various components such as a storage unit 12, a button input unit 17, and a touch panel 18.

The print application storage area 43 is an area for storing various data used by the print application 21a. The print application storage area 43 stores the trigger generation flag, screen data, comparison screen data, and screenshot prohibited area information.

The trigger generation flag is information that is "ON" when the screenshot image is acquired and "OFF" when it is not acquired. The screen data is data for displaying a plurality of types of screens included in the print application 21a. The plurality of types of screens include, for example, a main screen, a setting screen, an edit result display screen, a preview screen, and the like. The main screen is the screen that is first displayed when the print application 21a is started. The setting screen is a screen for accepting changes in various settings of the print application 21a. The edit result display screen is a screen for displaying an image after various editing processes such as trimming and writing have been performed. The preview screen is a screen for displaying a preview of a printed image.

The comparison screen data is data for displaying the comparison screen. The comparison screen is prepared for each of a plurality of types of screens. The comparison screen is a screen used for determining the presence / absence of an error in S270, which will be described later.

The screenshot prohibited area information is information indicating a screenshot prohibited area in which acquisition of a screenshot image is prohibited on each of a plurality of types of screens. An example of a screenshot prohibited area is an area where personal information such as a name and a telephone number is displayed. For example, in the setting image D11 of FIG. 6, the item images I1 and I2 correspond to personal information. That is, the area where the item images I1 and I2 are displayed is the screenshot prohibited area. Therefore, the screenshot prohibited area information indicates that the area in which the item images I1 and I2 are displayed is the screenshot prohibited area.

(Operation of print application 21a)
The operation of the printing application 21a will be described with reference to the flowcharts of FIGS. 2 to 5. Hereinafter, the CPU 11 that executes a program such as an application or OS 21g may be simply described by a program name. For example, the description "print application 21a" may mean "CPU 11 that executes the print application 21a".

In S110, the CPU 11 displays a screen selected from a plurality of types of screens on the touch panel 18. As a specific example, a case where the setting screen SC1 shown in FIG. 7 is displayed on the touch panel 18 will be described. The display image D21, the back button B1, the application evaluation button B2, the up scroll button B11, the down scroll button B12, and the scroll bar B13 are displayed on the setting screen SC1.

The display image D21 is an image cut out by the display frame F2 arranged on the set image D11 of FIG. The setting image D11 of FIG. 6 includes item images I1 to I11. Item images I1 to I11 show various settings of the print application 21a. Specifically, each of the item images I1 to I11 indicates a name, a telephone number, a paper size, a paper type, a number of copies, a page, a print direction, a color / monochrome, a print quality, a borderless print, and a double-sided print. There is. Further, the setting image D11 includes a first end portion P1 and a second end portion P2. The first end P1 is a position that becomes a start point of the scroll display. The second end P2 is a position that becomes the end point of the scroll display.

The back button B1 is a button image for receiving an instruction to switch the display to the screen displayed before the setting screen SC1. The application evaluation button B2 is a button image for receiving an instruction to feed back the user's evaluation of the print application 21a to the creator of the print application 21a. That is, when the application evaluation button B2 is pressed, the user's evaluation information is transmitted to the web server 100. The upper scroll button B11 is a button image for receiving an execution instruction for scroll display in the upward direction T1. The down scroll button B12 is a button image for receiving an execution instruction for scroll display in the downward direction T2. The scroll bar B13 is an image showing the correspondence between the display image D21 and the set image D11.

Hereinafter, the description will be continued using the setting image D11 of FIG. 6 and the setting screen SC1 of FIG. In S120, the CPU 11 determines whether or not a scroll operation has been input. Examples of the scroll operation include tap input to the up scroll button B11 or down scroll button B12, and swipe input into the display image D21. If affirmative judgment is made (S120: YES), the process proceeds to S130. In S130, the CPU 11 moves the position of the display frame F2 on the set image D11 in response to the input scroll operation. For example, the display frame F2 is moved upward T1 or downward T2 by a predetermined distance in response to the tapping of the up scroll button B11 or the down scroll button B12. Then, the process returns to S110, and the display image D21 cut out by the moved display frame F2 is displayed in the setting screen SC1. As a result, scroll display is realized.

On the other hand, if a negative determination is made in S120 (S120: NO), the process proceeds to S132. In S132, the CPU 11 determines whether or not a print instruction has been input. An example of inputting a print instruction is tap input to a print button (not shown). If affirmative judgment is made (S132: YES), the process proceeds to S134. In S134, the CPU 11 generates print data. Then, the print data is transmitted to the multifunction device 110 via the wireless communication 202 and 201. Then, it returns to S110.

If a negative determination is made in S132 (S132: NO), the process proceeds to S140. In S140, the CPU 11 executes a trigger determination process.

The content of the determination process of whether or not a trigger has occurred will be described with reference to FIG. In S410, the CPU 11 determines whether or not the screen switching operation has been input. The screen switching operation is an operation of switching the screen to another screen when any one of the main screen, the setting screen, the preview screen, and the like is displayed. If a negative judgment is made (S410: NO), the process proceeds to S430, and if a positive judgment is made (S410: YES), the process proceeds to S420. In S420, the CPU 11 determines whether or not the setting screen can be switched to another screen. Specifically, on the setting screen SC1 shown in FIG. 7, it is determined whether or not the tap input is performed on the back button B1. If affirmative determination is made (S420: YES), it is determined that the screenshot acquisition condition is satisfied, and the process proceeds to S480. In S480, the CPU 11 sets the trigger generation flag to "on". Then proceed to S150.

On the other hand, if a negative determination is made in S420 (S420: NO), the process proceeds to S430. In S430, the CPU 11 determines whether or not the application evaluation button B2 has been tapped. If a negative judgment is made (S430: NO), the process proceeds to S450, and if a positive judgment is made (S430: YES), the process proceeds to S435. In S435, the CPU 11 accepts the input of the user evaluation for the print application 21a. In S440, the CPU 11 transmits the input user evaluation and log information to the web server 100. The log information is information indicating a history of operations and processes of the print application 21a. Then, it is determined that the screenshot acquisition condition is satisfied, and the process proceeds to S480. The processing after S480 has already been described.

Further, in S450, the CPU 11 determines whether or not an error has occurred during the execution of the print application 21a. If a negative judgment is made (S450: NO), the process proceeds to S150, and if a positive judgment is made (S450: YES), the process proceeds to S460. In S460, the CPU 11 determines whether or not the error that has occurred is a serious error. A serious error is an error in which the print application 21a freezes and the print application 21a needs to be restarted. If a negative determination is made (S460: NO), it is determined that the screenshot acquisition condition is satisfied, and the process proceeds to S480. The processing after S480 has already been described.

On the other hand, if a positive judgment is made (S460: YES), the process proceeds to S470. In S470, when the screenshot data is stored in the print application storage area 43 by S200 or S240 described later, the CPU 11 transmits the screenshot data to the web server 100. Then return to S150.

Return to the description of FIG. In S150, the CPU 11 determines whether or not the screenshot acquisition condition is satisfied. Specifically, it is determined whether or not the trigger generation flag stored in the storage unit 12 is "on". If a negative judgment is made (S150: NO), the process returns to S110, and if a positive judgment is made (S150: YES), the process proceeds to S170.

In S170, the CPU 11 transmits the request information of the error information to the web server 100. The error information is information for identifying a screen having a high probability of an error from among a plurality of types of screens. An example of a screen with a high probability of an error is a screen with a heavy processing load. For example, since the editing result display screen is a screen displayed after executing various editing processes, the processing load is heavy. Further, since the setting screen is a screen for accepting changes in various settings, the processing load is heavy. In S180, the CPU 11 determines whether or not the error information has been received from the web server 100. If a negative judgment is made (S180: NO), the process returns to S180, and if a positive judgment is made (S180: YES), the process proceeds to S190.

In S190, the CPU 11 determines whether or not the screen currently displayed is a screen with a high probability of an error occurring, based on the error information. If a negative judgment is made (S190: NO), the process proceeds to S195. In S195, the CPU 11 sets the trigger generation flag to "off". Then, it returns to S110.

On the other hand, if a positive judgment is made in S190 (S190: YES), the process proceeds to S200. In S200, the CPU 11 acquires a screenshot image. The screenshot image is a copy image of the display image D21 included in the setting screen SC1. The acquisition of the screenshot image may be executed by calling the API (Application Program Interface) for acquiring the screenshot. Then, the CPU 11 stores the screenshot data indicating the acquired screenshot image in the print application storage area 43.

In the explanatory example of the present embodiment, a case where a screenshot image of the display image D21 is acquired while the setting screen SC1 shown in FIG. 7 is displayed will be described. In this case, the screenshot image SS1 shown in FIG. 9 is acquired. The screenshot image SS1 corresponds to the image cut out by the display frame F2 in the setting image D11 of FIG.

In S210, the CPU 11 determines whether or not the set image D11 includes a non-display range. The non-display range is a range other than the range cut out by the display image D21 in the display range of the set image D11. That is, it is a screen that is not completely displayed on the touch panel 18. The determination can be made based on whether or not the display range of the display image D21 is smaller than the display range of the set image D11. If a negative judgment is made (S210: NO), the process proceeds to S260, and if a positive judgment is made (S210: YES), the process proceeds to S220.

In the explanatory example of the present embodiment, as shown in FIG. 6, the display range of the display image D21 defined by the display frame F2 is smaller than the display range of the set image D11. The set image D11 includes the non-display ranges R1 and R2. Therefore, a positive judgment is made in S210.

In S220, the CPU 11 determines the arrangement number M and the arrangement position of the display frame F2 on the set image D11 so that the display image including the image in the non-display range can be displayed on the touch panel 18. The arrangement number M is a natural number of 1 or more.

In the explanatory example of the present embodiment, as shown in FIG. 8, the arrangement position of the display frame F2a including the non-display range R1 and the arrangement position of the display frame F2b including the non-display range R2 are determined. Therefore, the number of arrangements M is determined to be "2".

In S225, the CPU 11 sets the count value K to "1". In S230, the CPU 11 moves the display frame to the K-th arrangement position corresponding to the count value K. As a result, the display image including the non-display range can be displayed on the touch panel 18. Then, the process proceeds to S240, and the CPU 11 acquires a screenshot image. As a result, it is possible to acquire a screenshot image including the hidden range. Then, the CPU 11 stores the screenshot data indicating the acquired screenshot image in the print application storage area 43.

In S250, the CPU 11 determines whether or not screenshot images have been acquired for all of the M display frames. The determination can be made based on whether or not the count value K is equal to the number of arrangements M. If a negative judgment is made (S250: NO), the process proceeds to S255. In S255, the CPU 11 counts up the count value K by one. Then, it returns to S230.

In the explanatory example of the present embodiment, when the count value K is "1", the display frame F2a is arranged on the setting image D11 of FIG. Then, as shown in FIG. 10, the screenshot image SS2 of the display image D21 cut out by the display frame F2a is acquired. Next, when the count value K is "2", the display frame F2b is arranged on the setting image D11 of FIG. Then, as shown in FIG. 11, the screenshot image SS3 of the display image D21 cut out by the display frame F2b is acquired. The screenshot image SS2 includes the non-display range R1. The screenshot image SS3 includes the non-display range R2.

On the other hand, if a positive judgment is made in S250 (S250: YES), the process proceeds to S260. In S260, the CPU 11 reads the comparison screen data from the print application storage area 43. In S270, the CPU 11 determines whether or not an error may have occurred. Specifically, the contents of the parts corresponding to each other are compared between the screenshot image acquired in S200 or S240 and the image indicated by the comparison screen data. Then, if there is a difference between the two images, it can be determined that an error may have occurred. When there is a difference between the two images, for example, an icon image that does not originally exist appears due to an error, the arrangement of the button images arranged in a row is disturbed, or a part of the image is partly For example, when it is pitch black. If a negative judgment is made in S270 (S270: NO), the process proceeds to S275. In S275, the CPU 11 sets the trigger generation flag to "off". Then, it returns to S110.

On the other hand, if a positive judgment is made in S270 (S270: YES), the process proceeds to S280. In S280, the CPU 11 reads the screenshot prohibited area information from the print application storage area 43. In S290, the CPU 11 specifies the screenshot prohibited area indicated by the screenshot prohibited area information in the screenshot image acquired in S200 or S240. Then, mosaic processing is performed on the specified screenshot prohibited area so that the contents cannot be recognized. Then proceed to S300.

In the explanatory example of the present embodiment, the case where the area in which the item images I1 and I2 are displayed in the setting image D11 of FIG. 6 is a screenshot prohibited area is described. Therefore, in the screenshot image SS2 shown in FIG. 10, the area where the item images I1 and I2 are displayed is specified as the screenshot prohibited area. Then, mosaic processing is performed on the item images I1 and I2.

In S300, the CPU 11 determines whether or not the size of the screenshot data acquired in S200 and S240 is larger than a predetermined size. If a negative judgment is made (S300: NO), the process proceeds to S320, and if a positive judgment is made (S300: YES), the process proceeds to S310.

In S310, the CPU 11 reduces the data size by trimming a part of the screenshot image. At this time, trimming may be performed so as to eliminate images unnecessary for error analysis. Images unnecessary for error analysis are preset. Then proceed to S320.

In the explanatory example of the present embodiment, in the screenshot images SS1 to SS3 shown in FIGS. 9 to 11, the areas R11 to R13, which are the right half areas displaying the actual set values, are trimmed. As a result, the area on the left half displaying the setting item name can be excluded. That is, it is possible to eliminate the image of the region unnecessary for error analysis.

In S320, the CPU 11 transmits the stored screenshot data to the web server 100. The web server 100 can perform error analysis and the like using the transmitted screenshot data. In S330, the CPU 11 sets the trigger generation flag to "off". Then, it returns to S110.

(effect)
In the case where the scroll display for cutting out a part of the set image D11 as the display image D21 is adopted, the display image D21 depends on the establishment of the screenshot acquisition condition (S420: YES, S430: YES, S460: NO). Screenshot image can be obtained (S200). Then, when the non-display ranges R1 and R2, which are the ranges other than the range cut out by the display image D21, exist in the display range of the set image D11, the screenshot images of the non-display ranges R1 and R2 are also acquired. Can be done (S240). This makes it possible to acquire the entire screenshot image of the display image D21.

The print application 21a can transmit the screenshot image data to the web server 100 (S320). This makes it possible for the web server 100 to perform error analysis and the like using the screenshot image data.

If there is a difference between the acquired screenshot image and the image shown by the comparison screen data (270: YES), it can be determined that an error may have occurred. Then, the screenshot image data can be transmitted to the web server 100 (S320). This makes it possible to send the screenshot image data only when there is a possibility that an error has occurred. Unnecessary data transmission can be suppressed.

When the data size of the acquired screenshot image is larger than the predetermined size (S300: YES), the data size can be reduced by trimming a part of the screenshot image (S310). This makes it possible to suppress the amount of communication data.

When an error occurs during execution of the print application 21a (S450: YES), a screenshot image can be acquired (S480). This makes it possible to acquire a screenshot image of the screen on which the error has occurred. It is possible to analyze the error content using the screenshot image.

When the log information is transmitted to the web server 100 (S430: YES), the screenshot image can be acquired (S480). This makes it possible to analyze the contents of the log information based on the screenshot image.

When shifting from the state in which the display image D21 cut out from the setting screen SC1 is displayed to the state in which the display image D21 cut out from another screen (example: main screen) is displayed (S420: YES). , Screenshot images can be obtained (S480). As shown in FIG. 7, various settings are displayed on the setting screen SC1. Therefore, the setting screen SC1 is a useful screen for analyzing the cause of the error occurrence. Therefore, when the setting screen SC1 is switched to another screen, if the screenshot screen of the setting screen SC1 is acquired and stored, a serious error occurs in the print application 21a later (S460: YES). The stored screenshot screen can be transmitted to the web server 100 (S470). This makes it possible to reliably perform error analysis.

When a screen with a high probability of error (eg, setting screen, editing result display screen) is displayed on the touch panel 18 (S190: YES), a screenshot image can be acquired (S200). This makes it possible to selectively acquire only screenshot images of screens that are useful for error analysis. It is possible to suppress the situation where an unnecessary screenshot image is acquired.

The process of cutting out a part of the non-display range as a display image and displaying it on the touch panel 18 (S230) and the process of acquiring a screenshot image (S240) are determined to have no non-display range (S250: YES). It can be repeated alternately until This makes it possible to automatically acquire a screenshot image of the hidden range.

Mosaic processing can be performed on the screenshot prohibited area included in the acquired screenshot image (S290). This makes it possible to prevent the leakage of personal information.

Although specific examples of the present invention have been described in detail above, these are merely examples and do not limit the scope of claims. The techniques described in the claims include various modifications and modifications of the specific examples illustrated above. Modifications of the above embodiment are listed below.

(Modification example)
In S200, a screenshot image including the start point of the scroll display may be acquired. This will be described in detail. In S200, the CPU 11 moves the display frame to a position including the first end portion P1 of FIG. 6 and acquires a screenshot image. As a result, a screenshot image including the item images I1 to I5 is acquired. Next, the CPU 11 moves the display frame to a position surrounding the item images I6 to I10 (S230). Then, a screenshot image including the item images I6 to I10 is acquired (S240). Finally, the CPU 11 moves the display frame to a position surrounding the item images I7 to I11 (S230). Then, a screenshot image including the item images I7 to I11 is acquired (S240). As a result, it is possible to acquire a continuous screenshot image from the start point to the end point of the scroll display. Therefore, the set image D11 can be reproduced by stitching the screenshot images in the order in which they were acquired.

It is also possible to prevent the leakage of personal information by not acquiring the screenshot image of the screenshot prohibited area. In this case, in the flow of FIG. 3, S280 may be moved in front of S220 and S290 may be erased. In S220, the arrangement position of the display frame may be determined so as to include the image in the non-display range and not to include the screenshot prohibited area. In the explanatory example of this modification, as shown in FIG. 12, the arrangement position of the display frame F2c is set so as to include a part of the non-display range R1 and not include the item images I1 and I2 which are screenshot prohibited areas. You just have to decide.

The process of performing the mosaic processing of S280 and S290 may be performed at any timing. For example, it may be performed at the timing before the execution of S260.

The method for reducing the data size of the screenshot data in S310 is not limited to trimming, and various methods can be used. For example, the screenshot image may be reduced. In addition, when there are a plurality of screenshot images, thinning may be performed.

The method of acquiring the comparison screen data in S260 and the method of acquiring the screenshot prohibited area information in S280 may be in various modes. For example, this information may be received from the web server 100.

In the present embodiment, the case where the setting screen based on the setting image D11 is displayed on the touch panel 18 has been described, but the present embodiment is not limited to this embodiment. The same applies to the case where the main screen based on the main image and the editing result display screen based on the editing result image are displayed on the touch panel 18.

The platform of the mobile phone 10 is not limited to iOS, and various platforms can be used. For example, Android (registered trademark of Google Inc.), Windows phone (registered trademark of Microsoft Corporation), and the like may be used.

The process of determining whether or not the screen has a high probability of an error (S170 to S195) can be omitted. The process of determining whether or not the non-display range is included (S210) can be omitted. In this case, the process may proceed from S200 to S220. The process of determining whether or not an error may have occurred (S260 to S275) can be omitted. The process of performing mosaic processing on the screenshot prohibited area (S280, S290) can be omitted. The process of reducing the data size (S300, S310) can be omitted. From the above, generally speaking, the printing application 21a carries a "first display process", a "first predetermined condition determination process", a "first acquisition process", and a "second acquisition process". Just let the phone 10 do it. As a specific example, the printing application 21a may cause the mobile phone 10 to execute at least S110, S140, S150, S200, and S240.

The mobile phone 10 may execute Wi-Fi wireless communication to communicate various information with the web server 100. Further, when the mobile phone 10 is connected to the Internet 70 by wire, the mobile phone 10 may execute wired communication to communicate with the web server 100. Generally speaking, it suffices if the mobile phone 10 and the web server 100 can communicate with each other.

The device on which the printing application 21a operates does not have to be the mobile phone 10, and may be a stationary PC or another device (for example, a television).

In each of the above embodiments, the CPU 11 of the mobile phone 10 executes the program in the storage unit 12, so that each process shown in FIGS. 2 to 5 is realized. Instead of this, at least one of the processes shown in FIGS. 2 to 5 may be realized by hardware such as a logic circuit.

In addition, the technical elements described in the present specification or the drawings exhibit technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the techniques illustrated in the present specification or drawings achieve a plurality of objectives at the same time, and achieving one of the objectives itself has technical usefulness.

The touch panel 18 is an example of a display unit. The mobile phone 10 is an example of an information processing device. The CPU 11 is an example of a computer. The print application 21a is an example of a program. The setting image D11 is an example of the first image. The display image D21 is an example of the second image. The CPU that executes S110 is an example of the first display process. The screenshot acquisition condition is an example of the first predetermined condition. The CPU that executes S140 and S150 is an example of the first predetermined condition determination process. The screenshot image is an example of a copy image. The CPU that executes S200 is an example of the first acquisition process. The CPU that executes S210 is an example of the display range determination process. The CPU that executes S240 is an example of the second acquisition process. The CPU that executes S320 is an example of the first transmission process. The CPU that executes S260 is an example of the first image acquisition means for comparison. The CPU that executes S270 is an example of comparison processing. The CPU that executes S300 is an example of the size determination process. The web server 100 is an example of a server. The mobile phone I / F20 and the wireless LAN_I / F22 are examples of communication interfaces. The CPU that executes S440 is an example of the second transmission process. The error information is an example of identification information. The CPU that executes S180: Y is an example of the receiving means. The CPU that executes S190 is an example of the image type determining means. The CPU that executes S230 is an example of the non-display range display process. The CPU that executes S240 is an example of the hidden range acquisition process. The screenshot prohibited area information is an example of the arrangement information. The CPU that executes S280 is an example of the arrangement information acquisition process. The CPU that executes S290 is an example of image processing processing.

1: Communication system, 10: Mobile phone, 11: CPU, 21a: Printing application, 21g: Operating system, D11: Setting image, D21: Display image, F2: Display frame, R1 and R2: Non-display range

Claims (14)

A program that can be read by a computer of an information processing device equipped with a display unit.
On the computer
This is a first display process in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display process for scrolling display by moving the position according to user input, and
The first predetermined condition judgment process for determining whether or not the first predetermined condition is satisfied, and
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
A display range determination process for determining whether or not the display range of the second image is smaller than the display range of the first image, and
When it is determined by the display range determination process that the display area of the second image is smaller than the display area of the first image, the second image of the display range of the first image is cut out. The second acquisition process of acquiring the copy image of the hidden range, which is a range other than the range, and
A program characterized by executing. A computer-readable program of an information processing device equipped with a display unit and a communication interface for executing communication with a server .
On the computer
This is a first display process in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display process for scrolling display by moving the position according to user input, and
The first predetermined condition judgment process for determining whether or not the first predetermined condition is satisfied, and
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
The second acquisition process of acquiring the copy image showing the non-display range which is a range other than the range cut out in the second image in the display range of the first image, and
The first transmission process of transmitting the copy image acquired by the first acquisition process and the second acquisition process to the server via the communication interface, and
A program characterized by executing. A comparison first image acquisition means for acquiring a comparison first image,
A comparison process for comparing the contents of the copy image acquired by the first acquisition process and the second acquisition process with a region corresponding to the copy image in the comparison first image.
To the computer further
The first transmission of transmitting the copy image to the server when it is determined by the comparison process that the contents of the copy image and the region corresponding to the copy image in the first image for comparison are different. The program according to claim 2 , wherein the process is executed. The computer is further subjected to a size determination process for determining whether or not the data size of the copy image acquired by the first acquisition process and the second acquisition process is larger than a predetermined size.
When it is determined by the size determination process that the data size of the copy image is larger than the predetermined size, the first transmission process of trimming a part of the copy image and transmitting it to the server is executed. The program according to claim 2 or 3 . The first predetermined condition determination process according to any one of claims 1 to 4 , wherein it is determined that the first predetermined condition is satisfied when an error occurs during the execution of the program. Program. A computer-readable program of an information processing device equipped with a display unit and a communication interface for executing communication with a server .
On the computer
This is a first display process in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display process for scrolling display by moving the position according to user input, and
A second transmission process of transmitting log information indicating various histories of the program to the server via the communication interface, and
A first predetermined condition determination processing for determining the first predetermined condition is satisfied when the second transmission process for transmitting the log information,
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
The second acquisition process of acquiring the copy image showing the non-display range which is a range other than the range cut out in the second image in the display range of the first image, and
A program characterized by executing. A program that can be read by a computer of an information processing device equipped with a display unit.
On the computer
A first display in which at least a part of a first image of any one type among a plurality of types exists is cut out as a second image, and the cut out second image is displayed on the display unit. The first display process, which performs scroll display by moving the position of the display frame of the second image on the first image in response to user input,
The first predetermined condition for determining that the first predetermined condition is satisfied when the first display process displays the second image cut out from the first image of the first specific type defined in advance on the display unit. Judgment processing and
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
The second acquisition process of acquiring the copy image showing the non-display range which is a range other than the range cut out in the second image in the display range of the first image, and
A program characterized by executing. The first image of the first specific type is a first image for setting showing the contents of various settings of the program.
In the first predetermined condition determination process, from a state in which the first display process displays the second image cut out from the first image for setting on the display unit, from another type of first image. The program according to claim 7 , wherein it is determined that the first predetermined condition is satisfied when the cut-out second image is displayed on the display unit. A computer-readable program of an information processing device equipped with a display unit and a communication interface for executing communication with a server .
On the computer
This is a first display process in which at least a part of a first image in which a plurality of types exist is cut out as a second image and the cut out second image is displayed on the display unit, and is a display frame of the second image. The first display process of performing scroll display by moving the position on the first image according to the user input.
A receiving means for receiving identification information indicating a specific type of first image from the server, and
The first predetermined condition judgment process for determining whether or not the first predetermined condition is satisfied, and
When it is determined by the first predetermined condition determination process that the first predetermined condition is satisfied, whether or not the type of the first image that is the basis of the second image is the specific type is determined. Image type determination means for determining based on identification information,
According to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied , the type of the first image that is the basis of the second image is the specific type. The first acquisition process of acquiring a copy image of the second image displayed on the display unit, provided that the image is determined by the type determination means ,
On the condition that the image type determining means determines that the type of the first image, which is the source of the second image, is the specific type, the second image in the display range of the first image The second acquisition process of acquiring the copy image of the hidden range, which is a range other than the cut out range, and
A program characterized by executing. A program that can be read by a computer of an information processing device equipped with a display unit.
On the computer
This is a first display process in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display process for scrolling display by moving the position according to user input, and
The first predetermined condition judgment process for determining whether or not the first predetermined condition is satisfied, and
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
The second acquisition process of acquiring the copy image showing the non-display range which is a range other than the range cut out in the second image in the display range of the first image, and
To execute ,
The second acquisition process is
By moving the display frame of the second image within the non-display range, a part of the non-display range is cut out as a second image and displayed on the display unit.
A non-display range acquisition process for acquiring a copy image of the second image displayed on the display unit by the non-display range display process, and a non-display range acquisition process.
Is equipped with
A program characterized in that the non-display range display process and the non-display range acquisition process are alternately and repeatedly executed until the non-display range disappears . The first image includes a first end portion that is a starting point of the scroll display.
The first acquisition process is characterized in that the copy image is acquired for the second image in which the position of the display frame on the first image is the position including the first end portion of the first image. The program according to claim 10 . A program that can be read by a computer of an information processing device equipped with a display unit.
On the computer
This is a first display process in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display process for scrolling display by moving the position according to user input, and
The first predetermined condition judgment process for determining whether or not the first predetermined condition is satisfied, and
The first acquisition process of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination process that the first predetermined condition is satisfied. When,
The second acquisition process of acquiring the copy image showing the non-display range which is a range other than the range cut out in the second image in the display range of the first image, and
The arrangement information acquisition process for acquiring the arrangement information indicating the arrangement position of the copy prohibited area included in the first image, and
In the copy image acquired by the first acquisition process and the second acquisition process, an image processing process for processing an area corresponding to the copy prohibited area indicated by the arrangement information so that the contents cannot be recognized, and an image processing process.
A program characterized by executing. An information processing device equipped with a display unit
It is a first display means for cutting out at least a part of the first image as a second image and displaying the cut out second image on the display unit, and is on the first image of the display frame of the second image. The first display means for scrolling display by moving the position according to user input, and
The first predetermined condition determination means for determining whether or not the first predetermined condition is satisfied, and
The first acquisition means for acquiring a copy image of the second image displayed on the display unit in response to the determination by the first predetermined condition determination means that the first predetermined condition is satisfied. When,
A display range determining means for determining whether or not the display range of the second image is smaller than the display range of the first image, and
When the display range determining means determines that the display area of the second image is smaller than the display area of the first image, the second image is cut out of the display range of the first image. A second acquisition means for acquiring the copy image of the hidden range, which is a range other than the range, and
An information processing device characterized by being equipped with. A control method for an information processing device equipped with a display unit.
This is a first display step in which at least a part of the first image is cut out as a second image and the cut out second image is displayed on the display unit, and the cut-out second image is displayed on the first image in the display frame of the second image. The first display step of scrolling display by moving the position according to user input, and
The first predetermined condition determination step for determining whether or not the first predetermined condition is satisfied, and
The first acquisition step of acquiring a copy image of the second image displayed on the display unit in response to the determination in the first predetermined condition determination step that the first predetermined condition is satisfied. When,
A display range determination step for determining whether or not the display range of the second image is smaller than the display range of the first image, and
When it is determined in the display range determination step that the display area of the second image is smaller than the display area of the first image, the second image of the display range of the first image is cut out. The second acquisition step of acquiring the copy image showing the hidden range which is a range other than the range, and
A control method for an information processing device, which comprises.

Images