JP2017016370A - Terminal, image determination system, image determination method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To acquire, for an existing application, specific process timing by comparison of display images without adding to increasingly complicated application code, and also present operation guide information with acquired timing when appropriate timing with which to provide operation guide information is acquired.SOLUTION: According to the present invention, a display image acquisition unit acquires the display image of a displayed existing application, and a synthesized image creation unit synthesizes a template image stored in a template image storage unit and the display image acquired by the display image acquisition unit and creates a synthesized image. An image comparison unit compares the display image acquired by the display image acquisition unit and the synthesized image created by the synthesized image creation unit, and when there is a synthesized image that completely matches the display image as compared by the image comparison unit, a control unit reads an operation guide image that corresponds to the template image that is the source of the synthesized image from an operation guide image storage unit, and displays the read operation guide image by superposition on the display image.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a terminal, an image determination system, an image determination method, and a program.

  For example, in a terminal where application activation or display / situation switching is performed for each user interaction using a touch panel display such as a smartphone, the shortcut position on the home screen is changed, for example, depending on the current terminal display state, The operation method changes variously, such as switching to a different application. In addition, recent terminals are premised on cooperation with cloud services, and operations for switching UI specifications are increasing every moment, such as new ID registration work, login work, and interactive UI operations on the web.

  For this reason, operations that are possible with conventional non-touch panel displays, for example, by referring to the description in the manual from the terminal standard start position such as the home screen, etc. Navigation has become difficult. In particular, since elderly people have many users who store the same operation method for a certain purpose, the above problem increases the difficulty of operating a smartphone. For such a problem, it is required to present an operation description (so-called help function) in the operation application, but it is difficult to presume a scene where the operation description should be presented, and a help function is added. Therefore, renovating the application is a significant cost increase for the developer.

  For these reasons, Patent Documents 1 to 3 devise ways to show the next operation method, display frequently executed applications, and provide a UI suitable for the operation level. In Patent Document 4, the operation flow can be visually confirmed. Furthermore, according to Patent Document 5, as a method for displaying a help function so as not to distract the user's attention excessively in an application interface generated by a main application, an operation guide screen that is transparent on the main application is overlaid. A method for presenting information has been proposed.

Japanese Patent No. 5302712 JP 2011-170672 A JP 2011-0666850 A Japanese Patent No. 5081934 Japanese Patent No. 477380

  However, in the techniques described in Patent Documents 1 to 3, it is possible to guide the operation until the purpose is achieved, but on the other hand, the user's operation proficiency is not increased, and the use satisfaction of the terminal is not necessarily increased. I can't. Moreover, when the prediction is wrong, the user who relies on guidance falls into a situation where it cannot be operated thereafter. In addition, there is a problem that the problem that it is necessary to introduce a function for explaining operations in the application cannot be solved.

  Further, the technique described in Patent Document 4 has a problem that the problem that the operation explanation function needs to be introduced into the application cannot be solved. Furthermore, in the technique described in Patent Document 5, the trigger for displaying the help requires various user operations. Therefore, if the user such as a beginner or senior is not sure what to do in the first place, it is necessary if necessary. There is a problem that starting help is difficult. Further, since the help display function is managed by the main application, it is necessary to add or modify the help function depending on the development of the main application, and there is a problem that correction from an external application is not considered.

  Therefore, the present invention has been made in view of the above-described problems, and obtains a specific processing timing by comparing display images without modifying a complicated application code for an existing application. With the goal. In addition, the present invention may present the operation guide information at the acquired timing when the appropriate timing for providing the operation guide information is acquired without modifying the complicated application code for the existing application. Objective.

  The present invention proposes the following items in order to solve the above-described problems.

  (1) The present invention is a template comprising display image acquisition means for acquiring a display image of an existing application being displayed, a fixed display portion in a plurality of existing application images, and a transparent pixel portion other than the fixed display portion. Template image storage means for storing images in advance, and composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means And an image comparison means for comparing the display image acquired by the display image acquisition means with the composite image created by the composite image creation means, and in the image comparison means, the display image and the A terminal characterized by determining whether or not a composite image completely matches is proposed.

  (2) In the present invention, for the terminal of (1), the composite image creation means combines the pixel of the template image corresponding to the fixed display portion and the pixel of the display image corresponding to the transparent pixel portion. We have proposed a terminal characterized by this.

  (3) The present invention proposes a terminal characterized in that, for the terminal of (1) or (2), the synthesized image is synthesized with the display image as a lower part and the template image as an upper part.

  (4) The present invention provides an operation guide image storage unit that stores an operation guide image corresponding to the template image and the display image in any one of the terminals of (1) to (3). The operation guide image corresponding to the template image that is the original of the composite image is read from the operation guide image storage means and the read operation guide is read into the display image There has been proposed a terminal characterized by further comprising display control means for displaying images superimposed.

  (5) In the present invention, for any one of the terminals (1) to (4), the display image acquisition unit periodically acquires the displayed display image when a specific existing application is activated. A terminal is proposed in which acquisition of the displayed display image is stopped when a specific existing application finishes starting.

  (6) The present invention is an image determination system that includes a terminal and a display device and presents an operation guide for a specific existing application, in which the terminal acquires a display image of the existing application being displayed. An acquisition unit; a template image storage unit that stores in advance a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion; and an operation guide image corresponding to the template image. An operation guide image storage means for storing; a composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means; The display image acquired by the display image acquisition means and the composition An image comparison unit that compares the composite image created by the image creation unit, and the composite image that completely matches the display image in the image comparison unit when there is the composite image from the operation guide image storage unit An image generation means for reading an operation guide image corresponding to the template image of the original image, and generating an image obtained by superimposing the read operation guide image on the display image; and Transmitting means for transmitting to a display device, wherein the display device comprises receiving means for receiving the superimposed image from the transmitting means of the terminal, and display means for displaying the received superimposed image. We have proposed an image determination system characterized by this.

  (7) The present invention is an image determination system that includes a terminal and a display device and presents an operation guide for a specific existing application, in which the terminal acquires a display image of the existing application being displayed. An acquisition unit; a template image storage unit that stores in advance a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion; and an operation guide image corresponding to the template image. An operation guide image storage means for storing; a composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means; The display image acquired by the display image acquisition means and the composition An image comparison unit that compares the composite image created by the image creation unit, and the composite image that completely matches the display image in the image comparison unit when there is the composite image from the operation guide image storage unit A transmission unit that reads an operation guide image corresponding to the template image of the image source and transmits the operation guide image to the display device, and the display device receives the template image of the composite image source from the transmission unit of the terminal. Providing an image determination system comprising: a receiving unit that receives an operation guide image corresponding to the image; and a display unit that displays an operation guide image corresponding to the received template image of the synthesized image doing.

  (8) The present invention provides a display image acquisition means, a template image storage means for preliminarily storing a template image composed of a fixed display portion and a transparent pixel portion other than the fixed display portion in a plurality of existing application images, and a composition An image determination method in a terminal comprising an image creation means and an image comparison means, wherein the display image obtaining means obtains a display image of an existing application being displayed, and the composite image creation A second step of creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means; and the image comparison means, The display image acquired by the display image acquisition means and the composite created by the composite image creation means By comparing the image, it has proposed an image determination method characterized by and a third step of determining whether said displayed image and the composite image is an exact match.

  (9) The present invention provides a display image acquisition means, a template image storage means for preliminarily storing a template image composed of a fixed display portion and a transparent pixel portion other than the fixed display portion in a plurality of existing application images, and a composition A program for causing a computer to execute an image determination method in a terminal including an image creation unit and an image comparison unit, wherein the display image acquisition unit acquires a display image of an existing application being displayed. And a second step in which the composite image creation means creates a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means. And the image comparison means includes the display image acquired by the display image acquisition means and the display image acquisition means. Proposing a program for causing a computer to execute a third step of comparing the composite image created by the composite image creation means and determining whether the display image and the composite image completely match each other. ing.

  According to the present invention, the determination to acquire the timing of the specific processing in accordance with the contents of the screen is performed by the complete match comparison of the image being displayed. Therefore, without modifying the existing application that has already been created, There is an effect that it does not impose a burden on the existing application being started. In addition, when an appropriate timing for providing the operation guide information is acquired without modifying the complicated application code for the existing application, there is an effect that the operation guide information can be presented at the acquired timing.

It is an apparatus block diagram concerning the 1st Embodiment of this invention. It is a figure which shows the various images which concern on the 1st Embodiment of this invention. It is a flowchart regarding the matching determination process of the display image and template image which concern on the 1st Embodiment of this invention. It is a processing flow figure concerning a 1st embodiment of the present invention. It is a system configuration figure concerning a 2nd embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the constituent elements in the following embodiments can be appropriately replaced with existing constituent elements or the like, and various variations including combinations with other existing constituent elements are possible. Accordingly, the description of the following embodiments does not limit the contents of the invention described in the claims.

<First Embodiment>
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS. 1 to 3.

<Terminal configuration>
As shown in FIG. 1, the terminal 100 according to the present embodiment includes a display image acquisition unit 110, a display memory 120, a template image storage unit 130, an operation guide image storage unit 140, and a composite image creation unit 150. , An image comparison unit 160, a display unit 170, and a control unit 180.

  The display image acquisition unit 110 acquires display image data (for example, screen capture S in FIG. 2A) of an existing application displayed on the screen. Here, the display image means a displayed image excluding the overlay image, but does not exclude processing including the currently displayed overlay image. Specifically, the display image acquisition unit 110 outputs a display image acquisition request signal to the control unit 180 and receives display image data from the control unit 180. At this time, the control unit 180 responds to the display image acquisition request signal from the display image acquisition unit 110 when the display image data having the latest time stamp from the display memory 120 or when time series management is performed. The latest display image data is acquired and output to the display image acquisition unit 110. More specifically, the control unit 180 performs control to acquire display image data using a screen capture function of the terminal. As another example, the control unit 180 may acquire display image data directly from the communication path. The display image acquisition unit 110 outputs a display image acquisition request signal to the control unit 180 at a predetermined timing.

  The display memory 120 temporarily stores display image data. The display image data is given a time stamp. Alternatively, the display memory 120 manages the data in time series using a storage area or the like. The template image storage unit 130 stores template image data (for example, the template image T in FIG. 2B) corresponding to a plurality of existing application images.

  Here, the template image is composed of a fixed display portion in the existing application image and a transparent pixel portion other than the fixed display portion. The operation guide image storage unit 140 stores an operation guide image corresponding to the template image (for example, the overlay image O in FIG. 2C). Here, the operation guide image is an image that displays auxiliary information for using the application. For example, the operation guide image is an image on which information input display, icon function explanation display, or the like is made. Further, the operation guide image has a transparent pixel portion as in the template image.

  Here, the transparent pixel means a pixel of the upper image set so that the pixel of the lower image (display image in this embodiment) can be seen through when the image is superimposed from the upper part to the lower part. Specifically, the opacity (alpha value) in the PNG (Portable Network Graphics) format and the transparent GIF (Graphics Interchange Format) format is 0% (the alpha value is 0 in the PNG format). Alternatively, a method (chroma key processing) in which a predetermined single color (blue background or the like) or color range (hue, saturation is within a certain numerical range, etc.) is considered as a transparent pixel is also conceivable.

  The composite image creation unit 150 creates a composite image by combining the template image stored in the template image storage unit 130 and the image acquired by the display image acquisition unit 110. In the composite image, the transparent pixel portion of the template image T is not overwritten on the screen capture S, and the pixels of the screen capture S remain as they are.

  The image comparison unit 160 compares the display image acquired by the display image acquisition unit 110 with the composite image created by the composite image creation unit 150. This comparison processing flow will be described below with reference to FIG.

  First, initialization is performed in which the matching flag is set to “False”, and Num (the number of template images assigned to each of the plurality stored in the template image storage unit 130) is set to “0” (step S1). After the initialization process, a display image is acquired (step S2).

  Next, it is determined whether or not there is a matching flag in the acquired display image (step S3). When the matching flag is “True”, it is determined that the display image matches with the display image in step S8. Then, it is determined whether or not the template image with the number Num matches (step S4). In step S4, since it is determined only whether the display image has been changed from the most recently matched template image, it is not necessary to compare the display image with a plurality of template images, and the processing efficiency is improved. A specific example of matching determination will be described later. As a result of the coincidence determination, when it is determined as coincidence, the overlay image is continuously displayed.

  On the other hand, if it is determined in step S4 that the images do not match, the overlay image currently displayed is deleted, the matching flag is set to “False” (step S5), and the process proceeds to step S11.

  If the match flag is “False” in step S3, the process proceeds to step S6. Steps S6 to S10 are steps for comparing whether the display image matches any of the stored template images. In step S6, the number Num indicating the current number is compared with the number of stored template images (step S6). If the value of Num is smaller than the number of stored template images, the template image corresponding to the current number Num. Is acquired (step S7), and it is determined whether or not the display image matches the template image (step S8). If it is determined as a result of the match determination, an overlay image is displayed, the matching flag is set to “True”, and the process proceeds to step S2 (step S9).

  On the other hand, if it is determined in step S8 that the result of coincidence is not coincident, the number of Num is incremented by 1 (step S10), and the process returns to step S6. In step S6, when the value of Num is larger than the number of stored template images, the process proceeds to step S11. In step S11, Num is cleared to “0”, and the process returns to step S2.

  A specific example of coincidence determination is shown below.

  First, each pixel of the screen capture (S) is S [x, y], each pixel of the template image (T) is T [x, y], and each pixel of the composite image (C) is C [x, y]. To do. However, x and y are integers indicating the coordinate position of the pixel.

At this time, each pixel of the composite image (C) is as follows.
C [x, y] = S [x, y] (if T [x, y] = transparent pixel value)
= T [x, y] (if T [x, y] ≠ transparent pixel value)
That is, at this time, when C [x, y] = S [x, y] is satisfied by all pixel values, T [x, y] is not equal to the transparent pixel value. [x, y] = S [x, y] is satisfied, which means that the screen capture (S) has the same screen as the template image (T).

  The actual software implementation can be realized by the following two processes.

"Generate composite image"
The image data of the template image T is superimposed on the image data of the screen capture S. Specifically, in a method of using a superimposing image processing command prepared in each OS, for example, android (registered trademark), the bitmap data is similarly displayed on the canvas depicting the image data of the screen capture S as the bitmap data. There is a method of adding a template image T prepared as follows.

“Image Match Comparison”
It is confirmed whether the image data of the generated composite image matches the image data of the screen capture S. Specifically, there is a method of using an image matching comparison command prepared in each OS, for example, a method of using a command “sameAs” for checking whether or not both bitmap data are the same in Android (registered trademark). is there.

The above processing contents are shown in a program as follows.
Bitmap S = screenshot (); # (get screen capture)
Bitmap C = S.copy (Bitmap.Config.ARGB — 8888, true); # (Prepare C that replicates S)
Canvas canvas = new Canvas (C); # (Prepare a canvas on which C (= S) is drawn)
canvas.drawBitmap (T, 0, 0, null); # (add T to C (= S))
If (C.sameAs (S)) {
# Match processing} else {
#Disagreement processing}
However, T is a bitmap prepared in advance that means a template image.

  In addition to the above method, if there is a relationship between the position of the coordinates of the pixel data and the position of the bit string when the image is viewed as a data string, a method of processing as a data string instead of as an image Is also desirable as a way to reduce further processing. A specific example of this method is shown below.

"Generate composite image"
A bit string indicating the template image T is added to the bit string indicating the screen capture S by a bit operation.

“Image Match Comparison”
It is determined whether or not the bit string C indicating the composite image and the bit string S indicating the screen capture S completely match.

The above processing contents are shown in a program as follows.
Byte [] S = screenshot (). ToByteArray (); # (Acquisition of screen capture, conversion to bit string)
Byte [] C; # (C prepared)
C = S | T; (bit OR operation)
If (C == S) {
# Match processing} else {
#Disagreement processing}
Here, T is a bit string indicating a template image prepared in advance.

  The display unit 170 is composed of, for example, a liquid crystal display and displays a display image of the application. The control unit 180 controls the operation and processing of the entire terminal by a program stored in advance. In the present embodiment, for example, when there is a composite image that completely matches the display image in the image comparison unit 160, the operation guide image corresponding to the template image of the composite image is read from the operation guide image storage unit 140. Then, control is performed to display the operation guide image read on the display screen in a superimposed manner (for example, the display in FIG. 2D). The display image acquisition unit 110 periodically acquires a displayed display image when a specific existing application is started, and stops acquiring the displayed display image when the specific existing application is started. Control to do.

<Terminal processing>
Processing of the terminal according to the present embodiment will be described using FIG.
First, the display image acquisition unit acquires a display image of the existing application being displayed (step S110). The display image is preferably acquired so as to acquire the original display image before the operation guide images described later are superimposed. The composite image creation unit 150 creates a composite image by combining the template image stored in the template image storage unit 130 and the image acquired by the display image acquisition unit 110 (step S120).

  The image comparison unit 160 compares the display image acquired by the display image acquisition unit 110 with the composite image created by the composite image creation unit 150 (step S130). Then, when there is a composite image that completely matches the display image in the image comparison unit 160, the control unit 180 reads the operation guide image corresponding to the template image of the composite image source from the operation guide image storage unit 140. Then, the operation guide image read out is superimposed and displayed on the display screen (step S140).

  The above-described operation guide display process is implemented as a function (overlay display (superimposed image display) switching function) for displaying characters, figures, and characters serving as operation guides by overlaying the current display screen, for example. It is also desirable. In this overlay display switching function, a corresponding overlay display is performed according to the coincidence determination in the screen comparison function. It is also preferable to delete the overlay display when they do not match.

  As described above, according to the present embodiment, the timing of information presentation can be obtained by comparing display screens without modifying a complicated application code for an existing application. Further, the comparison of the display screens is practical because it can be realized by light and simple “image overwriting” and “perfect match comparison”.

<Second Embodiment>
Hereinafter, a second embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 4, the image determination system according to the present embodiment includes a terminal 100 and a display device 200. The terminal 100 includes a display image acquisition unit 110, a display memory 120, a template image storage unit 130, and the like. The operation guide image storage unit 140, the composite image creation unit 150, the image comparison unit 160, the control unit 181, the image generation unit 191, and the transmission unit 192, and the display device 200 includes the reception unit 210. The display unit 220 and the control unit 230 are included. In addition, about the component which attaches | subjects the same code | symbol as 1st Embodiment, since it has the same function, the detailed description is abbreviate | omitted.

  The image generation unit 191 reads an operation guide image corresponding to the template image of the composite image source from the operation guide image storage unit 140 when the image comparison unit 160 has a composite image that completely matches the display image. An image in which the operation guide image read out on the display screen is superimposed is generated.

  The transmission unit 192 transmits the generated superimposed image to the display device 200. For example, when there is a composite image that completely matches the display image in the image comparison unit 160, the control unit 181 reads an operation guide image corresponding to the template image that is the composite image source from the operation guide image storage unit 140. Then, control is performed so as to generate an image in which the operation guide images read on the display screen are superimposed, and to transmit the generated superimposed image to the display device 200.

  The reception unit 210 of the display device 200 receives the superimposed image from the transmission unit 192 of the terminal. The display unit 220 displays the received superimposed image. For example, the control unit 230 receives a superimposed image and performs control to display the received superimposed image. In addition, the receiving unit 210 receives an operation guide image corresponding to the template image of the synthesized image source from the transmitting unit 192 of the terminal 100. The display unit 220 displays the received operation guide image. For example, the control unit 230 receives an operation guide image and performs display control of the received operation guide image.

  Note that display image acquisition (screen capture) may function when a process currently in operation on the terminal is confirmed and a predetermined process (package name) exists. Further, it may be determined whether the display image acquisition (screen capture) functions depending on the start source (for example, a home application or a dedicated application) of the target application. For example, overlaying (overlay) may not be performed for normal activation, and overlaying (overlay) may be performed for activation from a specific mode such as an application that does not require a manual.

  The display image acquisition (screen capture) may be a help button, and may function by pressing a specific hardware button on the terminal or a software button in the terminal screen. In addition, when there is no comparison target in the displayed content, a series of functions starting from acquisition of the display image is not executed, the help button is not displayed, or the help button is disabled (for example, the button is gray scaled) You may make it do.

  Further, instead of the superimposed image, an explanation voice corresponding to the template image may be prepared, and the manipulation guide display may reproduce the explanation of the manipulation method by voice. Further, instead of the superimposed image (overlay image), an operation explanation moving image corresponding to the template image may be prepared, and the operation guide display may reproduce the operation explanation moving image. Also, a moving image such as an image with an animation may be displayed as a superimposed image (overlay image). Further, when the display image and the template image coincide with each other, the log may be used for improving the function of the application by transmitting it to the server and storing it as an application usage status log.

  In the image determination system, the terminal may have a communication function to the outside, and may acquire a template image and corresponding operation guide information from the outside. The acquisition timing of the template image and the corresponding operation guide information may be when a predetermined application is activated or at a regular timing. Further, it may be when a predetermined application is updated. In the image determination system, the display device may hold a set of template images and overlay images for each application, and may have a function of adding and updating an image set. Further, based on the determination, the display in the application may be erased, or an operation such as installation or purchase button pressing may not be performed. For example, an image inappropriate for display may not be shown, or purchase may be prevented.

  In the present embodiment, the process for determining whether or not the display image and the composite image completely match may be applied to the following technique. For example, when a user browses an online shopping site on a mobile terminal and purchases a product, when the user presses a “Purchase” button, a “settlement processing mark” previously determined by a communication company and a service provider is displayed. When this mark matches the template image, it is switched to offline screen transition by the match determination process, and screen transition such as a settlement amount confirmation screen and a credit card number entry screen necessary for settlement processing is performed. Good. Alternatively, an image mark specific to a phishing site may be registered as a template image, and if they match, the phishing site may be forcibly shifted to a safe page.

  The terminal and the image determination system of the present invention are recorded by recording the processing of the terminal and the image determination system on a recording medium readable by the computer system, causing the terminal and the image determination system recorded on the recording medium to read and execute the processing. Can be realized. The computer system here includes an OS and hardware such as peripheral devices.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW (World Wide Web) system is used. The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to the above embodiments, and includes a design and the like within a scope not departing from the gist of the present invention. .

DESCRIPTION OF SYMBOLS 100; Terminal 110; Display image acquisition part 120; Display memory 130; Template image storage part 140; Operation guide image storage part 150; Composite image creation part 160; Image comparison part 170; Display part 180; Control part 181; 191; Image generation unit 192; Transmission unit 200; Display device 210; Reception unit 220; Display unit 230;

Claims (9)

Display image acquisition means for acquiring a display image of an existing application being displayed;
Template image storage means for storing in advance a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion;
Composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means;
Image comparison means for comparing the display image acquired in the display image acquisition means with the composite image created in the composite image creation means;
With
In the image comparison means, it is determined whether or not the display image and the composite image completely match.   The terminal according to claim 1, wherein the synthesized image creating unit synthesizes the pixel of the template image corresponding to the fixed display portion and the pixel of the display image corresponding to the transparent pixel portion.   The terminal according to claim 1, wherein the synthesized image is synthesized with the display image as a lower part and the template image as an upper part. Operation guide image storage means for storing an operation guide image corresponding to the template image;
In the image comparison means, when there is the composite image that completely matches the display image, the operation guide image corresponding to the template image of the composite image source is read from the operation guide image storage means, and the display Display control means for superimposing and displaying the read operation guide image on an image;
The terminal according to any one of claims 1 to 3, further comprising:   The display image acquisition means periodically acquires the displayed display image when a specific existing application is started, and stops acquiring the displayed display image when the specific existing application is started. The terminal according to any one of claims 1 to 4, wherein: An image determination system that includes a terminal and a display device and presents an operation guide for a specific existing application,
The terminal is
Display image acquisition means for acquiring a display image of an existing application being displayed;
Template image storage means for storing in advance a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion;
Operation guide image storage means for storing an operation guide image corresponding to the template image;
Composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means;
Image comparison means for comparing the display image acquired in the display image acquisition means with the composite image created in the composite image creation means;
In the image comparison means, when there is the composite image that completely matches the display image, the operation guide image corresponding to the template image of the composite image source is read from the operation guide image storage means, and the display Image generating means for generating an image in which the read operation guide image is superimposed on an image;
Transmitting means for transmitting the generated superimposed image to the display device;
With
The display device
Receiving means for receiving the superimposed image from the transmitting means of the terminal;
Display means for displaying the received superimposed image;
An image determination system comprising: An image determination system that includes a terminal and a display device and presents an operation guide for a specific existing application,
The terminal is
Display image acquisition means for acquiring a display image of an existing application being displayed;
Template image storage means for storing in advance a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion;
Operation guide image storage means for storing an operation guide image corresponding to the template image;
Composite image creation means for creating a composite image by combining the template image stored in the template image storage means and the display image acquired by the display image acquisition means;
Image comparison means for comparing the display image acquired in the display image acquisition means with the composite image created in the composite image creation means;
In the image comparison means, when there is the composite image that completely matches the display image, the operation guide image corresponding to the template image of the composite image source is read from the operation guide image storage means, and the display Transmitting means for transmitting to the device;
With
The display device
Receiving means for receiving an operation guide image corresponding to the template image of the synthesized image source from the transmitting means of the terminal;
Display means for displaying an operation guide image corresponding to the received template image of the composite image;
An image determination system comprising: Display image acquisition means, template image storage means for preliminarily storing a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion, a composite image creation means, and an image comparison An image determination method in a terminal comprising means,
A first step in which the display image acquisition means acquires a display image of an existing application being displayed;
A second step in which the synthesized image creating means creates a synthesized image by synthesizing the template image stored in the template image storing means and the display image acquired by the display image acquiring means;
The image comparison unit compares the display image acquired by the display image acquisition unit with the composite image generated by the composite image generation unit, and whether the display image and the composite image completely match each other A third step of determining
An image determination method comprising: Display image acquisition means, template image storage means for preliminarily storing a template image composed of a fixed display portion in a plurality of existing application images and a transparent pixel portion other than the fixed display portion, a composite image creation means, and an image comparison A program for causing a computer to execute an image determination method in a terminal comprising means,
A first step in which the display image acquisition means acquires a display image of an existing application being displayed;
A second step in which the synthesized image creating means creates a synthesized image by synthesizing the template image stored in the template image storing means and the display image acquired by the display image acquiring means;
The image comparison unit compares the display image acquired by the display image acquisition unit with the composite image generated by the composite image generation unit, and whether the display image and the composite image completely match each other A third step of determining
A program that causes a computer to execute.