JP2018025941A - Terminal apparatus, display program and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of identifying a content displayed in an area between transparent windows overlapped with each other.SOLUTION: The terminal apparatus includes: a display unit that displays at least two windows; and a processing part that changes one of the at least two windows displayed on the display unit superimposed over the other window transmitted therethrough. When copying a piece of data specified in one window in a predetermined area on the superimposed window, the processing part changes the display mode of one window or both window.SELECTED DRAWING: Figure 12

Description

  The present invention relates to a terminal device, a display program, and a display method.

With the recent development of Information and Communication Technology (ICT), information processing devices (hereinafter also referred to as terminal devices) having a multi-window function have become widespread. Examples of such a terminal device include a smartphone, a personal computer (PC), a notebook PC, a tablet PC, and a personal data assistance (PDA). In a terminal device having a multi-window function, data can be moved and copied between a plurality of windows displayed on a display device such as a liquid crystal display (LCD).

  In the terminal device, there are cases where data is moved / copied between windows while the copy source and copy destination windows are overlapped. For example, in a school class or the like, class data (for example, a board) transmitted from the teacher side is displayed on one window of the terminal device used by the student, and the student's notebook is displayed on another window. It is a form to use.

  For example, the student superimposes a window displayed on the front side (uppermost layer) on a window displayed on the rear side (lower layer than the uppermost layer). Then, the student designates the copy source data area in the window displayed on the front side, and copies the designated data area to the overlapped portion of the back side window. In the terminal device, for example, the data area of the lesson designated in the window displayed on the front side can be copied to the area in the window that becomes the student's notebook displayed on the back side. By the above operation, it is possible to save the trouble of switching the copy source window and the copy destination window when moving / copying data between windows.

  Note that the movement and copying of data between windows in a terminal device is disclosed in the following prior art documents as a cut-and-paste technique.

JP 2000-20208 A

  However, when data is described in both windows, it is difficult to align the copy source data area displayed in the front window with the copy destination area in the back window. There is. Similarly, it may be difficult to align the copy source data area displayed in the rear window with the copy destination area in the front window.

  For both windows in which data is described, for example, when the front side is overlapped in a transparent state, the data described in each window is not visually recognized by the operator who performs the data movement / copy operation. Will interfere.

For example, data described in both windows is a character string. In the area between windows superimposed in a transparent state, the character string displayed in the area is the character string of the front window, or the character string of the back window that has passed through the blank area of the front window There is a case where it cannot be distinguished. This makes it difficult to align the copy source data area and the copy destination area to which the data area is copied / moved in the area between the windows superimposed in a transparent state.

In one aspect, an object of the present invention is to provide a technique capable of identifying contents displayed in a region between windows superimposed in a transparent state.

  The above technique can be exemplified by the following configuration of the terminal device. In other words, the terminal device has a display unit that displays at least two windows, and one of the at least two windows displayed on the display unit is transparently superimposed on the other window. And a processing unit that changes a display form in one window or the other window when the designated data is copied to a predetermined area on the superimposed window side.

  In one aspect, it is possible to provide a technique capable of identifying the content displayed in the area between windows superimposed in a transparent state.

It is a figure which shows an example of the hardware constitutions of the terminal device of this embodiment. It is a figure which shows an example of the window screen displayed on a terminal device. It is a figure which shows the comparative example of the window screen superimposed on the permeation | transmission state. It is a figure which shows the other comparative example of the window screen superimposed on the permeation | transmission state. It is a figure which shows the example of a setting of RGB value in the case of changing a background color and a character color. 6 is a diagram illustrating an example of changing a background color and a character color of a window screen in case 1. FIG. It is a figure which shows the example of a change of the window screen of case 2 corresponding to FIG. It is a figure which shows the example of a change of the window screen of case 2 corresponding to FIG. It is a figure which shows the example of a change of the window screen by the underline modification of case 3 corresponding to FIG. It is a figure which shows the example of a change of the window screen by the underline modification of case 3 corresponding to FIG. It is a figure which shows the example of a change of the window screen by the font and display thickness of case 4. FIG. 7 is a flowchart illustrating a display mode change process shown in Case 1. 10 is a flowchart illustrating a display mode change process shown in Case 2; 10 is a flowchart illustrating a display mode change process shown in Case 3. 10 is a flowchart illustrating display mode change processing shown in Case 4;

  Hereinafter, a terminal device according to an embodiment will be described with reference to the drawings. The configuration of the following embodiment is an exemplification, and the terminal device is not limited to the configuration of the following embodiment. Hereinafter, the terminal device according to the present embodiment will be described with reference to FIGS. 1 to 15.

<Embodiment>
FIG. 1 illustrates an example of a hardware configuration of the terminal device according to the present embodiment. A terminal apparatus 10 illustrated in FIG. 1 is an information processing apparatus having a multi-window function. Examples of the information processing apparatus having a multi-window function include a PC, a notebook PC, and a tablet PC. However, if the terminal device 10 is a device having a multi-window function, a smartphone, P
DA, a game machine, etc. may be sufficient. In the terminal device 10 having the multi-window function, data such as a character string can be moved / copied between a plurality of windows displayed on the display device such as the LCD 15a. Here, the “LCD 15a” of the terminal device 10 is an example of a “display unit”.

  For example, as a usage form of the terminal device 10, it is assumed that a teacher and a student each use the terminal device 10 to advance a class in an educational facility such as a school. On the terminal device 10 used on the student side, electronic materials distributed from the teacher side to the student side are displayed as a window screen. In addition, on the terminal device 10 used on the student side, a notebook (electronic note) used on the student side is displayed as a window screen. Each student, for example, describes the contents of the lesson on the note window screen while referring to the electronic material window screen displayed on the terminal device 10. Writing to the window screen to be a notebook is performed through an input device such as the touch pen 14a, for example. The electronic material distributed to the student-side terminal device 10 may include, for example, a captured image of a blackboard photographed by a video camera or the like. On the student side terminal device 10, the lesson content written on the blackboard with chalk or the like as the lesson progresses is displayed as a window screen.

  FIGS. 2A and 2B illustrate examples of window screens displayed on the student-side terminal device 10. FIG. 2A shows an example of a screen of electronic materials distributed from the teacher side to the student side in a class such as a school. FIG. 2 (2) is an example of a notebook screen used by the student in the class.

  In the screen example of FIG. 2A, for example, the display color of the hatched area Z1 on the window screen is black or dark green, and a character / character string such as “aiueo” described with the area Z1 as the background color The display color of is white. In the screen example of FIG. 2B, for example, the display color of the area Z2 on the window screen is white, and the display color of characters / character strings such as “ABCDEFG” described with the area Z2 as the background color Is black. On the display device (LCD 15a) of the terminal device 10 on the student side, the window screens of FIGS. 2 (1) and 2 (2) in which data such as character strings are described are displayed in parallel.

  It is assumed that an operation of copying / moving data such as a character string between windows displayed in parallel on the terminal device 10 is performed in a state where the windows are overlapped. In addition, among the overlapped windows, the window on the front side is in a transparent state. On the LCD 15a and the like of the terminal device 10, the character string of the front-side window is displayed together with the character string of the rear-side window that is transmitted through the front-side window.

  FIG. 3 illustrates a comparative example of window screens superimposed in a transparent state. FIG. 3 shows a screen example when the window screen of FIG. 2 (1) is on the back side and the window screen of FIG. 2 (2) is on the front side. As shown in FIG. 3, in the transparent state, the background color (area Z1) of the back side window screen (hereinafter also referred to as the back side window) is the character of the front side window screen (hereinafter also referred to as the front side window). It will overlap the color.

  In the state shown in FIG. 3, for example, the character portion of “DEFG” in the character string “ABCDEFG” of FIG. 2 (2) overlaps the background color of FIG. 2 (1). Since the background color (dark green) of the transparent rear window and the text color (black) of the front window are approximate colors, when displayed on the screen in the state shown in FIG. 3, the characters of the front window are displayed. It becomes difficult to identify columns and the like.

In the state shown in FIG. 3, when the background color of the transparent back window and the text color of the front window are the same color (black), the transparent background color and the text color of the front window are assimilated. Displayed on the screen. When displayed in an assimilated state, the position and contents of the character string and the like displayed on the front side window are not visually recognized. For example, the character part of “DEFG” in the character string “ABCDEFG” shown in FIG. 2 (2) is assimilated to the background color of the transparent back side window and becomes indistinguishable. In addition, the interference regarding the display color between the windows superimposed in the above-described transparent state may also occur between character strings described on the respective window screens.

  FIG. 4 illustrates another comparative example of a window screen superimposed in a transparent state. The rear side window and the front side window shown in FIG. 4 are the same as those in FIG. However, the background color shown in the area Z1 in FIG. 2 (1) is white, and the display color of the written characters and character strings such as “Aiueo” is black or a color similar to black (for example, dark green). is there. As shown in FIG. 4, in the transparent state, a character color such as a character string described in the back window overlaps with a character color described in the front window.

  For example, in a region Z3 surrounded by a broken-line rectangular frame in FIG. 4, the character string “Aiueo” in FIG. 2A and the character string “ABCDEFG” in FIG. Since the character color of the back side window (for example, dark green) transmitted through the front side and the character color of the front side window (black) are approximate colors, the characters described in each window on the display screen It becomes difficult to identify the column.

  Furthermore, when the character color of the back side window and the character color of the front side window are the same color, the overlapping part of the character strings is displayed assimilated, so the description contents described in each character string are displayed. Discrimination becomes difficult. For example, the character portion of “ABC” in the character string “ABCDEFG” shown in FIG. 2 (2) is assimilated to the character portion of “Iueo” in the character string “Aiueo” shown in FIG. 2 (1). Therefore, the description content is not visually recognized.

(Process of this embodiment)
Returning to FIG. 1, the terminal device 10 according to the present embodiment manages display positions and display contents of a plurality of windows displayed on the LCD 15 a and the like. And when the overlap occurs in the display position between the displayed windows, the terminal device 10 according to the present embodiment changes the display mode (form) in any of the superimposed windows. By changing the display mode, in the terminal device 10, whether the display content visually recognized in the overlapped partial area is the content of the front-side window or the content of the back-side window displayed through the front-side window. It becomes possible to identify. According to the terminal device 10 of the present embodiment, display contents between windows superimposed in a transparent state can be identified.

  As a change in the display mode in the window, for example, the terminal device 10 changes the background color in the overlapping window and the display color type of the object (character) displayed in combination with the background color to different types. (Case 1). In addition, for example, the terminal device 10 displays one of the overlapping windows in a blurred state such as through the ground glass (case 2). Further, the terminal device 10 may perform underline modification on a character string or the like displayed in one of the overlapping windows (case 3). Furthermore, the terminal device 10 may change a font such as a character string or a font displayed in one of the overlapping windows (case 4).

  Regarding the change of the display mode in (Case 2), for example, in the data copy source window, the operator who operates the terminal device 10 (hereinafter also referred to as a user) clearly sees the content to be copied and the display position. Therefore, it is preferable to maintain the display mode of the copy source. Further, in the copy destination window, it is only necessary that the user of the terminal device 10 can visually recognize a blank area for inserting copy source data.

〔Device configuration〕
A terminal device 10 illustrated in FIG. 1 includes a central processing unit (CPU) 11, a main storage unit 12, an auxiliary storage unit 13, an input unit 14, an output unit 15, which are connected to each other via a connection bus B 1.
A communication unit 16 is included. The main storage unit 12 and the auxiliary storage unit 13 are recording media that can be read by the terminal device 10.

  The CPU 11 is also called a microprocessor (MPU) or a processor. However, the CPU is not limited to a single processor and may have a multiprocessor configuration. A single CPU connected by a single socket may have a multi-core configuration.

  In the terminal device 10, the CPU 11 expands the program stored in the auxiliary storage unit 13 to be executable in the work area of the main storage unit 12, and controls peripheral devices through the execution of the program. Thereby, the terminal device 10 can execute a process that matches a predetermined purpose.

  The CPU 11 is a central processing unit that controls the entire terminal device 10. The CPU 11 performs processing according to a program stored in the auxiliary storage unit 13. The main storage unit 12 is a storage medium in which the CPU 11 caches programs and data and expands a work area. The main storage unit 12 includes, for example, a flash memory, a random access memory (RAM), and a read only memory (ROM).

  The auxiliary storage unit 13 stores various programs and various data in a recording medium in a readable and writable manner. The auxiliary storage unit 13 is also called an external storage device. The auxiliary storage unit 13 stores, for example, an operating system (OS) corresponding to the multi-window function, various programs, various tables, and the like. The OS includes, for example, a communication interface program that exchanges data with an external device or the like connected via the communication unit 16. Examples of the external device include an information processing device such as a PC or server on a network (not shown), another terminal device 10, an external storage device, and the like. Examples of the network include a public network such as the Internet, a wired network such as a local area network (LAN), a wireless network such as a mobile phone network and a wireless LAN.

The auxiliary storage unit 13 is, for example, an Erasable Programmable ROM (EPROM), a solid state drive device, a hard disk drive (HDD, Hard Disk Drive) device, or the like. In addition, as the auxiliary storage unit 13, for example, a Compact Disc (CD) drive device, a Digital Versatile Disc (DVD) drive device, a Blu-ray (registered trademark) Disc (BD) drive device, and the like can be presented. Examples of the recording medium include a silicon disk including a nonvolatile semiconductor memory (flash memory), a hard disk, a CD, a DVD, a BD, a universal serial bus (USB) memory, and a secure digital (SD) memory card.

  The input unit 14 receives an operation instruction from the user. The input unit 14 is an input device such as a touch pen 14a, an input button, a pointing device, or a microphone. The input unit 14 may include input devices such as a keyboard and a wireless remote controller. Examples of the pointing device include a touch panel, a mouse, a trackball, and a joystick.

The output unit 15 outputs data and information processed by the CPU 11 and data and information stored in the main storage unit 12 and the auxiliary storage unit 13. The output unit 15 includes, for example, an LCD 15a, Plasma
Display devices such as a display panel (PDP), an electroluminescence (EL) panel, and an organic EL panel are included. The output unit 15 may include an output device such as a printer or a speaker. The communication unit 16 is an interface with, for example, a network connected to the terminal device 10.

  In the terminal device 10, the CPU 11 reads out the OS, various programs, and various data stored in the auxiliary storage unit 13 to the main storage unit 12 and executes them, so that the processing of each processing unit illustrated in FIG. Provide functionality. The terminal device 10 provides functions of the display screen management unit 101 and the image processing unit 102 along with the execution of the target program. The terminal device 10 includes an auxiliary storage unit 13 as a storage destination of data to be referred to or managed by each of the above processing units. Here, each processing unit provided by executing the target program of the CPU 11 is an example of a “processing unit”.

However, at least a part of the processing of each of the processing units is a digital signal processor (DSP), an application specific integrated circuit (ASIC), a graphics processing unit (
GPU) or the like. In addition, at least a part of each of the processing units may be a dedicated large scale integration (LSI) such as a field-programmable gate array (FPGA), a numerical processor, a vector processor, an image processor, or other digital circuit. . In addition, an analog circuit may be included in at least a part of each processing unit.

[Configuration of processing section]
The display screen management unit 101 illustrated in FIG. 1 manages the display position of the window displayed on the LCD 15a or the like in association with information for identifying the window. The display position of the window screen displayed on the LCD 15a or the like is, for example, Application Programming Interface (API)
Via the OS. The display position of the window screen on the LCD 15a or the like is, for example, (X, Y) two-dimensional coordinates with the upper left corner of the display device as the origin, the left and right directions of the display device as the X axis, and the vertical direction as the Y axis. Can be represented.

  Further, the display screen management unit 101 determines the overlap of the display positions between the windows based on the acquired display position of the window screen. The display screen management unit 101 notifies the image processing unit 102 of the determination result when the display positions of the windows displayed on the LCD 15a and the like overlap. In addition, the display screen management unit 101 notifies the image processing unit 102 of the management information of the window for which the display position overlap is determined.

  Based on the window management information delivered from the display screen management unit 101, the image processing unit 102 acquires drawing information of each window that has been determined to overlap. For example, the drawing information is acquired from a predetermined area of the main storage unit 12 in which the drawing information of the window screen is stored. Note that the storage position of the drawing information on the window screen is acquired from the OS via the API, for example. The image processing unit 102 temporarily stores the acquired drawing information of the window screen in a predetermined area of the main storage unit 12.

  The image processing unit 102 changes the display mode in any of the superimposed windows based on the acquired drawing information of the window screen. The image processing unit 102 changes (Case 1) to (Case 4) for the display mode in any of the superimposed windows. Hereinafter, with reference to the drawings, description will be given of changes in display modes for (Case 1) to (Case 4). Note that the window screen examples illustrated in FIGS. 2A and 2B are used as explanatory examples.

(Case 1)
In Case 1, the image processing unit 102 changes the background color in the overlapping window and the display color type of the object displayed in combination with the background color to different types. The object displayed in combination with the scenery may include, for example, a line drawing. Hereinafter, the object displayed in combination with the background color will be described as a character / character string described in the window screen.

  For example, the image processing unit 102 acquires RGB values from the drawing information of the electronic material illustrated in FIG. Then, the image processing unit 102 specifies the RGB value having the highest appearance frequency (usage frequency) in the acquired RGB values as the background color and the other RGB values as the character color. This is because when the blackboard used in the class is photographed with a video camera or the like, the appearance frequency of the RGB value representing the ground color of the blackboard on which the character is described is the highest.

  The same applies to the note shown in FIG. However, the notebook used by the student is an electronic notebook. For this reason, in the window for displaying an electronic note, a background color, a character color, or an initial value is designated by a user setting. For example, the image processing unit 102 may acquire specified values (RGB values) of the background color and character color of a window used as a note via the OS.

  For example, the image processing unit 102 changes the RGB values of the background color and the character color acquired from the drawing information of each window to, for example, RGB values corresponding to the display color set in advance by the user. The image processing unit 102 outputs the drawing information of each window whose RGB value has been changed to a display device such as the LCD 15a. On the LCD 15a or the like of the terminal device 10, a window of background color and character color corresponding to the changed RGB value is superimposed and displayed.

  However, for example, the image processing unit 102 may maintain the background color and character color on the window side for displaying the distributed electronic material, and may change the background color and character color on the window side used as a notebook. By maintaining the background color and character color on the window side that displays the distributed electronic material, the user can continue to visually recognize the description content that is the copy source. In the terminal device 10, it is possible to reduce the amount of processing related to the RGB value change.

  FIG. 5 illustrates an example of setting RGB values in the table Tb1 when changing the background color and character color on the window side used as a note. In the table Tb1, information about the RGB color values of each window, the RGB acquired values of the background colors, the changing method, and the changed RGB values are represented as records. In the table Tb1, “window 1” represents a window used as a note, and “window 2” represents a window in which an electronic material (blackboard) is displayed.

  In the setting example illustrated in FIG. 5, the image processing unit 102 sets the background color on the window side used as a note to a transparent state. Then, the image processing unit 102 changes the character color on the window side used as a note to an inverted color obtained by inverting the background color on the window side on which the electronic material is displayed. In the setting example shown in FIG. 5, the RGB value of the character color acquired from the note window side is “25:25:25”. Further, the RGB value of the background color acquired from the window side of the electronic material is “41:51:21”. The image processing unit 102 changes the RGB value of the character color on the window side used as a note to “214: 204: 234” obtained by inverting the RGB value of the background color on the window side of the electronic material. Note that the RGB value of the character color on the window side used as a note may be changed to an RGB value having a long relative distance on the color coordinates indicated by the RGB value of the background color on the window side of the electronic document, for example.

In the setting example shown in FIG. 5, the RGB value of the background color on the window side where the electronic material is displayed is changed to “44:82:60”. This change is a color adjustment for easily identifying the character color after the display color change on the window side used as a note. Such color adjustment, for example, allows a plurality of subjects to evaluate the ease of visual recognition for a combination of a character color and a background color experimentally. Then, for example, an adjustment amount may be determined in advance based on statistical processing of evaluation results aggregated from a plurality of subjects. Further, for color adjustment, for example, the brightness and saturation of each of the combinations of the background color and the character color may be changed. When color adjustment is performed, an improvement in relative discrimination is expected as compared with a case where a reverse color of a background color is simply combined as a character color.

  FIG. 6 illustrates an example of changing the background color and character color of the window screen in case 1. The screen example of FIG. 6 is an example in which the background color and the character color of the window screen are changed in accordance with the setting example shown in FIG. In FIG. 6, a window screen Z4 is a window screen on which the electronic material illustrated in FIG. 2 (1) is displayed. Moreover, the window screen Z5 of FIG. 6 is a window screen used as a note illustrated in FIG.

  In FIG. 6, the window screen Z5 is a front-side window screen that is superimposed on the window screen Z4 displayed on the back side. As shown in the “background of window 1” record in the table Tb1 of FIG. 5, the background color of the front window screen Z5 is subjected to a transparent process. For this reason, on the display device such as the LCD 15a, the background color and the character color in the back side window screen Z4 are displayed through the overlapping window screen Z5.

  Further, the character color of the window screen Z5 displayed on the front side is changed to a reverse color with respect to the background color of the window screen Z4 displayed through the front side and displayed. For this reason, the user of the terminal device 10 visually recognizes a character string or the like in the back-side window screen Z4 displayed through the front-side window screen Z5, and also describes a character string or the like described in the window screen Z5. Can be clearly recognized.

  For example, in FIG. 6, the character portion “Iueo” of the character string “Aiueo” described on the window screen Z4 on the back side and “ABCD” of the character string “ABCDEFG” described on the window screen Z5 on the front side. "" Are displayed overlapping each other. However, even in the overlapped state, the display position of the character string “Aiueo” described in the rear-side window screen Z4 displayed through the front-side window screen Z5 can be recognized by visual recognition. In addition, it is possible to infer the contents such as character strings described in the front window screen Z5 and the rear window screen Z4.

  Note that the image processing unit 102 may change the display colors of the background color and the character color only in the overlapping partial area between the overlapping windows. As the display color change, for example, an RGB value obtained by adding the RGB value of the background color of the back window and the RGB value of the character color described in the front window is calculated, and the calculated RGB value is calculated. It may be used to change the character color on the front side. It is only necessary to be able to identify the contents such as character strings described in overlapping partial areas between overlapping windows, the display position, and the like.

(Case 2)
In case 2, the image processing unit 102 makes the display of one of the overlapping windows unclear and displays it in a blurred state like through the ground glass. The image processing unit 102 can obscure the display of the window by, for example, obscuring at least one of the display shading in the window, the boundary of the color scheme, and the outline of the display target.

  For example, in the screen example illustrated in FIG. 3, the image processing unit 102 changes the window screen of the electronic material displayed on the back side to a blurred state. Alternatively, the window screen displayed as a note on the front side is changed to a blurred state. In Case 2, the image processing unit 102 only needs to make the window display unclear. For this reason, for example, the image processing unit 102 can omit the drawing information acquisition process for specifying the background color and the character color of the window screen displayed on the back side. In Case 2, the terminal device 10 can reduce the processing amount of the image processing unit 102.

  7 to 8 illustrate examples of changing the window screen in case 2. FIG. The window screen illustrated in FIG. 7 to FIG. 8 is an example of a screen that is displayed in a state in which the display of the window displayed on the back side is unclear and is blurred like through the ground glass. The screen example of FIG. 7 is a screen example when the change of case 2 is applied to the window screen example superimposed in the transparent state shown in FIG. 3, for example. The screen example of FIG. 8 is a screen example when the change of case 2 is applied to the window screen example superimposed in the transparent state shown in FIG. 4, for example. In the screen examples of FIGS. 7 and 8, a window screen used as a notebook with a transparent background color is displayed in the front window.

  In the screen example of FIG. 7, the window screen Z6 is a window screen that is changed to a state in which the display of the entire window is blurred as if it is through the frosted glass. The window screen Z6 corresponds to the window screen on which the electronic material shown in FIG. The window screen Z7 is a window screen that is superimposed on the front side of the window screen Z6 in a transparent state. The window screen Z7 corresponds to the window screen used as a note shown in FIG.

  As shown in FIG. 7, when the window screen Z6 whose display is unclear is displayed through the window screen Z7 on the front side, for example, the display content is displayed so as to be entirely cloudy white. . For this reason, the user of the terminal device 10 can clearly recognize a character string or the like described in the front-side window screen Z7. In addition, the user of the terminal device 10 can visually recognize a description position of a character string or the like in the rear-side window screen Z6 displayed through the front-side window screen Z7.

  For example, in FIG. 7, the character portion of “Sushisoseso” in the character string “Sashisoseso” described in the window screen Z6 on the back side, and “ The character part of “Kakikuke” is displayed overlapping. However, even in the overlapping state, the display position of the character string “Sashisuseso” described in the rear-side window screen Z6 displayed through the front-side window screen Z7 can be grasped by visual recognition. In addition, it is possible to infer the contents of each character string or the like described in the front-side window screen Z7 and the rear-side window screen Z6.

  Next, the screen example of FIG. 8 will be described. In FIG. 8, a window screen Z8 is a window screen on the back side, in which the display of the entire window is changed to a blurred state like through the frosted glass. The window screen Z8 corresponds to the window screen on which the electronic material shown in FIG. 2 (1) is displayed (however, the background color is white and the character color is black). The window screen Z9 is a window screen that is superimposed on the front side of the window screen Z8 in a transparent state. The window screen Z9 corresponds to the window screen used as a note shown in FIG.

  As shown in FIG. 8, the window screen Z8 whose display is unclear is displayed so that the display content is generally clouded in white when the window screen Z9 is displayed through the front-side window screen Z9. . Therefore, the same effect as in FIG. 7 can be expected in FIG.

  For example, in FIG. 8, the character portion of “Iueo” in the character string “Aiueo” described in the window screen Z8 on the back side and “ABCD” in the character string “ABCDEFG” described in the window screen Z9 on the front side. "" Are displayed overlapping each other. However, even in the overlapped state, the display position of the character string “Iueo” described in the rear-side window screen Z8 that is displayed through the front-side window screen Z9 is visible. Further, it is possible to infer the contents of each character string and the like described in the front window screen Z9 and the rear window screen Z8.

  Also in FIG. 8, the user of the terminal device 10 can clearly recognize a character string or the like described in the front window screen Z9. In addition, the user of the terminal device 10 can visually recognize the description position and contents of the character string and the like in the rear-side window screen Z8 displayed through the front-side window screen Z9.

(Case 3)
In Case 3, the image processing unit 102 performs underline modification to a character string or the like displayed in one superimposed window. As a display color such as an underline that is modified to a character string or the like, for example, a noticeable color scheme such as red is adopted. The noticeable color scheme is, for example, a display color different from the background color and character color of the overlapping window. The image processing unit 102 employs a color scheme that gives a notice such as red to the display color of the underline modification, thereby allowing the user to visually recognize the display position, display interval, etc. of the character string in one of the superimposed windows. be able to.

  FIGS. 9 to 10 illustrate examples of changing the window screen by underlining the case 3. FIG. The window screen illustrated in FIGS. 9 to 10 is an example of a screen when red underlining is applied to a character string or the like of a window displayed on the front side. The screen example in FIG. 9 is a screen example in the case where a change by underline modification of case 3 is applied to the window screen example superimposed in the transparent state shown in FIG. Similarly, the screen example of FIG. 10 is a screen example in the case where a change by underline modification of case 3 is applied to the window screen example superimposed in the transparent state shown in FIG. In the screen examples of FIGS. 9 and 10, the window screen of the electronic material is displayed in the rear window.

  In the screen example of FIG. 9, the window screen Z10 corresponds to the window screen on which the electronic material shown in FIG. The window screen Z11 is a window screen that is superimposed on the front side of the window screen Z10 in a transparent state. The window screen Z11 corresponds to the window screen used as a note shown in FIG. The character string described in the window screen Z11 is red underlined as indicated by hatching, for example.

  As shown in FIG. 9, even if the rear window screen Z10 is transparently displayed, the character string described on the front window screen Z11 is displayed with red underline modification. Is done. For this reason, the user of the terminal device 10 can identify whether the display position of the character string is a character string described on the back side or a character string described on the front side by using the red underline decoration display as a guide become. In addition, the user of the terminal device 10 can grasp the space between lines in each window screen and the blank area in the line in which the character string is described by using the red underline modification display applied to the character string or the like as a guide. Become.

  For example, in FIG. 9, the character portion “Iueo” of the character string “Aiueo” described on the window screen Z10 on the back side and “ABC” of the character string “ABCDEFG” described on the window screen Z11 on the front side are shown. "" Are displayed overlapping each other. However, the character string described on the front window screen Z11 is red underlined, and the character string described on the back window screen Z10 is not underlined. For this reason, the user can identify the display location of the character string described on the window screen Z10 on the back side and the display location of the character string described on the window screen Z11 on the front side. Also, the user can visually recognize the blank area in the line between the lines of the window screen Z11 on the front side and the line describing the character string from the display position of the red underline modification. Similarly, the user can grasp the blank area in the line in which the character string is described between the lines of the window screen Z10 on the back side transmitted through the front side from the display position of the red underline modification.

  Next, the screen example of FIG. 10 will be described. In the screen example of FIG. 10, the window screen Z12 corresponds to the window screen (where the background color is white and the character color is black) on which the electronic material shown in FIG. 2A is displayed. The window screen Z13 is a window screen that is superimposed on the front side of the window screen Z12 in a transparent state. The window screen Z13 corresponds to the window screen used as a note shown in FIG. The character string described in the window screen Z13 is red underlined as indicated by hatching, for example.

  As shown in FIG. 10, even if the rear window screen Z12 is transparently displayed, the character strings described on the front window screen Z13 are displayed with red underline modification. Is done. For this reason, even if the character color of the window screen Z12 on the back side and the character color of the window screen Z13 on the front side are the same color, the user uses the red underline modification display as a guide, It can be identified whether it is a character string described in the above or a character string described on the front side. As in FIG. 9, the user can grasp the space between lines in each window screen and the blank area in the line where the character string is described by using the red underline modification display applied to the character string or the like as a guide. Become.

(Case 4)
In Case 4, the image processing unit 102 changes the font such as a character string displayed on one of the superimposed windows and the typeface such as the display thickness. The font such as a character string displayed on the window and the display thickness are specified based on, for example, drawing information acquired from each window screen. For example, the image processing unit 102 analyzes the acquired drawing information, and specifies a font and display thickness that approximate the character string described in each window screen. Then, the image processing unit 102 may change the font and display thickness of a character string or the like displayed in one window. However, when changing the font and display thickness, the number of characters displayed in one line may change. For this reason, when changing the font and display thickness, the image processing unit 102 performs a change process of the font and display thickness within a range where the display area per character does not change.

  In case 4, the terminal device 10 changes the font and display thickness, for example, even when the character color shown in FIG. 4 is the same color, the character string in which the character string display location is described on the back side. Or the character string described on the front side.

  FIG. 11 illustrates an example of changing the window screen depending on the font and display thickness of case 4. The window screen illustrated in FIG. 11 is an example of a screen when the font such as a character string of a window displayed on the front side is changed, for example. In the screen example of FIG. 11, the window screen Z14 corresponds to the window screen on which the electronic material shown in FIG. The window screen Z15 is a window screen that is superimposed on the front side of the window screen Z14 in a transparent state. The window screen Z15 corresponds to the window screen used as a note shown in FIG. For example, a character string described in the window screen Z15 is subjected to a font change process from Gothic to Mincho.

  As shown in FIG. 11, even when the rear window screen Z14 is transparently displayed, the character string described on the front window screen Z15 is subjected to font change processing and displayed. Is done. For this reason, the user of the terminal device 10 determines whether the display position of the character string is the character string described on the back side or the character string described on the front side, based on the relative font difference of the displayed character string. Can be identified. Further, the user of the terminal device 10 can grasp the space between lines in each window screen and the blank area in the line in which the character string is described from the relative font difference of the displayed character string.

  For example, in FIG. 11, the character string “patent B team” described on the window screen Z14 on the back side and the character string “patent team” described on the window screen Z15 on the front side are displayed overlapping each other. However, due to the difference in the fonts of the overlapping character strings, the user of the terminal device 10 displays the character string display location described on the rear window screen Z14 and the character string described on the front window screen Z15. It becomes possible to visually recognize the location. Further, for example, it can be understood that there is a character space between the character strings “patent” and “team” described in the window screen Z15 on the front side.

  Further, the user of the terminal device 10 can visually recognize the space between the lines on the front window screen Z15 and the blank area in the line in which the character string is described, based on the font difference between the overlapping character strings. Similarly, the user of the terminal device 10 grasps the blank area in the line in which the character string is described, between the lines of the back-side window screen Z14 transmitted to the front side, from the font difference of the overlapping character strings. Is possible.

  As described above, as illustrated in FIG. 6 to FIG. 11, by changing the display mode shown in Case 1 to Case 4, the terminal device 10 can identify the display content visually recognized in the partial area overlapped between the windows. Become. According to the change of the display mode shown in Case 1 to Case 4, the user of the terminal device 10 can clearly see the content to be copied and the display position. Further, the user of the terminal device 10 can visually recognize a blank area at the copy destination for inserting the copy source data.

[Processing flow]
Next, with reference to flowcharts illustrated in FIG. 12 to FIG. 15, the display mode changing process shown in case 1 to case 4 of the terminal device 10 of the present embodiment will be described. In the terminal device 10, the CPU 11 reads out various programs and various data stored in the auxiliary storage unit 13 to the main storage unit 12 and executes them, thereby performing the display mode changing process illustrated in FIGS. 12 to 15. In the following description, the overlapping windows will be described as “window A” and “window B”, respectively.

(Case 1)
FIG. 12 is a flowchart illustrating an example of the display mode changing process shown in Case 1. The terminal device 10 changes the display mode of the window screen by the display mode change process illustrated in FIG. 12 as described with reference to FIGS. 5 and 6, for example. In FIG. 6, “Window A” corresponds to, for example, a window screen used as a note, and “Window B” corresponds to a window screen on which electronic materials are displayed.

  In the flowchart illustrated in FIG. 12, the start of the processing of the terminal device 10 can be exemplified when a plurality of window screens are displayed in a display area such as the LCD 15 a. For example, the terminal device 10 acquires the display positions of the window A and the window B displayed on the LCD 15a or the like (S1).

  The display position of the window screen displayed on the LCD 15a or the like is acquired from the OS via an API or the like, for example. The display position of the window screen on the LCD 15a or the like is represented, for example, as (X, Y) two-dimensional coordinates with the upper left corner of the display device as the origin, the horizontal direction of the display device as the X axis, and the vertical direction as the Y axis. . The terminal device 10 temporarily stores the acquired display position of each window screen in a predetermined area of the main storage unit 12 in association with, for example, information (identification number) for identifying each window. The terminal device 10 delivers the acquired display position of each window screen to the process of S2.

In the process of S2, the terminal device 10 compares the display positions of the window screens delivered from the process of S1, and determines the presence of a partial area that overlaps between the window A and the window B. This is because when there is an overlapping partial area between window A and window B, it can be determined that window A and window B overlap.

  If there is no overlapping partial area between the window A and the window B (S2, No), the terminal device 10 proceeds to the process of S1. The terminal device 10 that has shifted to the processing of S1 repeats the processing of S1 to S2 until it is determined that the window A and the window B are overlapped. On the other hand, if there is an overlapping partial area between window A and window B (S2, Yes), the terminal device 10 proceeds to the process of S3.

  In the process of S3, the terminal device 10 acquires the RGB value of the window screen from the drawing information of the window A. Then, the terminal device 10 specifies the RGB value having the largest number as the background color and the other RGB values as the character color from the acquired RGB value distribution (appearance frequency). For example, in the example of FIG. 6, the RBG value “41 (R): 51 (B): 21 (G)” is specified as the background color of the window A. Also, the RBG value “250 (R): 250 (B): 250 (G)” representing white is specified as the character color of the window A.

  In the process of S4, the terminal device 10 acquires the RGB value of the window screen from the drawing information of the window B. Similarly to the processing of S3, the terminal device 10 specifies the RGB value that is the most frequent as the background color and the other RGB values as the character color from the distribution (appearance frequency) of the acquired RGB values. For example, in the example of FIG. 6, the RBG value “250 (R): 250 (B): 250 (G)” representing white is specified as the background color of the window B. Further, the RBG value “25 (R): 25 (B): 25 (G)” representing black is specified as the character color of the window B.

  In the process of S5, the terminal device 10 changes the display colors of the character colors displayed in combination with the background colors and background colors of the windows A and B specified in the processes of S3-S4 to different types. As described with reference to FIGS. 5 and 6, the display color of the background color of the windows A and B and the display color of the character color are changed. The display contents of the window A displayed through the window B may be identified.

  For example, the terminal device 10 changes the display colors of the background colors and the character colors of the windows A and B to display colors set in advance by the user so as to be different types. Alternatively, as described with reference to FIGS. 5 and 6, the terminal device 10 changes the display color of the background color or the character color of one of the windows A and B. The window A and the window B or the window A or the window B in which the display colors of the background color and the character color are changed by the process of S5 are displayed on a display device such as the LCD 15a of the terminal device 10.

  In the process of S6, the terminal device 10 uses the input unit 14 to position the copy source area and the copy destination area for the windows A and B to be superimposed with the display colors such as the background color and the character color being changed. Accept the alignment operation. The terminal device 10 changes the display positions of the superimposed windows A and B according to the alignment operation received via the input unit 14. In the terminal device 10, for example, alignment between the copy source area of the window A or B displayed on the front side and the copy destination area of the window B or window A displayed on the back side is performed.

In the process of S7, the terminal device 10 accepts an operation for designating data displayed in the copy source area of the window A or B displayed on the front side via the input unit 14, for example. The data specifying operation is performed by, for example, the touch pen 14a. For example, the terminal device 10 specifies the data of the copy source area selected by the designation operation from the drawing information of the window A or B that has been aligned in the process of S6. Further, the terminal device 10 specifies the copy destination area to be superimposed on the copy source area from the drawing information of the window B or window A displayed on the back side, for example. Then, the terminal device 10 inserts (pastes) the data of the copy source area selected by the designation operation into the copy destination area of the window B or the window A displayed on the back side. After the process of S7, the terminal device 10 proceeds to the process of S8.

  In the processing of S7, for example, when inserting data into the copy destination area, the terminal device 10 inserts data in accordance with the character string line described on the screen of the window A or B serving as the copy destination. It is good. The terminal device 10 allows fine adjustment along the character string row between the already described character string and the inserted data. Further, the terminal device 10 may change the font and color of the inserted data in accordance with the format such as the font and color of the character string described in the window A or B as the copy destination. In the terminal device 10, the format can be made identical between the already described character string or the like and the inserted data.

  In the process of S8, the terminal device 10 acquires the display positions of the window A and the window B displayed on the LCD 15a and the like, respectively, as in the process of S1. The terminal device 10 temporarily stores the acquired display position of each window screen in a predetermined area of the main storage unit 12 in association with information for identifying each window. The terminal device 10 delivers the acquired display position of each window screen to the process of S9.

  In the process of S9, similarly to the process of S2, the terminal device 10 compares the display positions of the window screens delivered from the process of S8, and determines the presence of an overlapping partial area between the window A and the window B. To do. This is because when window A and window B still overlap, there is a high probability that a copy operation is performed on another character string or the like described in window A or window B.

  If there is an overlapping partial area between the window A and the window B (S9, Yes), the terminal device 10 proceeds to the process of S8. The terminal device 10 that has shifted to the process of S8 acquires the display positions of the windows A and B, respectively, and determines from the acquired display positions of the windows that the windows A and B are not superimposed. , S8-S9 are repeated. However, if a copy operation is performed on another character string or the like described in window A or window B during the processing of S8-S9, the terminal device 10 accepts a user-designated operation by interrupt processing or the like. . And terminal operation 10 performs processing of S6-S7 according to an accepted user's designation operation.

  On the other hand, when there is no overlapping partial area between the window A and the window B (S9, No), the terminal device 10 proceeds to the process of S10. In the process of S10, the terminal device 10 returns the display colors of the windows A and B changed in the process of S5 to the RGB values acquired in the process of S3-S4. This is because when there is no overlapping partial area between the window A and the window B, it can be presumed that no copying operation is performed on other character strings described in the window A or the window B. The terminal device 10 ends the process of FIG. 12 after the process of S10.

(Case 2)
Next, the display mode changing process shown in Case 2 will be described. FIG. 13 is a flowchart illustrating an example of the display mode changing process shown in Case 2. In the change process of Case 2, the terminal device 10 performs a blurred display of the window screen as described with reference to FIGS. Here, the blurred display means, for example, that at least one of display shading in the window, a boundary of color scheme, and a contour of a display target are displayed indistinctly. 7 and 8, “Window A” corresponds to, for example, a window screen used as a note, and “Window B” corresponds to a window screen on which electronic material is displayed.

  As illustrated in the flowchart of FIG. 13, in the display mode changing process of case 2, the terminal device 10 performs the process of S11 instead of the process of S3 to S5 of the flowchart illustrated in FIG. 12. Further, the terminal device 10 performs the process of S12 instead of the process of S10 of the flowchart illustrated in FIG. Hereinafter, the process of S11-S12 is mainly demonstrated.

  In the flowchart illustrated in FIG. 13, the start of the process is the same as the process in FIG. 12. For example, the terminal device 10 acquires the display positions of the window A and the window B displayed on the LCD 15a or the like (S1). The acquired display position of each window screen is handed over to the process of S2. And the terminal device 10 performs the process of S2 based on the display position of each window handed over from the process of S1 in order to determine the superimposition of the windows A and B. In the process of S2, if there is an overlapping partial area between the window A and the window B (S2, Yes), the terminal device 10 proceeds to the process of S11.

  In the process of S <b> 11, the terminal device 10 changes the display of one of the windows A and B to unclear (blurred). For example, assume that window A is on the back side, window B is on the front side, and window A on the back side is blurred.

  In the above case, for example, as described with reference to FIGS. 7 and 8, the background color and the character color of the back side window A displayed through the front side window B are displayed so as to be cloudy white. Is done. A character string or the like written in the front-side window B is displayed with the back-side window A displayed in a cloudy white color as a background color. For this reason, the user of the terminal device 10 can clearly recognize the character string described in the window B on the front side. Further, the user of the terminal device 10 can visually recognize the display position of a character string or the like in the window A on the back side that is transmitted through the window B on the front side.

  Further, it is assumed that the display of the window B on the front side in the transparent state is unclear (blurred) and is in a blurred state. In this case, the background color or character color of the window A on the back side that is displayed through the window B on the front side is blurred and displayed as if it is through the ground glass. A character string or the like written in the front-side window B is displayed with the back-side window A, which is blurred and transmitted through the ground glass as a background color. Therefore, even in this case, the user of the terminal device 10 can clearly recognize the character string described in the window B on the front side. Further, the user of the terminal device 10 can visually recognize the display position of a character string or the like in the window A on the back side that is transmitted through the window B on the front side.

  The terminal device 10 aligns the copy source area and the copy destination area with respect to each overlapping window with the display of either the window A or the window B being unclearly changed via the input unit 14. An operation is accepted (S6). For example, the terminal device 10 accepts an operation for designating data displayed in the copy source area of the window A or B displayed on the front side, and the data of the selected copy source area is displayed on the window B or It is inserted into the copy destination area of window A (S7).

  In the terminal device 10, after the process of S7, the process of S8-S9 is performed, and when the partial area which overlaps between the window A and the window B does not exist (S9, No), the process of S12 is performed. In the process of S12, the terminal device 10 releases the blurred display state of the window A or the window B changed in the process of S11. The terminal device 10 ends the process of FIG. 13 after the process of S12.

(Case 3)
Next, the display mode changing process shown in Case 3 will be described. FIG. 14 is a flowchart illustrating an example of the display mode changing process shown in Case 3. In the change process of case 3, the terminal apparatus 10 performs underline modification with a notice color (for example, red) on a character string or the like, as described with reference to FIGS. In FIG. 9 and FIG. 10, “Window A” corresponds to, for example, a window screen used as a note, and “Window B” corresponds to a window screen on which electronic materials are displayed.

  As shown in the flowchart of FIG. 14, in the display mode changing process of case 3, the terminal device 10 performs the process of S13 instead of the processes of S3 to S5 of the flowchart shown in FIG. Further, the terminal device 10 performs the process of S14 instead of the process of S10 of the flowchart illustrated in FIG. Hereinafter, the process of S13-S14 is mainly demonstrated.

  In the flowchart illustrated in FIG. 14, the start of the process is the same as the process in FIG. 12. For example, the terminal device 10 acquires the display positions of the window A and the window B displayed on the LCD 15a or the like (S1). The acquired display position of each window screen is handed over to the process of S2. And the terminal device 10 performs the process of S2 based on the display position of each window handed over from the process of S1 in order to determine the superimposition of the windows A and B. In the process of S2, if there is an overlapping partial area between the window A and the window B (S2, Yes), the terminal device 10 proceeds to the process of S13.

  In the process of S13, the terminal device 10 performs underline modification to a character string or the like displayed in one of the windows A and B. As a display color such as an underline that is modified to a character string or the like, for example, a noticeable color scheme such as red is adopted. By adopting a color scheme that gives a notice of red or the like to the display color of the underline modification, it is possible to make the user visually recognize the display position, display interval, etc. of the character string in one of the superimposed windows.

  For example, red underlining is applied to the character string of window B on the front side, with window A on the back side and window B on the front side. The terminal device 10 acquires drawing information of the window B, and temporarily stores the acquired drawing information in a predetermined area of the main storage unit 12 in association with information for identifying the window B. For example, the terminal device 10 performs image analysis on the drawing information of the window B and specifies a character string or the like described in the window B. The terminal device 10 performs underline modification of the specified character string or the like, for example, with a display color (for example, red) different from the background color and character color of the superimposed window.

  9 and 10 exemplify screen examples in which the character string of window B displayed on the front side is red underlined. As shown in FIG. 9 and FIG. 10, even if the window A on the back side is displayed transparently, the character string described in the window B on the front side is decorated with a red underline. Is displayed. For this reason, the user of the terminal device 10 can identify whether the display position of the character string is the character string described in the window A or the character string described in the window B by using the red underline decoration display as a guide. become. In addition, the user of the terminal device 10 can grasp the space between lines on the screens of the windows A and B and the blank area in the line in which the character string is described by using the red underline decoration display applied to the character string or the like as a guide. It becomes possible.

  Returning to FIG. 14, the terminal device 10 copies the copy source area and the copy for each window to be superimposed with the underline modification applied to the character string or the like of either the window A or the window B via the input unit 14. An alignment operation with the previous area is accepted (S6). For example, the terminal device 10 accepts an operation for designating data displayed in the copy source area of the window A or B displayed on the front side, and the data of the selected copy source area is displayed on the window B or It is inserted into the copy destination area of window A (S7).

In the terminal device 10, after the process of S7, the process of S8-S9 is performed, and when the partial area which overlaps between the window A and the window B does not exist (S9, No), the process of S14 is performed. In the process of S14, the terminal device 10 cancels the underline modification to the character string described in the window A or the window B performed in the process of S13. The terminal device 10 ends the process of FIG. 14 after the process of S14.

(Case 4)
Next, the display mode changing process shown in Case 4 will be described. FIG. 15 is a flowchart illustrating an example of the display mode changing process shown in Case 4. In the changing process of case 4, the terminal device 10 changes the font such as a font such as a character string and the font, as described with reference to FIG. In FIG. 11, “Window A” corresponds to, for example, a window screen used as a note, and “Window B” corresponds to a window screen on which electronic materials are displayed.

  As shown in the flowchart of FIG. 15, in the display mode changing process of case 4, the terminal device 10 performs the processes of S <b> 15-S <b> 16 instead of the processes of S <b> 3-S <b> 5 of the flowchart shown in FIG. Further, the terminal device 10 performs the process of S17 instead of the process of S10 of the flowchart shown in FIG. Hereinafter, the process of S15-S17 is mainly demonstrated.

  In the flowchart illustrated in FIG. 15, the start of the process is the same as the process in FIG. 12. For example, the terminal device 10 acquires the display positions of the window A and the window B displayed on the LCD 15a or the like (S1). The acquired display position of each window screen is handed over to the process of S2. And the terminal device 10 performs the process of S2 based on the display position of each window handed over from the process of S1 in order to determine the superimposition of the windows A and B. In the process of S2, if there is an overlapping partial area between the window A and the window B (S2, Yes), the terminal device 10 proceeds to the process of S15. In the following description, the terminal device 10 will be described on the assumption that the font such as the character string of the window B and the font such as the display thickness are changed.

  In the process of S15, the terminal device 10 identifies the type of font and display thickness such as the character string of the other window A in order to change the font and display thickness of the character string or the like of one window B to be superimposed. To do. This is because the type of font such as font and display thickness after the change of window B is not overlapped with the type of type of window A.

  For example, the terminal device 10 acquires the drawing information of the window A, and temporarily stores the acquired drawing information in a predetermined area of the main storage unit 12 in association with information for identifying the window A. For example, the terminal device 10 performs image analysis on the drawing information of the window A, and specifies a font and display thickness that approximate a character string or the like described in the window A. The terminal device 10 passes the font information such as the character string specified from the drawing information of the window A and the typeface information such as the display thickness to the process of S16.

  In the process of S16, the terminal apparatus 10 changes the font such as the character string of window B and the display thickness based on the font information of window A delivered from the process of S15. The font and display thickness of the character string and the like of the window B are changed so that the difference between the character string and the like described in the window A becomes clear. To change the font and display thickness, for example, character strings having different fonts and display thickness are experimentally combined, and a plurality of subjects evaluate the ease of visual recognition of the combination. For example, a font to be changed for each font and for each display thickness may be determined in advance based on statistical processing of evaluation results aggregated from a plurality of subjects.

For example, the terminal device 10 acquires the drawing information of the window B, and temporarily stores the acquired drawing information in a predetermined area of the main storage unit 12 in association with information for identifying the window B. For example, the terminal device 10 performs image analysis on the drawing information of the window B, and specifies a font and display thickness that approximates a character string or the like described in the window B. Then, the terminal device 10 changes the font and display thickness of the character string described in the window B so that the mutual difference becomes clear with respect to the character string described in the window A and the like.

  In FIG. 11, when the font such as the character string described in window B is changed from the Gothic font to the Mincho font so that the difference between the character string described in window A and the like becomes clear. An example screen is illustrated. As shown in FIG. 11, even when the window A on the back side is displayed transparently, the character string described in the window B on the front side is displayed after being subjected to font change processing. . For this reason, the user of the terminal device 10 determines whether the display position of the character string is the character string described in the window A or the character string described in the window B from the relative font difference between the displayed character strings. Can be identified. Further, the user of the terminal device 10 can grasp the space between the lines in the windows A and B and the blank area in the line in which the character string is described from the relative font difference of the displayed character string.

  Returning to FIG. 15, the terminal device 10 transmits, via the input unit 14, the copy source for each window to be superimposed in a state where the font and display thickness of the character string or the like of either window A or window B is changed An alignment operation between the area and the copy destination area is accepted (S6). For example, the terminal device 10 accepts an operation for designating data displayed in the copy source area of the window A or B displayed on the front side, and the data of the selected copy source area is displayed on the window B or It is inserted into the copy destination area of window A (S7).

  In the terminal device 10, after the process of S7, the process of S8-S9 is performed, and when the partial area which overlaps between the window A and the window B does not exist (S9, No), the process of S17 is performed. In the process of S <b> 17, the terminal device 10 returns the font type such as the changed character string in the window A or the window B and the font type such as the display thickness to the state before the change. The terminal device 10 ends the process of FIG. 15 after the process of S17.

  As described above, in the terminal device 10 according to the present embodiment, the display contents shown in the overlapped partial areas between the windows can be identified by changing the display mode shown in Case 1 to Case 4. According to the change in the display mode of the terminal device 10 of the present embodiment, the user of the terminal device 10 can clearly see the content to be copied and the display position. Further, the user of the terminal device 10 can visually recognize a blank area at the copy destination for inserting the copy source data.

<Computer-readable recording medium>
A program that causes a computer or other machine or device (hereinafter, a computer or the like) to realize any of the above functions can be recorded on a computer-readable recording medium. The function can be provided by causing a computer or the like to read and execute the program of the recording medium.

Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer or the like. Say. Examples of such a recording medium that can be removed from a computer or the like include a flexible disk, a magneto-optical disk, and a Compact Disc Read Only Memory (CD-ROM). Compact Disc-Recordable
(CD-R), Compact Disc-ReWriterable (CD-RW), DVD, BD, Digital Audio Tape (DAT), 8 mm tape, flash memory, and other memory cards. Moreover, there are a hard disk, a ROM, and the like as a recording medium fixed to a computer or the like.

<Others>
The above embodiment further includes an aspect called the following supplementary note. The components included in the following supplementary notes can be combined with the constituents included in the other supplementary notes.
(Appendix 1)
A display for displaying at least two windows;
One of at least two windows displayed on the display unit is transparently superimposed on the other window, and data specified in the one window is placed in a predetermined area on the superimposed window side. A processing unit for changing a display form in the one window or the other window when copying;
A terminal device comprising:
(Appendix 2)
The processing unit is an object in which a background in the one window or the other window and a display color of an object displayed in combination with the background are described in the one window or the other window. The terminal device according to appendix 1, wherein the terminal device is changed to be identifiable.
(Appendix 3)
The terminal device according to attachment 1 or 2, wherein the processing unit blurs display of the one window or the other window.
(Appendix 4)
The terminal device according to supplementary note 3, wherein the processing unit makes the display of the window unclear by obscuring at least one of display shading, a color arrangement boundary, and a contour of a display target in the window.
(Appendix 5)
The terminal device according to any one of Supplementary Notes 1 to 4, wherein the processing unit performs character modification on a character described in the one window or the other window.
(Appendix 6)
The processing unit applies underline modification to a character described in the one window or the other window with a display color different from a background color and a character color in the one window or the other window. The terminal device according to attachment 5. (6)
(Appendix 7)
The processing unit changes a typeface of a character described in the one window or the other window so as to be identifiable as a character described in the one window or the other window. The terminal device according to any one of supplementary notes 1 to 6.

(Appendix 8)
On the computer,
Of at least two windows displayed on the display unit, one window is transparently superimposed on the other window, and the data specified in the one window is copied to a predetermined area on the superimposed window side. When changing the display form in the one window or the other window,
A display program that lets you do that.
(Appendix 9)
In the computer,
The display color of the object displayed in combination with the background in the one window or the other window and the background is changed so that it can be identified that the object is described in the one window or the other window. The display program according to attachment 8, wherein the display program is executed.
(Appendix 10)
In the computer,
The display program according to appendix 8 or 9, which causes the display of the one window or the other window to be unclear.
(Appendix 11)
In the computer,
The display program according to appendix 10, wherein the display of the window is made unclear by obscuring at least one of display shading, color boundary, and outline of a display target in the window.
(Appendix 12)
In the computer,
12. The display program according to any one of supplementary notes 8 to 11, which causes a character modification to a character described in the one window or the other window.
(Appendix 13)
In the computer,
The character described in the one window or the other window is subjected to underline modification of a display color different from the background color and the character color in the one window or the other window, The display program according to attachment 12.
(Appendix 14)
In the computer,
Changing the typeface of the character described in the one window or the other window so as to be identifiable as the character described in the one window or the other window. The display program according to any one of supplementary notes 8 to 13.

(Appendix 15)
Computer
Of at least two windows displayed on the display unit, one window is transparently superimposed on the other window, and the data specified in the one window is copied to a predetermined area on the superimposed window side. When changing the display form in the one window or the other window,
Display method to do that.
(Appendix 16)
The computer is
The display color of the object displayed in combination with the background in the one window or the other window and the background is changed so that it can be identified that the object is described in the one window or the other window. The display method according to supplementary note 15, wherein:
(Appendix 17)
The computer is
The display method according to appendix 15 or 16, wherein the display of the one window or the other window is made unclear.
(Appendix 18)
The computer is
18. The display method according to appendix 17, wherein the display of the window is made unclear by obscuring at least one of display shading, color boundary, and outline of a display target in the window.
(Appendix 19)
The computer is
The display method according to any one of supplementary notes 15 to 18, wherein character modification is performed on the character described in the one window or the other window.
(Appendix 20)
The computer is
Performing underline modification of a display color different from a background color and a character color in the one window or the other window on the character described in the one window or the other window, The display method according to attachment 19.
(Appendix 21)
The computer is
Changing the typeface of the character described in the one window or the other window so as to be identifiable as the character described in the one window or the other window; The display method according to any one of supplementary notes 15 to 20.

10 Terminal device 11 CPU
12 Main storage unit 13 Auxiliary storage unit 14 Input unit 15 Output unit 16 Communication unit 101 Display screen management unit 102 Image processing unit B1 Connection bus

Claims (9)

A display for displaying at least two windows;
One of at least two windows displayed on the display unit is transparently superimposed on the other window, and data specified in the one window is placed in a predetermined area on the superimposed window side. A processing unit for changing a display form in the one window or the other window when copying;
A terminal device comprising:   The processing unit is an object in which a background in the one window or the other window and a display color of an object displayed in combination with the background are described in the one window or the other window. The terminal device according to claim 1, wherein the terminal device is changed to be identifiable.   The terminal device according to claim 1, wherein the processing unit blurs display of the one window or the other window.   The terminal device according to claim 3, wherein the processing unit makes the display of the window unclear by obfuscating at least one of display shading, a color arrangement boundary, and a contour of a display target in the window. .   5. The terminal device according to claim 1, wherein the processing unit applies character modification to characters described in the one window or the other window. 6.   The processing unit applies underline modification to a character described in the one window or the other window with a display color different from a background color and a character color in the one window or the other window. The terminal device according to claim 5.   The processing unit changes a typeface of a character described in the one window or the other window so as to be identifiable as a character described in the one window or the other window. The terminal device according to any one of claims 1 to 6. On the computer,
Of at least two windows displayed on the display unit, one window is transparently superimposed on the other window, and the data specified in the one window is copied to a predetermined area on the superimposed window side. When changing the display form in the one window or the other window,
A display program that lets you do that. Computer
Of at least two windows displayed on the display unit, one window is transparently superimposed on the other window, and the data specified in the one window is copied to a predetermined area on the superimposed window side. When changing the display form in the one window or the other window,
Display method to do that.