JP2021026561A - Information processing device, information processing method and information processing program - Google Patents

Abstract

To provide an information processing device, an information processing method and an information processing program which allow a user of a first display part to correctly grasp a range of an image displayed on a second display part in the information processing device which can display on the second display part display information displayed on the first display part.SOLUTION: An information processing device comprises: a detection processing part which detects a designated position designated by a user on a first display part; a guide processing part which displays on the first display part a guide object in a size according to a second resolution on the basis of the designated position detected by the detection processing part; an extraction processing part which extracts first display information displayed at a position corresponding to the guide object displayed by the guide processing part in the first display part; and a display processing part which displays the first display information extracted by the extraction processing part on a second display part in a size according to the second resolution.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device, an information processing method, and an information processing program capable of displaying display information displayed on the first display unit on the second display unit.

Conventionally, an information processing device capable of displaying the display information displayed on the first display unit on the second display unit has been proposed (see, for example, Patent Document 1). For example, the information processing device is a pointer from the display images displayed on the liquid crystal display when the resolution of the image display device (second display unit) is lower than the resolution of the liquid crystal display (first display unit). A region having a size corresponding to the resolution of the image display device is extracted centering on the position where is superimposed and transmitted to the image display device.

JP-A-2009-192670

However, in the conventional technique, the user who operates the first display unit can recognize that the image near the pointer is displayed on the second display unit, but particularly the first display unit and the above. When the second display unit is installed away from the second display unit, the user cannot visually recognize the display content of the second display unit, so that the first image displayed on the first display unit is displayed. 2 It is difficult to accurately grasp the range of the image displayed on the display unit.

An object of the present invention is an information processing device capable of displaying display information displayed on the first display unit on the second display unit, in which a user of the first display unit is displayed on the second display unit. An object of the present invention is to provide an information processing device, an information processing method, and an information processing program that enable an accurate grasp of an image range.

The information processing device according to one aspect of the present invention can display the display information displayed on the first display unit having the first resolution on the second display unit having the second resolution lower than the first resolution. In the information processing device, the second resolution is determined based on the detection processing unit that detects the designated position designated by the user in the first display unit and the designated position detected by the detection processing unit. A guide processing unit that displays a guide object of a size on the first display unit, and first display information displayed at a position corresponding to the guide object displayed by the guide processing unit in the first display unit. It includes an extraction processing unit for extracting, and a display processing unit for displaying the first display information extracted by the extraction processing unit on the second display unit in a size corresponding to the second resolution.

In the information processing method according to another aspect of the present invention, the display information displayed on the first display unit having the first resolution can be displayed on the second display unit having the second resolution lower than the first resolution. In the information processing method, the size corresponding to the second resolution is based on the detection step of detecting the designated position designated by the user in the first display unit and the designated position detected by the detection step. A guide step for displaying the guide object of the above on the first display unit, and an extraction step for extracting the first display information displayed at a position corresponding to the guide object displayed by the guide step in the first display unit. A display step of displaying the first display information extracted by the extraction step on the second display unit in a size corresponding to the second resolution is executed by one or more processors.

The information processing program according to another aspect of the present invention can display the display information displayed on the first display unit having the first resolution on the second display unit having the second resolution lower than the first resolution. An information processing program having a size corresponding to the second resolution based on a detection step for detecting a designated position designated by the user in the first display unit and the designated position detected by the detection step. A guide step for displaying the guide object of the above on the first display unit, and an extraction step for extracting the first display information displayed at a position corresponding to the guide object displayed by the guide step in the first display unit. Information processing for causing one or more processors to execute the display step of displaying the first display information extracted by the extraction step on the second display unit in a size corresponding to the second resolution. It is a program.

According to the present invention, in an information processing device capable of displaying display information displayed on the first display unit on the second display unit, a user of the first display unit is displayed on the second display unit. Information processing devices, information processing methods, and information processing programs that enable an accurate grasp of the range of an image are provided.

FIG. 1 is a block diagram showing a configuration of an information processing device according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of monitor information used in the information processing apparatus according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of drawing information used in the information processing apparatus according to the embodiment of the present invention. FIG. 4A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 4B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 5A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 5B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 6A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 6B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 7A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 7B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 8A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 8B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 9A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 9B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 10 is a flowchart for explaining an example of an information processing procedure executed in the information processing apparatus according to the embodiment of the present invention. FIG. 11 is a flowchart for explaining an example of a procedure of drawing processing executed in the information processing apparatus according to the embodiment of the present invention. FIG. 12 is a flowchart for explaining an example of a guide change processing procedure executed in the information processing apparatus according to the embodiment of the present invention. FIG. 13 is a diagram showing an example of a display screen displayed on the main monitor and the sub monitor according to the embodiment of the present invention. FIG. 14A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 14B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 15A is a diagram showing an example of a display screen displayed on the main monitor according to the embodiment of the present invention. FIG. 15B is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention. FIG. 16 is a diagram showing an example of a display screen displayed on the sub monitor according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the following embodiment is an example embodying the present invention and does not have a character that limits the technical scope of the present invention.

As shown in FIG. 1, the information processing device 1 according to the embodiment of the present invention includes a touch display 100, sub-monitors 130 and 140, a control device 200, and a touch pen 300. The control device 200 is a computer that is connected to the touch display 100 and the sub-monitors 130 and 140 via the network N1 (wireless communication or wired communication) and controls the touch display 100 and the sub-monitors 130 and 140. The touch pen 300 is connected to the control device 200 via a network (wireless communication or wired communication). The information processing device 1 is an example of the information processing device of the present invention.

The touch display 100 includes a touch panel 110 and a main monitor 120. The touch panel 110 may be a capacitance type touch panel, or may be a pressure sensitive type or an infrared ray blocking type touch panel. That is, the touch panel 110 may be a device capable of appropriately accepting user's operation input such as touch. The touch panel 110 is provided on the main monitor 120.

The main monitor 120 is, for example, a liquid crystal display. The main monitor 120 is not limited to the liquid crystal display, and may be an LED (Light Emitting Diode) display, an organic EL (Electro-Luminescence) display, a projector, or the like. The main monitor 120 is an example of the first display unit of the present invention.

The sub-monitors 130 and 140 are, for example, liquid crystal displays. The sub-monitors 130 and 140 are not limited to the liquid crystal display, and may be an LED display, an organic EL display, a projector, or the like. Although FIG. 1 illustrates two sub-monitors 130 and 140 as an example of the information processing device 1, the information processing device of the present invention may include one sub-monitor or three or more sub-monitors. A sub monitor may be provided. Further, the sub monitors 130 and 140 may have a touch panel function. That is, the information processing device 1 may be configured to include one touch display 100 including a main monitor 120 and one or a plurality of touch displays including a sub monitor. One of the sub-monitors 130 and 140 is an example of the second display unit of the present invention, and the other is an example of the third display unit of the present invention.

The touch pen 300 is a pen for the user to touch (input) to the touch display 100. When the touch pen 300 is omitted, the user touches (inputs) the touch display 100 with a finger. For example, the user manually inputs (draws) an object such as a character or a figure with the touch pen 300 or a finger.

The information processing device 1 is a device capable of displaying display information displayed on the main monitor 120 having the first resolution on the sub-monitors 130 and 140 having a second resolution lower than the first resolution. As shown in FIG. 1, the control device 200 includes a storage unit 220, a control unit 210, and a communication unit 230.

The communication unit 230 connects the control device 200 to the network N1 wirelessly or by wire, and follows a predetermined communication protocol with external devices such as the touch display 100, the sub-monitors 130, 140, and the touch pen 300 via the network N1. It is a communication interface for executing data communication.

The storage unit 220 is a non-volatile storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various types of information.

Specifically, the storage unit 220 stores monitor information 222 including information about the monitor and drawing information 223 including information handwritten by the user.

FIG. 2 is a diagram showing an example of monitor information 222. As shown in FIG. 2, in the monitor information 222, each information of "monitor type", "identification information", "resolution", and "position information" is registered for each monitor. The "monitor type" is information indicating the type of monitor, and the "main monitor" or the "sub monitor" is registered. When there are a plurality of sub-monitors, distinguishable information such as "sub-monitor 1" and "sub-monitor 2" is registered. The "identification information" is the identification information of the monitor, and device information such as a number and a symbol that can identify the monitor is registered. The "resolution" is information indicating the resolution (number of pixels) of the monitor. The "position information" is information indicating the position of the monitor, and for example, information for specifying a room in which the monitor is installed, GPS (registered trademark) information, and the like are registered. When the monitor is connected to the network N1, the control unit 210 acquires various information from the monitor and registers it in the monitor information 222. In FIG. 2, information on each of the "main monitor" corresponding to the main monitor 120, the "sub monitor 1" corresponding to the sub monitor 130, and the "sub monitor 2" corresponding to the sub monitor 140 is registered. That is, the resolutions of the sub-monitors 130 and 140 are lower than the resolution of the main monitor 120. The resolution of the main monitor 120 is an example of the first resolution of the present invention, and the resolutions of the sub-monitors 130 and 140 are an example of the second resolution of the present invention. In the following description, for convenience, the resolution of the main monitor 120 is referred to as "first resolution", the resolution of the sub monitor 130 is referred to as "second resolution", and the resolution of the sub monitor 140 is referred to as "third resolution". The second resolution and the third resolution may be the same or different. In the following description, when the same processing is executed on each of the sub-monitors 130 and 140, one of the sub-monitors 130 will be taken as an example.

FIG. 3 is a diagram showing an example of drawing information 223. As shown in FIG. 3, in the drawing information 223, information on drawing objects such as characters and figures input by the touch pen 300 or a finger is registered. For example, in the drawing information 223, each information of "object ID", "page number", "display position", and "input information" is registered for each drawing object. The "object ID" is the identification information of the drawing object. The "page number" is the number of the page on which the drawing object is displayed. The "display position" is the coordinate position of the drawing object displayed on the main monitor 120. The "input information" is information input by the user, such as characters, figures, and symbols indicating the drawing object. The user may input the drawing object on the touch panel 110 with the touch pen 300 or a finger, or may input the drawing object using an operating device such as a keyboard or a mouse. In the drawing information 223, each information is registered in the order in which the drawing objects are input (time series).

Further, the storage unit 220 stores a control program such as an information processing program 221 for causing the control unit 210 to execute information processing (see FIG. 10) described later. For example, the information processing program 221 is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and is read by a reading device (not shown) such as a CD drive or a DVD drive included in the information processing device 1. It is stored in the storage unit 220.

The control unit 210 includes control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which control programs such as a BIOS and an OS for causing the CPU to execute various arithmetic processes are stored in advance. The RAM is a volatile or non-volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 210 controls the information processing device 1 by executing various control programs stored in advance in the ROM or the storage unit 220 on the CPU.

Specifically, as shown in FIG. 1, the control unit 210 includes various processing units such as a detection processing unit 211, a drawing processing unit 212, a guide processing unit 213, an extraction processing unit 214, and a display processing unit 215. The control unit 210 functions as the various processing units by executing various processing according to the information processing program 221 on the CPU. Further, a part or all of the processing unit may be composed of an electronic circuit. The information processing program 221 may be a program for causing a plurality of processors to function as the processing unit.

The detection processing unit 211 detects the input by the touch pen 300 or the finger to the touch display 100. The detection processing unit 211 is an example of the detection processing unit of the present invention. Specifically, the detection processing unit 211 detects the page number and the position coordinates of the position designated by the touch pen 300 or the user's finger on the touch panel 110. For example, when the user manually inputs characters on the touch panel 110, the detection processing unit 211 detects the page number and the position coordinates (display position) of the input position.

Further, the detection processing unit 211 detects a position (designated position) designated by the user when displaying the guide object G1 having a size corresponding to the second resolution corresponding to the sub monitor 130 on the main monitor 120. Here, the guide object G1 (see FIG. 6A and the like) is a frame-shaped image having a size corresponding to the display area (the second resolution) of the sub monitor 130. The guide object G1 corresponds to the shape of the display area of the sub monitor 130, and when the display area of the sub monitor 130 is rectangular, the guide object G1 is generated in a rectangular shape. Further, the guide object G1 is composed of a frame image and does not have image information in the frame. Therefore, when the guide object G1 is displayed on the main monitor 120, the image information (drawing information) input to the main monitor 120 is displayed in the frame of the guide object G1.

The drawing processing unit 212 causes the drawing object to be displayed on the main monitor 120 based on input information such as characters and figures input by the user with the touch pen 300 or a finger on the touch panel 110. Further, the drawing processing unit 212 registers each information regarding the drawing object in the drawing information 223 (see FIG. 3).

FIG. 4A shows the display screen of the main monitor 120. When the information processing program 221 is executed, the control unit 210 causes the main monitor 120 to display the menu screen 12 and the plurality of icons 12a included in the menu screen 12. The icon 12a is a shortcut icon for executing a specific function in the information processing program 221, and a plurality of icons 12a are arranged according to the function. The functions include, for example, "open file", "save file", "print", "draw line", "eraser", "guide mode" and the like. The "guide mode" is a display mode in which the guide object G1 is displayed on the main monitor 120 and the display information displayed at the position corresponding to the guide object G1 is displayed on the sub monitor 130. When the display mode is not the guide mode, that is, the normal mode, the display information displayed in the entire display area of the main monitor 120 is displayed on the sub monitor 130. FIG. 4B shows a display screen of the sub monitor 130 in the normal mode. As shown in FIG. 4B, the display information of the entire display area of the main monitor 120 is reduced and displayed on the sub monitor 130. The display mode can be appropriately switched by, for example, the user of the touch display 100 while using the touch display 100.

FIG. 5A shows the display screen of the main monitor 120. For example, when the user inputs the drawing object T1 on the touch panel 110 with the touch pen 300, the drawing processing unit 212 causes the input drawing object T1 to be displayed on the main monitor 120. Here, when the display mode is set to the normal mode, the display processing unit 215 causes the sub monitor 130 to display the display information displayed in the entire display area of the main monitor 120 as shown in FIG. 5B. .. Here, since the resolution of the sub monitor 130 (the second resolution) is lower than the resolution of the main monitor 120 (the first resolution), the display processing unit 215 responds to the display information of the main monitor 120 according to the second resolution. It is reduced in size and displayed on the sub monitor 130. In this case, since the drawing object T1 is reduced and displayed on the sub monitor 130, it becomes difficult for the user viewing the sub monitor 130 to visually recognize the drawing object T1.

The guide processing unit 213 causes the main monitor 120 to display the guide object G1 having a size corresponding to the second resolution based on the designated position detected by the detection processing unit 211. The guide processing unit 213 is an example of the guide processing unit of the present invention. For example, when the user specifies an arbitrary position on the touch display 100, the guide processing unit 213 arranges the guide object 213 so that the center position (center of gravity position) of the guide object G1 matches the designated position on the main monitor 120. Display G1.

The extraction processing unit 214 extracts display information (hereinafter, referred to as a partial drawing object) displayed at a position corresponding to the guide object G1 displayed by the guide processing unit 213 on the main monitor 120. The extraction processing unit 214 is an example of the extraction processing unit of the present invention. The partial drawing object is an example of the first display information of the present invention. For example, as shown in FIG. 6A, when the user specifies an arbitrary position on the touch panel 110, the guide processing unit 213 displays the guide object G1 on the main monitor 120, and the extraction processing unit 214 causes the guide object G1 on the main monitor 120. The partial drawing object (drawing object T2) displayed at the corresponding position is extracted.

The extraction processing unit 214 may further extract a partial background image included in the guide object G1 from the background image displayed on the main monitor 120. That is, the partial drawing object may include a partial background image included in the guide object G1 among the background images displayed on the main monitor 120.

Here, the extraction processing unit 214 groups the display information displayed in the vicinity of the designated position, and among the grouped display information, the display information displayed at the position corresponding to the guide object G1 is the part. Extract as a drawing object. In the example shown in FIG. 6A, the extraction processing unit 214 groups the text information of "next report announcement", "Yamada", "Tanaka", and "Yamamoto" arranged in the vicinity of the designated position. Here, since each grouped information is included in the frame of the guide object G1, the extraction processing unit 214 extracts the grouped information as the partial drawing object.

The guide processing unit 213 sets the guide object G1 on the main monitor 120 so that the center position of the display information grouped by the extraction processing unit 214 and the center position of the guide object G1 match based on the designated position. It may be displayed in. For example, when the user specifies an arbitrary position on the touch display 100, the extraction processing unit 214 groups the display information displayed in the vicinity of the designated position, and the guide processing unit 213 sets the center position of the display information. The guide object G1 is displayed on the main monitor 120 so as to coincide with the center position of the guide object G1. Then, the extraction processing unit 214 extracts the display information included in the guide object G1 as the partial drawing object.

The display processing unit 215 causes the sub monitor 130 to display the partial drawing object extracted by the extraction processing unit 214 in a size corresponding to the resolution of the sub monitor 130 (the second resolution). The display processing unit 215 is an example of the display processing unit of the present invention. For example, as shown in FIG. 6B, the display processing unit 215 displays the drawing object T2 extracted by the extraction processing unit 214 in a size corresponding to the second resolution of the sub monitor 130.

Since the guide object G1 indicating the display area of the sub monitor 130 is displayed on the main monitor 120 by the above-mentioned processing by each processing unit of the control unit 210, the user of the touch display 100 sees the guide object G1 and displays the guide object G1 on the sub monitor 130. It is possible to grasp the displayed display information. Further, since the partial drawing object corresponding to the guide object G1 is displayed on the sub monitor 130 in a size corresponding to the resolution of the sub monitor 130, the user of the sub monitor 130 can easily see the partial drawing object.

Here, when the range of the drawing object displayed on the main monitor 120 is large, it is conceivable that a part of the display information grouped by the extraction processing unit 214 protrudes from the guide object G1. For example, as shown in FIG. 7A, when the user inputs the drawing object T3 and the extraction processing unit 214 groups the drawing objects T3, the drawing object T3 does not fit in the guide object G1 and a part of the drawing object T3 does not fit. It may protrude from the guide object G1. In this case, as shown in FIG. 7B, only the portion included in the frame of the guide object G1 is displayed on the sub monitor 130, and appropriate information cannot be presented to the user who browses the sub monitor 130. ..

Therefore, when a part of the display information grouped by the extraction processing unit 214 protrudes from the guide object G1, the guide processing unit 213 sets the guide object G1 so that all of the display information fits in the guide object G1. At least one of the size and the position may be adjustable. For example, as shown in FIG. 8A, when the user performs an operation of expanding the frame of the guide object G1 so as to include the drawing object T3 with the touch pen 300, the guide processing unit 213 changes (enlarges) the size of the guide object G1. To do. The guide object G11 indicates a guide object whose size has been changed. Further, when the user performs an operation of moving the guide object G1 with the touch pen 300, the guide processing unit 213 moves the position of the guide object G1. In this way, the guide processing unit 213 adjusts at least one of the size and the position of the guide object G1 based on the operation of the user.

Further, the guide processing unit 213 may automatically adjust at least one of the size and the position of the guide object G1 so as to include the entire grouped display information without requiring the user's operation. Good.

Then, the display processing unit 215 reduces the partial drawing object extracted by the extraction processing unit 214 to a size corresponding to the second resolution and displays it on the sub monitor 130. As a result, as shown in FIG. 8B, all of the drawing objects T3 included in the frame of the guide object G11 are displayed on the sub monitor 130, and appropriate information is presented to the user who browses the sub monitor 130. The object.

9A and 9B show a display example when the user moves the guide object G1. For example, when the guide object G1 includes only the drawing object T3, the user moves the guide object G1 to the position of the guide object G11 (see FIG. 9A) to move the drawing objects T3 and T4 included in the guide object G11. It can be displayed on the sub monitor 130 (see FIG. 9B).

Although the details will be described later, when there are a plurality of sub-monitors (two sub-monitors 130 and 140 in FIG. 1), the control unit 210 displays a guide object on the main monitor 120 for each sub-monitor and corresponds to each guide object. The partial drawing object to be displayed may be displayed on each sub monitor.

[Information processing]
Hereinafter, the information processing executed in the information processing apparatus 1 will be described with reference to FIG. Specifically, in the present embodiment, the information processing is executed by the control unit 210 of the information processing device 1. The control unit 210 may end the information processing in the middle by a predetermined operation of the user.

The present invention can be regarded as an invention of an information processing method for executing one or a plurality of steps included in the information processing. In addition, one or more steps included in the information processing described here may be omitted as appropriate. The execution order of each step in the information processing may be different as long as the same effect is produced. Further, although the case where each step in the information processing is executed by the control unit 210 as an example will be described here, there are other information processing methods in which each step in the information processing is distributed and executed by a plurality of processors. Can be considered as an embodiment of.

For example, when the user selects the "guide mode" on the screen shown in FIG. 4A of the touch display 100, in step S11, the control unit 210 detects the designated position designated by the user on the main monitor 120 and the designated position. Display the guide object G1 (see FIG. 6A). Step S11 is an example of the input detection step and the guide step of the present invention.

Next, in step S12, the control unit 210 extracts the display information (partial drawing object) displayed at the position corresponding to the guide object G1 on the main monitor 120 and displays it on the sub monitor 130 (see FIG. 6B). .. Step S12 is an example of the extraction step and the display step of the present invention.

Next, in step S13, it is determined whether or not the input by the touch pen 300 or the finger to the touch display 100 is detected. When the input is detected (S13: YES), the process proceeds to step S14. Step S13 is an example of the input detection step of the present invention.

In step S14, the control unit 210 determines whether or not the end command has been selected by the user. When the end command is selected (S14: YES), the process ends. If the control unit 210 does not acquire the end command (S14: NO), the process proceeds to step S15.

In step S15, the control unit 210 determines whether or not drawing information has been acquired. For example, when the user inputs drawing information with the touch pen 300, the control unit 210 acquires the drawing information. When the drawing information is acquired (S15: YES), the control unit 210 executes a drawing process (see FIG. 11) described later. When not shifting to the drawing process (S15: NO), the process shifts to step S16.

In step S16, the control unit 210 determines whether or not the user has accepted the operation of changing the position and size of the guide object G1 displayed on the main monitor 120. When the user accepts the change operation of the guide object G1 (S16: YES), the control unit 210 executes the guide change process (see FIG. 12) described later. When the change operation of the guide object G1 is not accepted from the user (S16: NO), the process proceeds to step S17.

In step S17, the control unit 210 determines whether or not another command has been received from the user. When another command is received from the user (S17: YES), the control unit 210 executes the command processing. If no other command is accepted from the user (S17: NO), the process returns to step S11. The command is, for example, a printing process, a saving process, or the like of a material including a drawing object. Since these command processes are well-known processes, description thereof will be omitted.

[Drawing process]
The drawing process will be described with reference to FIG.

In step S21, the control unit 210 acquires the page number and the position coordinates of the input position of the drawing object input by the user. For example, the control unit 210 acquires the page number and the position coordinates of the drawing object T2 input to the touch panel 110 by the user with the touch pen 300 (see FIG. 6A and the like). The control unit 210 registers the acquired page number and position coordinate information and the input information in the drawing information 223 (see FIG. 3).

Next, in step S22, the control unit 210 groups the drawing contents. For example, when the user specifies the vicinity of the drawing object T2 on the touch panel 110 with the touch pen 300, the entire drawing object T2 is grouped into one group.

Next, in step S23, the control unit 210 calculates the center position of the group. For example, the control unit 210 calculates the center position of the drawing object T2.

Next, in step S24, the control unit 210 adjusts and records the position of the guide object G1. For example, the control unit 210 adjusts the position of the guide object G1 so that the center position of the drawing object T2 and the center position of the guide object G1 match, and displays the guide object G1 on the main monitor 120. The control unit 210 stores the position coordinates of the guide object G1 in the storage unit 220 in association with the drawing object T2.

After that, the process proceeds to step S16 of FIG.

[Guide change process]
The guide change process will be described with reference to FIG.

In step S31, the control unit 210 determines whether or not the operation of switching the display mode to the guide mode or the normal mode has been accepted. When the control unit 210 receives the operation (S31: YES), the control unit 210 performs a process of switching the display mode in step S32. On the other hand, when the control unit 210 does not accept the operation (S31: NO), the process proceeds to step S33.

In step S33, the control unit 210 determines whether or not the operation of changing the position of the guide object G1 has been accepted from the user. When the operation is accepted (S33: YES), the process proceeds to step S34. On the other hand, when the operation is not accepted (S33: NO), the process proceeds to step S35.

In step S34, the control unit 210 changes the position of the guide object G1 according to the operation of the user (see FIG. 9A). The control unit 210 stores the changed position information (position coordinates) in the storage unit 220.

In step S35, the control unit 210 determines whether or not the user has accepted the operation of changing the size of the guide object G1. When the operation is accepted (S35: YES), the process proceeds to step S36. On the other hand, when the operation is not accepted (S35: NO), the process proceeds to step S37.

In step S36, the control unit 210 changes the size of the guide object G1 according to the operation of the user. For example, when the user performs an operation to enlarge the guide object G1 with the touch pen 300, the control unit 210 enlarges the size of the guide object G1 (see FIG. 8A). The control unit 210 stores the changed size information in the storage unit 220.

In step S37, the control unit 210 determines whether or not the user has accepted the operation of returning the size of the guide object G1 to the original size. When the operation is accepted (S37: YES), the process proceeds to step S38. On the other hand, when the operation is not accepted (S37: NO), the process proceeds to step S39.

In step S38, the control unit 210 returns (reduces) the size of the guide object G1 to the original size according to the operation of the user. The control unit 210 stores the changed size information in the storage unit 220.

In step S39, the control unit 210 determines whether or not the user has accepted the operation of fixing the position of the guide object G1. When the operation is accepted (S39: YES), the process proceeds to step S40. On the other hand, when the operation is not accepted (S39: NO), the process ends.

In step S40, the control unit 210 fixes the position of the guide object G1 according to the operation of the user. The control unit 210 stores the position information of the fixed guide object G1 in the storage unit 220.

After that, the process proceeds to step S17 of FIG. When a plurality of guide objects exist, the control unit 210 executes the guide change process for the guide object selected by the user.

The information processing device 1 according to the embodiment executes the information processing as described above.

As described above, the information processing apparatus 1 displays the guide object G1 indicating the display area of the sub monitor 130 of the second resolution on the main monitor 120 of the first resolution, and the drawing object displayed on the main monitor 120. Among them, the partial drawing object included in the guide object G1 is reduced to a size corresponding to the second resolution and displayed on the sub monitor 130. As a result, the user of the touch display 100 can see the guide object G1 and grasp the display information displayed on the sub monitor 130. Therefore, the user of the main monitor 120 can accurately grasp the range of the image displayed on the sub monitor 130. Further, since the information intended by the user of the touch display 100 is enlarged and displayed on the sub monitor 130, the user who browses the sub monitor 130 can surely visually recognize (acquire) the information.

The present invention is not limited to the above-described embodiment.

As another embodiment, when the information processing apparatus 1 includes a plurality of sub-monitors (two sub-monitors 130 and 140 in FIG. 1), a guide object is displayed on the main monitor 120 for each sub-monitor, and the guide object corresponds to each guide object. Partial drawing objects may be displayed on each sub-monitor. That is, the guide processing unit 213 causes the main monitor 120 to display a first guide object having a size corresponding to the second resolution of the sub monitor 130 (corresponding to the second display unit of the present invention), and the sub monitor 140 (corresponding to the second display unit of the present invention). A second guide object having a size corresponding to the third resolution (corresponding to the third display unit) is displayed on the main monitor 120. The second resolution and the third resolution may be the same or different. The extraction processing unit 214 extracts the first display information displayed at the position corresponding to the first guide object displayed by the guide processing unit 213 on the main monitor 120, and the first display information displayed by the guide processing unit 213. 2 Extract the second display information displayed at the position corresponding to the guide object. Then, the display processing unit 215 displays the first display information extracted by the extraction processing unit 214 on the sub monitor 130 in a size corresponding to the second resolution, and the second display extracted by the extraction processing unit 214. The information is displayed on the sub monitor 140 in a size corresponding to the third resolution.

For example, as shown in FIG. 13, the control unit 210 (guide processing unit 213) causes the main monitor 120 to display the guide object G1 corresponding to the sub monitor 130 and the guide object G2 corresponding to the sub monitor 140. At this time, the control unit 210 may have different display modes (line color, thickness, type, etc.) so that the guide object G1 and the guide object G2 can be distinguished from each other. Then, the control unit 210 displays the partial drawing object T11 included in the guide object G1 on the sub monitor 130 in a size corresponding to the second resolution, and sets the partial drawing object T21 included in the guide object G2 to the third resolution. It is displayed on the sub monitor 140 with the corresponding size. As a result, different information can be presented for each sub monitor. Further, the user of the main monitor 120 can easily grasp the contents displayed on each sub monitor.

By the way, for example, when the guide object G1 has a size corresponding to the resolution of the sub monitor 130, as shown in FIG. 14A, a part of the partial drawing object T5 is formed at the boundary portion of the frame of the guide object G1 displayed on the main monitor 120. Is displayed, as shown in FIG. 14B, there arises a problem that the end portion of the partial drawing object T5 becomes difficult to see on the sub monitor 130. For example, in the case where the user inputs the drawing information in the frame of the guide object G1 after displaying the guide object G1 on the main monitor 120, when the user inputs the drawing information in the boundary portion of the frame of the guide object G1, the above Problems are likely to occur.

In order to solve this problem, in the information processing device 1, the guide processing unit 213 displays a guide object having a resolution higher than the second resolution on the main monitor 120, and the extraction processing unit 214 causes the guide to display the guide object. A partial drawing object having a size higher than the second resolution (fourth resolution) is extracted by the object, and the display processing unit 215 adjusts the extracted partial drawing object to a size corresponding to the second resolution. It is reduced and displayed on the sub monitor 130. The first resolution> the fourth resolution> the second resolution is satisfied.

For example, as shown in FIG. 15A, the guide processing unit 213 causes the main monitor 120 to display the guide object G3 having the size of the fourth resolution. The extraction processing unit 214 extracts the partial drawing object T5 having the size of the fourth resolution by the guide object G13. Then, as shown in FIG. 15B, the display processing unit 215 reduces the extracted partial drawing object T5 to a size corresponding to the second resolution and displays it on the sub monitor 130. As a result, even when a part of the partial drawing object overlaps the boundary portion of the frame of the guide object G1 on the main monitor 120, the entire partial drawing object can be displayed on the sub monitor 130. The guide processing unit 213 may change the guide object G1 to the guide object G3 and display it on the main monitor 120, or may display only the guide object G1 without displaying the guide object G3.

Further, as another embodiment, the control unit 210 provides guide information G10 indicating the position where the partial drawing object displayed on the sub monitor 130 is displayed in the display area of the display screen of the main monitor 120 on the sub monitor 130. It may be displayed. FIG. 16 corresponds to the example of FIG. 6A. As a result, the user of the sub monitor 130 can recognize that the information displayed in the lower right portion of the main monitor 120 is displayed on the sub monitor 130 by the guide information G10 shown in FIG.

The information processing device of the present invention may be configured by omitting the touch panel 110 and the touch pen 300. For example, the information processing device of the present invention may be composed of a control device 200, a main monitor 120, or a plurality of sub monitors. Further, the information processing device of the present invention may be composed of only the control device 200. In this configuration, the information processing apparatus of the present invention causes the main monitor 120, one or a plurality of sub-monitors connected via a network to execute various display processes. Further, the information processing device of the present invention may be composed of a control device 200 and a touch display 100. In this case, the control device 200 and the touch display 100 may be composed of separate devices and may be connected to each other by the network N1, or may be composed of one device (input display device). For example, when the sub monitor 130 is connected to the network N1, the input display device acquires the second resolution of the sub monitor 130, and the display information displayed on the input display device is increased in size according to the second resolution. Now it is displayed on the sub monitor 130.

Further, the sub-monitors 130 and 140 (second display unit of the present invention) may be information processing devices such as smartphones, mobile phones, and tablet terminals. These information processing devices are connected to the control device 200 and the touch display 100 via the network N1.

In the information processing apparatus 1 according to the present invention, within the scope of the invention described in each claim, each of the above-described embodiments can be freely combined, or each embodiment can be appropriately modified or partially modified. It can also be configured by omitting it.

1: Information processing device 100: Touch display 110: Touch panel 120: Main monitor 130: Sub monitor 140: Sub monitor 200: Control device 210: Control unit 211: Detection processing unit 212: Drawing processing unit 213: Guide processing unit 214: Extraction processing unit 215: Display processing unit

Claims (11)

An information processing device capable of displaying display information displayed on a first display unit having a first resolution on a second display unit having a second resolution lower than the first resolution.
A detection processing unit that detects a designated position specified by the user in the first display unit,
A guide processing unit that displays a guide object having a size corresponding to the second resolution on the first display unit based on the designated position detected by the detection processing unit.
In the first display unit, an extraction processing unit that extracts the first display information displayed at a position corresponding to the guide object displayed by the guide processing unit, and
A display processing unit that displays the first display information extracted by the extraction processing unit on the second display unit in a size corresponding to the second resolution.
Information processing device equipped with. The extraction processing unit groups the display information displayed in the vicinity of the designated position, and among the grouped display information, the display information displayed at the position corresponding to the guide object is the first display information. Extract as,
The information processing device according to claim 1. The guide processing unit causes the first display unit to display the guide object so that the center position of the display information grouped by the extraction processing unit coincides with the center position of the guide object.
The information processing device according to claim 2. When a part of the display information grouped by the extraction processing unit protrudes from the guide object, the guide processing unit determines the size of the guide object so that all of the display information fits in the guide object. Adjust at least one of the positions,
The information processing device according to claim 2 or 3. The guide processing unit adjusts at least one of the size and position of the guide object based on the operation of the user.
The information processing device according to claim 4. The guide processing unit causes the first display unit to display the guide object having a resolution higher than that of the second resolution.
The extraction processing unit extracts the first display information having a resolution higher than that of the second resolution by the guide object.
The display processing unit reduces the size of the first display information extracted by the extraction processing unit to a size corresponding to the second resolution and displays it on the second display unit.
The information processing device according to any one of claims 1 to 5. The information processing device can display the display information displayed on the first display unit on the second display unit and the third display unit having a third resolution lower than the first resolution.
The guide processing unit displays a first guide object having a size corresponding to the second resolution on the first display unit, and displays a second guide object having a size corresponding to the third resolution on the first display unit. Display on
The extraction processing unit extracts the first display information displayed at a position corresponding to the first guide object displayed by the guide processing unit in the first display unit, and displays the first display information by the guide processing unit. The second display information displayed at the position corresponding to the second guide object is extracted.
The display processing unit displays the first display information extracted by the extraction processing unit on the second display unit in a size corresponding to the second resolution, and the second display processing unit extracts the second display information. The display information is displayed on the third display unit in a size corresponding to the third resolution.
The information processing device according to any one of claims 1 to 6. The guide processing unit causes the first display unit to display the first guide object and the second guide object in different display modes.
The information processing device according to claim 7. The first display information includes a partial background image included in the guide object among the background images displayed on the first display unit.
The information processing device according to any one of claims 1 to 8. An information processing method capable of displaying display information displayed on a first display unit having a first resolution on a second display unit having a second resolution lower than the first resolution.
A detection step for detecting a designated position designated by the user in the first display unit, and
A guide step for displaying a guide object having a size corresponding to the second resolution on the first display unit based on the designated position detected by the detection step.
In the first display unit, an extraction step for extracting the first display information displayed at a position corresponding to the guide object displayed by the guide step, and
A display step of displaying the first display information extracted by the extraction step on the second display unit in a size corresponding to the second resolution.
An information processing method that is executed by one or more processors. An information processing program capable of displaying display information displayed on a first display unit having a first resolution on a second display unit having a second resolution lower than the first resolution.
A detection step for detecting a designated position designated by the user in the first display unit, and
A guide step for displaying a guide object having a size corresponding to the second resolution on the first display unit based on the designated position detected by the detection step.
In the first display unit, an extraction step for extracting the first display information displayed at a position corresponding to the guide object displayed by the guide step, and
A display step of displaying the first display information extracted by the extraction step on the second display unit in a size corresponding to the second resolution.
An information processing program for causing one or more processors to execute.