WO2007032219A1 - Image information processing device, image information processing method, and program - Google Patents

Abstract

[PROBLEMS] Conventional image information processing devices involve a problem of poor operability. [MEANS FOR SOLVING PROBLEMS] An image information processing device comprises a first-image information output section (12) for outputting first image information by using an image display window, a region specification instruction receiving section (14) for receiving a region specification window creating instruction and a region specification window movement instruction, a region specification window output section (15) for outputting a region specification window according to a region specification window creation instruction and moving the region specification window according to a region specification window movement instruction, a setting instruction receiving section (16) for receiving a setting instruction, an execution instruction region creating section (17) for creating execution instruction region setting information for setting a region in a region instruction window of the first image information an execution instruction region in an execution instruction region according to the setting instruction, and an execution instruction creating section (18) for creating execution instruction information outputted when an execution instruction region is specified according to the setting instruction.

Description

 Specification

 Image information processing apparatus, image information processing method, and program

 Technical field

 [0001] The present invention relates to an image information processing apparatus capable of processing image information.

 Background art

 Conventionally, as a technique for providing an interactive operation with respect to an image, there is a technique called V, a so-called “cricket force bull map” (see, for example, Patent Document 1). This is because the HTML file that refers to the image file stores information that sets the correspondence between the position in the image and various link destinations, and the information corresponding to the clicked position on the image is stored. Move to the link destination, open the linked file, etc.

 By using such a technique, for example, by clicking an object in the image displayed on the information processing apparatus, the user can explain the clicked object, etc. For example, information to be displayed can be sequentially displayed on another screen, for example.

 [0004] In conventional image information processing apparatuses, in general, in order to set an area having link information on an image, a selection range is first created on the image by dragging the mouse and the selection range is selected. By setting the link destination information for the area on the image, the link was set on the area on the image.

[0005] In addition, as a conventional image information processing apparatus, there is an apparatus having a so-called screen shot function that can be output to a display !, or can acquire all or part of the image as image information. there were. (For example, see Patent Document 2).

 Patent Document 1: Japanese Patent Laid-Open No. 10-302076 (Page 1, Fig. 1 etc.)

 Patent Document 2: Japanese Patent Laid-Open No. 2001-75696 (1st page, Fig. 1 etc.)

 Disclosure of the invention

 Problems to be solved by the invention

However, conventionally, in order to create a selection range on the image displayed in the window, when the image is scrolled, the selection range is also scrolled in conjunction with the image. For example, if a part of the image selected by the selection area moves outside the window and disappears, the selection area also moves and disappears in the same way, and it becomes difficult to know where it was selected. Shima! The operability is bad! There was a problem.

 [0007] In addition, since the selection range moves in conjunction with the image, when the relative position of the selection range with respect to the image is moved, it is always necessary to move the selection range other than the image, and the degree of freedom of operation is increased. There was a problem of low workability. For example, when the size of the selection range is small, it is often very difficult to move the selection range by dragging and dropping using a mouse or the like. In addition, when the selection range can be changed in size by manipulating the sides, it is possible that the shape of the selection range may be changed by mistake when moving the selection range.

 [0008] In addition, when the created selection area is moved over a portion not displayed in the image window, if the image is simply scrolled, the selection area is also scrolled at the same time, and the selection area becomes invisible. It may not be possible. For this reason, it is necessary to move the selected area after the non-displayed portion is displayed in the window by scrolling or the like, and there is a problem that the operability is bad.

 On the other hand, when acquiring image information that has been output to a conventional image information processing apparatus, image information of a desired character may be added to the acquired image information. There was a problem that it was not possible. For this reason, when adding characters to the acquired image information, the acquired image information is temporarily stored on a memory node disk or the like, and then this image information is used for a computer that executes an image processing application or the like. It was necessary to save it again after adding the image information of the text.

 [0010] On the other hand, in a conventional image information processing apparatus, in order to know where an area having link information or the like such as an image is, a pointer or the like must be arranged in the area on the image. I helped. For this reason, it is difficult to instantly recognize where the link information is set on the image.

[0011] In order to solve such a problem, in order to clearly indicate an area where link information or the like such as an image is set, another image such as link information or the like is included in the area having the link information or the like. It is conceivable to display an image or the like indicating that it has. [0012] However, when it is possible to display another image on an area where link information or the like is set, the image information corresponding to the size of the area having the link information or the like is displayed in advance. Prepared using image processing software, etc., and it is necessary to place or paste the image by specifying the position to be overlaid on the image to be overlaid, which complicates the work. In addition, knowledge for creating image information is required, and there is a problem that operability is very poor.

 Means for solving the problem

[0013] An image information processing apparatus according to the present invention includes a first image information storage unit that can store first image information, and an image display that is a window for displaying the first image information. A first image information output unit that outputs using a window, an area designation window generation instruction that is an instruction to generate an area designation window that is a window for designating an area, and an instruction to move the area designation window An area designation instruction receiving unit that accepts an area designation window movement instruction, and an area designation window is output based on the area designation window generation instruction, and the output area designation is output based on the area designation window movement instruction. An area designation window output unit for moving the window and outputting an area located within the area designation window of the first image information A setting instruction receiving unit that receives a setting instruction that is an instruction for setting in an execution instruction area that is an area for outputting execution instruction information that is information for instructing execution of processing, and based on the setting instruction, When an execution instruction area configuration unit constituting execution instruction area setting information, which is information for setting an area positioned in the area specification window as an execution instruction area, and the execution instruction area of the first image information are specified Execution instruction information, which is information output to the execution instruction, is configured based on the setting instruction, and includes an area information output unit that outputs the execution instruction area setting information and the execution instruction information. This is an image information processing device.

 [0014] With this powerful configuration, the area designation window can be freely moved with respect to the image display window, and the operability when selecting an area in the image can be improved.

[0015] In addition, the image information processing apparatus of the present invention is an instruction to change the size of the area designation window further to the image information processing apparatus. The area designation window output unit is an image information processing apparatus that changes and outputs the size of the output area designation window based on the area designation window size change instruction. .

 [0016] With the powerful configuration, the area designation window can be freely resized with respect to the image display window, and the operability when selecting an area in the image can be improved.

 [0017] Also, in the image information processing apparatus of the present invention, the area designation window output unit outputs the area designation window to the front of the image display window. An image information processing apparatus.

[0018] By virtue of the configuration, the area designation window can be missed.

[0019] Also, the image information processing apparatus of the present invention includes an image information instruction receiving unit that receives an image display window moving instruction that is an instruction to move the image display window! In addition, the first image information output unit is an image information processing apparatus that moves the image display window based on the image display window movement instruction.

 [0020] With this powerful configuration, the image display window can be freely moved with respect to the area designation window, and operability when selecting an area in the image can be improved.

 [0021] Further, in the image information processing apparatus according to the present invention, in the image information processing apparatus, the execution instruction area configuration unit includes at least a part of the area designation window arranged outside the image display window. In the image processing apparatus, the execution instruction area setting information indicating the position of the first image information corresponding to the position where the area designation window is arranged is displayed.

 [0022] With the coverable configuration, the execution instruction area can be set for the first image information outside the image display window.

 The image information processing apparatus of the present invention is an image information processing apparatus in which the background color in the area designation window is transparent.

[0024] The powerful configuration makes it easy to confirm the position where the area designation window is arranged. [0025] In addition, the image information processing apparatus of the present invention provides instructions to the image information processing apparatus to operate the area in the area designation window in the area in the area designation window. It is an image information processing apparatus that is received by an output image display window.

 [0026] With this powerful configuration, the area designation window can be made less likely to hinder operations on the image display window.

 [0027] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with an execution instruction area on the execution instruction area of the first image information. It is an image information processing apparatus that outputs area image information that is image information for showing.

 [0028] With this powerful configuration, it is possible to easily recognize the execution instruction area.

 [0029] Also, in the image information processing apparatus of the present invention, the area information instruction receiving unit accepts input of characters into the area specification window, and outputs the area information. The unit is an image information processing apparatus that outputs the received character on the execution instruction area of the first image information.

 [0030] By virtue of the powerful configuration, the character information can be freely displayed on the execution instruction area, and the operability when the character information is arranged on the first image information can be improved.

[0031] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with location information for receiving location information that is information indicating the location of desired information. The execution instruction configuration unit is an image information processing apparatus that configures execution instruction information for executing predetermined processing on the desired information indicated by the location information.

[0032] With the powerful configuration, the information at the location indicated by the location information can be displayed.

[0033] Further, in the image information processing apparatus of the present invention, the location information is a URL, and the execution instruction configuration unit is configured to acquire the URL force information. It is the image information processing apparatus which comprises the execution instruction information for performing a process.

[0034] With the powerful configuration, information in the URL can be displayed.

[0035] Further, in the image information processing apparatus of the present invention, the location information is directory information indicating the location of the second information, and the execution instruction configuration unit includes: An image information processing apparatus that constitutes execution instruction information for executing a process of acquiring and outputting the second information from a directory indicated by the directory information.

 [0036] With this configuration, the second information in the desired directory can be displayed.

In the image information processing apparatus of the present invention, the second information is information that can be output as an image to the image information processing apparatus, and the execution instruction area configuration unit Based on the directory information, a reduced image of the second information is configured, and the area information output unit is an image information processing apparatus that outputs the reduced image on the execution instruction area of the first image information.

 [0038] With the coverable configuration, an image displayed by designating the execution instruction area can be recognized in advance.

 [0039] In addition, the image information processing apparatus of the present invention is configured so that the first image information output unit outputs the image display window to the image information processing apparatus, and the first image information output unit An image acquisition instruction receiving unit that receives an image acquisition instruction that is an instruction for acquiring image information of at least a partial area of the output image, and at least a part of the image that is output based on the image acquisition instruction An image acquisition unit that acquires image information of the second area as the second information, wherein the location information is directory information indicating the location of the second information acquired by the image acquisition unit. is there.

 [0040] With this powerful configuration, it is possible to configure image information that can be easily interactively operated using an image on the screen.

 [0041] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with the area information output unit, the execution instruction area setting information, the execution instruction information, and the first The image information processing apparatus transmits image information to a predetermined address set in advance.

 [0042] The powerful configuration makes it possible to easily back up the created information and to make the created information available to others.

[0043] In addition, the image information processing apparatus of the present invention is the image information processing apparatus! The area information output unit includes the execution instruction area setting information, the execution instruction information, and the first Image information and an image in a directory indicated by the directory information are set in advance. The image information processing apparatus transmits to a predetermined address.

 [0044] The powerful configuration makes it possible to easily back up the created information and to make the created information public to others.

 In the image information processing apparatus of the present invention, the execution instruction area setting information of the first image information output from the first image information output unit is set in the image information processing apparatus. An image information processing apparatus further comprising: a designation information receiving unit that receives designation information that designates an execution instruction area to be executed; and an execution instruction information output unit that outputs the execution instruction information in response to the reception of the designation information It is.

 [0046] With the powerful configuration, interactive operations can be checked and enjoyed.

 In the image information processing apparatus of the present invention, the execution instruction area setting information of the first image information output from the first image information output unit is set in the image information processing apparatus. Based on the execution instruction information, a designation information receiving unit that receives designation information for designating, an execution instruction information output unit that outputs the execution instruction information in response to reception of the designation information, The image information processing apparatus further includes a second information output unit that acquires and outputs the second information from the directory indicated by the directory information.

 [0048] With the powerful configuration, it is possible to check and enjoy interactive operations.

[0049] The image information processing apparatus of the present invention includes a character instruction receiving unit that receives a character window moving instruction that is an instruction to move a character window that is a window for outputting characters, and a character input receiving that receives character input. And a character window output unit that outputs a character window in which the character received by the character input receiving unit is output, moves the character window to a position based on the character window moving instruction, and an area. An area designation window that is an instruction to move an area designation window that is a window for designating an area designation instruction receiving unit that accepts an instruction to move, an area designation window is output, and the output is performed based on the area designation window movement instruction. The area designation window output section that outputs the area designation window that has been moved, and the area designation window Output to a region within Indou An acquisition instruction reception unit that receives an acquisition instruction that is an instruction to acquire the image information that has been acquired, an area image acquisition unit that acquires image information output to an area in the area specification window in response to the acquisition instruction, An image information processing apparatus comprising: an output unit that outputs an image acquired by the region image acquisition unit.

 [0050] With this powerful configuration, it is possible to add a desired character when acquiring output image information using a character window. In addition, for example, images on two or more windows output by different applications etc. can be used to move characters independently of these windows, so that characters can be seamlessly printed on these windows. It is possible to

 [0051] In addition, the image information processing apparatus of the present invention further includes a frame output instruction receiving unit that receives a frame output instruction that is an instruction of force or power to output a frame of a character window to the image information processing apparatus. The character window output unit is an image information processing apparatus that outputs or does not output a character window frame based on the frame output instruction.

 [0052] Due to the powerful configuration, for example, when moving a character window, a frame for dragging the character window can be displayed to make the character window easier to operate, and image information about the character window can be displayed. At the time of acquisition, unnecessary frames can be deleted, and the user's usage and convenience can be improved.

 Further, the image information processing apparatus of the present invention receives magnification designation information that receives magnification designation information, which is information for designating a magnification for the image information acquired by the area image acquisition unit, to the image information processing apparatus. The area image acquisition unit is an image information processing apparatus that acquires, by enlarging or reducing, image information output to an area in the area specifying window based on the magnification specifying information.

 [0054] Due to the powerful configuration, when changing the size of the acquired image information, it is not necessary to open the acquired image information in another application, etc., and perform processing to reduce or enlarge it. Can be made.

[0055] Further, in the image information processing apparatus of the present invention, the character instruction accepting unit further sends a character window size change instruction, which is an instruction to change the size of the character window, to the image information processing apparatus. The character window output unit accepts the character window. This is an image information processing apparatus that changes the size of the output character window based on a size change instruction and outputs the changed character window.

 [0056] With a powerful configuration, a range for adding characters can be freely set.

 In the image information processing apparatus of the present invention, the area designation instruction receiving unit further instructs the image information processing apparatus to change the size of the area designation window. The area designation window output unit receives an instruction, and the area designation window output unit is based on the area designation window size change instruction! This is an image information processing apparatus that changes the size of the output area designation window and outputs the changed area specification window.

 [0058] With this configuration, the range for acquiring image information can be set freely.

 [0059] Further, in the image information processing apparatus of the present invention, the area designation window output unit outputs the area designation window to the front of all other windows to the image information processing apparatus. The window output unit is an image information processing apparatus that outputs the character window to the front of all other windows excluding the area designation window.

 [0060] Due to the powerful configuration, the position and range where image information is acquired and the position and range where characters are added are always checked, even when operating a window other than the area specification window or character window. And operability can be improved.

The image information processing apparatus of the present invention outputs a first information storage unit that can store first information, and the first information to a first information display window that is a window for displaying the first information. A first information output unit that receives the first window generation instruction that receives a first window generation instruction that is an instruction for generating a first window that is a window that specifies the first area, and the first window generation instruction. A first window output unit that outputs a first window, a second area designation instruction receiving unit that receives a second window generation instruction that is an instruction to generate a second window that is a window for designating a second area, Second window output unit that outputs a second window in response to a second window generation instruction, and an instruction to acquire image information output to an area in the second window An acquisition instruction receiving unit that receives an acquisition instruction; an area image acquisition unit that acquires area image information that is image information output to an area in a second window in response to the acquisition instruction; The area image information acquired by the image acquisition unit is located in the first window of the first information. An image information processing apparatus including an area image output unit that outputs an image on a previously existing area.

 [0062] With the powerful configuration, it is possible to reduce the time and effort required to prepare an image whose size has been adjusted in advance as area image information to be output on the first information, and to acquire area image information. The area and the position to display the acquired area image information can be set intuitively by moving the first window and the second window, and a desired area on the image output by the first information, for example, a link It is possible to easily display other images in an area where information is set.

 [0063] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with a first area designation instruction receiving unit that further includes an instruction for moving the first window. Receiving the window moving instruction, the second area designation instruction receiving unit further receives a second window moving instruction that is an instruction to move the second window, and the first window output unit further receives the first window output unit. In response to a window movement instruction, the output first window is moved and output, and the second window output unit further moves the output second window in response to the second window movement instruction. This is an image information processing device that outputs the information.

 [0064] With the powerful configuration, the position of the area from which the area image information is acquired or the area from which the area image information is output can be easily changed by moving the first window or the second window.

 [0065] Further, in the image information processing apparatus of the present invention, the first area designation instruction receiving unit further instructs the image information processing apparatus to change the size of the first window. A first window size change instruction is received, and the second region designation instruction receiving unit further receives a second window size change instruction that is an instruction to change the size of the second window, and the first window output unit Further changes the size of the output first window in response to the first window size change instruction, and the second window output unit further responds to the second window size change instruction. An image information processing apparatus that changes the size of the output second window for output.

[0066] By using a powerful configuration, the size of the first window or the second window can be changed to easily change the size of the area from which the area image information is acquired or the area from which the area image information is output. It can be done.

 [0067] Also, in the image information processing apparatus of the present invention, the first area designation instruction receiving unit further instructs the image information processing apparatus to change the size of the first window. In response to the first window size change instruction, the first window output unit further changes the size of the output first window in response to the first window size change instruction, and outputs the second window output. The unit is an image information processing apparatus that further changes the size of the output second window in response to the first window size change instruction.

 [0068] With the powerful configuration, the size of the second window can be changed in accordance with the size change of the first window. For example, by setting the second window size to be the same size as the first window size in response to the first window size change instruction, the second window size is always set to the first window size. Can be the same as the window size. As a result, it is possible to easily grasp the size relationship between the region from which the region image information is acquired and the region from which the region image information is output.

 [0069] Further, in the image information processing apparatus of the present invention, the second area designation instruction receiving unit further instructs the image information processing apparatus to change the size of the second window. In response to the second window size change instruction, the second window output unit further changes the size of the output second window in response to the second window size change instruction, and outputs the first window. The unit is an image information processing apparatus that further changes the size of the output first window in response to the second window size change instruction.

 [0070] With the powerful configuration, the size of the first window can be changed according to the size change of the second window. For example, by setting the size of the first window to be the same size as the size of the second window in response to the second window size change instruction, the size of the first window is always set to the second size. Can be the same as the window size. As a result, it is possible to easily grasp the size relationship between the region from which the region image information is acquired and the region from which the region image information is output.

[0071] Further, the image information processing apparatus of the present invention is the image information processing apparatus, wherein the first The one window output unit and the second window output unit are image information processing apparatuses that always output the first window and the second window to the front of the first information display window.

 [0072] With the powerful configuration, while constantly checking the first window and the second window, the image information acquired as the area image information can be changed, or the first information displayed in the first information display window can be changed. It can be moved or changed by scrolling, etc., improving operability.

 [0073] Also, the image information processing apparatus of the present invention provides the first information for receiving a first information display window movement instruction, which is an instruction to move the first information display window, to the image information processing apparatus! The image processing apparatus further includes an instruction receiving unit, and the first information output unit moves the first information display window in response to the first information display window movement instruction.

 [0074] Due to the powerful configuration, the first information display window is moved relative to the first window and the second window, and the position of the area from which the area image information is acquired and the area from which the area image information is output Can be easily changed.

[0075] Also, the image information processing apparatus of the present invention is an image in which the first information display window, the first window, and the second window move independently in the image information processing apparatus! Information processing apparatus.

[0076] Due to the powerful configuration, the positional relationship between the first information display window, the first window, and the second window can be freely changed, and the region for acquiring the region image information and the region image information are output. The position of the area to be performed can be set freely.

[0077] Also, the image information processing apparatus of the present invention is an image information processing apparatus in which the background color in the first window and the second window is transparent. .

 [0078] With the powerful configuration, it is easy to recognize what kind of image is displayed and the area designated in the first window and the second window.

[0079] Also, the image information processing apparatus of the present invention provides instructions to the image information processing apparatus to operate the areas in the first window and the second window. This is an image information processing apparatus that the window and the second window do not accept.

 [0080] With the powerful configuration, it is possible to change the image information displayed inside the first window and the second window while constantly checking the position and size of the first window and the second window. And operability is improved.

 [0081] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with the same size as the size of the first window. This is an image information processing apparatus that changes the output.

 [0082] Due to the powerful configuration, the region image information acquired in the second window and the region in which the first window, which is the region in which the region image information is displayed, have the same size, the region image The state when information is arranged can be imagined and operability is improved immediately.

 [0083] Also, the image information processing apparatus of the present invention provides information that instructs the image information processing apparatus to execute a predetermined process on an area located in the first window of the first information. A setting instruction receiving unit that receives a setting instruction that is an instruction to set in an execution instruction area that is an area in which an execution instruction that is information is output, and an area that is located in the first window is executed according to the setting instruction The execution instruction area configuration unit that constitutes the execution instruction area setting information that is information to be set in the instruction area, and the execution instruction that is information that is output when the execution instruction area of the first information is designated An image information processing apparatus further comprising: an execution instruction configuration unit configured according to an instruction; an area information output unit that outputs the execution instruction area setting information and the execution instruction.

 [0084] With this configuration, other images can be easily displayed in the execution instruction area on the image output by the first information.

 [0085] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with the execution instruction area configuration unit in which at least a part of the first window has the first information display window. An image information processing apparatus that constitutes the execution instruction area setting information that indicates a position corresponding to a position where the first window is arranged and where the first window is placed when the first information is arranged outside the window. is there.

[0086] With the powerful configuration, it is possible to set an execution instruction area or the like in which the first information is not scrolled. [0087] Also, the image information processing apparatus of the present invention is the execution set by the execution instruction area setting information of the first information output from the first information output unit in the image information processing apparatus. An image information processing apparatus further comprising: a designation receiving unit that receives designation of an instruction area; and an execution instruction output unit that outputs the execution instruction in response to receiving the designation.

[0088] By specifying the execution instruction area by using a powerful configuration, an execution instruction can be output.

 [0089] Also, the image information processing apparatus of the present invention provides the image information processing apparatus with the area information output unit, the execution instruction area setting information, the execution instruction, and the first information. And the second image information are transmitted to a predetermined address set in advance.

 [0090] With the powerful configuration, the information configured by the image information processing apparatus can be made available to other users.

 [0091] In addition, the image information processing apparatus of the present invention provides the image information processing apparatus with a setting instruction including location information that is information indicating the location of desired information. The execution instruction configuration unit is an image information processing apparatus that configures an execution instruction that is an instruction to execute a predetermined process on the desired information indicated by the location information.

With this configuration, it is possible to acquire desired information from the position indicated by the location information and execute a predetermined process.

 [0093] Also, in the image information processing apparatus of the present invention, the location information is a URL, and the execution instruction configuring unit obtains the URL force information. This is an image information processing apparatus that constitutes an execution instruction that is an instruction to execute the processing.

[0094] With the powerful configuration, URL force desired information can be acquired and predetermined processing can be executed.

[0095] Also, the image information processing apparatus of the present invention is the execution set by the execution instruction area setting information of the first information output from the first information output unit in the image information processing apparatus. A designation accepting unit that accepts designation of an instruction area; an execution instruction output unit that outputs the execution instruction in response to accepting the designation; and a URL from the URL according to the execution instruction. The image information processing apparatus further includes an execution information output unit that acquires and outputs desired information.

 [0096] With a powerful configuration, URL force desired information can be acquired in accordance with an external force instruction, and predetermined processing can be executed.

 [0097] In addition, the image information processing apparatus of the present invention receives the setting instruction including the directory information indicating the location of the desired information in the image information processing apparatus. The execution instruction configuration unit is an image information processing apparatus that configures an execution instruction that is an instruction to execute processing to acquire and output the desired information from a directory outside the directory indicated by the directory information.

 [0098] With the powerful configuration, desired information can be acquired from the directory and predetermined processing can be executed.

 [0099] Also, the image information processing apparatus of the present invention is the execution set by the execution instruction area setting information of the first information output from the first information output unit in the image information processing apparatus. A designation accepting unit that accepts designation of an instruction area; an execution instruction output unit that outputs the execution instruction in response to accepting the designation; and the desired information from a directory that is indicated by the directory information in accordance with the execution instruction. The information processing apparatus further includes an execution information output unit that acquires and outputs the information.

 [0100] With a powerful configuration, it is possible to acquire desired information from the directory and execute predetermined processing in response to an external force instruction.

 [0101] Also, in the image information processing device of the present invention, in the image information processing device, the area information output unit includes the execution instruction area setting information, the execution instruction, the first information, and the first information. This is an image information processing apparatus for transmitting two-image information and desired information in a directory indicated by the directory information to a predetermined address set in advance.

 [0102] With the powerful configuration, the information configured by the image information processing apparatus can be made available to other users.

 The invention's effect

[0103] According to the image information processing apparatus and the like according to the present invention, it is possible to improve operability when selecting a region in an image. [0104] Also, according to the image information processing apparatus of the present invention, desired characters can be added when acquiring the output image information.

[0105] Further, according to the image information processing apparatus and the like according to the present invention, a desired area on the image, for example,

In addition, it is possible to easily display other images in an area where link information or the like is set.

 BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of an image information processing apparatus and the like will be described with reference to the drawings. Note that components having the same reference numerals in the embodiment perform the same operation, and thus the description thereof may be omitted.

[Embodiment 1]

 FIG. 1 is a block diagram of an image information processing apparatus according to the present embodiment.

The image information processing apparatus 1 includes a first image information storage unit 11, a first image information output unit 12, an image information instruction reception unit 13, an area designation instruction reception unit 14, an area designation window output unit 15, and a setting instruction reception. Unit 16, execution instruction area configuration unit 17, execution instruction configuration unit 18, area information output unit 19

A designated information receiving unit 20, an execution instruction information output unit 21, and a second information output unit 22.

 The first image information storage unit 11 can store the first image information. The first image information storage unit 11 may store initial force first image information, or the first image information may be accumulated by another processing unit or the like. The first image information is information used to display an image, regardless of whether it is bitmap information (raster information) or vector information. It does not matter whether the first image information is compressed or uncompressed. The data format of the first image information does not matter. The first image information may be in any data format such as JPEG format, GIF format, BMP format, and TIFF format. Further, the first image information may be character information such as text as long as it can be displayed as an image. The first image information storage unit 11 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium.

[0110] The first image information output unit 12 outputs the first image information using an image display window which is a window for displaying the first image information. Use window for image information The configuration displayed in the window is a well-known technique as a general window system technique, and thus the description thereof is omitted. The first image information output unit 12 moves the image display window based on an image display window moving instruction received by an image information instruction receiving unit 13 described later. The image display window movement instruction is an instruction to move the image display window. That is, it is an instruction to move the output position of the image display window in the output device, for example, a display device such as a display. The image display window movement instruction includes, for example, information for specifying the movement destination of the image display window, specifically, information for specifying the coordinates and area of the movement destination in the output possible area of the output device, and the movement thereof. It consists of a command or the like for executing the forward movement. The first image information output unit 12 changes the size of the image display window based on an image display window size change instruction received by an image information instruction receiving unit 13 described later. The image display window size change instruction is an instruction to change the size of the image display window. The first image information output unit 12 enlarges or reduces the image of the first image information displayed in the image display window based on an enlargement / reduction instruction received by an image information instruction receiving unit 13 described later. Output. The enlargement / reduction instruction is an instruction to be displayed in the image display window! And to enlarge and reduce the image of the first image information. The first image information output unit 12 may or may not include an output device such as a display or a printer as an output device. The first image information output unit 12 may be realized by output device driver software, or output device driver software and an output device. Output is a concept that includes display on a display, printing on a printer, transmission to an external device, and the like.

The image information instruction accepting unit 13 accepts the above-described image display window moving instruction, which is an instruction to move the image display window. For example, when the image display window is dragged and dropped on the image display window, the image information instruction reception unit 13 receives an image display window movement instruction with the dropped position as the movement destination. In addition, when the pointer is moved within the output area of the output device and the mouse button or the like is clicked or double-clicked, the pointer is designated and the image display window move instruction is set to the target position. It may be accepted. In addition, the image information instruction receiving unit 13 receives the image display window size. The above-described image display window size change instruction, which is an instruction to change the window size, is received. The image display window size change instruction includes, for example, information on the vertical and horizontal lengths of the image display window, a command for executing change of the area designation window to the size, and the like. For example, if the image display window frame or the like is dragged and dropped, for example, the frame of the image display window, an image display window size change instruction according to the size of the window determined by the position of the dropped frame or the like is given. You can accept it. Further, the image information instruction accepting unit 13 changes the window size to a size determined by this numerical value when an unillustrated input unit or the like receives the changed size of the image display window by inputting the numerical value. You may receive an instruction to change the image display window. In addition, the image information instruction accepting unit 13 displays an enlarged or reduced image of the first image information that is displayed by selecting an enlargement command, a reduction command, etc. The above-described enlargement / reduction instruction may be accepted. The enlargement / reduction instruction may include, for example, information specifying the magnification of the image. The input received by the image information instruction receiving unit 13 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, a menu screen, and the like, and any input means may be used. The image information instruction receiving unit 13 can be realized by a device driver of input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system. The area designation instruction receiving unit 14 receives an area designation window generation instruction that is an instruction to generate an area designation window that is a window for designating an area, and an area designation window movement instruction that is an instruction to move the area designation window. Accept. The area designation window is specifically a window used for designating a desired area of the first image information. The area designation window generation instruction is an instruction for generating an area designation window, for example, a command. The area designation window movement instruction is an instruction to move the output position of the area designation window generated by the area designation window generation instruction. The area designation window movement instruction includes, for example, information for designating the movement destination of the area designation window, specifically, information for designating the coordinates and area of the movement destination within the area that can be output by the output device, and the movement destination. Consists of commands to execute movement. For example, the area designation instruction receiving unit 14 refers to the area designation window. When dragging and dropping, an area designation window move instruction with the drop position as the move destination is accepted. Also, when the pointer is moved within the area that can be output by the output device and the mouse button is clicked or double-clicked, an instruction to move the image display window with the pointer as the destination is specified. You can accept it. In addition, the area designation instruction receiving unit 14 receives an area designation window size change instruction that is an instruction to change the size of the area designation window. The area designation window size change instruction includes, for example, information on the vertical and horizontal lengths of the area designation window and a command for executing the area designation window change to the size. For example, when the area designation window 14 is dragged and dropped on a frame or side of the area designation window, the area designation window 14 changes the size of the area designation window to the window size determined by the position of the dropped frame or the like. An area designation window size change instruction may be accepted. In addition, when an input unit (not shown) receives the changed size of the area specification window by inputting a numerical value, the area specification instruction receiving unit 14 changes the window size to a size determined by this numerical value. An area designation window change instruction may be accepted. The input accepted by the area designation instruction accepting unit 14 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, or a menu screen, and any input means may be used. The area designation instruction receiving unit 14 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

The area designation window output unit 15 outputs an area designation window based on the area designation window generation instruction. Since the configuration for outputting the area designation window is a known technique as a general window system technique, the description thereof is omitted. The area designation window is an independent window with respect to the above-described image display window, and the area designation window and the image display window can be moved independently without being linked to each other. . In addition, in the area specification window, the output position can be freely set in the output area of the output device in the same way as the window of a general window system. For example, the area on the image display window described above can be set. It is also possible to output the area specification window to other areas. The area specification window is displayed on the image display window. Since it is used for designating an area, it is preferable that it is always placed in front of the above-described image display window so as not to be hidden behind the image display window. More preferably, it is arranged in the forefront with respect to all windows. For example, when the first image information output unit 12 and the region designation window output unit 15 output the image display window and the region designation window to the same display, the region designation window is always placed in front of the image display window. Will be. There is no need to display images in the area specification window. The background color in the area specification window is transparent so that you can check the area on the back of the area specification window so that you can select which area on the image! In particular, the background color is preferably transparent. Further, the area designation window may or may not have a frame. However, if the area specification window is transparent or transparent, it is preferable to display a frame so that the position of the area specification window can be confirmed. In the area designation window, an instruction to perform an operation on an area in the area designation window, specifically, an area other than the frame or side of the area designation window, such as an event, is received by the above-described area designation instruction receiving unit 14. It is preferable that a reception unit or the like that receives an instruction for an image display window or the like located on the back of the area designation window does not accept. As a result, operations such as an image display window can be performed through a portion where the area designation windows overlap. The area designation window output unit 15 moves the output area designation window based on the above-described area designation window movement instruction. That is, the area designation window is output at the position designated by the above-described area designation window movement instruction. Further, the area designation window output unit 15 changes the size of the output area designation window based on the above-described area designation window size change instruction and outputs it. That is, the area designation window having the size designated by the area designation window size change instruction described above is output. The region designation window output unit 15 may stop displaying the region designation window at any trigger or timing. For example, the area information output unit 19 (to be described later) may stop the display triggered by the output of execution instruction area setting information or the like, or an input reception unit (not shown) receives an input for instructing the end of the display. You may stop the display as a trigger. The area specification window output unit 15 As a vice, it may be considered that it includes an output device such as a display or a printer. The area designation window output unit 15 can be realized by output device driver software or output device driver software and an output device. Output is a concept that includes display on a display, printing on a printer, transmission to an external device, and the like. The setting instruction receiving unit 16 sets an area located in the area designation window of the first image information as an execution instruction area that is an area for outputting execution instruction information that is information for instructing execution of a predetermined process. A setting instruction, which is an instruction for receiving, is accepted. That is, an instruction to set an area located in the area designation window of the first image information as an execution instruction area is a setting instruction. The execution instruction area is an area for outputting execution instruction information. The execution instruction information is information that instructs execution of a predetermined process. “Output execution instruction information” refers to, for example, sending a message to another processing unit, issuing an event, or outputting a command such as an execution instruction or a start instruction. The area located in the area designation window of the first image information is, for example, an area located in the area designation window of the first image information displayed in the image display window. In addition, the area located in the area designation window of the first image information is outside the image display window of the first image information when at least a part of the area designation window is arranged outside the image display window. It may be an area including the area corresponding to the position where the area designation window is located. Specifically, when the image size of the first image information is larger than the size of the image display window, a part of the first image information is cut out and output in the image display window. Here, the area on the first image information that is output in the area designation window when the first image information is output without being cut out in the size of the image display window is also the area designation window of the first image information here. The area located inside. The setting instruction includes, for example, an instruction for setting an execution instruction area and information for setting what kind of execution instruction information is output for the set execution instruction area. The information for setting what kind of execution instruction information is output is, for example, information including location information that is information indicating the location of desired information. Specifically, if it is set in advance to output a command for executing an image opening process as execution instruction information, the directory of the image to be opened is specified as the location information in the execution instruction information. Accept directory information. In addition, if it is set in advance to output a command that causes other browser software or the like to execute processing for acquiring URL information as execution instruction information, the execution instruction information includes the execution instruction information. To receive information specifying the URL of the acquisition destination. If what kind of execution instruction information is to be output is set in advance, the setting instruction may not include information for setting what kind of execution instruction information is to be output. The input device of the setting instruction receiving unit 16 may be anything such as a numeric keypad, keyboard, mouse, or menu screen. The setting instruction receiving unit 16 can be realized by a device driver of an input device such as a numeric keypad or a keyboard, or control software for a menu screen. The execution instruction area configuration unit 17 configures execution instruction area setting information that is information for setting an area located in the area designation window as an execution instruction area based on the setting instruction received by the setting instruction receiving unit 16. To do. Specifically, this area is used as the execution instruction area described above. The execution instruction area configuration unit 17 uses, as the execution instruction area setting information, information specifying the area located in the area specification window of the first image information displayed in the image display window. However, if at least a part of the area designation window is arranged outside the image display window, the execution instruction area setting information indicating the position corresponding to the position where the area designation window is arranged in the first image information is configured. To do. Specifically, the execution instruction area setting information indicating the position where the area designation window is arranged on the first image information when the first image information is also displayed outside the image display window. Constitute. Specifically, the execution instruction area setting information is information for designating an area located in the area designation window in the first image information, and usually one or more coordinates in the first image information, for example, It has information on one of the four corners and the coordinates of the center point. For example, the execution instruction area setting information is composed of information on the coordinates of one of the four corners of the execution instruction area in the first image information and information on the size of the execution instruction area such as the vertical and horizontal lengths. The However, the execution instruction area setting information may be any information such as the coordinates of all four corners of the execution instruction area as long as the execution instruction area can be specified. Further, when the size of the execution instruction area is set in advance, only the information of one coordinate of the four corners of the execution instruction area may be used. This information is usually specified by the area. It is acquired based on information indicating the output position of the window, such as coordinates, information indicating the size of the area designation window, and the like. The execution instruction area setting information may include area image information, which is information of an image to be displayed in the area, in addition to information for specifying these areas. The area image information will be described later. The execution instruction area configuration unit 17 can usually be realized by an MPU, a memory, or the like. The processing procedure of the execution instruction area configuration unit 17 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

The execution instruction configuration unit 18 configures execution instruction information, which is information output when the execution instruction area of the first image information is designated, based on the setting instruction. The execution instruction information is specifically a process instructing execution of some process, and it does not matter what kind of process the execution instruction information is instructed to execute. Further, it does not matter what execution instruction information the execution instruction configuration unit 18 configures based on the setting instruction. For example, the execution instruction configuration unit 18 may configure a preset execution command in which information included in the setting instruction is set as a parameter. For example, when the location information is included in the setting instruction, the execution instruction configuration unit 18 configures execution instruction information for executing predetermined processing on desired information indicated by the location information. Specifically, if the location information is a URL, the execution instruction information for executing the process of acquiring the place force information indicated by the URL is configured. Further, if the location information is directory information, execution instruction information for executing processing for obtaining desired information from the directory indicated by the directory information and outputting the information may be configured. Here, the desired information is referred to as second information. In particular, here, a case where the second information is image information will be described. In addition, when a setting instruction is received, it is also possible to simply acquire predetermined execution instruction information triggered by the reception of the setting instruction. Here, the execution instruction information is configured based on the setting instruction. It is to be. The execution instruction configuration unit 18 can usually be realized by an MPU, a memory, or the like. The processing procedure of the execution instruction component 18 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

[0117] The area information output unit 19 includes an execution instruction area configuration unit 17 and an execution instruction configuration unit 18. The execution instruction area setting information and the execution instruction information are output. The area information output unit 19 sends the first image information in addition to the execution instruction area setting information and the execution instruction information to a transmission destination indicated by a predetermined address, for example, an IP address. It may be sent. Further, when the execution instruction information is information instructing to output the second information stored in a predetermined directory, this second information may be acquired and transmitted to the same address. The area information output unit 19 may output area image information that is image information for indicating the location of the execution instruction area on the execution instruction area of the first image information. An area where the area image information is output is an execution instruction area. The area image information may be any image information. Specifically, it may be image information having transparency, for example, translucent monochromatic image information. When the area information output unit 19 and the first image information output unit 12 display an image on the same display, the area image information is displayed on the execution instruction area of the image display window of the first image information. . The region information output unit 19 may be considered as including or not including an output device such as a display. The area information output unit 19 can be implemented by output device driver software, or output device driver software and an output device. Output is a concept that includes temporary storage and storage in a storage medium such as a memory, display on a display, transmission to an external device, and the like. In particular, a case where data is stored in a memory or the like will be described here.

The designation information receiving unit 20 receives designation information for designating the execution instruction area set by the execution instruction area setting information of the first image information output from the first image information output unit 12. For example, the designation information receiving unit 20 receives the designation information by designating a position, for example, coordinates, in the execution instruction area by an input from a pointing device or a keyboard. Specifically, for example, the designation information receiving unit 20 reads the designation instruction area setting information from the memory or the like, and the coordinates designated by the pointing device or the like are located in the area set by the designation time area setting information. It is determined whether or not the power to do. If it is located within the area, it is determined that the execution instruction area is designated, and the designation information is accepted. The input device of the designation information receiving unit 20 may be anything such as a numeric keypad, a keyboard, a mouse, or a menu screen. The designation information receiving unit can be realized by a device driver of an input device such as a numeric keypad or a keyboard, or control software for a menu screen. [0119] The execution instruction information output unit 21 outputs execution instruction information in response to the specification information reception unit 20 receiving the specification information. Here, the execution instruction information output unit 21 acquires and outputs execution instruction information corresponding to the execution instruction area specified by the specification information from a memory or the like. The output described here includes transmission of messages to other processing units, issuance of events, transmission of commands and start instructions, and the like. For example, when the execution instruction information is a command for acquiring and outputting image information from the directory indicated by the location information, this command is output to the second information output unit 22 described later. Then, based on this execution instruction information, the second information output unit 22 acquires image information from the directory indicated by the location information in the first image information storage unit 11 and the like, for example, in a new window. Output image information. As the execution instruction information, a predetermined execution command may be output to a device other than the image information processing device, an application executed by a computer, or the like. The correspondence relationship between the execution instruction area and the execution instruction information may be managed in any way, for example, using a table or the like. The execution instruction information output unit 21 may be considered as including or not including an output device such as a communication means. The execution instruction information output unit 21 can be realized by driver software of an output device or driver software and an output device of an output device. Output is a concept including output to other processing units in the image information processing apparatus, transmission to an external apparatus, and the like.

[0120] The second information output unit 22 acquires the second information described above from the directory indicated by the directory information based on the execution instruction information, and outputs the second information. The second information may be any information such as any image information or character information, and may be stored anywhere. The second information is usually stored in a storage medium such as a memory node (not shown). This storage medium may be the first image information storage unit 11 described above. For example, the second information output unit 22 outputs the second information using an image display window or the like. A configuration for displaying information such as image information and text information in a window using a window is a known technique as a general window system technique, and thus description thereof is omitted. The second information output unit 22 may or may not include an output device such as a display or a printer as an output device. The second information output unit 22 is output device driver software or output device driver software and output device. Can be realized. Output is a concept that includes display on a display, printing on a printer, transmission to an external device, and the like.

 Next, the operation of the image information processing apparatus will be described using the flowchart of FIG.

(Step S200) The first image information output unit 12 determines whether or not to output the first image information. The first image information output unit 12 may determine how to output image information. For example, the first image information output unit 12 outputs the first image information triggered by the image information instruction receiving unit 13 or an input receiving unit (not shown) receiving an instruction to output the first image information. You may decide that. When receiving an instruction to acquire the first image information from another device or another processing unit of the image information processing device 1, the first image information output unit 12 outputs the first image information. You may decide to do. If the first image information output unit 12 determines to output the first image information, the process proceeds to step S201. If not, the process returns to step S200.

(Step S201) The first image information output unit 12 outputs the first image information using the image display window.

 (Step S 202) The area designation instruction receiving unit 14 determines whether or not an area designation window generation instruction has been received. If accepted, the process proceeds to step S203. If not accepted, the process proceeds to step S208.

(Step S 203) The area designation window output unit 15 outputs an area designation window.

(Step S204) The setting instruction receiving unit 16 determines whether or not a setting instruction has been received.

 If accepted, the process proceeds to step S205. If not accepted, the process proceeds to step S210.

 (Step S 205) The execution instruction area configuration unit 17 configures execution instruction area setting information.

 Specifically, information specifying the area located in the area specification window of the image display window is acquired from the information of the area in the area specification window by coordinate conversion or the like, and the acquired information is set as the execution instruction area. Information.

(Step S206) The execution instruction configuration unit 18 configures execution instruction information. Specifically, an execution command or the like for outputting an image file or the like included in the setting instruction received in step S204 is configured as execution instruction information. Note that step S205 and steps What is the processing order of S206?

(Step S207) The region information output unit 19 outputs the execution instruction region setting information and the execution instruction information configured in Step S205 and Step S206. Then, return to step S204.

 (Step S 208) The image information instruction accepting unit 13 determines whether or not an image display window movement instruction has been accepted. If accepted, the process proceeds to step S209. If not accepted, the process returns to step S202.

(Step S209) First image information output unit 12 moves the image display window based on the image display window movement instruction received in step S208. Then, the process returns to step S202.

 (Step S 210) The designation information receiving unit 20 determines whether or not designation information for designating an execution instruction area has been received. If accepted, the process proceeds to step S211. If not accepted, the process proceeds to step S213.

(Step S211) The execution instruction information output unit 21 outputs execution instruction information corresponding to the execution instruction area specified by the specification information received in step S210.

(Step S212) The second information output unit 22 outputs the second information based on the execution instruction information output in Step S211. Then, the process returns to step S204.

(Step S213) The area designation instruction receiving unit 14 determines whether or not an area designation window movement instruction has been received. If accepted, proceed to step S214; otherwise, proceed to step S215.

(Step S214) The area designation window output unit 15 moves the area designation window based on the area designation window movement instruction received in step S213.

(Step S 215) The area designation instruction receiving unit 14 determines whether or not it has received a region designation window size change instruction. If accepted, the process proceeds to step S216. If accepted, the process proceeds to step S217.

(Step S216) The area designation window output unit 15 changes the size of the area designation window based on the area designation window movement instruction received in step S215. Then, the process returns to step S204. (Step S 217) The image information instruction accepting unit 13 determines whether or not an image display window movement instruction has been accepted. If accepted, the process proceeds to step S218. If not accepted, the process returns to step S204.

(Step S218) The first image information output unit 12 moves the image display window based on the image display window movement instruction received in step S217. Then, the process returns to step S204.

 In the flowchart of FIG. 2, the processing order of step S213 and step S214, step S215 and step S216, step S217 and step S218 may be appropriately changed.

 [0142] In the flowchart of Fig. 2, the process ends when the power is turned off or the process is terminated.

 [0143] Hereinafter, a specific operation of the image information processing apparatus in the present embodiment will be described. A conceptual diagram of the image information processing apparatus 1 is shown in FIG. Here, the case where the image information processing apparatus 1 has the display 30 as an output device will be described as an example.

 [0144] First, when the user gives an instruction to open the first image information to the image information processing apparatus 1 using a mouse or the like, the first image information output unit 12 responds to the instruction by the first image. The first image information “image001” stored in the information storage unit 11 is displayed on the display 30 using the image display window. Here, “image001”, which is the first image information, is assumed to be bitmap data.

 FIG. 4 is a diagram showing a display example of the image display window 40 on the display 30 of the image information processing apparatus 1. In the image display window 40, a scroll bar 41 for scrolling the first image information is displayed on the right side and the lower side of the area display window in order to display a portion where the first image information is not displayed. ing.

FIG. 5 is an image display window management table for managing the image display window 40 displayed on the display 30. The image display window management table includes “image display IDJ,“ window (x, y) ”,“ (height, width) J, “arrangement order”, “image (x, y) J,“ image ”and V, It has an attribute. “Image display ID” is identification information for managing the image display window. “Window (x, y)” is the coordinates of the upper left corner in the image display window. Is a pixel. “(Height, width)” is the height and width in the image display window, and the unit is pixels. “Arrangement order” indicates the arrangement order of the windows. The smaller the value is, the more the window is arranged in front. Here, since the area designation window, which will be described later, is always placed in front of the image display window, the “placement order” value of the area designation window is “1”, and the “placement order” of the image display window is set. The value of “” is a value of “2” or less. “Image (x, y)” is the position of the first image information displayed in the image display window 40 displayed at the upper left corner of the image display window 40 in coordinates in the first image information. It is the indicated value. Here, the coordinates of the upper left corner of the first image information are (0, 0). “Image” indicates the name of the first image information displayed in the image display window. Here, the upper left corner of the image display window 40 is aligned with the position of the upper left corner of the first image information. The first image information is image information having a height and width sufficiently larger than the display area of the area display window opened by default, for example, height, 600 pixels, and width 800 pixels. In the image display window, the upper left area of the first image information is cut out and output.

 [0147] The display position of the image display window can be changed by dragging and dropping the upper side with a mouse or the like. Specifically, the value of “Window (x, y)” in FIG. 4 is replaced with the coordinates of the upper left corner of the image display window at the time of dropping with the mouse, and the image is changed according to the replaced position. The display in the display window 40 is rewritten.

 Next, when the user operates the operation menu or the like to give an instruction to generate an area designation window, an area designation window 60 is displayed as shown in FIG. Note that the frame of the area specification window and the bar of the upper window may be hidden, or displayed or hidden by using commands etc.

FIG. 7 is an area designation window management table for managing area designation windows. The area designation window management table has the following attributes: “area ID”, “window (x, y)”, “(height, width)”, “arrangement order”. “Area ID” is identification information for managing the area designation window. “Window (x, y)” is the coordinates of the upper left corner in the area designation window in the display area of the display 30, and here the unit is pixel. . “(Height, width)” is the height and width in the area specification window, and the unit is pixels. “Arrangement Order” is the window arrangement order. As shown in the figure, the smaller the value, the closer to the front. Here, the area specification window is

Since it is arranged in the foreground, the value of “arrangement order” in the area designation window is “1”.

[0150] The display position of the area specification window 60 can be changed by dragging and dropping the upper side of the window. Specifically, the value of “Window (x, y)” in FIG. 7 is replaced with the coordinates of the upper left corner of the area display window when it is dropped with the mouse, and the area designation window is placed at the replaced position. 60 is rewritten and displayed. At this time, the area designation window 60 is an independent window with respect to the image display window 40, and is not interlocked with each other. Even if the area designation window 60 is moved, the image display window 40 does not move at all. Therefore, by moving the area designation window 60, the relative position of the area designation window 60 with respect to the image display window 40 can be adjusted.

[0151] In the area designation window 60, the display size can be changed by dragging and dropping the lower side, the side, or the corner of the window. Specifically, the height and width of the area display window at the time of dropping with the mouse replaces the values of “(height, width)” in FIG. 7, and the area designation window 60 of the replaced size is rewritten. Displayed. At this time, the area designation window 60 is an independent window with respect to the image display window 40 and does not interlock with each other, and the image display window 40 does not move at all even if the size of the area designation window 60 is changed. Therefore, by changing the size of the area designation window 60, the relative size and position of the area designation window 60 with respect to the image display window 40 can be adjusted.

[0152] The display position of the image display window 40 can be changed by dragging and dropping the upper side with a mouse or the like. Specifically, the value of “window (x, y)” in FIG. 4 is replaced by the coordinates of the upper left corner of the image display window 40 when it is dropped with the mouse, and the image display window 40 is at the replaced position. Rewritten and displayed. At this time, the image display window 40 is an independent window with respect to the area designation window 60, and is not linked to each other. Even if the position of the image display window 40 is moved, the area designation window 60 does not move at all. Therefore, by moving the image display window 40, it is possible to adjust the relative position of the area designation window 60 with respect to the image display window 40. Similarly, the image display window 40 has a lower edge, a side edge, and a corner. The display size can be changed by dragging and dropping a part of the image. However, even if the size of the image display window is changed, no change is made to the position of the area specification window 60. Similarly, the image display window 40 is displayed by selecting a menu power enlargement command, a reduction command, or the like, and displaying the image of the first image information enlarged or reduced. Even if the image of the first image information displayed in the image display window 40 is reduced or enlarged in this way, the position and size of the area specification window 60 can be changed. Is not done.

 [0153] In addition, the image display window 40 can move the area where the first display image is displayed by moving the scroll bar 41, and the first display image is not displayed. Can be displayed. At this time, the image display window 40 is an independent window with respect to the area designation window 60, and is not linked to each other. Even if the display area of the image display window 40 is moved, the area designation window 60 does not move at all. Therefore, by moving the scroll bar 41 of the image display window 40, it is possible to adjust the relative position of the area designation window 60 with respect to the image display window 40.

 [0154] In this way, the image display window 40 and the area designation window 60 are moved relative to each other, and the relative size between the image display window 40 and the area designation window 60 is changed. The positional relationship and the like can be set individually and freely.

 [0155] In addition, an operation performed on the area designation window 60, that is, a part other than the side of the area designation window 60 or the window bar is not an event for the area designation window 60. It is accepted as an event for the image display window 40 etc. displayed inside. Therefore, the image display window 40 is moved through the area designation window 60, the image displayed in the image display window 40 is modified, and the image information processing apparatus 1 and other devices are installed. Application menus can be selected using pointers. As a result, even if the area designation window 60 is displayed, it is possible to prevent the operation of the image display window 40 and the like from being hindered, and the operability can be improved.

Next, when the user operates the menu or the like, for example, as shown in FIG. 8, execution instruction information for displaying the second information is changed to an execution instruction area, that is, an area in the area designation window 60, Display the input screen for setting. The input screen shown in FIG. 8 displays an input field 81 and a description “Drop image file down” written on this field 81. Here, when the user drags and drops an image file including the second information as the image information to this field 81, the area in the setting instruction receiving unit 16 input area specifying window 60 is set as the execution instruction area, and this execution is executed. An instruction to set execution instruction information for displaying the second information dropped in the instruction area is received. Specifically, as shown in FIG. 9, an image display window 40 of the display 30 is arranged using a mouse or the like, and the icon 90a of the second information image file arranged in the area is displayed. For example, when dragging and dropping into the field 81 and dropping, the coordinate force of the upper left corner of the image file icon 90b, within the area determined from the coordinates of the upper left corner of the field 81 and the height and width If it matches the coordinates of, it is determined that it has been dropped in this image file force field 81. Then, triggered by the image file being dropped, the execution instruction area configuration unit 17 sets execution instruction area setting information for setting the area in the area specification window 60 of the first image information as the execution instruction area. Constitute. In addition, the execution instruction configuration unit 18 acquires the directory information of the image file dropped in the field 81, and executes the execution instruction for opening the second information included in the image file indicated by the directory information in a new window. Configure information, here actions. Here, the file name of the image file having the second information is “image—a.jpg”, and the directory information is “C: /user/desktop/image_a.jpg”. The action configured by the execution instruction component 18 is “windowopen—“ C: / user /, which is an action for opening “imag _e — a.jpg” in a new window when the execution instruction area is clicked. desktop / ima ge_a.jpg "". In addition, the display of the area designation window 60 ends when the image file 90a is dropped.

The area information output unit 19 temporarily stores the execution instruction area setting information configured by the execution instruction area configuration unit 17 and the execution instruction information configured by the execution instruction configuration unit 18 in a storage medium such as a memory. In this case, the path of the image file having the second information, the directory information, etc. are input as text in the force field 81 in which the image file having the second information is designated by drag and drop. May be. Take The same applies to the other embodiments.

 FIG. 10 is a diagram showing an execution instruction area management table for managing execution instruction areas.

The execution instruction area management table has attributes of “instruction area ID”, “window (x, y)”, “(height, width)”, “background”, “arrangement order”, and “action”. . “Instruction area ID” is identification information for managing the execution instruction area, and “Window (x, y)” is the coordinates of the upper left corner of the execution instruction area in the first image information. Here, the unit is pixel. To do. The “window (x, y)” is specifically determined from the coordinates of the image display window and the coordinates of the area designation window. “(Height, width)” is the height and width of the execution instruction area, and the unit is pixels. “Background” indicates an image displayed in the execution instruction area when the execution instruction area is displayed on the first image information. Here, the attribute value “white_50%” for filling the execution instruction area with a white image having a transmittance of 50% is set. The “arrangement order” indicates the arrangement order of the execution instruction areas, and the smaller the value is, the more they are arranged in front. “Action” is execution instruction information set in the execution instruction area. In this case, “windo _WO pen 1“ C: / user / desktop / image 1 a.jpg ”described above. `` Window (x, y) '', `` (Normal, Width) '', `` Background '', and `` Arrangement order '' correspond to the execution instruction area setting information configured by the execution instruction area configuration unit 17, and the action is This corresponds to the execution instruction information configured by the execution instruction configuration unit 18.

The area information output unit 19 displays the execution instruction area 110 on the first image information, as shown in FIG. 11, based on the execution instruction area management table. Here, the execution instruction area 110 is displayed in translucent white. The execution instruction area 110 may be transparent. Also, the image information displayed in the execution instruction area, that is, the area image information is image information displayed according to the execution instruction set in the execution instruction area, in this case, a thumbnail of “image—a.jpg”. It may be image information such as an image, for example, a reduced image or an image obtained by deforming a part of the image according to the shape of the execution instruction area, or an image arranged in a tile shape. Image information such thumbnail images, "i _mage -. _A jpg" like mosquitoesゝal process of configuration, is a known technique, description thereof is omitted. The area image information may be an icon or the like. This also applies to other embodiments.

[0160] Next, the user operates the mouse or the like to place the pointer on the execution instruction area 110. When a button such as a mouse is clicked, the designation information receiving unit 20 receives designation information for designating the execution instruction area 110. The execution instruction information output unit 21 uses the reception of the specified information as a trigger, and the execution instruction information corresponding to the execution instruction area 110 specified by the specified information, in this case, the “area instruction” in the execution instruction area management table shown in FIG. Acquire "windowopen""C:/user/desktop/image-one.jpg"", which is the" action "of the record whose ID is" 0001 ", and output it to the second information output unit 22 To do. According to this output, the second information output unit displays the second information of the image file “image—a.jpg” stored in the directory “C: ZuserZdesktopZimage—a.jpg” as shown in FIG. A new image display window 120 is used for display. This image is an image of the image file indicated by the icon 90a described above.

 Here, the second information output unit 22 is provided and the second information is output from the second information output unit 22, but instead of the second information, the first image information storage unit 11 The first image information stored in the first image information is output from the first image information output unit 12 based on the execution instruction information output from the execution instruction information output unit 21. You may make it output using a display window. In this manner, the execution instruction area may be set for the first image information output based on the execution instruction information by the processing as described above. The first image information may be the same as or different from the image already displayed in the image display window. The same applies to other embodiments.

[0162] Here, instead of setting the execution instruction information for displaying the second information as shown in FIG. 8, the user operates the menu, for example, a desired URL as shown in FIG. And an input screen for setting the execution instruction information to be displayed in the execution instruction area, that is, the area in the area designation window 60 is displayed. In the input screen shown in FIG. 13, an input field 131, a “setting” button 132, and a description “Enter URL below.” Described on this field 131 are displayed. When the user inputs a desired URL into the field 131 using a keyboard or the like and presses the setting button 132 using a mouse or the like, the execution instruction area configuration unit 17 displays the area designation window of the first image information. Configure the execution instruction area setting information for setting the area in the queue 60 as the execution instruction area. The Further, the execution instruction configuration unit 18 obtains the URL input in the field 131, and the information stored in the URL is executed by an application such as an Internet browser that is executed by another device, such as a computer in this case. , Execution instruction information to be opened with, here, an action is configured. Here, it is assumed that the input URL is “http: ZZwww.gijyutu.co.jp/index.html”. The action configured by the execution instruction configuration unit 18 is “get: http: ZZwww.gijyutu.co.jp/index.html” when the execution instruction area is clicked. — Url— “http: // w ww. Gijyutu. Co.jp/index.html” ”. “Get—url—” is an action that causes other applications to acquire information about the location indicated by the URL between two. Further, the display of the area designation window 60 is ended by pressing the “SET” button 132. The execution instruction area setting information configured by the execution instruction area configuration unit 17 and the execution instruction information set by the execution instruction configuration unit 18 are temporarily accumulated in a storage medium such as a memory by the area information output unit 19. Instead of inputting the URL using a keyboard or the like, the URL text may be dragged and dropped onto the field 131 in the same manner as the image file described above.

 FIG. 14 is a diagram showing an execution instruction area management table for managing execution instruction areas.

 The execution instruction area management table has attributes of "instruction area ID", "window (x, y)", "(height, width)", "background", "arrangement order", and "action". . Each attribute is the same as the execution instruction area management table in FIG. Here, the “action” is “get-url-“ htt p: Z Z www. Gijyutu. Co.jpZ index, html ”.

 The area information output unit 19 displays the execution instruction area on the first image information as shown in FIG. 11 based on the execution instruction area management table shown in FIG.

Next, when the user operates the mouse or the like to place the pointer on the execution instruction area 110 and clicks a button such as a mouse, the designation information receiving unit 20 points to the execution instruction area 110. Accepts specified information to be specified. The execution instruction information output unit 21 uses the reception of the specified information as a trigger, and the execution instruction information corresponding to the execution instruction area 110 specified by the specification information, “Get url” http: // www. Gijyutu. Co.jp/ind which is the “action” attribute of the record whose ID is “0001” ex.htmr ”, and the information that is stored in“ http: ZZwww.gijyutu.co.jp/index.html ”can be displayed in an application that can display predetermined Internet information. Output the instruction to get. An application that can display Internet information, such as an Internet browser, obtains information stored in the URL “http: ZZwww.gij yutu.co.jp/index.html” based on this command. The new window 150 is used for display as shown in.

 [0166] As described above, according to the present embodiment, the execution instruction area can be set for the first image information using the area designation window. As a result, when setting the execution instruction area, the image display window image and the area designation window can be operated without being linked, and the degree of freedom of operation when setting the execution instruction area is improved. It is possible to improve operability.

[0167] In the present embodiment, a case where a setting instruction for setting an area in the area designation window as an execution instruction area in a state where the area designation window is arranged on the image display window will be described. However, the area designation window may be arranged in an area outside the image display window to accept a setting instruction. For example, as shown in FIG. 16, the area designation window 160 is arranged outside the display image window for displaying the first image information, and the execution instruction information for displaying the second information as shown in FIG. 8 described above. Is displayed in the execution instruction area, and the second information is dragged and dropped on the input field of this input screen, the execution instruction area constituting unit 17 displays the first image currently displayed. When all the first image information related to the display image window is displayed at the information position, the position on the first image information of the area instruction window, here, the coordinates of the upper left corner is calculated. Then, the execution instruction area configuration unit 17 configures execution instruction information setting information for setting an execution instruction area having the same size as the size in the area instruction window with this coordinate as the upper left corner. For example, in FIG. 16, the area where the first image information is displayed when everything related to the display image window is displayed is represented by area 161. Then, the coordinates of the upper left corner of the area instruction window 160 on the calculated first image information are set as the coordinates of the upper left corner of the execution instruction area. The size of the execution instruction area is set to the same value as the height and width in the area instruction window 160. Territory Similarly, even when only a part of the area specification window protrudes from the image display window, the position of the execution instruction area is similarly determined from the position of the area specification window on the first image information when all the first image information is displayed. The execution instruction area setting information indicating the In addition, if the area instruction window protrudes from the first image information displaying all, the execution instruction area setting information may not be configured, or the execution instruction area is set so that the protruding part is cut off. You may do it. Thus, in the present embodiment, the area designation window can be arranged at a position other than on the display image window, and the execution instruction is also given to the area of the first image information that is not displayed in the display image window. The area can be set. This makes it possible to set the execution instruction area without moving the area not displayed in the display image window to a position where it can be displayed in the display image window by operating the scroll bar or the like. It can be shortened and the degree of freedom in work is improved. The same applies to other embodiments.

In addition, the area information output unit 19 does not store execution instruction area setting information or execution instruction information in a storage medium such as a memory. Based on the first image information output from the first image information output unit 12, the execution instruction area setting information and the execution instruction information are output to a predetermined address, for example, an IP address, Specifically, it may be transmitted. The predetermined address set in advance is, for example, an address set in advance in the image information processing apparatus 1 or an address input by the user immediately before. Along with these, second information that the execution instruction information instructs to output may also be output. Further, when transmitting these pieces of information, a single file including these pieces of information may be configured and transmitted. In particular, when configuring such a single file, the format of the configured file is set to the format of an image file having the same image information format as the first image information, and the image information of the image file is stored. The execution instruction area setting information, the execution instruction information, the second information, and the like may be stored in an area other than the area to be executed, such as a header area or a footer area. In this way, at least the first image information can be opened using an image processing apparatus that can open an image file having the first image information as image information, an image processing application, or the like. In addition, when sending information, this information is transferred to the Internet as necessary. Information that has been changed to a format that can be viewed on the Internet may be transmitted. In such a case, the image information processing apparatus 1 may not include the designation information receiving unit 20, the execution instruction information output unit 21, the second information output unit 22, and the like. Instead, the above-mentioned information output to an address such as a preset IP address is downloaded and output. You can be prepared. The same applies to other embodiments.

[0169] In the above embodiment, when the image information processing apparatus does not output the second information, the second information output unit 22 may be omitted. The same applies to other embodiments.

 [0170] In the above embodiment, the case where the second information is image information has been described. However, in the present invention, the second information may be any information. For example, the second information may be text.

 [0171] Also, in the above embodiment, the execution instruction area configuration unit 17 sets the area located in the area designation window as a predetermined area, for example, an area to be subjected to predetermined processing. You may make it comprise the execution instruction area setting information which is information!ヽ. For example, with such a configuration, with respect to the predetermined area, a predetermined process is performed on the area located in the area designation window of the first image information, for example, the color of the image is adjusted, and the sharpness is increased. It is possible to perform image processing such as adjustment and processing to cut out an image in this area. Since such processing is a known technique, description thereof is omitted. The same applies to other embodiments.

[0172] In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. The software that realizes the image information output device in each of the above embodiments is the following program. That is, this program outputs the stored first image information to the computer using an image display window which is a window for displaying the first image information. A first image information output step, an area designation window generation instruction that is an instruction to generate an area designation window that is a window for designating an area, and an area designation window movement instruction that is an instruction to move the area designation window. An area designation window output that outputs an area designation window based on the area designation instruction reception step to be accepted and outputs the area designation window based on the area designation window generation instruction, and moves and outputs the output area designation window based on the area designation window movement instruction The step and the region located in the region designation window of the first image information are set as an execution instruction region that is a region for outputting execution instruction information that is information for instructing execution of a predetermined process. A setting instruction receiving step for receiving a setting instruction that is an instruction for An execution instruction area configuration step for configuring execution instruction area setting information, which is information for setting an area located in the area specification window as an execution instruction area, and execution of the first image information. An execution instruction configuration step for configuring execution instruction information, which is information output when an instruction area is designated, based on the setting instruction, an area for outputting the execution instruction area setting information, and the execution instruction information A program for executing the information output step.

 [0173] In the above program, the transmission step for transmitting information and the reception step for receiving information are performed by hardware, for example, a modem or an interface card in the transmission step. It does not include processing (processing that can only be done with software). The same applies to other embodiments.

 [0174] In addition, this program is recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, etc.) that can be executed by being downloaded by force such as a server. The program may be executed by being read.

 [0175] Further, the computer that executes this program may be singular or plural. That is, centralized processing or distributed processing may be performed. This also applies to other embodiments.

 [0176] (Embodiment 2)

In the present embodiment, the image information processing apparatus according to the first embodiment is configured to accept input of characters in the area designation window. FIG. 17 is a block diagram of the image information processing apparatus according to the present embodiment. The image information processing device 2 includes a first image information storage unit 11, a first image information output unit 12, an image information instruction reception unit 13, an area designation instruction reception unit 24, an area designation window output unit 25, and a setting instruction reception unit. 16, an execution instruction area configuration unit 27, an execution instruction configuration unit 18, an area information output unit 29, a designation information reception unit 20, an execution instruction information output unit 21, and a second information output unit 22. First image information storage unit 11, first image information output unit 12, image information instruction reception unit 13, setting instruction reception unit 16, execution instruction configuration unit 18, designation information reception unit 20, execution instruction information output unit 21, and The configuration of the second information output unit 22 is the same as that of the first embodiment, and a description thereof will be omitted.

 [0178] The area designation instruction accepting unit 24 further inputs characters, for example, text, in the area designation window to the area designation instruction accepting part 14 described in! / In the first embodiment. Since other configurations are the same as those of the area designation instruction receiving unit 14, the description thereof is omitted.

 Area designation window output unit 25 outputs the characters received by setting instruction accepting unit 26 to the area designation window in addition to area designation window output unit 15 described in the first embodiment. It is what I did. The font and size of the characters output by the area specification window output unit 25 do not matter. The font and size of characters to be output may be set in advance, or may be changed as appropriate by the user. The other configuration is the same as that of the area designation window output unit 15, and thus the description is omitted.

 [0180] The execution instruction area configuration unit 27 outputs the characters received by the setting instruction reception unit 16 to the execution instruction area in the execution instruction area configuration unit 17 described in the first and second embodiments! The execution instruction area setting information further including information for the configuration is configured. For example, the execution instruction area configuration unit 27 configures execution instruction area setting information including, as information for outputting a character, a character display position in the execution instruction area, for example, coordinates, and a character to be displayed. The other configuration is the same as that of the execution instruction area configuration unit 17 and thus will not be described.

[0181] The region information output unit 29 is connected to the region information output unit 19 described in the first embodiment. Further, based on the execution instruction area setting information, the characters received by the setting instruction receiving unit 26 are output in the execution instruction area. The other configuration is the same as that of the region information output unit 19, and thus the description thereof is omitted.

[0182] Next, the operation of the image information processing apparatus will be described with reference to the flowchart of FIG. In FIG. 18, the same reference numerals as those in the flowchart of FIG. 2 indicate the same or corresponding steps, and the description thereof is omitted.

(Step S 1801) The area designation instruction accepting unit 24 determines whether or not an input of characters in the area designation window has been accepted. If accepted, the process proceeds to step S1802. If not accepted, the process returns to step S204.

(Step S1802) The area designation window output unit 25 outputs the characters received in step S1801 in the area designation window. Then, the process returns to step S204.

(Step S 1803) The execution instruction area configuration unit 27 determines whether or not the character is output in the area designation window. If a character is output, the process proceeds to step S 1804. If not, the process proceeds to step S205.

(Step S 1804) The execution instruction area configuration unit 27 configures execution instruction area setting information including information for outputting characters.

(Step S1805) The region information output unit 29 outputs the execution instruction region setting information configured in Step S205 and Step S1803, and the execution instruction information configured in Step S206. Then, the process returns to step S204. The execution instruction area setting information configured in step S205 or the execution instruction area setting information configured in step S1803.

In case of either V or deviation, only one of them is output.

Note that in the flowchart of FIG. 18, the processing is ended by powering off or interruption for aborting the processing.

 [0189] The specific operation of the image information processing apparatus in the present embodiment will be described below. Since the conceptual diagram of the image information processing apparatus 2 is the same as FIG. 3, the description thereof is omitted.

First, similarly to FIG. 6, it is assumed that the user displays the first image information on the display 30 in the image display window and further displays the area designation window 60. Since the processing up to this point is the same as that of the first embodiment, description thereof is omitted. Next, as shown in FIG. 19, for example, the user clicks in the area designation window 60 to display a cursor 1901 for inputting characters in the area designation window 60. When the keyboard isotropic text is input, the area designation instruction receiving unit 24 receives the input text, and the area designation window output unit 25 displays the received text 1902 in the area designation window. Here, it is assumed that the input text 1902 is a character string “detailed material”.

 Next, as in FIG. 8, an input screen for setting the execution instruction information for displaying the second information in the area in the area specifying window 60 is displayed, and the setting instruction receiving unit 16 is instructed to set the execution instruction information. When given, the execution instruction area configuration unit 27 configures execution instruction area setting information for setting the area in the area designation window 60 of the first image information as the execution instruction area. The execution instruction area configuration unit 27 includes information for displaying the text received by the area designation instruction receiving unit 24 on the execution instruction area, here, the displayed text and its display position. Configure area setting information. Further, the execution instruction configuration unit 18 configures execution instruction information.

 FIG. 20 is a diagram showing an execution instruction area management table for managing execution instruction areas.

 The execution instruction area management table includes "instruction area ID", "window (x, y)", "(height, width)", "background", "display text", "text position (x, y)", " It has the attributes “order of arrangement” and “action”. Attributes other than “display text” and “text position (x, y)” are the same as those in the execution instruction area management table of FIG. Here, “background” is assumed to be a value “T” indicating transparency. The “display text” is text displayed on the execution instruction area, and is text received by the area designation instruction receiving unit 24. “Text position (x, y)” is the display position of the text displayed on the execution instruction area, and is the coordinates of the upper left corner of the text. Here, the X and y values of the coordinates of the upper left corner of the execution instruction area are set to preset values, in this case, “10”, respectively.

The area information output unit 29 displays the execution instruction area 210 on the first image information, as shown in FIG. 21, based on the execution instruction area management table shown in FIG. Here, in particular, the “detailed material” t received by the area designation instruction receiving unit 24, and the text composed of the characters Is displayed in the execution instruction area 210.

Subsequent processes such as the process of designating the execution instruction area 110 are the same as those in the first embodiment, and a description thereof will be omitted.

[0196] Although the case has been described here in which execution instruction information for displaying the second information is set in an area in the area designation window 60, the URL information is displayed as in the first embodiment. The present embodiment can also be applied to the case where the execution instruction information is set in an area in the area designation window 60.

As described above, in the present embodiment, the execution designation area can be set for the first image information using the area designation window. As a result, when setting the execution instruction area, the image display window image and the area specification window can be operated without being linked, and the degree of freedom of operation when setting the execution instruction area is improved. Therefore, operability can be improved.

Furthermore, in the present embodiment, it is possible to display text in the execution instruction area using the area designation window.

[0199] Furthermore, since characters are input using the area designation window, it is possible to improve operability during movement, alignment, etc. when inputting characters to be displayed in the execution instruction area.

 [0200] Also, by entering characters with the area specification window protruding outside the image display window, the execution information area set in the portion of the second information not displayed in the image display window is displayed. It is also possible to display characters and to improve the workability without having to operate the image display window in order to display the position where characters are input.

 [0201] (Embodiment 3)

 In the present embodiment, the image displayed on the display in Embodiment 1 is acquired as image information and stored in a storage medium such as a memory, and the stored image information is used as second information. It is intended to be used.

FIG. 22 is a block diagram of the image information processing apparatus in the present embodiment. The image information processing device 3 includes a first image information storage unit 11, a first image information output unit 32, an image information instruction Reception unit 13, image acquisition instruction reception unit 30, image acquisition unit 31, area designation instruction reception unit 14, area designation window output unit 15, setting instruction reception unit 16, execution instruction area configuration unit 17, execution instruction configuration unit 18 A region information output unit 19, a designation information reception unit 20, an execution instruction information output unit 21, and a second information output unit 22. Since the configuration other than the image acquisition instruction receiving unit 30, the image acquisition unit 31, and the first image information output unit 32 is the same as that of the first embodiment, description thereof will be omitted.

 [0203] The first image information output unit 32 outputs the image display window to the screen of the display device. Specifically, image information for display is configured, and this image information is displayed on the screen of the display device. The first image information output unit 32 may include a display device, or may output image information for display to an external display device, and designate display of the image information on the external display device. Since the other configuration is the same as the configuration of the first image information output unit 12 of the first embodiment, description thereof is omitted.

 [0204] The image acquisition instruction receiving unit 30 receives an image acquisition instruction that is an instruction for acquiring image information of at least a part of an image output by the first image information output unit 32. The image acquisition instruction may simply be an instruction for acquiring an image, or may further include information for designating a region from which an image is acquired. For example, when the screen is dragged with the mouse, the information for specifying the area is the coordinates of the start point and end point of the drag, and the specified area is an area having the start point and the end point as a diagonal. Further, it may be information specifying the entire screen as an area. The input received by the image acquisition instruction receiving unit 30 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, a menu screen, and the like, and any input means may be used. The image acquisition instruction accepting unit 30 can be realized by a device driver of an input means such as a numeric keypad board, control software such as a menu screen or a window system, and the like.

[0205] Based on the image acquisition instruction, the image acquisition unit 31 acquires image information of at least a partial region of the output image as second information. For example, the image acquisition unit 31 acquires image information corresponding to at least a part of the area on the screen among image information configured to be displayed on the display device, specifically bitmap information. In particular, if the image acquisition instruction includes information specifying the area from which the screen is acquired, the Image information used to display an image in a defined area is acquired. In addition, when the image acquisition instruction does not include information for designating a region, image information used for displaying an image in a previously set region is acquired. The image acquisition unit 31 stores the acquired image information in a storage medium such as a memory node disk. In the present embodiment, for example, when the image acquisition unit 31 acquires image information, the image acquisition unit 31 sets directory information indicating a directory on a storage medium in which the image information is stored as a setting instruction. It is output to the display reception unit 16. When this directory information is input, the setting instruction receiving unit 16 outputs execution instruction information that is an instruction to open the image information acquired by the image acquiring unit 31 in the region of the first image information located in the region designation window. Accepts setting instructions to be set in the execution instruction area. Note that a technique for obtaining an image or the like displayed on the screen of the display device is a known technique generally called a screen shot or a screen capture, and thus detailed description thereof is omitted. The screen information acquisition unit 31 can usually be realized by an MPU, a memory, or the like. The processing procedure of the screen information acquisition unit 31 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

 Next, the operation of the image information processing apparatus will be described using the flowchart of FIG. In FIG. 23, the same reference numerals as those in the flowchart of FIG. 2 denote the same or corresponding steps, and the description thereof will be omitted.

 (Step S2301) The first image information output unit 32 outputs the first image information using the image display window. Here, in particular, display image information is constituted from the first image information, and this image information is displayed on the image of the display device.

 (Step S2302) The image acquisition instruction accepting unit 30 determines whether or not the image acquisition instruction has been accepted. If accepted, the process proceeds to step S2302. If not accepted, the process returns to step S204.

 (Step S2303) The image acquisition unit 31 acquires the image information displayed on the screen of the display device based on the image acquisition instruction received in step S2301, and stores it in a storage medium such as a memory.

[0210] (Step S2304) The image acquisition unit 31 displays the delay of the image information accumulated in step S2303. The country information is output to the setting instruction receiving unit 16.

 [0211] (Step S2305) The setting instruction receiving unit 16 detects that the directory information of the image information accumulated in Step S2303 has been input, and sets the area in the area designation window of the first image information as the directory information. A setting instruction to be set is received in the execution instruction area for outputting execution instruction information for opening image information stored in the directory indicated by. Then, step S205 proceeds.

 [0212] In the flowchart of Fig. 23, the process ends when the power is turned off or the process ends.

 [0213] Hereinafter, a specific operation of the image information processing apparatus according to the present embodiment will be described. The conceptual diagram of the image information processing apparatus 3 is the same as that in FIG.

 First, as in FIG. 6, it is assumed that the user displays the first image information on the display 30 with the image display window 40 and further displays the area designation window 60. Since the processing up to this point is the same as that of the first embodiment, description thereof is omitted.

 [0215] Next, the user operates a menu or the like to set execution instruction information for displaying a part of the image displayed on the display 30 in an area in the area designation window 60 of the first image information. When a menu item for selecting, for example, “Set screen capture as execution instruction area” is selected, the arrow-shaped pointer is changed to a cross-shaped pointer.

 [0216] When the user drags an area on the screen using the cross-shaped pointer 2400 as shown in FIG. 24, the image acquisition instruction accepting unit 30 causes the start point (xl, yl ) And an image acquisition instruction including the coordinate values of the end point (x2, y2).

[0217] The image acquisition unit 31 uses the coordinates of the start point (xl, yl) and the end point (x2, y2) included in the image acquisition instruction within the region of the display 30 with these coordinates as diagonals. The second information corresponding to the displayed image is the image configuration unit that constitutes the image information to be output to the display device, or the image information to be output to the display device is temporarily stored 格納 Storage unit such as VRAM Etc. The acquired image information is stored in a memory or a disk. It is assumed that the acquired image information is stored in a directory “c: Z ZuserZimgZsc01001” with a file name “sc01001”, for example. Then, the image acquisition unit 31 sets directory information indicating the location where the accumulated image information is stored. It outputs to the regular instruction reception unit 16.

 [0218] Upon receiving this directory information, the setting instruction receiving unit 16 displays execution instruction information for opening the image information of the directory "c: ZZuserZimgZsc01001" in the area in the area specifying window of the first image information. Accepts setting instruction information for setting.

 [0219] Based on the setting instruction information, the subsequent processing, for example, the execution instruction area setting information for setting the area in the area specifying window 60 of the first image information as the execution instruction area is configured. The process of configuring the execution instruction information for opening the image information in the directory “c: // user / img / scO 1001” is the same as in the first embodiment, and the description thereof is omitted.

 [0220] Then, as shown in FIG. 25, when the execution instruction area 2500 of the first image information is clicked using a mouse or the like, the image displayed in the dragged range 2401 shown in FIG. The image is displayed on the display 30 in the image display window 2501.

 [0221] As described above, in the present embodiment, the execution instruction area can be set for the first image information using the area designation window. As a result, when setting the execution instruction area, the image display window image and the area specification window can be operated without being linked, and the degree of freedom of operation when setting the execution instruction area is improved. Therefore, operability can be improved.

 [0222] Since the second information is acquired from the image of the desired area of the screen and the second information is output when the execution instruction area of the first image information is designated, First, it is necessary to prepare an image showing the operation procedure of the application in advance when constructing an image that interactively displays the operation procedure of various applications displayed on the screen. When the execution instruction area on the image information is designated, it can be easily set as an image to be output, and workability can be improved.

 [0223] In the above embodiments, each process (each function) may be realized by centralized processing by a single apparatus (system), or a plurality of apparatuses. It may be realized by distributed processing by.

[0224] In each of the above embodiments, two or more communication means (information Needless to say, the output unit or the like may be physically realized by a single medium.

 [0225] Also, in the above-described embodiment, the case where the image information processing apparatus is stand-alone has been described. However, the image information processing apparatus may be a stand-alone apparatus or a server in a client system. Also good. In the latter case, for example, the output unit, the reception unit, etc. receive input via a communication line or output information for displaying a screen.

 [0226] It goes without saying that the present invention can be variously modified without being limited to the above-described embodiments, and these are also included in the scope of the present invention.

 [0227] (Embodiment 4)

 Hereinafter, embodiments of an image information processing apparatus and the like will be described with reference to the drawings. Note that components having the same reference numerals in the embodiment perform the same operation, and thus the description thereof may be omitted.

 FIG. 26 is a block diagram of the image information processing apparatus in the present embodiment.

 [0229] The image information processing apparatus 1001 includes a character instruction reception unit 1011, a character input reception unit 1012, a frame output instruction reception unit 1013, a character window output unit 1014, an area designation instruction reception unit 1015, an area designation window output unit 1016, and a magnification. A designated information receiving unit 1017, an acquisition instruction receiving unit 1018, an area image acquiring unit 1019, and an output unit 1020 are provided.

[0230] Character instruction accepting unit 1011 accepts a character window moving instruction that is an instruction to move a character window that is a window for outputting characters. The character window movement instruction includes, for example, information (for example, coordinate values (x, y) and relative vector coordinates of the current coordinate value force) that specify the movement destination of the character window. For example, when a character window output by a character window output unit 1014 (to be described later) is dragged and dropped using a mouse or the like, the character instruction receiving unit 1011 uses a character window with the dropped position as the movement destination. Accept movement instructions. In addition, when the pointer is moved within the output area of an output device (not shown) and the mouse button is clicked or double-clicked, the pointer designates the character window to move to the destination. It may be accepted. The character instruction receiving unit 1011 further receives a character window size change instruction that is an instruction to change the size of the character window. Character window size The change instruction is composed of, for example, information on the length and width of the character window.

. Information indicating the size of the character window after the change may be information on coordinates indicating two or more positions of the character window after the change, for example, the upper left corner and the lower right corner. For example, when the character instruction receiving unit 1011 drags and releases the frame or side of the character window using a mouse or the like and releases it, the size of the window determined by the position of the released frame or the like is set. A character window size change instruction for changing the size of the character window may be accepted. In addition, when an unillustrated input unit or the like receives the changed size of the character window by inputting a numerical value, the character instruction receiving unit 1011 changes the size of the window to a size determined by this numerical value. An image display window change instruction may be accepted. The input accepted by the character instruction accepting unit 1011 may be any input means such as a pointing device such as a mouse, an input using a numeric keypad, a keyboard, and a menu screen. The character instruction receiving unit 1011 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

Character input receiving unit 1012 receives input of characters. Specifically, it accepts input of characters to be displayed in the character window, such as text. The font, size, color, etc. of the input characters are not important. The font and size of the input characters may be set in advance or may be changed as appropriate by the user. The character input accepting unit 1012 accepts, for example, the setting or changing of attributes such as font, size, and color for the inputted character or the inputted character. For example, the character attributes can be set or changed using a menu such as a drop-down menu displayed in the character window or a menu displayed by right-clicking the mouse in the character window. You may enable it to set for each window and each character. In addition, using the menu that displays the area designation window power described later and other menus that are displayed in areas other than the character window and area designation window, individual character windows and attributes for each character are individually specified. It may be possible to set the attribute or the like for the characters in all the character windows. Note that the configuration for accepting and executing processing for changing the font, size, color, etc. of a character is well known in the art. Since it is a technique, description is abbreviate | omitted here. The input accepted by the character input acceptance unit 1012 may be any input means such as a force menu screen mainly using a numeric keypad or a keyboard, or a mouse or tablet. The character input receiving unit 1012 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software for a menu screen.

[0232] The frame output instruction accepting unit 1013 accepts a frame output instruction that is an instruction as to whether or not to output the character window frame. The frame output instruction may be an instruction that specifies whether or not there is power to output the frame, and specifies whether to enable or disable the setting of performing frame output or not performing frame output. It may be an instruction. The frame output instruction may include an instruction as to whether or not to output the background color of the character window, or may be included in these instructions. The data structure of the frame output instruction does not matter. The frame output instruction accepting unit 1013 accepts input from the frame output instruction accepting unit 1013 by a pointing device such as a mouse, a numeric keypad, a keyboard, a menu screen, etc., and any input means can be used. Good. The frame output instruction receiving unit 1013 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

[0233] The character window output unit 1014 outputs the character window in which the character received by the character input reception unit 1012 is output, and the position based on the character window move instruction (for example, move (x, y), etc.) , Move the character window to output. Specifically, the character window output unit 1014 outputs a character when the character input reception unit 1012 does not accept character input !, a character window, or a preset character. Output a character window. When the character input receiving unit 1012 receives a character input, the received character is displayed in the character window. The character window is a window for displaying characters, and is a window independent of other windows, for example, an area designation window described later. The character window accepts operations such as moving, resizing, and erasing independently of other windows. The character window and other windows can be moved independently without being linked to each other. In addition, the character window can be output by the output device in the same way as a window in a general window system. Within the area, the output position can be set freely. The background color of the character window does not matter. Transparent color that allows the background color in the character window to be checked on which area of the output image! In particular, the background color is preferably transparent. The background color may be switched between display and non-display according to an instruction from the user received by the frame output instruction reception unit 1013 or the like. In addition, the character window is always an area that will be described later so that it can be used when adding explanatory text about image information that is output to other windows. It is preferable to output so that windows other than the designated window are placed in front. In the character window, the output position can be freely set within the output-enabled area of the output device in the same way as a window of a general window system. The character window output unit 1014 moves the output character window based on the character window move instruction described above. That is, the character window is output to the position indicated by the above-described character window movement instruction, for example, the position indicated by the coordinate information. Further, the character window output unit 1014 changes the size of the output character window based on the character window size change instruction and outputs the changed character window. Specifically, the character window having the size specified by the above-described character window size change instruction is output. Note that the configuration in which the character window output unit 1014 outputs the character window and the output by changing the size and position of the character window are well-known technologies as general window system technologies, and so on. Detailed explanation is omitted. The character window may or may not have a frame. However, if the inside of the character window is transparent, it is preferable to output a frame so that the position of the character window can be confirmed at least until the character is input. Here, in particular, it is assumed that the frame of the character window can be changed to output or non-output using the frame output instruction described above. Specifically, when the frame output instruction receiving unit 1013 receives a frame output instruction for outputting a frame of a character window, it acquires image information for outputting a frame stored in a memory (not shown). Using the image information, it composes and outputs image information for outputting a frame on the side of the character window. In addition, when the frame output instruction receiving unit 1013 receives a frame output instruction for non-outputting the character window frame, the image information for the character window frame is not output. Configure and output image information for the character window. In the character window, instructions to perform operations on areas other than the area where characters are displayed in the character window, specifically areas other than the frame and sides of the character window, such as events, It is preferable that the reception unit 1011 or the like does not receive, but the reception unit or the like of another device that outputs another window or the like on the back of the character window receives. As a result, it is possible to operate windows other than the character window through the overlapping portions of the character windows, and the presence of the character window can be prevented from interfering with operations on other windows. The operation of windows other than the character window is, for example, an operation of moving, resizing, deleting, or changing the image in the exercise. The character window output unit 1014 may display or stop displaying the character window at any trigger or timing. For example, a character window may be output when the operation of the image information processing apparatus 1001 starts, or a character window may be output based on a user instruction received by a reception unit (not shown). . In addition, the area image acquisition unit 1019 described later may stop displaying the image information as a trigger, or may output a character window when an area specification window described later is output. good. The display may be stopped when a not-shown input receiving unit or the like has received an input for instructing the end of the display. The character window output unit 1014 may or may not include an output device such as a display as an output device. The area designation window output unit 1016 can be realized by a driver software for an output device or driver software for an output device and an output device. Output is a concept that includes display on a display, transmission to an external device, and the like.

The area designation instruction accepting unit 1015 accepts an area designation window moving instruction that is an instruction to move an area designation window that is a window for designating an area. The area designation window movement instruction is composed of, for example, information for designating the movement destination of the area designation window. For example, when a character window output by an area designation window output unit 1016 described later is dragged and dropped using a mouse or the like, the area designation instruction receiving unit 1015 uses a mouse or the like as a destination area designation window. Accept movement instructions. In addition, in the area output by an output device (not shown) If you move the mouse and click or double-click the mouse button etc., you can accept the area designation window movement instruction with the pointer specified as the destination! The area designation instruction receiving unit 1015 further receives an area designation window size change instruction that is an instruction to change the size of the area designation window. The area designation window size change instruction includes, for example, information indicating the size of the area designation window after the change, specifically, information on the vertical and horizontal lengths of the area designation window. The information indicating the size of the area designation window after the change may be information of coordinates indicating two or more positions of the area designation window after the change, for example, the upper left corner and the lower right corner. For example, when the area designation window frame or side is dragged and dropped using a mouse or the like, the area designation instruction receiving unit 1015 sets the area size to the window size determined by the position of the dropped frame or the like. An area designation window size change instruction for changing the size of the designated window may be accepted. In addition, the area designation instruction receiving unit 1015, when an unillustrated input unit or the like receives the changed size of the area designation window by inputting a numerical value, the size of the area designation window is set to the size determined by this numerical value. An image display window change instruction for changing the image may be accepted. The input accepted by the area designation instruction accepting unit 1015 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, a menu screen, or the like, and any input means may be used. The area designation instruction accepting unit 1015 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

The area designation window output unit 1016 outputs an area designation window, and moves and outputs the output area designation window based on the area designation window movement instruction. Move the area specification window and output. The area designation window is a window used to designate an area for acquiring image information output in the window, and is a window independent of other windows such as a character window. This is The area specification window and other windows can be moved independently without being linked to each other. In addition, in the area specification window, the output position can be freely set within the output area of the output device in the same way as a window of a general window system. The background color of the area designation window is not specified. Area specification window It is preferable that the background color in the font is a transparent color so that the image on the back of the area specification window can be confirmed so that it can be identified on which area on the output image it is placed. In particular, the background color is preferably transparent. Since it is used for designating the area from which the image information being output is to be obtained, it is preferably output so that it is always placed in front of another window, particularly a character window. In the area specification window, the output position can be freely set in the output area of the output device, in the same way as a window of a general window system. The area designation window output unit 10 16 moves the output area designation window based on the area designation window movement instruction described above. That is, the area designation window is output at the position indicated by the above-described area designation window movement instruction, for example, the coordinates. The area designation window output unit 1016 changes the size of the output area designation window based on the area designation window size change instruction and outputs the changed area designation window. Specifically, the area designation window having the size designated by the area designation window size change instruction described above is output. Note that the configuration in which the region designation window output unit 1016 outputs the region designation window and the configuration in which the size and position of the region designation window are changed and output are well-known techniques such as general window system technology. Therefore, detailed description is omitted. The area designation window may or may not have a frame. However, if the area designation window is transparent, it is preferable to output a frame so that the position of the area designation window can be confirmed. In the area designation window, the above-described area designation instruction accepting unit 1015 accepts an instruction to perform an operation on an area in the area designation window, specifically, an area other than the frame or side of the area designation window, such as an event. First, the character instruction reception unit 1011 and the character input reception unit 1012 that receive instructions for the character window displayed on the back of the area specification window, or other windows that are displayed on the back of the area specification window It is preferable that the reception unit or the like of another device that outputs the data is received. As a result, operations such as windows other than the area designation window can be performed through the overlapping area designation windows, and the existence of the area designation window can be prevented from interfering with operations on other windows. The area designation window output unit 1016 may display or stop displaying the area designation window at any trigger or timing. Example For example, the region designation window may be output when the operation of the image information processing apparatus 1 is started, or the region designation window may be output when a character window is output. Also, the area designation window may be output based on a user instruction received by the reception unit or the like (not shown). In addition, the area image acquisition unit 1019, which will be described later, may stop the display as a trigger that the image information has been acquired, and the input accepting unit or the like inputs an instruction to end the display. It is also possible to stop the display with the acceptance as a trigger. The area designation window output unit 1016 may or may not include an output device such as a display as an output device. The area designation window output unit 10 16 can be implemented by output device driver software, or output device driver software and an output device. Output is a concept that includes display on a display, transmission to an external device, and the like.

 The magnification designation information accepting unit 1017 accepts magnification designation information that is information for designating a magnification for the image information acquired by the area image acquisition unit 1019. Specifically, the magnification is an enlargement ratio or a reduction ratio. The magnification designation information accepting unit 1017 may accept a numerical value for designating a magnification, for example, 50% as magnification designation information. In addition, information such as “enlargement” and “reduction” may be accepted. In this case, the size change for the image information is performed using a predetermined magnification set in advance. Magnification designation information receiving unit 1 017 The setting of the magnification designated by the magnification designation information received by 017 is stored in, for example, a memory. The input accepted by the magnification designation information accepting unit 1017 is a numeric keypad, a keyboard or a mouse or a menu screen, and any input means may be used. The magnification designation information receiving unit 1017 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software for a menu screen.

 The acquisition instruction receiving unit 1018 receives an acquisition instruction that is an instruction to acquire image information output to an area in the area specification window. The input accepted by the acquisition instruction accepting unit 1018 is from a numeric keypad, keyboard, mouse, menu screen, etc., and any input means may be used. The acquisition instruction receiving unit can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software for a menu screen.

[0238] The area image acquisition unit 1019 outputs the image information output to the area in the area designation window. get. Specifically, the image information output by the character window output unit 1014 or the output unit of another device is output to an area in the area specification window, that is, an area specified by the area specification window. Get image information. Specifically, the image information acquired by the region image acquiring unit 1019 is bitmap data. For example, the character window output unit 1014 and the image information output unit of other devices are usually composed of bitmap data for output to an output device or the like in an image output memory such as VRAM (not shown). Configure image information. The area image acquisition unit 1019 uses, for example, the coordinate information of the upper left corner in the area designation window and the vertical and horizontal lengths in the area designation window as area designation information that is information for designating the area in the area designation window. Is obtained from the area designation window output unit 1016 or the like, and the bitmap data power configured in the image display memory such as the VRAM described above is included in the area designated by the area designation information. Acquire image information. The process of acquiring at least a part of the output image information is a known technique as a process called so-called screen shot or screen capture, and detailed description thereof is omitted. Further, the area image acquisition unit 1019 acquires the image information output to the area in the area specification window based on the magnification specification information by enlarging or reducing the image information. For example, after acquiring the image information in the area specified by the area specifying information from the image information configured in the image display memory, the size of the acquired image information is set according to the magnification set by the magnification specifying information. change. Since the process of changing the size of the image information is a known technique, the description thereof is omitted. The region image acquisition unit 1019 can usually also be implemented with an MPU, memory, etc. The processing procedure of the area image acquisition unit 1019 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

The output unit 1020 outputs the image acquired by the region image acquisition unit 1019. Here, it is also considered that the output unit 1020 accumulates the image information acquired by the area image acquisition unit 1019 in a storage medium such as a hard disk. Further, it is considered that the output unit 1020 temporarily stores the image information acquired by the area image acquisition unit 1019 in a storage medium such as a memory. For example, the output unit 1020 temporarily stores the acquired image information in a so-called clipboard. The output unit 1020 includes an output device such as a display. You may think that it is not included. The output unit 1020 can be implemented by output device driver software, or output device driver software and an output device. Output is a concept including display on a display, transmission to an external device, temporary storage in a storage medium such as a memory, and accumulation in a storage medium such as a hard disk.

 Next, the operation of the image information processing apparatus 1001 will be described using the flowchart of FIG. Here, a description will be given in the case where some image is output in advance on the window of the display device.

 [0241] (Step S2701) The area designation window output unit 1016 determines whether or not to output an area designation window. The area designation window output unit 1016 may determine to output the area designation window by any trigger. For example, the area designation window output unit 1016 decides to output the area designation window, triggered by the instruction received by the character instruction acceptance section 1011, an input reception section (not shown), etc., to output the area designation window. May be. Further, it may be determined to output the area designation window with the fact that the image information processing apparatus 1001 has been started up as a trigger. In addition, when receiving an instruction to acquire an area designation window from another device or another processing unit of the image information processing apparatus 1, the area designation window output unit 1016 determines to output the area designation window. May be. If the area designation window output unit 1016 determines to output the area designation window, the process proceeds to step S2702, and if not, the process returns to step S2701.

 [0242] (Step S2702) The area designation window output unit 1016 outputs an area designation window.

 (Step S2703) The character window output unit 1014 outputs a character window. In addition

The processing order of step S2702 and step S2703 does not matter. The character window may be output when a user instruction is received.

[0244] (Step S2704) The acquisition instruction receiving unit 1018 determines whether or not the acquisition instruction has been received. If accepted, go to step S2705, otherwise accept step S2

Proceed to 709.

[0245] (Step S2705) The region image acquisition unit 1019 outputs the image to the region in the region designation window. Get image information. The acquired image information may be bitmap data including text.

 (Step S2706) The region image acquisition unit 1019 changes the size by reducing or enlarging the image information acquired in step S2705 based on the magnification designation information. When the magnification designation information is 100%, the size does not change, so the size does not need to be changed.

 (Step S 2707) The output unit 1020 outputs the image information acquired by the region image acquisition unit 1019. Then, the process returns to step S2704.

[0248] (Step S2708) The character input receiving unit 1012 determines whether or not the character input is accepted. If accepted, go to step S2709, otherwise accept step

Proceed to S2710.

 [0249] (Step S2709) The character window output unit 1014 configures a character window that outputs the character received in step S2708, and outputs the character window by replacing it with the currently output character window. Then, the process returns to step S2704.

 (Step S2710) Character instruction receiving portion 1011 determines whether or not a character window movement instruction has been received. If accepted, the process proceeds to step S2711. If not accepted, the process proceeds to step S2712.

 (Step S2711) Character window output unit 1014 moves and outputs the character window based on the character window movement instruction received in step S2710. Specifically, it replaces the currently output character window and outputs the character window at the position specified by the character window move instruction. Then, the process returns to step S2704.

 (Step S 2712) The character instruction receiving unit 1011 determines whether or not it has received a character window size change movement instruction. If accepted, the process proceeds to step S2713. If not accepted, the process proceeds to step S2714.

(Step S2713) Character window output unit 1014 changes the size of the character window based on the character window size change instruction received in step S2710, and outputs it. Specifically, a character window of the size specified by the character window size change instruction is configured and replaced with the currently output character window for output. And Return to step S2704.

 [0254] (Step S2714) The magnification designation information receiving unit 1017 determines whether or not the force has received the magnification designation information. If accepted, the process proceeds to step S2715. If not accepted, the process proceeds to step S2716.

 (Step S 2715) The magnification designation information receiving unit 1017 accumulates the magnification designation information received in Step S 2714 in a storage medium such as a memory. If the magnification specification information is already stored, the stored magnification specification information is updated with the received magnification specification information. Then, the process returns to step S 2704.

 (Step S2716) The frame display instruction receiving unit 1013 determines whether or not a frame display instruction has been received. If accepted, the process proceeds to step S2717. If not accepted, the process proceeds to step S2720.

 (Step S2717) The character window output unit 1014 detects the display state of the frame for the currently displayed character window. The display state of the frame can take any one of the state in which the frame is displayed and the force in which the frame is not displayed.

 [0258] (Step S2718) The character window output unit 1014 receives the frame display instruction received in step S2716, that is, whether to display the frame or not, and whether or not it matches the current frame display state. Determine whether. If they do not match, the process proceeds to step S2719. If they match, the process returns to step S2704.

 [0259] (Step S2719) The character window output unit 1014 changes the display state of the frame of the character window. Specifically, a character window whose frame display state has been changed is configured, and the currently displayed character window is replaced with the configured character window for output. Then, the process returns to step S2704. Note that the replacement output includes deleting the currently output window and outputting a new window.

 [0260] (Step S2720) The region designation instruction receiving unit 1015 determines whether or not it has received a region designation window movement instruction. If accepted, proceed to step S2721, accept, and go to step 5 / step S2722.

[0261] (Step S2721) The area designation window output unit 1016 moves the area designation window based on the area designation window movement instruction received in step S2720. Output. Specifically, the area designation window is output at the position designated by the area designation window movement instruction, replacing the area designation window currently output. Then, the process returns to step S2704.

[0262] (Step S2722) The region designation instruction receiving unit 1015 determines whether or not it has received the region designation window size change movement instruction. If accepted, the process proceeds to step S2723. If accepted, the process returns to step S2704.

[0263] (Step S2723) The area designation window output unit 1016 changes the size of the area designation window based on the area designation window size change instruction received in step S2721, and outputs the result. Specifically, an area specification window having the size specified by the area specification window size change instruction is configured, replaced with the currently output area specification window, and output. Then, the process returns to step S2704.

In the flowchart of FIG. 27, step S2708, step S2710, step

What is the order of processing S2712, step S2714, step S2716, step S2720, and step S2722?

Note that in the flowchart of FIG. 27, the processing is ended by powering off or interruption for aborting the processing.

 [0266] Hereinafter, a specific operation of the image information processing apparatus in the present embodiment will be described. FIG. 28 is a conceptual diagram of the image information processing apparatus. Here, a case where the image information processing apparatus 1001 has a display 1030 as an output device will be described as an example.

First, it is assumed that a window is displayed on the display 1030 as image information output by a device other than the image information processing device 1, for example, a computer that executes an application or the like. Next, when the user starts up the image information processing apparatus 1, the area designation window output unit 1016 and the character window output unit 1014 display the area designation window 1041 and the character window 1042 as shown in FIG. Is done. In the area specification window 1041 and the character window 1042, a frame 1041a and a frame 1042a are displayed, respectively. In FIG. 29, a window 1040 is a window displayed on the display 1030 by a device other than the image information processing device 1, for example, an image in a state where the case of the computer is opened is displayed. Shall. Area specification window 1 The display position, size, etc. of 041 and character window 1042 are determined based on preset values. The image information displayed on the display 1030 is, for example, image information temporarily stored in a VRAM or the like.

 FIG. 30 is an area designation window management table for managing the area designation window displayed on the display 1030. The area specification window management table is called “ID”, “window (x, y)”, “(width, height)”, “arrangement order”, “background color”, “magnification specification information”, and “frame display”. Has attributes. “ID” is identification information for managing the area designation window, and “Window (x, y)” is the coordinates of the upper left corner in the area designation window. Here, the unit is a pixel. “(Width, height)” is the width and height in the area specification window, and the unit is pixels. “Arrangement order” indicates the arrangement order of the windows, and the smaller the value, the more they are arranged in the front. Here, since the area designation window is always arranged in front of all other windows, the value of “arrangement order” of the area designation window is “1”. “Background color” is an attribute for designating the background color in the area designation window. Here, “T” indicating that the background color is transparent is set. “Magnification designation information” is the magnification designation information received by the magnification designation information receiving unit 17, and is assumed to be set to “100%” in the initial state. “Frame display” is an attribute for designating the power to specify the frame for the area specification window, “1” indicates that the frame is displayed, and “—1” indicates the frame. Indicates that is not displayed. When displaying a frame, the frame is displayed using image information or the like for displaying a frame designated in advance. The image information for displaying the frame is stored in a memory (not shown). The display of the frame is the same in the character window.

FIG. 31 is a character window management table for managing the character windows displayed on the display 1030. It has attributes of “ID”, “window (x, y)”, “(width, height)”, “arrangement order”, “background”, “frame display”, and “character string”. Since “ID”, “Window (x, y)”, “(Width, Height)”, “Arrangement Order”, “Background Color”, and “Frame Display” are the same as the corresponding attributes in FIG. The description is omitted. Since the character window is placed in front of all windows other than the area specification window, the value of “placement order” is set to “2”. “Frame display” indicates “1” indicating that a frame is displayed. "Character string" is a character string displayed in the character window. In the initial state, characters are input. Is not set.

 Next, as shown in FIG. 32, for example, the user clicks in the character window 1042 to display a cursor 1070 for inputting characters in the character window 1042. When the character string “Cautions when opening the case” is input from the keyboard or the like, the character input receiving unit 1012 receives the input character string, and the character window output unit 1014 receives the received character string 1071. Displayed in 1042 in the character window. The input character string is set as the attribute value of “Character string” in Figure 1031. Since the technique for displaying a cursor or the like at the character input position is a known technique, description thereof is omitted.

 [0271] When the user drags and drops the upper part or the upper side of the frame of the area designation window 1041 using a mouse or the like, the area designation instruction receiving unit 1015 receives the area designation window movement instruction and drops it with the mouse. The value of “window (x, y)” in FIG. 30 is replaced with the coordinates of the upper left corner of the area display window, and the area specification window 1041 is displayed at the replaced position. At this time, the area designation window 1041 is a window independent of the character window 1042 and other windows, and is not linked to each other. Even if the area designation window 1041 is moved, the character window 1042 does not move at all. Therefore, by moving the area designation window 1041, the relative position of the area designation window 1041 with respect to the character window 1042 and other windows can be adjusted.

[0272] In addition, when dragging and dropping the lower side, side, or corner of the area specification window 1041, the area specification instruction receiving unit 1015 receives an instruction to change the area specification window size and dropped it with the mouse. The height and width values of the area display window at the time replace the "(height, width)" value in Fig. 30, and the area specification window 41 of the replaced size is used to specify the currently displayed area. It is replaced with a window and displayed. At this time, the area designation window 1041 is a window independent of the character window 1042 and other windows, and is not linked to each other. Even if the size of the area designation window 1041 is changed, the position and position of the character window 1042 are not changed. There is no change in size. Therefore, by changing the size of the area specification window 1041, the size and position of the area specification window 1041 relative to the character window 1041 and other windows can be adjusted. Can be adjusted.

 [0273] In addition, when the user drags and drops the upper part or the upper side of the character window 1042 using a mouse or the like, the character instruction accepting unit 1011 accepts the instruction to move the character window and drops it with the mouse. The value of “window (x, y)” in FIG. 31 is replaced with the coordinates of the upper left corner of the character window, and the character window 1042 is displayed at the replaced position. At this time, the character window 1042 is a window independent of the area designation window 1041 and other windows, and is not linked to each other, and even if the character window 1042 is moved, the area designation window 1041 does not move at all. . Accordingly, by moving the character window 1042, it is possible to adjust the relative position of the character window 1042 with respect to the area designation window 1041 and other windows.

 [0274] In addition, if you drag and drop the lower side, side, or corner of the character window 1042, the character instruction acceptance unit 1011 receives the character window size change instruction and drops the character at the point when it was dropped with the mouse. The window height and width values replace the “(width, height)” value in Figure 31, and the character window 1042 of the replaced size is replaced with the currently displayed character window. Is done. At this time, the character window 42 is a window independent of the area specification window 1041 and other windows. Even if the size of the character window 1042 is changed without interlocking with each other, the position of the area specification window 1041 There is no change in size or size. Therefore, by changing the size of the character window 42, the size and position of the character window 1042 relative to the area designation window 1041 and other windows can be adjusted.

 [0275] When the user moves the area designation window 1041 and the character window 1042 using a mouse or the like and changes the size, the area designation window 1041 and the character window 1042 are displayed on the display 1030 as shown in FIG. Is displayed. As shown in FIG. 33, here, the character window 1042 is arranged in an area in the area designation window 1041.

 Further, FIG. 34 shows an area designation window management table corresponding to FIG. 33, and FIG. 35 shows a character window management table corresponding to FIG.

[0277] Next, the user selects a menu item for setting the frame display for the character window with the mouse. When a selection is made using, etc., a button 1111 for selecting to perform frame display as shown in FIG. 36 and a button 112 for selecting to perform frame display are displayed.

[0278] When the user places the pointer 1113 on the button 1112 and clicks the mouse button or the like, the frame display instruction receiving unit 13 receives a frame display instruction for hiding the frame. . The current frame display state is the state in which the frame is displayed, and the frame display instruction is different from the instruction to hide the frame. Therefore, according to this frame display instruction, the characters shown in FIG. As shown in the window management table, the attribute value of “frame display” is set to “−1” indicating that frame display is not performed. Then, the character window output unit 1014 hides the frame of the character window 1042 as shown in FIG. Specifically, the character window output unit 1014 configures a character window in which the frame is not displayed, and replaces the displayed character window with this character window.

 [0279] Next, when the user selects a menu item for acquiring the image information output in the area specification window using a mouse or the like, the acquisition instruction receiving unit 1018 receives the acquisition instruction. The area image acquisition unit 1019 acquires the image information output in the area designation window. Specifically, the area image acquisition unit 1019 uses, for example, information on the coordinates of the upper left corner in the area designation window and vertical information in the area designation window as area designation information that is information for designating an area in the area designation window. And the horizontal length information is obtained from the area designation management table as shown in Fig. 34. Then, from the display memory such as VRAM in which the image information to be displayed on the display 200 is stored, the image information of the area designated by the area designation information is extracted from the currently displayed image information. get. Here, the image information in the area where the coordinates of the upper left corner are (250, 50), the width is 500 pixels, and the vertical length is 300 pixels is acquired. Here, as shown in FIG. 34, since the “magnification designation information” is “100%”, the size of the acquired image information is not changed as a result. As a result, the region image acquisition unit 1019 acquires image information having a width of 500 pixels and a height of 300 pixels.

[0280] The output unit 20 stores the image information acquired by the region image acquisition unit 1019 in a hard disk or the like by assigning, for example, a file name according to a preset rule, such as "Screen 1", for example. To do. FIG. 39 is a diagram showing a display example when the image information acquired by the area image acquisition unit 1019 and stored in the hard disk or the like by the output unit 1020 is displayed on a display or the like. As shown in FIG. 39, the image information 1141 includes an image of the character string displayed in the character window 1042.

 [0282] Here, when the user wants to obtain image information excluding the character string displayed in the character window 42 from the image information 1141, the character window 1042 shown in FIG. The image information may be acquired using the area image acquisition unit 19 after being moved outside.

 [0283] Next, when the user selects a menu item for setting the magnification of the image information acquired by the area image acquisition unit 1019 using a mouse or the like, the magnification as shown in Fig. 40 is input. An input field 1141 for displaying is displayed.

 [0284] When the user inputs, for example, 50% as a numerical value in the input field 1141 using a keyboard or the like and presses the "OK" button 1142 using a mouse or the like, the magnification designation information receiving unit 1 017 displays As the magnification designation information, the magnification designation information with a value of “50%” is accepted. By this value, the value of “magnification designation information” in the area designation information management table shown in FIG. 34 is changed from “100%” to “50%”. Changed to

 [0285] As described above, when image information is acquired using the region image information acquisition unit 1019, the region image acquisition unit 19 reduces the acquired image to 50% in accordance with the magnification designation information. As a result, the image information stored in the output unit 1020 is an image information obtained by reducing the image information 1141 shown in FIG. 39 to 50%, that is, image information having a width of 250 pixels and a height of 150 pixels.

 As described above, according to the present embodiment, the character window for outputting characters and the area designation window for designating the area are output, and the image information output to the area in the area designation window is acquired. Since it is made possible, when acquiring the output image information, it is possible to acquire the image information in which desired characters are added to the output image information.

[0287] In addition, the character to be added is output in a character window that can be moved and resized independently of other windows. It is possible to easily set whether or not the character is placed in the area where the information is acquired, and workability can be improved.

 [0288] Also, the area for acquiring the output image information is specified by the area specification window that can be moved and resized independently of other windows, so the area setting is It becomes easy and workability can be improved.

 Note that, according to the present embodiment, if it is not necessary to change the magnification of the image information acquired by the area image acquisition unit 1019, the magnification specification unit 1017 and the like may be omitted.

 [0290] In the present embodiment, two or more area designation windows may be output. Similarly, two or more character windows may be output. For example, in the specific example described above, this can be realized by preparing as many records in the area designation window management table and character window management table as there are area designation windows and character windows. However, in this case, it is necessary to set the arrangement order in the area specification window and the character window.

 [0291] In the above embodiment, each process (each function) may be realized by centralized processing by a single device (system), or may be distributed by a plurality of devices. It will be realized by being.

[0292] In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. The software that realizes the image information processing apparatus in the above embodiment is the following program. That is, the program includes a character instruction receiving step for receiving a character window moving instruction, which is an instruction for moving a character window, which is a window for outputting characters, and a character input receiving step for receiving character input. The character window in which the character received in the character input reception step is output is output, the character window is moved to the position based on the character window movement instruction, and the region is specified. The area specification window that is the window for An area designation instruction receiving step for accepting an area designation window movement instruction as an instruction, and an area designation window for outputting the area designation window and moving and outputting the output area designation window based on the area designation window movement instruction An output step; an acquisition instruction receiving step for receiving an acquisition instruction that is an instruction to acquire image information output to an area in the area specifying window; and acquiring image information output to an area in the area specifying window This is a program for executing an area image acquisition step and an output step of outputting the image acquired in the area image acquisition step.

 [0293] In the above program, the transmission step for transmitting information and the reception step for receiving information are performed by hardware, for example, a modem or an interface card in the transmission step. Does not include processing (processing that can only be done with software)! /.

 [0294] This program is recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, etc.) that can be executed by being downloaded by a server or the like. The program may be executed by being read.

 [0295] Further, the computer that executes this program may be singular or plural. That is, centralized processing or distributed processing may be performed.

 [0296] Needless to say, in the above embodiment, two or more communication means (such as an output unit) existing in one device may be physically realized by one medium.

 [0297] In the above-described embodiment, the case where the image information processing apparatus is a stand-alone has been described. However, the image information processing apparatus may be a stand-alone apparatus or a server in a client system. Also good. In the latter case, for example, the output unit, the reception unit, etc. receive input via a communication line or output information for displaying a screen.

 [0298] It goes without saying that the present invention can be variously modified without being limited to the above-described embodiments, and these are also included in the scope of the present invention.

 [0299] (Embodiment 5)

Hereinafter, embodiments of an image information processing apparatus and the like will be described with reference to the drawings. It should be noted that components having the same reference numerals in the embodiment perform the same operation, so that There is a case where the description is omitted.

 FIG. 41 is a block diagram of the image information processing apparatus in the present embodiment.

 [0301] The image information processing apparatus 2001 includes a first information storage unit 2011, a first information output unit 2012, a first information instruction reception unit 2013, a first area designation instruction reception unit 2014, a first window output unit 2 015, Two-region designation instruction reception unit 2016, second window output unit 2017, acquisition instruction reception unit 2018, region image acquisition unit 2019, region image output unit 2020, setting instruction reception unit 2021, execution instruction region configuration unit 2022, execution instruction configuration unit 2023, an area information output unit 2024, a designation receiving unit 2025, an execution instruction output unit 2026, and an execution information output unit 2027.

 [0302] The first information storage unit 2011 may store the first information. In the first information storage unit 2011, the first information may be stored from the beginning, or the first information may be stored by another processing unit or the like. The first information may be any information such as text information and image information as long as it can be displayed. Here, a case where the first information is information used for displaying an image will be described as an example. It does not matter whether the first information is bitmap information (raster information) or vector information. It does not matter whether the first information is compressed or uncompressed. The data format of the first information does not matter. The first information may be in any data format such as JP EG format, GIF format, BMP format, TIFF format, etc. The first information may be character information such as text as long as it is information that can be displayed as an image. The first information storage unit 11 is preferably a nonvolatile recording medium, but can also be realized by a volatile recording medium.

[0303] The first information output unit 2012 outputs the first information to a first information display window which is a window for displaying the first information. For example, the first information output unit 2012 outputs the first information in response to the first information instruction receiving unit 2013 described later receiving an instruction to display the first information. The configuration for displaying the image information on the window is a well-known technique as a general window system technique, and thus description thereof is omitted. The first information output unit 2012 moves the first information display window in response to a first information display window movement instruction received by the first information instruction receiving unit 2013 described later. The first information display window movement instruction is an instruction to move the first information display window. That is, the first information display window in the output device, for example, a display device such as a display. This is an instruction to move the output position of the queue. The first information display window movement instruction includes, for example, information for specifying the movement destination of the first information display window, specifically, information for specifying the coordinates and area of the movement destination within the output area of the output device, and , And commands to execute movement to the destination. The first information output unit 2012 changes the size of the first information display window according to the first information display window size change instruction received by the first information instruction receiving unit 2013 described later. The first information display window size change instruction is an instruction to change the size of the first information display window. In addition, the first information output unit 2012 outputs an enlarged or reduced image of the first information displayed in the first information display window according to the enlargement / reduction instruction received by the first information instruction receiving unit 2013 described later. To do. The enlargement / reduction instruction is an instruction to enlarge or reduce the image of the first information displayed in the first information display window. The first information output unit 2012 may be considered to include or not include an output device such as a display or a printer as an output device. The first information output unit 2012 can be implemented by output device driver software, or output device driver software and an output device. Output is a concept that includes display on a display, printing on a printer, transmission to an external device, and the like.

For example, the first information instruction receiving unit 2013 receives an instruction to output the first information. The first information display window moving instruction described above, which is an instruction to move the first information display window, is received. For example, when the first information display window 2013 is so-called dragged and released, the first information instruction reception unit 2013 receives a first information display window movement instruction with the released position as a movement destination. In addition, when the pointer is moved within the output area of the output device and the mouse button is clicked or double-clicked, it receives an instruction to move the first information display window with the position specified by the pointer as the destination. May be. Further, the first information instruction receiving unit 2013 receives the above-described first information display window size change instruction which is an instruction to change the size of the first information display window. The first information display window size change instruction includes, for example, information on the vertical and horizontal lengths of the first information display window and a command for executing the change of the first window to the size. For example, the first information instruction receiving unit 2013 is configured to display the first information display queue. When the window of the window is dragged and released, a first information display window size change instruction corresponding to the window size determined by the position of the released frame or the like may be accepted. In addition, the first information instruction receiving unit 2013, when an unillustrated input unit or the like receives the changed size of the first information display window by inputting a numerical value, the window size is set to a size determined by this numerical value. An instruction to change the first information display window, which is an instruction to change, may be accepted. In addition, the first information instruction receiving unit 2013 displays the menu information by selecting an enlargement command, a reduction command, or the like, and displays an enlarged or reduced image of the first information. Therefore, the above-described enlargement / reduction instruction may be received. The enlargement / reduction instruction may include, for example, information specifying the magnification of the image. The input accepted by the first information instruction accepting unit 2013 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, a menu screen, and the like, and any input means may be used. The first information instruction receiving unit 2013 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or a control software such as a menu screen or a window system.

The first area designation instruction receiving unit 2014 accepts a first window generation instruction that is an instruction for generating a first window that is a window for specifying the first area. The first area is a desired area of the first information. Specifically, the first window is a window used for designating a desired area of the first information. The first window generation instruction is an instruction for generating a first window, for example, a command. The first area designation instruction receiving unit 2014 accepts a first window movement instruction that is an instruction to move the first window generated by the first window generation instruction. The first window movement instruction includes, for example, information for designating the destination of the first window, specifically, information for designating the coordinates and area of the destination within the output possible area of the output device, and the destination to the destination. Consists of commands that execute movement. For example, when the first area designation instruction accepting unit 2014 drags and releases the first window, the first area designation instruction accepting unit 2014 accepts a first window movement instruction with the released position as the movement destination. In addition, when the pointer is moved within the area where the output device can output and the mouse button or the like is clicked or double-clicked, a first window move instruction is issued with the position specified by the pointer as the move destination. You can accept Yes. The first area designation instruction accepting unit 2014 accepts a first window size change instruction that is an instruction to change the size of the first window. The first window size change instruction includes, for example, information on the vertical and horizontal lengths of the first window and a command for executing the change of the first window to the size. For example, when the first area designation instruction accepting unit 2014 drags and releases the frame or the edge of the first window and releases it, the first area designation instruction receiving unit 2014 receives the size of the window determined by the position of the released frame or the like. A first window size change instruction that is an instruction to change the size may be accepted. In addition, the first area designation instruction receiving unit 2014, when an input unit (not shown) receives the changed size of the first window by inputting a numerical value, the size of the first window is set to the size determined by this numerical value. A first window change instruction that is an instruction to change the window may be accepted. The input received by the first area designation instruction receiving unit 2014 is a pointing device such as a mouse, an input using a numeric keypad, a keyboard, a menu screen, and the like, and any input means may be used. The first area designation instruction receiving unit 2014 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

The first window output unit 2015 outputs the first window in response to the first window generation instruction. The configuration for outputting the first window is a well-known technique as a general window system technique, and thus description thereof is omitted. The first window is an independent window with respect to the first information display window described above, and the first window and the first information display window can be moved independently without being linked to each other. Is possible. In addition, the output position of the first window can be freely set in the output area of the output device in the same manner as a window of a general window system. For example, the first window can be set on the first information display window. It is also possible to output the first window to an area other than this area. Since the first window is used to specify the area on the first information display window, it is always placed in front of the first information display window described above so as not to be hidden behind the first information display window. It is preferred that More preferably, it is arranged in the forefront with respect to all windows other than the second window described later. For example, the first information output unit 2012 and the first window output unit 2015 have the same display. When the first information display window and the first window are output to play, the first window is always placed in front of the first information display window. No images etc. need to be displayed in the first window. The background color in the first window is a transparent image that allows you to see the image on the back of the first window so that you can select which area on the image to select. In particular, the background color is preferably transparent. Further, the first window may or may not have a frame. However, if the inside of the first window is transparent, it is preferable to display a frame so that the position of the first window can be confirmed. In the first window, the first window does not accept instructions to perform operations on areas in the first window, specifically, areas other than the frame and sides of the first window, such as events. Specifically, it is preferable that the first area designation instruction receiving unit 2014 or the like described above does not receive, but a reception unit or the like that receives an instruction for the first information display window or the like located behind the first window. Yes. Thereby, the operation of the first information display window and the like can be performed through the area surrounded by the first window. The first window output unit 2015 moves the output first window in response to the first window movement instruction described above. That is, the first window is output at the position indicated by the first window movement instruction described above. Also, the first window output unit 2015 changes the size of the output first window in response to the above-mentioned first window size change instruction and outputs the first window. That is, the first window having the size specified by the first window size change instruction described above is output. Note that the first window output unit 2015 may stop displaying the first window at any trigger or timing. For example, the area information output unit 2024, which will be described later, may stop the display when the execution instruction area setting information is output as a trigger, and the display is not shown! It may be possible to stop the display by accepting the input of the instruction. The first window output unit 2015 may or may not include an output device such as a display or a printer as an output device. The first window output unit 20 15 may be realized by output device driver software, or output device driver software and an output device. Output is a concept that includes display on a display, transmission to an external device, and the like. The second area designation instruction receiving unit 2016 accepts a second window generation instruction that is an instruction for generating a second window that is a window for specifying the second area. Specifically, the second area is a desired area on an area where display such as an area on the display is performed. Specifically, the second window is used to designate a desired area including an area on the image displayed by the first information on an area where the display area or the like is displayed. It is a window. It also accepts a second window movement instruction that is an instruction to move the second window. The second area designation instruction accepting unit 2016 accepts a second window size change instruction that is an instruction to change the size of the second window. Regarding the second window generation instruction, the second window movement instruction, the second window size change instruction, and the configuration for outputting the second window in response to these instructions, the first area designation instruction receiving unit 2014 Since the first window generation instruction, the first window movement instruction, the first window change instruction, and the structure that outputs the first window in response to these instructions are the same as described above in the description of the configuration, detailed description thereof is omitted. To do. When the first area designation instruction accepting unit 2014 accepts the first window size change instruction, the second window has a size corresponding to the size designated by the first window size change instruction, for example, the same size. The second window size change instruction may be configured and output to the second area designation instruction receiving unit 2016. In this way, the second window output unit 2017 described later can further change the size of the output second window in accordance with the first window size change instruction and output it. Similarly, when the second area designation instruction accepting unit 2016 accepts the second window size change instruction, the first window has a size corresponding to the size designated by the second window size change instruction, for example, the same The first window size change instruction may be configured so as to be the size and output to the first area designation instruction receiving unit 2014. In this way, the first window output unit 2015 can further change the size of the output first window in response to the second window size change instruction. For example, by doing this, the size of the first window and the second window can always be the same. The second area designation instruction accepting unit 2016 accepts input by pointing devices such as a mouse, numeric keypad, keyboard, menu screen, etc. It may be anything. The second area designation instruction accepting unit 2016 can be realized by a device driver of an input means such as a numeric keypad or a keyboard, or control software such as a menu screen or a window system.

The second window output unit 2017 outputs the second window in response to the second window generation instruction. Since the configuration for outputting the second window is a well-known technique as a general window system technique, a description thereof will be omitted. The second window is independent from the first information display window and the first window described above, and the second window, the first information display window, and the first window are not linked to each other. It can be moved independently. However, if necessary, at least two of these may be linked. Further, the output position of the second window can be freely set within the output possible area of the output device in the same manner as a window of a general window system. For example, the second window can be set on the first information display window described above. It is also possible to output the second window to an area other than the area. Since the second window is used to specify an area on the display area, etc., the first information display described above is always performed so as not to be hidden by the first information display window. It is preferable to be placed in front of the window. More preferably, it is arranged in the forefront with respect to all windows other than the first window described above. There is no need to display images in the second window. The background color in the second window can be used to confirm the image on the back of the second window so that it can be determined which area on the display area is selected. In particular, a transparent image is preferred, and the background color is preferably transparent. Further, the second window may or may not have a frame. However, when the second window is transparent or transparent, it is preferable to display a frame so that the position of the second window can be confirmed. In the second window, the second window does not accept an instruction to perform an operation on an area in the second window, specifically an area other than the frame or side of the second window, for example, an event. Specifically, it is preferable that the second area designation instruction receiving unit 2016 or the like described above does not receive, but a reception unit or the like that receives an instruction for the first information display window or the like located on the back of the second window. This is the second Operations such as the first information display window can be performed through the area surrounded by the window. The second window output unit 2017 moves the output second window in response to the second window movement instruction described above. That is, the second window is output at the position indicated by the second window movement instruction described above. Further, the second window output unit 17 changes the size of the output second window in accordance with the above-described second window size change instruction, and outputs it. That is, the second window having the size specified by the second window size change instruction described above is output. Note that the second window output unit 2017 may stop displaying the second window at any trigger timing. For example, the area information output unit 2024, which will be described later, may stop the display triggered by the output of the execution instruction area setting information, etc. It may be possible to stop the display by receiving the input to be triggered. The second window output unit 2017 may or may not include output devices such as displays and printers as output devices. The second window output unit 2017 can be realized by output device driver software, or output device driver software and an output device. The output is a concept including display on a display, transmission to an external device, and the like.

 [0309] The acquisition instruction receiving unit 2018 receives an acquisition instruction which is an instruction to acquire image information output to the area in the second window. The input accepted by the acquisition instruction accepting unit 2018 is through a numeric keypad, keyboard, mouse or menu screen, and any input means can be used. The acquisition instruction receiving unit can be realized by a device driver for input means such as a numeric keypad or a keyboard, control software for a menu screen, or the like.

[0310] The area image acquisition unit 2019 acquires the image information output to the area in the second window. Specifically, the image output to the area in the second window, that is, the area specified by the second window, of the image information output by the first window output unit 2015 or the output unit of another device. Get information. Specifically, the image information acquired by the area image acquisition unit 2019 is bitmap data, but may be vector data. For example, an output unit that outputs image information usually configures image information that also has bitmap data power to be output to an output device or the like in an image output memory such as VRAM (not shown). The region image acquisition unit 2019 is a region that is information specifying the region in the second window. As the area designation information, for example, the information on the coordinates of the upper left corner in the second window and the length and width information in the second window are obtained from the second area designation instruction receiving unit 2016 and the like, and are described above. Image information in an area designated by the area designation information is acquired from the image information having a bitmap data power configured in an image display memory such as a VRAM. The process for acquiring at least a part of the output image information is a known technique as a process called so-called screen shot or screen capture, and detailed description thereof is omitted. The area image acquisition unit 2019 may have such a memory or the like inside which the acquired image information may be stored in a memory or the like (not shown). The area image acquisition unit 2019 can usually be realized by an MPU (Micro Processing Unit), a memory, or the like. The processing procedure of the area image acquisition unit 2019 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

The region image output unit 2020 outputs the region image information acquired by the region image acquisition unit 2019 on the region located in the first window of the first information. The region image information output by the region image output unit 2020 is output so as to be displayed superimposed on the first information. The area image output unit 2020 may display the area image information in a completely opaque manner so as to overlap and display the area image information so that a part or all of the first information is transmitted. Good. Further, the region image information output by the region image output unit 2020 may be pasted to the first information, and the first information of the portion to which the region image information is pasted may be updated with the region image information. When the region image output unit 2020 and the first information output unit 2012 display an image on the same display, the region image information is displayed on the first information. Specifically, a display device (not shown) combines the first information output from each of the region image output unit 2020 and the first information output unit 2012 and the region image information, so that the first information is displayed on the first information. Displays area image information. When the size of the image output by the region image information is different from the size in the first window, the region image output unit 2020 makes the size of the region image information the same as the size in the first window. As described above, the image size of the region image information may be changed and output. As described above, the process of changing and outputting the region image information so as to be the size of the first window is a well-known technique, so the description is omitted. Omitted. The region image output unit 2020 may be considered not to include an output device such as a display. The area image output unit 2020 can be realized by output device driver software or output device driver software and an output device. Output is a concept including temporary storage and storage in a storage medium such as a memory, display on a display, transmission to an external device, and the like. The region image output unit 2020 and other output units such as the first information output unit 2012 may be realized by one output unit having the same configuration.

The setting instruction receiving unit 2021 is an instruction for setting an area located in the first window of the first information as an execution instruction area that is an area for outputting an execution instruction that is information for instructing execution of a predetermined process. Accept instructions. That is, an instruction to set an area located in the first window of the first information as an execution instruction area is a setting instruction. “Output execution instruction” means, for example, sending a message to another processing unit or the like, issuing an event, or outputting a command such as an execution instruction or a start instruction. The region located in the first window of the first information is, for example, a region located in the first window of the first information displayed in the first information display window. In addition, an area located within the first window of the first information has an area outside the first information display window of the first information when at least a part of the first window is arranged outside the first information display window. The area including the area corresponding to the position where the first window is arranged may be used. Specifically, when the size of the image of the first information is larger than the size of the first information display window, a part of the first information is cut out and output in the first information display window. The area on the first information that is determined to be output in the first window when the first information is output without being cut out in the size of the first information display window is also here. The area is located in the first window of information. The setting instruction includes, for example, an instruction for setting an execution instruction area, and information for setting what kind of execution instruction is output for the set execution instruction area. The information for setting what kind of execution instruction is output is, for example, information including location information that is information indicating the location of desired information. Specifically, if it is set in advance to output a command for executing an image opening process as an execution instruction, the location information includes the directory of the image to be opened in the execution instruction. Accept the specified directory information. In addition, if it is set in advance to output a command that causes other browser software or the like to execute processing for acquiring URL information as an execution instruction, information on the execution instruction is provided as location information. Accept the information that specifies the URL of the acquisition destination. In addition, when what kind of execution instruction is output is set in advance, the setting instruction may not include information for setting what kind of execution instruction is output. The input device of the setting instruction receiving unit 2021 may be anything such as a numeric keypad, keyboard, mouse, or menu screen. The setting instruction receiving unit 2021 can be realized by a device driver of an input device such as a numeric keypad or a keyboard, a menu screen control software, or the like.

The execution instruction area configuration unit 2022 configures execution instruction area setting information which is information for setting an area located in the first window as an execution instruction area in accordance with the setting instruction received by the setting instruction receiving unit 2021. . Specifically, this area is used as the execution instruction area described above. The execution instruction area configuration unit 2022 uses, as execution instruction area setting information, information specifying an area located in the first window of the first information displayed in the first information display window. However, if at least part of the first window is located outside the first information display window, the execution instruction area setting information indicating the position corresponding to the position where the first window is located in the first information. Configure. Specifically, when the first information is displayed outside the first information display window, the execution instruction area setting information indicating the position where the first window is arranged on the first information is configured. To do. Specifically, the execution instruction area setting information is information for designating an area located in the first window in the first information, and is usually one or more coordinates in the first information, for example, one of the four corners. It has information on the coordinates of the glossy center point. For example, the execution instruction area setting information includes information on coordinates of one of the four corners of the execution instruction area in the first information and information on the size of the execution instruction area such as the vertical and horizontal lengths. However, the execution instruction area setting information may be any information such as the coordinates of all four corners of the execution instruction area as long as the execution instruction area can be specified. In addition, when the size of the execution instruction area is set in advance, only the information of one coordinate of the four corners of the execution instruction area may be used. These pieces of information are usually information indicating the output position of the first window, for example, coordinates, etc. Acquired according to information indicating the size of one window. The execution instruction area setting information may include area image information, which is information of an image to be displayed in the area, in addition to information specifying these areas. The area image information will be described later. The execution instruction area configuration unit 2022 can usually be realized by an MPU, a memory, or the like. The processing procedure of the execution instruction area configuration unit 2022 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

 [0314] The execution instruction configuration unit 2023 configures an execution instruction, which is information output when the execution instruction area of the first information is specified, according to the setting instruction. Specifically, the execution instruction is information such as an instruction for instructing the execution of some process, and it does not matter what process the execution instruction is for instructing the execution of the process. Also, it does not matter what execution instruction the execution instruction configuration unit 2023 configures according to the setting instruction. For example, the execution instruction configuration unit 2023 may configure a preset execution command in which information included in the setting instruction is set as a parameter. For example, when location information is included in the setting instruction, the execution instruction configuration unit 2023 configures an execution instruction that is an instruction to execute predetermined processing on desired information indicated by the location information. Specifically, if the location information is a URL, an execution instruction that is an instruction to execute a process of acquiring the place force information indicated by the URL is configured. In addition, if the location information is directory information, an execution instruction that is an instruction to execute processing for obtaining desired information from the directory indicated by the directory information and outputting the information may be configured. Here, the desired information is referred to as second information. In particular, here, a case where the second information is image information will be described. In addition, when a setting instruction is accepted, it is also possible to simply acquire a predetermined execution instruction triggered by the acceptance of the setting instruction. Here, the execution instruction is configured according to the setting instruction. is there. The execution instruction configuration unit 2023 can be usually realized by an MPU or a memory. The processing procedure of the execution instruction configuration unit 23 is usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).

[0315] The area information output unit 2024 outputs the execution instruction area setting information configured by the execution instruction area configuration unit 2022 and the execution instruction configuration unit 2023, and the execution instruction. Here, the area information output unit 2024 stores the execution instruction area setting information and the execution instruction on a storage medium such as a hard disk. It is also considered as output that the display information is accumulated and the region information output unit 2024 temporarily stores the image information acquired by the region image acquisition unit 2019 in a storage medium such as a memory. The area information output unit 2024 displays, for example, first information and area image information in addition to the execution instruction area setting information and the execution instruction, by a predetermined address that is set in advance, such as an IP address. You may make it transmit with respect to the transmission destination. Further, when the execution instruction is information that is stored in a predetermined directory and instructs to output the second information, the second information may be acquired and transmitted to the same address or the like. The area where the area image information is output becomes the execution instruction area. The area image information may be any image information. Specifically, it may be image information having transparency, for example, translucent monochromatic image information. When the region information output unit 2024 and the first information output unit 2012 display an image on the same display, the region image information is displayed on the execution instruction region of the first information display window of the first information. . The area information output unit 2024 may or may not include an output device such as a display. The area information output unit 2024 can be implemented by output device driver software, or output device driver software and an output device. Output is a concept that includes temporary storage and storage in a storage medium such as a memory, display on a display, transmission to an external device, and the like. In particular, the case where data is stored in a memory will be described here.

 The designation receiving unit 25 receives the designation of the execution instruction area set by the execution instruction area setting information of the first information output by the first information output unit 2012. For example, the specified information reception unit

2025 accepts the designation by specifying a position in the execution instruction area, for example, coordinates by inputting a pointing device or a keyboard force. Specifically, for example, the designation receiving unit 2025 reads designation designation area setting information from a memory or the like, and the coordinates designated by the pointing device or the like are located within the area set by the designation area setting information. Judge whether or not it is OK. If it is located within the area, it is determined that the execution instruction area has been designated, and the designation is accepted. The input device of the designation receiving unit 2025 may be anything such as a numeric keypad, a keyboard, a mouse, or a menu screen. Designated reception department

It can be realized with device drivers for input devices such as numeric keys and keyboards, and control software for menu screens. [0317] The execution instruction output unit 2026 outputs an execution instruction in response to the designation received by the designation receiving unit 2025. Here, the execution instruction output unit 2026 acquires an execution instruction corresponding to the designated execution instruction area from a memory or the like and outputs it. The output described here includes sending messages to other processing units, issuing events, sending commands, starting instructions, etc. For example, when the execution instruction is a command for acquiring and outputting image information from the directory indicated by the location information, this command is output to the execution information output unit 2027 described later. In response to this execution instruction, the execution information output unit 2027 acquires image information from the directory indicated by the location information in the first information storage unit 2011, and outputs this image information in a new window, for example. . The execution instruction may output a predetermined execution command to an apparatus executed by another apparatus other than the image information processing apparatus, a computer, or the like. The correspondence relationship between the execution instruction area and the execution instruction may be managed in any manner, for example, using a table or the like. The execution instruction output unit 2026 may or may not include an output device such as a communication means. The execution instruction output unit 2026 may be realized by output device driver software, or output device driver software and an output device. Output is a concept including output to other processing units in the image information processing apparatus, transmission to an external apparatus, and the like.

[0318] The execution information output unit 2027 outputs the second information acquired according to the execution instruction. Specifically, the execution information output unit 2027 acquires and outputs the second information for the location force indicated by the URL as the location information, for example, in response to the execution instruction. Further, the execution information output unit 2027 acquires and outputs the second information from the directory indicated by the directory information that is the location information, for example, according to the execution instruction. This second information may be any information such as image information and character information. The second information may be stored anywhere. The second information is stored in a storage medium such as a memory disk (not shown). This storage medium may be the first information storage unit 2011 described above. Further, the second information may be stored in an external server connected via a network or the like. For example, the execution information output unit 20 27 outputs the second information using a first information display window or the like. The configuration for displaying information such as image information and text information in a window using a window etc. is a well-known technology as a general window system technology. Omitted. The execution information output unit 2027 may or may not include an output device such as a display or a printer as an output device. The execution information output unit 2027 can be realized by output device driver software or output device driver software and an output device. Output is a concept that includes display on a display, printing on a printer, transmission to an external device, and the like.

Next, the operation of the image information processing apparatus will be described using the flowchart of FIG.

[0320] (Step S4201) The first information output unit 2012 determines whether or not to output the first information. The first information output unit 2012 may determine whether or not to output image information. For example, the first information output unit 2012 outputs the first information triggered by the first information instruction receiving unit 2013 or an input receiving unit (not shown) receiving an instruction to output the first information. May be determined. In addition, when receiving an instruction to acquire the first information from another device or another processing unit of the image information processing apparatus 1, the first information output unit 2012 determines to output the first information. May be. If the first information output unit 2012 determines to output the first information, the process proceeds to step S4202, and if not, the process returns to step S4 201.

 [0321] (Step S4202) The first information output unit 2012 outputs the first information stored in the first information storage unit 2011 to the first information display window.

(Step S4203) First region designation instruction receiving unit 2014 and second region designation instruction receiving unit 2016 determine whether or not they have received the first window generation instruction and the second window generation instruction. Usually, these two instructions are accepted simultaneously. However, it may be accepted individually. If both are accepted, the process proceeds to step S4204. If both are accepted, the process proceeds to step S4213.

(Step S 4204) First window output unit 2015 outputs the first window. The second window output unit 2017 outputs the second window.

[0324] (Step S4205) The acquisition instruction receiving unit 2018 determines whether or not the acquisition instruction has been received. If accepted, go to step S4206, otherwise accept step S4206

Proceed to 4219. [0325] (Step S4206) The region image acquisition unit 2019 acquires region image information about the region specified by the second window. For example, area image information that is image information corresponding to an area designated by the second window is acquired from display image information stored in a VRAM or the like.

 (Step S4207) The region image output unit 2020 outputs the region image information acquired in step S4206 to the position where the first window of the first information was arranged.

 (Step S 4208) Setting instruction accepting unit 2021 determines whether or not a setting instruction has been accepted. For example, normally, an input window for accepting a setting instruction is displayed immediately after step S4207, and a setting instruction is accepted from this input window. If accepted, the process proceeds to step S4209. If not accepted, the process returns to step S4205.

 (Step S 4209) Execution instruction area configuration unit 2022 configures execution instruction area setting information. Specifically, information specifying the area located in the first window of the first information display window is acquired from the position information of the area in the first window by coordinate conversion or the like, and the acquired information is executed. It is designated area setting information.

 (Step S4210) The execution instruction configuring unit 2023 configures an execution instruction. Specifically, an execution instruction that is an execution command or the like that outputs an image file or the like included in the setting instruction received in step S4208 is configured. Note that the processing order of step S4209 and step S4210 does not matter.

 (Step S4211) Area † Blueprint Output Unit 2024 outputs the execution instruction area setting information and the execution instruction configured in Step S4209 and Step S4210. In this example, it is stored in memory.

 (Step S4212) First window output unit 2015 ends the output of the first window. In addition, the second window output unit 2017 ends the output of the second window. Then, the process returns to step S4203.

[0332] (Step S4213) The designation receiving unit 2025 determines whether or not the execution instruction area is set. The fact that the execution instruction area is set means that one or more execution instruction area setting information and execution instructions are configured and output in steps S4209 and S4210, and are stored in a memory or the like here. It is that. Execution instructions If the area has been set, the process proceeds to step S4214. If not, the process proceeds to step S4217.

 (Step S4214) The designation receiving unit 2025 determines whether or not designation for the execution instruction area has been received. If accepted, the process proceeds to step S4215. If not accepted, the process proceeds to step S4217.

(Step S4215) The execution instruction output unit 2026 outputs an execution instruction corresponding to the execution instruction area specified in step S4214.

(Step S4216) The execution information output unit 2027 outputs the second information obtained according to the execution instruction output in step S4215, that is, desired information. Then, the process returns to step S4203.

 [0336] (Step S4217) The first information instruction accepting unit 2013 receives the instruction to change the first information display window, that is, the first information display window move instruction or the first information display window size change instruction. Judge whether or not. If accepted, the process proceeds to step S4218. If not accepted, the process returns to step S4203.

 (Step S4218) The first information output unit 2012 changes the position and size of the first information display window according to the instruction received in step S4217. Then, the process returns to step S4203.

 [0338] (Step S4219) The first area designation instruction receiving unit 2014 determines whether or not the instruction to change the first window, that is, the first window moving instruction or the first window size changing instruction has been accepted. To do. If accepted, proceed to step S4220; otherwise, proceed to step S4221.

 (Step S4220) First window output unit 2015 changes the position and size of the first window according to the instruction received in step S4219. Then, the process returns to step S42 05.

[0340] (Step S4221) The second area designation instruction accepting unit 2016 determines whether or not the instruction to change the second window, that is, whether or not the second window move instruction or the second window size change instruction has been accepted. To do. If accepted, the process proceeds to step S4222, and if not accepted, the process proceeds to step S4223. (Step S4222) The second window output unit 2017 changes the position and size of the second window according to the instruction received in step S4221. Then, the process returns to step S42 05.

 (Step S4223) The first information instruction receiving unit 2013 receives the instruction to change the first information display window, that is, the first information display window moving instruction or the first information display window size changing instruction. Judge whether or not. If accepted, the process proceeds to step S4224. If not accepted, the process returns to step S4205.

 (Step S4224) The first information output unit 2012 changes the position and size of the first information display window according to the instruction received in step S4223. Then, the process returns to step S4205.

 [0344] In the flowchart of Fig. 42, the processing order of step S4219 and step S4220, step S4221 and step S4222, and step S4223 and step S4224 may be appropriately changed.

 Note that in the flowchart of FIG. 42, the processing is ended by powering off or interruption for aborting the processing.

 [0346] Hereinafter, a specific operation of the image information processing apparatus in the present embodiment will be described. A conceptual diagram of the image information processing apparatus 2001 is shown in FIG. Here, a case where the image information processing apparatus 2001 has a display 2030 as an output device will be described as an example. Here, it is assumed that image information “image002” is displayed on the display 2030 in advance using the third window 2031. Since the technique for displaying such image information on a display using a window is a known technique, a detailed description thereof will be omitted.

 First, when the user gives an instruction to open image information “image001”, which is the first information, to the image information processing apparatus 2001 using a mouse or the like, the first information output unit 2012 receives the instruction. In response, the first information “image001” stored in the first information storage unit 2011 is displayed on the display 2030 in the first information display window. Here, “image001” as the first information is assumed to be bitmap data.

FIG. 44 shows a first information display window on the display 2030 of the image information processing apparatus 2001. FIG. 20 is a view showing a display example of a window 2040. In the first information display window 2040, a scroll bar 2041 for scrolling the first information is displayed on the right side and the lower side of the area display window in order to display a portion where the first information is not displayed.

 [0349] FIG. 45 is a first information display window management table for managing the first information display window 2040 displayed on the display 2030. The first information display window The management table includes "image display ID", "window (x, y)", "(height, width)", "arrangement order", "image (x, y)", "image" t, have attributes! / “Image display ID” is identification information for managing the first information display window, and “window (x, y)” is the coordinates of the upper left corner in the first information display window. Here, the unit is pixel. “(Height, width)” is the height and width in the first information display window, and the unit is pixels. “Arrangement order” indicates the arrangement order of the windows. The smaller the value, the closer to the front. Here, since the first window, which will be described later, is always placed in front of the first information display window, the “placement order” of the first information display window is larger than the “placement order” value of the first window. The value is always a large value, in this case “3”. This value may be updated each time a new window is output, or may be a fixed value. “Image (x, y)” indicates the position of the first information displayed in the first information display window 2040 at the upper left corner of the first information display window 2040. It is the value indicated in coordinates. Here, the coordinates of the upper left corner of the first information are (0, 0). “Image” indicates the name of the first information displayed in the first information display window, such as a file name. Here, the upper left corner of the first information display window 2040 is aligned with the upper left corner of the first information. The first information is image information having a height and width sufficiently larger than the display area of the first information display window opened by default, for example, a height of 1600 pixels and a width of 3000 pixels. In the first information display window, the upper left area of this first information is cut out and output.

[0350] In this first information display window, the display position can be changed by dragging the upper side with a mouse or the like and releasing it. Specifically, the value of “Window (x, y)” in FIG. 45 is replaced with the coordinates of the upper left corner of the first information display window when the mouse is released, and depending on the replaced position, The display of the first information display window 40 is rewritten. Next, when the user operates the operation menu or the like to acquire an image displayed on the display 2030 and give an instruction to place it on the first information, the first area designation instruction receiving unit 1 4 receives an instruction to generate a first window, and a second area designation instruction receiving unit 16 receives an instruction to generate a second window. Then, as shown in FIG. 46, the first window 2060 and the second window 2070 are displayed on the display 2030. Note that the frames of the first window 2060 and the second window 2070, the bars of the upper window, and the like may be hidden, or may be switched between display and non-display by using a command or the like.

 FIG. 47 is an area window management table for managing the first window and the second window. The area window management table has the following attributes: “area ID”, “window (x, y)”, “(height, width)”, “arrangement order”. “Area ID” is identification information for managing the first window and the second window. Here, “001” force first window and “002” are the second window. “Window (x, y)” is the coordinates of the upper left corner in the first window and the second window in the display area of the display 2030, and here the unit is pixels. “(Height, width)” is the height and width in the first and second windows, and the unit is pixels. “Arrangement order” indicates the arrangement order of windows, and the smaller the value, the more they are arranged in the foreground. Here, as an example, the second window 2070 is arranged in the foreground, so the value of “arrangement order” of the second window 2070 is “1”. Also, since the first window 2060 is arranged immediately after the second window 2070, the value of the “arrangement order” of the first window 60 is “2”.

[0353] The display positions of the first window 2060 and the second window 2070 can be changed by dragging and releasing the upper side of the window. Specifically, the value of “Window (x, y)” in FIG. 47 is replaced with the coordinates of the upper left corner of the area display window when the mouse is released, and the first window 2060 is placed at the replaced position. Is rewritten and displayed. At this time, the first window 2060 and the second window 70 are independent windows with respect to the first information display window 2040, and are not interlocked with each other, and even if the first window 2060 and the second window 2070 are moved, The first information display window 2040 does not move at all. Therefore, by moving the first window 2060 and the second window 70, The relative positions of the first window 2060 and the second window 2070 with respect to the first information display window 2040 can be adjusted.

[0354] In addition, the display size of the first window 2060 and the second window 2070 can be changed by dragging and releasing the lower side, the side, and the corner of the window. Specifically, the height and width of the area display window when the mouse is released replaces the value of “(Height, Width)” in FIG. 47, and the first window 20 60 of the replaced size and The second window 2070 is rewritten and displayed. At this time, the first window 2060 and the second window 2070 are independent of the first information display window 2040, and are not linked to each other, and the sizes of the first window v60 and the second window 2070 are changed. However, the first information display window 2040 does not move at all. Therefore, by changing the size of the first window 2060 and the second window 2070, it is possible to adjust the relative size and position of the first window 2060 and the second window 2070 with respect to the first information display window 40. Become.

[0355] The display position of the first information display window 2040 can be changed by dragging the upper side with a mouse or the like and releasing it. Specifically, the value of “Window (x, y)” in FIG. 44 is replaced with the coordinates of the upper left corner of the first information display window 2040 when the mouse is released, and the first information is displayed at the replaced position. Display window 2040 is rewritten and displayed. At this time, the first information display window 2040 is an independent window with respect to the first window 2060 and the second window 2070, and is not linked to each other, and even if the position of the first information display window 2040 is moved. The first window 2060 and the second window 2070 do not move at all. Therefore, by moving the first information display window 2040, the relative positions of the first window 2060 and the second window 2070 with respect to the first information display window 2040 can be adjusted. Similarly, the display size of the first information display window 40 can be changed by dragging and releasing the lower side, side, or corner of the window. Even if is changed, the positions of the first window 2060 and the second window 2070 are not changed. Similarly, in the first information display window 40, the menu power can be enlarged and displayed by selecting an enlarge command, a reduce command, etc. The power that can be displayed in a reduced size In this way, even if the image of the first information displayed in the first information display window 2040 is reduced or enlarged, the position of the first window 60 can be reduced. No change in size or size.

 [0356] Further, the first information display window 2040 can move the area where the first display image is displayed by moving the scroll bar 2041, and the first display image is not displayed. Can be displayed. At this time, the first information display window 2040 is an independent window with respect to the first window 2060 and the second window 2070, and is not linked to each other, and even if the display area of the first information display window 2040 is moved, The first window 2060 and the second window 2070 do not move at all. Accordingly, by moving the scroll bar 2041 of the first information display window 2040, the relative positions of the first window 2060 and the second window 2070 with respect to the first information display window 2040 can be adjusted. .

 [0357] In this way, the first information display window 2040 and the first window 2060 and the first window 2060 and the first window 2060 and the first window 2060 The relative positional relationship with the second window 2070 can be set individually and freely.

 [0358] In addition, the operations performed on the first window 2060 and the second window 2070, that is, on the portions other than the sides of the first window 2060 and the second window 2070, the window bar, and the like, It is not an event for, but is accepted as an event for the first information display window 2040 etc. displayed in the window. Accordingly, the first information display window 2040 is moved through the first window 2060, the image displayed in the first information display window 2040 is changed or modified, or the image information processing apparatus 2001 or the like. Other devices and application menus can be selected using the pointer. Thereby, even if the first window 2060 is displayed, it is possible to prevent the operation on the first information display window 2040 and the like from being obstructed, and the operability can be improved.

Next, when the user operates the menu or the like to give an instruction to acquire the image information displayed in the second window 2070, the area image acquisition unit 2019 displays the second window 207. The image information output within 0 is acquired. Specifically, the area image acquisition unit 2019 uses, for example, information on the coordinates of the upper left corner in the second window and the vertical and horizontal lengths in the second window as information for specifying the area in the second window 2070. Is obtained from the area window management table as shown in Fig. 47. Then, from the display memory such as VRAM in which the image information to be displayed on the display 2030 is stored, the image information of the area designated by the area designation information is extracted from the currently displayed image information and acquired. . Here, for example, image information in an area having coordinates of the upper left corner of (1000, 600), a width of 180 pixels, and a vertical length of 180 pixels is acquired. Here, the image information on the window 2031 is acquired. As a result, the region image acquisition unit 2019 acquires region image information having a width of 180 pixels and a length of 180 pixels.

 [0360] The region image output unit 2020 assigns the region image information acquired by the region image acquisition unit 2019, for example, a file name according to a preset rule, for example, "Screen A. GIF". Then, the image data is accumulated in a hard disk (not shown) in the image information processing apparatus 2001, and the accumulated area image information is output to the area where the first window 2060 was displayed, and is displayed here. FIG. 48 shows a display example in which an image 2080 corresponding to the region image information is displayed. Here, for easy understanding, the periphery of the image 2080 is surrounded by a dotted line, but in reality, such a dotted line or the like may not be displayed.

 FIG. 49 is a diagram showing an area image information management table for managing area image information.

 The area image information management table has attributes of "area image information ID", "area image information name", "area coordinates (x, y)", "(height, width)", and "storage location". Yes. “Area image information ID” is identification information for managing the execution instruction area, “Area image information name” is the file name of the area image information, and “Area coordinates (x, y)” is the area in the first information. The coordinates of the upper left corner of the area where the image information is placed, and here the unit is pixels. Specifically, the “region coordinates (x, y)” is determined using the coordinates of the first information display window, the coordinates of the first window, and the like. “(Height, width)” is the height and width of the area in the first information where the area image information is arranged, and the unit is pixels. The “storage location” is a location where area image information is stored, and here is a directory where area image information is stored.

Note that in the present invention, the region image information acquired by the region image acquisition unit 2019 is the highest. Finally, it may be outputted to the area of the first information where the first window 2060 is displayed, that is, the area where the image 2080 is displayed. For example, the region image information acquired by the region image acquisition unit 19 is displayed in the first window or a similar window by the first window output unit 2015, etc. When receiving a force instruction, the area image output unit 2020 or the like may output the area image information to the area where the first window 2060 of the first information is displayed. In this way, the position and size of the region image information on the first information are finely adjusted by moving the first window or changing the size, and the region image information is changed to the first information. It can be placed on a piece of information.

Next, the setting instruction receiving unit 2021 sets an execution window for displaying an execution instruction for displaying second information, here, image information, in an execution instruction area, that is, an area in the first window 2 060, for example. Display as shown in 50. As shown in FIG. 50, the input window 2110 displays an input field 2081 and a description “Drop image file down” described in the field 2081. Here, when the user drags and drops an image file including image information as second information to this field 2081, the setting instruction receiving unit 2021 sets the area in the first window 2060 as the execution instruction area. An instruction to set an execution instruction to display the second information dropped in the execution instruction area is received. Specifically, as shown in FIG. 51, the first information display window 2040 of the display 2030 is arranged using a mouse or the like, and the icon 2090a of the image file arranged in the area is displayed in, for example, the field. When dragged and dropped into 2081, the coordinates of the upper left corner of the image file icon 2090b when it was dropped 1S The coordinates of the upper left corner of the field 2081 and the coordinates in the area where the height, width and force were also determined In this case, it is determined that the image file is dropped in the field 2081. Then, triggered by the image file being dropped, the execution instruction area configuration unit 2022 configures execution instruction area setting information for setting the area located in the first window 2060 of the first information as the execution instruction area. To do. That is, the area where the image 2080 corresponding to the area image information is displayed in FIG. 48 is set as the execution instruction area. In addition, the execution instruction configuration unit 2023 decodes the image file dropped in the field 2081. The directory information is acquired, and an execution instruction, in this case, an action, which is an instruction to open the second information included in the image file indicated by the directory information in a new window, is configured. Here, the file name of the image file having the second information is “image—a.jpg”, and the directory information is “C: ZuserZdesktopZimage—a.jpg”. Moreover, the action constituting the execution instruction configuration unit 23, when the user clicks the execution instruction area "imag _e - a jpg." Freshness, an action that opens a window "window open (" C:. / User /desktop/image_a.jpg "In this case, the display of the first window 2060 and the second window 70 is terminated when the icon a is dropped.

 [0364] The area information output unit 2024 temporarily stores the execution instruction area setting information configured by the execution instruction area configuration unit 2022 and the execution instruction configured by the execution instruction configuration unit 2023 in a storage medium such as a memory. In this case, the path of the image file having the second information, the directory information, etc. are input as text in the force field 2081 in which the image file having the second information is designated by drag and drop. May be. The same applies to other embodiments.

 FIG. 52 is a diagram showing an execution instruction area management table for managing execution instruction areas.

 The execution instruction area management table has “instruction area ID”, “area coordinates (x, y)”, “(height, width)”, and “action” attributes. “Instruction area ID” is identification information for managing the execution instruction area, and “Area coordinates (x, y)” are the coordinates of the upper left corner of the execution instruction area in the first information, where the unit is pixel. To do. Specifically, the “region coordinates (x, y)” is determined using the coordinates of the first information display window, the coordinates of the first window, and the like. “(Height, width)” is the height and width of the execution instruction area, and the unit is pixels. “Action” is an execution instruction set in the execution instruction area, and is “window.open (“ C: /user/desktop/image_a.jpg ”)” described above. The “region coordinates (x, y)” and “(height, width)” correspond to the execution instruction region setting information configured by the execution instruction region configuration unit 2022.

[0366] Here, the area image information is managed by the area image information management table and the execution instruction area is managed by the execution instruction area management table. However, the area where the area image information is arranged, the execution instruction Since each area is an area where the first window is arranged, the area image information and the execution instruction area may be managed by one management table. For example, The execution instruction area management table shown in FIG. 52 may have the same attributes as “area image information name” and “storage location” as in FIG. 49 to manage the area image information! .

Next, when the user operates the mouse or the like to place the pointer 2120 on the image 2080 corresponding to the area image information shown in FIG. 48 and clicks the button of the mouse or the like, the designation is accepted. The unit 25 receives the designation of the execution instruction area set at the same position as the area where the image 2080 is arranged. The execution instruction output unit 2026 triggers the reception of the designation of the execution instruction area, and executes an execution instruction corresponding to the designated execution instruction area, in this case, the “area instruction ID” in the execution instruction area management table shown in FIG. "Window.open (" C: /user/desktop/image-a.jpg) "is guided to the execution information output unit 2027. Output. According to this output, the execution information output unit 2027 reads “C: /user/desktop/image_a.jpg”! The image information of the image file “image_a.jpg” obtained in the directory is acquired and displayed using a new window 2130 as shown in FIG. This image is an image of the image file indicated by the icon 2090a described above. It does not matter how the new window 2130 is displayed. For example, the window 2130 may be displayed while zooming out from the position of the image 2080.

Here, instead of displaying the field 2081 as shown in FIG. 50, for example, an execution instruction for acquiring and displaying information on a desired URL as shown in FIG. 54 is displayed in the execution instruction area. In other words, the input window 2111 set in the area in the first window 2060 may be displayed. In the input window 2111 shown in FIG. 54, an input field 2131, a “set” button 2132, and a description “Enter the URL below” described in the field 2131 are displayed. . When the user inputs a desired URL in the field 2131 using a keyboard or the like and presses the “set” button 2132 using a mouse or the like, the execution instruction area configuration unit 222 reads the first information, The execution instruction area setting information for setting the area in the first window 2060 as the execution instruction area is configured. Further, the execution instruction configuration unit 2023 acquires the URL input in the field 2131, and stores the information stored in the URL in another device, such as a browser for the Internet executed by a computer or the like in this case. Execution instructions to be opened in the application, in this case, configure the action. Here I entered Assume that the URL is "http://Zwww.jpmap.co.jp/index.html". The action configured by the execution instruction component 2023 is “ht tp: ZZ www.jpmap.co.jpz index.html” when the execution instruction area is clicked. “Get.url C'http: //www.jpmap.co.jp/index,html”) ”. “Get.url ("")" is an action that causes other applications to acquire information on the location indicated by the URL between two URLs. Further, when the “Setting” button 2132 is pressed, the display of the first window 2060 is ended. The execution instruction area setting information configured by the execution instruction area configuration unit 2022 and the execution instructions set by the execution instruction configuration unit 2023 are temporarily accumulated in a storage medium such as a memory by the area information output unit 2024. Instead of inputting the URL using a keyboard or the like, the URL text or the like may be dragged and dropped onto the field 2131 in the same manner as the image file described above.

 FIG. 55 is a diagram showing an execution instruction area management table for managing execution instruction areas.

 The execution instruction area management table has attributes of "instruction area ID", "window (x, y)", "(height, width)", "background", "arrangement order", and "action". . Each attribute is the same as the execution instruction area management table of FIG. Here, the “action” is “to.” In “get.url C'http: //www.jpmap.co.jp/index, html)” described above.

[0370] Next, when the user operates the mouse or the like to place the pointer on the image 80 shown in FIG. 48 and clicks the button of the mouse or the like, the designation receiving unit 2025 places the image 2080. Then, it is set at the same position as the area, and the designation of the execution instruction area is accepted. The execution instruction output unit 2026 is triggered by reception of the designation of the execution instruction area, and the execution instruction corresponding to the specified execution instruction area, in this case, “area instruction ID” in the execution instruction area management table shown in FIG. "Get.url (" http: //www.jpmap.co.jp/index.html ")" is acquired as the "action" attribute of the record with "0001" Outputs a command to obtain information stored in “http://www.jpmap.co.jp/index.html” to an application such as a browser that can display Internet information. Applications that can display Internet information, such as Internet browsers, are stored in the URL "http: Z / www.jpmap.co.jp / index.html" according to this command. Acquire the information and use the new information as shown in Figure 56. Display using Indo 2150.

[0371] As described above, according to the present embodiment, the area image information that is the image information of the position where the second window is arranged is acquired, and the first window of the first information is arranged and the position is changed to the position. Since it can be displayed, it is possible to reduce the trouble of preparing an image whose size has been adjusted in advance, etc., and the area for acquiring the area image information and the position for displaying the acquired area image information can be reduced. It can be set intuitively by moving the first and second windows. As a result, it is possible to easily display another image, that is, an image corresponding to the region image information, on a desired region on the first information, for example, on the execution instruction region.

 [0372] In addition, using the first window and the second window that can be moved independently of the first information, the execution instruction area for the first information and the area for acquiring the area image information And can be set. As a result, when setting the execution instruction area, the first information display window image and the first window can be operated without being linked to each other, and freedom of operation when setting the execution instruction area is possible. It is possible to improve the operability and the operability.

 [0373] In the present embodiment, with the first window placed on the first information display window, the area in the first window is set as an area for outputting area image information, or is executed. The case where a setting instruction that is an instruction to be set in the instruction area is received has been described. When the first information display window is smaller than the size of the first information, the first window is moved to an area outside the first information display window. Even in the case of arrangement, the arranged area may be set as an area for outputting area image information, or a setting instruction may be received.

For example, as shown in FIG. 57, a first window 2160 smaller than the size of the first information is arranged outside the display image window that displays the first information, and an instruction to acquire area image information is issued. Assuming that it is given to the two-region designation instruction accepting unit 2016, the region image output unit 2020 displays the first information related to the size of the display image window at the position of the currently displayed first information. The position on the first information of one window, here, the coordinates of the upper left corner are calculated. Then, the area image output unit 2020 uses this coordinate. The area of the same size as the size in the first window, which is the upper left corner, is set as the area for outputting the area image information. For example, in FIG. 57, an area in which the first information is displayed when everything related to the display image window is displayed is represented by an area 2161. Then, the coordinates of the upper left corner of the first window 2160 on the calculated first information are set to the coordinates of the upper left corner of the region where the region image information is output.

[0375] Similarly, the execution instruction area configuration unit 2022 displays the first information related to the size of the display image window at the position of the first information that is currently displayed. The position on the first information of one window, here, the coordinates of the upper left corner is calculated. Then, the execution instruction area configuration unit 2022 may configure execution instruction setting information for setting an execution instruction area having the same size as the size in the first window with this coordinate as the upper left corner.

 [0376] Even when only a part of the first window protrudes from the first information display window, similarly, the first window on the first information when all the first information is displayed is displayed. The position information for displaying the area image information and the execution instruction area setting information indicating the position of the execution instruction area may be configured from the position.

 [0377] Also, in the above case, if the first window protrudes from the first information displaying all, the execution instruction area setting information or the like may not be configured, or the first window may protrude. An execution instruction area or the like may be set so that the portion is cut off.

 [0378] As described above, in the present embodiment, the first window can be arranged at a position other than the display image window, and the first information is not displayed in the display image window. In addition, an area for arranging the area image information and an execution instruction area can be set. As a result, the area where the area image information is arranged and the execution instruction area are moved without moving the area not displayed in the display image window to a position where it can be displayed in the display image window by operating a scroll bar or the like. It can be set, the work time can be shortened, and the degree of freedom in work is improved.

[0379] Also, instead of the area information output unit 2024 accumulating execution instruction area setting information and execution instructions in a storage medium such as a memory, instructions from the user, instructions from other processing units, etc. Based on the first information output from the first information output unit 12, the region image information, The line instruction area setting information and the execution instruction may be output, specifically, transmitted to a predetermined address, for example, an IP address. The predetermined address set in advance is, for example, an address set in advance in the image information processing apparatus 2001 or an address input immediately before by the user. Along with these, second information that the execution instruction instructs to output, for example, image information may be output. Further, when transmitting these pieces of information, a single file including these pieces of information may be configured and transmitted. In particular, when configuring such a single file, the format of the configured file is set to the format of an image file having the same image information as the first information, and the image information of the image file is stored. Execution instruction area setting information and execution instructions, second information, and the like may be stored in areas other than areas, such as a header area and a footer area. In this way, at least the first information can be opened using an image processing apparatus that can open an image file having the first information as normal image information, an image processing application, or the like. . Moreover, when transmitting, you may transmit the information which changed these information into the format which can be browsed on the internet as needed. In such a case, the image information processing apparatus 2001 may not include the designation receiving unit 2025, the execution instruction output unit 2026, the execution information output unit 2027, and the like. Instead, the device that obtains and outputs the above-mentioned information output to an address such as a preset IP address via a network or the like, in addition to the communication means that obtains the above-mentioned information, the designation receiving unit 2025 Alternatively, an execution instruction output unit 2026, an execution information output unit 2027, etc., or a processing unit corresponding to these may be provided. The same applies to other embodiments.

 [0380] In the above embodiment, when the image information processing apparatus does not output the second information, the execution information output unit 27 may be omitted. The same applies to other embodiments.

[0381] In the above embodiment, the case has been described where the second information acquired by causing the processing to be executed based on the execution instruction is image information. In the present invention, the second information is Any information may be used. For example, the second information may be text or the like. [0382] Also, in each of the above embodiments, each processing (each function) may be realized by centralized processing by a single device (system), or a plurality of devices. It may be realized by distributed processing by.

 [0383] For example, the area information output unit 2024 of the first client device uploads information such as the first information, area image information, execution instruction area setting information, and execution instruction to the server, etc. A second client device provided with a designation receiving unit or the like may acquire information uploaded to the server as appropriate according to the designation and execute the execution instruction.

[0384] Also, in each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. Good. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. The software that realizes the image information processing apparatus in each of the above embodiments is the following program. That is, this program designates the first information output step for outputting the first information stored in the computer to the first information display window, which is the window for displaying the first information, and the first area. A first area designation instruction receiving step for receiving a first window generation instruction that is an instruction for generating a first window that is a window; a first window output step for outputting a first window in response to the first window generation instruction; A second area designation instruction receiving step for receiving a second window generation instruction that is an instruction for generating a second window that is a window for specifying the second area, and outputting the second window in response to the second window generation instruction A second window output step, and image information output to the area in the second window. An acquisition instruction receiving step of receiving an acquisition instruction that is an instruction to perform, an area image acquisition step of acquiring area image information that is image information output to an area in a second window in response to the acquisition instruction, In the region image acquisition step, a region image output step for outputting the region image information acquired in a region located in the first window of the first information is executed. . [0385] In the above program, the transmission step for transmitting information and the reception step for receiving information are performed by hardware, for example, a modem or an interface card in the transmission step. Does not include processing (processing that can only be done with software)! /.

 [0386] In addition, this program is recorded on a predetermined recording medium (for example, an optical disk such as a CD-ROM, a magnetic disk, a semiconductor memory, etc.) that can be executed by being downloaded by a server or the like. The program may be executed by being read.

 [0387] Further, the computer that executes this program may be singular or plural. That is, centralized processing or distributed processing may be performed.

 [0388] Needless to say, in each of the above embodiments, two or more communication means (such as an information transmission unit) existing in one apparatus may be physically realized by one medium.

 [0389] In the above-described embodiment, the case where the image information processing apparatus is a stand-alone has been described. However, the image information processing apparatus may be a stand-alone apparatus or a server in a client system. Also good. In the latter case, for example, the output unit, the reception unit, etc. receive input via a communication line or output information for displaying a screen.

 [0390] It goes without saying that the present invention can be variously modified without being limited to the above-described embodiments, and these are also included in the scope of the present invention.

 Industrial applicability

[0391] As described above, the image information processing apparatus and the like according to the present invention can be applied as, for example, an apparatus for configuring image information capable of interactive operation. It is useful as an image information processing device that performs processing that requires specifying an area.

 [0392] The image information processing apparatus according to the present invention is suitable for an image information processing apparatus that can acquire at least a part of the output image information, and is particularly suitable for image information to be acquired. It is useful as an image information processing apparatus that can add characters.

Further, the image information processing apparatus and the like according to the present invention can be applied, for example, as an apparatus for configuring information and the like that can be operated interactively. This is useful as an image information processing device that performs processing that needs to explicitly show some areas of information.

Brief Description of Drawings

 FIG. 1 is a block diagram of an image information processing apparatus according to Embodiment 1.

 FIG. 2 is a flowchart for explaining the operation.

 [Figure 3] Conceptual diagram

 [Figure 4] Diagram showing the display example

 [Figure 5] Figure showing the image display window management table

 [Figure 6] Figure showing the display example

[7] Figure showing the same area specification window management table

 [Figure 8] Diagram showing the display example

 [Figure 9] Diagram showing the display example

[10] Figure showing the execution instruction area management table

 [Figure 11] Diagram showing the display example

 [Figure 12] Diagram showing the display example

 [Figure 13] Diagram showing the display example

 FIG. 14 is a diagram showing the execution instruction area management table

 [Figure 15] Diagram showing the display example

 [Figure 16] Diagram showing the display example

 FIG. 17 is a block diagram of an image information processing apparatus in the second embodiment.

 FIG. 18 is a flowchart for explaining the operation.

 [Figure 19] Diagram showing the display example

 FIG. 20 is a diagram showing the execution instruction area management table

 [Fig.21] Diagram showing the display example

 FIG. 22 is a block diagram of an image information processing device in the third embodiment.

FIG. 23 is a flowchart for explaining the operation.

[Figure 24] Diagram showing the display example

[Figure 25] Diagram showing the same display example FIG. 26 is a block diagram of the image information processing apparatus in the fourth embodiment.

FIG. 27 is a flowchart for explaining the operation.

 [Figure 28] Conceptual diagram

 [Fig.29] Diagram showing the display example

 [Figure 30] Figure showing the same area specification window management table

[31] Figure showing the same character window management table

 [Figure 32] Figure showing a display example

 [Fig.33] Diagram showing the same display example

 [Figure 34] Figure showing the same area specification window management table

 [Figure 35] Figure showing the same character window management table

 [Fig.36] Diagram showing the same display example

 [Figure 37] Figure showing the same character window management table

 [Fig.38] Diagram showing the same display example

 [Figure 39] Figure showing the same display example

 FIG. 40 is a diagram showing an example of the display

 FIG. 41 is a block diagram of an image information processing apparatus in the fifth embodiment.

FIG. 42 is a flowchart for explaining the operation.

 [Figure 43] Conceptual diagram

 [Fig.44] Diagram showing the display example

 [Fig.45] The first information display window management table

 [Fig.46] Diagram showing the same display example

 [Figure 47] Figure showing the same area window management table

 [Figure 48] Figure showing the same display example

 FIG. 49 is a diagram showing the same area image information management table.

 [Fig.50] Diagram showing the same display example

 [Fig.51] Diagram showing the same display example

 [Figure 52] Figure showing the execution instruction area management table

[Fig.53] Diagram showing the same display example [Fig.54] Diagram showing the same display example

[55] Figure showing the execution instruction area management table

[Fig.56] Diagram showing the same display example

 [Figure 57] Figure showing the same display example

Claims

The scope of the claims

 [1] a first image information storage unit in which first image information can be stored;

 A first image information output unit that outputs first image information using an image display window that is a window for displaying the first image information;

 An area designation instruction receiving unit that receives an area designation window generation instruction that is an instruction to generate an area designation window that is a window for designating an area, and an area designation window movement instruction that is an instruction to move the area designation window; ,

 An area designation window output unit that outputs an area designation window based on the area designation window generation instruction, and moves and outputs the output area designation window based on the area designation window movement instruction;

 This is an instruction for setting an area located in the area designation window of the first image information as an execution instruction area which is an area for outputting execution instruction information which is information for instructing execution of a predetermined process. A setting instruction receiving unit that receives a setting instruction; and execution instruction area setting information that is information for setting an area located in the area specifying window as an execution instruction area based on the setting instruction! Execution instruction area configuration part,

 An execution instruction configuration unit configured to configure execution instruction information, which is information output when an execution instruction area of the first image information is designated, based on the setting instruction;

 An image information processing apparatus comprising: an area information output unit that outputs the execution instruction area setting information and the execution instruction information.

 [2] The area designation instruction accepting unit further accepts an area designation window size change instruction that is an instruction to change the size of the area designation window,

 The image information processing apparatus according to claim 1, wherein the area designation window output unit changes the size of the output area designation window based on the area designation window size change instruction.

3. The image information processing apparatus according to claim 1, wherein the area designation window output unit outputs the area designation window to the front of the image display window at all times. [4] An image information instruction receiving unit that receives an image display window movement instruction that is an instruction to move the image display window;

 4. The image information processing apparatus according to claim 1, wherein the first image information output unit moves the image display window based on the image display window movement instruction.

 5. The image information processing apparatus according to claim 4, wherein the image display window and the area designation window move independently.

[6] In the execution instruction area configuration unit, when at least a part of the area designation window is arranged outside the image display window, the area designation window of the first image information is arranged. 6. The image information processing apparatus according to claim 1, wherein the execution instruction area setting information indicating a position corresponding to a speaking position is configured.

7. The image information processing apparatus according to claim 1, wherein a background color in the area designation window is transparent.

[8] The image according to any one of claims 1 to 7, wherein an instruction to perform an operation on an area in the area designation window is received by an image display window output to the area in the area designation window. Information processing device.

[9] The region information output unit outputs region image information, which is image information for indicating an execution instruction region, on the execution instruction region of the first image information. The image information processing apparatus described.

[10] The area designation instruction accepting unit accepts input of characters into the area designation window,

 9. The image information processing apparatus according to claim 1, wherein the area information output unit outputs the received character on the execution instruction area of the first image information.

[11] The setting instruction receiving unit receives a setting instruction including location information for receiving location information, which is information indicating the location of desired information,

The image information processing apparatus according to claim 1, wherein the execution instruction configuring unit configures execution instruction information for executing predetermined processing on the desired information indicated by the location information. . [12] The location information is a URL,

 12. The image information processing apparatus according to claim 11, wherein the execution instruction configuration unit configures execution instruction information for executing a process of acquiring information from the URL.

[13] The location information is directory information indicating the location of the second information,

 The execution instruction configuration unit configures execution instruction information for executing a process of acquiring and outputting the second information from a directory outside the directory indicated by the directory information. Image information processing apparatus.

[14] The second information is information that can be output as an image,

 The execution instruction area configuration unit configures a reduced image of the second information based on the directory information,

 14. The image information processing apparatus according to claim 13, wherein the area information output unit outputs the reduced image on the execution instruction area of the first image information.

 [15] The first image information output unit outputs the image display window,

 An image acquisition instruction receiving unit that receives an image acquisition instruction that is an instruction for acquiring image information of at least a partial region of the image output by the first image information output unit, and an output based on the image acquisition instruction An image acquisition unit that acquires, as the second information, image information of at least a partial region of the image to be processed,

 15. The image information processing apparatus according to claim 13, wherein the location information is directory information indicating a location of second information acquired by the image acquisition unit.

 16. The request from claim 1, wherein the area information output unit transmits the execution instruction area setting information, the execution instruction information, and the first image information to a predetermined address set in advance. Item 121. The image information processing apparatus according to any one of the deviations.

 [17] The area information output unit is preset with the execution instruction area setting information, the execution instruction information, the first image information, and an image in the directory indicated by the directory information. 17. The image information processing apparatus according to claim 13, wherein the image information processing apparatus transmits the image to a predetermined address.

[18] A designation information receiving unit for receiving designation information for designating an execution instruction area set by the execution instruction area setting information in the first image information output by the first image information output unit; 18. The image information processing apparatus according to claim 1, further comprising an execution instruction information output unit that outputs the execution instruction information in response to reception of the designation information.

[19] A designation information receiving unit for receiving designation information for designating an execution instruction area set by the execution instruction area setting information of the first image information output from the first image information output unit; An execution instruction information output unit for outputting the execution instruction information in response to reception;

 The image information according to any one of claims 13 to 15V, further comprising: a second information output unit that acquires and outputs the second information from a directory indicated by the directory information based on the execution instruction information. Processing equipment.

[20] Area specification instruction that receives an area specification window generation instruction that is an instruction to generate an area specification window that is a window for specifying an area, and an area specification window movement instruction that is an instruction to move the area specification window A reception department;

 Based on the area designation window generation instruction, the area designation window is output to the forefront of one or more windows other than the area designation window, and the output area designation window is output based on the area designation window movement instruction. An area designation window output section that outputs the object by moving it, and

 An execution instruction area configuration unit constituting execution instruction area setting information, which is information for setting an area positioned in the area specification window as a predetermined area, and outputting the execution instruction area setting information An image information processing apparatus comprising an area information output unit.

 [21] a first image information output step of outputting the stored first image information using an image display window which is a window for displaying the first image information;

 An area designation instruction receiving step for receiving an area designation window generation instruction which is an instruction for generating an area designation window which is a window for designating an area, and an area designation window moving instruction which is an instruction for moving the area designation window; ,

An area designation window is output based on the area designation window generation instruction, and the area designation window is output. An area designation window output step for moving and outputting the output area designation window based on the area designation window movement instruction;

This is an instruction for setting an area located in the area designation window of the first image information as an execution instruction area which is an area for outputting execution instruction information which is information for instructing execution of a predetermined process. A setting instruction receiving step for receiving a setting instruction; and execution based on the setting instruction to execute execution instruction area setting information which is information for setting an area located in the area specifying window as an execution instruction area Instruction area configuration steps;

An execution instruction configuration step for configuring execution instruction information, which is information output when an execution instruction area of the first image information is designated, based on the setting instruction; and the execution instruction area setting information; An image information processing method comprising: an area information output step for outputting the execution instruction information.

On the computer,

A first image information output step for outputting the stored first image information using an image display window which is a window for displaying the first image information, and an area which is a window for designating an area An area designation instruction receiving step for receiving an area designation window generation instruction that is an instruction for generating a designated window, an area designation window moving instruction that is an instruction for moving the area designation window,

An area designation window output step for outputting an area designation window based on the area designation window generation instruction, and moving and outputting the output area designation window based on the area designation window movement instruction;

This is an instruction for setting an area located in the area designation window of the first image information as an execution instruction area which is an area for outputting execution instruction information which is information for instructing execution of a predetermined process. A setting instruction receiving step for receiving a setting instruction; and execution based on the setting instruction to execute execution instruction area setting information which is information for setting an area located in the area specifying window as an execution instruction area Instruction area configuration steps;

Execution which is information output when the execution instruction area of the first image information is designated A program for executing an execution instruction configuration step for configuring instruction information based on the setting instruction, and an area information output step for outputting the execution instruction area setting information and the execution instruction information .

 [23] A character instruction receiving unit that receives a character window moving instruction that is an instruction to move a character window that is a window for outputting characters;

 A character input receiving unit for receiving character input;

 A character window output unit that outputs a character window in which the character received by the character input reception unit is output, and moves the character window to a position based on the character window movement instruction; and

 An area designation instruction accepting unit that accepts an area designation window moving instruction that is an instruction to move an area designation window that is a window for designating an area;

 An area designation window output unit that outputs an area designation window and moves and outputs the output area designation window based on the area designation window movement instruction, and an image output to an area in the area designation window An acquisition instruction reception unit that receives an acquisition instruction that is an instruction to acquire information;

 In response to the acquisition instruction, an area image acquisition unit that acquires image information output to an area in the area specification window;

 An image information processing apparatus comprising: an output unit that outputs an image acquired by the region image acquisition unit.

 [24] A frame output instruction receiving unit that receives a frame output instruction that is an instruction of force or power to output the frame of the character window;

 24. The image information processing apparatus according to claim 23, wherein the character window output unit outputs or does not output a frame of the character window based on the frame output instruction.

[25] A magnification designation information receiving unit that receives magnification designation information that is information for designating a magnification for the image information acquired by the region image acquisition unit,

24. The image according to claim 23 or claim 241, wherein the area image acquisition unit acquires the image information output to an area in the area specification window based on the magnification specification information by enlarging or reducing the image information. Information processing device. [26] The character instruction accepting unit further accepts a character window size change instruction which is an instruction to change the size of the character window,

 4. The image information processing apparatus according to claim 1, wherein the character window output unit changes and outputs the size of the output character window based on the character window size change instruction.

[27] The area designation instruction accepting unit further accepts an area designation window size change instruction that is an instruction to change the size of the area designation window,

 The image information processing apparatus according to any one of claims 23 to 261, wherein the area designation window output unit changes the size of the output area designation window based on the area designation window size change instruction. .

[28] The area designation window output unit outputs the area designation window to the front of all other windows,

 28. The image information processing apparatus according to claim 23, wherein the character window output unit outputs the character window to a front surface of all other windows except for the area designation window.

 [29] A character instruction accepting step for accepting a character window moving instruction that is an instruction to move a character window that is a window for outputting characters;

 A character input accepting step for accepting character input;

 A character window output step of outputting a character window in which the character received in the character input reception step is output, and moving the character window to a position based on the character window movement instruction;

 An area designation instruction accepting step for accepting an area designation window moving instruction which is an instruction to move an area designation window which is a window for designating an area;

 An area designation window output step of outputting an area designation window and moving and outputting the output area designation window based on the area designation window movement instruction, and an image output to an area in the area designation window An acquisition instruction reception step for receiving an acquisition instruction, which is an instruction for acquiring information;

In response to the acquisition instruction, the image information output to the area in the area designation window is acquired. A region image acquisition step to be obtained;

 An image information processing method comprising: an output step of outputting the image acquired in the region image acquisition step.

 [30] On the computer,

 A character instruction accepting step for accepting a character window moving instruction which is an instruction to move a character window which is a window for outputting characters;

 A character input accepting step for accepting character input;

 A character window output step of outputting a character window in which the character received in the character input reception step is output, and moving the character window to a position based on the character window movement instruction;

 An area designation instruction accepting step for accepting an area designation window moving instruction which is an instruction to move an area designation window which is a window for designating an area;

 An area designation window output step of outputting an area designation window and moving and outputting the output area designation window based on the area designation window movement instruction, and an image output to an area in the area designation window An acquisition instruction reception step for receiving an acquisition instruction, which is an instruction for acquiring information;

 An area image acquisition step of acquiring image information output to an area in the area designation window according to the acquisition instruction;

 A program for executing an output step of outputting the image acquired in the region image acquisition step.

[31] a first information storage unit in which the first information can be stored;

 A first information output unit for outputting the first information to a first information display window which is a window for displaying the first information;

 A first area designation instruction receiving unit that receives a first window generation instruction that is an instruction to generate a first window that is a window for designating a first area;

 A first window output unit for outputting a first window in response to the first window generation instruction;

The second window is an instruction to generate a second window that is a window for designating the second area. A second area designation instruction receiving unit for receiving a dough generation instruction;

 A second window output unit for outputting a second window in response to the second window generation instruction;

 An acquisition instruction receiving unit that receives an acquisition instruction that is an instruction to acquire image information output to the area in the second window;

 In response to the acquisition instruction, an area image acquisition unit that acquires area image information that is image information output to an area in the second window;

 An image information processing apparatus comprising: a region image output unit that outputs the region image information acquired by the region image acquisition unit on a region located in the first window of the first information.

 [32] The first area designation instruction accepting unit further accepts a first window movement instruction which is an instruction to move the first window,

 The second area designation instruction accepting unit further accepts a second window moving instruction that is an instruction to move the second window,

 The first window output unit further moves and outputs the output first window in response to the first window movement instruction,

 32. The image information processing apparatus according to claim 31, wherein the second window output unit further moves and outputs the output second window in response to the second window movement instruction.

[33] The first area designation instruction accepting unit further accepts a first window size change instruction that is an instruction to change the size of the first window,

 The second area designation instruction receiving unit further receives a second window size change instruction that is an instruction to change the size of the second window,

 The first window output unit further changes and outputs the size of the output first window in response to the first window size change instruction,

 The image information according to claim 31 or claim 32 V, wherein the second window output unit further changes the size of the output second window in accordance with the second window size change instruction and outputs the changed size. Processing equipment.

[34] The first area designation instruction receiving unit further includes an instruction for changing a size of the first window. The first window size change instruction is received,

 The first window output unit further changes and outputs the size of the output first window in response to the first window size change instruction,

 The second window output unit further changes the size of the output second window according to the first window size change instruction, and outputs the changed second window size.

V, an image information processing device with a gap.

 [35] The second area designation instruction receiving unit further receives a second window size change instruction that is an instruction to change the size of the second window,

 The second window output unit further changes and outputs the size of the output second window according to the second window size change instruction,

 The first window output unit further changes the size of the output first window in accordance with the second window size change instruction, and outputs the changed first window size.

V, an image information processing device with a gap.

 36. The any one of claims 31 to 35, wherein the first window output unit and the second window output unit always output the first window and the second window to the front of the first information display window. The image information processing apparatus described.

 [37] A first information instruction receiving unit that receives a first information display window moving instruction that is an instruction to move the first information display window;

 37. The image information processing apparatus according to claim 31, wherein the first information output unit moves the first information display window in response to an instruction to move the first information display window.

 38. The image information processing apparatus according to claim 31, wherein the first information display window, the first window, and the second window move independently.

39. The image information processing apparatus according to claim 31, wherein a background color in the first window and the second window is transparent.

[40] The image according to any one of claims 31 to 39, wherein the first window and the second window do not accept an instruction to perform an operation on an area in the first window and the second window. Information processing device. [41] The image information processing apparatus according to any one of claims 31 to 40, wherein the region image output unit changes the size of the region image information to the same size as the size of the first window and outputs the same. .

 [42] A setting instruction which is an instruction to set an area located in the first window of the first information as an execution instruction area which is an area for outputting an execution instruction which is information instructing execution of a predetermined process. A setting instruction accepting unit that accepts;

 In response to the setting instruction, an execution instruction area configuration unit constituting execution instruction area setting information, which is information for setting an area located in the first window as an execution instruction area, and an execution instruction area for the first information An execution instruction that is information that is output in response to the setting instruction;

 42. The image information processing apparatus according to claim 31, further comprising an area information output unit that outputs the execution instruction area setting information and the execution instruction.

 [43] In the execution instruction area configuration unit, the first window of the first information is arranged when at least a part of the first window is arranged outside the first information display window. 443. The image information processing apparatus according to claim 442, comprising the execution instruction area setting information that indicates a position corresponding to a position where the user speaks.

 [44] a designation receiving unit that receives designation of an execution instruction area set by the execution instruction area setting information of the first information output by the first information output unit;

 44. The image information processing apparatus according to claim 42, further comprising an execution instruction output unit that outputs the execution instruction in response to reception of the designation.

[45] The area information output unit is a request for transmitting the execution instruction area setting information, the execution instruction, the first information, and the second image information to a predetermined address set in advance. 45. The image information processing apparatus according to any one of items 42 to 44.

[46] The setting instruction receiving unit receives a setting instruction including location information, which is information indicating the location of desired information,

45. The image information processing according to claim 42, wherein the execution instruction configuration unit configures an execution instruction that is an instruction to execute predetermined processing on the desired information indicated by the location information. apparatus. [47] The location information is a URL.

 47. The image information processing apparatus according to claim 46, wherein the execution instruction configuration unit configures an execution instruction that is an instruction to execute a process of acquiring information from the URL.

[48] a designation receiving unit that receives designation of an execution instruction area set by the execution instruction area setting information of the first information output by the first information output unit;

 An execution instruction output unit that outputs the execution instruction in response to the reception of the designation; and an execution information output unit that acquires and outputs the desired information from the URL in response to the execution instruction. 48. The image information processing apparatus according to claim 47.

[49] The setting instruction receiving unit receives a setting instruction including directory information indicating a location of desired information,

 45. The execution instruction according to any one of claims 42 to 44, wherein the execution instruction configuring unit configures an execution instruction that is an instruction to execute processing to acquire and output the desired information from a directory outside the directory indicated by the directory information. Image information processing apparatus.

[50] A designation receiving unit that receives designation of an execution instruction area set by the execution instruction area setting information of the first information output by the first information output unit;

 An execution instruction output unit that outputs the execution instruction in response to acceptance of the designation, and an execution information output unit that acquires and outputs the desired information from a directory outside the directory indicated by the directory information in accordance with the execution instruction 50. The image information processing apparatus according to claim 49, further comprising:

 [51] The area information output unit includes the execution instruction area setting information, the execution instruction, the first information, the second image information, and desired information in a directory indicated by the directory information. The image information processing apparatus according to claim 49 or 50V, wherein the image information is transmitted to a predetermined address set in advance.

 [52] A first information output step for outputting the stored first information to a first information display window, which is a window for displaying the first information;

 A first area designation instruction receiving step for receiving a first window generation instruction that is an instruction for generating a first window that is a window for designating a first area;

First window output for outputting the first window in response to the first window generation instruction The tape,

A second area designation instruction receiving step for receiving a second window generation instruction that is an instruction for generating a second window that is a window for specifying the second area;

A second window output step for outputting a second window in response to the second window generation instruction;

An acquisition instruction receiving step for receiving an acquisition instruction which is an instruction for acquiring image information output to the area in the second window;

An area image acquisition step of acquiring area image information which is image information output to an area in the second window in response to the acquisition instruction;

An image information processing method comprising: a region image output step of outputting the region image information acquired in the region image acquisition step onto a region located in the first window of the first information. .

On the computer,

A first information output step for outputting the first information stored in the first information display window, which is a window for displaying the first information;

A first area designation instruction receiving step for receiving a first window generation instruction that is an instruction for generating a first window that is a window for designating a first area;

A first window output step for outputting a first window in response to the first window generation instruction;

A second area designation instruction receiving step for receiving a second window generation instruction that is an instruction for generating a second window that is a window for specifying the second area;

A second window output step for outputting a second window in response to the second window generation instruction;

An acquisition instruction receiving step for receiving an acquisition instruction which is an instruction for acquiring image information output to the area in the second window;

An area image acquisition step of acquiring area image information which is image information output to an area in the second window in response to the acquisition instruction;

In the region image acquisition step, the region image information acquired in the step A program for executing an area image output step for outputting on an area located in the first window.