JP2014106810A - Image processing apparatus, image processing system, and image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a display state of each image when the image is displayed in list form.SOLUTION: An image processing apparatus comprises: a display area instruction part for instructing a display area of a first display image to be displayed on a display part; and a list image generation part for generating a second display image to be displayed in list form on the display part, and displays the second display image generated by the list image generation part in list form on a list image display part. The list image generation part generates the second image by superimposing an image displayed in the display area instructed by the display area instruction part and an image included in a non-display area other than the display area, out of the first display image, when the display area is instructed by the display area instruction part.

Description

  The present invention relates to a communication system.

  There is a so-called “electronic information board” product in which a touch panel is mounted on a large display of a size of about 40 inches to 60 inches using a flat panel or projector such as liquid crystal or plasma. The “electronic information board” can display a large screen of the connected PC by connecting the PC. For this reason, the “electronic information board” is used in presentations at meetings of corporations and government agencies, educational institutions, and the like.

  The “electronic information board” is equipped with a touch panel function. With this touch panel function, it is possible to operate the personal computer displaying the screen by directly touching the screen being displayed instead of the mouse operation. That is, the personal computer can be operated via the touch panel.

  Furthermore, an application that runs on a personal computer connected to an “electronic information board”, a so-called “blackboard application” is provided together with these devices. The “blackboard application” provides, for example, a screen functioning as a blackboard, and provides a function of drawing handwritten characters on the blackboard via the touch panel. The “blackboard application” provides a function of taking a screen of a personal computer and drawing a handwritten character on the screen.

  By the way, in the blackboard application, the display state is recorded for each created image. For example, if the contents of the second page are enlarged while the image of the second page is displayed, and then the third page is newly created and displayed, each image is displayed at the same magnification. Further, when the display is switched to the second page in order to confirm the contents of the second page again, the image is displayed in an enlarged state using the second page last. For this reason, it is possible to save the trouble of making the second page in an enlarged state again.

  When generating reduced images from a plurality of images and displaying them in a list, a technology is known that enlarges a reduced image selected to make it easier to see the contents of the reduced image to such an extent that other reduced images are not difficult to see (for example, patents). Reference 1).

  In the blackboard application, the display state is recorded for each image. However, since the display state of each image cannot be displayed when each image is displayed as a list, the display state of each image cannot be confirmed from the image list.

  Therefore, an object of the present invention is to display the display state of each image when displaying a list of images.

The disclosed image processing apparatus includes:
A display area instruction section for instructing a display area of a first display image to be displayed on the display section;
A list image generation unit that generates a second display image to be displayed as a list on the display unit,
An image processing apparatus that displays a list of second display images generated by the list image generation unit on a list image display unit,
The list image generation unit, when a display area is instructed by the display area instruction unit, of the first display image, an image displayed in a display area instructed by the display area instruction unit, The second display image is generated by superimposing an image included in a non-display area other than the display area.

  According to the disclosed embodiment, when displaying a list of images, the display state of each image can be displayed.

It is a figure which shows one Example of an image processing system. It is a functional block diagram which shows one Example of an image processing apparatus. It is a figure which shows one Example of the image displayed on a display part. It is a flowchart which shows one Example of an image reading process. It is a figure which shows one Example of a file selection dialog. It is a figure which shows one Example of an image display. It is a flowchart which shows one Example of a list image generation process. It is a figure which shows one Example of a reduction image. It is a flowchart which shows one Example of an image display process. It is a flowchart which shows one Example of a list image display process. It is a flowchart which shows one Example of a display image instruction | indication process. It is a figure which shows one Example of an operation sub panel. It is a flowchart which shows one Example of a display area zoom process. It is a flowchart which shows one Example of a display area shift process. FIG. 6 is a first diagram illustrating an example of an image displayed by the image processing apparatus. FIG. 10 is a second diagram illustrating an example of an image displayed by the image processing apparatus. FIG. 10 is a third diagram illustrating an example of an image displayed by the image processing apparatus; FIG. 10 is a fourth diagram illustrating an example of an image displayed by the image processing apparatus; It is FIG. (5) which shows one Example of the image displayed by an image processing apparatus. It is a functional block diagram which shows one Example of an image processing apparatus. It is a figure which shows one Example of the image displayed on a display part. It is a flowchart which shows one Example of a line segment writing process. It is a flowchart which shows one Example of an image superimposition process. It is a figure which shows one Example of the image displayed by an image processing apparatus. 6 is a flowchart illustrating an example of a blank paper image generation process. It is a figure which shows one Example of the image displayed by an image processing apparatus. It is a figure which shows one Example of the image displayed by an image processing apparatus. It is a flowchart which shows one Example of an image preservation | save process. It is a figure which shows one Example of the image displayed by an image processing apparatus. It is a figure which shows one Example of the image displayed by an image processing apparatus. It is a figure which shows one Example of the image displayed on a display part. It is a figure which shows one Example of the image displayed on a display part. It is a figure which shows one Example of the image displayed on a display part. It is a figure which shows one Example of a page thumbnail button. It is a figure which shows one Example of the image displayed on a display part. It is a figure which shows one Example of a page thumbnail button. It is a figure which shows one Example of the image displayed on a display part.

Next, the form for implementing this invention is demonstrated, referring drawings based on the following Examples.
In all the drawings for explaining the embodiments, the same reference numerals are used for those having the same function, and repeated explanation is omitted.

<First embodiment>
<Image processing system>
FIG. 1 shows an embodiment of an image processing system 100.

  The image processing system 100 includes an image processing device 110 as a display device, and PCs 130a and 130b as terminals. The image processing apparatus 110 and the PCs 130a and 130b are connected by cables 124 and 126, respectively. The image processing apparatus 110 and the PCs 130a and 130b may be wirelessly connected.

  The image processing apparatus 110 displays images displayed on the PCs 130a and 130b (hereinafter referred to as “display images”). Further, the image processing apparatus 110 can display an image generated by the user drawing (hereinafter referred to as “drawing image”). The image processing apparatus 110 may be included in an electronic information board.

  Further, the image processing apparatus 110 generates an event when the display unit 112 is touched. The image processing apparatus 110 transmits an event generated by an input device such as a mouse or a keyboard to the PC 130a and PC 130b.

  The PCs 130 a and 130 b are information processing apparatuses that provide display images to the image processing apparatus 110. The PC 130a and PC 130b include an interface for outputting an image signal. The PC 130a and PC 130b supply the image processing apparatus 110 with an image signal forming a display image of the PC 130a and PC 130b at a predetermined rate. For example, the predetermined rate is preferably about 30 frames per second.

  In one embodiment of the image processing system, the PC 130a and PC 130b include a VGA (Video Graphics Array) output terminal (not shown) as an interface. The PC 130a and the PC 130b transmit a VGA signal to the image processing apparatus 110 via the cable 124 such as a VGA cable. The PC 130a and the PC 130b may transmit an image signal for forming a display image to the image processing apparatus 110 by wireless communication complying with various wireless communication protocols.

  Further, the PC 130 a and the PC 130 b can acquire the display image of the display unit 112 of the image processing apparatus 110. The PC 130a and PC 130b include a USB (Universal Serial Bus) port (not shown). The PC 130a and PC 130b can acquire a display image stored in the image processing apparatus 110 connected via the USB cable 126 using a general-purpose driver such as USB Mass Storage Class.

  In an embodiment of the image processing system, notebook PCs are employed as the PCs 130a and 130b. As the PC 130a and PC 130b, an information processing apparatus capable of supplying image frames such as a desktop PC, a tablet PC, a PDA (Personal Digital Assistants), a digital video camera, and a digital camera can be employed.

  In one embodiment of the image processing system, two PCs 130a and 130b are employed. One PC or three or more PCs may be employed.

<Functions of Image Processing Device 110>
FIG. 2 shows an embodiment of the image processing apparatus 110. FIG. 2 is a functional block diagram related to image display.

  The functions represented by this functional block diagram are mainly executed by a CPU (not shown) mounted on the image processing apparatus 110. That is, the functions represented by the functional block diagram of FIG. 2 are executed by the CPU according to the application stored in the storage unit (not shown).

  The CPU functions as an image reading unit 202, an image display unit 204, a list image generation unit 206, a list image display unit 208, a display image instruction unit 210, and a display area instruction unit 212.

  The image reading unit 202 reads an image. For example, an image signal for forming a display image from the PC 130a or PC 130b is read.

  The display area instruction unit 212 instructs the display area of the display image.

  The list image generation unit 206 superimposes display area information based on the display area designated by the display area instruction unit 212 on the display image read by the image reading unit 202. The list image generation unit 206 generates a list reduced image (hereinafter referred to as a “list reduced image”) in which display area information is superimposed on a display image. The thumbnail image for list may be a thumbnail.

  The list image display unit 208 displays a plurality of list reduced images generated by the list image generation unit 206.

  The display image instruction unit 210 instructs a list reduction image to be displayed on the image display unit 204 from a plurality of list reduction images displayed by the list image display unit 208.

  The image display unit 204 displays, from the display image read by the image reading unit 202, the display area designated by the display area designation unit 212 of the display image corresponding to the list reduction image designated by the display image designation unit 210. Display.

  The image processing apparatus 110 mounts an image display application that executes an image display method.

  An image display application will be described.

  FIG. 3 shows an example of an image displayed on the display unit 112 according to the image display application. For example, in an embodiment of an application operating environment and a development environment, WINDOWS (registered trademark) 7 (Microsoft) as an OS, MSDN (Microsoft) as a development environment, Net Framework and WPF (Windows Presentation Foundation) as a development framework, Microsoft Corporation) can be used.

  The image display application includes a first application that displays one window. By executing the first application, the designated display area of the designated display image is displayed in the entire window.

  An operation panel is attached to the right side of the window. The operation panel is displayed on the display image. The operation panel includes a plurality of function execution buttons. By pressing the function execution button with a pointing device such as a mouse, the function corresponding to the pressed function execution button is executed.

  In one embodiment of the function execution button, an image reading button 302 labeled “load” for executing the image reading process is attached. Also, a display image zoom button 304 labeled “Zoom” for instructing the display area of the display image and simultaneously executing the process of generating and updating the list reduced image is attached. An application end button 306 labeled “Quit” for ending the application is attached.

  An image list display panel 308 is attached to the lower part of the window. The image list display panel 308 may be displayed on the display image. The image list display panel 308 includes a plurality of function execution buttons. By pressing the function execution button with a pointing device or the like, the function corresponding to the function execution button is executed.

  The image list display panel 308 is provided with a list advance button 312 and a list return button 314 for executing processing for switching the displayed reduced image for list. Further, four thumbnail thumbnail buttons 316, 318, 320, and 322 for displaying a list reduced image and executing processing for designating an image corresponding to the list reduced image are attached as display target images. The image thumbnail buttons 316, 318, 320, and 322 are not limited to four, may be 2-3, and may be five or more.

<Operation of Image Processing Device 110>
Processing performed by executing the image display application will be described.

<Image reading process>
FIG. 4 shows an embodiment of the image reading process. FIG. 4 mainly shows processing executed by the image reading unit 202.

  In step S402, the image reading button 302 in the operation panel is pressed. This pressing may be performed by pressing the image reading button 302 displayed on the display screen configured by the touch panel by a human hand or by pressing by a pointing device such as a pen. May be. Alternatively, the image reading button may be physically provided, and the reading button may be pressed by a human hand.

  In step S404, when the image reading button 302 is pressed in step S402, the image processing apparatus 110 displays a dialog for selecting an image file (hereinafter referred to as “file selection dialog”). The file selection dialog can use, for example, an Open File Dialog component in Windows (registered trademark).

  In step S406, when an image file is selected in the file selection dialog and the “load” button is pressed, the image processing apparatus 110 determines whether there is a file path of the selected image file. When a “Cancel” button (not shown) is pressed in the file selection dialog, the image processing apparatus 110 stops the image reading process.

  In step S408, if it is determined in step S406 that there is a file path, the file path is acquired, the image data is read, and the process is completed.

  If it is determined in step S406 that there is no file path, the process ends.

  When the image reading process is completed, the list image generating unit 206 executes the list image generating process using the read image data. If the number of image data being read is three or less, the list image display unit 208 also executes list image display processing.

  If there is no image data being read, the image display unit 204 executes image display processing of the image data read first.

  FIG. 5 shows an example of the file selection dialog 315.

  In the example shown in FIG. 5, four image files “Image01.png”, “Image02.png”, “Image03.png”, and “Image04.png” are selected from the plurality of files in the file selection dialog 315. Selected. When the user depresses the image load button 302 labeled “load”, the selected “Image01.png”, “Image02.png”, “Image03.png”, and “Image04.png” These four image files are read.

  FIG. 6 shows an embodiment of the display image. FIG. 6 shows an example of an image displayed on the display unit 112 by the list image display unit 208 after reading four image files.

  In the example shown in FIG. 6, “A”, “B”, “C”, and “D” corresponding to “Image01.png”, “Image02.png”, “Image03.png”, and “Image04.png”. The image data on which the characters are drawn is read.

  The list image display unit 208 causes the list image display panel 308 to display the list reduced image generated and updated by the list image generation unit 206. In the example shown in FIG. 6, the image thumbnail button 316 displays an image on which characters “A” corresponding to the image data “Image01.png” are drawn. The image thumbnail button 318 displays an image on which characters “B” corresponding to the image data “Image02.png” are drawn. The image thumbnail button 320 displays an image on which characters “C” corresponding to the image data “Image03.png” are drawn. The image thumbnail button 322 displays an image on which characters “D” corresponding to the image data “Image04.png” are drawn.

  The image display unit 204 displays an image corresponding to the image data “Image01” displayed on the image thumbnail button 316 on the screen. The list image display unit 208 selects an image thumbnail button corresponding to the display image so that the current display image can be determined from the image thumbnail buttons 316, 308, 310, and 312 included in the list image display panel 308. It is preferable to display. In the example shown in FIG. 6, the list image display unit 208 highlights the frame of the image thumbnail button 316.

<List image generation processing>
FIG. 7 shows an embodiment of the list image generation process. FIG. 7 mainly illustrates processing executed by the list image generation unit 206.

  In step S702, the image processing apparatus 110 determines whether image data has been read in the image reading process.

  In step S704, if it is determined in step S702 that the image data has been read, the image processing apparatus 110 generates a reduced image for list of the read image data. The image processing apparatus 110 sets the list thumbnail image in the image thumbnail button 310. At the time of generating the list reduced image, processing for changing the display area of the display image is not performed. Therefore, the image processing apparatus 110 does not perform the process of superimposing the display area information on the display image.

  However, when the image display area is changed by the display area instruction unit 212, the list image generation unit 206 superimposes the information on the display area on the reduced list image corresponding to the display image whose display area has been changed.

  FIG. 8 shows an example of the list reduced image. FIG. 8 shows an example of a reduced list image displayed on the image thumbnail button 310. The list reduction image is created by the list image generation unit 206.

  Both the display image size and the application window size are horizontal X pixels and vertical Y pixels. Also, the size of the list reduced image (image thumbnail button) is assumed to be x horizontal pixels and y vertical pixels.

  The display image size, the application window size, and the aspect ratio of the list reduced image are all the same. The application window and the list reduction image follow a coordinate system in which the upper left is (0, 0) and the lower right is (X, Y) and (x, y).

  The display area instruction unit 212 executes an instruction to enlarge the display by n times (n is an integer of 1 ≦ n). When the display is enlarged n times, the display area is relatively 1 / n times larger. Accordingly, when the display is enlarged n times, the display area becomes a rectangular area of horizontal X / n pixels and vertical Y / n pixels.

  When the display area is shifted so that the upper left corner of the rectangular area is (X1 / n, Y1 / n), the upper left corner of the first display area of the display image is (X1 / n, Y1 / n). , A rectangular area of horizontal X / n pixels and vertical Y / n pixels. Here, the non-display area is (0, 0) in the upper left, and is an area obtained by removing the first display area from the rectangular area of horizontal X pixels and vertical Y pixels.

  The list image generation unit 206 generates a non-display image in which the upper left is (0, 0) and the first display area is removed from the rectangular area of horizontal X pixels and vertical Y pixels. The list image generation unit 206 multiplies the non-display image by x / n. The list image generation unit 206 superimposes a non-display image multiplied by x / n on the list reduced image. It is preferable that the list image generation unit 206 displays the non-display image so that the list reduction image can be distinguished from the non-display image. For example, it is preferable that the list image generation unit 206 generates a non-display image that is gray and translucent.

  In addition, the display area instruction unit 212 executes an instruction to reduce the display to 1 / n times. When the display is reduced to 1 / n times, the display area becomes relatively n times. Therefore, when the display is reduced to 1 / n times, the display area becomes a rectangular area of horizontal n × X pixels and vertical n × Y pixels. Even when the display is reduced to 1 / n times, a reduced image for list can be generated. Furthermore, a non-display image can be generated as necessary.

  FIG. 9 shows an embodiment of the image display process. FIG. 9 shows processing executed mainly by the image display unit 204.

  In step S902, the image processing apparatus 110 acquires image data to be displayed. For example, the image display unit 204 acquires image data corresponding to the image instructed by the display image instruction unit 210. Further, the image display unit 204 acquires image data read by the image reading unit 202 when the image reading process is executed in a state where there is no image instruction by the display image instruction unit 210.

  In step S904, the image processing apparatus 110 cuts out an image in the display area. For example, when the display area of the display image of the image data acquired in step S902 is changed, the image display unit 204 cuts out the display area image from the display image based on the display area information.

  In step S906, the image processing apparatus 110 displays the image of the display area cut out in step S904 by fitting to the window size. For example, the image display unit 204 displays the image of the display area cut out in step S904.

<List image display processing>
FIG. 10 shows an embodiment of the list image display process.

  FIG. 10 mainly illustrates processing executed by the list image display unit 208.

  In step S1002, the image processing apparatus 110 determines whether the read image data is 4 or less.

  In step S1004, if the read image data is 4 or less, the image processing apparatus 110 causes the image thumbnail button to display a list reduced image corresponding to all image data.

  In step S <b> 1006, when there are more read image data than 4, the image processing apparatus 110 determines whether the list return button has been pressed.

  In step S1008, if it is determined in step S1006 that the list return button has been pressed, the image processing apparatus 110 determines that there is image data read before the image data of the displayed list reduction image. A reduced list image corresponding to the previously read image data is displayed. When there are four or more image data read before the image data of the displayed list reduced image, it is preferable to display a list reduced image corresponding to a maximum of four image data.

  In step S1010, if it is determined in step S1006 that the list return button cannot be pressed, the image processing apparatus 110 determines whether or not the list feed button has been pressed.

  In step S1012, if it is determined in step S1010 that the list feed button has been pressed, and there is image data read after the image data of the displayed list reduction image, the list reduction image corresponding to them is displayed. Display. When there are four or more image data read after the image data of the displayed list reduced image, it is preferable to display a list reduced image corresponding to a maximum of four image data.

  If it is not determined in step S1010 that the list feed button has been pressed, the list image display process is terminated after the processes in steps S1004, S1008, and S1012 are completed.

  In the flowchart shown in FIG. 10, the order of steps S1002 and S1004, steps S1006 and S1008, and steps S1010 and S1012 may be changed.

<Display image instruction processing>
FIG. 11 shows an embodiment of the display image instruction process.

  FIG. 11 shows processing executed mainly by the display image instruction unit 210.

  In step S1102, the image thumbnail button is pressed. This pressing may be performed by pressing the image thumbnail button displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be.

  In step S1104, the image processing apparatus 110 executes image display processing of image data corresponding to the list thumbnail image displayed on the image thumbnail button pressed in step S1102. As a result of executing the image display process, the display area of the display image is displayed in the window.

  In step S1106, the image processing apparatus 110 returns the highlighted image thumbnail button to the original non-highlighted image thumbnail button, and highlights the pressed thumbnail button.

<Zoom and shift the display screen>
FIG. 12 shows an embodiment of the operation sub-panel. The example shown in FIG. 12 shows an embodiment of the operation sub-panel 324 displayed when the display image zoom button 304 is pressed on the operation panel. When the operation sub panel 324 is displayed, the operation sub panel 324 can be closed by pressing the display image zoom button 304 again.

  In the image display application, the display image can be enlarged or reduced by the display image zoom button 304 on the operation panel. In the image display application, the display area of the display image can be designated by shifting the display area with the shift button 334 while the display image is enlarged.

  An operation sub-panel 324 shown in FIG. 12 is provided with an equal magnification button 332 represented as “100%” for equalizing the display screen display. In addition, a double zoom button 330 represented as “200%” for doubling the display on the display screen is attached. In addition, a 3 × zoom button 328 represented by “300%” is added to triple the display on the display screen. In addition, a 4 × zoom button 326 represented by “400%” is added to make the display screen display 4 ×. The zoom button shown in FIG. 12 is an example, and a button for enlarging or reducing to a desired magnification may be provided.

  Further, the operation sub-panel 324 is provided with a shift button 334 for executing a process of shifting (shifting) the display area in the vertical and horizontal directions when the display is zoomed (enlarged) twice or more. .

  FIG. 13 shows an embodiment of the display area zoom process. The process shown in FIG. 13 is mainly executed by the display area instruction unit 212.

  In step S1302, the image processing apparatus 110 determines whether or not the equal magnification button 332 has been pressed. This pressing may be performed by pressing the same size button 332 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be. Alternatively, the same size button 332 may be physically provided, and the same size button 332 may be pressed by a human hand.

  In step S1304, if it is determined in step S1302 that the equal-size button has been pressed, the image processing apparatus 110 changes the display area to the entire display image.

  In step S <b> 1306, when it is determined in step S <b> 1302 that the normal magnification button is not pressed, the image processing apparatus 110 determines whether or not the double zoom button 330 is pressed. This pressing may be performed by pressing the double zoom button 330 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be executed. Alternatively, the 2 × zoom button 330 may be physically provided, and the 2 × zoom button 330 may be pressed by a human hand.

  In step S1308, if it is determined in step S1306 that the double zoom button 330 has been pressed, the image processing apparatus 110 sets the size of the display area to the current magnification / 2 while keeping the center of the display area unchanged. Change to

  In step S1310, when it is determined in step S1306 that the double zoom button 330 is not pressed, the image processing apparatus 110 determines whether the triple zoom button 328 is pressed. This pressing may be executed by pressing the double zoom button 328 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be executed. Alternatively, a 3 × zoom button 328 may be physically provided, and the 3 × zoom button 328 may be pressed by a human hand.

  In step S1312, if it is determined in step S1310 that the 3 × zoom button 328 has been pressed, the image processing apparatus 110 sets the display area size to the current magnification / 3. Change to

  In step S1314, when it is determined in step S1310 that the 3 × zoom button 328 is not pressed, the image processing apparatus 110 determines whether the 4 × zoom button 326 is pressed. This pressing may be performed by pressing the 4 × zoom button 326 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be executed. Alternatively, a 4 × zoom button 326 may be physically provided, and the 4 × zoom button 326 may be pressed by a human hand.

  In step S1316, if it is determined in step S1314 that the 4 × zoom button 326 has been pressed, the image processing apparatus 110 sets the display area size to the current magnification / 4. Change to

  In step S1318, after the processes in steps S1304, S1308, S1312, and S1316, the image processing apparatus 110 executes the image display process described with reference to FIG.

  If it is determined in step S1314 that the 4 × zoom button 326 is not pressed, or after the process of step S1318, the display area zoom process is terminated.

  When the display area changes from the display image when the display area is changed in steps S1304, S1308, S1312, and S1316, it is preferable to automatically shift the display area so as to become the display image.

  In the flowchart shown in FIG. 13, the order of steps S1302 and S1304, steps S1306 and S1308, steps S1310 and S1312, and steps S1314 and S1316 may be changed.

<Display area shift processing>
FIG. 14 shows an embodiment of the display area shift process. The process shown in FIG. 14 is mainly executed by the display image instruction unit 210.

  In step S1402, the image processing apparatus 110 determines whether or not the upper shift button of the shift button 334 has been pressed. This pressing may be performed by pressing the upper shift button displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be. Alternatively, the upper shift button may be physically provided, and the upper shift button may be pressed by a human hand.

  In step S1404, if it is determined in step S1402 that the upshift button has been pressed, the image processing apparatus 110 shifts the display area upward by N pixels.

  In step S1406, when it is determined in step S1402 that the upper shift button is not pressed, the image processing apparatus 110 determines whether the lower shift button of the shift button 334 is pressed. This pressing may be executed by pressing the lower shift button displayed on the display screen configured by the touch panel by a human hand or by pressing by a pointing device such as a pen. May be. Alternatively, the lower shift button may be physically provided, and the lower shift button may be pressed by a human hand.

  In step S1408, if it is determined in step S1406 that the downshift button has been pressed, the image processing apparatus 110 shifts the display area downward by N pixels.

  In step S1410, when it is determined in step S1406 that the down shift button is not pressed, the image processing apparatus 110 determines whether the left shift button of the shift button 334 is pressed. This pressing may be performed by pressing the left shift button displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be. Alternatively, a left shift button may be physically provided, and the left shift button may be executed by being pushed down by a human hand.

  In step S1412, if it is determined in step S1410 that the left shift button has been pressed, the image processing apparatus 110 shifts the display area to the left by N pixels.

  In step S1414, if it is determined in step S1410 that the left shift button is not pressed, the image processing apparatus 110 determines whether the right shift button of the shift button 334 is pressed. This pressing may be executed when the right shift button displayed on the display screen configured by the touch panel is pressed by a human hand, or by pressing with a pointing device such as a pen. May be. Alternatively, a right shift button may be physically provided, and the right shift button may be executed by being pushed down by a human hand.

  In step S1416, when it is determined in step S1414 that the right shift button has been pressed, the image processing apparatus 110 shifts the display area to the right by N pixels.

  In step S1418, after the processes in steps S1404, S1408, S1412, and S1416, the image processing apparatus 110 executes the image display process described with reference to FIG.

  If it is determined in step S1414 that the right shift button is not pressed, or after the process of step S1418, the display area shift process is terminated.

  When the display area is shifted from the display image when the display areas in steps S1404, S1408, S1412, and S1416 are shifted, it is preferable to automatically shift the display area so that it is within the display image.

  In the flowchart shown in FIG. 14, the order of steps S1402 and S1404, steps S1406 and S1408, steps S1410 and S1412, and steps S1414 and S1416 may be changed.

<One Example of Operation of Image Processing Apparatus 110>
15 to 19 show an example of an image displayed by the image processing apparatus 110.

  The image processing apparatus 110 executes processing for displaying an image in accordance with an image display application.

  In the image processing apparatus 110, when the image display application operates, a plurality of images are switched and displayed.

  In the example shown in FIG. 15, a display image when the double zoom button 330 is pressed down on the operation sub-panel 324 in the screen state shown in FIG. 12 is shown. In the display image, the center of the display area is unchanged, and the vertical and horizontal sizes are halved because the display area is enlarged from the same magnification, which is the magnification before pressing, to twice.

  Further, with the change of the display area, the non-display area is superimposed on the list thumbnail image displayed on the image thumbnail button 316.

  In the example shown in FIG. 16, a display image when the right shift button of the shift button 334 is pressed several times in the screen state shown in FIG. The display area shifts to the right. The display area includes a right side portion that was a non-display area in FIG. Further, the list reduced image displayed on the image thumbnail button 316 is also updated. For example, if 20 pixels are shifted by one press, 40 pixels are shifted by two presses.

  In the example shown in FIG. 17, the image thumbnail button 318 displayed as “B” is selected in the screen state shown in FIG. After the image thumbnail button 318 is selected and a display image corresponding to the image thumbnail button 318 is displayed, the 3 times zoom button 328 is pressed down on the operation sub-panel 324, and the lower shift button of the shift button 334 is pressed down. The

  According to FIG. 17, compared with FIG. 12, the display area of the display image corresponding to the list reduced image displayed on the image sub nail button 316 and the list reduced image displayed on the image sub nail button 318 are supported. The display area of the display image to be changed is changed. Therefore, information on the display area is superimposed on the list thumbnail image displayed on the image thumbnail button 316 and the list thumbnail image displayed on the image thumbnail button 318, respectively.

  Further, since the list thumbnail image of the image thumbnail button 318 is displayed, the image thumbnail button 318 is highlighted.

  By viewing the image displayed on the image thumbnail button, it is possible to confirm the display image when the image thumbnail button is selected and displayed.

  In the example shown in FIG. 18, the image thumbnail button 322 is selected in the screen state shown in FIG. After the image thumbnail button 322 is selected and a display image corresponding to the image thumbnail button 322 is displayed, the 4 × zoom button 326 is pressed on the operation sub-panel 324, and the upper shift button of the shift button 334 is further pressed. The

  According to FIG. 18, compared with FIG. 12, the display area of the display image corresponding to the reduced image for list displayed on the image sub nail button 316 and the reduced image for list displayed on the image sub nail button 318 are supported. The display area of the display image to be displayed and the display area of the display image corresponding to the reduced image for list displayed on the image sub nail button 322 are changed. For this reason, the display area information is superimposed on the list thumbnail image displayed on the image thumbnail button 316, the list thumbnail image displayed on the image thumbnail button 318, and the list thumbnail image displayed on the image thumbnail button 322, respectively. Is done.

  In addition, since the list thumbnail image of the image thumbnail button 322 is displayed, the image thumbnail button 322 is highlighted.

  By viewing the image displayed on the image thumbnail button, it is possible to confirm the display image when the image thumbnail button is selected and displayed.

  In the example shown in FIG. 19, the image thumbnail button 318 is selected in the screen state shown in FIG. The image thumbnail button 318 is selected, and a display image corresponding to the image thumbnail button 318 is displayed.

  When selecting an image thumbnail button, the list thumbnail image and the non-display area can be confirmed by looking at the image thumbnail button. That is, the display state of the display image can be confirmed before switching the display image.

  According to an embodiment of the image processing system, it is possible to display a list of reduced images for list that are candidates for display and editing. Furthermore, the display and editing target can be selected from the list-displayed reduced image.

  Also, when changing the display area by enlarging or reducing the display image and enlarging it, the non-display area is determined based on the display area, and the non-display area information is superimposed on the list reduced image. Can be displayed on the image thumbnail button. By displaying an image obtained by superimposing non-display area information on the list reduced image on the image thumbnail button, the user can grasp the display state of the display image.

<Second embodiment>
An embodiment of the image processing system 100 is substantially the same as FIG.

<Functions of Image Processing Device 110>
FIG. 20 shows an embodiment of the image processing apparatus 110. FIG. 20 is a functional block diagram related to image editing.

  The functions represented by this functional block diagram are mainly executed by a CPU (not shown) mounted on the image processing apparatus 110. That is, the function represented by the functional block diagram of FIG. 20 is executed by the CPU according to the application stored in the storage unit (not shown).

  The CPU includes an image reading unit 202, an image display unit 204, a list image generation unit 206, a list image display unit 208, a display image instruction unit 210, a display area instruction unit 212, a blank paper image generation unit 214, The line segment writing unit 216, the image superimposing unit 218, and the image storage unit 220 function.

  The functions of the image reading unit 202, the image display unit 204, the list image generation unit 206, the list image display unit 208, the display image instruction unit 210, and the display area instruction unit 212 are substantially the same as the functions described with reference to FIG. is there.

  The line segment writing unit 216 writes a line segment on the display image.

  The image superimposing unit 218 superimposes the line segment written on the display image by the line segment writing unit 216 on the display image.

  The blank paper image generation unit 214 generates image data of a blank display image.

  The image storage unit 220 stores the read image data and the generated image data.

  One embodiment of the image processing apparatus 110 implements an image editing application that executes an image display method.

  An image editing application will be described.

  By executing the image editing application, the image processing apparatus 110 has a blank image generation unit 214, a line segment writing unit 216, an image superimposing unit 218, and an image storage unit in addition to the function when the image display application is executed. It functions as 220. A description of the function when the image display application is executed will be omitted.

  FIG. 21 shows an example of an image displayed on the display unit 112 according to the image editing application. An embodiment of the application operating environment and the development environment is the same as the first embodiment.

  An operation panel is attached to the right side of the window. The operation panel is displayed on the display image. The operation panel includes a plurality of function execution buttons. A function corresponding to the pressed function execution button is executed by pressing a plurality of function execution buttons with a pointing device such as a mouse.

  In one embodiment of the function execution button, an image reading button 302 labeled “load” for executing the image reading process is attached. Also, a display image zoom button 304 labeled “Zoom” for instructing the display area of the display image and simultaneously executing the process of generating and updating the list reduced image is attached. Also, a blank image generation button 336 labeled “new” for executing a blank image generation process for generating a blank image as image data to be displayed and edited is attached. Further, an image save button 338 labeled “save” for executing the image saving process for saving the read image data, the generated image data, and the edited image data is attached. In addition, an application end button labeled “Quit” is attached to end the application. An application end button 306 labeled “Quit” for ending the application is attached.

  Further, by dragging while holding down the pointing device in an image display area other than the operation panel, a drag locus is displayed on the display image.

  An image list display panel 308 is attached at the bottom of the window. The image list display panel 308 is displayed on the display image. The image list display panel 308 includes a plurality of function execution buttons. By pressing the function execution button with the pointing device, the function corresponding to the function execution button is executed.

  In one embodiment of the image list display panel 308, a list advance button 312 and a list return button 314 for executing a process of switching the displayed reduced image for list are attached. Also, four image thumbnail buttons 316, 318, 320, and 322 for displaying a list reduced image and executing processing for specifying an image corresponding to the list reduced image using the display image are attached.

<Operation of image editing application>
Processing performed when the image editing application is executed will be described.

<Line segment writing process, image superimposition process>
FIG. 22 shows an example of the line segment writing process.

  FIG. 22 shows processing mainly executed by the line segment writing unit 216.

  In step S2202, the image processing apparatus 110 determines whether or not a mouse button (pointing device) is pressed at an arbitrary place on the window other than the operation panel and the image list display panel 308.

  In step S2204, if it is determined in step S2202 that the mouse button has been pressed, the image processing apparatus 110 determines whether the mouse button has been released.

  In step S2206, if it is determined in step S2204 that the mouse button is not released, the image processing apparatus 110 determines whether the mouse is being dragged.

  In step S2208, if it is determined in step S2206 that the mouse is being dragged, the image processing apparatus 110 recognizes that the line segment is being written, and displays the drag locus on the window.

  If it is determined in step S2202 that the mouse button is not pressed in any place other than the operation panel and the image list display panel 308, the line segment writing process ends.

  If it is determined in step S2206 that the mouse is not being dragged, or the drag locus is displayed in the window in step S2208, the process returns to step S2204.

  In step S2210, if it is determined in step S2204 that the mouse button has been released, the image processing apparatus 110 determines whether a drag trajectory is displayed on the window corresponding to the mouse drag trajectory.

  In step S2212, when it is determined in step S2210 that the drag trajectory is displayed, the image processing apparatus 110 executes image superimposition processing.

  If it is determined in step S2210 that the drag locus is not displayed, the line segment writing process ends.

  FIG. 23 shows an embodiment of the image superimposing process.

  FIG. 23 mainly shows processing executed by the image superimposing unit 218.

  In step S2302, the image processing apparatus 110 acquires the displayed line segment information.

  In step S2304, the image processing apparatus 110 generates a composite image by superimposing the line segment acquired in step S2302 on the display image. The image processing apparatus 110 replaces the image data of the composite image generated in step S2304 with new image data.

  In step S2306, the image processing apparatus 110 deletes the displayed line segment.

  In step S2308, the image processing apparatus 110 displays a composite image corresponding to the new image data replaced in step S2304 on the window.

  In step S2310, the image processing apparatus 110 executes the list image generation process described with reference to FIG. 7 based on the composite image displayed in step S2308.

  In step S2312, the image processing apparatus 110 executes the list image display process described with reference to FIG. 10 based on the composite image displayed in step S2308, and updates the display in the window.

  FIG. 24 shows an example of an image displayed by the image processing apparatus 110.

  FIG. 24 shows a screen in which line segments are written on the display image.

  The user drags the mouse so as to draw a circle while pressing the mouse button on the right side of “A” in the display image. The image processing apparatus 110 displays a line segment according to the movement of the mouse pointer. The user releases the mouse button. The image processing apparatus 110 superimposes the written line segment on the display image and also updates the reduced image for list on the image thumbnail button corresponding to the display screen among the image thumbnail buttons included in the image list display panel 308.

<Blank image generation processing>
FIG. 25 shows an example of a blank paper image generation process.

  FIG. 25 shows processing executed mainly by the blank paper image generation unit 214.

  In step S2502, the blank image generation button 336 in the operation panel is pressed. This pressing may be performed by pressing the blank image generation button 336 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be executed. Alternatively, a blank page image generation button 336 may be physically provided, and the blank page image generation button 336 may be executed by being pushed down by a human hand.

  In step S2504, when the blank image generation button 336 is pressed in step S2502, the image processing apparatus 110 generates blank image data. The size of the blank image is preferably set in advance.

  In step S2506, the image processing apparatus 110 displays a blank image on the window by executing the image display process described with reference to FIG.

  In step S2508, the image processing apparatus 110 executes the list image generation process described with reference to FIG. 7, thereby generating a list reduced image based on the blank image data.

  In step S2510, the image processing apparatus 110 executes the display image instruction process described with reference to FIG. 11, so that, based on the blank image data, among the image thumbnail buttons included in the image list display panel 308, a blank page is displayed. The image thumbnail button on which the image is displayed is highlighted and the display is updated.

  FIG. 26 shows an example of an image displayed by the image processing apparatus 110.

  FIG. 26 shows a screen on which a blank image is created in a state where four image data have been read.

  When the user presses the blank image generation button 336, a blank image is displayed in the window. Further, the thumbnail image 322 corresponding to the blank image is displayed on the image thumbnail button 322 at the end of the image list display panel 308, and the image thumbnail button 322 is highlighted.

  FIG. 27 shows an example of an image displayed by the image processing apparatus 110.

  FIG. 27 shows a display screen when a line segment is written on the blank image after the blank image is generated. Since a blank image can be generated, for example, a free discussion memo can be written and stored in a blank image. In other words, it can be used like a whiteboard.

<Image storage processing>
FIG. 28 shows an embodiment of the image storage process. FIG. 28 shows processing mainly executed by the image storage unit 220.

  In one embodiment of the image storage process, the image data is stored in a format different from the format of the read image data. For example, a plurality of image data are stored as one PDF (Portable Document Format) file.

  In step S2802, the image save button 338 in the operation panel of the image processing apparatus 110 is pressed. This pressing may be performed by pressing the image saving button 338 displayed on the display screen configured by the touch panel by a human hand, or by pressing by a pointing device such as a pen. May be.

  In step S2804, the image processing apparatus 110 generates a save file name for saving image data based on the time information when the image save button 338 is pressed.

  In step S2806, the image processing apparatus 110 displays a dialog for selecting a directory for storing image data.

  FIG. 29 shows an example of an image displayed by the image processing apparatus 110.

  FIG. 29 shows an embodiment of the directory selection dialog.

  In the directory selection dialog, the generated save file name is displayed in the caption part.

  The user can specify a save destination directory by selecting a directory in the directory information and pressing the “Save” button.

  For example, a Windows FolderBrowserDialog component can be used for processing the image saving dialog.

  In step S2808, after the save destination directory is designated, the image processing apparatus 110 generates a PDF file including all image data. For example, iText (iText Software) can be used when generating a PDF file.

  In step S2810, the image processing apparatus 110 stores the PDF file generated in step S2808 with the file name generated in step S2804 in the directory specified in step S2806.

<One Example of Operation of Image Processing Apparatus 110>
FIG. 30 shows an example of an image displayed by the image processing apparatus 110.

  The image processing apparatus 110 displays an image according to the image editing application.

  FIG. 30 shows a screen immediately after starting the blackboard application.

  There is an operation panel on the right side of the screen. An image reading button 302 for reading image data to be pasted on the page is attached to the operation panel. A display image zoom button 304 for displaying a zoom pan panel for zooming or shifting the display area of the page is attached to the operation panel. A write button 340 for writing a line segment on the display page is attached to the operation panel. The operation panel is provided with a pen attribute change button 342 for displaying a pen attribute change panel for selecting the color and width of the line when writing the line segment on the display page. A blank image button 336 for creating a new page is attached to the operation panel. An image save button 338 for saving the created page is attached to the operation panel. An application end button 306 for ending the application is attached to the operation panel.

  The pen attribute change button 342 is provided with nine color buttons and four line width buttons. Further, a page list display panel 308 is attached at the bottom of the screen. The page list display panel 308 is provided with four image thumbnail buttons 316, 308, 320 and 322, a page list advance button 312 and a page list return button 314.

  Note that in the image editing application executed in the embodiment of the image processing apparatus 110, the page size is larger than the size of the display image. Therefore, the image displayed on the image thumbnail button in the initial state is gray indicating a non-display area. An area is included.

  FIG. 31 shows an example of an image displayed on the display unit 112.

  FIG. 31 shows a screen immediately after reading four pieces of image data. By starting the image editing application, a new page is automatically created every time image data is read. Image data is pasted on a new page.

  Also, when the page is read, if the first page created in the initial state is blank, the first page is deleted.

  FIG. 32 shows an example of an image displayed on the display unit 112.

  FIG. 32 shows a zoom pan panel 344 displayed when the display zoom button 304 is pressed.

  FIG. 33 shows an example of the zoom pan panel 344.

  The zoom pan panel 344 includes a shift area 346, a magnification change button 348, and a reset button 350.

  The shift area 346 is an area for displaying the display area and the non-display area when the display area is shifted.

  The display magnification change button 348 is a button for zooming the display area. FIG. 33 shows what is shown as “200” selected when zooming to 2 × and what is shown as “150” selected when zooming to 1.5 ×. Also, FIG. 33 shows what is shown as “100” selected when displaying at the same magnification and what is shown as “75” selected when reducing to 75%.

  The reset button 350 is selected when restoring the display area shift and zoom.

  The user depresses the mouse button in the shift area 346 and drags the display area to shift the table area.

  In the shift area, the change contents of the display area are updated in real time. Therefore, the user can intuitively change the display area.

  FIG. 34 shows an example of the image thumbnail button.

  In the image thumbnail button, the change contents of the display area are updated in real time as in the shift area 346.

  FIG. 35 shows an example of an image displayed on the display unit 112.

  FIG. 35 shows a screen that is displayed when a line segment is written in the page together with an operation for zooming the display. The user can quickly perform necessary writing while changing the display area to a desired magnification and position.

  FIG. 36 shows an example of an image displayed on the display unit 112.

  FIG. 36 shows a screen displayed when the display area is changed after changing the display on the second page. The page list panel displays information on the display areas of pages 1, 2, 3, and 4. For this reason, the display state of the first page can be confirmed while the second page is being displayed. Furthermore, when the displayed screen is switched, the displayed area can be grasped in advance.

  FIG. 37 shows an example of an image displayed on the display unit 112.

  This screen is displayed when the display area is switched to the first page after the display area is switched to the second page.

  The user can confirm the display state of the page to be switched in advance before switching the page. For this reason, it is possible to continue the discussion quickly without being confused without knowing where is displayed immediately after switching.

  According to an embodiment of the image processing system, it is possible to display a list of reduced images for list that are candidates for display and editing. Furthermore, the display and editing target can be selected from the list-displayed reduced image.

  In addition, when changing the display area by enlarging or reducing the display image and displaying the enlarged image, the non-display area is determined based on the display area and the non-display area information is superimposed on the list reduced image. Can be displayed on the image thumbnail button. By displaying on the image thumbnail button an image obtained by superimposing non-display area information on the list reduced image, the display state of the display image can be grasped.

  Further, a blank paper image can be generated, and a line segment can be written and stored in the blank paper image. For this reason, for example, a free discussion memo can be written on a blank image and stored.

  Although the present invention has been described with reference to particular embodiments, each embodiment is merely illustrative, and those skilled in the art will appreciate various variations, modifications, alternatives, substitutions, and the like. . For convenience of explanation, an apparatus according to an embodiment of the present invention has been described using a functional block diagram, but such an apparatus may be implemented in hardware, software, or a combination thereof. The present invention is not limited to the above-described embodiments, and various variations, modifications, alternatives, substitutions, and the like are included without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 100 Image processing system 110 Image processing apparatus 112 Display part 130a, 130b PC
124, 126 cable

JP-A-11-306369

Claims (10)

A display area instruction section for instructing a display area of a first display image to be displayed on the display section;
A list image generation unit that generates a second display image to be displayed as a list on the display unit,
An image processing apparatus that displays a list of second display images generated by the list image generation unit on a list image display unit,
The list image generation unit, when a display area is instructed by the display area instruction unit, of the first display image, an image displayed in a display area instructed by the display area instruction unit, An image processing apparatus that generates the second display image by superimposing an image included in a non-display area other than the display area.   The list image generation unit reduces an image obtained by reducing an image obtained by superimposing an image displayed in the display area and an image included in a non-display area other than the display area, out of the first display images. The image processing apparatus according to claim 1, wherein the second display image is generated. A line segment writing unit for writing a line segment;
A superimposing unit that superimposes the first display image and the line segment written by the line segment writing unit;
The image processing apparatus according to claim 1, wherein the image display unit displays an image in which the first display image and the line segment are superimposed by the superimposing unit. An image generation unit for generating a third image;
The superimposing unit superimposes the third image and the line segment written by the line segment writing unit,
The image processing apparatus according to claim 1, wherein the image display unit displays an image in which the third image and the line segment are superimposed by the superimposing unit. An image reading unit for reading data of the first display image;
5. The image processing apparatus according to claim 1, wherein the display area instruction unit instructs a display area of the first display image read by the image reading unit. 6.   The image processing apparatus according to claim 1, wherein the display area instruction unit instructs the display area based on a display magnification of the first display image.   The image processing apparatus according to claim 1, wherein the display area instruction unit instructs the display area based on an area surrounded by the first display image. A display area instruction unit for instructing a display area of a first display image to be displayed on the display device;
A list image generation unit that generates a second display image to be displayed as a list on the display device;
An image processing system for displaying a list of second display images generated by the list image generation unit on a list image display unit,
The list image generation unit, when a display area is instructed by the display area instruction unit, of the first display image, an image displayed in a display area instructed by the display area instruction unit, An image processing system for generating the second display image by superimposing an image included in a non-display area other than the display area. The display area of the first display image to be displayed on the display unit is instructed,
Of the first display image, a second display image displayed in a list on the display unit by superimposing an image displayed in the display area and an image included in a non-display area other than the display area. Generate
An image processing method in an image processing apparatus, wherein the second display image is displayed in a list on a list image display unit. By computer
Instruct the display area of the first display image to be displayed on the display unit,
Of the first display image, a second display image displayed in a list on the display unit by superimposing an image displayed in the display area and an image included in a non-display area other than the display area. Generated,
A program for executing a process of displaying a list of the second display image on a list image display unit.