JP6793779B2 - Image processing device and image processing method - Google Patents

Description

The present invention relates to an image processing apparatus and an image processing method including a processing unit that performs a process of displaying an image on a display screen.

In recent years, in an image processing device provided with a large-sized display screen such as a tablet terminal, a personal computer, or a whiteboard, an operation can be performed by directly touching the display screen with a touch pen or a finger. For example, a device capable of switching an image to be displayed as if the image being displayed is slid in the direction of the operation by performing a slide operation to the right or left on the display screen on which the image is displayed. It is disclosed (see Patent Document 1).

Japanese Unexamined Patent Publication No. 2011-221827

However, in the conventional device, although the image displayed on the display screen can be switched, it is not considered that the user freely writes characters or figures on the displayed image.

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image processing apparatus and an image processing method capable of writing a handwritten image on an image displayed on a display screen.

The image processing device according to the present invention is an image processing device that displays an image on a display screen, and is a control unit that superimposes and displays a handwritten image input on a transparent board on a background image displayed on the display screen. If the provided background image and a judging section that judges whether an image of a given application, the control unit, the determination unit, wherein the background image is determined to Ru image der the given application If the to show through the transparent board superimposed on the background image, the determination unit, when the background image is determined not in the image of the predetermined application, the superimposed on the background image the transparent board Is not displayed transparently.

In the image processing apparatus according to the present invention, when the control unit determines that the background image does not include an image of a predetermined application at the start of handwriting input, the control unit determines the background image to have a specific color or pattern. Image or prepared image.

In the image processing apparatus according to the present invention, the image displayed on the display screen is captured as a captured image when a predetermined operation is accepted, and the captured image is used to indicate whether or not to use the captured image. A first setting unit for setting a flag is provided, and the control unit determines that the background image includes an image of a predetermined application, and the first setting unit sets a captured image use flag. If not, the transparent board superimposed on the background image is transparently displayed.

The image processing apparatus according to the present invention includes a second setting unit that sets a captured flag indicating whether or not the image displayed on the display screen has been captured, and the control unit captures the image displayed on the first setting unit. When the completed image use flag is set and the captured flag is set in the second setting unit, the background image is changed to the captured image of the predetermined application.

In the image processing device according to the present invention, when the control unit sets the captured image use flag in the first setting unit and the captured image flag is not set in the second setting unit, the control unit superimposes the captured image on the background image. The transparent board is transparently displayed.

The image processing method according to the present invention is an image processing method for displaying an image on a display screen, wherein a handwritten image input to a transparent board is superimposed and displayed on a background image displayed on the display screen. background image is equal to or an image of a given application, if the background image is determined to Ru image der the given application, show through the transparent board which is superimposed on the background image However , when it is determined that the background image is not an image of a predetermined application, the transparent board superimposed on the background image is not transparently displayed.

According to the present invention, a handwritten image can be written on the image displayed on the display screen.

It is a block diagram which shows an example of the structure of the image processing apparatus of 1st Embodiment. It is a schematic diagram which shows the 1st Example of the display screen of the image processing apparatus of 1st Embodiment. It is a schematic diagram which shows the 2nd Example of the display screen of the image processing apparatus of 1st Embodiment. It is explanatory drawing which shows an example of the transparent board management data used by the image processing apparatus of 1st Embodiment. It is a schematic diagram which shows an example of the presentation image of 1st Embodiment. It is a schematic diagram which shows the state which the transparent board image was drawn with respect to the presentation image of 1st Embodiment. It is a schematic diagram which shows the 1st Example of the operation of the image processing apparatus of 1st Embodiment. It is a schematic diagram which shows the 2nd Embodiment of the operation of the image processing apparatus of 1st Embodiment. It is a schematic diagram which shows the 3rd Example of the operation of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the processing procedure of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the control processing of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the presentation start processing of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the page change processing of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the page change processing of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the thumbnail display processing of the image processing apparatus of 1st Embodiment. It is a flowchart which shows an example of the procedure of the setting change processing of the image processing apparatus of 1st Embodiment. It is explanatory drawing which shows an example of the transparent board management data used by the image processing apparatus of 2nd Embodiment. It is a schematic diagram which shows an example of the background image of 2nd Embodiment. It is a schematic diagram which shows the state which the transparent board image was drawn with respect to the background image of 2nd Embodiment. It is a schematic diagram which shows the 4th Example of the operation of the image processing apparatus of 2nd Embodiment. It is a schematic diagram which shows the 5th Example of the operation of the image processing apparatus of 2nd Embodiment. It is a schematic diagram which shows the sixth embodiment of the operation of the image processing apparatus of 2nd Embodiment. It is a flowchart which shows an example of the processing procedure of the image processing apparatus of 2nd Embodiment. It is a flowchart which shows an example of the procedure of the control processing of the image processing apparatus of 2nd Embodiment. It is a flowchart which shows an example of the procedure of page change processing of the image processing apparatus of 2nd Embodiment. It is a flowchart which shows an example of the procedure of page change processing of the image processing apparatus of 2nd Embodiment. It is a flowchart which shows an example of the procedure of the setting change processing of the image processing apparatus of 2nd Embodiment.

(First Embodiment)
Hereinafter, the present invention will be described with reference to the drawings showing the embodiments. FIG. 1 is a block diagram showing an example of the configuration of the image processing device 100 of the first embodiment. The image processing device 100 may be, for example, a display device having a display screen having a relatively large display panel (display screen) such as a whiteboard, or an information processing device having a display screen such as a tablet terminal or a personal computer. Good.

As shown in FIG. 1, the image processing device 100 includes a control unit 11, a drawing unit 12, an image processing unit 13, a display screen 14, a reduced image generation unit 15, a storage unit 16, and the like that control the entire device. Further, the display screen 14 includes a display panel unit 141, a touch panel unit 142, and the like. The touch panel unit is also referred to as a touch screen unit. Further, the storage unit 16 stores transparent board management data 161, transparent board image data 162, presentation image data 163, and the like.

The control unit 11 is, for example, a microprocessor, an FPGA (Field Programmable Gate Array) that can be programmed, an ASIC (Application Specific Integrated Circuit) designed and manufactured for a specific application, and a circuit having other arithmetic functions. And so on. Further, a control program for controlling the operation of the control unit 11 is stored in a ROM or the like (not shown). The control program includes a transparent board application described later.

The display panel unit 141 is composed of a display device such as a liquid crystal panel, and can display an image (including a moving image) processed by the image processing unit 13.

The touch panel unit 142 is composed of, for example, one-point or multi-point touch panel devices, and is arranged so as to be overlapped on the surface side of the display panel unit 141. The touch panel unit 142 is also referred to as a transparent board. That is, the user can view the image of the display panel unit 141 arranged on the back side of the touch panel unit 142 through the transparent touch panel unit 142. When the user performs a touch operation with a pen, a finger, or the like, the touch panel unit 142 can acquire position information indicating the position on the display screen 14 on which the touch operation has been performed.

Further, the touch panel unit 142 can detect a swipe operation, a flick operation, and the like. Further, when two or more separated parts are pressed, the touch panel unit 142 can also acquire the position information of each part, and can detect the so-called multi-touch operation. Further, the touch panel unit 142 outputs the acquired position information to the control unit 11.

The drawing unit 12 draws a handwritten image on the display screen 14 based on the position when the touch pen or the finger touches the display screen 14. For example, when the touch panel unit 142 detects a touch (touch) of a touch pen or a finger, a point of a required size is drawn at the detected position, and when the touch position changes, the locus (stroke) of the detected position is drawn. Draw a line along. As a result, a handwritten image can be written on the image displayed on the display screen 14.

FIG. 2 is a schematic view showing a first embodiment of the display screen 14 of the image processing device 100 of the first embodiment, and FIG. 3 is a second embodiment of the display screen 14 of the image processing device 100 of the first embodiment. It is a schematic diagram which shows. The drawing unit 12 displays a drawing area for drawing a handwritten image such as a character or a figure in the same area as the display area of the display screen 14. Further, the drawing unit 12 displays an operation unit that accepts operations such as opening and saving a file, and an icon that accepts operations such as page forward, page return, and thumbnail display. The drawing area is transparent so that the image displayed on the display panel unit 141 arranged on the back side of the touch panel unit 142 can be seen through.

When the thumbnail display icon shown in FIG. 2 is operated, the display screen 14 shifts to the display mode illustrated in FIG. As shown in FIG. 3, a thumbnail display area appears below the drawing area, and all or part of the thumbnail image pages are displayed. When some pages of the thumbnail image are displayed in the thumbnail display area, the page forward or page back icon is displayed, and the desired thumbnail image is displayed by operating the page forward or page back icon. be able to. The page forward or page return icon, or the icon for shifting to an arbitrary page has a function as a transition reception unit.

Note that FIGS. 2 and 3 are examples, and the display mode of the display screen 14 is not limited to the examples of FIGS. 2 and 3. For example, the operation unit does not need to be displayed at all times, and the position or number of the operation unit is not limited to the examples of FIGS. 2 and 3. Further, instead of displaying the page feed or page return icon, the operation of sliding the touch pen or finger laterally (leftward and rightward) on the display screen 14 is defined as the page feed and page return operations. You can also.

The drawing unit 12 and the control unit 11 are also referred to as a transparent board application.

The image processing unit 13 has a function as a processing unit that performs a process of displaying an image on the display screen 14. The image processing unit 13 is also referred to as an application. The image processing unit 13 is compatible with applications such as Word and PowerPoint, and can switch and display images in page units according to the data format. In the first embodiment, the image processing unit 13 controls each of activation, file opening, page switching, and termination according to the instruction of the drawing unit 12 or the control unit 11.

When the image processing unit 13 displays an image on the display screen 14 and the drawing unit 12 draws a handwritten image, the control unit 11 is displayed on the display screen 14 at the same time as the handwritten image and the handwritten image. It is controlled to associate the images and store them in the storage unit 16. In this case, the image data handled by the image processing unit 13 is stored in the presentation image data 163. Further, the handwritten image drawn by the drawing unit 12 is stored in the transparent board image data 162.

For example, when an image (for example, an image displayed when a desired application is executed, an image of an arbitrary page when a file composed of a plurality of pages is opened, etc.) is displayed on the display screen 14, the relevant image is displayed. When a handwritten image composed of characters such as comments and memos or a figure is drawn on the image, the image simultaneously displayed on the display screen 14 and the handwritten image are stored in association with each other. Associating includes, for example, grouping as the same file or grouping as the same page. The timing of storing in the storage unit 16 can be when a predetermined operation is performed. The predetermined operation will be described later.

As a result, when handwritten input is performed on the image displayed on the display screen 14, the image and the handwritten image can be associated and stored, so that the user does not need to make a note on paper or the like, which improves convenience. To do.

Next, the transparent board management data 161 used in the first embodiment will be described. FIG. 4 is an explanatory diagram showing an example of the transparent board management data 161 used by the image processing apparatus 100 of the first embodiment. As shown in FIG. 4, the “display page” indicated by the reference numeral P indicates the page currently displayed on the display screen 14. The “number of pages” indicated by reference numeral N indicates the number of pages of the captured image. Here, the image means a presentation image and / or a transparent board image.

The "presentation image data" represented by the reference numeral D (n) indicates the presentation image data on the nth page, and indicates the image data processed by the image processing unit 13 and displayed on the display screen 14 and the storage location of the image data. .. Note that n is an integer. The “transparent board image data” indicated by the reference numeral M (n) indicates the transparent board image data on the nth page, and indicates the storage location of the handwritten image data and the handwritten image data of the handwritten image drawn by the drawing unit 12. ..

The "captured flag" indicated by the reference numeral C (n) is a flag indicating whether or not the image on the nth page has been captured. For example, when the flag is 1 (true), it has been captured. If there is, and the flag is 0 (false), it can be considered uncaptured.

The “captured image use flag” indicated by the reference numeral U (n) is a flag indicating whether or not to use the captured image on the nth page. For example, when the flag is 1 (true), it is captured. If the flag is 0 (false), it can be said that the captured image is not used.

The "use flag initial value" indicated by the symbol IU is the initial value of the captured image use flag set for the new page when the page is newly created. For example, when the IU is 1 (true), the value is set. It is possible to use the captured image and not use the captured image when the IU is 0 (false).

Further, the "presentation image overwrite flag" indicated by the code EW is a flag indicating whether or not the overwriting of the presentation image is effective at the time of page update. For example, when the flag is 1 (true), the overwriting is performed. If it is valid and the flag is 0 (false), then overwriting can be considered invalid.

FIG. 5 is a schematic view showing an example of the presentation image of the first embodiment. The presentation image is an image handled by an application such as Word or PowerPoint, and as shown in FIG. 5, the image can be specified on a page-by-page basis. That is, the presentation image is also an image handled by the image processing unit 13. In the example of FIG. 5, the presentation image on page 4 is illustrated, and for convenience, the presentation image on page 1 is indicated by sign A, the presentation image on page 2 is indicated by code B, and the presentation image on page 3 is indicated by code C. The presentation image on the 4th page is indicated by the sign D. The number of pages is not limited to 4. Hereinafter, the images on pages 1 to 4 are also referred to as presentation image A, presentation image B, presentation image C, and presentation image D.

In the case of the example of FIG. 5, the image data of the presentation image A is also represented as D (1) and is stored in the area D (1). The image data of the presentation image B is also represented as D (2) and is stored in the area D (2). The image data of the presentation image C is also represented as D (3) and is stored in the area D (3). The image data of the presentation image D is also represented as D (4) and is stored in the area D (4).

FIG. 6 is a schematic view showing a state in which a transparent board image is drawn with respect to the presentation image of the first embodiment. The transparent board image is also called a handwritten image. In FIG. 6, for convenience, the transparent board image is represented by an arrow indicated by reference numeral a. Hereinafter, it is also referred to as a transparent board image a. FIG. 6 shows a state in which handwritten input is made to the presentation image A on the first page displayed on the display screen 14 and the transparent board image a on the first page is drawn. Since the transparent board image a is the image on the first page, the image data of the transparent board image a is also represented as M (1) and is stored in the area M (1).

Next, the operation by the image processing apparatus 100 of the first embodiment will be described. FIG. 7 is a schematic view showing a first embodiment of the operation of the image processing device 100 of the first embodiment. The figure illustrated on the left side in FIG. 7 is the same as that in FIG. 6, and handwriting input is performed with the presentation image A on the first page displayed on the display screen 14, and the transparent board image a on the first page is displayed. Indicates the drawn state.

In this state, when, for example, a page feed operation is performed as a predetermined operation, as shown in the figure on the right side, the presentation image B on the second page is displayed and the transparent board on the second page is displayed. It is set. The transparent board on the second page is a page in which the transparent board image (handwritten image) is not drawn at all and can be newly handwritten.

Further, as shown in the lower figure of FIG. 7, when the page feed operation is performed, the presentation image A on the first page is captured, and the presentation image A on the first page and the transparent board image on the first page are captured. It is stored (stored) in the presentation image data area D (1) and the transparent board image data M (1) of the storage unit 16 in association with a.

In the first embodiment, the control unit 11 controls the handwritten image (transparent board image) drawn by the drawing unit 12 on the display screen 14 so as to store a plurality of pages of handwritten images on a page-by-page basis. For example, when the application is started and images (presentation images) of a plurality of pages are displayed in order on the display screen 14 (when a presentation image is displayed), the drawing unit 12 draws a handwritten image in page units. By doing so, for example, the image page and the handwritten image page are synchronized, the handwritten image of the first page is associated with the image of the first page, and similarly, the image of the n (n is an integer) page is linked. Can associate a handwritten image on page n. As a result, a different handwritten image can be associated with each page of the image of a plurality of pages, and a handwritten image of a plurality of pages can be recorded.

Further, in the first embodiment, the transparent board image of an arbitrary page (1 page in the example of FIG. 7) is displayed on the display screen 14 for the icon (transition reception unit) such as page forward or page return. If so, the operation of shifting to a page different from the arbitrary page (page 2 in the example of FIG. 7) is accepted. When the control unit 11 receives the operation, the control unit 11 stores the transparent board image of an arbitrary page as the arbitrary page (the first page in the example of FIG. 7).

For example, it is assumed that a transparent board image is drawn when the presentation image on the display screen 14 (for example, the presentation image on the first page) is displayed. The transparent board image is associated with, for example, the presentation image on the first page and becomes the transparent board image on the first page. In this state, when the operation of shifting to a page different from the first page (for example, the second page) is accepted, the control unit 11 displays the transparent board image of the arbitrary page (first page) for the arbitrary page (for example, the second page). Store as (1 page).

That is, simply by drawing a transparent board image on the presentation image displayed on the display screen 14 and performing an operation of moving to another page, the transparent board image displayed at the same time as the presentation image before the operation is performed. (Handwritten image on the first page) can be automatically recorded.

Assuming that the transparent board supports only one page of the handwritten image, after drawing the handwritten image on the image displayed on the display screen, the displayed image is displayed on another page. When switching, before switching the image, perform the operation of temporarily storing the handwritten image input on the transparent board together with the image before switching, and then clearing (erasing) the handwritten image displayed on the transparent board. It is necessary and the operation is complicated.

However, according to the present embodiment, since the transparent board corresponds to the handwritten image for a plurality of pages, it is displayed on the display screen 14 at the same time as the presentation image only by performing the operation of moving to another page. The transparent board image can be automatically recorded, and the operability can be improved.

Further, in the first embodiment, when the drawing unit 12 accepts an operation such as page feed or page return, the transparent board image displayed on the display screen 14 is deleted from the display screen 14. That is, according to the first embodiment, since the transparent board corresponds to the handwritten image for a plurality of pages, the operation of clearing (erasing) the displayed transparent board image before moving to another page can be performed. It is no longer necessary and you can automatically record the transparent board image 14 displayed on the display screen and prepare a new (separate) page for the transparent board image just by moving to another page. it can.

The “presentation image overwrite flag” indicated by the above-mentioned reference numeral EW has a function as a setting unit. That is, the "presentation image overwrite flag" stores the presentation image displayed on the display screen 14 at the same time as the transparent board image of an arbitrary page as the arbitrary page when an operation such as page feed or page return is accepted. Set whether or not. For example, when the "presentation image overwrite flag" is set to 1 (when it is set to memorize the presentation image), it is displayed on the display screen 14 at the same time just by performing the operation of moving to another page. The presentation image and the transparent board image can be associated with each other as the same page and automatically recorded, and the operability can be improved.

FIG. 8 is a schematic view showing a second embodiment of the operation of the image processing device 100 of the first embodiment. FIG. 8 schematically shows a state when the page turning operation illustrated in FIG. 7 is performed a plurality of times (three times in the example of FIG. 8).

First, as in FIG. 7, it is assumed that the handwritten input is performed while the presentation image A on the first page is displayed and the transparent board image a is drawn. When the page feed operation is performed next to the page (second page) in this state, the presentation image B on the second page is displayed on the display screen 14, and the transparent board on the second page is set. By the page feed operation, the presentation image A on the first page and the transparent board image a are saved in association with each other. Associating means, for example, treating the presentation image A as the image of layer 1, the transparent board image a as the image of layer 2, and the layers 1 and 2 as one image.

Next, it is assumed that the handwriting input is performed while the presentation image B on the second page is displayed, and the transparent board image b is drawn. When the page feed operation is performed next to the page (third page) in this state, the presentation image C on the third page is displayed on the display screen 14, and the transparent board on the third page is set. By the page feed operation, the presentation image B on the second page and the transparent board image b are saved in association with each other.

Next, it is assumed that the handwriting input is performed while the presentation image C on the third page is displayed, and the transparent board image c is drawn. When the page feed operation is performed next to the page (fourth page) in this state, the presentation image D on the fourth page is displayed on the display screen 14, and the transparent board on the fourth page is set. By the page feed operation, the presentation image C on the third page and the transparent board image c are saved in association with each other.

As described above, in the first embodiment, the control unit 11 is optional when the "presentation image overwrite flag" is set to 1 when an operation such as page feed or page return is accepted. The transparent board image of the page and the presentation image displayed on the display screen 14 at the same time as the transparent board image are associated and stored as the arbitrary page.

Assuming that the transparent board supports only one page of the handwritten image, after drawing the handwritten image on the image displayed on the display screen, the displayed image is displayed on another page. When switching, before switching the image, perform the operation of temporarily storing the handwritten image input on the transparent board together with the image before switching, and then clearing (erasing) the handwritten image displayed on the transparent board. It is necessary and the operation is complicated.

However, according to the first embodiment, since the transparent board corresponds to the transparent board images for a plurality of pages, the presentation image simultaneously displayed on the display screen 14 only by performing the operation of moving to another page. And the transparent board image can be associated with each other as the same page and automatically recorded, and the operability can be improved.

Further, in the first embodiment, the image processing unit 13 displays the presentation image on the display screen 14 in page units. Then, when an operation such as page feed or page return is accepted, the presentation image of an arbitrary page is switched to the presentation image of a different page and displayed on the display screen 14. For example, suppose that the transparent board image is drawn when the application is started and the presentation image of the first page is displayed on the display screen 14. The transparent board image is associated with the presentation image on the first page and becomes the transparent board image on the first page. In this state, when the operation of shifting to a page different from the first page (for example, the second page) is accepted, the presentation image handled by the application is also switched from the first page to the second page. As a result, the page of the presentation image and the page of the transparent board image can be switched in synchronization by simply performing the page transition operation.

Next, an operation example by combining the captured flag C (n) and the captured image use flag U (n) will be described.

FIG. 9 is a schematic view showing a third embodiment of the operation of the image processing device 100 of the first embodiment. As shown in FIG. 9, it is assumed that the captured flag C (1) on the first page is 1, and the captured image use flag U (1) is 1. The presentation image on the first page is the presentation image F, and the transparent board image is the left upward arrow. As the image displayed on the display screen 14, the presentation image F and the transparent board image of the left upward arrow are displayed at the same time. Further, since the captured flag C (1) is 1, the image data of the presentation image F is stored in the presentation image data D (1). Since the captured image use flag U (1) is 1, the captured image is set to be used, and the presentation image F and the transparent board image of the left upward arrow are stored in association with each other. , The saved image is reduced and displayed as a thumbnail image described later.

Further, it is assumed that the captured flag C (2) on the second page is 1, and the captured image use flag U (2) is 0. The presentation image on the second page is the presentation image G, and the transparent board image is the left downward arrow. As the image displayed on the display screen 14, the presentation image G and the transparent board image of the left downward arrow are displayed at the same time. Further, since the captured flag C (2) is 1, the image data of the presentation image G is stored in the presentation image data D (2). However, since the captured image use flag U (2) is 0, the captured image is not used, and the presentation image G is not saved in association with the transparent board image of the downward arrow on the left side. For example, a transparent image is used instead of the presentation image G. Therefore, the presentation image G does not appear in the thumbnail image, and only the transparent board image of the left downward arrow is displayed.

Further, it is assumed that the captured flag C (3) on the third page is 0 and the captured image use flag U (3) is 1. The presentation image on the third page is the presentation image H, and the transparent board image is the right upward arrow. In the image displayed on the display screen 14, the presentation image H and the transparent board image of the right upward arrow are displayed at the same time. Further, since the captured flag C (3) is 0, the presentation image H is not captured, and the presentation image data D (3) is blank. The captured image use flag U (3) is 1, and it is set to use the captured image, but since the presentation image H is set not to be captured, the presentation image H is transparent with the upward arrow on the right side. It is not saved in association with the board image, and instead of the presentation image H, for example, a transparent image is used. Therefore, the presentation image H does not appear in the thumbnail image, and only the transparent board image of the right upward arrow is displayed.

The reduced image generation unit 15 has a function as a reduced unit, and one or a plurality of transparent board images and a plurality of pages of transparent board images and presentation images stored in association with the storage unit 16 are displayed on the display screen 14. Reduced to page size (also called thumbnail image). The mode displayed on the display screen 14 means the same state as the state displayed on the display screen 14.

The control unit 11 has a function as a reduced image display unit, and displays all or a part of the reduced image reduced by the reduced image generation unit 15 (for example, as illustrated in FIG. 3). As a result, it is possible to see a list of reduced images in which the presentation image being displayed and the transparent board image are simultaneously displayed when handwritten input is performed, and the required image can be easily accessed.

Further, the thumbnail display area on which the thumbnail image is displayed has a function as a selection reception unit, and accepts an operation of selecting one thumbnail image from the thumbnail images of a plurality of pages displayed on the display screen 14.

Then, the control unit 11 has a function as a display control unit, and when one thumbnail image is selected, the transparent board image and the presentation image corresponding to the selected thumbnail image are displayed on the display screen 14. Control to display again. As a result, the user can display the transparent board image and the presentation image that was displayed at the same time when the transparent board image was drawn in the original display mode simply by selecting the thumbnail image.

FIG. 10 is a flowchart showing an example of the processing procedure of the image processing apparatus 100 of the first embodiment. Hereinafter, for the sake of simplicity, the subject of processing will be described as the control unit 11. The control unit 11 sets the display page P to 0, the number of pages N to 0, and the presentation image overwrite flag EW to 1 (S11). The control unit 11 determines the presence / absence of the control process (S12), if there is a control process (YES in S12), executes the control process (S13), and if there is no control process (NO in S12), in step S13. The process of step S14 described later is performed without performing the process. The details of the control process will be described later.

The control unit 11 determines whether or not the display page P> 0 (S14), and if the display page P> 0 is not (NO in S14), changes the background of the transparent board from transparent to white (S15). The processing after step S12 is performed. If the display page P> 0 is not set, the presentation image file is not opened, and the entire drawing area is displayed in white. In this case, the handwriting input to the display screen 14 can be invalidated. The configuration is not limited to displaying the entire drawing area in white, and other colors, patterns, or images prepared in advance may be displayed.

When the display page P> 0 (YES in S14), the control unit 11 determines whether or not the captured image use flag U (P) = 1 (S16), and the captured image use flag U (P). ) = 1 (YES in S16), it is determined whether or not the captured flag C (P) = 1 (S17).

When the captured flag C (P) = 1 (YES in S17), the control unit 11 changes the background of the transparent board to the presentation image data D (P) (S18). That is, in the setting to use the captured presentation image, the background of the transparent board is changed to the captured presentation image only when it has been captured.

On the other hand, when the captured image use flag U (P) is not 1 (NO in S16) or the captured flag C (P) is not 1 (NO in S17), the control unit 11 makes the background of the transparent board transparent. (S19). By making the background transparent, you can see the presentation image displayed by the application behind it.

The control unit 11 adds the transparent board image data such as characters and figures written by touch operation or the like to the transparent board image data M (P) (S20), and continues the processing after step S12.

FIG. 11 is a flowchart showing an example of the procedure of the control processing of the image processing apparatus 100 of the first embodiment. The process illustrated in FIG. 11 specifically represents the process in step S13 of FIG. The control unit 11 determines whether or not the presentation start operation has been performed (S31), and if the presentation start operation is performed (YES in S31), performs the presentation start process (S32). When the presentation start operation has not been performed (NO in S31), it is determined whether or not the page change operation has been performed without performing the process of step S32 (S33).

When the page change operation is performed (YES in S33), the control unit 11 executes the page change process (S34). When the page change operation has not been performed (NO in S33), the control unit 11 determines whether or not the thumbnail display operation has been performed without performing the process of step S34 (S35).

When the thumbnail display operation is performed (YES in S35), the control unit 11 executes the thumbnail display process (S36). When the thumbnail display operation has not been performed (NO in S35), the control unit 11 determines whether or not the setting change operation has been performed without performing the process of step S36 (S37).

When the setting change operation is performed (YES in S37), the control unit 11 executes the setting change process (S38). When the setting change operation has not been performed (NO in S37), the control unit 11 determines whether or not to end the process without performing the process in step S36 (S39). When the process is not completed (NO in S39), the control unit 11 ends the control process, and when the process ends (YES in S39), the control unit 11 ends the process of FIG.

FIG. 12 is a flowchart showing an example of the procedure of the presentation start processing of the image processing apparatus 100 of the first embodiment. The process illustrated in FIG. 12 specifically represents the process in step S32 of FIG. The control unit 11 instructs the application (application) to read the presentation file specified by the user (S41). Here, the presentation file is a file handled by the application such as a Word file and a PowerPoint file. The application is not limited to Word or PowerPoint.

The control unit 11 determines whether or not the application has read the presentation file normally (S42), and if it reads normally (YES in S42), sets the display page P = 1 and the number of pages N = 1 (S43). ), Ends the presentation start process. If the reading is not performed normally (NO in S42), the control unit 11 displays an error (S44) and ends the presentation start process.

13 and 14 are flowcharts showing an example of the procedure of page change processing of the image processing apparatus 100 of the first embodiment. The processes exemplified in FIGS. 13 and 14 specifically represent the processes in step S34 of FIG. The control unit 11 determines whether or not the page to be changed is different from the display page P (S51), and when the page to be changed is different from the display page P (YES in S51), the captured flag C (P) = 1. It is determined whether or not there is (S52).

When the captured flag C (P) is not 1 (NO in S52), the control unit 11 determines whether or not the captured image use flag U (P) = 1 (S53). When the captured image use flag U (P) = 1 (YES in S53), that is, in the case of setting to use the captured presentation image without capturing, the control unit 11 captures the presentation image displayed by the application. Then, the captured presentation image data is saved as the presentation image data D (P) (S54), the captured flag C (P) is set to 1 (S55), and the process of step S56 described later is performed.

When the captured flag C (P) = 1 (YES in S52) or when the captured image use flag U (P) = 1 is not (NO in S53), the control unit 11 changes the page for the application. Instruct to switch to (S56).

The control unit 11 determines whether or not the application has completed the page change normally (S57), and if the page change is completed normally (YES in S57), sets the display page P to the page to be changed (S58). ). The control unit 11 determines whether or not the display page P> the number of pages N (S59), and when the display page P> the number of pages N (YES in S59), that is, when the changed page is a new page. , The number of pages N = N + 1 (S60).

For the new page, the control unit 11 sets the captured image use flag U (P) to the use flag initial value IU (S61), sets the captured flag C (P) = 0 (S62), and sets the page. End the change process.

When the page to be changed is the display page P (NO in S51), when the application has not completed the page change normally (NO in S57), or when the display page P> the number of pages N is not (NO in S59). The control unit 11 ends the page change process.

FIG. 15 is a flowchart showing an example of a procedure for thumbnail display processing of the image processing device 100 of the first embodiment. The process illustrated in FIG. 15 specifically represents the process in step S36 of FIG. The control unit 11 reads out the presentation image data and the transparent board image data saved in the page unit (S71), and generates a thumbnail image in the page unit based on the read presentation image data and the transparent board image data (S72). The control unit 11 displays the generated thumbnail image (S73), and ends the thumbnail display process.

FIG. 16 is a flowchart showing an example of a procedure for changing the settings of the image processing apparatus 100 of the first embodiment. The process illustrated in FIG. 16 specifically represents the process in step S38 of FIG. The control unit 11 determines whether or not the management data to be changed is the captured image use flag U (P) (S81), and if it is not the captured image use flag U (P) (NO in S81), sets it. End the change process.

When the management data to be changed is the captured image use flag U (P) (YES in S81), the control unit 11 sets the captured image use flag U (P) to a value to be changed (S82).

The control unit 11 determines whether or not the changed captured image use flag U (P) = 1 (S83), and when the changed captured image use flag U (P) = 1 (YES in S83). ), The presentation image displayed by the application is captured, and the captured presentation image data is saved as the presentation image data D (P) (S84). Here, since the captured presentation image has been changed from the "not used" setting to the "used" setting, the capture is performed.

The control unit 11 sets the captured flag C (P) = 1 (S85), and ends the setting change process. If the changed captured image use flag U (P) is not 1 (NO in S83), the control unit 11 sets the captured flag C (P) = 0 (S86), and ends the setting change process.

(Second Embodiment)
In the first embodiment described above, a presentation image having the concept of a page was targeted. In the second embodiment, an image having no concept of a page (for example, a moving image or an image of the application itself) is targeted. That is, in the second embodiment, a case where an image that cannot be managed on a page-by-page basis is handled will be described. In the following, the term “background image” will be used instead of the presentation image to distinguish it from the first embodiment. In the second embodiment, the background image displayed under the transparent board (rear surface) and the page of the transparent board image are not synchronized. Hereinafter, the differences from the first embodiment will be described.

FIG. 17 is an explanatory diagram showing an example of transparent board management data 161 used by the image processing apparatus 100 of the second embodiment. The difference from the transparent board management data illustrated in FIG. 4 is that the background image data B (n) is used instead of the presentation image data D (n), and the background image overwrite flag is used instead of the presentation image overwrite flag. This is the point to use. For convenience, the background image data on the nth page is represented by B (n), but this does not mean that the background image has the concept of the page, but is associated with the transparent board image having the concept of the page. It is the meaning of the page corresponding to the page of the transparent board at the time, and is for associating with the page of the transparent board image.

Further, the image processing device 100 of the second embodiment stores background image data in the storage unit 16 instead of the presentation image data 163 illustrated in FIG.

Further, in the first embodiment, when the page feed operation is performed, the presentation image and the transparent board image are synchronized to move to the next page, but in the second embodiment, the background image is displayed on the page. There is no concept. Therefore, when the page feed operation is performed, the transparent board image moves to the next page, but the background image does not move to the next page in conjunction with the page feed operation. The background image will be displayed on the display screen 14 according to, for example, the application's own processing.

FIG. 18 is a schematic view showing an example of the background image of the second embodiment. When the background image is, for example, a moving image, as shown in FIG. 18, the display screen 14 has a background image 1 and a background image in which numbers (1, 2, 3, 4, ...) Are represented by circled symbols. 2. The background image 3, the background image 4, ... Are displayed in chronological order.

FIG. 19 is a schematic view showing a state in which a transparent board image is drawn with respect to the background image of the second embodiment. In FIG. 19, as in FIG. 6, for convenience, the transparent board image is represented by an arrow indicated by reference numeral a. Hereinafter, it is also referred to as a transparent board image a. FIG. 19 shows a state in which handwriting input is performed on the background image 1 displayed on the display screen 14 and the transparent board image a on the first page is drawn. Since the transparent board image a is the image on the first page, the image data of the transparent board image a is also represented as M (1) and is stored in the area M (1).

FIG. 20 is a schematic view showing a fourth embodiment of the operation of the image processing device 100 of the second embodiment. The figure illustrated on the left side in FIG. 20 is the same as that in FIG. 19, and is a state in which handwriting input is performed with the background image 1 displayed on the display screen 14 and the transparent board image a on the first page is drawn. Is shown.

In this state, as a predetermined operation, for example, when a page feed operation is performed, the transparent board on the second page is set as shown in the figure on the right side. As the background image, the background image originally displayed by the application when the page feed operation is performed is displayed. In the example of FIG. 20, the background image 3 is displayed. That is, the background image is not synchronized with the transparent board page (transparent board image page). The transparent board on the second page is a page in which the transparent board image (handwritten image) is not drawn at all and can be newly handwritten.

Further, as shown in the lower figure of FIG. 20, when the page feed operation is performed, the background image (background image 1 in the example of FIG. 20) displayed on the display screen 14 at that time is captured. The captured background image and the transparent board image a on the first page are associated with each other and stored (stored) in the background image data area B (1) and the transparent board image data M (1) of the storage unit 16, respectively. ..

In the second embodiment, the control unit 11 controls the handwritten image (transparent board image) drawn by the drawing unit 12 on the display screen 14 so as to store a plurality of pages of handwritten images on a page-by-page basis. For example, when the application is started and the background image is displayed on the display screen 14 (for example, when the image of the moving image or the presentation itself is displayed), the drawing unit 12 draws the handwritten image on a page-by-page basis. A plurality of pages of transparent board images can be recorded by associating the transparent board image on the first page with the background image displayed at the same time as the transparent board image.

FIG. 21 is a schematic view showing a fifth embodiment of the operation of the image processing device 100 of the second embodiment. FIG. 21 schematically shows a state in which the page turning operation illustrated in FIG. 20 is performed a plurality of times (three times in the example of FIG. 21).

First, as in FIG. 20, it is assumed that the handwriting input is performed while the background image 1 is displayed and the transparent board image a is drawn. When the page feed operation is performed next to the page (second page) in this state, the background image 3 originally displayed by the application when the page feed operation is performed is displayed on the display screen 14 and at the same time. The transparent board on the second page is set. By the page feed operation, the background image 1 and the transparent board image a are saved in association with each other. Associating means, for example, treating the background image 1 as the image of layer 1, the transparent board image a as the image of layer 2, and the layers 1 and 2 as one image.

Next, it is assumed that handwriting input is performed while the background image 3 is displayed and the transparent board image b is drawn. When the page feed operation is performed next to the page (third page) in this state, the background image 4 independently displayed by the application when the page feed operation is performed is displayed on the display screen 14 and at the same time. The transparent board on the third page is set. By the page feed operation, the background image 3 and the transparent board image b are saved in association with each other.

Next, it is assumed that handwriting input is performed while the background image 4 is displayed and the transparent board image c is drawn. When the page feed operation is performed next to the page (fourth page) in this state, the background image 6 independently displayed by the application when the page feed operation is performed is displayed on the display screen 14 and at the same time. The transparent board on the 4th page is set. By the page feed operation, the background image 4 and the transparent board image c are saved in association with each other.

As described above, in the second embodiment, the control unit 11 is arbitrary when the "background image overwrite flag" is set to 1 when an operation such as page feed or page return is accepted. The transparent board image of the page and the background image displayed on the display screen 14 at the same time as the transparent board image are associated and stored as the arbitrary page.

Assuming that the transparent board supports only one page of the handwritten image, after drawing the handwritten image on the image displayed on the display screen, the displayed image is displayed on another page. When switching, before switching the image, perform the operation of temporarily storing the handwritten image input on the transparent board together with the image before switching, and then clearing (erasing) the handwritten image displayed on the transparent board. It is necessary and the operation is complicated.

However, according to the second embodiment, since the transparent board corresponds to the transparent board images for a plurality of pages, the background image that is simultaneously displayed on the display screen 14 only by performing the operation of moving to another page. And the transparent board image can be associated with each other as the same page and automatically recorded, and the operability can be improved.

FIG. 22 is a schematic view showing a sixth embodiment of the operation of the image processing device 100 of the second embodiment. As shown in FIG. 22, it is assumed that the captured flag C (1) on the first page is 1, and the captured image use flag U (1) is 1. Then, the background image is the background image 1, and the transparent board image is the left upward arrow. As the image displayed on the display screen 14, the background image 1 and the transparent board image of the left upward arrow are displayed at the same time. Further, since the captured flag C (1) is 1, the image data of the background image 1 is stored in the background image data B (1). Since the captured image use flag U (1) is 1, the captured image is set to be used, and the background image 1 and the transparent board image of the left upward arrow are stored in association with each other. , The saved image is reduced and displayed as a thumbnail image.

Further, it is assumed that the captured flag C (2) on the second page is 1, and the captured image use flag U (2) is 0. Since the captured flag C (2) is 1, for example, the background image 3 is captured, and the background image data B (2) stores the image data of the background image 3. On the other hand, as for the image displayed on the display screen 14, the background image 5 different from the background image 3 is displayed by the application processing independently from the time of capture. That is, the background image 5 and the transparent board image of the left downward arrow are displayed on the display screen 14 at the same time. Since the captured image use flag U (2) is 0, the captured image is not used, and the captured background image 3 is saved in association with the transparent board image of the left downward arrow. Instead of the background image 3, for example, a transparent image is used. Therefore, the background image 3 does not appear in the thumbnail image, and only the transparent board image of the left downward arrow is displayed.

Further, it is assumed that the captured flag C (3) on the third page is 0 and the captured image use flag U (3) is 1. Since the captured flag C (3) is 0, the background image is not captured, and the background image data B (3) is blank. On the other hand, as the image displayed on the display screen 14, the background image 7 is displayed by the application's own processing. That is, the background image 7 and the transparent board image of the right upward arrow are simultaneously displayed on the display screen 14. The captured image use flag U (3) is 1, and the captured image is used, but the background image is not captured, so the background image is the transparent board image with the upward arrow on the right side. It is not saved in association with, and instead of the background image, for example, a transparent image is used. Therefore, the background image does not appear in the thumbnail image, and only the transparent board image of the right upward arrow is displayed.

FIG. 23 is a flowchart showing an example of the processing procedure of the image processing apparatus 100 of the second embodiment. Hereinafter, for the sake of simplicity, the subject of processing will be described as the control unit 11. The control unit 11 sets the display page P to 1, the number of pages N to 1, and the background image overwrite flag EW to 1 (S111). Here, the reason why the display page P is set to 1 and the number of pages N is set to 1 is that the background image is displayed by the application's own processing, unlike the case of the first embodiment.

The control unit 11 determines the presence / absence of the control process (S112), if there is a control process (YES in S112), executes the control process (S113), and if there is no control process (NO in S112), in step S113. The process of step S114 described later is performed without performing the process. The details of the control process will be described later.

The control unit 11 determines whether or not the captured image use flag U (P) = 1 (S114), and if the captured image use flag U (P) = 1 (YES in S114), the captured image has been captured. It is determined whether or not the flag C (P) = 1 (S115).

When the captured flag C (P) = 1 (YES in S115), the control unit 11 changes the background of the transparent board to the background image data B (P) (S116). That is, in the setting to use the captured background image, the background of the transparent board is changed to the captured background image only when it has been captured.

On the other hand, when the captured image use flag U (P) = 1 (NO in S114) or the captured flag C (P) = 1 (NO in S115), the control unit 11 makes the background of the transparent board transparent. (S117). By making the background transparent, you can see the background image displayed by the application behind it.

The control unit 11 adds the transparent board image data such as characters and figures written by touch operation or the like to the transparent board image data M (P) (S118), and continues the processing after step S112.

FIG. 24 is a flowchart showing an example of the procedure of the control processing of the image processing apparatus 100 of the second embodiment. The process illustrated in FIG. 24 specifically represents the process in step S113 of FIG. The control unit 11 determines whether or not the page change operation has been performed (S131). When the page change operation is performed (YES in S131), the control unit 11 executes the page change process (S132). When the page change operation is not performed (NO in S131), the control unit 11 determines whether or not the thumbnail display operation is performed without performing the process of step S132 (S133).

When the thumbnail display operation is performed (YES in S133), the control unit 11 executes the thumbnail display process (S134). When the thumbnail display operation has not been performed (NO in S133), the control unit 11 determines whether or not the setting change operation has been performed without performing the process of step S134 (S135).

When the setting change operation is performed (YES in S135), the control unit 11 executes the setting change process (S136). If the setting change operation has not been performed (NO in S135), the control unit 11 determines whether or not to end the process without performing the process in step S136 (S137). When the process is not completed (NO in S137), the control unit 11 ends the control process, and when the process ends (YES in S137), the control unit 11 ends the process of FIG. 23.

25 and 26 are flowcharts showing an example of the procedure of page change processing of the image processing apparatus 100 of the second embodiment. The processes exemplified in FIGS. 25 and 26 specifically represent the processes in step S132 of FIG. 24. The control unit 11 determines whether or not the page to be changed is different from the display page P (S141), and when the page to be changed is different from the display page P (YES in S141), the captured flag C (P) = 1. It is determined whether or not there is (S142).

When the captured flag C (P) is not 1 (NO in S142), the control unit 11 determines whether or not the captured image use flag U (P) = 1 (S143). When the captured image use flag U (P) = 1 (YES in S143), that is, in the case of setting to use the captured background image without capturing, the control unit 11 captures the background image displayed by the application. Then, the captured background image data is saved as the background image data B (P) (S144), the captured flag C (P) is set to 1 (S145), and the process of step S146 described later is performed.

When the captured flag C (P) = 1 (YES in S142) or when the captured image use flag U (P) = 1 is not (NO in S143), the control unit 11 changes the display page P. (S146). The control unit 11 determines whether or not the display page P> the number of pages N (S147), and when the display page P> the number of pages N (YES in S147), that is, when the changed page is a new page. , The number of pages N = N + 1 (S148).

The control unit 11 sets the captured image use flag U (P) to the use flag initial value IU (S149), sets the captured flag C (P) = 0 (S150) for the new page, and sets the page. End the change process.

When the page to be changed is the display page P (NO in S141), or when the display page P> the number of pages N is not (NO in S147), the control unit 11 ends the page change process.

Since the thumbnail display process of step S134 in FIG. 24 is the same as the process of FIG. 15, the description thereof will be omitted.

FIG. 27 is a flowchart showing an example of a procedure for changing the settings of the image processing apparatus 100 of the second embodiment. The process illustrated in FIG. 27 specifically represents the process in step S136 of FIG. 24. The control unit 11 determines whether or not the management data to be changed is the captured image use flag U (P) (S161), and if it is not the captured image use flag U (P) (NO in S161), sets it. End the change process.

When the management data to be changed is the captured image use flag U (P) (YES in S161), the control unit 11 sets the captured image use flag U (P) to a value to be changed (S162).

The control unit 11 determines whether or not the changed captured image use flag U (P) = 1 (S163), and when the changed captured image use flag U (P) = 1 (YES in S163). ), The background image displayed by the application is captured, and the captured background image data is saved as the background image data B (P) (S164). Here, since the captured background image has been changed from the "not used" setting to the "used" setting, the capture is performed.

The control unit 11 sets the captured flag C (P) = 1 (S165), and ends the setting change process. If the changed captured image use flag U (P) is not 1 (NO in S163), the control unit 11 sets the captured flag C (P) = 0 (S166) and ends the setting change process.

The technical features described in each of the above embodiments of the present invention can be combined with each other to form a new technical plan.

The image processing device of the present embodiment is an image processing device including a processing unit (13) that performs a process of displaying an image on the display screen (14), and is a position when a touch pen or a finger touches the display screen. A drawing unit (12) for drawing a handwritten image on the display screen based on the above is provided.

The image processing method of the present embodiment is an image processing method using an image processing device including a processing unit (13) that performs a process of displaying an image on the display screen (14), and a touch pen or a finger touches the display screen. The feature is that the drawing unit (12) includes a step of detecting the position at the time of drawing and drawing the handwritten image on the display screen based on the detected position.

In the present embodiment, the drawing unit draws a handwritten image on the display screen based on the position when the touch pen or the finger touches the display screen. For example, when a transparent touch panel (also called a transparent board) is placed on the display screen and a touch (touch) of a touch pen or finger is detected by the touch panel, a point of the required size is drawn at the detected position and the touch position. When is changed, a handwritten image can be written on the image displayed on the display screen by drawing a line along the locus (stroke) of the detected position.

The image processing device of the present embodiment has a storage unit (16), and when the processing unit displays an image on the display screen and the drawing unit draws a handwritten image, the handwritten image and It is characterized by including a control unit (11) that controls the image displayed on the display screen at the same time as the handwritten image so as to be associated and stored in the storage unit.

In the present embodiment, when the processing unit displays an image on the display screen and the drawing unit draws the handwritten image, the control unit displays the handwritten image and the handwritten image at the same time as the display screen. It is controlled to associate the image displayed in and store it in the storage unit. For example, when an image (for example, an image displayed when a desired application is executed, an image of an arbitrary page when a file composed of a plurality of pages is opened, etc.) is displayed on the display screen, the image is displayed. When a handwritten image composed of characters such as comments and memos or a figure is drawn, the image simultaneously displayed on the display screen and the handwritten image are stored in association with each other. Associating includes, for example, grouping as the same file or grouping as the same page. The timing of storing in the storage unit can be when a predetermined operation is performed.

As a result, when handwritten input is performed on the image displayed on the display screen, the image and the handwritten image can be associated and stored, so that the user does not have to make a note on paper or the like, which improves convenience. ..

In the image processing device of the present embodiment, the control unit (11) controls to store a plurality of pages of handwritten images drawn by the drawing unit (12) on the display screen in page units. It is characterized by being designed to do so.

In the present embodiment, the control unit controls the handwriting image drawn by the drawing unit on the display screen so as to store a plurality of pages of handwriting images on a page-by-page basis. For example, when the application is started and the images of a plurality of pages are displayed in order on the display screen (when the presentation image is displayed), the drawing unit draws the handwritten image in page units, for example, an image. The page of the handbook image is synchronized with the page of the handbook image, the handbook image of the first page is associated with the image of the first page, and similarly, the hand of the nth page is associated with the image of the n (n is an integer) page. Calligraphy images can be associated. As a result, a different handwritten image can be associated with each page of the image of a plurality of pages, and a handwritten image of a plurality of pages can be recorded.

The image processing device of the present embodiment includes a transition reception unit (12) that accepts an operation of transitioning to a page different from the arbitrary page when a handwritten image of an arbitrary page is displayed on the display screen. The control unit (11) is characterized in that when the operation is received by the transition reception unit, the handwritten image of the arbitrary page is stored as the arbitrary page.

In the present embodiment, the transition reception unit accepts an operation of transitioning to a page different from the arbitrary page when the handwritten image of the arbitrary page is displayed on the display screen. When the transition reception unit receives the operation, the control unit stores the handwritten image of the arbitrary page as the arbitrary page.

For example, suppose that a handwritten image is drawn when an image on the display screen is displayed. The handwritten image is associated with, for example, the image on the first page and becomes the handwritten image on the first page. In this state, when the operation of shifting to a page different from the first page (for example, the second page) is accepted, the control unit displays the handwritten image of the arbitrary page (first page) for the arbitrary page (1). Memorize as (pages).

That is, simply by drawing a handwritten image on the image displayed on the display screen and performing an operation of moving to another page, the handwritten image (1 page) that was displayed at the same time as the image before the operation was performed. The handwritten image of the eye) can be recorded automatically.

Assuming that the transparent board supports only one page of handwritten image, when switching the displayed image to another page after drawing the handwritten image for the image displayed on the display screen. Before switching the image, it is necessary to perform an operation to temporarily memorize the handwritten image input to the transparent board together with the image before switching, and then to clear (erase) the handwritten image displayed on the transparent board. Yes, the operation is complicated. However, according to the present embodiment, since the transparent board corresponds to the handwritten image for a plurality of pages, the hand displayed at the same time as the image on the display screen only by performing the operation of moving to another page. The calligraphy image can be automatically recorded, and the operability can be improved.

When the operation is received by the transition reception unit (12), the image processing apparatus of the present embodiment displays the image displayed on the display screen (14) at the same time as the handwritten image of the arbitrary page. It is characterized by including a setting unit (161) for setting whether or not to store as pages.

In the present embodiment, when the transition reception unit accepts the operation, the setting unit stores the image displayed on the display screen at the same time as the handwritten image of the arbitrary page as the arbitrary page. Set whether or not. For example, if it is set to memorize an image in the setting section, the image displayed at the same time on the display screen and the handwritten image are automatically associated as the same page by simply performing the operation of moving to another page. It is possible to record the image and improve the operability.

In the image processing device of the present embodiment, when the control unit (11) is set to store an image in the setting unit (161) when the operation is received by the transition reception unit (12). Is characterized in that the handwritten image of the arbitrary page and the image displayed on the display screen (14) at the same time as the handwritten image are associated and stored as the arbitrary page.

In the present embodiment, when the control unit receives the operation in the transition reception unit and is set to store the image in the setting unit, the control unit can use the handbook image of any page and the handbook. The image displayed on the display screen at the same time as the image is associated and stored as the arbitrary page.

Assuming that the transparent board supports only one page of handwritten image, when switching the displayed image to another page after drawing the handwritten image for the image displayed on the display screen. Before switching the image, it is necessary to perform an operation to temporarily memorize the handwritten image input to the transparent board together with the image before switching, and then to clear (erase) the handwritten image displayed on the transparent board. Yes, the operation is complicated. However, according to the present embodiment, since the transparent board corresponds to the handwritten image for a plurality of pages, the image and the hand displayed on the display screen at the same time can be obtained only by performing the operation of moving to another page. The calligraphy image can be associated with the same page and automatically recorded, and the operability can be improved.

In the image processing device of the present embodiment, when the drawing unit (12) receives the operation at the transition reception unit (12), the drawing unit (12) displays the drawing displayed on the display screen (14) from the display screen. It is characterized in that it is erased.

In the present embodiment, when the transition reception unit accepts the operation, the drawing unit deletes the drawing displayed on the display screen from the display screen. That is, according to the present embodiment, since the transparent board corresponds to the handwritten image for a plurality of pages, the operation of clearing (erasing) the handwritten image being displayed before moving to another page can be performed. It is no longer necessary, and the handwritten image displayed on the display screen can be automatically recorded and another page for the handwritten image can be prepared simply by performing an operation of moving to another page.

In the image processing apparatus of the present embodiment, the processing unit (13) displays an image on the display screen (14) in page units, and the transition reception unit (12) accepts the operation. In this case, the image of the arbitrary page is switched to the image of the different page and displayed on the display screen.

In the present embodiment, the processing unit displays an image on the display screen in page units. Then, when the operation is accepted by the transition reception unit, the image on an arbitrary page is switched to an image on a different page and displayed on the display screen. For example, suppose that the handwritten image is drawn when the application is started and the image of the first page is displayed on the display screen. The handwritten image is associated with the image on the first page and becomes the handwritten image on the first page. In this state, when the operation of shifting to a page different from the first page (for example, the second page) is accepted, the image by the application is also switched from the first page to the second page. As a result, the page of the image and the page of the handwritten image can be switched in synchronization only by performing the transition operation.

In the image processing apparatus of the present embodiment, one or more pages of handwritten images and images stored in association with the storage unit (16) are reduced by one or more pages in a manner displayed on the display screen. It is characterized by including a reduction unit (15) for reducing the image and a reduction image display unit (11) for displaying all or a part of the reduced image reduced by the reduction unit.

In the present embodiment, the reduced unit is a reduced image for one or more pages in a manner in which one or more pages of handwritten images and images stored in association with the storage unit are displayed on the display screen. to shrink. The mode displayed on the display screen means the same state as that displayed on the display screen. The reduced image display unit displays all or a part of the reduced image reduced by the reduced unit. As a result, it is possible to see a list of the image being displayed when the handwritten input is performed and the reduced image in which the handwritten image is displayed at the same time, and it is possible to easily access the required image.

The image processing device of the present embodiment includes a selection reception unit (12) that accepts an operation of selecting one reduced image from a plurality of pages of reduced images displayed by the reduced image display unit (11), and the selection. When one reduced image is selected in the reception unit, the display control unit (11) controls to display the handwritten image and the image corresponding to the selected reduced image again in the manner displayed on the display screen (14). It is characterized by having.

In the present embodiment, the selection reception unit accepts an operation of selecting one reduced image from the reduced images of a plurality of pages displayed by the reduced image display unit. When one reduced image is selected by the selection receiving unit, the display control unit controls to display the handwritten image and the image corresponding to the selected reduced image again in the manner displayed on the display screen. As a result, the user can display the handwritten image and the image that was displayed at the same time when the handwritten image was drawn in the original display mode simply by selecting the reduced image.

11 Control unit 12 Drawing unit 13 Image processing unit 14 Display screen 141 Display panel unit 142 Touch panel unit 15 Reduced image generation unit 16 Storage unit 161 Transparent board management data 162 Transparent board image data 163 Presentation image data

Claims (6)

An image processing device that displays an image on the display screen.
A control unit that superimposes and displays a handwritten image input on the transparent board on the background image displayed on the display screen.
The background image and a judging section that judges whether an image of a predetermined application,
The control unit
The determination unit, when the background image is determined to Ru image der the given application, and show through the transparent board which is superimposed on the background image,
The determination unit, when the background image is determined not in the image of the predetermined application, the image processing apparatus not show through the transparent board which is superimposed on the background image. The control unit
According to claim 1, if the determination unit determines that the background image does not include an image of a predetermined application at the start of handwriting input, the background image is an image of a specific color or pattern or a prepared image. The image processing apparatus described. The image displayed on the display screen is captured as a captured image when a predetermined operation is accepted, and a first setting unit for setting a captured image use flag indicating whether or not to use the captured image is provided. Prepare,
The control unit
When the determination unit determines that the background image includes an image of a predetermined application and the captured image use flag is not set in the first setting unit, the transparent board superimposed on the background image is transparent. The image processing apparatus according to claim 1 or 2, wherein the image processing apparatus is displayed. A second setting unit for setting a captured flag indicating whether or not the image displayed on the display screen has been captured is provided.
The control unit
3. When the captured image use flag is set in the first setting unit and the captured image flag is set in the second setting unit, the background image is changed to the captured image of the predetermined application. The image processing apparatus according to. The control unit
4. When the captured image use flag is set in the first setting unit and the captured image flag is not set in the second setting unit, the transparent board superimposed on the background image is transparently displayed. The image processing apparatus according to. An image processing method that displays an image on the display screen.
The handwritten image input to the transparent board is superimposed and displayed on the background image displayed on the display screen.
It is determined whether or not the background image is an image of a predetermined application, and
If the background image is determined to Ru image der the given application, and show through the transparent board which is superimposed on the background image,
If the background image is determined to be not in the image of the predetermined application, an image processing method that does not show through the transparent board which is superimposed on the background image.

Images