JP2014033283A - Image processing apparatus, image processing program, and image processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily identify, when an image processing apparatus is in an asynchronous mode not in conjunction with a display screen of other image processing apparatus, the display screen currently displayed on the other image processing apparatus.SOLUTION: An image processing apparatus 14 includes: a first image generation unit 44 that generates a first locus image of locus information corresponding to page information of the currently displayed page of identification information of the image processing apparatus 14; a second image generation unit 46 that generates, when at least synchronization information of the image processing apparatus 14 is in an asynchronous mode, a second locus image indicating a locus image of locus information corresponding to page information of the currently displayed page of identification information that has synchronization information in a synchronization mode and the latest page change time, in a display form indicating that the locus image is an image of the latest page change time; a composition unit 48 that generates a composition image of the first locus image and the second locus image; and a display control unit 50 that controls to display the composite image on a display unit.

Description

  The present invention relates to an image processing apparatus, an image processing program, and an image processing system.

  2. Description of the Related Art Conventionally, an electronic blackboard is used in which a background image is displayed on a large display and a user can write a drawing image such as letters, numbers, and figures on a large display at a meeting in a company, an educational institution, or a governmental organization.

  As such an electronic blackboard, a system is disclosed in which drawing data drawn on a drawing screen is converted into electronic data and transmitted to a whiteboard at another remote location via a communication line (for example, Patent Document 1). Also, in Patent Document 1, electronic data transmitted from the other remote whiteboard is received, converted into drawing data, and displayed. Thus, in Patent Document 1, input information to the whiteboard is shared in a conference between remote locations.

  In addition, when the display screen is updated at one of a plurality of bases, a so-called synchronous mode in which update information is reflected on the other bases, and an asynchronous mode in which the display screens of the other bases are asynchronous. Switching is also done. Asynchronous mode is used, for example, when displaying a display screen of another page temporarily only at a certain site.

  However, conventionally, when a certain base is set to the asynchronous mode, the display screen of another base cannot be confirmed at the base in the asynchronous mode.

  The present invention solves the above-described problems, and easily confirms a display screen currently displayed on another image processing apparatus when the asynchronous mode is not linked to the display screen of the other image processing apparatus. An object is to provide an image processing apparatus, an image processing program, and an image processing system.

  In order to solve the above-described problems and achieve the object, an image processing apparatus according to the present invention includes a first storage unit, a second storage unit, a third storage unit, a first image generation unit, and a second storage unit. An image generation unit, a synthesis unit, and a display control unit are provided. The first storage unit stores identification information of a plurality of image processing devices connected to the network. The second storage unit stores trajectory information indicating the trajectory on the display screen and page information in association with each other. The third storage unit displays the identification information, a current display page indicating a page currently displayed on the display screen of the image processing device specified by the identification information, and a display screen of another image processing device in conjunction with the display screen. The synchronization information indicating either the synchronous mode for changing the screen or the asynchronous mode not linked to the display screen of another image processing apparatus is stored in association with the page change time of the current display page. The first image generation unit generates a first trajectory image of trajectory information corresponding to the page information of the current display page of the identification information of the image processing apparatus. The second image generation unit has a locus corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronization mode and the page change time is the latest when at least the synchronization information of the image processing apparatus is in the asynchronous mode. A second trajectory image indicating the trajectory image of information in a display form indicating that the trajectory image is an image at the latest page change time is generated. The synthesis unit generates a synthesized image of the first trajectory image and the second trajectory image. The display control unit performs control to display the composite image on the display unit.

  An image processing program according to the present invention stores a first storage unit that stores identification information of a plurality of image processing apparatuses connected to a network, locus information indicating a locus on a display screen, and page information in association with each other. Two storage units, the identification information, a current display page indicating a page currently displayed on the display screen of the image processing apparatus specified by the identification information, and a display screen in conjunction with the display screen of another image processing apparatus A third storage unit that stores the synchronous information indicating either the synchronous mode for changing the image or the asynchronous mode not linked to the display screen of another image processing apparatus and the page change time of the current display page in association with each other And a step of generating a first trajectory image of trajectory information corresponding to the page information of the current display page of the identification information of the image processing apparatus, When the synchronization information of the image processing apparatus is in the asynchronous mode, the trajectory image of the trajectory information corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronous mode and the latest page change time is Generating a second trajectory image in a display form indicating that the trajectory image is an image at the latest page change time, and generating a composite image of the first trajectory image and the second trajectory image. And an image processing program for causing the computer to execute control for displaying the composite image on a display unit.

  An image processing system of the present invention is an image processing system including a server device and a plurality of image processing devices connected to the server device via a network. The image processing apparatus includes a first storage unit, a second storage unit, a third storage unit, a first acquisition unit, a first update unit, a first image generation unit, a second image generation unit, and a composition And a display control unit. The first storage unit stores identification information of a plurality of image processing devices connected to the network. The second storage unit stores trajectory information indicating the trajectory on the display screen and page information in association with each other. The third storage unit displays the identification information, a current display page indicating a page currently displayed on the display screen of the image processing device specified by the identification information, and a display screen of another image processing device in conjunction with the display screen. The synchronization information indicating either the synchronous mode for changing the screen or the asynchronous mode not linked to the display screen of another image processing apparatus is stored in association with the page change time of the current display page. The first acquisition unit acquires a mode change instruction including the changed synchronization information and the identification information of the image processing apparatus whose mode has been changed from the server apparatus. The first updating unit stores the synchronization information included in the mode change instruction in the third storage unit as synchronization information corresponding to the identification information included in the mode change instruction. The first image generation unit generates a first trajectory image of trajectory information corresponding to the page information of the current display page of the identification information of the image processing apparatus. The second image generation unit has a locus corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronization mode and the page change time is the latest when at least the synchronization information of the image processing apparatus is in the asynchronous mode. A second trajectory image indicating the trajectory image of information in a display form indicating that the trajectory image is an image at the latest page change time is generated. The synthesis unit generates a synthesized image of the first trajectory image and the second trajectory image. The display control unit performs control to display the composite image on the display unit. The server device includes the first storage unit, the second storage unit, the third storage unit, a second acquisition unit, and a second update unit. The second acquisition unit acquires the mode change instruction from at least one of the plurality of image processing apparatuses. The second updating unit stores the synchronization information included in the mode change instruction in the third storage unit as synchronization information corresponding to the identification information included in the mode change instruction.

  According to the present invention, it is possible to easily check the display screen currently displayed on the other image processing apparatus when the asynchronous mode is not linked to the display screen of the other image processing apparatus. Play.

FIG. 1 is a schematic diagram of an image forming system according to the first embodiment. FIG. 2 is a functional block diagram of the information processing terminal. FIG. 3 is a schematic diagram illustrating an example of a data structure of data stored in the first storage unit. FIG. 4 is a schematic diagram illustrating an example of a data structure of data stored in the second storage unit. FIG. 5 is a schematic diagram illustrating an example of a data structure of data stored in the third storage unit. FIG. 6 is a flowchart showing the procedure of image processing. FIG. 7 is a flowchart showing the procedure of the first process. FIG. 8 is a flowchart showing the procedure of the composite image generation process. FIG. 9 is a schematic diagram illustrating an example of a composite image. FIG. 10 is a schematic diagram illustrating an example of a composite image. FIG. 11 is a flowchart showing the procedure of the second process. FIG. 12 is a flowchart showing the procedure of the third process. FIG. 13 is a flowchart showing the procedure of the fourth process. FIG. 14 is a flowchart showing the procedure of the fifth process. FIG. 15 is a flowchart showing the procedure of the sixth process. FIG. 16 is a schematic diagram illustrating an image processing system. FIG. 17 is a schematic diagram illustrating a configuration of a server device according to the second embodiment.

  Hereinafter, an embodiment of an image processing apparatus, an image processing program, and an image processing method will be described with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a schematic diagram of an image processing system according to the present embodiment.

  As shown in FIG. 1, the image forming system 10 includes a plurality of image processing apparatuses 14 (an image processing apparatus 14 </ b> A, an image processing apparatus 14 </ b> B, and an image processing apparatus 14 </ b> C) connected via a network 16.

  Each image processing device 14 displays a trajectory image indicating a trajectory by the input unit 18 on the display screen on the display unit synchronously or asynchronously between the image processing devices 14.

  The network 16 is a known communication line. The network 16 may be a wired communication network or a wireless communication network. The network 16 is, for example, a LAN (Local Area Network) or the Internet, and uses a communication protocol such as Ethernet (registered trademark) or TCP / IP. Each image processing device 14 may be directly connected by a known connection cable.

  FIG. 2 is a functional block diagram of each image processing apparatus 14A in the image processing system 10. In FIG. 2, as an example, a functional block diagram of the image processing device 14A in the image processing device 14 is shown, but the image processing device 14B and the image processing device 14C have the same configuration.

  In the following description, when the image processing device 14A, the image processing device 14B, and the image processing device 14C are collectively described, they are simply referred to as the image processing device 14.

  The image processing device 14A is a device in which the following functional units are mounted on a known computer including a CPU (Central Processing Unit 9), a ROM (Read Only Memory), an HDD (Hard Disk Drive) RAM (Random Access Memory), and the like. is there.

  As shown in FIG. 2, the image processing apparatus 14 </ b> A includes a processor 20, a ROM 22, a communication unit 26, a display unit 28, a storage unit 36, and a RAM 24, and a hardware configuration using a normal computer It has become.

  The processor 20 is a processing operation device such as a CPU or MPU, and operates OS such as WINDOWS (registered trademark) series, UNIX (registered trademark), LINUX (registered trademark), TRON, ITRON, μITRON, etc. Under the management, the program of the present invention described in a programming language such as assembler, C, C ++, Java (registered trademark), JavaScript (registered trademark), PERL, RUBY, PYTHON is executed. The ROM 22 is a non-volatile memory in which a boot program such as BIOS or EFI is stored.

  The communication unit 26 is a communication interface for transmitting and receiving various data to and from the image processing apparatus 14 via the network 16. The display unit 28 displays various images such as a display screen. The display unit 28 may be a known LCD (Liquid Crystal Display) or the like.

  The input unit 18 is a functional unit that allows a user to input various operations. Examples of the input unit 18 include a mouse, a button, a remote controller, a keyboard, a microphone, and a combination of one or more of these.

  In the present embodiment, the input unit 18 functions as an instruction member that instructs at least the position on the display screen displayed on the display unit 28.

  In the image processing apparatus 14A, the input unit 18 and the display unit 28 may be integrally configured. In this case, a known LCD (Liquid Crystal Display) with a touch panel in which the input unit 18 and the display unit 28 are integrated may be used.

  The storage unit 36 is a storage medium such as a hard disk drive (HDD). The storage unit 36 includes a first storage unit 36A, a second storage unit 36B, and a third storage unit 36C. The first storage unit 36A, the second storage unit 36B, and the third storage unit 36C may be configured as separate HDDs, or may be different memory areas in one HDD.

  The first storage unit 36A stores identification information (ID) of the image processing device 14 participating in the electronic conference in the image processing system 10. That is, each piece of identification information stored in the first storage unit 36A indicates identification information of the image processing apparatus 14 currently participating in the electronic conference in the image processing system 10.

  FIG. 3 is a schematic diagram illustrating an example of a data structure of data stored in the first storage unit 36A. As shown in FIG. 3, the first storage unit 36 </ b> A includes an electronic conference name to be held (described as a conference room name in FIG. 3) and identification information (hereinafter referred to as ID) of the image processing apparatus 14 participating in the electronic conference. Are stored in association with each other.

  The second storage unit 36B displays the locus on the display screen created by the image processing device 14 participating in the electronic conference, that is, the image processing device 14 specified by each identification information stored in the first storage unit 36A. The trajectory information shown and the page information showing the page of the trajectory display screen are stored in association with each other. That is, the second storage unit 36B stores trajectory information included in the display screen for each page as information common to the image processing apparatuses 14 participating in the electronic conference.

  FIG. 4 is a schematic diagram illustrating an example of a data structure of data stored in the second storage unit 36B. As shown in FIG. 4, the second storage unit 36 </ b> B shows trajectory information indicating the trajectory of the display screen (in FIG. 4, the trajectory information is referred to as “stroke”. As shown in FIG. The storage unit 36B stores one or more pieces of trajectory information (in FIG. 4, stroke 1 to stroke 6) in association with each page.

  The third storage unit 36C stores the identification information of the image processing device 14, the current display page, the synchronization information, and the page change time in association with each other. That is, the third storage unit 36C stores the current display page of each image processing device 14, the synchronization information of each image processing device 14, and the time (page change time) when the current display page was changed in each image processing device 14. Remember.

  The current display page is information indicating the page of the display screen currently displayed on the display unit in the image processing apparatus 14 specified by the corresponding identification information (sometimes referred to as “current page”).

  The synchronization information is not linked to the display mode of the other image processing apparatus 14 in the image processing system 10 or the synchronization mode in which the display screen is changed in conjunction with the display screen of the other image processing apparatus 14 in the image processing system 10. Indicates one of the asynchronous modes. The page change time is information indicating the time when the image processing apparatus 14 specified by the corresponding identification information is updated on the display screen of the corresponding current display page.

  FIG. 5 is a schematic diagram illustrating an example of a data structure of data stored in the third storage unit 36C. As shown in FIG. 5, the third storage unit 36 </ b> C displays the currently displayed page, synchronization information, and page change for each identification information (A to C in FIG. 5) of each image processing device 14. The time is stored in association with each other.

  Note that each piece of information stored in each of the first storage unit 36A, the second storage unit 36B, and the third storage unit 36C is appropriately updated by a process described later.

  Returning to FIG. 2, the RAM 24 is a main storage device and provides an execution space for executing the image processing program of the present embodiment. The processor 20 reads an image processing program from a hard disk device (not shown) for continuously storing software programs, various data, and the like, expands it in the RAM 24, and executes it. As a result, the acquisition unit 38, the trajectory information generation unit 40, the update unit 42, the image generation unit 45, the synthesis unit 48, and the display control unit 50 are expanded in the RAM 24.

  The trajectory information generation unit 40 generates trajectory information (stroke) including a group of coordinate information indicating the trajectory based on the trajectory indicated by the input unit 18 on the display screen instructed by the input unit 18.

  The acquisition unit 38 acquires various types of information by receiving various types of information from other image processing apparatuses 14 and the like via the communication unit 26. The acquisition unit 38 acquires various types of information from the input unit 18 according to an operation instruction of the input unit 18 by the user.

  In the present embodiment, the acquisition unit 38 acquires a trajectory update instruction, a page change instruction, a mode change instruction, and the like from the input unit 18 of the image processing apparatus 14A or another image processing apparatus 14 via the network 16. To do.

  The trajectory update instruction is an instruction signal for instructing update of trajectory information indicating the trajectory by the input unit 18 on the display screen of the display unit 28 of the image processing device 14. The trajectory update instruction includes trajectory information (latest trajectory information) indicating a trajectory by the input unit 18 on the display screen currently displayed on the display unit 28 of the image processing device 14, a page (page information) of the display screen, And an instruction signal for instructing the locus update.

  The page change instruction is a signal for instructing to change the page of the display screen currently displayed on the display unit 28 of the image processing apparatus 14. The page change instruction includes the page after the change, the identification information of the image processing apparatus 14 whose page has been changed on the display screen, the page change time, and an instruction signal instructing the page change. The page change time indicates the date and time when the display screen is changed to the page after the change in the image processing apparatus 14 that has transmitted the page change instruction. The date and time may be a date and time.

  The mode change instruction is an instruction signal for changing the synchronization information of the display screen displayed on the display unit 28 of the image processing apparatus 14 to the asynchronous mode or the synchronous mode. The mode change instruction includes synchronous information after the change (asynchronous mode or synchronous mode), identification information of the image processing apparatus 14 whose mode has been changed, and an instruction signal instructing change of the synchronous information.

  The update unit 42 updates various information in the storage unit 36 by storing the various types of information acquired by the acquisition unit 38 in the storage unit 36.

  Specifically, when the acquisition unit 38 acquires the trajectory update instruction, the update unit 42 associates the trajectory information included in the trajectory update instruction with the page of the display screen included in the trajectory update instruction. 2 is stored in the storage unit 36B. Thereby, the second storage unit 36B is updated.

  When the acquisition unit 38 acquires the page change instruction, the update unit 42 sets the changed page included in the page change instruction as the current display page and associates it with the identification information included in the page change instruction. Store in the third storage unit 36C. Further, the updating unit 42 stores the page change time included in the page change instruction in the third storage unit 36C in association with the identification information. Thereby, the update unit 42 updates the third storage unit 36C.

  On the other hand, when the acquisition unit 38 acquires the mode change instruction, the update unit 42 stores the synchronization information included in the mode change instruction in the third storage as the synchronization information corresponding to the identification information included in the mode change instruction. The part 36C is updated.

  The image generation unit 45 generates a display image to be displayed on the display screen of the display unit 28. The image generation unit 45 includes a first image generation unit 44 and a second image generation unit 46.

  The first image generation unit 44 generates a first trajectory image of the trajectory information of the currently displayed page currently displayed in the image processing device 14 (the image processing device 14 in which the first image generation unit 44 is provided). To do. For example, when the trajectory information to be displayed includes coordinate information indicating the character “C”, the first image generation unit 44 uses the first trajectory image as a linear image connecting the points indicated by the coordinate information. Generate as

  Specifically, when the synchronization information of the image processing apparatus 14A is in the synchronization mode, the first image generation unit 44 sets the latest page change time among the identification information stored in the third storage unit 36C. Read the corresponding current display page. Then, the first image generating unit 44 reads the trajectory information corresponding to the read current display page from the second storage unit 36B as the trajectory information to be displayed, and generates a trajectory image.

  Further, when the synchronization information of the image processing device 14A is in the asynchronous mode, the first image generation unit 44 reads the current display page corresponding to the identification information of the image processing device 14A from the third storage unit 36C. Then, the first image generating unit 44 reads the trajectory information corresponding to the read current display page from the second storage unit 36B as the trajectory information to be displayed, and generates a trajectory image.

  The second image generation unit 46 generates a second trajectory image at least when the synchronization information of the image processing device 14A is in the asynchronous mode. Note that the second image generation unit 46 may generate the second trajectory image even when the synchronization information of the image processing device 14A is in the synchronization mode.

  The second trajectory image includes the trajectory information corresponding to the page information of the currently displayed page of the identification information whose synchronization information is the synchronization mode and the page change time is the latest among the image processing devices 14 other than the image processing device 14A. It is an image which shows a locus image in the display form which shows that it is the newest display image in other image processing devices 14 of synchronous mode.

  Examples of this display form include a form in which the locus information of the locus information is shown in the color frame image of the color corresponding to the identification information of the other image processing apparatus 14 in which the synchronization information is in the synchronization mode. In addition, the display form includes a form in which a locus image of the locus information is displayed in a window in which a character image indicating identification information of another image processing device 14 in which the synchronization information is in the synchronization mode is displayed.

  Note that this display form is not limited to the above example as long as it is a display form indicating that it is the latest display image in the other image processing apparatus 14 in the synchronous mode.

  In addition, the second image generation unit 46 generates a second trajectory image so that the screen is smaller than the first trajectory image when displayed.

  In the present embodiment, the second image generation unit 46 also creates a thumbnail image of the display image for each page created by the image processing device 14 included in the image processing system 10.

  The combining unit 48 generates a combined image obtained by combining the first trajectory image generated by the first image generating unit 44 and the second trajectory image generated by the second image generating unit 46.

  The display control unit 50 displays various images such as a first trajectory image generated by the first image generation unit 44, a second trajectory image generated by the second image generation unit 46, or a composite image on the display unit 28. Control.

  Next, an image processing procedure executed by the image processing apparatus 14 will be described.

  FIG. 6 is a flowchart illustrating a procedure of image processing executed by the image processing apparatus 14. As an example, the procedure of image processing executed by the image processing apparatus 14A will be described.

  First, the processor 20 of the image processing apparatus 14A transmits start information to another image processing apparatus 14 via the communication unit 26 and the network 16 (step S100). The start information is information indicating the start of the electronic conference.

  In each image processing apparatus 14 that has received the start information, when instruction to participate in the electronic conference is instructed by an operation instruction of the input unit 18 of the user, participation instruction information that instructs participation in the electronic conference, and own image processing The participation information including the identification information of the device 14 is transmitted to the image processing device 14 that is the transmission source of the start information connected to the network 16 and the other image processing devices 14. In addition, in each image processing device 14 that has received the start information, when data is stored in the third storage unit 36C of the storage unit 36, the identification of the image processing device 14 of its own among the stored data. Participation information that further includes the currently displayed page that is currently displayed, the synchronization information, and the page change time corresponding to the information is transmitted.

  Next, the acquisition unit 38 of the image processing apparatus 14A acquires the identification information of its own image processing apparatus 14A, the current display page corresponding to the identification information, the synchronization information, and the page change time from the third storage unit 36C. (Step S102), and transmits to the other image processing apparatus 14 (Step S106).

  Next, the acquisition unit 38 of the image processing device 14A repeats negative determination until participation information is received from another image processing device 14 (step S108: No). If an affirmative determination is made in step S108 (step S108: Yes), the updating unit 42 stores the identification information included in the received participation information in the first storage unit 36A (step S110). In addition, when the received participation information further includes the current display page, the synchronization information, and the page change time together with the identification information of the image processing device 14, the update unit 42 displays the information as the first information. 3 is stored in the storage unit 36C (step S110).

  Next, the acquisition unit 38 determines whether or not a trajectory update instruction has been acquired from the input unit 18 (step S112). If an affirmative determination is made in step S112 (step S112: Yes), the process proceeds to step S114. In step S114, a first process to be described later is executed (step S114).

  Next, the processor 20 determines whether or not to end the electronic conference (step S136). In step S136, for example, the determination in step S136 is performed by determining whether or not information indicating the end of the electronic conference is input via the input unit 18 in accordance with a user operation instruction. In step S136, for example, the acquisition unit 38 determines whether or not information indicating the end of the electronic conference has been acquired from another image processing apparatus 14 via the network 16, thereby determining the determination in step S136. You may go.

  If a negative determination is made in step S136 (step S136: No), the process returns to step S112. On the other hand, if an affirmative determination is made in step S136 (step S136: Yes), this routine ends.

  On the other hand, if a negative determination is made in step S112 (step S112: No), the process proceeds to step S116. In step S116, the acquisition unit 38 determines whether a page change instruction has been acquired from the input unit 18 (step S116). If an affirmative determination is made in step S116 (step S116: Yes), the process proceeds to step S118, a second process described later is executed (step S118), and the process proceeds to step S136.

  If a negative determination is made in step S116 (step S116: No), the process proceeds to step S120. In step S120, the acquisition unit 38 determines whether a mode change instruction has been acquired from the input unit 18 (step S120). If an affirmative determination is made in step S120 (step S120: Yes), a third process whose details will be described later is executed (step S122). Then, the process proceeds to step S136.

  If a negative determination is made in step S120 (step S120: No), the process proceeds to step S124. In step S124, the acquisition unit 38 determines whether a mode change instruction is received from another image processing apparatus 14 (step S124). If an affirmative determination is made in step S124 (step S124: Yes), the process proceeds to step S126, and a fourth process whose details will be described later is executed (step S126). Then, the process proceeds to step S136. On the other hand, if a negative determination is made in step S124 (step S124: No), the process proceeds to step S128.

  Next, the acquiring unit 38 determines whether a trajectory update instruction has been received from another image processing apparatus 14 (step S128). If an affirmative determination is made in step S128 (step S128: Yes), the process proceeds to step S130. In step S130, a fifth process to be described later is executed (step S130). Then, the process proceeds to step S136.

  If a negative determination is made in step S128 (step S128: No), the process proceeds to step S132. In step S132, the acquisition unit 38 determines whether a page change instruction is received from another image processing apparatus 14 (step S132). If an affirmative determination is made in step S132 (step S132: Yes), the process proceeds to step S134, a sixth process described later is executed (step S134), and the process proceeds to step S136. On the other hand, when a negative determination is made in step S132 (step S132: No), the process proceeds to step S136.

  Next, the first process (see step S114 in FIG. 6) will be described.

  FIG. 7 is a flowchart showing the procedure of the first process.

  First, the updating unit 42 reads the trajectory information included in the trajectory update instruction acquired from the input unit 18 in step S112 and the page of the display screen, and stores the trajectory information in association with the page information of the page. By storing in the unit 36, the trajectory information is updated, and the second storage unit 36B is updated (step S200).

  Next, the updating unit 42 receives a trajectory update instruction including the trajectory information, page information, identification information of its own image processing device 14 and an instruction signal instructing trajectory update, updated in step S200. It transmits to each other image processing apparatus 14 specified by the identification information currently participating in the said electronic conference memorize | stored in 1 memory | storage part 36A (step S202).

  Next, the image generation unit 45 generates a composite image to be displayed on the display screen of the display unit 28 (step S204).

  FIG. 8 is a flowchart showing the procedure of the composite image generation process executed by the image generation unit 45.

  First, the first image generation unit 44 generates a first trajectory image of trajectory information to be displayed (step S270). Specifically, the first image generation unit 44 first reads the synchronization information of the image processing device 14A from the third storage unit 36C. Then, when the synchronization information of the image processing apparatus 14A is in the synchronization mode, the first image generation unit 44 currently corresponds to the latest page change time among the identification information stored in the third storage unit 36C. Read the display page. Then, the first image generation unit 44 reads the trajectory information corresponding to the read current display page from the second storage unit 36B as the trajectory information to be displayed, and generates a first trajectory image.

  Further, when the synchronization information of the image processing device 14A is in the asynchronous mode, the first image generation unit 44 reads the current display page corresponding to the identification information of the image processing device 14A from the third storage unit 36C. Then, the first image generation unit 44 reads the trajectory information corresponding to the read current display page from the second storage unit 36B as the trajectory information to be displayed, and generates a first trajectory image.

  Next, the second image generation unit 46 generates a second trajectory image (step S272). Specifically, the second image generation unit 46 generates a second trajectory image at least when the synchronization information of the image processing device 14A is in the asynchronous mode. Note that the second image generation unit 46 may generate the second trajectory image even when the synchronization information of the image processing device 14A is in the synchronization mode.

  As described above, the second trajectory image is a trajectory corresponding to the page information of the currently displayed page whose synchronization information is the synchronization mode and the page change time is the latest among the image processing apparatuses 14 other than the image processing apparatus 14A. It is an image which shows information in the display form which shows that it is the newest display image in the other image processing apparatus 14 of synchronous mode.

  Next, the synthesizing unit 48 creates a synthesized image obtained by synthesizing the first trajectory image created in step S270 and the second trajectory image created in step S272 (step S274). Then, this routine ends.

  Through the processing in step S204 (that is, step S270 to step S274), for example, the synthesis unit 48 creates a synthesized image 60 shown in FIG.

  FIG. 9 is a schematic diagram illustrating an example of the composite image 60.

  In the example illustrated in FIG. 9, a case where the second image generation unit 46 generates a thumbnail image as the second trajectory image will be described.

  As illustrated in FIG. 9, the composite image 60 includes, for example, a first trajectory image 64 indicating a character image “C” and a thumbnail image 62. The thumbnail image 62 includes images indicating the first trajectory image 62A to the first trajectory image 62E as display images for each page. The thumbnail image 62 is a display indicating that, for example, the first trajectory image 62A among the first trajectory image 62A to the first trajectory image 62E is the latest display image in the other image processing apparatus 14 in the synchronous mode. As a form, the first trajectory image 62A is shown as a second trajectory image shown in a display form surrounded by a frame image of a predetermined color indicating that it is the latest display image.

  In the example illustrated in FIG. 9, the first trajectory image 62 </ b> C displayed on the display screen of the image processing apparatus 14 </ b> A is also displayed on the image processing apparatus 14. It is shown in a display form surrounded by a frame image of a predetermined color indicating that

  Further, the synthesizing unit 48 may create, for example, a synthesized image 60A illustrated in FIG.

  A composite image 60A shown in FIG. 10 has a form in which a second trajectory image 66 is further displayed at a location different from the thumbnail image 62 in addition to the composite image 60 shown in FIG. As shown in FIG. 10, the second trajectory image 66 has a first trajectory image 68, which is the latest display image in the other image processing apparatus 14 in the synchronous mode, as a display form indicating the latest display image. This is an image shown in another window 66.

  For this reason, even if the image processing apparatus 14 being operated is in the asynchronous mode, the image displayed on the display screen of the image processing apparatus 14 and other images in the synchronous mode are displayed. The latest display image in the processing device 14 can be displayed together.

  Returning to FIG. 7, the display control unit 50 performs control to display the composite image generated in step S204 on the display unit 28 (step S206). Then, this routine ends.

  Next, the second process (see step S118 in FIG. 6) will be described.

  FIG. 11 is a flowchart showing the procedure of the second process.

  First, the update unit 42 reads the identification information, the page after change, and the page change time included in the page change instruction acquired from the input unit 18 in step S116, and the identification information (that is, the image processing device 14A). In association with the identification information), the changed page is stored as the current display page in the third storage unit 36C, and the page change time is stored in the third storage unit 36C. Thereby, the update unit 42 updates the current display page information and the page change time of the image processing device 14A in the third storage unit 36C (step S250).

  Next, the updating unit 42 stores the page change instruction received in step S116, including the changed page, identification information, page change time, and an instruction signal instructing page change in the first storage unit 36A. To the other image processing devices 14 specified by the identification information participating in the electronic conference (step S252).

  Next, the image generation unit 45 generates a composite image to be displayed on the display screen of the display unit 28 (step S254). In step S254, the display image generation process shown in FIG. 8 is executed.

  Next, the image generation unit 45 performs control to display the composite image generated in step S254 on the display unit 28 (step S256). Then, this routine ends.

  Next, the third process (see step S122 in FIG. 6) will be described.

  FIG. 12 is a flowchart showing the procedure of the third process.

  First, the update unit 42 includes the changed synchronization information (asynchronous mode or synchronous mode), the identification information of the image processing device 14A, and the synchronization information included in the mode change instruction acquired from the input unit 18 in step S120. An instruction signal for instructing the change is read, and the synchronization information is stored in the third storage unit 36C in association with the identification information (step S300).

  When the synchronization information of the image processing apparatus 14A is changed by the operation instruction of the input unit 18 by the user through the process in step S300, the changed synchronization information is stored in the third storage unit 36C.

  Next, the update unit 42 sends the mode change instruction acquired in step S120 to each of the other image processing devices 14 specified by the identification information that is stored in the first storage unit 36A and is participating in the electronic conference. Transmit (step S302).

  Next, the processor 20 determines whether or not the synchronization information of the image processing apparatus 14A has been changed from the asynchronous mode to the synchronous mode by the process of step S300 (step S304). If a negative determination is made in step S304 (step S304: No), this routine ends.

  On the other hand, if a positive determination is made in step S304 (step S304: Yes), the process proceeds to step S306.

  In step S306, the image generation unit 45 and the synthesis unit 48 generate a synthesized image (step S306). In step S306, the composite image generation process shown in FIG. 8 is executed.

  Next, the image generation unit 45 performs control to display the composite image generated in step S306 on the display unit 28 (step S308). Then, this routine ends.

  Next, the fourth process (see step S126 in FIG. 6) will be described.

  FIG. 13 is a flowchart showing the procedure of the fourth process.

  First, the update unit 42 includes the changed synchronization information (asynchronous mode or synchronous mode) included in the mode change instruction received from the other image processing apparatus 14 in step S124, the identification information of the image processing apparatus 14, and An instruction signal for instructing change of the synchronization information is read, and the synchronization information is stored in the third storage unit 36C in association with the identification information (step S310). Then, this routine ends.

  When the synchronization information is changed in the other image processing apparatuses 14 participating in the electronic conference by the process of step S310, the synchronization information of the image processing apparatus 14 can be changed according to the change.

  Next, the fifth process (see step S130 in FIG. 6) will be described.

  FIG. 14 is a flowchart showing the procedure of the fifth process.

  First, the update unit 42 reads the trajectory information included in the trajectory update instruction received from the other image processing apparatus 14 in step S128 and the page of the display screen, and associates the trajectory with the page information of the page. By storing the information in the storage unit 36, the trajectory information is updated, and the second storage unit 36B is updated (step S400).

  Even when the trajectory information is updated in the other image processing apparatuses 14 participating in the electronic conference by the process of step S400, the trajectory information of the corresponding page can be updated at any time.

  Next, the update unit 42 determines whether or not the synchronization information corresponding to the identification information included in the locus update instruction received in step S128 is in the synchronization mode (step S402). The determination in step S402 is performed by determining whether or not the synchronization information corresponding to the identification information stored in the third storage unit 36C is in the synchronization mode.

  If a negative determination is made in step S402 (step S402: No), this routine ends. On the other hand, if an affirmative determination is made in step S402 (step S402: Yes), the process proceeds to step S404.

  In step S404, the update unit 42 determines whether or not the synchronization information of its own image processing apparatus 14A is the synchronization mode (step S404). The determination in step S404 is performed by determining whether or not the synchronization information stored in the third storage unit 36C and corresponding to the identification information of the image processing apparatus 14A is the synchronization mode.

  If a negative determination is made in step S404 (step S404: No), this routine ends. On the other hand, if an affirmative determination is made in step S404 (step S404: Yes), the process proceeds to step S406.

  In step S406, the image generation unit 45 and the synthesis unit 48 generate a synthesized image (step S406). The process of step S406 is performed in the same manner as step S204 (see FIG. 8 for details).

  Next, the display control unit 50 performs control to display the composite image generated in step S406 on the display unit 28 (step S408). Then, this routine ends.

  Next, the sixth process (see step S134 in FIG. 6) will be described.

  FIG. 15 is a flowchart showing the procedure of the sixth process.

  First, the update unit 42 reads the identification information, the changed page, and the page change time included in the page change instruction received from the other image processing apparatus 14 in step S132, and associates them with the identification information. The changed page is stored in the third storage unit 36C as the current display page, and the page change time is stored in the third storage unit 36C. As a result, when the display page is changed in another image processing device 14, the update unit 42 displays the current display page information and page change time of the image processing device 14 stored in the third storage unit 36C. Update (step S450).

  Next, the update unit 42 determines whether or not the synchronization information corresponding to the identification information included in the page change instruction received in step S132 is in the synchronization mode (step S452). The determination in step S452 is performed by determining whether or not the synchronization information corresponding to the identification information stored in the third storage unit 36C is in the synchronization mode.

  If a negative determination is made in step S452 (step S452: No), this routine ends. On the other hand, if an affirmative determination is made in step S452 (step S452: Yes), the process proceeds to step S454.

  In step S454, the update unit 42 determines whether or not the synchronization information of its own image processing apparatus 14A is the synchronization mode (step S454). The determination in step S454 is performed by determining whether or not the synchronization information stored in the third storage unit 36C and corresponding to the identification information of the image processing apparatus 14A is the synchronization mode.

  If a negative determination is made in step S454 (step S454: No), this routine ends. On the other hand, if a positive determination is made in step S454 (step S454: Yes), the process proceeds to step S456.

  In step S456, the image generation unit 45 and the synthesis unit 48 generate a synthesized image (step S456). The process in step S456 is performed in the same manner as in step S204 (see FIG. 8 for details).

  Next, the display control unit 50 performs control to display the composite image generated in step S456 on the display unit 28 (step S458). Then, this routine ends.

  In the above description, the processing in the image processing device 14A has been described as an example, but the same applies to other image processing devices 14 (the image processing device 14B and the image processing device 14C in the present embodiment) connected to the network 16. Needless to say, this processing is performed.

  As described above, in the image processing apparatus 14 according to the present embodiment, the first storage unit 36A stores identification information of a plurality of image processing apparatuses 14 that are connected via the network 16 and participate in the electronic conference. . The second storage unit 36B stores trajectory information indicating the trajectory on the display screen and page information in association with each other. The third storage unit 36 </ b> C is linked to the identification information, the current display page indicating the page currently displayed on the display screen of the image processing device 14 specified by the identification information, and the display screens of the other image processing devices 14. The synchronization information indicating either the synchronous mode for changing the display screen or the asynchronous mode not linked to the display screen of another image processing apparatus 14 and the update time of the current display page are stored in association with each other.

  Then, the first image generation unit 44 generates a first trajectory image of trajectory information corresponding to the page information of the currently displayed page in the image processing apparatus 14 of the first image generation unit 44. In addition, the second image generation unit 46 updates the page information of the currently displayed page of the identification information whose synchronization information is the synchronous mode and whose update time is the latest when at least the synchronization information of the image processing apparatus 14 is the asynchronous mode. A second trajectory image indicating the corresponding trajectory information in a display form indicating that the trajectory image of the trajectory information is the image in the synchronous mode and the latest update time is generated. The combining unit 48 generates a combined image of the first trajectory image and the second trajectory image. The display control unit 50 performs control to display the composite image on the display unit 28.

  For this reason, in the image processing apparatus 14 according to the present embodiment, even if the image processing apparatus 14 is in the asynchronous mode, the image in the synchronous mode among the other image processing apparatuses 14 participating in the electronic conference. The display screen currently displayed on the processing device 14 can be confirmed.

  Therefore, the image processing apparatus 14 can easily confirm the display screen currently displayed on the other image processing apparatus 14 when the asynchronous mode is not linked to the display screen of the other image processing apparatus 14. .

(Second Embodiment)
In the above embodiment, a case where a plurality of image processing apparatuses 14 are connected via the network 16 has been described. However, the server apparatus 12 is further connected to the network 16, and each image processing apparatus 14 connects the server apparatus 12 to the network apparatus 16. The trajectory update instruction, the page change instruction, and the mode change instruction may be transmitted / received via the above.

  FIG. 16 is a schematic diagram showing an image processing system 10A according to the present embodiment.

  As shown in FIG. 16, the image processing system 10 </ b> A has a configuration in which a server device 12 and a plurality of image processing devices 14 are connected via a network 16.

  FIG. 17 is a schematic diagram illustrating a configuration of the server device 12. The server device 12 includes a processor 20, a ROM 22, a RAM 24A, a communication unit 26, and a storage unit 36, and has a hardware configuration using a normal computer. The communication unit 26, the processor 20, the ROM 22, and the storage unit 36 are the same as those in the first embodiment.

  The RAM 24A includes an acquisition unit 38A and an update unit 42A.

  Upon acquiring the trajectory update instruction, page change instruction, and mode change instruction from each image processing apparatus 14 via the communication unit 26, the acquisition unit 38A uses the identification information (ID) stored in the first storage unit 36A. Each acquired instruction is transmitted to each identified image processing device 14 (that is, the image processing device 14 participating in the electronic conference). Further, when the acquisition unit 38A acquires a trajectory update instruction, a page change instruction, and a mode change instruction from each image processing apparatus 14 via the communication unit 26, the acquisition unit 38A outputs the acquired instructions to the update unit 42A.

  The update unit 42A updates various information in the storage unit 36 by storing the various types of information acquired by the acquisition unit 38A in the storage unit 36. The update unit 42A performs the same process as the update unit 42 of the first embodiment except that each instruction is received from the acquisition unit 38A instead of the acquisition unit 38.

  Note that the image processing apparatus 14 according to the present embodiment includes a trajectory update instruction, a page change instruction, and a mode change instruction that the image processing apparatus 14 according to the first embodiment has directly transmitted to the other image processing apparatus 14. Is the same as that of the first embodiment except that is transmitted via the server device 12.

  As described above, each image processing device 14 is configured to perform transmission and reception of a trajectory update instruction, a page change instruction, and a mode change instruction via the server device 12, so that each image processing device can be efficiently and quickly performed. 14 can be updated.

  The image processing program executed by the image processing apparatus 14 according to the above-described embodiment is a file in an installable format or an executable format, and is a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk). ) And the like, and is provided as a computer program product.

  Further, the image processing program executed by the image processing apparatus 14 according to the above-described embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. . The image processing program executed by the image processing apparatus 14 may be provided or distributed via a network such as the Internet.

  Further, the image processing program executed by the image processing apparatus 14 according to the above embodiment may be provided by being incorporated in advance in a ROM or the like.

  The image processing program executed by the image processing apparatus 14 of the above embodiment includes the above-described units (acquisition unit 38, trajectory information generation unit 40, update unit 42, image generation unit 45 (first image generation unit 44, second image generation unit 44). The module configuration includes an image generation unit 46), a synthesis unit 48, and a display control unit 50). As actual hardware, a CPU (processor) reads and executes an image processing program from the storage medium. Each unit is loaded on the main storage device, and each unit is generated on the main storage device.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

10, 10A Image processing system 12 Server device 14 Image processing device 38, 38A Acquisition unit 40 Trajectory information generation unit 42, 42A Update unit 44 First image generation unit 45 Image generation unit 46 Second image generation unit 48 Composition unit 50 Display control Part

JP 2000-188655 A

Claims (8)

A first storage unit that stores identification information of a plurality of image processing apparatuses connected to the network;
A second storage unit that stores trajectory information indicating a trajectory on the display screen and page information in association with each other;
Synchronous mode for changing the display screen in conjunction with the identification information, the current display page indicating the page currently displayed on the display screen of the image processing device specified by the identification information, and the display screen of another image processing device Or a third storage unit that stores the synchronization information indicating any one of the asynchronous modes that are not linked to the display screen of another image processing apparatus and the page change time of the current display page in association with each other;
A first image generation unit for generating a first trajectory image of trajectory information corresponding to the page information of the currently displayed page of the identification information of the image processing apparatus;
When at least the synchronization information of the image processing apparatus is in the asynchronous mode, the trajectory image of the trajectory information corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronous mode and the latest page change time is A second image generation unit for generating a second trajectory image shown in a display form indicating that the trajectory image is an image at the latest page change time;
A combining unit that generates a combined image of the first trajectory image and the second trajectory image;
A display control unit that performs control to display the composite image on a display unit;
An image processing apparatus.   When the synchronization information of the image processing apparatus is in an asynchronous mode, at least when the second image generation unit displays the current display page of the identification information whose synchronization information is the synchronization mode and the page change time is the latest as the display form. The trajectory image of the trajectory information corresponding to the page information is generated as a second trajectory image indicating a trajectory image in a predetermined color frame image indicating that the trajectory image is an image at the latest page change time. Image processing apparatus.   The image processing apparatus according to claim 1, wherein the second image generation unit generates the second trajectory image having a reduced size of the first trajectory image. An acquisition unit for acquiring a mode change instruction including the synchronization information after the change and the identification information of the image processing apparatus whose mode has been changed;
An update unit that stores synchronization information included in the mode change instruction in the third storage unit as synchronization information corresponding to identification information included in the mode change instruction;
The image processing apparatus according to any one of claims 1 to 3, further comprising: The acquisition unit further acquires a trajectory update instruction including the latest trajectory information and page information of a display screen on which the trajectory of the trajectory information is indicated,
The update unit stores the trajectory information included in the trajectory update instruction in the second storage unit in association with page information included in the trajectory update instruction.
The image processing apparatus according to claim 4. The acquisition unit further acquires a page change instruction including the changed page, the identification information of the image processing device whose display screen has been changed, and the page change time,
The update unit stores the changed page included in the page change instruction as a current display page in association with the identification information included in the page change instruction in the third storage unit.
The image processing apparatus according to claim 4 or 5. A first storage unit that stores identification information of a plurality of image processing apparatuses connected to the network;
A second storage unit that stores trajectory information indicating a trajectory on the display screen and page information in association with each other;
Synchronous mode for changing the display screen in conjunction with the identification information, the current display page indicating the page currently displayed on the display screen of the image processing device specified by the identification information, and the display screen of another image processing device Or a third storage unit that stores the synchronization information indicating any one of the asynchronous modes that are not linked to the display screen of another image processing apparatus and the page change time of the current display page in association with each other;
An image processing program for causing a computer equipped with
Generating a first trajectory image of trajectory information corresponding to the page information of the current display page of the identification information of the image processing device;
When at least the synchronization information of the image processing apparatus is in the asynchronous mode, the trajectory image of the trajectory information corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronous mode and the latest page change time is Generating a second trajectory image shown in a display form indicating that the trajectory image is an image at the latest page change time;
Generating a composite image of the first trajectory image and the second trajectory image;
Performing control to display the composite image on a display unit;
An image processing program for causing the computer to execute. An image processing system comprising a server device and a plurality of image processing devices connected to the server device via a network,
The image processing apparatus includes:
A first storage unit that stores identification information of a plurality of image processing apparatuses connected to the network;
A second storage unit that stores trajectory information indicating a trajectory on the display screen and page information in association with each other;
Synchronous mode for changing the display screen in conjunction with the identification information, the current display page indicating the page currently displayed on the display screen of the image processing device specified by the identification information, and the display screen of another image processing device Or a third storage unit that stores the synchronization information indicating any one of the asynchronous modes that are not linked to the display screen of another image processing apparatus and the page change time of the current display page in association with each other;
A first acquisition unit that acquires from the server device a mode change instruction including the synchronization information after the change and the identification information of the image processing device whose mode has been changed;
A first update unit that stores synchronization information included in the mode change instruction in the third storage unit as synchronization information corresponding to identification information included in the mode change instruction;
A first image generation unit for generating a first trajectory image of trajectory information corresponding to the page information of the currently displayed page of the identification information of the image processing apparatus;
When at least the synchronization information of the image processing apparatus is in the asynchronous mode, the trajectory image of the trajectory information corresponding to the page information of the current display page of the identification information whose synchronization information is the synchronous mode and the latest page change time is A second image generation unit for generating a second trajectory image shown in a display form indicating that the trajectory image is an image at the latest page change time;
A combining unit that generates a combined image of the first trajectory image and the second trajectory image;
A display control unit that performs control to display the composite image on a display unit;
With
The server device
The first storage unit;
The second storage unit;
The third storage unit;
A second acquisition unit that acquires the mode change instruction from at least one of the plurality of image processing devices;
A second updating unit that stores synchronization information included in the mode change instruction in the third storage unit as synchronization information corresponding to identification information included in the mode change instruction;
Comprising
Image processing system.

Images