JP6786898B2 - Image processing equipment, image processing systems, and programs - Google Patents

Description

The present invention relates to an image processing apparatus, an image processing system, and a program.

In recent years, an "electronic information board" in which a touch panel is mounted on a large display of about 40 to 80 inches using a flat panel such as liquid crystal or plasma or a projector has been used regardless of public or private institutions. It is already known that an electronic information board can display a large display screen of a connected PC by connecting a personal computer (hereinafter referred to as "PC").

Further, it is known that the connected PC can be operated by touching the display via the touch panel mounted on the electronic information board. Furthermore, the electronic blackboard application installed on the PC can be used to draw on the display of the electronic information board connected to the PC via touch operations, etc., so that the electronic information board can be used like a blackboard or whiteboard. It is already known that it can be used.

In addition, in the display screen, there is a picture-in-picture (hereinafter referred to as "PinP") function that reduces the sub-image displayed on the main display screen and has a different image source from the main image and superimposes it on the main image. Are known.

The above-mentioned techniques related to the PinP function are disclosed in, for example, Patent Document 1. In Patent Document 1, in a device having a PinP function, the display position of the auxiliary screen is not fixed or selectively displayed, but the composite position data or the like can be input by a position pointer or a selection circuit and can be freely changed by the user. In addition, a configuration is disclosed in which the arrangement of auxiliary screens is changed for use.

By the way, when the PinP function is combined with the electronic information board, when the sub image is superimposed and displayed on the main image displayed on the display by using the PinP function, the sub image is superimposed and displayed. Since the main image is hidden, it is not possible to draw on the hidden part. This is because the main image has a function of accepting the drawing process, whereas the sub image displayed by using the PinP function does not have the function of accepting the drawing process.

Therefore, by changing the display position of the sub image or changing the display position of the main image in order to secure the drawing area of the main image that is hidden by the sub image and disappears, it is hidden by the sub image and disappears. Processing such as making the part visible is required. If such a process is required for each drawing, for example, when explaining while showing the main image to the audience, the progress is stopped by the above process, which is very much for both the explainer and the audience. troublesome.

The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to smoothly execute processing on the main image even when the sub image is superimposed and displayed on the main image by the PinP function. To do.

In order to achieve the above object, the image processing apparatus of the present invention has an image display means for displaying an image that accepts a predetermined process on a screen, and a predetermined process for displaying an image that does not accept the predetermined process by the image display means. A superposed image display means for superimposing the image on the image to be displayed on the screen, a detecting means for detecting the contact or approach of an object to the screen, and a transmitting means for transmitting the detection result by the detecting means to another image processing device. The receiving means for receiving the detection result of the contact or approach of the object to the screen provided in the other image processing device, and the position where the contact or approach of the object to the screen is detected by the detecting means or the detection result received by the receiving means When the indicated position is included in the display area of the image displayed on the screen by the superimposed image display means that does not accept the predetermined process, the display control means for hiding the image that does not accept the predetermined process is provided. And.

According to the present invention, even when the sub image is superimposed on the main image and displayed by the PinP function, the processing for the main image can be smoothly executed.

It is the schematic of the image processing system in 1st Embodiment of this invention. It is a schematic block diagram of the image processing apparatus in 1st Embodiment of this invention. It is a functional block diagram of the image processing apparatus in the 1st Embodiment of this invention. It is a schematic diagram for demonstrating the process of hiding a PinP screen in embodiment of this invention. It is a schematic diagram for demonstrating another non-display processing of a PinP screen in embodiment of this invention. It is a flowchart which shows the processing procedure in 1st Embodiment of this invention. It is the schematic of the image processing system in the 2nd Embodiment of this invention. It is a schematic block diagram of the image processing apparatus in the 2nd Embodiment of this invention. It is a functional block diagram of the image processing apparatus in the 2nd Embodiment of this invention. It is a flowchart which shows the processing procedure in 2nd Embodiment of this invention.

The image processing system and the image processing apparatus included in the image processing system according to the embodiment of the present invention will be described with reference to the following drawings, but the present invention is not limited to the present embodiment as long as the gist of the present invention is not exceeded. In each figure, the same or corresponding parts are designated by the same reference numerals, and the duplicated description thereof will be appropriately simplified or omitted. Moreover, the embodiment described below is the best embodiment of the present invention, and does not limit the scope of claims according to the present invention.

In the present embodiment, an electronic information board will be described as an example of the image processing device, but the image processing device of the present invention is not limited thereto. For example, the present invention may be applied to a television having an information processing function as an image processing device, a personal computer, or the like.

[About the image processing system according to the first embodiment of the present invention]
The outline of the image processing system according to the first embodiment of the present invention will be described with reference to FIG. In FIG. 1, in the image processing system of the present embodiment, an electronic information board 1 as an image processing device and information processing devices 3a and 3b (representatively referred to as “information processing device 3”) are connected to an input / output cable 4. It is configured to be connected via. The information processing device 3 and the electronic information board 1 may be connected to each other via a network such as a LAN or a WAN.

An image acquired from the information processing device 3 can be displayed on the screen 11 of the electronic information board 1. Further, the electronic information board 1 can display the PinP screen 12 overlapping the screen 11 by the PinP function. The image acquired from the information processing device 3a can be displayed on the screen 11, and the image overlapping the image acquired from the information processing device 3a displayed on the screen 11 can be acquired from the information processing device 3b and displayed on the PinP screen 12. .. In the following, the area where the PinP screen 12 is displayed will be referred to as a “PinP area”. The PinP area may be the same size as the PinP screen 12 or may be larger than the PinP screen 12.

Further, the electronic information board 1 is provided with, for example, a touch panel or the like as a detection means for detecting the contact or approach of an object to the screen 11. When the object is a touch pen for drawing on the screen 11, the electronic information board 1 can display the image drawn by the user on the screen 11 by using the touch pen. In this embodiment, it will be described below assuming that drawing cannot be performed on the PinP screen 12.

The information processing device 3a and the information processing device 3b are provided with an interface for outputting an image signal, and a predetermined image signal forming a display image of the information processing device 3a and the information processing device 3b is output, for example, 30 frames per second. It is supplied to the electronic information board 1 at a rate.

Further, in the present embodiment, the information processing device 3a and the information processing device 3b are provided with a video output terminal such as VGA as an interface, and a video signal is transmitted to the electronic information board 1 via an input / output cable 4 such as a VGA cable. Can be sent. The information processing device 3a and the information processing device 3b may transmit the display image to the electronic information board 1 by wireless communication conforming to various wireless communication protocols. In the information processing device 3a and the information processing device 3b, an interface for outputting an image signal, a video output terminal, and means for transmitting the image signal or video signal to the electronic information board 1 by wireless communication are used as transmission means.

In FIG. 1, a notebook PC is adopted as the information processing device 3a and the information processing device 3b, but the present invention is not limited to this. For example, it goes without saying that an information processing device capable of supplying image frames such as a desktop PC, a tablet PC, a PDA, a digital video camera, and a digital camera can be adopted. Further, in the image processing system shown in FIG. 1, two information processing devices 3a and three or more information processing devices 3b are adopted, but the present invention is not limited to this, and one user PC or three or more user PCs may be adopted. May be good.

Next, the schematic configuration of the electronic information board 1 in the present embodiment will be described with reference to FIG.
The electronic information board 1 includes an image input interface 232, and is connected to the information processing device 3a and the information processing device 3b via this interface. The image input interface 232 is an interface for receiving an image signal forming a display image of the information processing device 3a and the information processing device 3b. This interface is used as a receiving means for receiving an image signal from the information processing device.

In the present embodiment, a DVI connector composed of DVI (Digital Visual Interface) terminals can be adopted as the image input interface 232. The image input interface 232 receives a VGA signal from the information processing device 3a and the information processing device 3b via an input / output cable 4 such as a VGA cable, and supplies the VGA signal to the image acquisition unit 206 included in the electronic information board 1.

On the other hand, as the image input interface 232, a VGA (Video Graphics Array) connector, an HDMI (High-Definition Multimedia Interface _, registered trademark) connector and the like can be adopted. Further, as the image input interface 232, a Displayport connector can be adopted. Further, the image input interface 232 may receive an image signal from the information processing device 3a and the information processing device 3b by wireless communication compliant with a wireless communication protocol such as Bluetooth (registered trademark) or WiFi.

The electronic information board 1 includes a processor 200, a ROM 202, a RAM 204, an image acquisition unit 206, a coordinate detection unit 224, a coordinate detection device 226, and a display unit 112.

The processor 200 is a processing arithmetic unit such as a CPU or MPU, and operates an OS such as WINDOWS (registered trademark) series, UNIX (registered trademark), LINUX (registered trademark), TRON, ITRON, or μITRON. The processor 200 executes the program of the present embodiment described in a programming language such as, for example, assembler, C, C ++, Java (registered trademark), Javascript (registered trademark), Perl, RUBY, PYTHON, etc. under the control of these OSs. To do.

The ROM 202 is a non-volatile memory in which boot programs such as BIOS and EFI are stored. The RAM 204 is a main storage device such as a DRAM or SRAM, and provides an execution space for executing the program of the present embodiment.

The processor 200 reads a program from a hard disk device for continuously holding a software program, various data, and the like, expands the program in RAM 204, and executes the program.

The program includes an event processing unit 210, an application image generation unit 212, a layout management unit 214, a drawing generation unit 216, a composition unit 218, and an image display control unit 220, which are program modules. The program also includes a snapshot generation unit 222, a snapshot storage unit 236, a snapshot transmission unit 238, and a repository management unit 228.

The image acquisition unit 206 is a functional means for acquiring an image signal from the information processing device 3a and the information processing device 3b. When the image acquisition unit 206 receives an image signal from the information processing device 3a and the information processing device 3b via the image input interface 232, the image acquisition unit 206 analyzes the image signal. The image acquisition unit 206 derives image information such as the resolution of the image frame which is the display image of the information processing device 3a and the information processing device 3b formed by the image signal and the update frequency of the image frame, and is an application image generation unit. Send to 212.

Further, the image acquisition unit 206 forms an image frame which is a display image of the information processing device 3a and the information processing device 3b by using the image signal, and is a storage means which can temporarily store the image data. Each is overwritten and saved in RAM 208.

The application image generation unit 212 is a functional means for generating various display windows to be displayed on the display unit 112. The display window includes a display window for displaying an image frame which is a display image of the information processing device 3a and the information processing device 3b, and a display window for displaying a drawn image generated by the user. Further, the display window includes a display window for displaying buttons, menus, and the like for performing various settings of the electronic information board 1, for example, a display window for a file viewer, a Web browser, and the like. The application image generation unit 212 draws these display windows on the image layer on which the display window should be drawn.

The layout management unit 214 is a functional means for drawing the display images of the information processing device 3a and the information processing device 3b on the display window generated by the application image generation unit 212. When the layout management unit 214 acquires the image information from the image acquisition unit 206, the layout management unit 214 acquires the image frame stored in the video RAM 208. The layout management unit 214 uses the image information to change the size of the image frame so as to match the size of the display window generated by the application image generation unit 212, and the image layer on which the image frame should be drawn. Draw on.

The coordinate detection device 226 is a functional means for detecting the contact of an object such as the drawing device 240. In the present embodiment, as the coordinate detection device 226, a coordinate input device based on an infrared blocking method is adopted. In this coordinate input device, two light receiving / receiving devices installed at both lower ends of the display unit 112 emit a plurality of infrared rays in parallel with the display unit 112, and retroreflection is provided around the display unit 112. It receives light reflected on the same light path by the member.

The coordinate detection device 226 notifies the coordinate detection unit 224 of the infrared identification information emitted by the two light emitting / receiving devices blocked by the indicating object, and the coordinate detection unit 224 identifies the coordinate position which is the contact position of the indicating object. To do.

On the other hand, a capacitance type touch panel that specifies a contact position by detecting a change in capacitance, and a resistance film type touch panel that specifies a contact position by a voltage change of two opposing resistance films may be adopted. .. Further, various detection means such as an electromagnetic induction type touch panel that detects the electromagnetic induction generated by the contact of the contact object with the display unit 112 and specifies the contact position may be adopted.

The coordinate detection unit 224 is a functional means for calculating the coordinate position, which is the contact position of the indicating object with respect to the display unit 112, and issuing various events. In the present embodiment, the coordinate detection unit 224 calculates the coordinate position of the contact position of the object by using the blocked infrared identification information notified by the coordinate detection device 226.

The coordinate detection unit 224 issues various events to the event processing unit 210 together with the coordinate position of the contact position. The event issued by the coordinate detection unit 224 includes an event (TOUCH) for notifying that the object has touched or approached, and a notification that the contact point or approach point has moved while the object is in contact with or close to the display unit 112. Events (MOVE) are included. Further, the event issued by the coordinate detection unit 224 includes an event (RELEASE) for notifying that the object has left the display unit 112. These events include coordinate position information which is contact position coordinates and approach position coordinates.

The drawing device 240 is a device that draws by contacting the coordinate detection device 226 of the electronic information board 1. The drawing device 240 has a pen shape having a contact detecting means for detecting the contact of an object at its tip, and when the contact detecting device comes into contact with an object, the drawing device 240 sends a contact signal indicating that the contact is made. It is transmitted to the coordinate detection unit 224 together with the identification information.

Further, the drawing device 240 has a function of erasing the drawn drawing object. The drawing device 240 is provided with a mode changeover switch on the side surface or the rear end portion for switching from the drawing mode to the erase mode. When the contact detecting means comes into contact with an object in the erasing mode, a signal indicating the contact and a signal in the erasing mode are transmitted to the coordinate detection unit 224 together with the identification information of the drawing device 240. The drawing device 240 allows the user to select objects such as menus and buttons displayed on the display unit 112.

When the drawing device 240 is brought into contact with the display unit 112 of the electronic information board 1 while the user presses the erase mode changeover switch, the drawing device 240 erases the drawing device 240 together with the contact signal and the identification information of the drawing device 240. A mode type signal indicating the mode is transmitted. When the drawing device 240 is brought into contact with the electronic information board 1 without the user pressing the erase mode changeover switch, the drawing device 240 transmits the contact signal and the identification information of the drawing device 240.

In the present embodiment, when the coordinate detection unit 224 receives the infrared identification information from the coordinate detection device 226, it calculates the coordinate position which is the contact position of the indicating object, and then receives the contact signal from the drawing device 240. Publish various events. At this time, the coordinate detection unit 224 notifies the event processing unit 210 of the information indicating the mode type (hereinafter, referred to as “mode type information”) together with the event.

In this embodiment, various signals are transmitted by short-range wireless communication such as Bluetooth (registered trademark). In addition, various signals can be transmitted by wireless communication using ultrasonic waves or infrared rays.

The event processing unit 210 is a functional means for processing an event issued by the coordinate detection unit 224. When the event processing unit 210 receives an event from the coordinate detection unit 224, the event processing unit 210 performs the following processing. That is, the event processing unit 210 identifies whether it is a drawing instruction event in the drawing area, an erasure instruction event, or an event in the PinP area in addition to the above two events, and executes each function. To do. In addition, the event processing unit 210 identifies whether or not it is a selection notification event that selects an icon for each function displayed on the display unit 112, and executes each function.

The drawing instruction event is an event that instructs the electronic information board 1 to draw. The erasure instruction event is an event for erasing the object drawn on the electronic information board 1.

The event in the PinP area is an event for notifying that an image of either the information processing device 3a or the information processing device 3b is performing a drawing instruction event or an erasing event in the PinP area where the PinP screen 12 is displayed. Is. The drawing instruction event, the erasing event, and the event in the PinP area are issued due to the drawing device 240 coming into contact with the display unit 112.

The selection notification event is an event indicating that various objects such as buttons and menu bars that make up the screen displayed on the display unit 112 have been selected. The selection notification event is issued due to the drawing device 240 coming into contact with the display unit 112. The event processing unit 210 issues a selection notification event when the coordinate position information included in the event issued by the coordinate detection unit 224 is within the coordinate area of the object.

In the present embodiment, identification information is assigned to each of the drawing instruction event and the selection notification event, and the functional means of the electronic information board 1 that operates by using these events as a trigger is various with reference to the identification information. Execute the processing of. Further, the identification information of the selected object is added to the selection notification event, and the functional means of the electronic information board 1 that operates by using the selection notification event as a trigger refers to the identification information of the object and performs various processes. To execute.

The drawing generation unit 216 is a functional means for generating a drawing image drawn by the user by the drawing device 240. The drawing generation unit 216 generates an image layer in which the color of the coordinate position indicated by the coordinate position information is changed to a specific color. The drawing generation unit 216 stores the coordinate position as drawing information in the drawing information storage area of the RAM 204.

The compositing unit 218 is a functional means for compositing various images. In the compositing unit 218, the application image generation unit 212 should draw an image layer (hereinafter referred to as “app image layer”) on which the image should be drawn, and the layout management unit 214 should draw the display image of the information processing devices 3a and 3b. The image layer (hereinafter referred to as "image capture layer") and the image layer on which the drawing generation unit 216 should draw an image (hereinafter referred to as "handwriting layer") are combined.

The image display control unit 220 is a functional means for controlling the display unit 112. The image display control unit 220 displays the composite image generated by the composite unit 218 on the display unit 112. In the present embodiment, the synthesis unit 218 calls the image display control unit 220 to display the composite image on the display unit 112. Further, the compositing unit 218 and the image display control unit 220 may synthesize the image layers and display them on the display unit 112 at the same frequency as the update frequency of the image frame included in the image information.

The snapshot generation unit 222 is a functional means for generating a snapshot image which is a composite image of the display image of the information processing device 3a and the information processing device 3b and the drawing image generated by the drawing generation unit 216.

When the snapshot generation unit 222 receives the selection notification event indicating that the snapshot button instructing the acquisition of the snapshot displayed on the display unit 112 has been selected, the snapshot generation unit 222 synthesizes the image capture layer and the handwriting layer and snaps them. Generate a shot image. When the snapshot generation unit 222 generates the snapshot image, the snapshot image is stored in the storage device 230 for the repository management unit 228.

The snapshot storage unit 236 is a functional means for storing the snapshot image stored in the storage device 230 through the repository management unit 228 in an external storage device such as a USB memory 242 through the data output interface 234.

When the snapshot saving unit 236 receives the selection notification event indicating that the snapshot saving button for instructing the saving of the snapshot displayed on the display unit 112 has been selected, the snapshot saving unit 236 performs the following processing. That is, the snapshot storage unit 236 acquires the snapshot image stored in the storage device 230 through the repository management unit 228, and outputs the snapshot image to the external storage device connected to the data output interface 234.

The snapshot transmission unit 238 is a functional means for transmitting the snapshot image stored in the storage device 230 through the repository management unit 228 to a server or the like outside the image processing device through the communication control unit 250.

When the snapshot transmission unit 238 receives the selection notification event indicating that the snapshot transmission button for instructing the transmission of the snapshot displayed on the display unit 112 has been selected, the snapshot transmission unit 238 performs the following processing. That is, the snapshot transmission unit 238 acquires the snapshot image stored in the storage device 230 through the repository management unit 228, and outputs the snapshot image to the communication control unit 250.

The communication control unit 250 transmits a snapshot image to an external server or the like of the electronic information board 1 via a communication unit 252 by a predetermined communication protocol such as FTP or SMTP.

The repository management unit 228 is a functional means for controlling the storage device 230 for storing the snapshot image. As described above, the repository management unit 228 stores the snapshot image in the storage device 230 according to the instruction of the snapshot generation unit 222. Further, the repository management unit 228 acquires a snapshot image from the storage device 230 and transmits it to the data output interface 234 or the communication control unit 250 according to the instruction of the snapshot storage unit 236 or the snapshot transmission unit 238.

The data output interface 234 is a physical interface that outputs a snapshot image to an external device. In this embodiment, a USB socket can be adopted as the data output interface 234.

The electronic information board 1 includes a communication control unit 250 and a communication unit 252. The communication control unit 250 is a functional means for controlling communication between image processing devices via a network. The communication unit 252 is a network interface with the network. The communication control unit 250 communicates authentication information, image data such as image frames and snapshot images, drawing information, and information such as events via the communication unit 252.

Next, the functional blocks of the image processing apparatus according to the present embodiment will be described with reference to FIG. The image processing device in the present embodiment includes an image display unit 21, a superposed image display unit 22, a detection unit 23, and a display control unit 24 as functional blocks.

The image display unit 21 is an image display means for displaying on the screen an image that is accepted for drawing by the drawing device 240, which is a predetermined process, and is the above-mentioned application image generation unit 212, layout management unit 214, drawing generation unit 216, and image display. The function is executed by the control unit 220 or the like. The image that accepts a predetermined process such as drawing means an image having a function of reading a processing signal such as a drawing signal input by the drawing device 240, taking drawing as an example.

The superimposed image display unit 22 is a superimposed image display unit that superimposes an image that does not accept a predetermined process on an image that accepts a predetermined process displayed by the image display unit 21 and displays it on the screen. The function of the superimposed image display unit 22 is executed by the above-mentioned application image generation unit 212, layout management unit 214, drawing generation unit 216, composition unit 218, image display control unit 220, and the like. The image that does not accept the predetermined processing is an image that is displayed on top of the layer displayed as the main screen, such as the PinP screen 12 described above, and accepts drawing by the drawing device 240. It refers to images that cannot be used.

The detection unit 23 is a detection means for detecting the contact or approach of an object to the screen, and its function is executed by the coordinate detection device 226 and the coordinate detection unit 224 described above. The detection unit 23 is not limited to the infrared blocking method in the present embodiment, and may detect the coordinates from the contact position by a capacitance method or an electromagnetic induction method.

When the position where the contact or approach of the object to the screen is detected by the detection unit 23 is included in the display area of the image displayed on the screen by the superimposed image display unit 22 and which does not accept the predetermined processing, the display control unit 24 This is a display control means for hiding an image that does not accept a predetermined process. The function of the display control unit 24 is executed by the event processing unit 210, the application image generation unit 212, the layout management unit 214, the drawing generation unit 216, the composition unit 218, the snapshot generation unit 222, and the like described above.

In the present embodiment, the display image of the information processing apparatus 3 excluding the image layer set to be displayed on the PinP screen 12 by the compositing unit 218 is synthesized together with the other layers. As a result, the PinP screen 12 is not displayed in the combined image. Such a process is included in the process of "hiding the image" in the present embodiment. Further, the display control unit 24 displays the image drawn by the drawing generation unit 216 after the drawing instruction event is processed by the event processing unit 210.

Specifically, when the coordinate detection unit 224 issues an event in the PinP region, the event processing unit 210 passes the composite image generated by the composite unit 218 through the image display control unit 220 until another event is issued. Is displayed on the display unit 112. Other events include, for example, an event other than a drawing operation using a finger or a stylus by the user, a selection notification event described above, and the like.

The composite image generated by the synthesis unit 218 is obtained by synthesizing the display image of the information processing device 3 together with other layers, excluding the image layer set to be displayed on the PinP screen 12 from the display image of the information processing device 3. It is an image.

When a user starts drawing with a finger, a stylus, or the like in an image display area that does not accept a predetermined process, the image that does not accept the predetermined process is hidden. As a result, the drawing area is not hidden by the image that does not accept the predetermined processing, and the processing can be continued without interrupting the drawing.

Further, the display control unit 24 determines in the display area of the image displayed on the screen by the superimposed image display unit 22 until the contact or approach of the object to the screen by the detection unit 23 is not detected. The image that does not accept the processing of may be hidden.

Specifically, the coordinate position information generated by the drawing generation unit 216 stored in the drawing information storage area of the RAM 204 is processed as follows as long as it is drawn in the PinP display area. That is, the compositing unit 218 synthesizes the display image of the user PC together with the other layers, excluding the image layer set to be displayed on the PinP screen 12 from the display image of the information processing device 3.

As a result, for example, the PinP screen 12 is hidden while the user is drawing with a finger, a stylus, or the like, or while the drawn image is being erased. Therefore, the drawing process is blocked by the display of the image that the user does not accept the predetermined process. It will never be done.

Further, the display control unit 24 may perform the following processing in the display area of the image displayed on the screen by the superimposed image display unit 22 and not accepting the predetermined processing. That is, it is a process of hiding an image that does not accept the predetermined process for a certain period of time after the contact or approach of the object to the screen by the detection unit 23 is not detected.

Specifically, when the event processing unit 210 issues an event in the PinP area, the compositing unit 218 generates the compositing unit 218 through the image display control unit 220 for a predetermined time after the other events are issued. The image is displayed on the display unit 112.

As a result, the main image is not hidden by the display of the PinP screen 12 for a predetermined time after the display unit 112 is no longer in contact with the PinP area, and the drawing is performed without being affected by the PinP screen 12 during drawing. Can be done.

Next, the outline of the non-display processing of the PinP screen 12 in the present embodiment will be described with reference to FIG. FIG. 4A is a diagram showing a state in which the PinP screen 12, which is an image that does not accept a predetermined process, is displayed on the screen 11 that displays the display image of the information processing device 3 on the screen 11. In this case, the touch pen 13 cannot draw on the display area of the PinP screen 12.

On the other hand, as shown in FIG. 4B, according to the above-described processing according to the present embodiment, the PinP screen 12 is hidden when the touch pen 13 detects contact with the display area of the PinP screen 12. As a result, it is possible to draw in the area of the screen 11 hidden by the PinP screen 12.

As shown in FIG. 5, the size of the PinP area 14 is made larger by the coordinate width 14a than the size of the PinP screen 12. Further, when the detection unit 23 detects drawing on the PinP area 14 by the drawing device 240 in the coordinate width 14a, that is, contact or the like, the display control unit 24 hides the PinP screen 12 previously displayed in the PinP area 14. It may be. As a result, the PinP screen 12 can be hidden before the drawn image is applied to the PinP screen 12.

Since operations such as drawing are not accepted while the PinP screen 12 is displayed, operability such as drawing deteriorates during that time. According to the above process, the PinP screen 12 is hidden when the drawing is detected in the coordinate width 14a of the PinP area 14, so that the drawing operation can be smoothly executed and the operability is improved.

Next, the outline of the processing procedure in the present embodiment will be described with reference to FIG. First, the image display unit 21 displays the display image of the information processing device 3a or 3b (step S1).

After that, the superimposed image display unit 22 superimposes and displays the PinP screen 12 on the display image of the information processing device 3a or 3b (step S2).

The detection unit 23 detects the contact or approach of an object in the PinP region, and determines whether or not a drawing instruction event has been issued (step S3). When the drawing instruction event is issued (step S3, YES), the display control unit 24 hides the PinP screen 12 (step S4). On the other hand, when the drawing instruction event is not issued (step S3, NO), the detection of the contact or approach of the object in the PinP region is continued (step S3).

After the non-display processing of the PinP screen 12, the display control unit 24 displays the image to be drawn after the drawing instruction event is processed (step S5).

[About the image processing system according to the second embodiment of the present invention]
The image processing system according to the second embodiment of the present invention will be described with reference to FIG. The description of the same configuration as that of the first embodiment and the overlapping configuration will be omitted.

The image processing system according to the second embodiment is a system in which an electronic information board 1a and an electronic information board 1b (representatively referred to as "electronic information board 1") are connected via a network 10. In FIG. 7, the cable connecting the electronic information board 1 and the network 10 is a communication cable 5.

The electronic information board 1a and the electronic information board 1b are connected to the network 10 by a communication cable 5. The network 10 is, for example, a LAN (Local Area Network), the Internet, or the like, and various data can be communicated between the electronic information board 1a and the electronic information board 1b.

In the present embodiment, the electronic information board 1a and the electronic information board 1b are image data to be displayed on both screens 11a and 11b (representatively referred to as "screen 11"), and drawing issued on either of them. Information such as events is transmitted and received to and from each other via the network 10. Note that FIG. 7 shows a configuration in which only two electronic information boards 1a and 1b are connected via the network 10, but the present invention is not limited to this, and three or more electronic information boards 1 may be used. It may be connected.

Further, FIG. 7 shows a configuration in which the information processing device 3a and the information processing device 3b are connected to the electronic information board 1a, and the information processing device 3c and the information processing device 3d are connected to the electronic information board 1b. It's just that. The PinP screen 12 on the electronic information board 1a is referred to as a PinP screen 12a, and the PinP screen 12 on the electronic information board 1b is referred to as a PinP screen 12b (representally referred to as "PinP screen 12"). In the following description, the information processing devices 3a to 3d will be referred to as "information processing device 3".

Further, in the present embodiment, the electronic information board 1a and the electronic information board 1b will be described as being devices having the same functions. On the other hand, the present invention is not limited to the present embodiment, and the electronic information boards are connected so that an image displayed or drawn on one electronic information board can be displayed and shared on the other electronic information board. All you need is.

Further, in the present embodiment, when the information processing device 3 is connected to the electronic information board 1, the image based on the video signal output from the information processing device 3 connected to any of the electronic information boards 1 is electronic. It shall be displayed on the screen 11 of the information board 1. On the other hand, when no video signal is output from the information processing device 3 and nothing is displayed on the screen 11 of any of the electronic information boards 1, the screen of the application stored in the electronic information board 1 is displayed. And.

Next, the schematic configuration of the electronic information board 1 which is the image processing apparatus in the second embodiment will be described with reference to FIG. The description of the configuration overlapping with the configuration of the electronic information board 1 in the first embodiment will be omitted. That is, the second embodiment is different from the configuration of the first embodiment in that the communication unit 252 and the communication control unit 250 also control communication with both electronic information boards 1.

In the electronic information board 1, the communication control unit 250 and the like can set the cooperation between the devices, and can transmit and receive information such as image data, various events, and various setting values to and from each other. When the same image as the image displayed on the screen 11a of the electronic information board 1a is displayed on the screen 11b of the electronic information board 1b, the image data drawn on the screen 11a on the electronic information board 1a is also shared and the electronic information board. It is reflected on the screen 11b of 1b.

On the other hand, the PinP screen 12a displayed in the PinP area of the electronic information board 1a and the PinP screen 12b displayed in the PinP area of the electronic information board 1b are not shared, and different images specified in the electronic information board 1 are displayed. It shall be. On the other hand, the present invention is not limited to this, and the PinP screen 12 displayed in the PinP area of the electronic information board 1 may be set to be shared.

Next, the functional block of the image processing apparatus according to the second embodiment will be described with reference to FIG. The same description as the functional block shown in FIG. 3 will be omitted. Further, the image processing device that is the transmission destination of the display image and various events is referred to as the electronic information board 1a, and the image processing device that is the reception destination of the display image and various events is referred to as the electronic information board 1b. Further, the functional blocks of the electronic information board shall be distinguished by adding the respective codes "a" and "b" after the number symbols attached to the respective functional blocks.

The first communication unit 25a is a communication means for transmitting a display image displayed on the electronic information board 1a, a drawing event to be issued, and the like to the electronic information board 1b, and the communication control unit 250 and the communication unit 252 shown in FIG. That function is realized. The second communication unit 25b is a communication means for receiving a display image, a drawing event, or the like transmitted from the electronic information board 1a, and its functions are realized by the communication control unit 250 and the communication unit 252 shown in FIG.

Next, the processing procedure in the second embodiment will be described with reference to FIGS. 9 and 10. In the second embodiment, the image displayed on the screen 11a based on the video signal output from the information processing device 3 connected to the electronic information board 1a is shared by the electronic information board 1b and reflected on the screen 11b. This will be described using an example. Further, an example will be described in which an image drawn on the screen 11a of the electronic information board 1a is shared by the electronic information board 1b and a similar drawn image is reflected on the screen 11b.

First, the image display unit 21a on the electronic information board 1a displays the image a output from the information processing device 3a or the information processing device 3b on the screen 11a (step S11).

Next, the data of the image a is transmitted to the electronic information board 1b by the first communication unit 25a of the electronic information board 1a (step S12).

When the data of the image a is received by the second communication unit 25b on the electronic information board 1b, the image display unit 21b on the electronic information board 1b displays the image a on the screen 11b (step S13).

The superimposed image display unit 22a on the electronic information board 1a superimposes the PinP screen 12a on the image a and displays it (step S14). On the other hand, the superimposed image display unit 22b on the electronic information board 1b superimposes the PinP screen 12b on the image a and displays it (step S15).

After that, it is drawn on the screen 11a by the drawing device 240, and a drawing instruction event is issued on the electronic information board 1a (step S16). A signal indicating that a drawing instruction event has been issued by the communication control unit 250 and the communication unit 252 on the electronic information board 1a is transmitted to the electronic information board 1b (step S17). Further, the display control unit 24a of the electronic information board 1a hides the PinP screen 12a (step S18).

Upon receiving the signal indicating that the drawing instruction event has been issued by the second communication unit 25b on the electronic information board 1b, the display control unit 24b on the electronic information board 1b hides the PinP screen 12b (step S19). The process is not limited to this, and the PinP screen 12b may be hidden when a signal indicating that the PinP screen 12a on the electronic information board 1a is hidden is received.

After that, the display control unit 24a of the electronic information board 1a displays an image drawn on the portion of the image a in which the PinP screen 12a is hidden (step S20). Further, the display control unit 24b of the electronic information board 1b displays the image drawn by the electronic information board 1a on the portion of the image a in which the PinP screen 12b is hidden (step S21).

In the above procedure, an embodiment in which the electronic information board 1b receives an image a displayed on the screen 11a, a signal indicating that a drawing instruction event has been issued, or the like on the electronic information board 1a has been described. On the other hand, in the electronic information board 1b, the electronic information board 1a receives an image b displayed on the screen 11b, a signal indicating that a drawing instruction event has been issued, and the like, and performs the same processing as in the above-described embodiment. Needless to say, it may be.

As described above, according to the second embodiment, operations such as drawing can be performed without the image displayed on the screen 11 of the electronic information board 1 being hidden by the image displayed in the PinP area. As a result, the drawing operation is not blocked by the PinP screen 12a on the electronic information board 1a on the side that accepts the drawing operation. Further, also on the electronic information board 1b of the connection destination, the image drawn on the electronic information board 1a is displayed without being blocked by the PinP screen 12b. Therefore, when a remote conference or the like is held between the bases by using the electronic information boards 1a and 1b installed at different bases, the conference or the like can be smoothly proceeded.

It should be noted that each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the gist of the present invention. For example, each process in the image processing device and the image processing system of the present embodiment described above can be executed by hardware, software, or a composite configuration of both.

When executing processing by software, it is possible to install and execute a computer-readable program that records the processing sequence in the memory, that is, the storage unit in the computer embedded in the dedicated hardware. is there. Alternatively, the program can be installed and executed on a general-purpose computer capable of executing various processes.

1, 1a, 1b Electronic information board 3a, 3b, 3c, 3d Information processing device 4 Input / output cable 5 Communication cable 10 Network 11, 11a, 11b Screen 12, 12a, 12b PinP screen 21 Image display unit (image display means)
22 Superimposed image display unit (superimposed image display means)
23 Detection unit (detection means)
24 Display control unit (display control means)
25a 1st communication unit 25b 2nd communication unit 112 Display unit 200 Processor 202 ROM
204 RAM
206 Image acquisition unit 208 Video RAM
210 Event processing unit 212 App image generation unit 214 Layout management unit 216 Drawing generation unit 218 Synthesis unit 220 Image display control unit 222 Snapshot generation unit 224 Coordinate detection unit 226 Coordinate detection device 228 Repository management unit 230 Storage device 232 Image input interface 234 Data output interface 236 Snapshot storage unit 238 Snapshot transmission unit 240 Drawing device 242 USB memory 250 Communication control unit 252 Communication unit

Japanese Patent Application Laid-Open No. 07-046564

Claims (5)

An image display means for displaying an image that accepts a predetermined process on the screen,
An superimposed image display means that superimposes an image that does not accept a predetermined process on an image that accepts the predetermined process displayed by the image display means and displays it on the screen.
A detection means for detecting the contact or approach of an object to the screen,
A transmission means for transmitting the detection result by the detection means to another image processing device, and
A receiving means for receiving the detection result of contact or approach of an object to the screen provided in the other image processing device, and
The predetermined process in which the position where the contact or approach of an object to the screen is detected by the detection means or the position indicated by the detection result received by the receiving means is displayed on the screen by the superimposed image display means is accepted. An image processing apparatus comprising: a display control means for hiding an image that does not accept the predetermined process when it is included in a display area of a non-existent image. The display control means does not detect contact or approach of an object to the screen by the detection means in a display area of an image displayed on the screen by the superimposed image display means that does not accept the predetermined process. The image processing apparatus according to claim 1, wherein an image that does not accept the predetermined processing is hidden. The display control means does not detect contact or approach of an object to the screen by the detection means in a display area of an image displayed on the screen by the superimposed image display means that does not accept the predetermined process. The image processing apparatus according to claim 1 or 2, wherein an image that does not accept the predetermined processing is hidden for a certain period of time later. An image processing system in which a first image processing device and a second image processing device are connected.
The first image processing apparatus is
An image display means for displaying an image that accepts a predetermined process on the screen,
An superimposed image display means that superimposes an image that does not accept a predetermined process on an image that accepts the predetermined process displayed by the image display means and displays it on the screen.
A detection means for detecting the contact or approach of an object to the screen,
A transmission means for transmitting the detection result by the detection means to the second image processing device is provided.
The second image processing device is
An image display means for displaying an image that accepts a predetermined process on the screen,
An superimposed image display means that superimposes an image that does not accept a predetermined process on an image that accepts the predetermined process displayed by the image display means and displays it on the screen.
A receiving means for receiving the detection result by the detecting means included in the first image processing device, and
When the position indicated by the detection result received by the receiving means is included in the display area of the image displayed on the screen by the superimposed image display means that does not accept the predetermined process, the image that does not accept the predetermined process is displayed. Display control means to hide
An image processing system characterized by being equipped with. The process of displaying an image that accepts a predetermined process on the screen, and
A process of superimposing an image that does not accept a predetermined process on an image that accepts a predetermined process displayed on the screen and displaying the image on the screen.
The process of detecting the contact or approach of an object to the screen, and
The process of transmitting the result of the detected process to another image processing device, and
The process of receiving the detection result of the contact or approach of an object to the screen provided in the other image processing device, and
When the position where the contact or approach of the object to the screen is detected or the position indicated by the received detection result is included in the display area of the image displayed on the screen that does not accept the predetermined process, the predetermined position is specified. A program characterized by having a computer execute a process of hiding an image that does not accept the process.

Images