JP2017010548A - Image processing apparatus, image processing system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To smoothly process a main image even when a sub image is displayed over a main image through a PinP function.SOLUTION: An image processing apparatus comprises: image display means of displaying an image to accept predetermined processing on a screen; superposed image display means of displaying, on the screen, an image not to accept the predetermined processing over the image to accept the predetermined processing that the image display means displays; detection means of detecting a body being in contact with or close to the screen; and display control means of placing the image not to accept the predetermined processing in a non-display state when the position where the detection means detects the body being in contact with or close to the screen is included in a display region of the image not to accept the predetermined processing that the superposed image display means displays on the screen.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus, an image processing system, and a program.

  In recent years, an “electronic information board” in which a touch panel is mounted on a large display of about 40 to 80 inches using a flat panel such as liquid crystal or plasma or a projector has been used regardless of public or private institutions. It is already known that an electronic information board can display a large display screen of a connected PC by connecting a personal computer (hereinafter referred to as “PC”).

  In addition, it is known that a connected PC can be operated by a touch operation on a display via a touch panel mounted on an electronic information board. Furthermore, an electronic information board such as a blackboard or a whiteboard can be used by drawing on the display via a touch operation on the display of the electronic information board connected to the PC by an electronic blackboard application installed on the PC. It is already known that it can be used.

  In addition, a picture-in-picture (hereinafter referred to as “PinP”) function is provided in which a sub-image having a different image source from the main image displayed on the main display screen is reduced and superimposed on the main image. Are known.

  A technique related to the PinP function as described above is disclosed in, for example, Patent Document 1. In Patent Document 1, the device having the PinP function is not a method of fixing or selecting the display position of the auxiliary screen, but can be freely changed on the user side by inputting composite position data or the like by a position pointer or a selection circuit. And the structure which changed and used the arrangement | positioning of an auxiliary | assistant screen, etc. is disclosed.

  By the way, when the PinP function is combined with the electronic information board, when the sub image is superimposed and displayed on the main image displayed on the display, the sub image is superimposed and displayed. Since the main image is hidden, it cannot be drawn in the hidden portion. This is because the main image has a function of accepting a drawing process, whereas the sub-image displayed using the PinP function does not have a function of accepting a drawing process.

  For this reason, the display position of the sub image was changed again in order to secure the drawing area of the main image that was hidden behind the sub image, or the main image was hidden behind the sub image. Processing such as making the portion visible is necessary. If such processing is required for each drawing, for example, when explaining while showing the main image to the audience, the above process stops the progress, which is very much for both the presenter and the audience. troublesome.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to smoothly execute processing on a main image even when a sub image is superimposed on the main image and displayed by the PinP function. To do.

  In order to achieve the above object, an image processing apparatus according to the present invention includes an image display unit that displays an image that accepts a predetermined process on the screen, and a predetermined process that displays an image that does not accept the predetermined process by the image display unit. The superimposed image display means for superimposing the image on the screen for receiving the image, the detection means for detecting the contact or approach of the object to the screen, and the position at which the contact or approach of the object to the screen is detected by the detection means are superimposed. And display control means for hiding an image that does not accept the predetermined process when it is included in the display area of the image that does not accept the predetermined process displayed on the screen by the image display means.

  According to the present invention, even when a sub image is superimposed and displayed on the main image by the PinP function, the process for the main image can be executed smoothly.

1 is a schematic diagram of an image processing system in a first embodiment of the present invention. 1 is a schematic configuration diagram of an image processing apparatus according to a first embodiment of the present invention. 1 is a functional block diagram of an image processing apparatus according to a first embodiment of the present invention. It is a schematic diagram for demonstrating the non-display process of the PinP screen in embodiment of this invention. It is a schematic diagram for demonstrating the other non-display process of the PinP screen in embodiment of this invention. It is a flowchart which shows the process sequence in 1st Embodiment of this invention. It is the schematic of the image processing system in 2nd Embodiment of this invention. It is a schematic block diagram of the image processing apparatus in 2nd Embodiment of this invention. It is a functional block diagram of the image processing apparatus in 2nd Embodiment of this invention. It is a flowchart which shows the process sequence in 2nd Embodiment of this invention.

  An image processing system and an image processing apparatus included in the image processing system according to an embodiment of the present invention will be described below with reference to the drawings. However, the present invention is not limited to the present embodiment as long as the gist of the present invention is not exceeded. In addition, in each figure, the same code | symbol is attached | subjected to the part which is the same or it corresponds, The duplication description is simplified thru | or abbreviate | omitted suitably. The embodiments described below are the best modes of the present invention and do not limit the scope of the claims according to the present invention.

  In the present embodiment, an electronic information board will be described as an example of the image processing apparatus, but the image processing apparatus of the present invention is not limited to this. For example, the present invention may be applied to a television provided with an information processing function as an image processing apparatus, a personal computer, or the like.

[Image processing system in the first embodiment of the present invention]
An outline of the image processing system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 shows an image processing system according to this embodiment in which an electronic information board 1 as an image processing apparatus and information processing apparatuses 3a and 3b (referred to as “information processing apparatus 3” as a representative of these) are input / output cables 4. It is connected and configured. The configuration is not limited to this, and the information processing apparatus 3 and the electronic information board 1 may be connected via a network such as a LAN or a WAN.

  An image acquired from the information processing apparatus 3 can be displayed on the screen 11 of the electronic information board 1. Further, the electronic information board 1 can display a PinP screen 12 overlapping the screen 11 by the PinP function. An image acquired from the information processing device 3a can be displayed on the screen 11, and an image overlapping the image acquired from the information processing device 3a displayed on the screen 11 can be acquired from the information processing device 3b and displayed on the PinP screen 12. . Hereinafter, an area where the PinP screen 12 is displayed is referred to as a “PinP area”. The PinP area may be the same size as the PinP screen 12 or may be larger than the PinP screen 12.

  In addition, the electronic information board 1 includes, for example, a touch panel as detection means for detecting contact or approach of an object to the screen 11. When the object is a touch pen for drawing on the screen 11, the electronic information board 1 can display an image drawn by the user on the screen 11 using the touch pen. In the present embodiment, the following description will be made assuming that drawing cannot be performed on the PinP screen 12.

  The information processing device 3a and the information processing device 3b are provided with an interface for outputting an image signal, and an image signal forming a display image of the information processing device 3a and the information processing device 3b is set to a predetermined value such as 30 frames per second, for example. The electronic information board 1 is supplied at a rate.

  In the present embodiment, the information processing apparatus 3a and the information processing apparatus 3b include a video output terminal such as a VGA as an interface, and a video signal is input to the electronic information board 1 via an input / output cable 4 such as a VGA cable. Can be sent. Note that the information processing device 3a and the information processing device 3b may transmit the display image to the electronic information board 1 by wireless communication complying with various wireless communication protocols. Note that in the information processing apparatus 3a and the information processing apparatus 3b, an interface for outputting an image signal, a video output terminal, and a means for transmitting the image signal and the video signal to the electronic information board 1 through wireless communication are referred to as a transmission means.

  In FIG. 1, notebook PCs are employed as the information processing apparatus 3a and the information processing apparatus 3b, but the present invention is not limited to this. For example, it goes without saying that an information processing apparatus capable of supplying image frames such as a desktop PC, a tablet PC, a PDA, a digital video camera, and a digital camera can be employed. In the image processing system shown in FIG. 1, the two information processing apparatuses 3 a and 3 b are employed. However, the present invention is not limited to this, and one user PC or three or more user PCs are employed. Also good.

Next, a schematic configuration of the electronic information board 1 in the present embodiment will be described with reference to FIG.
The electronic information board 1 includes an image input interface 232, and is connected to the information processing device 3a and the information processing device 3b via this interface. The image input interface 232 is an interface that receives an image signal that forms a display image of the information processing device 3a and the information processing device 3b. This interface is a receiving means for receiving an image signal from the information processing apparatus.

  In the present embodiment, a DVI connector constituted by a DVI (Digital Visual Interface) terminal can be employed as the image input interface 232. The image input interface 232 receives a VGA signal from the information processing device 3 a and the information processing device 3 b via the input / output cable 4 such as a VGA cable, and supplies the VGA signal to the image acquisition unit 206 provided in the electronic information board 1.

On the other hand, as the image input interface 232, a VGA (Video Graphics Array) connector, an HDMI (High-Definition Multimedia Interface _, registered trademark) connector, or the like can be employed. Further, as the image input interface 232, a display port connector can be employed. In addition, the image input interface 232 may receive image signals from the information processing device 3a and the information processing device 3b by wireless communication complying with a wireless communication protocol such as Bluetooth (registered trademark) or WiFi, for example.

  The electronic information board 1 includes a processor 200, a ROM 202, a RAM 204, an image acquisition unit 206, a coordinate detection unit 224, a coordinate detection device 226, and a display unit 112.

  The processor 200 is a processing operation device such as a CPU or MPU, and operates an OS such as WINDOWS (registered trademark) series, UNIX (registered trademark), LINUX (registered trademark), TRON, ITRON, μITRON, or the like. The processor 200 executes the program of the present embodiment described in a program language such as assembler, C, C ++, Java (registered trademark), JavaScript (registered trademark), PERL, RUBY, PYTHON, or the like under the management of these OSs. To do.

  The ROM 202 is a non-volatile memory in which a boot program such as BIOS and EFI is stored. The RAM 204 is a main storage device such as a DRAM or SRAM, and provides an execution space for executing the program of this embodiment.

  The processor 200 reads out a program from a hard disk device for continuously holding a software program, various data, and the like, expands it in the RAM 204, and executes it.

  The program includes an event processing unit 210, an application image generation unit 212, a layout management unit 214, a drawing generation unit 216, a synthesis unit 218, and an image display control unit 220, which are program modules. The program includes a snapshot generation unit 222, a snapshot storage unit 236, a snapshot transmission unit 238, and a repository management unit 228.

  The image acquisition unit 206 is a functional unit that acquires an image signal from the information processing device 3a and the information processing device 3b. When receiving an image signal from the information processing device 3a and the information processing device 3b via the image input interface 232, the image acquisition unit 206 analyzes the image signal. The image acquisition unit 206 derives image information such as the resolution of the image frame, which is a display image of the information processing device 3a and the information processing device 3b formed by the image signal, and the update frequency of the image frame, and the application image generation unit 212.

  In addition, the image acquisition unit 206 uses the image signal to form image frames that are display images of the information processing device 3a and the information processing device 3b, respectively, and is video that is a storage unit that can temporarily store image data. Each is overwritten and saved in the RAM 208.

  The application image generation unit 212 is a functional unit that generates various display windows to be displayed on the display unit 112. The display window includes a display window that displays an image frame that is a display image of the information processing device 3a and the information processing device 3b, and a display window that displays a drawing image generated by the user. The display window includes a display window for displaying buttons and menus for performing various settings of the electronic information board 1, for example, a display window for a file viewer, a web browser, and the like. The application image generation unit 212 draws these display windows on an image layer in which the display window is to be drawn.

  The layout management unit 214 is a functional unit that draws display images of the information processing device 3 a and the information processing device 3 b on the display window generated by the application image generation unit 212. When the layout management unit 214 acquires image information from the image acquisition unit 206, the layout management unit 214 acquires image frames stored in the video RAM 208. Using the image information, the layout management unit 214 changes the size of the image frame to match the size of the display window generated by the application image generation unit 212, and the image layer on which the image frame is to be drawn To draw.

  The coordinate detection device 226 is a functional unit that detects contact of an object such as the drawing device 240. In the present embodiment, as the coordinate detection device 226, a coordinate input device using an infrared ray blocking method is employed. In this coordinate input device, two light receiving / emitting devices installed at both lower ends of the display unit 112 radiate a plurality of infrared rays in parallel to the display unit 112, and retroreflective provided around the display unit 112. Light reflected by the member on the same optical path is received.

  The coordinate detection device 226 notifies the coordinate detection unit 224 of infrared identification information emitted by the two light receiving and emitting devices blocked by the pointing object, and the coordinate detection unit 224 identifies the coordinate position that is the contact position of the pointing object. To do.

  On the other hand, a capacitive touch panel that specifies a contact position by detecting a change in electrostatic capacitance, or a resistive film type touch panel that specifies a contact position based on a voltage change between two opposing resistance films may be employed. . Further, various detection means such as an electromagnetic induction type touch panel that detects electromagnetic induction caused by contact of a contact object with the display unit 112 and identifies a contact position may be employed.

  The coordinate detection unit 224 is a functional unit that calculates a coordinate position that is a contact position of the pointing object with respect to the display unit 112 and issues various events. In the present embodiment, the coordinate detection unit 224 calculates the coordinate position of the contact position of the object using the infrared identification information that is blocked by the coordinate detection device 226.

  The coordinate detection unit 224 issues various events to the event processing unit 210 together with the coordinate position of the contact position. The event issued by the coordinate detection unit 224 is an event (TOUCH) for notifying that an object has touched or approached, and that the contact point or approach point has moved while the object is in contact with or approaching the display unit 112. An event (MOVE) is included. The event issued by the coordinate detection unit 224 includes an event (RELEASE) notifying that the object has left the display unit 112. These events include coordinate position information that is contact position coordinates and approach position coordinates.

  The drawing device 240 is a device that draws in contact with the coordinate detection device 226 of the electronic information board 1. The drawing device 240 has a pen shape provided with a contact detection means for detecting the contact of an object at the tip, and when the contact detection device comes into contact with the object, a contact signal indicating the contact is sent to the drawing device 240. It transmits to the coordinate detection part 224 with identification information.

  The drawing device 240 has a function of deleting the drawn drawing object. The drawing apparatus 240 includes a mode switch for switching from the drawing mode to the erasing mode on the side surface and the rear end. When the contact detection means contacts the object in the erasing mode, a signal indicating that the object is in contact and a signal in the erasing mode are transmitted to the coordinate detection unit 224 together with the identification information of the drawing device 240. The drawing device 240 allows the user to select an object such as a menu or button displayed on the display unit 112.

  If the drawing device 240 is brought into contact with the display unit 112 of the electronic information board 1 while the user presses the erasing mode changeover switch, the drawing device 240 erases together with the contact signal and the identification information of the drawing device 240. A mode type signal indicating a mode is transmitted. When the drawing device 240 is brought into contact with the electronic information board 1 in a state where the user has not pressed the erase mode switch, the drawing device 240 transmits a contact signal and identification information of the drawing device 240.

  In the present embodiment, the coordinate detection unit 224 receives the infrared identification information from the coordinate detection device 226, calculates the coordinate position that is the contact position of the pointing object, and then receives the contact signal from the drawing device 240. Issue various events. At this time, the coordinate detection unit 224 notifies the event processing unit 210 of information indicating the mode type (hereinafter referred to as “mode type information”) together with the event.

  In the present embodiment, various signals are transmitted by short-range wireless communication such as Bluetooth (registered trademark). Moreover, various signals can be transmitted by wireless communication using ultrasonic waves or infrared rays.

  The event processing unit 210 is a functional unit that processes an event issued by the coordinate detection unit 224. When the event processing unit 210 receives an event from the coordinate detection unit 224, the event processing unit 210 performs the following processing. That is, the event processing unit 210 identifies whether the event is a drawing instruction event in the drawing area, an erasing instruction event, or an event in the PinP area in addition to the two events, and implements each function. To do. In addition, the event processing unit 210 identifies whether the event is a selection notification event for selecting an icon for each function displayed on the display unit 112, and implements each function.

  The drawing instruction event is an event that instructs the electronic information board 1 to perform drawing. The erasure instruction event is an event for erasing an object drawn on the electronic information board 1.

  The event in the PinP area is an event for notifying that an image of either the information processing apparatus 3a or the information processing apparatus 3b is performing a drawing instruction event or an erasing event in the PinP area where the PinP screen 12 is displayed. It is. The drawing instruction event, the erasure event, and the event in the PinP area are issued due to the drawing device 240 touching the display unit 112.

  The selection notification event is an event indicating that various objects such as buttons and menu bars constituting the screen displayed on the display unit 112 have been selected. The selection notification event is issued due to the drawing device 240 touching the display unit 112. The event processing unit 210 issues a selection notification event when the coordinate position information included in the event issued by the coordinate detection unit 224 is within the coordinate area of the object.

  In the present embodiment, identification information is assigned to each of the drawing instruction event and the selection notification event, and the functional means of the electronic information board 1 that operates using these events as a trigger refers to the identification information. Execute the process. Further, identification information of the selected object is added to the selection notification event, and the functional means of the electronic information board 1 that operates using the selection notification event as a trigger refers to the identification information of the object and performs various processes. Execute.

  The drawing generation unit 216 is a functional unit that generates a drawing image drawn by the user using the drawing device 240. The drawing generation unit 216 generates an image layer in which the color of the coordinate position indicated by the coordinate position information is changed to a specific color. The drawing generation unit 216 stores the coordinate position as drawing information in the drawing information storage area of the RAM 204.

  The synthesizing unit 218 is a functional unit that synthesizes various images. The composition unit 218 should draw the image layer (hereinafter referred to as “application image layer”) on which the application image generation unit 212 should draw an image, and the layout management unit 214 should draw the display image of the information processing devices 3a and 3b. An image layer (hereinafter referred to as “image capture layer”) and an image layer (hereinafter referred to as “handwriting layer”) on which the drawing generation unit 216 should draw an image are synthesized.

  The image display control unit 220 is a functional unit that controls the display unit 112. The image display control unit 220 displays the combined image generated by the combining unit 218 on the display unit 112. In the present embodiment, the composition unit 218 calls the image display control unit 220 and displays the composite image on the display unit 112. The combining unit 218 and the image display control unit 220 may combine the image layers and display them on the display unit 112 at the same frequency as the update frequency of the image frames included in the image information.

  The snapshot generation unit 222 is a functional unit that generates a snapshot image that is a composite image of the display image of the information processing devices 3a and 3b and the drawing image generated by the drawing generation unit 216.

  When the snapshot generation unit 222 receives a selection notification event indicating that the snapshot button instructing acquisition of the snapshot displayed on the display unit 112 has been selected, the snapshot generation unit 222 combines the image capture layer and the handwriting layer, Generate a shot image. When the snapshot generation unit 222 generates a snapshot image, the snapshot generation unit 222 stores the snapshot image in the storage device 230 for the repository management unit 228.

  The snapshot storage unit 236 is a functional unit that stores a snapshot image stored in the storage device 230 through the repository management unit 228 in an external storage device such as the USB memory 242 through the data output interface 234.

  When the snapshot saving unit 236 receives a selection notification event indicating that the snapshot saving button instructing saving of the snapshot displayed on the display unit 112 has been selected, the snapshot saving unit 236 performs the following processing. In other words, the snapshot storage unit 236 acquires a snapshot image stored in the storage device 230 through the repository management unit 228 and outputs the snapshot image to an external storage device connected to the data output interface 234.

  The snapshot transmission unit 238 is a functional unit that transmits a snapshot image stored in the storage device 230 through the repository management unit 228 to a server or the like outside the image processing apparatus through the communication control unit 250.

  When the snapshot transmission unit 238 receives a selection notification event indicating that the snapshot transmission button instructing transmission of the snapshot displayed on the display unit 112 has been selected, the snapshot transmission unit 238 performs the following processing. That is, the snapshot transmission unit 238 acquires the snapshot image stored in the storage device 230 through the repository management unit 228 and outputs the snapshot image to the communication control unit 250.

  The communication control unit 250 transmits a snapshot image to an external server of the electronic information board 1 or the like via a communication unit 252 using a predetermined communication protocol such as FTP or SMTP.

  The repository management unit 228 is a functional unit that controls the storage device 230 that stores the snapshot image. As described above, the repository management unit 228 stores the snapshot image in the storage device 230 according to the instruction from the snapshot generation unit 222. Further, the repository management unit 228 acquires a snapshot image from the storage device 230 according to an instruction from the snapshot storage unit 236 or the snapshot transmission unit 238 and transmits the snapshot image to the data output interface 234 or the communication control unit 250.

  The data output interface 234 is a physical interface that outputs a snapshot image to an external device. In the present embodiment, a USB socket can be adopted as the data output interface 234.

  The electronic information board 1 includes a communication control unit 250 and a communication unit 252. The communication control unit 250 is a functional unit that controls communication between image processing apparatuses via a network. The communication unit 252 is a network interface with the network. The communication control unit 250 communicates information such as authentication information, image data such as image frames and snapshot images, drawing information, and events via the communication unit 252.

  Next, functional blocks of the image processing apparatus according to the present embodiment will be described with reference to FIG. The image processing apparatus in the present embodiment includes an image display unit 21, a superimposed image display unit 22, a detection unit 23, and a display control unit 24 as functional blocks.

  The image display unit 21 is an image display unit that displays an image for accepting drawing by the drawing device 240, which is a predetermined process, on the screen. The application image generation unit 212, the layout management unit 214, the drawing generation unit 216, and the image display described above. The function is executed by the control unit 220 or the like. Note that an image that receives a predetermined process such as drawing is an image in which a function that can read a processing signal such as a drawing signal input by the drawing device 240 is incorporated.

  The superimposed image display unit 22 is a superimposed image display unit that superimposes an image that does not receive a predetermined process on an image that receives the predetermined process displayed by the image display unit 21 and displays the image on the screen. The function of the superimposed image display unit 22 is executed by the application image generation unit 212, the layout management unit 214, the drawing generation unit 216, the synthesis unit 218, the image display control unit 220, and the like described above. An image that does not accept a predetermined process is an image that is displayed superimposed on a layer that is displayed as a main screen, such as the PinP screen 12 described above, and accepts drawing by the drawing device 240. An image that cannot be used.

  The detection unit 23 is a detection unit that detects contact or approach of an object to the screen, and the function is executed by the coordinate detection device 226 and the coordinate detection unit 224 described above. The detection unit 23 is not limited to the infrared ray blocking method in the present embodiment, and may detect coordinates from the contact position by a capacitance method or an electromagnetic induction method.

  The display control unit 24 includes the position where the detection or contact of the object detected by the detection unit 23 is included in the display area of the image that does not accept the predetermined process displayed on the screen by the superimposed image display unit 22. This is a display control means for hiding an image that does not accept predetermined processing. The function of the display control unit 24 is executed by the event processing unit 210, the application image generation unit 212, the layout management unit 214, the drawing generation unit 216, the synthesis unit 218, the snapshot generation unit 222, and the like described above.

  In the present embodiment, the display image of the information processing apparatus 3 excluding the image layer set to be displayed on the PinP screen 12 by the combining unit 218 is combined with other layers. Thus, the PinP screen 12 is not displayed in the synthesized image. Such a process is included in the process of “undisplaying an image” in the present embodiment. Further, the display control unit 24 displays the image drawn by the drawing generation unit 216 after the drawing instruction event is processed by the event processing unit 210.

  Specifically, when the coordinate detection unit 224 issues an event in the PinP area, the event processing unit 210 passes through the image display control unit 220 and generates a composite image generated by the synthesis unit 218 until another event is issued. Is displayed on the display unit 112. Other events include, for example, events other than a drawing operation using a finger or a touch pen by a user, the above-described selection notification event, and the like.

  The combined image generated by the combining unit 218 is obtained by combining the display image of the information processing apparatus 3 with the other layers from the display image of the information processing apparatus 3 excluding the image layer set to be displayed on the PinP screen 12. It is an image.

  When a user starts drawing with a finger, a touch pen, or the like in an image display area that does not accept predetermined processing, an image that does not accept predetermined processing is hidden. Accordingly, the drawing area is not hidden by an image that does not accept the predetermined process, and the process can be continued without being interrupted.

  Further, the display control unit 24 performs predetermined processing until the contact or approach of the object to the screen by the detection unit 23 is not detected in the display region of the image that does not accept the predetermined processing displayed on the screen by the superimposed image display unit 22. An image that does not accept the process may be hidden.

  Specifically, as long as the coordinate position information generated by the drawing generation unit 216 saved in the drawing information storage area of the RAM 204 is drawn in the PinP display area, the following processing is performed. That is, the combining unit 218 combines the display image of the user PC from the display image of the information processing device 3 excluding the image layer set to be displayed on the PinP screen 12 with other layers.

  As a result, for example, since the PinP screen 12 is not displayed while the user is drawing with a finger, a touch pen, or the like, or while the drawn image is deleted, the drawing process is interrupted by displaying an image that does not accept a predetermined process. It is never done.

  Furthermore, the display control unit 24 may perform the following processing in the display region of the image that does not accept the predetermined processing displayed on the screen by the superimposed image display unit 22. That is, it is a process of hiding an image that does not accept the predetermined process for a certain period of time after the detection unit 23 has not detected the contact or approach of an object to the screen.

  Specifically, when the event processing unit 210 issues an event in the PinP area, the event processing unit 210 generates a composite generated by the combining unit 218 through the image display control unit 220 for a predetermined time after another event is issued. The image is displayed on the display unit 112.

  As a result, the main image is not hidden by the display of the PinP screen 12 for a predetermined time after the PinP area is not in contact with the display unit 112, and drawing is not affected by the PinP screen 12 during drawing. Can do.

  Next, an outline of the non-display process of the PinP screen 12 in the present embodiment will be described with reference to FIG. FIG. 4A is a diagram illustrating a state in which a PinP screen 12 that is an image that does not accept predetermined processing is displayed on the screen 11 on the screen 11 that displays the display image of the information processing apparatus 3. In this case, drawing on the display area of the PinP screen 12 with the touch pen 13 is not possible.

  On the other hand, as shown in FIG. 4B, according to the above-described processing according to the present embodiment, when the touch pen 13 detects contact with the display area of the PinP screen 12, the PinP screen 12 is hidden. Thereby, it is possible to draw in the area of the screen 11 that has been hidden by the PinP screen 12.

  As shown in FIG. 5, the size of the PinP area 14 is made larger than the size of the PinP screen 12 by the coordinate width 14a. Further, when the detection unit 23 detects drawing on the PinP region 14 by the drawing device 240 in the coordinate width 14a, that is, contact or the like, the display control unit 24 does not display the PinP screen 12 that has been displayed in the PinP region 14 until then. It may be. Accordingly, the PinP screen 12 can be hidden before the drawn image is applied to the PinP screen 12.

  Since operations such as drawing are not accepted while the PinP screen 12 is being displayed, operability such as drawing is reduced during that time. According to the above processing, since the PinP screen 12 is not displayed when the drawing is detected in the coordinate width 14a of the PinP region 14, the drawing operation can be executed smoothly and the operability is improved.

  Next, an outline of a processing procedure in the present embodiment will be described with reference to FIG. First, the image display unit 21 displays a display image of the information processing device 3a or 3b (step S1).

  Thereafter, the superimposed image display unit 22 displays the PinP screen 12 so as to overlap the display image of the information processing device 3a or 3b (step S2).

  The detection unit 23 detects contact or approach of an object in the PinP region, and determines whether a drawing instruction event has been issued (step S3). If a drawing instruction event has been issued (step S3, YES), the display control unit 24 hides the PinP screen 12 (step S4). On the other hand, when the drawing instruction event has not been issued (step S3, NO), the detection of contact or approach of the object in the PinP region is continued (step S3).

  After the non-display processing of the PinP screen 12, the display control unit 24 displays an image to be drawn by processing the drawing instruction event (step S5).

[Image processing system according to the second embodiment of the present invention]
An image processing system according to the second embodiment of the present invention will be described with reference to FIG. In addition, description is abbreviate | omitted about the structure similar to 1st Embodiment, or the overlapping structure.

  The image processing system according to the second embodiment is a system in which an electronic information board 1 a and an electronic information board 1 b (representatively referred to as “electronic information board 1”) are connected via a network 10. In FIG. 7, the cable connecting the electronic information board 1 and the network 10 is a communication cable 5.

  The electronic information board 1 a and the electronic information board 1 b are connected to the network 10 by the communication cable 5. The network 10 is, for example, a LAN (Local Area Network) or the Internet, and can communicate various data between the electronic information board 1a and the electronic information board 1b.

  In the present embodiment, the electronic information board 1a and the electronic information board 1b are image data to be displayed on both screens 11a and 11b (representatively referred to as “screen 11”), and drawing issued in either of them. Information such as events is transmitted and received via the network 10. FIG. 7 shows a configuration in which only two electronic information boards 1a and 1b are connected via the network 10. However, the present invention is not limited to this, and three or more electronic information boards 1 are included. It may be configured to be connected.

  FIG. 7 shows a configuration in which the information processing device 3a and the information processing device 3b are connected to the electronic information board 1a, and the information processing device 3c and the information processing device 3d are connected to the electronic information board 1b. Only. The PinP screen 12 on the electronic information board 1a is referred to as a PinP screen 12a, and the PinP screen 12 on the electronic information board 1b is referred to as a PinP screen 12b (referred to as “PinP screen 12” as a representative). In the following description, the information processing apparatus 3a to the information processing apparatus 3d will be referred to as “information processing apparatus 3”.

  In the present embodiment, the electronic information board 1a and the electronic information board 1b will be described as devices having the same function. On the other hand, the present invention is not limited to this embodiment, and electronic information boards are connected to each other, and an image displayed or drawn on one electronic information board can be displayed and shared on the other electronic information board. I just need it.

  Furthermore, in the present embodiment, when the information processing device 3 is connected to the electronic information board 1, an image based on the video signal output from the information processing device 3 connected to any one of the electronic information boards 1 is electronic. It is assumed that it is displayed on the screen 11 of the information board 1. On the other hand, when no video signal is output from the information processing device 3 in any electronic information board 1 and nothing is displayed on the screen 11, a screen of an application stored in the electronic information board 1 is displayed. And

  Next, a schematic configuration of the electronic information board 1 which is an image processing apparatus in the second embodiment will be described with reference to FIG. In addition, description about the structure which overlaps with the structure of the electronic information board 1 in 1st Embodiment is abbreviate | omitted. That is, the second embodiment is different from the configuration of the first embodiment in that the communication unit 252 and the communication control unit 250 also control communication with both electronic information boards 1.

  In the electronic information board 1, the communication control unit 250 or the like can perform cooperation settings between devices, and information such as image data, various events, and various setting values can be transmitted and received mutually. When the same image as that displayed on the screen 11a of the electronic information board 1a is displayed on the screen 11b of the electronic information board 1b, the image data drawn on the screen 11a in the electronic information board 1a is also shared and the electronic information board It is reflected on the screen 11b of 1b.

  On the other hand, the PinP screen 12a displayed in the PinP area of the electronic information board 1a and the PinP screen 12b displayed in the PinP area of the electronic information board 1b are not shared, and different images designated on the electronic information board 1 are displayed. Shall be. On the other hand, the present invention is not limited to this, and the setting may be such that the PinP screen 12 displayed in the PinP area of the electronic information board 1 can be shared.

  Next, functional blocks of the image processing apparatus according to the second embodiment will be described with reference to FIG. In addition, the description similar to the functional block shown in FIG. 3 is abbreviate | omitted. An image processing apparatus that is a transmission destination of a display image and various events is an electronic information board 1a, and an image processing apparatus that is a reception destination of the display image and various events is an electronic information board 1b. In addition, the functional blocks of the electronic information board are distinguished by appending the respective symbols “a” and “b” after the numerical symbols attached to the respective functional blocks.

  The first communication unit 25a is a communication unit that transmits a display image displayed on the electronic information board 1a, a drawing event to be issued, and the like to the electronic information board 1b. The communication control unit 250 and the communication unit 252 shown in FIG. That function is realized. The second communication unit 25b is a communication unit that receives a display image, a drawing event, and the like transmitted from the electronic information board 1a. The function is realized by the communication control unit 250 and the communication unit 252 illustrated in FIG.

  Next, a processing procedure in the second embodiment will be described with reference to FIGS. In the second embodiment, an image displayed on the screen 11a based on the video signal output from the information processing apparatus 3 connected to the electronic information board 1a is shared by the electronic information board 1b and reflected on the screen 11b. An example will be described. Further, an example in which an image drawn on the screen 11a of the electronic information board 1a is shared with the electronic information board 1b and a similar drawn image is reflected on the screen 11b will be described.

  First, the image display unit 21a in the electronic information board 1a displays the image a output from the information processing device 3a or the information processing device 3b on the screen 11a (step S11).

  Next, the data of the image a is transmitted to the electronic information board 1b by the first communication unit 25a in the electronic information board 1a (step S12).

  When the data of the image a is received by the second communication unit 25b in the electronic information board 1b, the image display unit 21b in the electronic information board 1b displays the image a on the screen 11b (step S13).

  The superimposed image display unit 22a in the electronic information board 1a displays the PinP screen 12a so as to overlap the image a (step S14). On the other hand, the superimposed image display unit 22b in the electronic information board 1b displays the PinP screen 12b superimposed on the image a (step S15).

  Thereafter, the image is drawn on the screen 11a by the drawing device 240, and a drawing instruction event is issued on the electronic information board 1a (step S16). A signal indicating that a drawing instruction event has been issued by the communication control unit 250 and the communication unit 252 in the electronic information board 1a is transmitted to the electronic information board 1b (step S17). Further, the display control unit 24a of the electronic information board 1a hides the PinP screen 12a (step S18).

  When receiving a signal indicating that a drawing instruction event has been issued by the second communication unit 25b in the electronic information board 1b, the display control unit 24b in the electronic information board 1b hides the PinP screen 12b (step S19). Note that the present invention is not limited to this process, and when a signal indicating that the PinP screen 12a in the electronic information board 1a has been hidden is received, the PinP screen 12b may be hidden.

  Thereafter, the display control unit 24a of the electronic information board 1a displays an image drawn on the portion of the image a where the PinP screen 12a is not displayed (step S20). Further, the display control unit 24b of the electronic information board 1b displays the image drawn on the electronic information board 1a on the portion of the image a where the PinP screen 12b is not displayed (step S21).

  In the above procedure, the embodiment has been described in which the electronic information board 1b receives the image a displayed on the screen 11a, a signal indicating that a drawing instruction event has been issued, and the like in the electronic information board 1a. On the other hand, in the electronic information board 1b, the electronic information board 1a receives the image b displayed on the screen 11b, a signal indicating that a drawing instruction event has been issued, and the like, and performs the same processing as in the above-described embodiment. Needless to say.

  As described above, according to the second embodiment, an operation such as drawing can be performed without the image displayed on the screen 11 of the electronic information board 1 being hidden by the image displayed in the PinP area. Thereby, in the electronic information board 1a which receives the drawing operation, the drawing operation is not blocked by the PinP screen 12a. In addition, the image drawn on the electronic information board 1a is also displayed on the PinP screen 12b without being blocked by the electronic information board 1b that is the connection destination. Therefore, when a remote conference or the like is performed using the electronic information boards 1a and 1b installed at different sites, the conference or the like can be smoothly advanced.

  Each of the above-described embodiments is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention. For example, each process in the image processing apparatus and the image processing system of the present embodiment described above can be executed by hardware, software, or a combined configuration of both.

  When the processing is executed by software, it is possible to install and execute a computer readable program recording a processing sequence in a memory, that is, a storage unit in a computer incorporated in dedicated hardware. is there. Alternatively, the program can be installed and executed on a general-purpose computer capable of executing various processes.

DESCRIPTION OF SYMBOLS 1, 1a, 1b Electronic information board 3a, 3b, 3c, 3d Information processing apparatus 4 Input / output cable 5 Communication cable 10 Network 11, 11a, 11b Screen 12, 12a, 12b PinP screen 21 Image display part (image display means)
22 Superimposed image display unit (superimposed image display means)
23 Detection part (detection means)
24 display control unit (display control means)
25a 1st communication part 25b 2nd communication part 112 Display part 200 Processor 202 ROM
204 RAM
206 Image acquisition unit 208 Video RAM
210 Event processing unit 212 Application image generation unit 214 Layout management unit 216 Drawing generation unit 218 Composition unit 220 Image display control unit 222 Snapshot generation unit 224 Coordinate detection unit 226 Coordinate detection unit 228 Repository management unit 230 Storage device 232 Image input interface 234 Data output interface 236 Snapshot storage unit 238 Snapshot transmission unit 240 Drawing device 242 USB memory 250 Communication control unit 252 Communication unit

JP 07-046564 A

Claims (6)

Image display means for displaying an image for receiving a predetermined process on the screen;
Superimposed image display means for superimposing an image not accepting a predetermined process on an image accepting the predetermined process displayed by the image display means, and displaying the image on the screen;
Detecting means for detecting contact or approach of an object to the screen;
When the position at which the contact or approach of the object to the screen is detected by the detection means is included in the display area of the image that is not accepted by the superimposed image display means and displayed on the screen, An image processing apparatus comprising: display control means for hiding an image that does not accept processing.   The display control means until the contact or approach of the object to the screen by the detecting means is not detected in the display area of the image not accepting the predetermined processing displayed on the screen by the superimposed image display means. The image processing apparatus according to claim 1, wherein an image that does not accept the predetermined process is hidden.   In the display region of the image that does not accept the predetermined processing displayed on the screen by the superimposed image display unit, the display control unit has not detected contact or approach of an object to the screen by the detection unit. The image processing apparatus according to claim 1, wherein an image that does not receive the predetermined process is hidden after a certain period of time. An image processing system in which two or more information processing devices and an image processing device are connected,
Of the two or more information processing devices, the first information processing device is:
A transmission means for transmitting a first image to be displayed on the screen of the image processing apparatus;
Of the two or more information processing devices, a second information processing device is:
A transmission unit configured to transmit a second image overlapping the first image displayed on the screen of the image processing apparatus;
The image processing apparatus includes:
Receiving means for receiving the first image and / or the second image;
Image display means for displaying the first image received by the receiving means on the screen as an image for receiving a predetermined process;
Superimposed image display means for displaying the second image received by the receiving means on the screen as an image that does not accept a predetermined process and superimposed on the first image displayed by the image display means;
Detecting means for detecting contact or approach of an object to the screen;
When the position at which contact or approach of an object to the screen is detected by the detection means is included in the display area of the second image displayed on the screen by the superimposed image display means, the second image is An image processing system comprising: display control means for non-display. A process for displaying an image for receiving a predetermined process on the screen;
A process of superimposing an image not accepting a predetermined process on an image accepting a predetermined process displayed on the screen and displaying the image on the screen;
Processing to detect contact or approach of an object to the screen;
When the position where the contact or approach of the object to the screen is detected is included in the display area of the image that does not accept the predetermined process displayed on the screen, the image that does not accept the predetermined process is not displayed. A program for causing a computer to execute processing to be performed. A computer-readable program to be executed by an image processing system in which two or more information processing apparatuses and an image processing apparatus are connected,
Of the two or more information processing devices, the first information processing device is:
Including a process of transmitting a first image to be displayed on the screen of the image processing apparatus;
Of the two or more information processing devices, a second information processing device is:
Including a process of transmitting a second image that overlaps the first image displayed on the screen of the image processing apparatus;
The image processing apparatus includes:
Processing for receiving the first image and / or the second image and storing them in a storage unit;
A process of displaying the first image stored in the storage unit on the screen as an image for receiving a predetermined process;
A process of superimposing the second image stored in the storage unit on the first image as an image not accepting a predetermined process and displaying the second image on the screen;
Processing to detect contact or approach of an object to the screen;
And a process of hiding the second image when the position where the contact or approach of the object to the screen is detected is included in the display area of the second image displayed on the screen. A featured program.

Images