WO2017110505A1 - 画像処理装置、画像表示方法、プログラム - Google Patents
画像処理装置、画像表示方法、プログラム Download PDFInfo
- Publication number
- WO2017110505A1 WO2017110505A1 PCT/JP2016/086581 JP2016086581W WO2017110505A1 WO 2017110505 A1 WO2017110505 A1 WO 2017110505A1 JP 2016086581 W JP2016086581 W JP 2016086581W WO 2017110505 A1 WO2017110505 A1 WO 2017110505A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- unit
- display
- input
- electronic blackboard
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
- G06F3/1462—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay with means for detecting differences between the image stored in the host and the images displayed on the remote displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0021—Image watermarking
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/10—Intensity circuits
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
- G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2358/00—Arrangements for display data security
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/027—Arrangements and methods specific for the display of internet documents
Definitions
- the present invention relates to an image processing apparatus, an image display method, and a program.
- An electronic blackboard with a touch panel mounted on a large flat panel display is known.
- the electronic blackboard displays a screen that functions as a blackboard, detects the coordinates touched by an indicator such as an electronic pen or a finger, and draws the coordinate locus on the screen as handwritten content. Therefore, the user can use the screen like a blackboard.
- Patent Document 1 discloses a display device that converts a moving image transmitted from an external information processing device into image data, stores it, and redisplays it.
- the electronic blackboard has a function to capture (capture) video displayed on the display, and can capture video input from a PC as a still image, not limited to handwritten content.
- an electronic blackboard when used, there is a request to display an arbitrary translucent image separately from video from a PC or the like. For example, if an arbitrary image is made translucent and displayed on the electronic blackboard, a participant or the like in the conference can see the handwritten content while looking at the translucent image. If the characters “Confidential” and “secret” are described in the translucent image, the participants can always be aware that the information displayed on the display is highly confidential.
- an object of the present invention is to provide an electronic blackboard that can suppress a decrease in the visibility of an image being displayed.
- an image processing apparatus that displays an input video input by an external device is a first image acquisition unit that acquires a first image stored in a storage unit. And a second image acquisition means for acquiring a second image from the input video, and when the input video input from the external device does not satisfy a predetermined condition, the first image is not displayed.
- Determining to display the second image and determining that the first image and the second image are to be displayed when the input video input from the external device satisfies the predetermined condition;
- an image determination unit that determines to display the first image, and a determination that the image determination unit displays the first image and the second image
- the first image The includes an image superimposing means for superimposing the second image, and a display unit the image superimposing means for displaying on the display unit the second image and the first image superimposed.
- FIG. 1 is an example of an overall configuration diagram of an image processing system. It is an example of the hardware block diagram of an electronic blackboard. It is an example of the functional block diagram of an electronic blackboard. It is an example of a functional block diagram of a file processing unit. It is an example of the functional block diagram of a server part and a client part. It is an example of the block diagram of each image layer.
- FIG. 1A shows a state where a notebook PC 6 (Personal Computer), which is an external device, and the electronic blackboard 2 are not connected to the electronic blackboard 2.
- the notebook PC 6 displays an image on its own display, but this image is not output to the electronic blackboard 2.
- the electronic blackboard 2 has a function of displaying a translucent image (hereinafter referred to as a watermark image), and displays the characters “Confidential” using the watermark image. Since the watermark image (character “Confidential”) is translucent, participants in a meeting or the like (hereinafter sometimes referred to as a user who uses the electronic blackboard 2) may be displayed on the display 3. Information is visible.
- NDA non-disclosure agreement
- FIG. 1B shows the operation of the comparative example compared with the electronic blackboard 2 of the present embodiment.
- FIG. 1B shows a state in which the notebook PC 6 and the electronic blackboard 2 are connected.
- a video this is referred to as an output image (C)
- the watermark image (E) is in front of the image of the notebook PC 6, it is translucent so that the user can see the image of the notebook PC 6 through the watermark image.
- the character “Confidential” is always displayed on the display 3 of the electronic blackboard 2, the visibility of the image of the notebook PC 6 decreases.
- the portion where the characters “Confidential” and the video overlap also changes with time. Since the user sees the change as a moving image and the change in the overlapping portion of the watermark image and the moving image, it is difficult to grasp the timing for capturing the video of the notebook PC 6.
- FIG. 1C is a diagram for explaining the operation when the electronic blackboard 2 of the present embodiment displays the image of the notebook PC 6.
- the electronic blackboard 2 to which the video from the notebook PC 6 is input switches the watermark image (E) to non-display.
- the characters “Confidential” are not displayed on the display 3. Since the video of the notebook PC 6 does not overlap with the characters “Confidential”, the user can capture the video of the notebook PC 6 as a still image at the timing when the video desired to be stored as a still image is displayed.
- FIG. 1D is a diagram for explaining the operation when the electronic blackboard 2 of the present embodiment does not display the image of the notebook PC 6.
- the electronic blackboard 2 to which no video from the notebook PC 6 is input displays the watermark image (E) on the display 3. Even without the user's operation, the display and non-display of the watermark image (E) can be switched depending on whether or not the video of the notebook PC 6 is input.
- the electronic blackboard 2 displays the first image (for example, a watermark image such as the characters “Confidential”) stored in the electronic blackboard 2 (in advance). ) Is displayed on the display 3. In this case, the video of the notebook PC 6 is not displayed on the display 3. As will be described later with reference to FIG. 20 and the like, when the video (input video) input from the notebook PC 6 does not satisfy the predetermined condition, the electronic blackboard 2 displays the first image (watermark image such as the characters “Confidential”).
- the electronic blackboard 2 displays the first image (such as the characters “Confidential”).
- the watermark image) and the video input from the notebook PC 6 are displayed on the display 3.
- the predetermined condition is not satisfied.
- the predetermined condition is satisfied.
- the electronic blackboard 2 controls the display and non-display of the watermark image, so that the watermark image can be used when the video of the notebook PC 6 is not input, and the notebook when the video of the notebook PC 6 is input.
- the video of PC6 can be displayed with high image quality.
- the external device in the claims may be an external device to the electronic blackboard 2, and refers to a device that can be connected via a cable, a network, or an interface.
- the notebook PC 6 and an equivalent device are examples of the external device.
- a portable storage medium also corresponds to an external device.
- the image processing device is a device that displays an image.
- the electronic blackboard 2 described above is an example of an image processing apparatus.
- the image processing apparatus may have a display or may project an image using a projector. In the present embodiment, the image processing apparatus will be described in terms of the electronic blackboard 2.
- the display unit is a means for displaying an image, such as a display or a projector.
- the display image
- the display image
- the display image
- the image processing apparatus projects an image using a projector
- the portion on which the image is projected is the display unit.
- FIG. 2 is an overall configuration diagram of the image processing system 1 of the present embodiment.
- FIG. 2 only two electronic blackboards 2a and 2b and electronic pens 4a and 4b associated therewith are shown for the sake of simplicity.
- An electronic pen or the like may be used.
- the image processing system 1 includes a plurality of electronic blackboards 2a and 2b, a plurality of electronic pens 4a and 4b, USB memories 5a and 5b, a notebook PC 6 (Personal Computer) 6a and 6b, a television ( Video) having conference terminals 7a, 7b and PC8.
- the electronic blackboards 2a and 2b and the PC 8 are connected via a communication network 9 so that they can communicate with each other.
- the plurality of electronic blackboards 2a and 2b are provided with displays 3a and 3b, respectively.
- an image drawn by an event (touch of the pen tip of the electronic pen 4a or the pen tip of the electronic pen 4a on the display 3a) generated by the electronic pen 4a is displayed on the display 3a.
- an event a gesture such as enlargement, reduction, or page turning generated by the user's hand Ha or the like.
- the electronic blackboard 2a can be connected to a USB memory 5a.
- the electronic blackboard 2a reads an electronic file such as PDF from the USB memory 5a, and the electronic blackboard 2a records an electronic file in the USB memory 5a. Can do.
- the electronic blackboard 2a includes a cable 10a1 capable of communication according to standards such as DisplayPort (registered trademark), DVI (Digital Visual Interface), HDMI (registered trademark: High-Definition Multimedia Interface), and VGA (Video Graphics Array). Via the notebook PC 6a. Then, the electronic blackboard 2a generates an event by touching the display 3a, and transmits event information indicating the event to the notebook PC 6a in the same manner as an event from an input device such as a mouse or a keyboard.
- DisplayPort registered trademark
- DVI Digital Visual Interface
- HDMI registered trademark: High-Definition Multimedia Interface
- VGA Video Graphics Array
- a television (video) conference terminal 7a is connected to the electronic blackboard 2a via a cable 10a2 capable of communication according to the above-mentioned standards.
- the notebook PC 6a and the video conference terminal 7a may communicate with the electronic blackboard 2a by wireless communication complying with various wireless communication protocols such as Bluetooth (registered trademark).
- the electronic blackboard 2b with the display 3b, the electronic pen 4b, the USB memory 5b, the notebook PC 6b, the video conference terminal 7b, the cable 10b1, and the cable 10b2 in the same manner as described above. Is used. Furthermore, the image displayed on the display 3b can be changed based on an event caused by the user's hand Hb or the like.
- the image drawn on the display 3a of the electronic blackboard 2a at one base is also displayed on the display 3b of the electronic blackboard 2b at another base, and conversely on the display 3b of the electronic blackboard 2b at another base.
- the image drawn on is displayed on the display 3a of the electronic blackboard 2a at one base.
- the image processing system 1 can perform remote sharing processing for sharing the same image at a remote location, and thus is very convenient when used for a conference or the like at a remote location.
- an arbitrary electronic blackboard 2 among the plurality of electronic blackboards 2 it is indicated as “electronic blackboard 2”.
- display 3 When an arbitrary display among a plurality of displays is shown, “display 3” is shown.
- an arbitrary electronic pen among a plurality of electronic pens When an arbitrary USB memory is indicated among the plurality of USB memories, it is indicated as “USB memory 5”.
- an arbitrary notebook PC 6 among the plurality of notebook PCs 6 is indicated, it is indicated as “note PC 6”.
- an arbitrary video conference terminal is indicated among the plurality of video conference terminals, it is indicated as “video conference terminal 7”.
- “hand H” is used when an arbitrary hand among the hands of a plurality of users is shown.
- an arbitrary cable is indicated among the plurality of cables, it is indicated as “cable 10”.
- the electronic blackboard 2 will be described as an example of an image processing apparatus.
- the electronic blackboard 2 is not limited thereto, and other examples of the image processing apparatus include an electronic signboard (digital signage), sports, weather forecasts, and the like. It may be a telestrator used in or a remote image (video) diagnostic device.
- the notebook PC 6 will be described as an example of the information processing terminal, but is not limited thereto.
- Other examples of the information processing terminal include a desktop PC, a tablet PC, a PDA, a smartphone, a digital video camera, and a digital camera.
- a terminal capable of supplying image frames such as a game machine may be used.
- the communication network includes the Internet, a LAN (Local Area Network), a mobile phone communication network, and the like.
- a USB memory is described as an example of a recording medium.
- the present invention is not limited to this, and various recording media such as an SD card may be used as another example of the recording medium.
- FIG. 3 is a hardware configuration diagram of the electronic blackboard 2.
- the electronic blackboard 2 includes a CPU 101 that controls the operation of the electronic blackboard 2 as a whole, a ROM 102 that stores programs used to drive the CPU 101 such as an IPL, and a RAM 103 that is used as a work area for the CPU 101. , An SSD 104 for storing various data such as a program for the electronic blackboard 2, a network controller 105 for controlling communication with the communication network 9, and an external storage controller 106 for controlling communication with the USB memory 5.
- the electronic blackboard 2 displays a capture device 111 that displays video information as a still image or a moving image on the display of the notebook PC 6, a GPU (Graphics Processing Unit) 112 that specializes in graphics, and an output image from the GPU. 3 and a display controller 113 for controlling and managing screen display for output to the video conference terminal 7.
- a capture device 111 that displays video information as a still image or a moving image on the display of the notebook PC 6, a GPU (Graphics Processing Unit) 112 that specializes in graphics, and an output image from the GPU. 3 and a display controller 113 for controlling and managing screen display for output to the video conference terminal 7.
- a GPU Graphics Processing Unit
- the electronic blackboard 2 includes a sensor controller 114 that controls the processing of the contact sensor 115 and a contact sensor 115 that detects that the electronic pen 4 or the user's hand H is in contact with the display 3.
- the contact sensor 115 performs coordinate input and coordinate detection by an infrared ray blocking method.
- this coordinate input and coordinate detection method two light emitting / receiving devices installed at both upper ends of the display 3 emit a plurality of infrared rays in parallel with the display 3 and are provided around the display 3. This is a method of receiving light that is reflected by the reflecting member and returns on the same optical path as the light path emitted by the light receiving element.
- the contact sensor 115 outputs infrared ID (Identification) emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 114, and the sensor controller 114 identifies the coordinate position that is the contact position of the object. All IDs shown below are examples of identification information.
- the contact sensor 115 is not limited to the infrared ray blocking method, but a capacitance type touch panel that identifies a contact position by detecting a change in capacitance, or a contact position determined by a voltage change of two opposing resistance films.
- Various detection means such as a resistance film type touch panel to be identified and an electromagnetic induction type touch panel to identify a contact position by detecting electromagnetic induction caused by contact of a contact object with the display unit may be used.
- the electronic blackboard 2 includes an electronic pen controller 116. This electronic pen controller 116 communicates with the electronic pen 4 to determine whether or not there is a pen tip touch or a pen butt touch on the display 3. It should be noted that the electronic pen controller 116 may determine whether or not the user grips the part of the electronic pen 4 as well as the other electronic pen part, as well as the pen tip and the bottom of the electronic pen 4.
- the electronic blackboard 2 includes a CPU 101, ROM 102, RAM 103, SSD 104, network controller 105, external storage controller 106, capture device 111, GPU 112, sensor controller 114, and electronic pen controller 116 as shown in FIG.
- a bus line 120 such as an address bus or a data bus for electrical connection is provided.
- program for the electronic blackboard 2 may be recorded and distributed on a computer-readable recording medium such as a CD-ROM.
- FIG. 4 is a functional block diagram of the electronic blackboard 2.
- the electronic blackboard 2 has each functional configuration shown in FIG. 4 by the hardware configuration and program shown in FIG.
- the electronic blackboard 2 can be a “host device” that starts the remote sharing process first, and can also be a “participating device” that participates in the remote sharing process that has already started.
- the electronic blackboard 2 is roughly composed of both the client unit 20 and the server unit 90.
- the client unit 20 and the server unit 90 are functions realized in one housing of the electronic blackboard 2.
- the electronic blackboard 2 implements the client unit 20 and the server unit 90.
- the electronic blackboard 2 is a participating device, in the electronic blackboard 2, the client unit 20 is realized, but the server unit 90 is not realized. That is, in FIG.
- the client unit 20 of the electronic blackboard 2 a passes through the server unit 90 realized in the same electronic blackboard 2 a. Communicate with the client unit 20 of the electronic blackboard 2b.
- the client unit 20 of the electronic blackboard 2b communicates with the client units of the other electronic blackboard 2a via the server unit 90 realized in the other electronic blackboard 2a.
- the client unit 20 includes a video acquisition unit 21, a coordinate detection unit 22, an automatic adjustment unit 23, a contact detection unit 24, an event distribution unit 25, an operation processing unit 26, a gesture processing unit 27, a video superimposing unit 28, and an image processing unit 30. And a communication control unit 60.
- the video acquisition unit 21 acquires the output image of the video output device connected to the cable 10.
- the video acquisition unit 21 analyzes the image signal, and updates the resolution of the image frame that is a display image of the video output device formed by the image signal.
- Image information such as frequency is derived and output to the image acquisition unit 31.
- the coordinate detection unit 22 detects the coordinate position of an event (such as an operation in which the user's hand H is touched on the display 3) generated by the user on the display 3.
- the coordinate detection unit 22 also detects the touched area.
- the automatic adjustment unit 23 is activated when the electronic blackboard 2 is activated (may be expressed as restarting), and coordinates that detect coordinates by an optical sensor method so that the coordinate detection unit 22 can output an appropriate value.
- the detection unit 22 adjusts parameters when processing the image of the sensor camera.
- the contact detection unit 24 detects an event (such as an operation in which the pen tip of the electronic pen 4 or the pen butt of the electronic pen 4 is pressed (touched) on the display 3).
- the event distribution unit 25 distributes the coordinate position of the event detected by the coordinate detection unit 22 and the detection result detected by the contact detection unit 24 to each event of stroke drawing, UI operation, and gesture operation.
- stroke drawing is performed when the user presses the electronic pen 4 on the display 3 when a stroke image (B) described later shown in FIG. 7 is displayed on the display 3. In this state, the electronic pen 4 is moved and finally the electronic pen 4 is released from the display 3.
- alphabets “S” and “T” are drawn on the display 3.
- the “stroke drawing” includes not only drawing an image but also an event of deleting an already drawn image or editing a drawn image.
- the “UI operation” is an event in which the user presses a predetermined position with the electronic pen 4 or the hand H when a UI image (A) described later shown in FIG. 7 is displayed on the display 3. .
- a UI image (A) described later shown in FIG. 7 is displayed on the display 3. .
- this UI operation for example, the color or width of a line drawn by the electronic pen 4 is set.
- “Gesture operation” is an event in which the user touches or moves the display 3 with the hand H when a stroke image (B) described later shown in FIG. 7 is displayed on the display 3. is there.
- this gesture operation for example, by moving the hand H while the user touches the display 3 with the hand H, the image can be enlarged (or reduced), the display area can be changed, or the page can be switched. it can.
- the operation processing unit 26 executes various operations according to the UI element in which the event is generated, from what is determined as the UI operation by the event distribution unit 25.
- Examples of the UI element include a button, a list, a check box, and a text box.
- the gesture processing unit 27 performs an operation corresponding to what is determined as a gesture operation by the event distribution unit 25.
- the video superimposing unit 28 displays the image superimposed by the display superimposing unit 36 described later on the display unit 29 as a video.
- the display unit 29 shows a display function realized by the display 3.
- the video superimposing unit 28 performs picture-in-picture on the video sent from another video output device (such as the video conference terminal 7) with respect to the video from the video output device (such as the notebook PC 6). Further, the video superimposing unit 28 performs switching for displaying the video that is picture-in-picture and displayed on a part of the display unit 29 on the entire display unit 29.
- the image processing unit 30 performs superimposing processing of each image layer as shown in FIG.
- the image processing unit 30 includes an image acquisition unit 31, a stroke processing unit 32, a UI image generation unit 33, a background generation unit 34, a watermark image generation unit 38, a layout management unit 35, a display superimposition unit 36, a page processing unit 37, a file A processing unit 40, a page data storage unit 300, and a remote license management table 310 are included.
- the image acquisition unit 31 acquires each frame as an image from the video acquired by the video acquisition unit 21.
- the image acquisition unit 31 outputs the image data to the page processing unit 37.
- This image corresponds to an output image (C) from the video output device (notebook PC 6 or the like) shown in FIG.
- the stroke processing unit 32 draws an image, deletes the drawn image, or edits the drawn image based on the event related to the stroke drawing allocated by the event distribution unit 25.
- the image by this stroke drawing corresponds to the stroke image (B) shown in FIG.
- the results of drawing, deleting, and editing an image based on the stroke drawing are stored in the operation data storage unit 840 as operation data described later.
- the UI image generation unit 33 generates a UI (user interface) image set in advance on the electronic blackboard 2. This UI image corresponds to the UI image (A) shown in FIG.
- the background generation unit 34 receives the media data from the page data read from the page data storage unit 300 by the page processing unit 37 from the page processing unit 37.
- the background generation unit 34 outputs the received media data to the display superimposing unit 36.
- the image based on the media data corresponds to the background image (D) shown in FIG.
- the pattern of the background image (D) is plain or grid display.
- the watermark image generation unit 38 outputs the watermark image data stored in the page data storage unit 300 as storage means of the electronic blackboard 2 to the display superimposing unit 36.
- This watermark image data corresponds to the watermark image (E) shown in FIG.
- the watermark image generation unit 38 performs processing such as matching the watermark image data in the page data storage unit 300 to the resolution and aspect ratio of the display 3 to generate watermark image data.
- the transparency may be previously stored in the watermark image data, or may be set by the user on the electronic blackboard 2.
- the watermark image data regarding the watermark image (E) may include at least information regarding the transparency of the watermark image (E).
- the layout management unit 35 for the display superimposing unit 36, lays out the images output from the image acquisition unit 31, the stroke processing unit 32, the UI image generation unit 33 (or the background generation unit 34), and the watermark image generation unit 38. Is managed. Thereby, the layout management unit 35 outputs the output image (C), the stroke image (B), and the watermark image (E) to the display superimposing unit 36 in the UI image (A) and the background image (D). It is possible to indicate whether the position is displayed or not.
- the display superimposing unit 36 is output from the image acquisition unit 31, the stroke processing unit 32, the UI image generation unit 33 (background generation unit 34), and the watermark image generation unit 38 based on the layout information output from the layout management unit 35. Each image is laid out (superposed).
- the page processing unit 37 stores the data of the stroke image (B) and the data of the output image (C) in one page data and stores them in the page data storage unit 300.
- the data of the stroke image (B) forms part of page data as the stroke arrangement data (each stroke data) indicated by the stroke arrangement data ID shown in FIG.
- the data of the output image (C) forms part of page data as the media data indicated by the media data ID shown in FIG. Then, when this media data is read from the page data storage unit 300, it is handled as data of the background image (D).
- the page processing unit 37 transmits the media data of the once stored page data to the display superimposing unit 36 via the background generating unit 34 so that the video superimposing unit 28 displays the background image (D). 3 can be displayed again.
- the page processing unit 37 can return the stroke arrangement data (each stroke data) in the page data to the stroke processing unit 32 so that the stroke can be re-edited. Further, the page processing unit 37 can delete or duplicate page data.
- the data of the output image (C) displayed on the display 3 when the page processing unit 37 stores the page data in the page data storage unit 300 is temporarily stored in the page data storage unit 300 and then When read from the page data storage unit 300, it is read as media data indicating the background image (D). Then, the page processing unit 37 outputs stroke arrangement data indicating the stroke image (B) among the page data read from the page data storage unit 300 to the stroke processing unit 32. Further, the page processing unit 37 outputs media data indicating the background image (D) among the page data read from the page data storage unit 300 to the background generation unit 34.
- the page processing unit 37 sends the watermark image data stored in the page data storage unit 300 to the watermark image generation unit 38.
- the watermark image generating unit 38 transmits the watermark image to the display superimposing unit 36.
- the display superimposing unit 36 includes an output image (C) from the image acquisition unit 31, a stroke image (B) from the stroke processing unit 32, a UI image (A) from the UI image generation unit 33, and a background from the background generation unit 34.
- the image (D) and the watermark image (E) from the watermark image generation unit 38 are superimposed according to the layout designated by the layout management unit 35. Accordingly, as shown in FIG. 7, the UI image (A), the stroke image (B), the watermark image (E), the output image (C), and the background are displayed in the order in which the user can see each image even if they overlap. Each layer of the image (D) is configured.
- the display superimposing unit 36 switches between the output image (C) and the background image (D) shown in FIG. 7, and performs the UI image (A), the stroke image (B), and the watermark image (E). It is also possible to superimpose them exclusively.
- the cable 10 between the electronic blackboard 2 and the video output device (notebook PC 6 or the like) was disconnected while the UI image (A), stroke image (B), and output image (C) were initially displayed.
- the output image (C) can be excluded from the superimposition target and the background image (D) can be displayed as specified by the layout management unit 35.
- the layout management unit 35 switches the watermark image (E) from non-display to display.
- the display superimposing unit 36 also performs display enlargement, display reduction, and display area movement processing.
- the page data storage unit 300 stores page data as shown in Table 1.
- Table 1 conceptually shows the page data.
- the page data is data for one page displayed on the display 3 (stroke arrangement data (each stroke data) and media data). Since there are many types of parameters included in the page data, here, the contents of the page data will be described separately in Tables 1 to 4.
- the page data is a page data ID for identifying an arbitrary page, a start time indicating the start time of display of this page, and rewriting of the contents of the page by a stroke, a gesture or the like.
- the stroke arrangement data ID for identifying the stroke arrangement data generated by the stroke of the electronic pen 4 or the user's hand H
- the media data ID for identifying the media data. Is remembered.
- the stroke arrangement data is data for displaying a stroke image (B) shown in FIG.
- the media data is data for displaying a background image (D) shown in FIG.
- the stroke arrangement data shows detailed information as shown in Table 2.
- Table 2 conceptually shows the stroke arrangement data.
- one stroke arrangement data is represented by a plurality of stroke data.
- One stroke data includes a stroke data ID for identifying the stroke data, a start time indicating the start time of writing one stroke, an end time indicating the end time of writing one stroke, the color of the stroke, A stroke width and coordinate array data ID for identifying an array of stroke passing points are shown.
- the coordinate array data shows detailed information as shown in Table 3.
- Table 3 conceptually shows the coordinate array data.
- the coordinate array data includes one point on the display 3 (X coordinate value, Y coordinate value), and a time difference (ms from the start time of the stroke when the one point is passed) ) And writing pressure information of the electronic pen 4 at this one point. That is, a set of one point shown in Table 3 is shown by one coordinate array data shown in Table 2. For example, when the user draws the alphabet “S” with the electronic pen 4, it is drawn with a single stroke, but passes through a plurality of passing points until the drawing of “S” is completed. Information.
- the media data of the page data shown in Table 1 has detailed information as shown in Table 4.
- Table 4 conceptually shows the media data.
- the media data is stored in the page data storage unit 300 from the page processing unit 37, the media data ID in the page data shown in Table 1, the data type of the media data, and the page data storage unit 300.
- the recording time, the position of the image displayed on the display 3 by the page data (X coordinate value, Y coordinate value), the image size (width, height), and data indicating the contents of the media data are shown in association with each other Has been.
- the position of the upper left corner of the image to be displayed is shown.
- the page data storage unit 300 stores watermark image data.
- the watermark image data has information as shown in Table 5.
- Table 5 conceptually shows watermark image data stored in the page data storage unit 300.
- the watermark image data is held as a file, and the file name, update date / time, type, and creator information are held in association with each other. These are items that the information processing apparatus has as file attributes, and other attributes that the file may have may be registered.
- file attributes and other attributes that the file may have may be registered.
- three files are registered, but one or more files may be registered.
- no file may be registered (a watermark image cannot be displayed).
- the watermark image data displayed last, the watermark image data selected by the user, the watermark image data with the newest (or oldest) update date, or the user who has logged into the electronic blackboard 2
- the watermark image data as the creator is appropriately selected and used.
- the file type is transparent PNG that can handle transparency (hereinafter simply referred to as PNG), but any file that can represent transparency, such as transparent GIF, may be used. Further, even if the transparency of the file function cannot be maintained, the watermark image generation unit 38 may create a watermark image whose transparency is controlled from JPEG or the like.
- the remote license management table 310 manages license data necessary for executing remote sharing processing.
- the product ID of the electronic blackboard 2 As shown in Table 6, the product ID of the electronic blackboard 2, the license ID used for authentication, and the expiration date of the license are managed in association with each other.
- FIG. 5 is a functional block diagram of the file processing unit.
- the file processing unit 40 includes a recovery processing unit 41, a file input unit 42a, a file output unit 42b, a file conversion unit 43, a file transmission unit 44, an address book input unit 45, a backup processing unit 46, a backup output unit 47, and a setting management unit. 48, a setting file input unit 49a, and a setting file output unit 49b.
- the file processing unit 40 includes an address book management table 410, a backup data storage unit 420, a setting file storage unit 430, and a connection destination management table 440.
- the recovery processing unit 41 detects the abnormal end after the electronic blackboard 2 is abnormally terminated, and recovers the unsaved page data. For example, in the case of a normal end, the page data is recorded as a PDF file on the USB 5 via the file processing unit 40, but in the case of an abnormal end such as when the power is down, the page data is recorded in the page data storage unit 300. Has been done. Therefore, when the power is turned on again, the recovery processing unit 41 recovers by reading the page data from the page data storage unit 300.
- the file input unit 42a reads a PDF file from the USB memory 5 and stores each page in the page data storage unit 300 as page data.
- the file conversion unit 43 converts the page data stored in the page data storage unit 300 into a PDF format file.
- the file input unit 42 a reads the watermark image data and stores it in the page data storage unit 300.
- a predetermined type of file such as PNG may be automatically read from the USB memory 5 mounted on the electronic blackboard 2, or the file specified by the user is copied from the USB memory 5 to the page data storage unit 300. May be.
- the user may operate an arbitrary terminal to communicate with the electronic blackboard 2 and input the watermark image data to the electronic blackboard 2 by uploading using a Web page prepared by the electronic blackboard 2.
- the file input unit 42a functions as a Web server.
- An arbitrary terminal receives from the electronic blackboard 2 HTML data that can be transmitted by specifying the IP address of the electronic blackboard 2 using a browser or the like. Since the browser accepts the user's selection of the file, an arbitrary terminal transmits the watermark image data file selected by the user to the file input unit 42a.
- the file input unit 42 a stores the watermark image data file in the page data storage unit 300.
- the file input unit 42a can capture (acquire) watermark image data having information related to the transparency of the watermark image (E) from the outside, and the watermark image data is stored in the page data storage unit 300. Can be memorized.
- the file output unit 42 b records the PDF file output by the file conversion unit 43 in the USB memory 5.
- the file transmission unit 44 transmits the PDF file generated by the file conversion unit 43 as an attachment to an e-mail.
- the transmission destination of the file is displayed by displaying the contents of the address book management table 410 on the display 3 by the display superimposing unit 36, and the file transmitting unit 44 accepts the selection of the destination by the operation of the input device such as a touch panel by the user. It is determined.
- the address book management table 410 as shown in Table 7, the name of the destination and the mail address of the destination e-mail are managed in association with each other.
- the file transmission unit 44 can accept an input of a mail address as a destination by an operation of an input device such as a touch panel by the user.
- the address book input unit 45 reads the e-mail address list file from the USB memory 5 and manages it in the address book management table 410.
- the backup processing unit 46 performs backup by storing the file output by the file output unit 42b and the file transmitted by the file transmission unit 44 in the backup data storage unit 420. If the user does not set backup, backup processing is not performed.
- the backup data is stored in PDF format as shown in Table 8.
- the backup output unit 47 stores the backed up file in the USB memory 5. During this storage, a passcode is input for security by the operation of an input device such as a touch panel by the user.
- the setting management unit 48 stores and reads various setting information of the electronic blackboard 2 in the setting file storage unit 430 for management.
- the various setting information include network settings, date and time settings, region and language settings, mail server settings, address book settings, connection destination list settings, and backup settings.
- the network setting is, for example, an IP address setting of the electronic blackboard 2, a net mask setting, a default gateway setting, a DNS (Domain Name System) setting, or the like.
- the setting file output unit 49b records various setting information of the electronic blackboard 2 in the USB memory 5 as a setting file. Note that the settings file cannot be viewed by the user due to security.
- the setting file input unit 49a reads the setting file stored in the USB memory 5 and reflects various setting information in the various settings of the electronic blackboard 2.
- the address book input unit 50 reads a list file of connection destination IP addresses for remote sharing processing from the USB memory 5 and manages it in the connection destination management table 440.
- An example of the connection destination management table 440 is shown in Table 9.
- the connection destination management table 440 reduces the effort for the user of the participating device to input the IP address of the electronic blackboard 2 that plays the role of the host device. This is a table for managing in advance.
- the name of the base where the electronic blackboard 2 as a hosting apparatus that can participate is installed and the IP address of the electronic blackboard 2 as the hosting apparatus are managed in association with each other.
- connection destination management table 440 may be omitted.
- the user of the participating device needs to input the IP address of the host device using an input device such as a touch panel in order to start remote request processing with the host device. Therefore, the user of the participating device obtains the IP address of the sponsoring device from the user of the sponsoring device by telephone or electronic mail.
- FIG. 6 is an example of a functional block diagram of the server unit 90 and the client unit 20.
- the communication control unit 60 controls communication with other electronic whiteboards 2 and communication with the later-described communication control unit 70 in the server unit 90 via the communication network 9. Therefore, the communication control unit 60 includes a remote start processing unit 61, a remote participation processing unit 62, a remote image transmission unit 63, a remote image reception unit 64, a remote operation transmission unit 65, a remote operation reception unit 66, and a participation base management table 610. have.
- the remote start processing unit 61 makes a request for starting a new remote sharing process to the server unit 90 of the same electronic blackboard 2, and receives the result of the request from the server unit 90.
- the remote start processing unit 61 refers to the remote license management table 310 and makes a request to start remote sharing processing when license information (product ID, license ID, and expiration date) is managed. be able to. However, if the license information is not managed, a request to start remote sharing processing cannot be made.
- the participation base management table 610 is a table for managing the electronic blackboard 2 as a participating device that is currently participating in the remote sharing process when the electronic blackboard 2 is the sponsoring device.
- An example of the participating base management table 610 is shown in Table 10.
- the participating base management table 610 the name of the base where the participating electronic blackboard 2 is installed and the IP address of the electronic blackboard 2 are managed in association with each other.
- the remote participation processing unit 62 sends the remote connection processing to the remote sharing processing to the remote connection request receiving unit 71 in the server unit 90 of the electronic blackboard 2 as the host apparatus that has already started the remote sharing processing via the communication network 9. Request participation. Also in this case, the remote participation processing unit 62 refers to the remote license management table 310. In addition, when the remote participation processing unit 62 participates in the remote sharing process that has already been started, the IP address of the electronic blackboard 2 of the participation destination is acquired with reference to the connection destination management table 440. Note that the remote participation processing unit 62 may not input the connection destination management table, and may input the IP address of the electronic blackboard 2 as a participation destination by an operation of an input device such as a touch panel by the user.
- the remote image transmission unit 63 transmits the output image (C) sent from the video acquisition unit 21 via the image acquisition unit 31 to the server unit 90.
- the remote image receiving unit 64 receives image data from the video output device connected to the other electronic blackboard 2 from the server unit 90 and outputs it to the display superimposing unit 36, thereby enabling remote sharing processing.
- the remote operation transmission unit 65 transmits various operation data necessary for remote sharing processing to the server unit 90.
- Examples of the operation data include adding a stroke, deleting a stroke, editing a stroke (enlarging, reducing, moving), storing page data, creating page data, duplicating page data, deleting page data, and displaying. Data related to the switching of the current page.
- the remote operation receiving unit 66 receives the operation data input from another electronic blackboard 2 from the server unit 90 and outputs it to the image processing unit 30 to perform remote sharing processing.
- the server unit 90 includes a communication control unit 70 and a data management unit 80. (Functional configuration of communication control unit 70) Next, the functional configuration of the communication control unit 70 will be described with reference to FIG.
- the communication control unit 70 controls communication with the communication control unit 70 in the client unit 20 in the same electronic blackboard 2 and the communication control unit 70 in the client unit 20 in another electronic blackboard 2 via the communication network 9.
- the data management unit 80 manages operation data, image data, and the like.
- the communication controller 70 includes a remote connection request receiver 71, a remote connection result transmitter 72, a remote image receiver 73, a remote image transmitter 74, a remote operation receiver 75, and a remote operation transmitter 76. have.
- the remote connection request receiving unit 71 receives a remote sharing processing start request from the remote start processing unit 61 or receives a participation request for remote sharing processing from the remote participation processing unit 62.
- the remote connection result transmission unit 72 transmits the result of the remote sharing processing start request to the remote start processing unit 61, or transmits the result of the participation request for the remote sharing processing to the remote participation processing unit 62.
- the remote image receiving unit 73 receives the image data (data of the output image (C)) from the remote image transmitting unit 63 and transmits it to the remote image processing unit 82 described later.
- the remote image transmission unit 74 receives image data from the remote image processing unit 82 and transmits this image data to the remote image reception unit 64.
- the remote operation receiving unit 75 receives operation data (data such as a stroke image (B)) from the remote operation transmitting unit 65 and transmits it to the remote operation processing unit 83 described later.
- the remote operation transmission unit 76 receives operation data from the remote operation processing unit 83 and transmits this operation data to the remote operation reception unit 66.
- the data management unit 80 includes a remote connection processing unit 81, a remote image processing unit 82, a remote operation processing unit 83, an operation composition processing unit 84, and a page processing unit 85.
- the server unit 90 includes a passcode management unit 810, a participating site management table 820, an image data storage unit 830, an operation data storage unit 840, and a page data storage unit 850.
- the remote connection processing unit 81 starts remote sharing processing and ends remote sharing processing.
- the remote connection processing unit 81 also receives the license information received by the remote connection request receiving unit 71 from the remote start processing unit 61 together with the remote sharing processing start request or the remote sharing processing unit 62 from the remote sharing processing participation request. Based on the received license information, it is confirmed whether there is a license and whether it is within the license period. Further, the remote connection processing unit 81 confirms whether or not the participation request from the other electronic blackboard 2 as the client unit exceeds the predetermined number of possible participations.
- the remote connection processing unit 81 has the same passcode that is sent when another electronic blackboard 2 has requested to participate in remote sharing processing as the passcode managed by the passcode management unit 810. It is determined whether or not there is the same, and if they are the same, participation in the remote sharing process is permitted.
- This passcode is issued by the remote connection processing unit 81 when a new remote sharing process is started, and the user of the electronic blackboard 2 as a participating apparatus who intends to participate in the remote sharing process can It is transmitted from the user of the electronic blackboard 2 by telephone or e-mail.
- a user of a participating device who intends to participate in the remote sharing process inputs the pass code to the participating device using an input device such as a touch panel and requests participation, thereby permitting participation.
- the user's ease of use may be given priority over security, and the confirmation of the passcode may be omitted only by confirming the license status.
- the remote connection processing unit 81 uses the participation base information included in the participation request sent from the remote participation processing unit 62 of the participating device via the communication network 9 as the server unit.
- the data are stored in the 90 participating site management table 820.
- the remote connection processing unit 81 reads out the remote site information stored in the participating site management table 820 and transmits it to the remote connection result transmission unit 72.
- the remote connection result transmission unit 72 transmits the remote base information to the remote start processing unit 61 in the client unit 20 of the same sponsor device.
- the remote start processing unit 61 stores the remote site information in 610 in the participating site management table.
- the host device manages remote site information in both the client unit 20 and the server unit 90.
- the remote image processing unit 82 is an image from a video output device (notebook PC 6 or the like) connected to the client unit of each electronic blackboard 2 (including the client unit of its own electronic blackboard 2 which is the hosting device) during remote sharing processing.
- Data output image (C)
- the remote image processing unit 82 refers to the participation base management table 820, and includes the client units 20 of all the electronic blackboards 2 participating in the remote sharing process (including the client units of the electronic blackboard 2 that is the host device).
- the image data is transmitted in the determined order via the communication control unit 70 (remote image transmission unit 74).
- the remote operation processing unit 83 performs various types of operation data (stroke images (including stroke images) drawn by the client unit of each electronic blackboard 2 (including the client unit of its own electronic blackboard 2 that is the host device) during the remote sharing process. B) and the like are received, and the display order of the images to be remotely shared is determined in the order in which they arrived at the server unit 90 of the electronic blackboard 2 that is the host device.
- the various operation data is the same as the various operation data described above.
- the remote operation processing unit 83 refers to the participating site management table 820 and operates all the client units 20 of the electronic blackboard 2 (including the client unit of the electronic blackboard 2 that is the hosting device) during the remote sharing process. Send data.
- the operation synthesis processing unit 84 synthesizes the operation data of each electronic blackboard 2 output from the remote operation processing unit 83, stores the operation data as a result of the synthesis in the operation data storage unit 840 and the remote operation processing unit 83.
- the operation data is transmitted from the remote operation transmission unit 76 to each of the client unit of the electronic blackboard 2 that is the host device and the client unit of the electronic blackboard 2 that is the participating device, so that the same operation is performed on each electronic blackboard 2.
- An image related to the data is displayed.
- An example of the operation data is shown in Table 11.
- the operation data includes SEQ (Sequence), the operation name of the operation data, the IP address of the electronic blackboard 2 that is the transmission source of the operation data, the Port No. of the client unit (server unit), Shows the IP address of the electronic blackboard 2 to which the operation data is sent, the port number of the client unit (server unit), the operation type of the operation data, the operation target of the operation data, and data indicating the contents of the operation data in association with each other. Has been.
- the electronic blackboard 2 shows that operation data has been sent to the server part (Port No .: 50000).
- the operation type is “STROKE”
- the operation object is the page data ID “p005”
- the data indicating the contents of the operation data is data indicating the stroke.
- the other electronic blackboard 2 (IP address: 192.0.0.1) that is the participating device.
- the client part (Port No .: 50001) indicates that operation data has been sent.
- the operation composition processing unit 84 performs composition in the order in which the operation data is input to the operation composition processing unit 84. Therefore, if the communication network 9 is not congested, remote sharing is performed in the order of strokes by the users of the electronic blackboards 2. A stroke image (B) is displayed on the displays 3 of all the electronic blackboards 2 being processed.
- the page processing unit 85 has the same function as the page processing unit 37 in the image processing unit 30 of the client unit 20, and the server unit 90 also converts the page data shown in Tables 1 to 3 into the page data storage unit. Store in 850. Note that the page data storage unit 850 has the same contents as the page data storage unit 300 in the image processing unit 30, and therefore the description thereof is omitted.
- FIGS. 8 and 9 are sequence diagrams showing the processing of each electronic blackboard 2.
- the electronic blackboard 2a serves as a hosting device (server unit and client unit) that hosts the remote sharing process, and the electronic blackboards 2b and 2c participate in the remote sharing process. A case where it plays a role as a device (client unit) will be described.
- the displays 3a, 3b, 3c are connected to the electronic blackboards 2a, 2b, 2c, respectively, and further notebook PCs 6a, 6b, 6c are connected respectively.
- electronic pens 4a, 4b, and 4c are used, respectively.
- the client unit 20 of the electronic blackboard 2a When the user turns on the power switch of the electronic blackboard 2a, the client unit 20 of the electronic blackboard 2a is activated.
- the server unit 90 When the user performs an operation to activate the server unit 90 using an input device such as a touch panel, the server unit 90 is transferred from the remote start processing unit 61 of the client unit 20 to the remote connection request receiving unit 71 in the server unit 90 of the same electronic blackboard 2a. An instruction to start the process is output.
- the server unit 90 In the electronic blackboard 2a, not only the client unit 20 but also the server unit 90 can start various processes (step S21).
- the UI image generating unit 33 in the client unit 20 of the electronic blackboard 2a generates connection information for establishing a connection with the electronic blackboard 2a, and the video superimposing unit 28 transmits the display superimposing unit 36 from the UI image generating unit 33.
- the connection information obtained through is displayed on the display 3a (step S22).
- connection information includes the host device's IP address and the passcode generated for this remote sharing process.
- the passcode stored in the passcode management unit 810 is read by the remote connection processing unit 81 shown in FIG. 7 and transmitted in the order of the remote connection result transmission unit 72 and the remote start processing unit 61.
- the pass code is transmitted from the communication control unit 60 including the remote start processing unit 61 to the image processing unit 30 shown in FIG. 5 and finally input to the UI image generation unit 33.
- the connection information includes the passcode.
- the connection information is transmitted to the users of the electronic blackboards 2b and 2c by telephone or electronic mail by the user of the electronic blackboard 2a. If there is the connection destination management table 440, even if the connection information does not include the IP address of the hosting device, the participating device can make a participation request.
- the remote participation processing unit 62 in the client unit 20 of each electronic blackboard 2a and 2b Based on the IP address, a participation request is made by transmitting a pass code to the communication control unit 70 in the server unit 90 of the electronic blackboard 2a via the communication network 9 (steps S23 and S24).
- the remote connection request receiving unit 71 of the communication control unit 70 receives a participation request (including a passcode) from each of the electronic blackboards 2b and 2c, and outputs this passcode to the remote connection processing unit 81.
- the remote connection processing unit 81 authenticates the passcode received from each of the electronic blackboards 2b and 2c using the passcode managed by the passcode management unit 810 (step S25).
- the remote connection result transmission unit 72 notifies the authentication result to the client unit 20 of each electronic blackboard 2b, 2c (steps S26, S27).
- each of the electronic blackboards 2b and 2c is a valid electronic blackboard 2
- the electronic blackboard 2a that is the host device and the electronic blackboards 2b and 2c that are the participating devices are remotely connected. Communication of the sharing process is established, and the remote participation processing unit 62 in the client unit 20 of each electronic blackboard 2b, 2c enables the start of remote sharing processing with each other electronic blackboard 2 (steps S28, S29). ).
- the electronic blackboard 2b displays the output image (C) on the display 3b (step S30).
- the image acquisition unit 31 of the electronic blackboard 2b receives the data of the output image (C) displayed on the notebook PC 6b from the notebook PC 6b via the video acquisition unit 21, and displays the display superimposing unit 36 and the video.
- the display 3b displays the output image (C).
- the image processing unit 30 including the image acquisition unit 31 of the electronic blackboard 2 b transmits the output image (C) data to the remote image transmission unit 63, so that the communication control unit 60 including the remote image transmission unit 63 is performed.
- the data of the output image (C) is transmitted to the communication control unit 70 of the electronic blackboard 2a that is the hosting device via the communication network 9 (step S31).
- the remote image receiving unit 73 of the electronic blackboard 2a receives the output image (C) data and outputs it to the remote image processing unit 82, so that the remote image processing unit 82 outputs the output image to the image data storage unit 830.
- the data of (C) is stored.
- the electronic blackboard 2a which is the hosting device, displays the output image (C) on the display 3a (step S32).
- the remote image processing unit 82 of the electronic blackboard 2 a outputs the output image (C) data received from the remote image receiving unit 73 to the remote image transmitting unit 74.
- the remote image transmitting unit 74 outputs the data of the output image (C) to the remote image receiving unit 64 in the client unit 20 of the electronic blackboard 2a which is the same host device.
- the remote image receiving unit 64 outputs the data of the output image (C) to the display superimposing unit 36.
- the display superimposing unit 36 outputs the output image (C) data to the video superimposing unit 28.
- the video superimposing unit 28 outputs the data of the output image (C) to the display 3a. Thereby, the display 3a displays the output image (C).
- the communication control unit 70 including the remote image transmission unit 74 in the server unit 90 of the electronic blackboard 2a as the hosting device via the communication network 9 is the electronic blackboard 2b that is the transmission source of the data of the output image (C).
- the data of the output image (C) is transmitted to the communication control unit 60 of the electronic blackboard 2c other than (step S33).
- the remote image receiving part 64 of the electronic blackboard 2c which is a participating apparatus receives the data of an output image (C).
- the electronic blackboard 2c displays the output image (C) on the display 3c (step S34).
- the remote image receiving unit 64 of the electronic blackboard 2c outputs the data of the output image (C) received in step S33 to the display superimposing unit 36 of the electronic blackboard 2c.
- the display superimposing unit 36 outputs the output image (C) data to the video superimposing unit 28.
- the video superimposing unit 28 outputs the data of the output image (C) to the display 3c. Thereby, the display 3c displays the output image (C).
- the display superimposition is performed.
- the superimposed image (A, B, C) is generated by the unit 36, and the video overlapping unit 28 outputs the data of the superimposed image (A, B, C) to the display 3c.
- the watermark image (E) is not displayed.
- video conference video (F) data is sent from the video conference terminal 7 to the video superimposing unit 28, the video superimposing unit 28 displays the superimposed image (A, B, C).
- the video conference video (F) data is superimposed by picture-in-picture and output to the display 3c.
- the watermark image (E) is not transmitted / received between the sponsor device and the participating device. Therefore, whether or not the watermark image (E) is displayed differs depending on the electronic blackboard 2. Also, the watermark image (E) displayed by each electronic blackboard 2 may be different depending on the electronic blackboard 2 (there may be the same case).
- the watermark image data may be transmitted and received between the electronic blackboards 2.
- the electronic blackboard 2 has a function of transmitting setting information in which settings related to the operation of the electronic blackboard 2 are described.
- the setting information includes, for example, settings for appropriately operating the electronic blackboard 2 (synchronization time, restart time, etc.), and settings for permitting or restricting the operation of the electronic blackboard 2 (settings related to security such as a passcode).
- On / off settings for each function settings for communicating with the Internet and other devices via a network (IP address, etc.), and the like.
- the watermark image data can be shared between the electronic blackboards 2 together with the setting information by using the function of transmitting the setting information.
- the user draws a stroke image (B) on the electronic blackboard 2b using the electronic pen 4b (step S41).
- the display superimposing unit 36 of the electronic blackboard 2b superimposes the stroke image (B) on the UI image (A) and the output image (C), as shown in FIG.
- the unit 28 displays the superimposed images (A, B, C) superimposed on the display 3b of the electronic blackboard 2b (step S42).
- the stroke processing unit 32 of the electronic blackboard 2b receives the stroke image (B) data as the operation data from the coordinate detection unit 22 and the contact detection unit 24 via the event distribution unit 25, and displays the superimposed image. It transmits to the part 36.
- the display superimposing unit 36 can superimpose the stroke image (B) on the UI image (A) and the output image (C), and the video superimposing unit 28 is placed on the display 3b of the electronic blackboard 2b.
- the superimposed image (A, B, C) can be displayed.
- the image processing unit 30 including the stroke processing unit 32 of the electronic blackboard 2b transmits the stroke image (B) data to the remote operation transmission unit 65, so that the remote operation transmission unit 65 of the electronic blackboard 2b communicates.
- the data of the stroke image (B) is transmitted via the network 9 to the communication control unit 70 of the electronic blackboard 2a that is the hosting device (step S43).
- the remote operation receiving unit 75 of the electronic blackboard 2a receives the data of the stroke image (B) and outputs it to the remote operation processing unit 83, so that the remote operation processing unit 83 sends the stroke image to the operation composition processing unit 84.
- the data of (B) is output.
- the data of the stroke image (B) drawn on the electronic blackboard 2b is sequentially transmitted to the remote operation processing unit 83 of the electronic blackboard 2a that is the hosting device every time it is drawn.
- the data of the stroke image (B) is data shown for each stroke data ID shown in FIG. Therefore, for example, as described above, when the user draws the alphabet “T” with the electronic pen 4, the stroke image (B) indicated by each of the two stroke data IDs is sequentially transmitted. Is done.
- the electronic blackboard 2a which is the hosting device, displays on the display 3a a superimposed image (A, B, C) including the data of the stroke image (B) sent from the electronic blackboard 2b (Step S). S44).
- the operation composition processing unit 84 of the electronic blackboard 2a synthesizes the data of the plurality of stroke images (B) sequentially sent via the remote operation processing unit 83 and stores them in the operation data storage unit 840. Store and return to the remote operation processing unit 83.
- the remote operation processing unit 83 outputs the combined stroke image (B) data received from the operation synthesis processing unit 84 to the remote operation transmission unit 76.
- the remote operation transmitting unit 76 outputs the combined stroke image (B) data to the remote operation receiving unit 66 in the client unit 20 of the electronic blackboard 2a which is the same hosting device.
- the remote operation receiving unit 66 outputs the combined stroke image (B) data to the display superimposing unit 36 in the image processing unit 30. Therefore, the display superimposing unit 36 superimposes the combined stroke image (B) on the UI image (A) and the output image (C).
- the video superimposing unit 28 displays the superimposed image (A, B, C) superimposed by the display superimposing unit 36 on the display 3a.
- the communication control unit 70 including the remote operation transmission unit 76 in the server unit 90 of the electronic blackboard 2a as the hosting device via the communication network 9 is the electronic blackboard 2b that is the transmission source of the stroke image (B) data.
- the composite stroke image (B) data is transmitted to the communication control unit 60 of the electronic blackboard 2c other than (step S45).
- the remote operation receiving part 66 of the electronic blackboard 2c which is a participating apparatus receives the data of the synthesized stroke image (B).
- the electronic blackboard 2c displays a superimposed image (A, B, C) on the display 3c (step S46).
- the remote operation receiving unit 66 of the electronic blackboard 2c outputs the combined stroke image (B) data received in step S45 to the image processing unit 30 of the electronic blackboard 2c.
- the display superimposing unit 36 of the image processing unit 30 superimposes each data of the UI image (A) and the output image (C) and the data of the combined stroke image (B), and superimposes the superimposed image ( A, B, C) data is output.
- the video superimposing unit 28 outputs the data of the superimposed image (A, B, C) to the display 3c. Thereby, the display 3c displays a superimposed image (A, B, C).
- the output image (C) is displayed on the display 3, but a background image (D) may be displayed instead of the output image (C).
- a background image (D) may be displayed instead of the output image (C).
- the exclusive relationship between the output image (C) and the background image (D) may be stopped, and both the output image (C) and the background image (D) may be displayed on the display 3 at the same time.
- the remote participation processing unit 62 sends a communication control unit 70 in the server unit 90 of the electronic blackboard 2a as a host device to the communication control unit 70.
- a request to end participation is made (step S47).
- the remote connection request receiving unit 71 of the communication control unit 70 receives the participation end request from the electronic blackboard 2c, and outputs the participation end request to the remote connection processing unit 81 together with the IP address of the electronic blackboard 2c. .
- the remote connection processing unit 81 of the electronic blackboard 2a based on the IP address sent from the remote connection request receiving unit 71, from the participation base management table 820, the IP of the electronic blackboard 2c that has requested participation.
- the address and the name of the base where the electronic blackboard 2c is installed are deleted, and the remote connection result transmission unit 72 outputs the IP address of the electronic blackboard 2c and a notification of the deletion.
- the communication control unit 70 including the remote connection result transmission unit 72 instructs the communication control unit 60 in the client unit 20 of the electronic blackboard 2c to end participation via the communication network 9 (step S48).
- the remote participation processing unit 62 of the communication control unit 60 in the electronic blackboard 2c disconnects the communication of the remote sharing process, thereby completing the participation process, thereby completing the participation (step S49).
- the administrator can communicate with the electronic blackboard 2 using the administrator terminal and upload the watermark image file to the electronic blackboard 2.
- FIG. 10A shows a screen example of the administrator terminal.
- FIG. 10A shows a part of a Web page provided by the Web server of the electronic blackboard 2.
- the upload screen 601 includes a port number column 602, an IPID column 603, and an upload button 604.
- the port number column 602 port numbers for the electronic blackboard 2 to accept various settings are set.
- An IPID is entered in the IPID column 603.
- the IPID is information for specifying the IP address of the electronic blackboard 2, and has the same value as the ID of the electronic blackboard 2. Since the administrator only has to input an IPID instead of an IP address, it becomes easy to upload a watermark image.
- the table in which the ID of the electronic blackboard 2 is associated with the IP address is transmitted from the electronic blackboard 2 or stored in the administrator terminal.
- An IP address may be input.
- an IP address or a host name associated with the target electronic blackboard is often input. In such a case, since the IP address has already been specified, there is no need for the IPID column.
- a file selection screen 611 in FIG. 10B is displayed.
- the file selection screen 611 has a file list part 612 and an open button 613.
- the administrator selects a watermark image file from the file list section 612 and presses an open button 613. As a result, the watermark image file is transmitted to the electronic blackboard 2.
- FIG. 11A shows an example of a watermark image.
- FIG. 11B shows another example of a watermark image.
- FIG. 11A is a watermark image that displays the characters “Confidential”, and
- FIG. 11B is a watermark image that is entirely uniform.
- FIGS. 11A and 11B show a state in which the UI image (A), the stroke image (B), the output image (C), and the background image (D) are not displayed.
- the watermark image of FIG. 11A When the watermark image of FIG. 11A is displayed on the display 3, one or more users watching the display 3 can be notified that the stroke image (B) and the background image (C) are confidential matters.
- the watermark image of FIG. 11B when the watermark image of FIG. 11B is displayed on the display 3, it is possible to suppress the user from feeling dazzled because the white display 3 can be normally displayed in a shade with lower luminance. If the brightness of the display 3 is lowered, the screen may feel dark. However, if the watermark image (E) is used, the brightness of the display 3 can be reduced without lowering the brightness. For example, if the uniform color is green or black (not necessarily completely black), the color is similar to that of a blackboard on which characters are drawn with chalk. If it is a transparent uniform color watermark image, the entire image becomes dark, so that an effect of adjusting the contrast can be obtained.
- the watermark image (E) as shown in FIG. 11 is in front of the output image (C), the user can visually recognize the output image (C) through the watermark image (E).
- the watermark image (E) stored in the electronic blackboard 2 is, for example, an image having one or more predetermined characters as shown in FIG. 11A or a uniform color image as shown in FIG. 11B. There may be.
- PNG has a function of setting transparency in units of pixels. In this embodiment, it is assumed that 0% is completely transparent and 100% is completely opaque. The opposite of the interpretation of general words is that it follows the definition of PNG transparency, and may be defined as 0% completely opaque and 100% completely transparent.
- FIG. 11A is a watermark image in which the transparency of the character portion “Confidential” (pixel unit) is 20% and the others are 0% transparency.
- FIG. 11B shows an example in which a watermark image having a black color and 20% transparency is superimposed on a white image.
- the characters in FIG. 11A and the uniform image in FIG. 11B are merely examples.
- the electronic blackboard 2 can display various characters as watermark images, and can display various landscapes and photographs as watermark images.
- the watermark image may be a moving image.
- the operation processing unit 26 can accept a transparency setting (setting value) of part or all of the watermark image (E).
- the watermark image (E) is displayed with the set transparency.
- FIG. 12 is an example of a flowchart illustrating a transparency setting method. This will be described with reference to FIGS. 13A and 13B as appropriate.
- the user selects a menu for selecting the transparency of the watermark image from the UI image (A).
- the user selects watermark image data for which transparency is to be set from the list.
- the watermark image generation unit 38 displays the watermark image (E) on the display 3 (step S10).
- the watermark image generation unit 38 receives a color or region setting for setting the transparency (step S20). More specifically, when the coordinate detection unit 22 detects a coordinate touched by the electronic pen 4 or the finger, the event distribution unit 25 determines that a UI operation has been performed, and notifies the operation processing unit 26 of it. The operation processing unit 26 determines the operation content from the coordinates touched by the electronic pen 4 or the finger (color or region setting operation), and notifies the watermark image generation unit 38 of the operation content.
- the watermark image generation unit 38 receives a transparency setting (step S30). For example, the transparency of the watermark image is set by the user.
- the flow of processing from the coordinate detection unit 22 to the watermark image generation unit 38 is the same as in step S20.
- the watermark image generation unit 38 redisplays the transparency of the color or region specified in step S20 with the transparency set in step S30.
- the watermark image generation unit 38 repeats the processing of steps S20 to S40 until the user finishes setting the transparency (step S50).
- FIG. 13A shows an example of a transparency setting screen 501 that accepts a color specification and accepts a transparency setting.
- the transparency setting screen 501 includes a watermark image field 502 in which a watermark image is displayed, a color setting unit 503, a transparency slider 504, and a transparency input field 505.
- the user designates the color whose transparency is changed with the electronic pen 4 or the finger. For example, when changing the transparency of the characters “Confidential”, the user touches a part of “Confidential” with the electronic pen 4 or a finger anywhere. Since the pixel touched by the coordinate detection unit 22 is known (can be detected), the watermark image generation unit 38 can detect the color of this pixel.
- the watermark image generation unit 38 accepts this and sets all the pixels having the same color to the set transparency.
- the transparency is recorded in the watermark image data for each pixel.
- the character part can be specified and the transparency can be changed in this way, the transparency of only the character can be changed without changing the overall transparency of the watermark image data having two or more colors (character part and others).
- the user can change (set) the transparency of the watermark image partially and entirely.
- the user can change the text “Confidential” and the background color.
- the watermark image generation unit 38 accepts this and displays a color palette. The user can select an arbitrary color from the color palette and change the selected color of the pixel designated by touching the electronic pen 4 or the finger.
- FIG. 13B shows an example of a transparency setting screen 501 that accepts designation of a region and accepts transparency settings.
- the user designates the area 506 whose transparency is to be changed with the electronic pen 4 or the finger. For example, the user draws a rectangular area by designating two points, draws a circle, or draws the area 506 by free writing. Since the watermark image generation unit 38 acquires the coordinates of the region 506 via the coordinate detection unit 22, the pixels in this region can be specified.
- the watermark image generation unit 38 accepts this, and sets the pixels in the designated area to the set transparency.
- the transparency can be set by designating an arbitrary area of watermark image data having a uniform color or complex watermark image data having a large number of colors. As in FIG. 13A, the color of the area designated by the user can be changed. If the entire watermark image is selected as the area 506, the transparency of the entire watermark image can be set.
- the setting method in FIG. 13A and the setting method in FIG. 13B are both mounted on the electronic blackboard 2 and can be arbitrarily selected by the user.
- Enabling the watermark image (E) means that the watermark image (E) is automatically displayed when the condition (display condition) for displaying the watermark image (E) is satisfied. That is, if the display condition is not satisfied even if the watermark image (E) is valid, the electronic blackboard 2 does not display the watermark image (E).
- the display condition is, for example, that a video is input. Details of the display conditions will be described later.
- FIG. 14 is an example of a flowchart showing a control procedure for determining whether the watermark image generation unit 38 validates or invalidates the watermark image (E). The process of FIG. 14 is periodically executed, for example, when the electronic blackboard 2 is activated or during activation.
- the watermark image generation unit 38 determines whether watermark image data is stored in the page data storage unit 300 via the page processing unit 37 (step S10).
- the page data storage unit 300 determines whether there is a file in the folder or directory. Further, based on whether data with a predetermined extension (* .png) is stored or whether data with a predetermined file name is stored, the watermark image generation unit 38 is configured to store the page data storage unit 300. It may be determined whether or not watermark image data is stored.
- the watermark image generation unit 38 acquires watermark image data from the page processing unit 37 via the page processing unit 37 (step S20).
- the watermark image data selected on the screen as shown in FIG. 15 is acquired.
- the operation processing unit 26 displays a plurality of watermark images on the display 3, and accepts one image selected from the plurality of watermark images as a watermark image to be used (displayed).
- the watermark image generation unit 38 sets the watermark image to be effective for the layout management unit 35 (step S30). Since the watermark image (E) is valid, the layout management unit 35 requests the display superimposing unit 36 to display the layer of the watermark image (E). When the watermark image generating unit 38 sends the watermark image to the display superimposing unit 36, the watermark image (E) is displayed on the display 3.
- step S10 determines whether the determination in step S10 is No. If the determination in step S10 is No, the watermark image generation unit 38 sets the layer of the watermark image (E) to be invalid in the layout management unit 35 (step S40). Since the watermark image (E) is invalid, the layout management unit 35 requests the display superimposing unit 36 not to display the layer of the watermark image (E). Even if the watermark image generating unit 38 sends the watermark image to the display superimposing unit 36, the watermark image (E) is not displayed on the display 3.
- determination in FIG. 14 may be performed by the layout management unit 35 instead of the watermark image generation unit 38.
- the validity or invalidity of the watermark image is automatically set in this way, it is not necessary to set the watermark image (E) to be valid when the user wants to display the watermark image (E). However, there may be cases where the user does not want to display the watermark image. In this case, the user may delete the watermark image data from the page data storage unit 300, but this may be troublesome for the user. Therefore, it is effective that the user can select valid / invalid as follows.
- FIG. 15 is a diagram showing an example of the valid / invalid setting screen 511 in which the validity / invalidity of the watermark image is set.
- the valid / invalid setting screen 511 includes a reduced watermark image data column 512, a data selection button 513, a valid setting column 514, and a valid setting button 515.
- the valid / invalid setting screen 511 is displayed by, for example, the UI image generation unit 33 when the user performs a predetermined operation.
- the user selects one watermark image data from the list of watermark image data. Since the data selection button 513 is an exclusive button, the user can select only one arbitrary button (one watermark image). Further, when the user wants to validate the watermark image, the user selects the valid setting button 515 before “Yes”. When invalidating the watermark image, the user selects the valid setting button 515 in front of “No”.
- the valid setting button 515 is also an exclusive button. As described above, the user can select the watermark image and can set whether the watermark image is valid or invalid on the display 3 of the electronic blackboard 2. Note that the selected watermark image data and the setting contents of validity or invalidity are stored in the page data storage unit 300.
- FIG. 16 is an example of a flowchart illustrating a control procedure for determining whether the watermark image generation unit 38 validates or invalidates the watermark image (E). In the description of FIG. 16, differences from FIG. 14 will be described.
- the watermark image generation unit 38 refers to the setting contents of the user stored in the page data storage unit 300, and determines whether or not the watermark image is set to be valid (step S5).
- step S5 determines whether the watermark image is displayed even if the watermark image data is stored in the page data storage unit 300. If the user wants to display a watermark image, if the watermark image data is stored in the page data storage unit 300, the watermark image data can be automatically displayed when the display condition is satisfied.
- the display superimposing unit 36 can display the watermark image (E) on the display 3.
- the layout management unit 35 determines whether or not the display condition is satisfied, and switches between displaying and hiding the watermark image (E) as follows.
- FIG. 17 is an example of a flowchart illustrating a procedure in which the layout management unit 35 switches between display and non-display of the watermark image (E) depending on whether video is input.
- FIG. 17 is periodically executed, for example, when the watermark image is valid.
- the layout management unit 35 determines whether an image is input from the notebook PC 6 (step S10).
- the video from the notebook PC 6 is acquired by the video acquisition unit 21 and acquired by the image acquisition unit 31.
- the layout management unit 35 inquires of the image acquisition unit 31 whether or not a video is input.
- the layout management unit 35 may inquire of the display superimposing unit 36 whether or not the output image (C) is output from the image acquisition unit 31. Further, such determination is made in consideration of the convenience of explanation, and may be determined based on whether or not the capture device 111 detects a video signal.
- the case where no video is input means that the notebook PC 6 and the electronic blackboard 2 are not connected by a video cable (D-Sub, HDMI (registered trademark), DVI, etc.). Even if the notebook PC 6 is connected to the electronic blackboard 2 with the video cable, if the video cannot be input because the power of the notebook PC 6 is OFF, it is determined that no video is input.
- D-Sub HDMI (registered trademark), DVI, etc.
- step S10 the layout management unit 35 notifies (requests) the display superimposing unit 36 to hide the watermark image (E) layer and display the output image (C) layer.
- Step S20 the layer of the output image (C) is often displayed as long as video is input, and there is no need to notify the layer of the output image (C).
- step S10 the layout management unit 35 notifies (requests) the display superimposing unit 36 to display the layer of the watermark image (E) and hide the layer of the output image (C).
- Step S30 Since the layer of the output image (C) is not displayed unless a video is input, there is no need to notify the layer of the output image (C) to be hidden.
- the watermark image (E) is not displayed when the output image (C) is displayed, the watermark image does not get in the way and the user can easily specify the video of the notebook PC 6 that he / she wants to capture as a still image. . If the output image (C) is not displayed, the watermark image (E) is displayed. If “Confidential” is displayed, the user knows that the confidentiality of the stroke image (B) and the background image (D) is high. it can. If a uniform watermark image is displayed, the stroke image (B) and the background image (D) can be visually observed with a desired color and contrast.
- FIG. 18A is an example of a flowchart showing an operation when a still image acquisition operation is performed when video is input.
- 18B and 18C are examples of images displayed on the display 3.
- the UI image (A) and the stroke image (B) are not displayed.
- the user operates the UI image (A) to capture a still image.
- the operation processing unit 26 receives this operation (step S10).
- FIG. 18B shows an output image (C) when a still image is captured.
- a stroke image (B) and an output image (C) are acquired as still images.
- the UI image (A) is not an acquisition target, and the watermark image (E) is not displayed (even if displayed, the watermark image (E) is not an acquisition target). Since the output image (C) is displayed, the background image (D) is not displayed.
- the page processing unit 37 acquires the output image (C) from the image acquisition unit 31, acquires the stroke image (B) from the stroke processing unit 32, and stores it in the page data storage unit 300 as the background image (D).
- the page processing unit 37 sends the background image (D) to the background generation unit 34, and the background generation unit 34
- the background image (D) is sent to the display superimposing unit 36 (step S20).
- the layout management unit 35 notifies the display superimposing unit 36 to hide the output image (C) in order to prioritize the background image (D) and to display the layer of the watermark image (E) (step S30). ).
- FIG. 18C shows a still image and a watermark image (E) displayed as a background image (D).
- the electronic blackboard 2 can display the watermark image (E) again.
- Characters such as “Confidential” allow the user to grasp that the confidentiality of the background image (D) is high even if the watermark image (E) is not displayed in the output image (C).
- FIG. 18C Video is input from the notebook PC 6 while the background image (D) and the watermark image (E) are displayed. After the elapse of a certain time, the processing of FIG. 17 is executed again, and the display state of the display 3 is switched from the state of displaying the background image (D) and the watermark image (E) to the state of displaying the output image (C). . In order to switch the display state of the display 3 before the fixed time has elapsed, the user performs an operation of switching from the background image (D) and the watermark image (E) to the output image (C).
- FIG. 19A shows an output image (C) in which the electronic blackboard 2 displays the video of the notebook PC 6 in full screen.
- the video icon 622 for capturing the video of the notebook PC 6 is highlighted. For example, a frame of a predetermined color is displayed on the video icon 622, the frame becomes thick, or blinks.
- FIG. 19B shows the stage at the end of FIG. 18A. That is, the background image (D) and the watermark image (E) are displayed.
- a still image is captured, a new page is generated, and a thumbnail 623 is displayed at the bottom of the display 3. Further, since the output image (C) is not displayed, the video icon 622 is not highlighted. Further, since the currently displayed thumbnail 623 is highlighted, the user can grasp that it is the background image (D).
- FIG. 19C shows a state where the process of FIG. 17 has been executed.
- the background image (D) and the watermark image (E) are switched to the output image (C). For this reason, the video icon 622 is highlighted. Further, since the currently displayed thumbnail 623 is not highlighted, the user can grasp that the image displayed on the display 3 is the output image (C).
- the page processing unit 37 freezes the second image displayed on the display 3 (video input to the electronic blackboard 2 from the notebook PC 6). Acquire (capture) as an image.
- the video superimposing unit 28 displays the acquired still image and the first image (character “Confidential”) on the display 3 for a predetermined time. After a predetermined time has elapsed, the video superimposing unit 28 displays the second image (video input from the notebook PC 6 to the electronic blackboard 2) again.
- the user presses the video icon 622.
- the display state of the display 3 is a state in which a stroke image (B) handwritten by the user is displayed and a background image (D) is also displayed. If no video is input, the user cannot perform the capture operation.
- the watermark image (E) is hidden when a video is input, and the watermark image (E) is displayed when no video is input. Further, the display and non-display of the watermark image (E) may be switched based on whether or not the video input from the notebook PC 6 to the electronic blackboard 2 is a moving image. That is, whether or not a moving image is input is a display condition.
- FIG. 20 is a modification of the flowchart showing a procedure in which the layout management unit 35 switches between display and non-display of the watermark image (E) depending on whether or not a video is input.
- the layout management unit 35 switches between display and non-display of the watermark image (E) depending on whether or not a video is input.
- the layout management unit 35 determines whether the input video (input video) is a moving image (step S15).
- This moving image may be, for example, a video that continuously displays a series of images taken at regular time intervals.
- the moving image may be a video that changes with time when the user operates the notebook PC 6. For example, even when the screen is switched or scrolled by browser software, the video is a moving image.
- Whether or not the video is a moving image can be determined by a time series frame difference calculation acquired by the image acquisition unit 31. If the difference calculation is performed on the entire frame and the load is high, it may be performed only on a part of the frame.
- the layout management unit 35 hides the layer of the watermark image (E) and displays the layer of the output image (C). 36 is notified (requested) (step S20). Therefore, in this case, the video superimposing unit 28 displays the output image (C) without displaying the watermark image (E).
- the layout management unit 35 notifies the display superimposing unit 36 to display both the watermark image (E) layer and the output image (C) layer.
- the video superimposing unit 28 displays the watermark image (E) and the output image (C). More specifically, the display superimposing unit 36 superimposes the watermark image (E) and the output image (C), and the video superimposing unit 28 superimposes the watermark image (E) superimposed on the display superimposing unit 36 and the output image (C). ) Is displayed on the display 3. In other words, the video superimposing unit 28 displays an image obtained by superimposing the watermark image (E) and the output image (C).
- the watermark image (E) When a video is input, it is unclear which video the user wants to see, and there is a possibility that the watermark image (E) may become an obstacle to search for the video. In the case of being performed, the watermark image (E) can be hidden. In other words, the user can see a plurality of images constituting the moving image input from the notebook PC 6 without being disturbed by the watermark image (E). Thereby, for example, the user can acquire (capture) one of a plurality of images at a desired timing (time point). Also, when a still image is input, the user can view the video slowly, so the electronic blackboard 2 determines that the watermark image (E) does not get in the way, and the watermark image (E) and the output image (C) is displayed.
- the electronic blackboard 2 displays the watermark image (E) when the video changes while the output image (C) is displayed, and displays the watermark image (E) when the video no longer changes. Can be used.
- the video is still, for example, the word “Confidential” can be displayed, so that even if the video is input, the watermark image (E) can be displayed if it is a still image.
- the video superimposing unit 28 displays the watermark image (E) and the output image (C). 3 may be superimposed and displayed.
- the video superimposing unit 28 displays the output image (C) without displaying the watermark image (E). 3 may be displayed.
- the electronic blackboard 2 can switch between displaying and hiding the watermark image depending on the presence / absence of video input from the notebook PC 6 without operation by the user.
- a watermark image is not limited to text or a uniform color on a white background, and can be a watermark image if it is an image regardless of the information contained in the image.
- the notebook PC 6 may wirelessly input an image to the electronic blackboard 2.
- the presence or absence of video input is determined by whether or not a communication device such as a wireless LAN has received video.
- this embodiment can be applied not only when the notebook PC 6 and the electronic blackboard 2 are connected or communicated one-on-one but also when communicating via a network (wired or wireless).
- FIG. 4 and the like is divided according to main functions in order to facilitate understanding of processing by the electronic blackboard 2.
- the present invention is not limited by the way of dividing the processing unit or the name.
- the processing of the electronic blackboard 2 can be divided into more processing units according to the processing content. Moreover, it can also divide
- the watermark image generation unit 38 is an example of a first image acquisition unit
- the image acquisition unit 31 is an example of a second image acquisition unit
- the layout management unit 35 is an example of an image determination unit.
- the unit 36 is an example of an image superimposing unit
- the video superimposing unit 28 is an example of a display unit.
- the watermark image is an example of a first image
- the output image is an example of a second image.
- the file input unit 42a is an example of an image capturing unit
- the operation processing unit 26 is an example of a transparency receiving unit
- the page processing unit 37 is an example of a still image acquisition unit.
- the image processing apparatus may be realized by a device memory storing one or more programs and one or more processors.
- the one or more processors execute the processes described in the embodiments by executing the one or more programs.
- the device memory and the one or more processors can realize (implement) the functions described in the embodiments.
- the device memory and the one or more processors may be realized (implemented) by hardware elements as described in the embodiments.
- One or more programs for causing a computer such as an image processing apparatus to execute processing may be stored in a non-volatile recording medium.
Abstract
Description
図1A-図1Dは、本実施形態の電子黒板2の動作の概略を説明する図の一例である。図1Aは電子黒板2に対し外部機器となるノートPC6(Personal Computer)と電子黒板2が接続されていない状態を示す。ノートPC6は自機のディスプレイに映像を表示しているがこの映像は電子黒板2には出力されていない。電子黒板2は半透明の画像(以下、透かし画像という)を表示する機能を有しており、透かし画像を利用して「Confidential」という文字を表示している。透かし画像(文字「Confidential」)は半透明であるため、会議などへの参加者(以下、電子黒板2を使用する者という意味でユーザという場合がある)はディスプレイ3に表示されている各種の情報を目視できる。
特許請求の範囲の外部機器は、電子黒板2に対し外部の機器であればよく、ケーブル、ネットワーク、又はインタフェースを介して接続できる機器を言う。例えば、ノートPC6及びこれと同等の機器が外部機器の一例である。また、可搬性の記憶媒体も外部機器に相当する。
図2は、本実施形態の画像処理システム1の全体構成図である。なお、図2では、説明を簡略化するために、2台の電子黒板2a,2b及びこれに付随する電子ペン4a,4b等を示しているだけであって、3台以上の電子黒板2や電子ペン等を利用してもよい。
続いて、図3を用いて、本実施形態の電子黒板2のハードウェア構成を説明する。なお、図3は、電子黒板2のハードウェア構成図である。
また、電子黒板2は、電子ペンコントローラ116を備えている。この電子ペンコントローラ116は、電子ペン4と通信することで、ディスプレイ3へのペン先のタッチやペン尻のタッチの有無を判断する。なお、電子ペンコントローラ116が、電子ペン4のペン先及びペン尻だけでなく、電子ペン4のユーザが握る部分や、その他の電子ペンの部分のタッチの有無を判断するようにしてもよい。
続いて、図4~図7を用いて、電子黒板2の機能構成について説明する。なお、先ずは、図4を用いて、電子黒板2の全体的な機能構成について説明する。図4は、電子黒板2の機能ブロック図である。
続いて、主に図4から図7を用いて、クライアント部20の機能構成について説明する。クライアント部20は、映像取得部21、座標検知部22、自動調整部23、接触検知部24、イベント振分部25、操作処理部26、ジェスチャ処理部27、映像重畳部28、画像処理部30、及び通信制御部60を有する。
続いて、図5を用いて、図4に示されているファイル処理部40の機能構成を説明する。なお、図5は、ファイル処理部の機能ブロック図である。ファイル処理部40は、リカバリ処理部41、ファイル入力部42a、ファイル出力部42b、ファイル変換部43、ファイル送信部44、アドレス帳入力部45、バックアップ処理部46、バックアップ出力部47、設定管理部48、設定ファイル入力部49a、及び設定ファイル出力部49bを有している。更に、ファイル処理部40は、アドレス帳管理テーブル410、バックアップデータ記憶部420、設定ファイル記憶部430、及び接続先管理テーブル440を有している。
次に、図6を用いて、通信制御部60の機能構成について説明する。図6は、サーバ部90とクライアント部20の機能ブロック図の一例である。通信制御部60は、通信ネットワーク9を介して、他の電子黒板2と行う通信や、サーバ部90における後述の通信制御部70と行う通信を制御する。そのため、通信制御部60は、遠隔開始処理部61、遠隔参加処理部62、遠隔画像送信部63、遠隔画像受信部64、遠隔操作送信部65、遠隔操作受信部66、及び参加拠点管理テーブル610を有している。
続いて、図6を用いて、サーバ部90の機能構成について説明する。サーバ部90は、各電子黒板2に設けられており、いずれの電子黒板2であっても、サーバ部としての役割を果たすことができる。そのため、サーバ部90は、通信制御部70、及びデータ管理部80を有している。
(通信制御部70の機能構成)
次に、図6を用いて、通信制御部70の機能構成について説明する。
次に、図6を用いて、データ管理部80の機能構成について説明する。データ管理部80は、遠隔接続処理部81、遠隔画像処理部82、遠隔操作処理部83、操作合成処理部84、及びページ処理部85を有している。更に、サーバ部90は、パスコード管理部810、参加拠点管理テーブル820、画像データ記憶部830、操作データ記憶部840、及びページデータ記憶部850を有している。
続いて、図8及び図9を用いて、本実施形態の処理又は動作について説明する。なお、図8及び図9は、各電子黒板2の処理を示したシーケンス図である。図8及び図9に示す実施形態では、電子黒板2aが遠隔共有処理を主催する主催装置(サーバ部及びクライアント部)としての役割を果たしており、電子黒板2b,2cが遠隔共有処理に参加する参加装置(クライアント部)としての役割を果たす場合について説明する。また、ここでは、電子黒板2a,2b,2cには、それぞれディスプレイ3a,3b,3cが接続され、更に、それぞれノートPC6a,6b,6cが接続されている。また、電子黒板2a,2b,2cでは、それぞれ電子ペン4a,4b,4cが使用される。
まずは、図8を用いて、電子黒板2b,2cが遠隔共有処理に参加するための処理について説明する。
続いて、図8を用いて、遠隔共有処理における出力画像(C)が表示される処理について説明する。
続いて、図9を用いて、遠隔共有処理における重畳画像が表示される処理について説明する。
続いて、図9を用いて、参加装置が遠隔共有処理への参加を終了する処理について説明する。図9に示す実施形態では、電子黒板2cが参加を終了する処理が示されている。
上記のように例えば管理者は管理者端末を使って電子黒板2と通信し、透かし画像のファイルを電子黒板2にアップロードできる。
図11Aは透かし画像の一例を示す。図11Bは、透かし画像の別の例を示す。図11Aは「Confidential」という文字を表示する透かし画像であり、図11Bは全体が均一色の透かし画像である。なお、説明の便宜上、図11A及び図11Bは、UI画像(A)、ストローク画像(B)、出力画像(C)及び背景画像(D)が表示されていない状態を示している。
電子黒板2が透かし画像を表示するか否かの制御について説明する。透かし画像データがページデータ記憶部300に記憶されている場合、電子黒板2が自動的に(ユーザの操作がなくても)ディスプレイ3に透かし画像(E)を表示すれば、ユーザが透かし画像(E)を表示し忘れたりすることがなく便利である。そこで、電子黒板2は透かし画像(E)が記憶されている場合、透かし画像(E)を有効にするものとする。
以上のように、透かし画像データが有効に設定された場合、表示重畳部36は透かし画像(E)をディスプレイ3に表示することができる。しかし、透かし画像が邪魔になる場合があるため、以下のようにレイアウト管理部35は表示条件が成立するか否かを判断し、透かし画像(E)の表示と非表示を切り替える。
ノートPC6から電子黒板2に映像が入力されている場合の静止画の取得処理について説明する。
図18Cに示すように背景画像(D)と透かし画像(E)が表示されている間もノートPC6から映像が入力されている。一定時間の経過後、再び、図17の処理が実行され、ディスプレイ3の表示状態が、背景画像(D)と透かし画像(E)を表示する状態から出力画像(C)を表示する状態に切り替わる。一定時間が経過する前にディスプレイ3の表示状態を切り替えるには、ユーザは背景画像(D)及び透かし画像(E)から出力画像(C)に切り替える操作を行う。
映像が入力されていない場合、出力画像(C)は非表示で透かし画像(E)が表示されている。また、ディスプレイ3の表示状態は、ユーザが手書きしたストローク画像(B)が表示され、背景画像(D)も表示されている状態である。映像が入力されていない場合、ユーザは取り込む操作を行えない。
図17の処理では、映像が入力されていれば透かし画像(E)を非表示にして、映像が入力されていなければ透かし画像(E)を表示した。更に、ノートPC6から電子黒板2に入力された映像が動画か否かに基づいて、透かし画像(E)の表示と非表示を切り替えてもよい。つまり、動画が入力されているかどうかが表示条件となる。
以上説明したように、本実施形態の電子黒板2は、ユーザが操作しなくても、透かし画像の表示と非表示をノートPC6の映像の入力の有無により切り替えることができる。
以上、本発明を実施するための最良の形態について実施例を用いて説明したが、本発明はこうした実施例に何等限定されるものではなく、本発明の要旨を逸脱しない範囲内において種々の変形及び置換を加えることができる。
3 ディスプレイ
4 電子ペン
30 画像処理部
31 画像取得部
33 UI画像生成部
34 背景生成部
35 レイアウト管理部
36 表示重畳部
37 ページ処理部
38 透かし画像生成部
Claims (11)
- 外部機器が入力する入力映像を表示する画像処理装置であって、
記憶手段に記憶された第一の画像を取得する第一の画像取得手段と、
前記入力映像から第二の画像を取得する第二の画像取得手段と、
前記外部機器から入力された前記入力映像が所定の条件を満たさない場合、前記第一の画像を表示せずに前記第二の画像を表示させると判断し、前記外部機器から入力された前記入力映像が前記所定の条件を満たす場合、前記第一の画像と前記第二の画像を表示させると判断し、前記外部機器から前記入力映像が入力されていない場合、前記第一の画像を表示させると判断する画像判断手段と、
前記画像判断手段が前記第一の画像と前記第二の画像を表示させると判断した場合、前記第一の画像と前記第二の画像を重畳する画像重畳手段と、
前記画像重畳手段が重畳した前記第一の画像と前記第二の画像を表示部に表示する表示手段と、を有する画像処理装置。 - 前記第一の画像取得手段は、少なくとも一部に透明度に関する情報を有する前記第一の画像を取得する請求項1に記載の画像処理装置。
- 外部から透明度に関する情報を有する前記第一の画像を取り込み、前記記憶手段に記憶させる画像取り込み手段を有する請求項1又は2に記載の画像処理装置。
- 前記第一の画像は、所定の文字を有するか又は均一色である請求項2又は3に記載の画像処理装置。
- 前記第一の画像の一部又は全体の透明度の設定を受け付ける透明度受付手段を有する請求項2~4のいずれか1項に記載の画像処理装置。
- 前記透明度受付手段は、複数の画像を表示し、前記複数の画像から選択された一つの画像を前記第一の画像として受け付け、
前記第一の画像取得手段は選択された前記第一の画像を前記記憶手段から取得する請求項5に記載の画像処理装置。 - 前記画像判断手段は、前記外部機器から入力された前記入力映像が動画である場合、前記第一の画像を表示せず、前記第二の画像を表示させると判断し、
前記画像判断手段は、前記外部機器から入力された前記入力映像が動画でない場合、前記第一の画像及び前記第二の画像を表示させると判断する請求項1~6のいずれか1項に記載の画像処理装置。 - 所定の操作により前記第二の画像を静止画として取得する静止画取得手段を有し、
前記静止画取得手段が前記静止画を取得した場合、前記入力映像が入力されていても、前記画像判断手段は前記第二の画像を表示せず、前記静止画と共に前記第一の画像を表示させると判断する請求項1~7のいずれか1項に記載の画像処理装置。 - 所定の操作に応答して前記第二の画像を静止画として取得する静止画取得手段を有し、
前記所定の操作が行われた後に、前記表示手段は前記静止画と前記第一の画像を所定時間表示し、
前記所定時間が経過した後に、前記表示手段は前記第二の画像を表示する請求項1~7のいずれか1項に記載の画像処理装置。 - 外部機器が入力する入力映像を表示する画像処理装置が行う画像表示方法であって、
第一の画像取得手段が、記憶手段に記憶された第一の画像を取得するステップと、
第二の画像取得手段が、前記入力映像から第二の画像を取得するステップと、
画像判断手段が、前記外部機器から入力された前記入力映像が所定の条件を満たさない場合、前記第一の画像を表示せずに前記第二の画像を表示させると判断し、前記外部機器から入力された前記入力映像が前記所定の条件を満たす場合、前記第一の画像と前記第二の画像を表示させると判断し、前記外部機器から前記入力映像が入力されていない場合、前記第一の画像を表示させると判断するステップと、
画像重畳手段が、前記画像判断手段が前記第一の画像と前記第二の画像を表示させると判断した場合、前記第一の画像と前記第二の画像を重畳するステップと、
表示手段が、前記画像重畳手段が重畳した前記第一の画像と前記第二の画像を表示部に表示するステップと、を有する画像表示方法。 - 外部機器が入力する入力映像を表示する画像処理装置を、
記憶手段に記憶された第一の画像を取得する第一の画像取得手段と、
前記入力映像から第二の画像を取得する第二の画像取得手段と、
前記外部機器から入力された前記入力映像が所定の条件を満たさない場合、前記第一の画像を表示せずに前記第二の画像を表示させると判断し、前記外部機器から入力された前記入力映像が前記所定の条件を満たす場合、前記第一の画像と前記第二の画像を表示させると判断し、前記外部機器から前記入力映像が入力されていない場合、前記第一の画像を表示させると判断する画像判断手段と、
前記画像判断手段が前記第一の画像と前記第二の画像を表示させると判断した場合、前記第一の画像と前記第二の画像を重畳する画像重畳手段と、
前記画像重畳手段が重畳した前記第一の画像と前記第二の画像を表示部に表示する表示手段、として機能させるためのプログラム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201680075106.5A CN108475160A (zh) | 2015-12-25 | 2016-12-08 | 图像处理装置、图像显示方法和程序 |
JP2017557866A JP6583432B2 (ja) | 2015-12-25 | 2016-12-08 | 画像処理装置、画像表示方法、プログラム |
EP16878397.5A EP3396510B1 (en) | 2015-12-25 | 2016-12-08 | Image processing device, image display method, and program |
US16/008,370 US20180292951A1 (en) | 2015-12-25 | 2018-06-14 | Image processing apparatus, image display method, and non-transitory recording medium |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015253020 | 2015-12-25 | ||
JP2015-253020 | 2015-12-25 | ||
JP2016-209023 | 2016-10-25 | ||
JP2016209023 | 2016-10-25 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/008,370 Continuation US20180292951A1 (en) | 2015-12-25 | 2018-06-14 | Image processing apparatus, image display method, and non-transitory recording medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017110505A1 true WO2017110505A1 (ja) | 2017-06-29 |
Family
ID=59090097
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2016/086581 WO2017110505A1 (ja) | 2015-12-25 | 2016-12-08 | 画像処理装置、画像表示方法、プログラム |
Country Status (5)
Country | Link |
---|---|
US (1) | US20180292951A1 (ja) |
EP (1) | EP3396510B1 (ja) |
JP (1) | JP6583432B2 (ja) |
CN (1) | CN108475160A (ja) |
WO (1) | WO2017110505A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11061513B2 (en) | 2019-03-26 | 2021-07-13 | Seiko Epson Corporation | Method for controlling display device, and display device |
JP2023515030A (ja) * | 2020-02-24 | 2023-04-12 | 北京字節跳動網絡技術有限公司 | 画像処理方法、モジュール、電子装置及び記憶媒体 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018101514A1 (ko) * | 2016-12-01 | 2018-06-07 | 엘지전자 주식회사 | 영상표시장치, 및 이를 구비하는 영상표시 시스템 |
CN110087098B (zh) | 2018-01-26 | 2021-12-03 | 阿里巴巴(中国)有限公司 | 水印处理方法及装置 |
US11132122B2 (en) | 2019-04-11 | 2021-09-28 | Ricoh Company, Ltd. | Handwriting input apparatus, handwriting input method, and non-transitory recording medium |
US11551480B2 (en) | 2019-04-11 | 2023-01-10 | Ricoh Company, Ltd. | Handwriting input apparatus, handwriting input method, program, and input system |
CN111176531A (zh) * | 2020-01-03 | 2020-05-19 | 京东方科技集团股份有限公司 | 电子设备及其交互方法、计算机可读存储介质 |
CN113630606B (zh) * | 2020-05-07 | 2024-04-19 | 百度在线网络技术(北京)有限公司 | 视频水印处理方法、装置、电子设备及存储介质 |
CN111930653B (zh) * | 2020-07-13 | 2022-06-24 | 四川钛阁科技有限责任公司 | 一种usb设备的远程分配使用方法及装置 |
CN115618812A (zh) * | 2021-07-16 | 2023-01-17 | 富泰华工业(深圳)有限公司 | 基于色彩编码的用户信息嵌入方法、电子设备及存储介质 |
TWI796265B (zh) * | 2022-07-27 | 2023-03-11 | 友達光電股份有限公司 | 顯示裝置以及影像顯示方法 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010102267A (ja) * | 2008-10-27 | 2010-05-06 | Sharp Corp | 画像表示装置、携帯端末 |
JP2015501023A (ja) * | 2011-10-11 | 2015-01-08 | ファスドットコム カンパニー リミテッドFASOO.COM Co.,Ltd. | ウォーターマークを画面上に表示する装置及び方法 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3898651B2 (ja) * | 2003-02-25 | 2007-03-28 | 株式会社東芝 | 情報表示装置、情報表示方法および情報表示システム |
US20070041608A1 (en) * | 2003-05-28 | 2007-02-22 | Oki Electric Industry Co., Ltd. | Watermark information embedding apparatus, image processing device, watermark information embedding method and image processing method |
US7546528B2 (en) * | 2004-12-20 | 2009-06-09 | Ricoh Co., Ltd. | Stamp sheets |
JP4596156B2 (ja) * | 2005-08-11 | 2010-12-08 | ブラザー工業株式会社 | 情報処理装置及びプログラム |
US20100259560A1 (en) * | 2006-07-31 | 2010-10-14 | Gabriel Jakobson | Enhancing privacy by affecting the screen of a computing device |
EP1981274A1 (en) * | 2007-04-12 | 2008-10-15 | Alcatel Lucent | Multimedia descriptions for adding additional multimedia |
EP2071822A1 (en) * | 2007-12-13 | 2009-06-17 | Thomson Licensing | Method and apparatus for inserting a removable visible watermark in an image and method and apparatus for removing such watermarks |
US20130128120A1 (en) * | 2011-04-06 | 2013-05-23 | Rupen Chanda | Graphics Pipeline Power Consumption Reduction |
US20140176562A1 (en) * | 2012-12-21 | 2014-06-26 | Appsense Limited | Systems and methods for providing a software application privacy screen |
JP2015069284A (ja) * | 2013-09-27 | 2015-04-13 | 株式会社リコー | 画像処理装置 |
-
2016
- 2016-12-08 CN CN201680075106.5A patent/CN108475160A/zh active Pending
- 2016-12-08 JP JP2017557866A patent/JP6583432B2/ja active Active
- 2016-12-08 EP EP16878397.5A patent/EP3396510B1/en active Active
- 2016-12-08 WO PCT/JP2016/086581 patent/WO2017110505A1/ja active Application Filing
-
2018
- 2018-06-14 US US16/008,370 patent/US20180292951A1/en not_active Abandoned
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010102267A (ja) * | 2008-10-27 | 2010-05-06 | Sharp Corp | 画像表示装置、携帯端末 |
JP2015501023A (ja) * | 2011-10-11 | 2015-01-08 | ファスドットコム カンパニー リミテッドFASOO.COM Co.,Ltd. | ウォーターマークを画面上に表示する装置及び方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3396510A4 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11061513B2 (en) | 2019-03-26 | 2021-07-13 | Seiko Epson Corporation | Method for controlling display device, and display device |
JP2023515030A (ja) * | 2020-02-24 | 2023-04-12 | 北京字節跳動網絡技術有限公司 | 画像処理方法、モジュール、電子装置及び記憶媒体 |
Also Published As
Publication number | Publication date |
---|---|
CN108475160A (zh) | 2018-08-31 |
JPWO2017110505A1 (ja) | 2018-10-04 |
EP3396510B1 (en) | 2020-06-03 |
JP6583432B2 (ja) | 2019-10-02 |
EP3396510A4 (en) | 2018-12-05 |
EP3396510A1 (en) | 2018-10-31 |
US20180292951A1 (en) | 2018-10-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6583432B2 (ja) | 画像処理装置、画像表示方法、プログラム | |
JP6094550B2 (ja) | 情報処理装置、プログラム | |
JP2015069284A (ja) | 画像処理装置 | |
JP6493546B2 (ja) | 電子黒板、記憶媒体、及び情報表示方法 | |
US11294495B2 (en) | Electronic whiteboard, method for image processing in electronic whiteboard, and recording medium containing computer program of electronic whiteboard | |
JP6402826B2 (ja) | 情報処理装置、画像表示方法、プログラム | |
JP2019186946A (ja) | 電子黒板 | |
JP2016208394A (ja) | 情報処理装置、画像表示方法 | |
CN107037939B (zh) | 电子黑板和图像处理方法 | |
JP6143100B2 (ja) | 画像処理装置及び画像処理システム | |
JP2016139322A (ja) | 画像処理装置及びそれを備えた電子黒板 | |
JP6631643B2 (ja) | 画像処理装置、画像処理システム及び画像処理方法 | |
JP6036621B2 (ja) | システム、情報処理装置 | |
JP6589621B2 (ja) | 表示装置、カメラ位置制御方法、およびプログラム | |
JP7298224B2 (ja) | 表示装置、及び表示方法 | |
JP7363064B2 (ja) | 画像処理装置、方法、およびプログラム | |
JP2019114123A (ja) | データ共有システム、情報処理装置、プログラム、データ共有方法 | |
JP2017129890A (ja) | 座標検知装置、画像処理装置、座標検知方法及びプログラム | |
JP2015056038A (ja) | 画像処理装置及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16878397 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017557866 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2016878397 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016878397 Country of ref document: EP Effective date: 20180725 |