WO2016181637A1 - Display apparatus and display system - Google Patents

Display apparatus and display system Download PDF

Info

Publication number
WO2016181637A1
WO2016181637A1 PCT/JP2016/002243 JP2016002243W WO2016181637A1 WO 2016181637 A1 WO2016181637 A1 WO 2016181637A1 JP 2016002243 W JP2016002243 W JP 2016002243W WO 2016181637 A1 WO2016181637 A1 WO 2016181637A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
distribution
electronic blackboard
display
unit
Prior art date
Application number
PCT/JP2016/002243
Other languages
French (fr)
Inventor
Taro Okuyama
Original Assignee
Ricoh Company, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2016079799A external-priority patent/JP2016212844A/en
Application filed by Ricoh Company, Ltd. filed Critical Ricoh Company, Ltd.
Priority to CN201680026230.2A priority Critical patent/CN107533770A/en
Priority to EP16792366.3A priority patent/EP3295429A4/en
Publication of WO2016181637A1 publication Critical patent/WO2016181637A1/en
Priority to US15/786,635 priority patent/US20180041564A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
    • G09G5/026—Control of mixing and/or overlay of colours in general
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/39—Control of the bit-mapped memory
    • G09G5/395—Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen
    • G09G5/397—Arrangements specially adapted for transferring the contents of two or more bit-mapped memories to the screen simultaneously, e.g. for mixing or overlay
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/12—Frame memory handling
    • G09G2360/127—Updating a frame memory using a transfer of data from a source area to a destination area

Definitions

  • the present invention relates to display apparatuses and display systems.
  • an electronic blackboard such as electronic whiteboards (interactive whiteboards: IWBs) have been widely used as display apparatuses.
  • Such an electronic blackboard has a configuration combining an image display device that includes a flat panel such as a liquid crystal panel, a coordinate detection device such as a touch panel that detects coordinates of a position on a display surface of the image display device where an object used for input such as an input pen or a finger touches, and a control device that causes an image including various images, text, numbers, and figures written on the display surface of the image display device to be displayed based on coordinate data output from the coordinate detection device.
  • conference material or any other material can be enlarged and displayed, and an input pen or a finger can be used to write on the display surface.
  • electronic blackboard systems that each connect an electronic blackboard as described above and communication terminals (client terminals) such as personal computers (PCs) and tablet computers via a network such as an in-house LAN, exist.
  • the electronic blackboard system can compress an image displayed on or a written video drawn on the electronic blackboard and distribute the compressed image or written video to a communication terminal, so that the image on the electronic blackboard can be viewed from the communication terminal.
  • Patent Literature 1 describes a technique to transmit image data of content generated by an electronic blackboard to a communication terminal.
  • the technique includes cutting out part of the image data, converting the cut-out image data into transmission data, and transmitting the converted data to the communication terminal.
  • the typical electronic blackboard system known to the inventor basically distributes all images generated by the electronic blackboard, and therefore an image including an area that should not be distributed is distributed as it is to the communication terminal.
  • the area of the image undesirable for distribution can be trimmed out before the image is distributed; however, if the area to exclude is transparent, an image displayed under the trimmed image is missing from the distributed image. Also, the area to exclude may dynamically change depending on the status of the display apparatus, and in this case, the area is difficult to specify.
  • the technique described in Patent Literature 1 that cuts out part of image data does not solve the problems of missing of a generated image and the difficulty in specifying a variable area to exclude.
  • the present invention is made in view of such circumstances, and aims at generating a distribution image with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at a communication terminal.
  • a display apparatus is configured to generate an image viewable by a communication terminal.
  • the display apparatus includes an image generating unit.
  • the image generating unit is configured to generate a display image in which a specific layer for displaying a specific image and one or more other layers for displaying respective images other than the specific image are overlapped, and a distribution image in which the specific layer is excluded and only the one or more other layers are overlapped.
  • the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal.
  • Fig. 1 is a block diagram illustrating a configuration of an electronic blackboard system according to a first embodiment and a second embodiment of the present invention.
  • Fig. 2 is a configuration diagram illustrating a hardware configuration of an electronic blackboard used for the electronic blackboard system according to the first embodiment of the present invention.
  • Fig. 3 is a functional block diagram of the electronic blackboard used for the electronic blackboard system.
  • Fig. 4 is a view illustrating a display screen on the electronic blackboard.
  • Fig. 5 is a view illustrating layers of the display screen on the electronic blackboard.
  • Fig. 6 is a functional block diagram of a communication terminal used for the electronic blackboard system.
  • Fig. 7 is a diagram illustrating a procedure for generating and distributing a distribution image in the electronic blackboard system.
  • Fig. 8 is a view illustrating a display screen on a communication terminal according to a modification of the first embodiment.
  • Fig. 9 is a functional block diagram of an electronic blackboard used for the electronic blackboard system according to the second embodiment.
  • Fig. 10 is a view illustrating a display screen on the electronic blackboard according to the second embodiment.
  • Fig. 11 is a view illustrating a display screen on the electronic blackboard and display screens on communication terminals according to the second embodiment.
  • Fig. 12 is a view illustrating selection of a temporary distribution image in the electronic blackboard system.
  • Fig. 13 is a view illustrating display screens on an electronic blackboard and the communication terminals when the temporary distribution image is distributed in the electronic blackboard system.
  • Fig. 14 is a diagram illustrating a procedure for distributing the temporary distribution image in the electronic blackboard system.
  • Fig. 15 is a flowchart illustrating a procedure in which a frame output unit of the electronic blackboard acquires a distribution image.
  • the present invention includes the following configurations for easily and suitably distributing a desired image to a communication terminal, with a specific image undesirable for distribution being excluded.
  • a display apparatus is exemplified by an electronic blackboard
  • a display system is exemplified by an electronic blackboard system in which the electronic blackboard and communication terminals are connected via a communication network.
  • FIG. 1 is a block diagram illustrating a configuration of an electronic blackboard system according to the first embodiment of the present invention.
  • An electronic blackboard system 1 according to the present embodiment includes an electronic blackboard 10 and a plurality of communication terminals 20 (20-1, 20-2, ..., 20-n) connected to the electronic blackboard 10 via a wireless local area network (LAN).
  • the wireless LAN is used for an intra-company network, for example.
  • the electronic blackboard 10 can be connected to the communication terminals 20 via various wired or wireless communication networks such as a wired LAN and the Internet, not limited to the wireless LAN.
  • the electronic blackboard 10 includes an application 100, a video distribution service 200, and an image display device 50.
  • the communication terminals 20 are notebook-type personal computers, tablet computers, and other devices, and operate on various operating systems (OSs) such as iOS, Android (registered trademark), Windows (registered trademark), and Mac OS (registered trademark).
  • OSs operating systems
  • the communication terminals 20 each include an image display unit.
  • Fig. 2 is a configuration diagram illustrating a hardware configuration of the electronic blackboard used for the electronic blackboard system according to the first embodiment of the present invention.
  • the electronic blackboard 10 includes a central processing unit (CPU) 501, a read only memory (ROM) 502, a random access memory (RAM) 503, a hard disc drive (HDD) 504, a hard disk controller (HDC) 505, a media drive 507, an image display interface (I/F) device 508, an interface (I/F) 509, a keyboard 511, a mouse 512, a microphone 513, a speaker 514, a graphics processing unit (GPU) 515, and a touch panel 519, which are connected via an extension bus line 520.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • HDD hard disc drive
  • HDC hard disk controller
  • the CPU 501 controls the entire operation of the electronic blackboard 10.
  • the ROM 502 stores therein a computer program, such as an initial program loader (IPL), used for driving the CPU 501.
  • the RAM 503 is used as a work area for the CPU 501.
  • the HDD 504 stores therein various pieces of data such as a computer program.
  • the HDC 505 controls reading and writing of various pieces of data from and to the HDD 504 under the control of the CPU 501.
  • the media drive 507 controls reading and writing (storing) of data from and to a recording medium 506 such as a flash memory.
  • the image display interface 508 is used for connecting to the image display device 50 that displays various pieces of information.
  • the I/F 509 is used for transmitting data via a communication network or for connecting a dongle.
  • the GPU 515 is connected to a ROM 516 storing therein a computer program used for driving the GPU 515, and a RAM 517 used as a work area for the GPU 515.
  • the extension bus line 520 includes an address bus, a data bus, and other lines for electrically connecting the components described above.
  • the touch panel 519 detects coordinates of a position on the image display device 50 where an input pen or a finger touches.
  • the CPU 501 executes predetermined image distribution software to implement the application 100 and the video distribution service 200 that distributes, as video, a plurality of images generated by the application 100.
  • the application 100 detects an operation event that is a stroke of writing with an input pen or a finger or a paging operation on the image display device 50 through the touch panel 519, and draws a stroke or the like on the image display device 50 based on the operation event detected through the touch panel 519.
  • the application 100 then outputs an image to be distributed to the communication terminals 20 (distribution image) and an image to be displayed on the image display device 50 (display image), and distributes the distribution image to the video distribution service 200 (Step S1).
  • the video distribution service 200 compresses a plurality of images resulted from the drawing by the application 100 and distributes the images to the communication terminals 20 (Step S2). In this example, the distribution is performed from one electronic blackboard 10 to a plurality of (n) communication terminals 20-1, 20-2, ..., 20-n at the same time.
  • Each of the communication terminals 20 displays an image acquired from the electronic blackboard 10, on the display unit.
  • the communication terminal 20 allows a touch operation or a mouse operation to be performed on the image displayed on the display unit to draw on video. Operation information of the touch operation or the mouse operation, for example, is transmitted to the video distribution service 200 of the electronic blackboard 10 (Step S3), and further transmitted from the video distribution service 200 to the application 100 (Step S4).
  • Fig. 3 is a functional block diagram of the electronic blackboard used for the electronic blackboard system.
  • the electronic blackboard 10 includes the application 100 and the video distribution service 200.
  • the application 100 provides a user with a function in cooperation with the video distribution service 200.
  • the application 100 includes: a function execution unit 110; an application input/output unit 120; a frame output unit 130; an image generation unit 140 serving as an image generating unit; an operation reception unit 150; and a display control unit 160.
  • the image generation unit 140 generates a display image to be displayed on the image display device 50 and a distribution image to be distributed to the communication terminals 20.
  • the operation reception unit 150 receives an operation such as writing based on the coordinates of the input pen or the finger detected through the touch panel 519.
  • the display control unit 160 causes the image display device 50 to display the display image generated by the image generation unit 140.
  • the image display device 50 displays an image of an operation panel and an image of the electronic blackboard in a superimposed manner.
  • An image generated as the distribution image by the image generation unit 140 is output to the frame output unit 130.
  • the image output by the frame output unit 130 to the video distribution service 200 is captured by a capture unit 270 and distributed to the communication terminals 20.
  • operation information from the communication terminal 20 is input to the application input/output unit 120 through the distribution service input/output unit 210 of the video distribution service 200, transferred to the function execution unit 110, and processed in the same manner as described above.
  • the video distribution service 200 is a general term for modules of the electronic blackboard 10 in the electronic blackboard system 1.
  • the video distribution service 200 includes, as illustrated in Fig. 3, the distribution service input/output unit 210, a distribution control unit 220, a distribution information management unit 230, a communication control unit 240, and a video encoder unit 250.
  • the distribution control unit 220, the distribution information management unit 230, and the communication control unit 240 constitute a distribution module 280, and the video encoder unit 250 constitutes a codec module 290.
  • the distribution service input/output unit 210 receives data (for example, data regarding service start and service stop) output from the application input/output unit 120.
  • the distribution service input/output unit 210 transmits data such as an operation event to the application input/output unit 120.
  • the distribution information management unit 230 manages a video encode setting related to image distribution, and information on the communication terminals 20 that are being connected.
  • the communication control unit 240 serving as a communicating unit performs overall control of the image distribution and issues instructions to start and end the codec module 290.
  • the video encoder unit 250 acquires and compresses an image from the capture unit 270 to generate compressed data.
  • the capture unit 270 acquires a frame image output from the frame output unit 130 of the application 100.
  • Fig. 4 is a view illustrating a display screen on the electronic blackboard.
  • the image display device 50 of the electronic blackboard 10 displays, other than an acquired image or a handwritten image 60, an operation panel 70 at the side of the image.
  • the handwritten image 60 includes a stroke image 61 and text 62 being "Whiteboard Application" that have been drawn.
  • the operation panel 70 includes a plurality of icons.
  • the electronic blackboard 10 when an image including the handwritten image 60 and the operation panel 70 is distributed to and displayed on each communication terminal 20, a user of the communication terminal 20 misunderstands that the user can operate the handwritten image 60 with the displayed operation panel 70.
  • the electronic blackboard 10 generates an image with the operation panel 70 being excluded, and distributes only the handwritten image 60 to the communication terminals 20.
  • a thumbnail or other item displayed on the lower part of the image display device 50 can be a target of exclusion.
  • the target of exclusion can be defined by the specification or other setting of the communication terminals 20.
  • Fig. 5 is a view illustrating layers of the display screen on the electronic blackboard.
  • the operation panel 70 is displayed on an operation panel display layer 81, the stroke image 61 on a handwritten image layer 82, and the text 62 on a handwritten image layer 83.
  • a desired handwritten image layer may be selected and superimposed.
  • the operation panel 70 displayed on the image display device 50 is a specific image
  • the operation panel display layer 81 is a specific layer.
  • the stroke image 61 and the text 62 are images other than the specific image.
  • the handwritten image layers 82 and 83 are other layers.
  • the display image is generated from the operation panel display layer 81 and the handwritten image layers 82 and 83 superimposed by the image generation unit 140.
  • the distribution image is generated from the handwritten image layers 82 and 83 superimposed by the image generation unit 140.
  • the distribution image is an image obtained by excluding the operation panel display layer 81 from the display image.
  • the image generation unit 140 can superimpose a specified desired handwritten image layer to generate an image.
  • Each layer may be assigned with metadata or an ID that identifies the layer, so that whether the layer is to be included in a distribution image can be determined.
  • Fig. 6 is a functional block diagram of an electronic processing terminal used for an image processing system.
  • the communication terminals 20 each include a graphical user interface (GUI) unit 310, a communication information management unit 320, an overall control unit 330, a communication control unit 340, a reproduction control unit 350, a video decoder unit 360, and an image display unit 370.
  • the GUI unit 310 causes the image display unit 370 of the communication terminal 20 to display a user interface (UI).
  • UI user interface
  • the overall control unit 330 performs overall control such as issuing instructions to start and disconnect communication.
  • the communication information management unit 320 holds information on distribution, for example, a video encode setting.
  • the communication control unit 340 controls communication with the electronic blackboard 10, and transmits and receives data to and from the video distribution service 200 of the electronic blackboard 10.
  • the reproduction control unit 350 inputs compressed data to the video decoder unit 360.
  • the video decoder unit 360 decodes the compressed data and causes the image display unit 370 to display an image.
  • the image display unit 370 includes a liquid-crystal image display panel and displays a GUI based on an image output from the GUI unit 310 and a distribution image based on the image from the video decoder unit 360.
  • Fig. 7 is a diagram illustrating a procedure for generating and distributing a distribution image in the electronic blackboard system.
  • the image generation unit 140 of the application 100 superimposes all layers including the operation panel display layer 81 to be displayed on the image display device 50 of the electronic blackboard 10, to generate a display image.
  • the image generation unit 140 transmits the display image to the display control unit 160 (Step S11).
  • the image generation unit 140 generates a distribution image that does not include the operation panel display layer 81 and outputs the distribution image to the frame output unit 130 (Step S12).
  • the capture unit 270 of the video distribution service 200 captures and acquires the image output to the frame output unit 130 (Step S13).
  • the captured image is transmitted to the codec module 290 (Step S14).
  • the video encoder unit 250 compresses the image to generate compressed data and transmits the compressed data to the distribution module 280 (Step S15).
  • the distribution module 280 transmits the compressed data to the communication terminals 20 (Step S16).
  • the video decoder unit 360 decodes the compressed data and the GUI unit 310 displays the distribution image with the operation panel being excluded.
  • the communication terminals 20 each displays the distribution image including the handwritten image layers 82 and 83, with the operation panel display layer 81 being excluded.
  • the distribution image may be formed with desired layers selected from a plurality of handwritten image layers such as the layers 82 and 83, and distributed. In this manner, the operation panel is excluded from the distribution image distributed to each communication terminal 20 in order to prevent a user of the communication terminal 20 from misunderstanding that the user can operate the blackboard from the operation panel.
  • Fig. 8 is a view illustrating a display screen on a communication terminal in the electronic blackboard system according to the modification of the first embodiment.
  • the image display unit 370 of the communication terminal 20 may display only a handwritten image without an operation panel.
  • some communication terminals desirably provide a number of functions such as changing colors of handwriting and enlarging display.
  • the communication terminals 20 can each display a unique operation panel 30.
  • the operation panel 30 may include a pen writing icon 31, an enlarged-display icon 32, and a text input icon 33.
  • displaying the unique operation panel 30 on each of the communication terminals 20 enables provision of an appropriate operation panel depending on the type of the communication terminal 20.
  • the text input icon 33 may be specified so as to facilitate text input to the display unit.
  • An electronic blackboard system 1A according to the second embodiment includes, as illustrated in Fig. 1, an electronic blackboard 10A and the communication terminals 20.
  • the electronic blackboard 10A can select, as an image to be transmitted to the communication terminals 20, a predetermined image other than a handwritten image according to an external instruction such as an instruction from an operator of the electronic blackboard 10A.
  • the predetermined image is distributed as a distribution image to the communication terminals 20.
  • the electronic blackboard system 1A includes the electronic blackboard 10A and the communication terminals 20 (20-1, 20-2, ..., 20-n) connected to the electronic blackboard 10A via a wireless LAN.
  • the wireless LAN is used for an in-house network, for example.
  • the electronic blackboard 10A includes an application 100A, the video distribution service 200, and the image display device 50.
  • the communication terminals 20 are the same as the first embodiment.
  • the electronic blackboard 10A has the same hardware configuration as the electronic blackboard 10 according to the first embodiment, which is illustrated in Fig. 2.
  • Fig. 9 is a functional block diagram of the electronic blackboard used for the electronic blackboard system according to the second embodiment.
  • the electronic blackboard 10A includes the application 100A and the video distribution service 200.
  • the application 100A has the same configuration as the application 100 of the first embodiment except that the application 100A includes a nonvolatile memory unit 170 serving as an image storing unit. That is, the application 100A includes, other than the nonvolatile memory unit 170, the function execution unit 110, the application input/output unit 120, the frame output unit 130, the image generation unit 140, the operation reception unit 150, and the display control unit 160.
  • the nonvolatile memory unit 170 preliminarily stores therein one or more distribution layers selectable as other layers.
  • the communication terminals 20 used in the electronic blackboard system 1A each have the same configuration as the communication terminals 20 used in the electronic blackboard system 1 according to the first embodiment (refer to Fig. 6).
  • Fig. 10 is a view illustrating a display screen on the electronic blackboard according to the second embodiment.
  • the image display device 50 in the electronic blackboard system 1A displays an operation panel 70A and the handwritten image 60 including the stroke image 61 and the text 62, for example.
  • the configuration of the handwritten image 60 is the same as the configuration of the handwritten image 60 in the first embodiment.
  • the operation panel 70A includes a plurality of function icons.
  • the operation panel 70A includes a message distribution icon 72 for distributing, as a distribution image, a layer specified from one or more distribution layers displaying respective messages stored in the nonvolatile memory unit 170.
  • Fig. 11 is a view illustrating a display screen on the electronic blackboard and display screens on the communication terminals according to the second embodiment.
  • the image display device 50 of the electronic blackboard 10A displays the handwritten image 60 and the operation panel 70A.
  • the handwritten image 60 is distributed as the distribution image to the communication terminals 20 (20-1 to 20-4) and displayed on the respective image display units. This state is the same as the display in the first embodiment.
  • the procedure for distributing the handwritten image 60 is the same as the first embodiment, which is illustrated in Fig. 7.
  • the following describes the distribution of an image stored as a distribution image in the nonvolatile memory unit 170 to the communication terminals 20.
  • the electronic blackboard system 1A is used in an educational field.
  • a teacher performs writing or presents material on the electronic blackboard 10A to give explanation.
  • Students use the communication terminals 20 such as tablet terminals. Each student views an image of the electronic blackboard on the screen of the student's communication terminal 20, and inputs handwritten information from the communication terminal 20 as needed. Each student can view the handwritten image 60 on the screen of the communication terminal 20 and thus the student's attention is on the communication terminal 20.
  • the teacher needs the students to look up and give attention to the teacher, it is desirable that a desired message or image be displayed on each communication terminal 20 without changing the image that has been displayed on the image display device 50 of the electronic blackboard 10A.
  • specifying the message distribution icon 72 on the operation panel 70A of the electronic blackboard 10A enables selection of a necessary image from images stored in the nonvolatile memory unit 170 and transmission of the image to the communication terminals 20.
  • Fig. 12 is a view illustrating selection of a temporary distribution image in the electronic blackboard system.
  • Fig. 13 is a view illustrating display screens on the electronic blackboard and the communication terminals when the temporary distribution image is distributed in the electronic blackboard system. These diagrams illustrate an example screen displayed on the communication terminals 20. Selecting the message distribution icon 72 displays a list 90 of the temporary distribution images that can be distributed to the communication terminals 20, as illustrated in Fig. 12.
  • four images are selectably displayed, which are an image 91 indicating "Look Forward!, an image 92 indicating "Attention!, an image 93 indicating "Working”, and an image 94 indicating "Break until 16:00".
  • One of the four temporary distribution images is selected.
  • These temporary distribution images are stored as temporary distribution layers in the nonvolatile memory unit 170. From the temporary distribution layers, a layer is selected by the function execution unit 110 serving as a selecting unit, formed as a distribution image by the image generation unit 140, and distributed to the communication terminals 20.
  • all the communication terminals 20 (20-1 to 20-4) display the selected temporary distribution image (in this example, the image 91 of "Look Forward!) in place of the handwritten image 60, as illustrated in Fig. 13.
  • the nonvolatile memory unit 170 is set to be capable of storing therein a temporary image freely added from the electronic blackboard. Displaying such temporary distribution image can bring the students' attention to the electronic blackboard 10A instead of the respective communication terminals 20. Under this state, which is regarded as the state of distributing the temporary distribution image, operation from the communication terminals can be prohibited. Reselecting the message icon on the operation panel 70A on the electronic blackboard 10A ends the state of distributing the temporary distribution image, and redistributes the handwritten image 60 to the communication terminals 20.
  • Fig. 14 is a diagram illustrating a procedure for distributing the temporary distribution image in the electronic blackboard system.
  • the image generation unit 140 of the application 100A generates a display image to be displayed on the image display device 50 of the electronic blackboard 10A, and transmits the display image to the display control unit 160 (Step S21).
  • the frame output unit 130 acquires a temporary distribution image selected from the nonvolatile memory unit 170 (Step S22).
  • the distribution information management unit 230 then transmits the temporary distribution image to the capture unit 270 (Step S23).
  • the capture unit 270 transmits the temporary distribution image to the codec module 290 (Step S24).
  • the codec module 290 compresses the temporary distribution image and transmits the compressed temporary data to the distribution module 280 (Step S25).
  • the distribution module 280 distributes the compressed temporary data to the communication terminals 20 (Step S26).
  • the video decoder unit 360 decodes the compressed temporary data and the image display unit 370 displays a temporary display image.
  • Fig. 15 is a flowchart illustrating a procedure in which the frame output unit of the electronic blackboard acquires a distribution image.
  • the frame output unit 130 determines whether a temporary distribution image is being distributed (Step S31). In a normal state of distributing no temporary distribution image (No at Step S31), the handwritten image 60 is acquired as a distribution image from the image generation unit 140 (Step S32) and transmitted to the frame output unit 130 (step S34). If a temporary distribution image is being distributed (Yes at Step S31), the temporary distribution image selected from the nonvolatile memory unit 170 is acquired (Step S33).
  • the electronic blackboard system 1A can distribute a temporary distribution image to the communication terminals 20 as needed.
  • Each of the electronic blackboards 10 and 10A may include a web server unit. This configuration enables each communication terminal 20 to use a web browser to view an image from the frame output unit 130.
  • the electronic blackboard 10 of the present aspect generates an image viewable by the communication terminal 20 and includes the image generation unit 140.
  • the image generation unit 140 generates a display image in which the operation panel display layer 81 for displaying the operation panel 70 and the handwritten image layers 82 and 83 for displaying respective images other than the operation panel 70are overlapped, and a distribution image in which the operation panel display layer 81 is excluded and only the other layers are overlapped.
  • the image generation unit 140 generates the display image generated from the operation panel display layer 81 and the handwritten image layers 82 and 83, and the distribution image generated from the handwritten image layers 82 and 83.
  • the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.
  • the image generation unit 140 of the electronic blackboard 10 superimposes a desired layer among the the handwritten image layers 82 and 83, to form the distribution image.
  • the image generation unit 140 generates the display image from the operation panel display layer 81 and the handwritten image layers 82 and 83.
  • the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.
  • the present aspect includes: the nonvolatile memory unit 170 that preliminarily stores therein one or more temporary distribution layers selectable as the other layers, and a selecting unit that selects, as the other layers, any one of the one or more distribution layers stored in the nonvolatile memory unit 170, according to an instruction from the message distribution icon 72 on the operation panel 70A.
  • the image generation unit 140 selects, according to an external instruction, a layer from the temporary distribution layers stored in the nonvolatile memory unit 170, to form the distribution image.
  • the electronic blackboard 10A can distribute a temporary distribution image to the communication terminal 20 at a desired timing.
  • the electronic blackboard 10 or 10A includes the video distribution service 200 that distributes the distribution image to the communication terminal 20.
  • the video distribution service 200 can distribute the distribution image from the electronic blackboard 10 or 10A to the communication terminal 20.
  • the communication terminal 20 can display the distribution image from the electronic blackboard 10 or 10A.
  • the electronic blackboard 10 includes the web server unit that publishes the distribution image.
  • the communication terminal 20 can acquire the distribution image from the electronic blackboard 10 through the web server unit using a web browser.
  • the communication terminal 20 can easily display the distribution image.
  • the electronic blackboard 10A includes a registering unit that registers an image as the one or more distribution layers, in the nonvolatile memory unit 170. According to the present aspect, the electronic blackboard 10A can register an image in the nonvolatile memory unit 170. Thus, various images can be distributed as a temporary distribution image to the communication terminal 20.
  • the electronic blackboard system 1 or 1A includes: the electronic blackboard 10 or 10A; and the communication terminal 20 that is connected to the electronic blackboard 10 or 10A via a network, and receives and displays the distribution image.
  • the electronic blackboard 10 or 10A distributes, to the communication terminal 20, the display image generated from the operation panel display layer 81 and the handwritten image layers 82 and 83, and the distribution image generated from the handwritten image layers 82 and 83, the display image and the distribution image being generated by the image generation unit 140.
  • the distribution image is generated with the image of the operation panel 70 undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.

Abstract

A display apparatus is configured to generate an image viewable by a communication terminal. The display apparatus includes an image generating unit configured to generate a display image in which a specific layer for displaying a specific image and one or more other layers for displaying respective images other than the specific image are overlapped, and a distribution image in which the specific layer is excluded and only the one or more other layers are overlapped.

Description

DISPLAY APPARATUS AND DISPLAY SYSTEM
The present invention relates to display apparatuses and display systems.
In recent years, electronic blackboards such as electronic whiteboards (interactive whiteboards: IWBs) have been widely used as display apparatuses. Such an electronic blackboard has a configuration combining an image display device that includes a flat panel such as a liquid crystal panel, a coordinate detection device such as a touch panel that detects coordinates of a position on a display surface of the image display device where an object used for input such as an input pen or a finger touches, and a control device that causes an image including various images, text, numbers, and figures written on the display surface of the image display device to be displayed based on coordinate data output from the coordinate detection device. With this electronic blackboard, conference material or any other material can be enlarged and displayed, and an input pen or a finger can be used to write on the display surface.
As display systems, electronic blackboard systems that each connect an electronic blackboard as described above and communication terminals (client terminals) such as personal computers (PCs) and tablet computers via a network such as an in-house LAN, exist. The electronic blackboard system can compress an image displayed on or a written video drawn on the electronic blackboard and distribute the compressed image or written video to a communication terminal, so that the image on the electronic blackboard can be viewed from the communication terminal.
Patent Literature 1 describes a technique to transmit image data of content generated by an electronic blackboard to a communication terminal. The technique includes cutting out part of the image data, converting the cut-out image data into transmission data, and transmitting the converted data to the communication terminal.
The typical electronic blackboard system known to the inventor, however, basically distributes all images generated by the electronic blackboard, and therefore an image including an area that should not be distributed is distributed as it is to the communication terminal. The area of the image undesirable for distribution can be trimmed out before the image is distributed; however, if the area to exclude is transparent, an image displayed under the trimmed image is missing from the distributed image. Also, the area to exclude may dynamically change depending on the status of the display apparatus, and in this case, the area is difficult to specify.
The technique described in Patent Literature 1 that cuts out part of image data does not solve the problems of missing of a generated image and the difficulty in specifying a variable area to exclude.
The present invention is made in view of such circumstances, and aims at generating a distribution image with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at a communication terminal.
To solve the problem described above, a display apparatus is configured to generate an image viewable by a communication terminal. The display apparatus includes an image generating unit. The image generating unit is configured to generate a display image in which a specific layer for displaying a specific image and one or more other layers for displaying respective images other than the specific image are overlapped, and a distribution image in which the specific layer is excluded and only the one or more other layers are overlapped.
According to the present invention, the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal.
Fig. 1 is a block diagram illustrating a configuration of an electronic blackboard system according to a first embodiment and a second embodiment of the present invention. Fig. 2 is a configuration diagram illustrating a hardware configuration of an electronic blackboard used for the electronic blackboard system according to the first embodiment of the present invention. Fig. 3 is a functional block diagram of the electronic blackboard used for the electronic blackboard system. Fig. 4 is a view illustrating a display screen on the electronic blackboard. Fig. 5 is a view illustrating layers of the display screen on the electronic blackboard. Fig. 6 is a functional block diagram of a communication terminal used for the electronic blackboard system. Fig. 7 is a diagram illustrating a procedure for generating and distributing a distribution image in the electronic blackboard system. Fig. 8 is a view illustrating a display screen on a communication terminal according to a modification of the first embodiment. Fig. 9 is a functional block diagram of an electronic blackboard used for the electronic blackboard system according to the second embodiment. Fig. 10 is a view illustrating a display screen on the electronic blackboard according to the second embodiment. Fig. 11 is a view illustrating a display screen on the electronic blackboard and display screens on communication terminals according to the second embodiment. Fig. 12 is a view illustrating selection of a temporary distribution image in the electronic blackboard system. Fig. 13 is a view illustrating display screens on an electronic blackboard and the communication terminals when the temporary distribution image is distributed in the electronic blackboard system. Fig. 14 is a diagram illustrating a procedure for distributing the temporary distribution image in the electronic blackboard system. Fig. 15 is a flowchart illustrating a procedure in which a frame output unit of the electronic blackboard acquires a distribution image.
The following describes in detail the present invention by way of embodiments illustrated in the drawings. The present invention includes the following configurations for easily and suitably distributing a desired image to a communication terminal, with a specific image undesirable for distribution being excluded. In the embodiments below, a display apparatus is exemplified by an electronic blackboard, and a display system is exemplified by an electronic blackboard system in which the electronic blackboard and communication terminals are connected via a communication network.
First Embodiment
First, the following describes an electronic blackboard according to a first embodiment of the present invention.
Fig. 1 is a block diagram illustrating a configuration of an electronic blackboard system according to the first embodiment of the present invention. An electronic blackboard system 1 according to the present embodiment includes an electronic blackboard 10 and a plurality of communication terminals 20 (20-1, 20-2, ..., 20-n) connected to the electronic blackboard 10 via a wireless local area network (LAN). The wireless LAN is used for an intra-company network, for example. The electronic blackboard 10 can be connected to the communication terminals 20 via various wired or wireless communication networks such as a wired LAN and the Internet, not limited to the wireless LAN.
The electronic blackboard 10 includes an application 100, a video distribution service 200, and an image display device 50.
The communication terminals 20 are notebook-type personal computers, tablet computers, and other devices, and operate on various operating systems (OSs) such as iOS, Android (registered trademark), Windows (registered trademark), and Mac OS (registered trademark). The communication terminals 20 each include an image display unit.
Fig. 2 is a configuration diagram illustrating a hardware configuration of the electronic blackboard used for the electronic blackboard system according to the first embodiment of the present invention.
The electronic blackboard 10 includes a central processing unit (CPU) 501, a read only memory (ROM) 502, a random access memory (RAM) 503, a hard disc drive (HDD) 504, a hard disk controller (HDC) 505, a media drive 507, an image display interface (I/F) device 508, an interface (I/F) 509, a keyboard 511, a mouse 512, a microphone 513, a speaker 514, a graphics processing unit (GPU) 515, and a touch panel 519, which are connected via an extension bus line 520.
The CPU 501 controls the entire operation of the electronic blackboard 10. The ROM 502 stores therein a computer program, such as an initial program loader (IPL), used for driving the CPU 501. The RAM 503 is used as a work area for the CPU 501. The HDD 504 stores therein various pieces of data such as a computer program. The HDC 505 controls reading and writing of various pieces of data from and to the HDD 504 under the control of the CPU 501. The media drive 507 controls reading and writing (storing) of data from and to a recording medium 506 such as a flash memory. The image display interface 508 is used for connecting to the image display device 50 that displays various pieces of information. The I/F 509 is used for transmitting data via a communication network or for connecting a dongle. The GPU 515 is connected to a ROM 516 storing therein a computer program used for driving the GPU 515, and a RAM 517 used as a work area for the GPU 515. The extension bus line 520 includes an address bus, a data bus, and other lines for electrically connecting the components described above. The touch panel 519 detects coordinates of a position on the image display device 50 where an input pen or a finger touches.
In the electronic blackboard 10 having the above-described configuration, the CPU 501 executes predetermined image distribution software to implement the application 100 and the video distribution service 200 that distributes, as video, a plurality of images generated by the application 100.
The application 100 detects an operation event that is a stroke of writing with an input pen or a finger or a paging operation on the image display device 50 through the touch panel 519, and draws a stroke or the like on the image display device 50 based on the operation event detected through the touch panel 519. The application 100 then outputs an image to be distributed to the communication terminals 20 (distribution image) and an image to be displayed on the image display device 50 (display image), and distributes the distribution image to the video distribution service 200 (Step S1). The video distribution service 200 compresses a plurality of images resulted from the drawing by the application 100 and distributes the images to the communication terminals 20 (Step S2). In this example, the distribution is performed from one electronic blackboard 10 to a plurality of (n) communication terminals 20-1, 20-2, ..., 20-n at the same time.
Each of the communication terminals 20 displays an image acquired from the electronic blackboard 10, on the display unit. The communication terminal 20 allows a touch operation or a mouse operation to be performed on the image displayed on the display unit to draw on video. Operation information of the touch operation or the mouse operation, for example, is transmitted to the video distribution service 200 of the electronic blackboard 10 (Step S3), and further transmitted from the video distribution service 200 to the application 100 (Step S4).
The following describes a functional configuration of the electronic blackboard 10 in the electronic blackboard system 1.
Fig. 3 is a functional block diagram of the electronic blackboard used for the electronic blackboard system. The electronic blackboard 10 includes the application 100 and the video distribution service 200.
The application 100 provides a user with a function in cooperation with the video distribution service 200. The application 100 includes: a function execution unit 110; an application input/output unit 120; a frame output unit 130; an image generation unit 140 serving as an image generating unit; an operation reception unit 150; and a display control unit 160.
The function execution unit 110 is a module that executes a function specific to the electronic blackboard. The application input/output unit 120 receives data, for example, an operation event, output from a distribution service input/output unit 210. The function execution unit 110 converts the received data into a format that the function execution unit 110 can process, and distributes the converted data. The function execution unit 110 transmits data regarding service start, service stop, and the like to the distribution service input/output unit 210.
The frame output unit 130 outputs images to be distributed as video to the communication terminals 20. For example, the frame output unit 130 outputs RGB bitmap images as video compressed in H.264/AVC format.
The image generation unit 140 generates a display image to be displayed on the image display device 50 and a distribution image to be distributed to the communication terminals 20.
The operation reception unit 150 receives an operation such as writing based on the coordinates of the input pen or the finger detected through the touch panel 519.
The display control unit 160 causes the image display device 50 to display the display image generated by the image generation unit 140. Thus, the image display device 50 displays an image of an operation panel and an image of the electronic blackboard in a superimposed manner.
An image generated as the distribution image by the image generation unit 140 is output to the frame output unit 130. The image output by the frame output unit 130 to the video distribution service 200 is captured by a capture unit 270 and distributed to the communication terminals 20.
When an operation is received from one of the communication terminals 20, operation information from the communication terminal 20 is input to the application input/output unit 120 through the distribution service input/output unit 210 of the video distribution service 200, transferred to the function execution unit 110, and processed in the same manner as described above.
The video distribution service 200 is a general term for modules of the electronic blackboard 10 in the electronic blackboard system 1. The video distribution service 200 includes, as illustrated in Fig. 3, the distribution service input/output unit 210, a distribution control unit 220, a distribution information management unit 230, a communication control unit 240, and a video encoder unit 250. The distribution control unit 220, the distribution information management unit 230, and the communication control unit 240 constitute a distribution module 280, and the video encoder unit 250 constitutes a codec module 290.
The distribution service input/output unit 210 receives data (for example, data regarding service start and service stop) output from the application input/output unit 120. The distribution service input/output unit 210 transmits data such as an operation event to the application input/output unit 120. The distribution information management unit 230 manages a video encode setting related to image distribution, and information on the communication terminals 20 that are being connected. The communication control unit 240 serving as a communicating unit performs overall control of the image distribution and issues instructions to start and end the codec module 290.
The video encoder unit 250 acquires and compresses an image from the capture unit 270 to generate compressed data. The capture unit 270 acquires a frame image output from the frame output unit 130 of the application 100.
The following describes the display image and the distribution image generated by the image generation unit 140.
Fig. 4 is a view illustrating a display screen on the electronic blackboard. The image display device 50 of the electronic blackboard 10 displays, other than an acquired image or a handwritten image 60, an operation panel 70 at the side of the image. The handwritten image 60 includes a stroke image 61 and text 62 being "Whiteboard Application" that have been drawn. The operation panel 70 includes a plurality of icons. When the operation reception unit 150 detects selection of a pen icon 71 with an input pen, the function execution unit 110 changes colors used for writing.
In this configuration, when an image including the handwritten image 60 and the operation panel 70 is distributed to and displayed on each communication terminal 20, a user of the communication terminal 20 misunderstands that the user can operate the handwritten image 60 with the displayed operation panel 70.
In the present embodiment, the electronic blackboard 10 generates an image with the operation panel 70 being excluded, and distributes only the handwritten image 60 to the communication terminals 20. Not only the operation panel 70 but also a thumbnail or other item displayed on the lower part of the image display device 50 can be a target of exclusion. The target of exclusion can be defined by the specification or other setting of the communication terminals 20.
Fig. 5 is a view illustrating layers of the display screen on the electronic blackboard.
As illustrated in Fig. 5, the operation panel 70 is displayed on an operation panel display layer 81, the stroke image 61 on a handwritten image layer 82, and the text 62 on a handwritten image layer 83. Not limited to the two handwritten image layers, a desired handwritten image layer may be selected and superimposed. The operation panel 70 displayed on the image display device 50 is a specific image, and the operation panel display layer 81 is a specific layer. The stroke image 61 and the text 62 are images other than the specific image. The handwritten image layers 82 and 83 are other layers.
The display image is generated from the operation panel display layer 81 and the handwritten image layers 82 and 83 superimposed by the image generation unit 140. The distribution image is generated from the handwritten image layers 82 and 83 superimposed by the image generation unit 140. In other words, the distribution image is an image obtained by excluding the operation panel display layer 81 from the display image.
When a plurality of handwritten image layers are present, the image generation unit 140 can superimpose a specified desired handwritten image layer to generate an image.
Each layer may be assigned with metadata or an ID that identifies the layer, so that whether the layer is to be included in a distribution image can be determined.
The following describes the communication terminals 20.
Fig. 6 is a functional block diagram of an electronic processing terminal used for an image processing system. The communication terminals 20 each include a graphical user interface (GUI) unit 310, a communication information management unit 320, an overall control unit 330, a communication control unit 340, a reproduction control unit 350, a video decoder unit 360, and an image display unit 370.
The GUI unit 310 causes the image display unit 370 of the communication terminal 20 to display a user interface (UI). The overall control unit 330 performs overall control such as issuing instructions to start and disconnect communication. The communication information management unit 320 holds information on distribution, for example, a video encode setting. The communication control unit 340 controls communication with the electronic blackboard 10, and transmits and receives data to and from the video distribution service 200 of the electronic blackboard 10. The reproduction control unit 350 inputs compressed data to the video decoder unit 360. The video decoder unit 360 decodes the compressed data and causes the image display unit 370 to display an image. The image display unit 370 includes a liquid-crystal image display panel and displays a GUI based on an image output from the GUI unit 310 and a distribution image based on the image from the video decoder unit 360.
The following describes a flow of processing performed in the electronic blackboard system 1. Fig. 7 is a diagram illustrating a procedure for generating and distributing a distribution image in the electronic blackboard system.
The image generation unit 140 of the application 100 superimposes all layers including the operation panel display layer 81 to be displayed on the image display device 50 of the electronic blackboard 10, to generate a display image. The image generation unit 140 transmits the display image to the display control unit 160 (Step S11).
At the same time, the image generation unit 140 generates a distribution image that does not include the operation panel display layer 81 and outputs the distribution image to the frame output unit 130 (Step S12).
The capture unit 270 of the video distribution service 200 captures and acquires the image output to the frame output unit 130 (Step S13). The captured image is transmitted to the codec module 290 (Step S14). In the codec module 290, the video encoder unit 250 compresses the image to generate compressed data and transmits the compressed data to the distribution module 280 (Step S15).
The distribution module 280 transmits the compressed data to the communication terminals 20 (Step S16). In each of the communication terminals 20, the video decoder unit 360 decodes the compressed data and the GUI unit 310 displays the distribution image with the operation panel being excluded.
By the above-described processing, the communication terminals 20 each displays the distribution image including the handwritten image layers 82 and 83, with the operation panel display layer 81 being excluded.
The distribution image may be formed with desired layers selected from a plurality of handwritten image layers such as the layers 82 and 83, and distributed.
In this manner, the operation panel is excluded from the distribution image distributed to each communication terminal 20 in order to prevent a user of the communication terminal 20 from misunderstanding that the user can operate the blackboard from the operation panel.
The following describes a modification of the first embodiment.
Fig. 8 is a view illustrating a display screen on a communication terminal in the electronic blackboard system according to the modification of the first embodiment.
If each communication terminal 20 allows only viewing, the image display unit 370 of the communication terminal 20 may display only a handwritten image without an operation panel. However, some communication terminals desirably provide a number of functions such as changing colors of handwriting and enlarging display.
Thus, in the present modification, the communication terminals 20 can each display a unique operation panel 30. For example, the operation panel 30 may include a pen writing icon 31, an enlarged-display icon 32, and a text input icon 33.
As described above, displaying the unique operation panel 30 on each of the communication terminals 20 enables provision of an appropriate operation panel depending on the type of the communication terminal 20. For example, when one of the communication terminals 20 includes a keyboard, the text input icon 33 may be specified so as to facilitate text input to the display unit.
Second Embodiment
The following describes an electronic blackboard system according to a second embodiment of the present invention.
An electronic blackboard system 1A according to the second embodiment includes, as illustrated in Fig. 1, an electronic blackboard 10A and the communication terminals 20.
In the electronic blackboard system 1A according to the present embodiment, the electronic blackboard 10A can select, as an image to be transmitted to the communication terminals 20, a predetermined image other than a handwritten image according to an external instruction such as an instruction from an operator of the electronic blackboard 10A. The predetermined image is distributed as a distribution image to the communication terminals 20.
As illustrated in Fig. 1, the electronic blackboard system 1A includes the electronic blackboard 10A and the communication terminals 20 (20-1, 20-2, ..., 20-n) connected to the electronic blackboard 10A via a wireless LAN. The wireless LAN is used for an in-house network, for example.
The electronic blackboard 10A includes an application 100A, the video distribution service 200, and the image display device 50. The communication terminals 20 are the same as the first embodiment. The electronic blackboard 10A has the same hardware configuration as the electronic blackboard 10 according to the first embodiment, which is illustrated in Fig. 2.
Fig. 9 is a functional block diagram of the electronic blackboard used for the electronic blackboard system according to the second embodiment. The electronic blackboard 10A includes the application 100A and the video distribution service 200.
The application 100A has the same configuration as the application 100 of the first embodiment except that the application 100A includes a nonvolatile memory unit 170 serving as an image storing unit. That is, the application 100A includes, other than the nonvolatile memory unit 170, the function execution unit 110, the application input/output unit 120, the frame output unit 130, the image generation unit 140, the operation reception unit 150, and the display control unit 160. The nonvolatile memory unit 170 preliminarily stores therein one or more distribution layers selectable as other layers.
The communication terminals 20 used in the electronic blackboard system 1A each have the same configuration as the communication terminals 20 used in the electronic blackboard system 1 according to the first embodiment (refer to Fig. 6).
Fig. 10 is a view illustrating a display screen on the electronic blackboard according to the second embodiment. The image display device 50 in the electronic blackboard system 1A displays an operation panel 70A and the handwritten image 60 including the stroke image 61 and the text 62, for example. The configuration of the handwritten image 60 is the same as the configuration of the handwritten image 60 in the first embodiment.
The operation panel 70A includes a plurality of function icons. In the present embodiment, the operation panel 70A includes a message distribution icon 72 for distributing, as a distribution image, a layer specified from one or more distribution layers displaying respective messages stored in the nonvolatile memory unit 170.
Fig. 11 is a view illustrating a display screen on the electronic blackboard and display screens on the communication terminals according to the second embodiment. In Fig. 11, the image display device 50 of the electronic blackboard 10A displays the handwritten image 60 and the operation panel 70A. The handwritten image 60 is distributed as the distribution image to the communication terminals 20 (20-1 to 20-4) and displayed on the respective image display units. This state is the same as the display in the first embodiment. The procedure for distributing the handwritten image 60 is the same as the first embodiment, which is illustrated in Fig. 7.
The following describes the distribution of an image stored as a distribution image in the nonvolatile memory unit 170 to the communication terminals 20.
It is assumed that the electronic blackboard system 1A is used in an educational field. A teacher performs writing or presents material on the electronic blackboard 10A to give explanation. Students use the communication terminals 20 such as tablet terminals. Each student views an image of the electronic blackboard on the screen of the student's communication terminal 20, and inputs handwritten information from the communication terminal 20 as needed.
Each student can view the handwritten image 60 on the screen of the communication terminal 20 and thus the student's attention is on the communication terminal 20. When the teacher needs the students to look up and give attention to the teacher, it is desirable that a desired message or image be displayed on each communication terminal 20 without changing the image that has been displayed on the image display device 50 of the electronic blackboard 10A.
In the present embodiment, specifying the message distribution icon 72 on the operation panel 70A of the electronic blackboard 10A enables selection of a necessary image from images stored in the nonvolatile memory unit 170 and transmission of the image to the communication terminals 20.
Fig. 12 is a view illustrating selection of a temporary distribution image in the electronic blackboard system. Fig. 13 is a view illustrating display screens on the electronic blackboard and the communication terminals when the temporary distribution image is distributed in the electronic blackboard system.
These diagrams illustrate an example screen displayed on the communication terminals 20. Selecting the message distribution icon 72 displays a list 90 of the temporary distribution images that can be distributed to the communication terminals 20, as illustrated in Fig. 12.
In this example, four images are selectably displayed, which are an image 91 indicating "Look Forward!", an image 92 indicating "Attention!", an image 93 indicating "Working", and an image 94 indicating "Break until 16:00". One of the four temporary distribution images is selected. These temporary distribution images are stored as temporary distribution layers in the nonvolatile memory unit 170. From the temporary distribution layers, a layer is selected by the function execution unit 110 serving as a selecting unit, formed as a distribution image by the image generation unit 140, and distributed to the communication terminals 20.
When the temporary distribution image is distributed, all the communication terminals 20 (20-1 to 20-4) display the selected temporary distribution image (in this example, the image 91 of "Look Forward!") in place of the handwritten image 60, as illustrated in Fig. 13. The nonvolatile memory unit 170 is set to be capable of storing therein a temporary image freely added from the electronic blackboard.
Displaying such temporary distribution image can bring the students' attention to the electronic blackboard 10A instead of the respective communication terminals 20. Under this state, which is regarded as the state of distributing the temporary distribution image, operation from the communication terminals can be prohibited. Reselecting the message icon on the operation panel 70A on the electronic blackboard 10A ends the state of distributing the temporary distribution image, and redistributes the handwritten image 60 to the communication terminals 20.
The following describes a procedure for distributing the temporary distribution image.
Fig. 14 is a diagram illustrating a procedure for distributing the temporary distribution image in the electronic blackboard system. The image generation unit 140 of the application 100A generates a display image to be displayed on the image display device 50 of the electronic blackboard 10A, and transmits the display image to the display control unit 160 (Step S21). The frame output unit 130 acquires a temporary distribution image selected from the nonvolatile memory unit 170 (Step S22). The distribution information management unit 230 then transmits the temporary distribution image to the capture unit 270 (Step S23). The capture unit 270 transmits the temporary distribution image to the codec module 290 (Step S24). The codec module 290 compresses the temporary distribution image and transmits the compressed temporary data to the distribution module 280 (Step S25). The distribution module 280 distributes the compressed temporary data to the communication terminals 20 (Step S26). In the video distribution service 200, the video decoder unit 360 decodes the compressed temporary data and the image display unit 370 displays a temporary display image.
The following describes a procedure in which the frame output unit 130 of the electronic blackboard 10A acquires a distribution image and a temporary distribution image. Fig. 15 is a flowchart illustrating a procedure in which the frame output unit of the electronic blackboard acquires a distribution image.
The frame output unit 130 determines whether a temporary distribution image is being distributed (Step S31). In a normal state of distributing no temporary distribution image (No at Step S31), the handwritten image 60 is acquired as a distribution image from the image generation unit 140 (Step S32) and transmitted to the frame output unit 130 (step S34).
If a temporary distribution image is being distributed (Yes at Step S31), the temporary distribution image selected from the nonvolatile memory unit 170 is acquired (Step S33).
As described above, the electronic blackboard system 1A according to the second embodiment can distribute a temporary distribution image to the communication terminals 20 as needed.
Each of the electronic blackboards 10 and 10A may include a web server unit. This configuration enables each communication terminal 20 to use a web browser to view an image from the frame output unit 130.
Configurations, Actions, and Effects of Aspects of Present Invention
First Aspect
The electronic blackboard 10 of the present aspect generates an image viewable by the communication terminal 20 and includes the image generation unit 140. The image generation unit 140 generates a display image in which the operation panel display layer 81 for displaying the operation panel 70 and the handwritten image layers 82 and 83 for displaying respective images other than the operation panel 70are overlapped, and a distribution image in which the operation panel display layer 81 is excluded and only the other layers are overlapped.
According to the present aspect, the image generation unit 140 generates the display image generated from the operation panel display layer 81 and the handwritten image layers 82 and 83, and the distribution image generated from the handwritten image layers 82 and 83. Thus, the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.
Second Aspect
In the present aspect, the image generation unit 140 of the electronic blackboard 10 superimposes a desired layer among the the handwritten image layers 82 and 83, to form the distribution image.
According to the present aspect, the image generation unit 140 generates the display image from the operation panel display layer 81 and the handwritten image layers 82 and 83. Thus, the distribution image is generated with a specific image undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.
Third Aspect
The present aspect includes: the nonvolatile memory unit 170 that preliminarily stores therein one or more temporary distribution layers selectable as the other layers, and a selecting unit that selects, as the other layers, any one of the one or more distribution layers stored in the nonvolatile memory unit 170, according to an instruction from the message distribution icon 72 on the operation panel 70A.
According to the present aspect, the image generation unit 140 selects, according to an external instruction, a layer from the temporary distribution layers stored in the nonvolatile memory unit 170, to form the distribution image. Thus, the electronic blackboard 10A can distribute a temporary distribution image to the communication terminal 20 at a desired timing.
Fourth Aspect
In the present aspect, the electronic blackboard 10 or 10A includes the video distribution service 200 that distributes the distribution image to the communication terminal 20.
According to the present aspect, the video distribution service 200 can distribute the distribution image from the electronic blackboard 10 or 10A to the communication terminal 20. Thus, the communication terminal 20 can display the distribution image from the electronic blackboard 10 or 10A.
Fifth Aspect
In the present aspect, the electronic blackboard 10 includes the web server unit that publishes the distribution image.
According to the present aspect, the communication terminal 20 can acquire the distribution image from the electronic blackboard 10 through the web server unit using a web browser. Thus, the communication terminal 20 can easily display the distribution image.
Sixth Aspect
In the present aspect, the electronic blackboard 10A includes a registering unit that registers an image as the one or more distribution layers, in the nonvolatile memory unit 170.
According to the present aspect, the electronic blackboard 10A can register an image in the nonvolatile memory unit 170. Thus, various images can be distributed as a temporary distribution image to the communication terminal 20.
Seventh Aspect
In the present aspect, the electronic blackboard system 1 or 1A includes: the electronic blackboard 10 or 10A; and the communication terminal 20 that is connected to the electronic blackboard 10 or 10A via a network, and receives and displays the distribution image.
According to the present aspect, the electronic blackboard 10 or 10A distributes, to the communication terminal 20, the display image generated from the operation panel display layer 81 and the handwritten image layers 82 and 83, and the distribution image generated from the handwritten image layers 82 and 83, the display image and the distribution image being generated by the image generation unit 140. Thus, the distribution image is generated with the image of the operation panel 70 undesirable for distribution being excluded, enabling easy and suitable viewing at the communication terminal 20.
1, 1A Electronic blackboard system
10, 10A Electronic blackboard
20 Communication terminal
100, 100A Application
110 Function execution unit
120 Application input/output unit
130 Frame output unit
140 Image generation unit
150 Operation reception unit
160 Display control unit
170 Nonvolatile memory unit
200 Video distribution service
Japanese Laid-open Patent Publication No. 2014-199650

Claims (7)

  1. A display apparatus configured to generate an image viewable by a communication terminal, the display apparatus comprising:
    an image generating unit configured to generate a display image in which a specific layer for displaying a specific image and one or more other layers for displaying respective images other than the specific image are overlapped, and a distribution image in which the specific layer is excluded and only the one or more other layers are overlapped.
  2. The display apparatus according to claim 1, wherein the image generating unit superimposes a desired layer among the one or more other layers to form the distribution image.
  3. The display apparatus according to claim 1, further comprising:
    an image storing unit configured to preliminarily store one or more distribution layers selectable as the one or more other layers; and
    a selecting unit configured to select, as the one or more other layers, any one of the one or more distribution layers stored in the image storing unit, according to an external instruction.
  4. The display apparatus according to any one of claims 1 to 3, further comprising a distributing unit configured to distribute the distribution image to the communication terminal.
  5. The display apparatus according to any one of claims 1 to 3, further comprising a web server unit configured to publish the distribution image.
  6. The display apparatus according to claim 3, further comprising a registering unit configured to register an image as the one or more distribution layers, in the image storing unit.
  7. A display system comprising:
    the display apparatus according to any one of claims 1 to 6; and
    a communication terminal that is connected to the display apparatus via a network, and configured to receive and display the distribution image.
PCT/JP2016/002243 2015-05-08 2016-04-28 Display apparatus and display system WO2016181637A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201680026230.2A CN107533770A (en) 2015-05-08 2016-04-28 Display device and display system
EP16792366.3A EP3295429A4 (en) 2015-05-08 2016-04-28 Display apparatus and display system
US15/786,635 US20180041564A1 (en) 2015-05-08 2017-10-18 Electronic blackboard system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015095597 2015-05-08
JP2015-095597 2015-05-08
JP2016-079799 2016-04-12
JP2016079799A JP2016212844A (en) 2015-05-08 2016-04-12 Display device and display system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/786,635 Continuation US20180041564A1 (en) 2015-05-08 2017-10-18 Electronic blackboard system

Publications (1)

Publication Number Publication Date
WO2016181637A1 true WO2016181637A1 (en) 2016-11-17

Family

ID=57249491

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/002243 WO2016181637A1 (en) 2015-05-08 2016-04-28 Display apparatus and display system

Country Status (1)

Country Link
WO (1) WO2016181637A1 (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015043149A (en) * 2013-08-26 2015-03-05 株式会社リコー Operation terminal, program, and information processing system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015043149A (en) * 2013-08-26 2015-03-05 株式会社リコー Operation terminal, program, and information processing system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3295429A4 *

Similar Documents

Publication Publication Date Title
KR101179912B1 (en) Dummy touch screen system for connecting a plurality of mobile terminal
Gumienny et al. Tele-board: Enabling efficient collaboration in digital design spaces
US20100318921A1 (en) Digital easel collaboration system and method
US20100231556A1 (en) Device, system, and computer-readable medium for an interactive whiteboard system
US11209921B2 (en) Electronic blackboard, storage medium, and information display method
JP6051670B2 (en) Image processing apparatus, image processing system, image processing method, and program
JP7042622B2 (en) Image processing device, image processing system, image processing method, and program
JP6160305B2 (en) Image processing apparatus, program, image processing system, and image processing method
US9229679B2 (en) Image distribution apparatus, display apparatus, and image distribution system
US20170229102A1 (en) Techniques for descriptor overlay superimposed on an asset
JP6031750B2 (en) Display control apparatus, image display system, display control method, and program
US20170228137A1 (en) Local zooming of a workspace asset in a digital collaboration environment
JP6458581B2 (en) Information processing system, display position determination method, terminal device, information processing device, and program
JP2019096367A (en) Electronic blackboard, image processing method of electronic blackboard, and recording medium with program of electronic blackboard recorded thereon
EP3893496A1 (en) Output apparatus, output system, method of changing format information, and carrier means
KR101000893B1 (en) Method for sharing displaying screen and device thereof
WO2017138233A1 (en) Image processing device, image processing system and image processing method
WO2016181637A1 (en) Display apparatus and display system
JP2017062645A (en) Image distribution system, image distribution method, and program
EP3295429A1 (en) Display apparatus and display system
JP2020154660A (en) Display device and display method
JP2013187589A (en) Image display device, display system, and portable terminal
WO2016166955A1 (en) Image processing device, image distribution system, and image processing method
CN111610893B (en) Method and apparatus for presenting electronic whiteboard, and computer-readable storage medium
US20170070560A1 (en) Dynamically providing host input control for streaming applications

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16792366

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE