JP6677700B2 - Terminal display device, display method and program - Google Patents

Description

  The present invention relates to a terminal display device and the like that share display data and allow a handwritten image to be added to the display data.

  2. Description of the Related Art In recent years, a video conference in which remote locations are connected via a telephone communication network, a LAN, or the like, and a conference is held by sharing image display data with each other has become widespread.

Patent Literature 1 describes a technique capable of adding and modifying image data.

JP-A-6-259522

  In the conventional video conference system, the image display data transmitted from the main venue is received at the conference venue, and the display is mainly stopped at the conference venue.

  In a video conference system using a personal computer, there have been some video conference systems that can add a revision to a shared image, but this revision information is also shared by all conference participants and is kept as a personal memo. There is a problem that such considerations are not taken into account.

  Although a handwriting display device as described in Patent Document 1 can modify and correct arbitrary image data, it is not a device that shares image data among a plurality of devices in a conference system or the like. In addition, there is a problem that, in a meeting or the like, additional information on image data is also shared by all meeting participants and cannot be applied to leaving as a personal memo.

  The present invention has been made to solve such a problem, and in a system including a main display device and one or more terminal display devices, a display image is shared. It is an object of the present invention to provide a terminal display device and the like, each of which captures a display image transmitted from a main display device by a user's operation and allows handwritten information to be added to the captured data.

The present invention
A terminal display device having a display unit for displaying image data,
A communication unit that is connected to the display device for communication and performs reception or transmission of image data;
A control unit that displays the image data received from the display device on the display unit ,
A capture unit that captures the image data displayed on the display unit,
A handwriting input unit which performs handwriting input to the image data captured by the capture unit,
With
Wherein the control unit includes a first instruction icon accepting an instruction to capture more of the image data displayed on the display unit to the capture unit, captured handwritten image data input in handwriting by the handwriting input unit A terminal display device , wherein a second instruction icon for receiving an instruction to transmit composite image data with the image data to a display device by the communication unit is superimposed on the image data and displayed.

The present invention
The terminal display device further includes a storage unit that stores image data ,
The control unit displays the image data captured by the capture unit, or a third instruction icon for receiving an instruction to save the composite image data, superimposed on the image data,
Said storage unit, said third instruction icon of time was depressed, and to store captured the image data, or the composite image data by the capture unit.

Also, the present invention
The communication unit and transmits the image data captured by the capture unit before Symbol display device.

Further, the display method of the present invention,
In a display method of a terminal display device having a display unit for displaying image data,
A communication step of communicating with the display device and receiving image data;
And a control step of displaying the image data received from the display device to the display unit,
A capture step of key Yapucha the image data displayed on the display unit,
Handwriting input step intends line handwriting input to capture said image data,
Including
The control step displays a first instruction icon for accepting an instruction to capture the image data displayed on the display unit, and composite image data of the handwritten input image data and the captured image data. a second instruction icon accepting an instruction to be transmitted to the apparatus, characterized in that it comprises displaying superimposed on the image data.

Also, the program of the present invention
On the computer,
A communication function of communicating with a display device and receiving or transmitting image data;
A control function of displaying the image data received from the display device to the display unit,
A capture function to capture the image data displayed on the display unit,
A handwriting input function for performing handwriting input on the captured image data,
Including
The control function, the first instruction icon accepting an instruction to key Yapucha the image data displayed on the display unit, the synthesized image data of the image data which has been handwritten input and captured the image data a second instruction icon accepting an instruction to be transmitted to the display device, displays superimposed on the image data,
It is characterized by realizing this.

  According to the present invention, the display screen of the main display device is transmitted to the terminal display device, and the display data of the main display device is displayed on the terminal display device. Since it is possible to capture the screen and perform arbitrary handwriting input, for example, in a conference system, it becomes possible to leave a memo or the like in the electronic conference material independently for each individual participating in the conference.

  Further, according to the present invention, since handwritten data for the material is transmitted from each terminal display device to the main display device, the transmission data from each terminal display device is used as a meeting opinion on the main display device side. It is possible to collect and display images can be shared.

It is a system outline view of a handwritten image display system. 1 is a system block diagram illustrating a configuration of a handwritten image display system. It is a process conceptual diagram in a handwritten image display system. 5 is a flowchart illustrating a process of the main display device 2. 5 is a flowchart illustrating a specific operation as main processing of the terminal display device 3. 6 is a flowchart showing a subroutine of a capture mode process in step S18 in FIG. 7 is a flowchart in which a new processing step is added to FIG. FIG. 3 is a diagram illustrating a state in which the same image data is displayed on a main display device 2 and a terminal display device 3. FIG. 4 is a diagram showing function icons 40 of the electronic conference application program. FIG. 4 is a diagram illustrating a state in which display data on the terminal display device 3 is not enlarged even if display data on the main display device 2 is enlarged. FIG. 9 is a diagram illustrating a state where handwriting input has been performed on the terminal display device 3.

  Hereinafter, the handwritten image display system 1 according to the present invention will be described.

  FIG. 1 is a system appearance diagram showing the appearance of the image display system 1. The main display device 2 is, for example, a display device having a large screen display unit 11, and is configured by a system including a plurality of terminal display devices 3-1, 3-2, and 3-3. Note that the handwritten image display system 1 may have a system configuration including the main display device 1 and one terminal display device.

  FIG. 2 is a system block diagram showing the configuration of the handwritten image display system. The main display device 2 includes a display unit 21 as a first display unit, a touch detection unit 22, a storage unit 23 as a first storage unit, a communication unit 24 as a first communication unit, and a main control unit 25. The terminal display device 3 includes a display unit 31 as a second display unit, a touch detection unit 32, a storage unit 33 as a second storage unit, a communication unit 34 as a second communication unit, a screen capture unit 35, and a capture memory unit 36. , A handwriting input unit 37, an image editing unit 38, and a main control unit 39.

  The display units 21 and 31 are, for example, a liquid crystal display, an EL (Electro Luminescence) display, or the like, and display a display image on a screen.

  The touch detection units 22 and 32 include a capacitive touch panel, a resistive touch panel, and the like. When a touch operation is performed, information indicating a position where the touch operation is performed on the screen, that is, a touch operation is performed. To obtain position coordinate information indicating the location where the operation has been performed. The position coordinate information acquired by the touch detection units 22 and 32 is input to the main control unit 25 and the main control unit 39, respectively. In the display device 1, when two or more areas separated from each other are pressed, the touch detection unit 3 can also acquire position information corresponding to each area. In this case, a capacitive touch panel capable of performing a so-called multi-touch operation is provided.

  The storage units 23 and 33 include a volatile memory such as a DDR SDRAM (Double Data Rate Synchronous Dynamic Random Access Memory), a flash ROM (Read Only Memory), an EEPROM (registered trademark), and a HDD (Hard Disk Drive). And a program for controlling the main display device 2 and the terminal display device 3 and data to be displayed are stored.

  The communication units 24 and 34 perform processing for communicating with other devices by wire or wirelessly.

The main control unit 25 of the main display device 2 is a control arithmetic circuit such as a CPU (Central Processing Unit), and controls the display unit 21, the touch detection unit 22, the storage unit 23, and the communication unit 24.

  The screen capture unit 35 of the terminal display device stores a control program for receiving and capturing screen data displayed on the main display device 2. Note that this program may be stored in the storage unit 33.

  The capture memory unit 36 stores the screen data captured by the screen capture unit 35. The screen data at this time may be stored in the storage unit 33.

  The handwriting input unit 37 forms handwritten stroke data based on the coordinate data from the touch detection unit 32.

  The image editing unit 38 performs a process of superimposing and displaying the handwritten stroke data formed by the handwriting input unit 37 on the captured image data.

The main control unit 39 of the terminal display device 2 is a control arithmetic circuit such as a CPU (Central Processing Unit), and includes a display unit 31, a touch detection unit 32, a storage unit 33, a communication unit 34, a screen capture unit 35, a capture memory unit. 36, a handwriting input unit and an image editing unit 38 are controlled.

  FIG. 3 shows that, in the handwritten image display system 1, the main display device 2 and the display terminal device 3 share screen data, and the display terminal device 3 that has received the screen data from the main display device 2 captures the screen data at an arbitrary timing. FIG. 8 is a conceptual diagram of processing in a handwritten image display system showing that handwriting input and data saving are performed as appropriate.

  When the electronic conference application program is started in the organizer mode in A and the conference is started in B, the main display device 2 displays screen data of an initial page as conference material, and sequentially displays pages of the material like CDE. Advance the meeting by changing. After the display of the initial page of the screen data, if there is a terminal display device connected for communication, the screen data at that time is transmitted to the terminal display device.

  On the other hand, the terminal display device 3 starts the electronic conference application program in the participant mode in F, displays the screen data of the page 1 transmitted from the main display device 2 in G, and displays the main display device 2. When the screen data is updated, the screen data of page 2 updated in H is received and displayed.

  At this time, when the user wants to leave a memo on the screen data by handwriting on the terminal display device 3, the user presses the capture button with I to fix the screen data. In this state, handwriting input is performed as appropriate and the captured data is saved, and the screen returns to the screen sharing mode with J. On the other hand, the conference progresses on the main display device 2 and the screen data on the main display device 2 changes to page E as shown in E. When the process has proceeded to 4, the display on the terminal display device 3 displays page 4 which is the screen data of the main display device 2.

4, 5, and 6 are flowcharts illustrating specific operations of the handwritten image display system 1 according to the first embodiment, and FIG. 4 is a flowchart illustrating processing of the main display device 2. FIG. 5 and FIG. 6 are flowcharts showing the processing of the terminal display device 3.

  FIG. 8 to FIG. 11 are diagrams showing the form of the display screen of each of the main display device 2 and the terminal display device 3 of the handwritten image display system 1. Note that these are merely examples, and it goes without saying that various modifications can be made in the implementation of the present invention.

  FIG. 4 is a diagram showing a specific operation as main processing of the main display device 2 of the handwritten image display system 1. First, in step S1, an electronic conference application program is activated in an organizer mode by an electronic conference icon (not shown). Then, the process proceeds to step S2. At this time, some image data is already displayed on the main display device, or the image data is read out from the storage unit 23 and displayed after the electronic conference application program is started in the host mode by the electronic conference icon. It is assumed that

  In step S2, it is determined whether a communication request from the terminal display device 3 has been received. If a communication start request has been received, the process proceeds to step S3. If a communication request has not been received, the process proceeds to step S4.

In step S3, the image data is transmitted to the requesting terminal display device 3, the display image data of the main display device 1 is displayed on the terminal display device 3, and the process proceeds to step S4. At this time, the display image data 21 of the main display device 2 in the handwritten image display system 1 and the terminal display device 3
The same image data is displayed as the image data 31 of FIG. Reference numeral 40 denotes a function icon 40 of the electronic conference application program, which will be described later in detail.

  In step S4, it is determined whether a communication request from another terminal display device has been received. If yes, the process returns to step S3 to transmit image data. If no, the process proceeds to step S5.

  In step S5, it is determined whether the image data displayed on the electronic conference application program has been updated. The page is changed using a “next page” icon or the like (not shown). In the case of yes, the process returns to step S2 to transmit image data to the terminal display device that has requested communication, and in the case of no, the process proceeds to step S6.

  In step S6, it is determined whether an end icon (not shown) has been designated. If no, this step is repeated until the end icon is designated. If yes, the process proceeds to step S7.

  FIG. 5 is a flowchart showing a specific operation as main processing of the terminal display device 3 of the handwritten image display system 1. First, in step S11, an electronic conference application program is started in a participant mode by an electronic conference icon (not shown). The process proceeds to step S12.

  In step S12, although not shown, a connectable communication partner is displayed, an arbitrary connectable destination is selected, and the process proceeds to step S13.

  In step S13, a communication start request is transmitted to the designated device by the communication unit 24, and the process proceeds to step S14. Here, it is assumed that a communication start request is made to the main display device 2.

In step S14, by pressing the screen sharing icon 41 in the function icon 40 of the electronic conference application program shown in FIG. Request transmission, and proceed to step S15.

  In step S15, screen data is received from the main display device 2 and displayed on the display unit 31, and the process proceeds to step S16. In step S15, it is assumed that the screen data is received each time the screen data of the main display device 2 is updated. FIG. 8 shows the state at this time, and the screen displayed on the display unit 21 of the main display device 2 and the screen displayed on the display unit 31 of the terminal display device 3 are the same screen. I have.

  In step S16, it is determined whether or not the capture icon has been pressed. If yes, the process proceeds to step S18, to the subroutine of the capture mode process, and if no, to step S17. Note that 42 in FIG. 9 is an example of the capture icon.

  In step S17, it is determined whether or not an end button (not shown) has been pressed. If no, the process returns to step S14. If yes, the electronic conference application program ends.

  FIG. 6 is a flowchart showing a subroutine of the capture mode process in step S18 in FIG. 5. In step S21, the screen capture memo function is activated, and the process proceeds to step S22. The activation of the screen capture memo function is specifically performed by pressing the capture icon 42 in the function icon 40 of the electronic conference application program shown in FIG.

  In step S22, the screen data being displayed is captured by the processing program of the screen capture unit 35, stored in the capture memory unit 36, and the process proceeds to step S23. FIG. 10 shows the state at this time, and shows the state where the display data on the terminal display device 3 is not enlarged even if the display data on the main display device 2 is enlarged.

  In step S23, it is determined whether or not the editing icon 43 shown in FIG. 9 has been pressed. If no, the process proceeds to step S29. If yes, the editing function is activated and the process proceeds to step S24.

  In step S24, a handwriting input is performed with a dedicated pen or the like (not shown) for the display device 2, and the process proceeds to step S25. FIG. 11 shows the state at this time, and shows a state where "Japan map" is handwritten and input on the screen data of the Japan map.

  In step S25, it is determined whether the memo save icon 44 described in FIG. 9 has been pressed. If no, the process proceeds to step S29. If yes, the save function is activated and the process proceeds to step S26.

  In step S26, the data is stored in a storage format selected by the user from a menu screen (not shown), and the process proceeds to the next step.

  In step S27, the synthesis result of the captured image and the handwritten portion is stored as raster image data. In step S28, only the handwritten portion is stored as stroke data, and the process proceeds to step S29.

  In step S29, it is determined whether or not the drawing sharing icon 41 in FIG. 9 has been pressed. If no, the process returns to step S23, and if yes, the process returns to step S18 in FIG.

FIG. 7 is a flowchart showing a specific operation of the handwritten image display system 1 according to the second embodiment, and is a flowchart showing a subroutine of the capture mode process in step S18 in FIG. It is the flowchart which added step S30 to the processing of the device 3.

  In step S30, a process of transmitting the stored data to main display device 1 is performed, and the process proceeds to step S29. The main display device 1 allows the user to check the stored data transmitted from each terminal display device 3 and has an effect of collecting opinions on the contents of the conference.

  Although not shown, as a third embodiment, the terminal display device can display saved data as a list and also display a thumbnail. For example, by displaying the stored data saved on the terminal display device 3 as a thumbnail, each user using the terminal display device can easily check which conference material a memo is left for.

The display program stored in the storage unit 23 of the main display device 2 of the handwritten image display system configured as described above includes a device including the display unit 21 and the touch detection unit 22 having a touch panel as the main display device 2. A program that works,
The display program stored in the storage unit 33 of the terminal display device 3 of the handwritten image display system and the control program stored in the screen capture unit 35 include a display unit 31 and a touch detection unit 32 having a touch panel. Is a program that functions as a terminal display device 3.

  This display program can be recorded on a conventionally known computer-readable recording medium. By recording the display program on a recording medium, it is possible to provide, in a portable manner, a recording medium on which program codes (executable programs, intermediate code programs, source programs, etc.) for executing processing based on the display program are recorded. it can.

  Note that the recording medium may be a program medium such as a ROM (Read Only Memory) for processing by the microcomputer, or may be inserted into a program reading device provided as an external storage device in the computer. It may be a program medium that can be read by the user.

  The program stored in the recording medium may be a method in which a microprocessor accesses the recording medium and executes the program. Alternatively, the microprocessor may read a program code from the recording medium and read the program code from the recording medium. The program may be executed by being downloaded to a program storage area of a computer. It is assumed that this download program is stored in the main unit in advance.

  Here, the program medium is a recording medium configured to be separable from the main body, such as a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a flexible disk and a hard disk, and a CD-ROM (Compact Disc-Read Only Memory). ), MO (Magneto Optical disc), MD (Mini Disc), DVD (Digital Versatile Disc) and other optical discs, IC cards (including memory cards), optical cards and other card systems, or mask ROMs and EPROMs A medium that fixedly holds the program code may include a semiconductor memory such as an Erasable Programmable Read Only Memory (EEPROM), a flash ROM, or the like.

Further, if the main display device and the terminal display device have a system configuration capable of connecting to a communication network including the Internet, the recording medium carries the program code in a fluid manner so as to download the program code from the communication network. Media. When the program is downloaded from the communication network as described above, the download program is stored in the main device in advance or installed from another recording medium. Further, the display program may be realized in the form of a computer data signal embedded in a carrier wave, in which the program code is embodied by electronic transmission.

  Further, according to the above-described embodiment, the display screen of the main display device is transmitted to the terminal display device, and the display data of the main display device is displayed on the terminal display device. It is possible to capture the display screen according to the instruction of the user and perform arbitrary handwriting input, so that, for example, in a conference system, it is possible to leave memos etc. on electronic conference materials independently for each individual participating in the conference. Thus, a highly convenient handwritten image display system is provided.

  In addition, since handwritten data for the material is transmitted from each terminal display device to the main display device, transmission data from each terminal display device can be collected as a meeting opinion on the main display device side, and a meeting It becomes a handwritten image display system that is highly convenient as an organizer.

  In addition, by displaying thumbnails of the data stored on the terminal display device, it is possible to easily determine which conference material a memo of a conference participant left.

  In addition, the main display device and the terminal display device can function as the handwritten image display system.

Reference Signs List 1 handwritten image display system 2 main display device 3 terminal display device 21, 31 display unit 22, 32 touch detection unit 23, 33 storage unit 24, 34 communication unit 25, 39 main control unit 35 screen capture unit 36 capture memory unit 37 handwriting Input unit 38 Image editing unit

Claims (6)

A terminal display device having a display unit for displaying image data,
A communication unit that is connected to the display device for communication and performs reception or transmission of image data;
A control unit that displays the image data received from the display device on the display unit,
A capture unit that captures the image data displayed on the display unit,
A handwriting input unit for performing handwriting input on the image data captured by the capture unit,
With
Wherein the control unit, the instructions to the image data displayed on the display unit to capture by the capture unit, composite image of the handwritten image data and captured the image data input in handwriting by prior Symbol handwriting input unit instructions for transmitting the data to the display device by the communication unit, and a plurality of instruction icon accepting an instruction to receive the image data from the display device, and displayed superimposed on the image data,
The terminal display device , wherein, when the control unit receives an instruction to receive the image data, the communication unit transmits a request to transmit the image data to the display device. The terminal display device further includes a storage unit that stores image data,
Wherein the controller displays superimposed the image data captured by the capture unit or the instructions icons are accepted instruction to store the composite image data to said image data,
The terminal display device according to claim 1, wherein the storage unit stores the image data or the composite image data captured by the capture unit when receiving the instruction to save .   The terminal display device according to claim 1, wherein the communication unit transmits the image data captured by the capture unit to the display device. The storage unit stores an electronic conference application program that can be started in any one of the organizer mode and the participant mode,
The terminal display device according to claim 2, wherein the control unit, when activated in the participant mode, displays the plurality of instruction icons so as to be superimposed on the image data. In a display method of a terminal display device having a display unit for displaying image data,
A communication step of communicating with the display device and receiving image data;
A control step of displaying the image data received from the display device on the display unit,
A capture step of capturing the image data displayed on the display unit,
A handwriting input step of performing a handwriting input on the captured image data,
Including
The control step includes instructions for capturing the image data displayed on the display unit, instructions for transmitting the synthesized image data of the handwritten input handwritten image data and captured the image data to the display device A plurality of instruction icons for receiving an instruction to receive the image data from the display device are displayed in a manner superimposed on the image data ,
The display method , wherein the communication step includes transmitting a request to transmit the image data to the display device when receiving an instruction to receive the image data in the control step . A computer of a terminal display device having a display unit for displaying image data ,
A communication function of communicating with a display device and receiving or transmitting image data;
A control function of displaying the image data received from the display device on the display unit,
A capture function for capturing the image data displayed on the display unit,
A handwriting input function for performing handwriting input on the captured image data,
Including
The control function instructions to capture the image data displayed on the display unit, instructions for transmitting the synthesized image data of the handwritten image data and captured the image data which has been handwritten input to the display device A plurality of instruction icons for receiving an instruction to receive the image data from the display device are displayed in a manner superimposed on the image data ,
The communication function, when the control function receives an instruction to receive the image data, transmits a transmission request of the image data to the display device ,
A program to make things happen.

Images