JP7279442B2 - Display device, display method, display program - Google Patents

Description

The present invention relates to a display device, a display method, and a display program.

In recent years, display devices that accept handwritten input on touch panel displays have become widespread. Also, in this display device, for example, a technique is known that associates a handwritten stroke image with a person who has input this stroke image.

As one of such techniques, there is conventionally known a technique for associating handwritten strokes written by a teacher and handwritten strokes written by a student with respect to a page or unit of an electronic teaching material.

When the conventional display device described above is used for a meeting or the like in an organization such as a company, it is possible to associate the stroke image with the person who has input the stroke image. Cannot be associated with the meeting that was being held.

An object of the technology disclosed herein is to enable identification of a conference being held when a stroke image is input.

The disclosed technology includes an input unit that receives an input of a stroke image, which is an image of the trajectory of each stroke input by handwriting with an electronic pen, and a conference that identifies the conference that was being held when the stroke image was input. a page generator that generates output data including specific information, pen information about the electronic pen, stroke information that indicates the stroke image , and capture image data obtained by capturing a screen of a display unit, and stores the output data in a storage unit; and a display control unit for displaying, on the display unit, a preview screen in which a selection column for selecting a value of an item included in at least one of the pen information and the meeting specifying information is superimposed on the captured image data. and, when receiving selection of the value of the item in the selection field, the display control unit causes the display unit to display only the stroke image indicated by the stroke information associated with the value of the selected item. It is a display device.

The conference that was being held when the stroke image was input can be identified.

It is a figure explaining an electronic blackboard. It is a figure which shows an example of the hardware constitutions of an electronic blackboard. It is a figure explaining the function structure of an electronic blackboard. It is a figure which shows an example of a meeting information storage part. It is a figure which shows the example of the screen which sets correspondence with a user ID and pen ID. FIG. 4 is a diagram for explaining a screen displayed on the display of the electronic blackboard; It is a figure which shows an example of PDF data. 10 is a flowchart for explaining processing for acquiring pen information using an electronic blackboard; FIG. 10 is a flowchart for explaining processing for displaying a specific stroke image on an electronic blackboard; FIG. FIG. 3 is a first diagram for explaining a display example on an electronic blackboard; FIG. 11 is a second diagram for explaining a display example on the electronic blackboard; FIG. 11 is a third diagram for explaining a display example on the electronic blackboard; It is a figure which shows an example of the system configuration|structure of the information processing system containing an electronic blackboard. It is a first diagram showing a modification of the information processing system. It is a second diagram showing a modification of the information processing system. It is a third diagram showing a modification of the information processing system.

This embodiment will be described below with reference to the drawings. FIG. 1 is a diagram for explaining an electronic blackboard.

The electronic blackboard 200 of this embodiment has a short-range communication circuit 219 , a power switch 222 and a display 280 . The electronic blackboard 200 of the present embodiment is one of the display devices that displays information shared by a plurality of people, for example, at a meeting or the like held in an organization such as a company.

When the electronic blackboard 200 of the present embodiment receives handwriting input of characters and images by the electronic pen 290 on the display 280, stroke image data indicating the characters and images, information specifying the user of the electronic pen 290, It is stored in association with conference information specifying the conference held at this time.

Therefore, according to the present embodiment, it is possible to identify the conference held when the stroke image was input and the user who input the stroke image. Note that the stroke image in this embodiment is an image of the trajectory of each stroke handwritten on the display 280 of the electronic blackboard 200 using the electronic pen 290 . Also, the electronic pen 290 is an example of input means for inputting a stroke image.

Further, in the present embodiment, when the conference participant A presses the power switch 222 when using the electronic blackboard 200 for a conference, the display control unit, which will be described later, may display a login screen on the display 280. . At this time, when participant A brings his/her own IC card 10 close to short-range communication circuit 219 of electronic blackboard 200 , electronic blackboard 200 reads the identification information of IC card 10 from IC card 10 .

Then, the electronic blackboard 200 associates the image displayed on the electronic blackboard 200 after reading the IC card 10 and the input stroke image data with the meeting information previously associated with the identification information of the IC card 10. Store.

As described above, in the present embodiment, by associating the participants of the conference with the conference information, the participants of the conference simply hold up the IC card 10 to display the conference information and the electronic blackboard 200 during the conference. It can be stored in association with shared information.

The hardware configuration of the electronic blackboard 200 of this embodiment will be described below with reference to FIG. FIG. 2 is a diagram showing an example of the hardware configuration of the electronic blackboard.
FIG. 2 is a hardware configuration diagram of the electronic blackboard. As shown in FIG. 2, the electronic blackboard 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, a network I/ F205 and an external device connection I/F (Interface) 206 are provided.

Among these, the CPU 201 controls the operation of the entire electronic blackboard 2 . The ROM 202 stores programs used to drive the CPU 201, such as the CPU 201 and an IPL (Initial Program Loader). A RAM 203 is used as a work area for the CPU 201 . The SSD 204 stores various data such as electronic blackboard programs.

A network I/F 205 controls communication with a communication network. The external device connection I/F 206 is an interface for connecting various external devices. The external devices in this case are, for example, a USB (Universal Serial Bus) memory 230 and external devices (microphone 240, speaker 250, camera 260).

The electronic blackboard 200 also includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, an antenna 219a of the short-range communication circuit 219, a power switch 222 and Selection switches 223 are provided.

Among these devices, the capture device 211 causes the display of an external PC (Personal Computer) 270 to display video information as a still image or moving image. A GPU (Graphics Processing Unit) 212 is a semiconductor chip that specializes in graphics.
The GPU 212 may be built in the CPU 201 or integrated with the CPU 201 .

The display controller 213 controls and manages screen display in order to output an output image from the GPU 212 to the display 280 or the like. The contact sensor 214 detects that the electronic pen 290 , the user's hand H, or the like touches the display 280 . A sensor controller 215 controls the processing of the contact sensor 214 .

The contact sensor 214 performs coordinate input and coordinate detection using an infrared shielding method. In this coordinate input and coordinate detection method, two light emitting/receiving devices installed at both ends of the upper side of the display 280 radiate a plurality of infrared rays in parallel with the display 280, and are provided around the display 280. This is a method of receiving light that is reflected by a reflecting member and returns along the same optical path as that of light emitted by a light receiving element. The contact sensor 214 outputs to the sensor controller 215 the IDs of the infrared rays emitted by the two light emitting/receiving devices blocked by the object, and the sensor controller 215 identifies the coordinate position, which is the contact position of the object.

The electronic pen controller 216 communicates with the electronic pen 290 to determine whether or not the display 280 has been touched with the tip of the pen or the bottom of the pen. The short-range communication circuit 219 is a communication circuit such as NF (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for switching ON/OFF of the power of the electronic blackboard 2 . The selection switches 223 are, for example, a group of switches for adjusting the brightness and color of the display on the display 280 .

Further, the electronic blackboard 2 has a bus line 210 . A bus line 210 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201 shown in FIG.

In addition, the contact sensor 214 is not limited to the infrared blocking type, but is a capacitive type touch panel that identifies the contact position by detecting changes in capacitance, and identifies the contact position by voltage changes of two opposing resistive films. Various detection means may be used, such as a resistive touch panel that detects an electromagnetic induction generated when a contact object touches the display unit and identifies the contact position. Further, the electronic pen controller 216 may determine whether or not the part of the electronic pen 290 gripped by the user or other parts of the electronic pen is touched, in addition to the tip and the pen butt of the electronic pen 290 .

Further, in the present embodiment, the camera 260 is an example of a proximity sensor that detects the proximity of the electronic pen 290 or the hand H to the display 280. A touch panel, an infrared sensor, or the like may be provided.

Next, with reference to FIG. 3, the functional configuration of the electronic blackboard 200 of this embodiment will be described. FIG. 3 is a diagram for explaining the functional configuration of the electronic blackboard.

The electronic blackboard 200 of this embodiment includes a page storage unit 310, a meeting information storage unit 315, a display control unit 320, an input unit 330, a meeting information management unit 340, a pen information acquisition unit 350, a page generation unit 360, and a stroke identification unit 370. have

The page storage unit 310 of this embodiment stores superimposed image data 311 , stroke image data 312 , page data 313 and PDF data 314 . The page storage unit 310 is implemented by, for example, the ROM 202, the RAM 203, the SSD 20204, and the like. Data stored in the page storage unit 310 of this embodiment is generated by the page generation unit 360 . Details of each data stored in the page storage unit 310 will be described later.

The conference information storage unit 315 stores information about conferences in which the electronic blackboard 200 is used. The details of the meeting information storage unit 315 will be described later.

The display control unit 320, for example, displays images output from a computer connected to the electronic blackboard 200, various files input to the electronic blackboard 200, and other electronic blackboards 200 installed at remote locations. An image or the like is displayed on the display 280 .

The input unit 330 of the present embodiment acquires stroke images representing characters and images handwritten on the display 280, image data of images displayed on the touch panel provided on the display 280, and the like.

The input unit 330 also acquires moving image data captured by the camera 260 and the like. In this embodiment, the moving image data is included in the image data. Input unit 330 also receives various instructions for electronic blackboard 200 . The input unit 330 also acquires input image data and the like that are output from the PC 270 and the like and input to the electronic whiteboard 200 .

The conference information management section 340 manages conference information stored in the conference information storage section 315 . Specifically, when a conference with the same title is held multiple times, information indicating the version of each conference is added.

The pen information acquisition unit 350 receives input of pen information regarding the electronic pen 290 , acquires the pen information, and stores it in the page storage unit 310 in association with the stroke image input by the electronic pen 290 . In other words, the pen information acquisition unit 350 acquires the pen information of the electronic pen 290 and stores it in the page storage unit 310 in association with the stroke information indicating the stroke image input with the electronic pen 290 . This pen information is stored in the page storage unit 310 as part of the PDF data 314 including stroke information.

Pen information is information associated with a stroke image input with the electronic pen 290 . Specifically, the pen information includes, for example, a pen ID that identifies the electronic pen 290, a user ID that identifies the user who uses the electronic pen 290, and a color and line thickness of a stroke image drawn with the electronic pen 290. including information that indicates Details of the pen information will be described later.

The page generation unit 360 of this embodiment acquires the superimposed image data 311 , the page data 313 and the PDF data 314 from the one-page image (display image) displayed on the display 280 . Further, the page generation unit 360 acquires the stroke image data 312 when a stroke image is input as an image of one page.

Specifically, the page generation unit 360 acquires image data of a superimposed image obtained by superimposing an input image, a stroke image, or the like input to the display 280 , and stores it in the page storage unit 310 as superimposed image data 311 . Note that the page generation unit 360 uses the image displayed on the display 280 as the superimposed image data when the stroke image is not input to the display 280 .

The superimposed image in this embodiment is a captured image obtained by capturing the screen of the display 280, and the superimposed image data is captured image data. In other words, the superimposed image is a display image displayed on the screen of display 280 , and the superimposed image data is display image data representing the display image displayed on the screen of display 280 .

Also, when a stroke image is input to the display 280 , the page generation unit 360 acquires image data of the stroke image and stores it in the page storage unit 310 as stroke image data 312 .

Further, the page generation unit 360 generates display page data for displaying the image from the image displayed on the display 280 , and stores it in the page storage unit 310 as page data 313 .

Further, the page generating unit 360 generates PDF data 314 by converting the superimposed image data 311 into the PDF format from the superimposed image data 311 , the stroke image data 312 and the page data 313 , and stores the PDF data 314 in the page storage unit 310 . do.

The PDF data 314 of this embodiment is image data in PNG (Portable Network Graphics) format generated from the superimposed image data and vector format generated from page data when stroke image data is included in the superimposed image data. stroke information.

Further, when stroke image data is included in the superimposed image data, the page generation unit 360 identifies the pen information acquired by the pen information acquisition unit 350 and the conference held when the stroke image data was input. meeting specific information to be included in the PDF data 314 .

Further, the PDF data 314 of this embodiment includes only PNG-format image data when the stroke image data is not included in the superimposed image data. The details of the PDF data 314 of this embodiment will be described later.

In this embodiment, the superimposed image data 311 includes, for example, page identification information (page ID) for identifying a page, and each of the superimposed image data 311, stroke image data 312, page data 313, and PDF data 314 is You may correspond by page ID. Details of the superimposed image data will be described later.

For example, when a page ID is selected and an operation is performed to display the page data of the selected page ID on the display 280, the electronic blackboard 200 of the present embodiment displays the PDF data 314 corresponding to the page ID. 280 to display. In other words, the PDF data 314 of this embodiment is output data displayed on the display 280 .

Stroke identifying section 370 identifies a stroke image to be displayed on display 280 in accordance with an operation received by input section 330 . The specified stroke image is displayed on display 280 by display control unit 320 .

The conference information storage unit 315 of this embodiment will be described below. FIG. 4 is a diagram illustrating an example of a meeting information storage unit;

The meeting information storage unit 315 of this embodiment has meeting ID, version, date, user ID, and pen ID as information items. In the meeting information storage unit 315, the item “meeting ID” is associated with other items. In the following description, information in which the value of the item "meeting ID" and the values of other items are associated is called meeting information. The meeting information of the present embodiment is, for example, information registered in the electronic whiteboard 200 in advance before the meeting is held.

The value of the item "meeting ID" is identification information that identifies the title of the conference, and the value of the item "version" indicates the number of times (version) that the conference with the title identified by the conference ID has been held. The value of the item "version" may be given by the conference information management unit 340, or may be input in advance by a conference participant or the like together with the conference title.

The value of the item "date" indicates the date on which the meeting identified by the meeting ID and version will be held.

That is, in this embodiment, the held conference is specified by the value of the item "meeting ID" and the value of the item "version". Therefore, the information that associates the conference ID with the version can be said to be conference identification information for identifying the conference.

In the example of FIG. 4, it can be seen that the first conference with the title indicated by the conference ID “001” was held on February 10, 2017.

The value of the item "user ID" is identification information that identifies a participant who participates in the conference. In other words, the value of the item “user ID” is the identification information of the user who will use the electronic blackboard 200 in the conference. The user ID may be information associated with the identification information of the IC card 10 of the participant, or may be the identification information of the IC card 10 itself.

The value of the item “pen ID” is identification information for identifying the electronic pen 290 and is given to the electronic pen 290 in advance. In this embodiment, for example, when a stroke image is input to the display 280 by the electronic pen 290 , the electronic pen 290 communicates with the electronic pen controller 216 and the electronic pen controller 216 acquires the pen ID of the electronic pen 290 .

The item “pen ID” and the item “user ID” may be associated with each other before the electronic pen 290 identified by the pen ID starts drawing a stroke image. Therefore, the pen ID and the user ID may be associated after the conference is held.

The correspondence between user IDs and pen IDs according to the present embodiment will be described below with reference to FIG. FIG. 5 is a diagram showing an example of a screen for setting associations between user IDs and pen IDs.

A screen 51 shown in FIG. 5 is an example of a screen displayed on the display 280, for example. On the screen 51, information 52 indicating the pen ID of the electronic pen 290, a user ID input field 53, and a setting button 54 are displayed.

For example, the display control unit 320 of the electronic whiteboard 200 receives an instruction to register the conference information by the input unit 330, and when the conference ID, the date, and the user IDs of the participants of the conference are registered among the conference information, the screen 51 is displayed. may be displayed on the display 280.

When the user ID is input to the input field 53 and the setting button 54 is selected on the screen 51, the input unit 330 associates the pen ID indicated by the information 52 with the input user ID to generate meeting information. Stored in the storage unit 315 .

Next, the superimposed image data 311 of this embodiment will be described with reference to FIG. The image indicated by the superimposed image data 311 of this embodiment is the image displayed on the display 280 .

FIG. 6 is a diagram for explaining a screen displayed on the display of the electronic blackboard. FIG. 6A is a diagram for explaining an image to be superimposed, and FIG. 6B is a diagram showing an example of the superimposed image.

In the electronic whiteboard 200 of the present embodiment, the display control unit 320 superimposes and displays an input image acquired by the input unit 330, a stroke image, a UI (User Interface) image, and a background image according to a predetermined layout. Let

Note that the UI image is a preset image. The background image is, for example, a plain image, an image including grid lines, or the like, and is media data included in the superimposed image.

As shown in FIG. 6, the display control unit 320 displays a layer 91 for displaying a UI image, a layer 92 for displaying a stroke image, and an input image output from the PC and input to the electronic blackboard 200. It has a layer 93 and a layer 94 for displaying a background image.

When the user of the electronic blackboard 200 views the display 280, the display control unit 320 of the present embodiment has the layer 91 as the first layer, the layer 92 as the second layer, the layer 93 as the third layer, and the layer 94 as the fourth layer. Each layer is superimposed so that it becomes an eye.

Then, the display control unit 320 synthesizes the image data of the UI image (UI image data), the stroke image data, the image data of the input image (input image data), and the image data of the background image (background image data). Image data of a four-layer superimposed image 90 is generated.

In other words, the superimposed image in this embodiment is an image obtained by synthesizing the images displayed on each layer of the display 280 .

The page generation unit 360 of this embodiment generates PDF data 314 by converting the superimposed image data 311 representing the superimposed image into PDF format. Further, the page generation unit 360 of the present embodiment includes the pen information acquired by the pen information acquisition unit 350 in the PDF data 314 when generating the PDF data 314 . In other words, the page generator 360 generates PDF data 314 including pen information.

The PDF data 314 of this embodiment will be described below with reference to FIG. FIG. 7 is a diagram showing an example of PDF data.

The PDF data 314 of this embodiment includes pen information 380 acquired by the pen information acquisition unit 350 .

The PDF data 314 of this embodiment has page ID, PNG image data, stroke ID, stroke information, pen ID, user ID, thickness, color, meeting ID, version, etc. as information items. , the item “page ID” and other items are associated with each other.

Among the information items included in the PDF data 314 of this embodiment, the items “pen ID”, “user ID”, “thickness”, and “color” are also information items of the pen information 380 .

Among the information items included in the PDF data 314 of this embodiment, the items “meeting ID” and “version” are also information items of the meeting information stored in the meeting information storage unit 315 .

That is, the PDF data 314 includes pen information 380 and part of the meeting information 315a. The pen information 380 has pen ID, user ID, thickness, and color as information items, and a part of meeting information 315a includes meeting ID and version as information items. Part 315a of the conference information included in the PDF data 314 is conference identification information for identifying the conference.

The value of the item “page ID” is page identification information for identifying a page. The value of the item “PNG image data” is image data in PNG format. The value of the item “stroke ID” is identification information for identifying a stroke image, which is assigned to each stroke image input with the electronic pen 290 .

The value of the item "stroke information" is information indicating a coordinate group for drawing a stroke image. Specifically, the value of the item “stroke information” is vector format information generated from the page data.

The value of the item “pen ID” is the pen ID of the electronic pen 290 that has input the stroke image specified by the stroke ID. The value of the item “user ID” indicates the user ID associated with the pen ID in the meeting information storage unit 315 . The value of the item "color" indicates the color of the stroke image specified by the stroke ID.

The value of the item "thickness" indicates the thickness of the stroke image specified by the stroke ID. In the example of FIG. 7, when the value of the item "thickness" is "True", the stroke image is a stroke image drawn as a bold stroke, and the value of the item "thickness" is "False". , then the image was a stroke image with no boldface specified. The value of the item "color" indicates the color of the stroke image specified by the stroke ID.

In the example of FIG. 7, it can be seen that the PNG format image data specified by the page ID "p001" is the image data G1. Also, it can be seen that the superimposed image indicated by the image data G1 includes the stroke images specified by the stroke IDs "10" to "14". Furthermore, in the example of FIG. 7, it can be seen that the stroke image with the stroke ID "10" was drawn in bold black by the user with the user ID "A" using the electronic pen 290 with the pen ID "1". .

Furthermore, it can be seen that the user with the user ID "A" who drew the stroke image with the stroke ID "10" drew this stroke image in the conference specified by the conference ID "001" and the version "1".

In this embodiment, as described above, by including the pen information 380 in the PDF data 314, only stroke images drawn by a specific user are displayed, or only stroke images drawn in a specific color are displayed. can be

Further, in this embodiment, the PDF data 314 includes part of the conference information 315a for identifying the conference, thereby identifying the conference that was being held when the stroke image included in the PDF data 314 was drawn. can do.

Note that the electronic blackboard 200 of the present embodiment displays the PDF data 314 of the page ID “p001” on the display 280, for example, when the input unit 330 receives an instruction to display the page ID “p001”.

Then, when a new stroke image is input to the PDF data 314 displayed on the display 280, the electronic whiteboard 200 updates the value of the item "version" in the PDF data 314 to create a new PDF. Generate data 314 .

For example, assume that the PDF data 314 with the page ID "p001" in FIG. 7 is displayed on the display 280 and a new stroke image with the stroke ID "20" is drawn. In this case, when the electronic blackboard 200 generates the new PDF data 314 to which the stroke image is added by the page generation unit 360, the value of the item “meeting” is the meeting of the PDF data 314 with the page ID “p001”. ID, and only the value of the item "version" is updated.

In this embodiment, by managing the PDF data 314 in this manner, stroke images can be specified for each version of the conference.

The operation of the electronic blackboard 200 of this embodiment will be described below with reference to FIGS. 8 and 9. FIG. First, the process of acquiring and storing pen information will be described with reference to FIG.

FIG. 8 is a flowchart for explaining the process of acquiring pen information using the electronic blackboard.

In the electronic blackboard 200 of the present embodiment, when the input unit 330 detects the start of drawing a stroke image with the electronic pen 290 (step S801), the conference information management unit 340 adds version is given (step S802).

Specifically, in the conference information stored in the conference information storage unit 315, the conference information management unit 340 updates the value of the latest version among the values of the versions corresponding to the conference ID, and adds the updated value to the new conference. Assign to ID. The conference ID is specified from the identification information of the IC card 10 held up by the participants in advance when the conference using the electronic blackboard 200 is held.

Subsequently, the electronic blackboard 200 determines whether or not the user ID is associated with the pen ID of the electronic pen 290 by the pen information acquisition unit 350 (step S803). In step S803, if the pen ID and the user ID are not associated, the pen information acquisition unit 350 waits until the pen ID is associated with the user ID. At this time, the pen information acquisition section 350 may cause the display control section 320 to display the screen 51 shown in FIG. 5 on the display 280 .

At this time, if the pen information acquisition unit 350 receives an operation instructing not to associate the user ID with the pen ID, the process may proceed to step S804, which will be described later.

In step S803, if the pen ID and the user ID are associated with each other, the pen information acquisition unit 350 associates the user ID and the pen ID with the conference ID, and stores the pen information in the page storage unit 310. It is held as a part (step S804).

Subsequently, the electronic blackboard 200 determines whether or not the input unit 330 has received an operation to select a pen color (step S805). If the corresponding operation is not accepted in step S805, the electronic blackboard 200 proceeds to step S807, which will be described later.

In step S805, when the corresponding operation is received, the electronic blackboard 200 acquires information indicating the selected color by the pen information acquisition unit 350, and as part of the pen information associated with the pen ID, It is held in the page storage unit 310 (step S806).

Subsequently, the electronic blackboard 200 determines whether or not the input unit 330 has received an operation to select the thickness of the stroke image (step S807). If the corresponding operation is not accepted in step S807, the electronic whiteboard 200 proceeds to step S809, which will be described later.

In step S807, when the corresponding operation is accepted, the electronic blackboard 200 causes the pen information acquisition unit 350 to associate the information indicating the thickness with the pen ID and hold it in the page storage unit 310 as part of the pen information. (Step S808). Note that in the present embodiment, the information indicating the thickness may be information indicating whether or not the stroke image should be bold.

Subsequently, the electronic blackboard 200 acquires stroke information indicating a stroke image drawn with the electronic pen 290 (step S809).

Subsequently, the electronic blackboard 200 associates the pen information acquired by the pen information acquisition unit 350 with the stroke information and stores them in the page storage unit 310 (step S810), and ends the process.

In this embodiment, the process of FIG. 8 is executed each time the input unit 330 accepts input of a stroke image. When the electronic blackboard 200 receives an operation to switch pages, the page generating section 360 generates PDF data 314 including the pen information 380 and a part of the meeting information 315a, and stores the generated PDF data 314 in the page storage section 310 .

Next, with reference to FIG. 9, processing for displaying a specific stroke image on the electronic blackboard 200 of the present embodiment will be described. FIG. 9 is a flowchart for explaining processing for displaying a specific stroke image on the electronic blackboard.

For example, when the electronic blackboard 200 of the present embodiment receives a page ID specification and a display instruction, the display control unit 320 causes the display control unit 320 to include the specified page ID out of the PDF data 314 stored in the page storage unit 310. The PDF data 314 is displayed on the display 280 as a preview screen (step S901).

At this time, the display control unit 320 displays selection columns for pen information and meeting information included in the PDF data 314 on the preview screen. The pen information selection fields are, for example, selection fields for selecting a user ID, thickness, and color. The conference information selection field is, for example, a selection field for selecting the version of the conference.

Subsequently, the electronic blackboard 200 determines whether or not the user ID has been selected in the selection column by the input unit 330 (step S902). In step S902, if no user ID has been selected, the electronic blackboard 200 proceeds to step S905, which will be described later.

In step S902, when the user ID is selected, the electronic blackboard 200 causes the stroke identification unit 370 to determine the stroke corresponding to the selected user ID from the pen information 380 included in the PDF data 314 displayed on the display 280. ID is specified (step S903).

Subsequently, the electronic blackboard 200 causes the display control unit 320 to display only the stroke image indicated by the specified stroke ID on the display 280 (step S904).

Next, the electronic blackboard 200 determines whether or not a color has been selected in the selection column by the input unit 330 (step S905). In step S902, if no color has been selected, the electronic blackboard 200 proceeds to step S908, which will be described later.

In step S905, when a color is selected, the electronic blackboard 200 causes the stroke identification unit 370 to determine the stroke ID corresponding to the selected color from the pen information 380 included in the PDF data 314 displayed on the display 280. Identify (step S906).

Subsequently, the electronic blackboard 200 causes the display control unit 320 to display only the stroke image indicated by the specified stroke ID on the display 280 (step S907).

Next, the electronic blackboard 200 determines whether or not the thickness has been selected in the selection field by the input unit 330 (step S908). If the thickness is not selected in step S908, the electronic blackboard 200 proceeds to step S911, which will be described later.

In step S908, when the thickness is selected, the electronic blackboard 200 causes the stroke identification unit 370 to determine the stroke ID corresponding to the selected thickness from the pen information 380 included in the PDF data 314 displayed on the display 280. is specified (step S909).

Subsequently, the electronic blackboard 200 causes the display control unit 320 to display only the stroke image indicated by the specified stroke ID on the display 280 (step S910).

Next, the electronic blackboard 200 determines whether or not the conference version is selected in the selection column by the input unit 330 (step S911). In step S911, if the conference version is not selected, the electronic whiteboard 200 ends the process.

In step S 911 , when the conference version is selected, the electronic whiteboard 200 uses the stroke identification unit 370 to select the selected conference version from part of the conference information included in the PDF data 314 displayed on the display 280 . and the corresponding stroke ID is specified (step S912).

Subsequently, the electronic blackboard 200 causes the display control unit 320 to display only the stroke image indicated by the specified stroke ID on the display 280 (step S913), and ends the process.

Display examples on the electronic whiteboard 200 of the present embodiment will be described below with reference to FIGS. 10 and 11. FIG. FIG. 10 is a first diagram for explaining a display example on the electronic blackboard.

A screen 101 shown in FIG. 10 is an example of a preview screen displayed on the display 280 . A screen 101 displays a superimposed image in which an output image 105 and stroke image groups 103 and 104 are superimposed.

The screen 101 also displays the values of the items included in the pen information 380, the values of the items included in the part 315a of the meeting information (meeting specific information), and a selection column 102 for selection. The selection column 102 includes selection boxes 102-1, 102-2, 102-3 and 102-4.

The selection box 102-1 is a selection box for selecting the conference ID and the corresponding user ID included in the PDF data 314 corresponding to the superimposed image data displayed on the screen 101. FIG. That is, the selection box 102-1 is a selection column for selecting the value of the item “user ID” included in the pen information 380 included in the PDF data 314. FIG.

The selection box 102-2 is for selecting the color of the stroke image, and the selection box 102-3 is for selecting the bold stroke image. That is, the selection box 102-2 is a selection column for selecting the value of the item "color" of the pen information 380, and the selection box 102-3 is used to select the value of the item "thickness" of the pen information 380. This is a selection column for

A selection box 102-4 is a selection box for selecting the version corresponding to the conference ID included in the PDF data 314 corresponding to the superimposed image data displayed on the screen 101. FIG. In other words, the selection box 102-4 is a selection field for selecting the value of the item "version" of the meeting identification information. Note that the conference ID may be displayed together with the version in the selection box 102-4.

FIG. 11 is a second diagram for explaining a display example on the electronic blackboard. 11A shows a display example when a user ID is selected in selection field 102 of screen 101, and FIG. 11B shows a display example when red is selected in selection field 102 of screen 101. 4 shows an example of display in this case.

On the screen 101A shown in FIG. 11A, user ID "A" is selected. Therefore, of the stroke images included in the superimposed image displayed on the screen 101, only the stroke images whose stroke ID is associated with the user ID "A" are displayed on the screen 101A.

Since the stroke image group 103 and the stroke image group 104 are displayed on the screen 101A, it can be seen that the stroke images included in these stroke image groups were drawn by the user with the user ID "A".

Further, "red" is selected on the screen 101B shown in FIG. 11(B). Therefore, of the stroke images included in the superimposed image displayed on the screen 101, the stroke image drawn in red is displayed on the screen 101B. Since only the stroke image group 104 is displayed on the screen 101B, it can be seen that the stroke images drawn in red are only the stroke images included in the stroke image group 104. FIG.

As described above, in the present embodiment, pen information related to the electronic pen 290 that drew the stroke image is stored in association with the stroke image.

Further, in the present embodiment, the stroke image is stored in association with the conference held when the stroke image was drawn.

Therefore, in the present embodiment, it is possible to identify the conference at which the stroke image drawn with the electronic pen 290 was drawn and the user who drew the stroke image.

In this embodiment, for example, the PDF data 314 including only stroke information indicating the stroke images displayed on the screen 101A and the screen 101B may be newly generated and stored in the page storage unit 310. FIG.

Further, in this embodiment, for example, when an operation for selecting a stroke image is received, pen information corresponding to the selected stroke image may be displayed on the display 280 .

FIG. 12 is a third diagram showing a display example on the electronic blackboard. On the screen 101C shown in FIG. 12, a stroke image included in the stroke image group 103 is selected, and a display field 106 is displayed near the selected stroke image.

The display field 106 displays pen information 380 corresponding to the selected stroke image. In the example of FIG. 12, the display field 106 displays, as the pen information, the user ID "A" and "emphasis" indicating that the boldface type has been selected.

Thus, in this embodiment, when a stroke image is selected, pen information regarding the electronic pen 290 that has drawn the stroke image can be displayed. The screen 101C may be a screen displayed on the display 280 during the conference, or may be a screen displayed on the display 280 as a preview screen.

Further, the electronic blackboard 200 of this embodiment may be included in a system that communicates with a server device.

FIG. 13 is a diagram showing an example of a system configuration of an information processing system including an electronic blackboard. The information processing system 500 has an electronic blackboard (electronic information board) 200 and a server device 550 . In information processing system 500, electronic blackboard 200 and server device 550 are connected via a network.

In the information processing system 500 of the present embodiment, the electronic blackboard 200 includes content data including each data stored in the page storage unit 310 by the page generation unit 360 and audio data collected by a sound collecting device such as a microphone. is sent to the server device 550 . Content data may be stored at the server device 550 .

Further, the electronic blackboard 200 may acquire the content data from the server device 550 when receiving the display instruction of the content data.

Further, the electronic whiteboard 200 can communicate with a plurality of terminal devices, and may acquire image data and audio data from each terminal device. In this case, the image displayed on the electronic blackboard 200 may be shared by a plurality of terminal devices, and the electronic blackboard 200 becomes a shared terminal that displays a screen shared by the plurality of terminal devices.

Next, a modified example of the information processing system described above will be described with reference to FIGS. 14 to 16. FIG.

FIG. 14 is a first diagram showing a modification of the information processing system. The example of FIG. 14 has a terminal device 600 , an image projection device 700 and a pen motion detection device 810 instead of the electronic blackboard 200 .

The terminal device 600 is connected to the image projection device 700 and the pen motion detection device 810 by wire.

The image projection device 700 projects image data input from the terminal device 600 onto the screen 800 .

The pen motion detection device 810 communicates with the electronic pen 820 and detects motion of the electronic pen 820 in the vicinity of the screen 800 . Specifically, the electronic pen 820 detects coordinate information indicating a point indicated by the electronic pen 820 on the screen 800 and transmits the coordinate information to the terminal device 600 .

Terminal device 600 generates stroke image data representing a stroke image input by electronic pen 820 based on the coordinate information received from pen motion detection device 810 , and causes image projection device 700 to draw the stroke image on screen 800 .

The terminal device 600 also generates page data including superimposed image data representing the image projected by the image projection device 700 and transmits the page data to the server device 550 .

FIG. 15 is a second diagram showing a modification of the information processing system. In the example of FIG. 13, instead of the electronic blackboard 200, a terminal device 600, a display 800A, and a pen motion detection device 810 are provided.

Pen motion detection device 810 is arranged near display 800 A, detects coordinate information indicating a point indicated by electronic pen 820 A on display 800 A, and transmits the information to terminal device 600 . In the example of FIG. 13, the electronic pen 820A may be charged by the terminal device 600 via a USB connector.

Terminal device 600 generates image data of a stroke image input by electronic pen 820A based on the coordinate information received from pen motion detection device 810, and displays it on display 800A.

In addition, the terminal device 600 of the present embodiment generates page data including superimposed image data representing an image projected by the image projection device 700 and transmits the generated page data to the server device 550 .

FIG. 16 is a third diagram showing a modification of the information processing system. The example of FIG. 14 has a terminal device 600 and an image projection device 700 instead of the electronic blackboard 200 .

The terminal device 600 performs wireless communication (such as Bluetooth) with the electronic pen 820B and receives coordinate information of a point indicated by the electronic pen 820B on the screen 800. FIG. Based on the received coordinate information, the terminal device 600 generates image data of the stroke image input by the electronic pen 820B, and causes the image projection device 700 to project the stroke image on the screen 800. FIG.

The terminal device 600 also generates page data including superimposed image data representing the image projected by the image projection device 700 and transmits the page data to the server device 550 .

As described above, each embodiment described above can be applied in various system configurations.

Each function of the embodiments described above may be implemented by one or more processing circuits. Here, the "processing circuit" in this specification means a processor programmed by software to perform each function, such as a processor implemented by an electronic circuit, or a processor designed to perform each function described above. devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays) and conventional circuit modules.

Note that the device to which the present embodiment is applied is not limited to the electronic whiteboard 200 as long as it is a display device having a function of operating an object by touch operation. Devices to which the present embodiment is applied include, for example, PJ (Projector: projector), output devices such as digital signage, HUD (Head Up Display) devices, network home appliances, automobiles (Connected Cars), notebook PCs (Personal Computers), A mobile phone, a smart phone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a wearable PC, or the like may be used.

Moreover, the devices described in the embodiments are only representative of one of several computing environments for implementing the embodiments disclosed herein.

In some embodiments, the first apparatus includes multiple computing devices, such as a server cluster. Multiple computing devices are configured to communicate with each other over any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, the second apparatus may include multiple computing devices configured to communicate with each other.

Further, the first device and the second device can be configured to share the steps of the processes shown in Figures 8 and 9 in various combinations. For example, a process performed by a given unit may be performed by a second device. Likewise, the functions of a given unit can be performed by a second device. Also, each element of the first device and the second device may be integrated into one server device, or may be divided into a plurality of devices.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without impairing the gist of the present invention, and can be determined appropriately according to the application form.

200 electronic blackboard 280 display 290 electronic pen 310 page storage unit 315 meeting information storage unit 320 display control unit 330 input unit 340 meeting information management unit 350 pen information acquisition unit 360 page generation unit 370 stroke identification unit

JP 2013-232149 A

Claims (8)

an input unit that receives an input of a stroke image, which is an image of the trajectory of each stroke input by handwriting with an electronic pen;
Meeting specifying information specifying the meeting held when the stroke image was input, pen information related to the electronic pen, stroke information indicating the stroke image , and captured image data obtained by capturing the screen of the display unit. a page generation unit that generates output data including, and stores in a storage unit ;
a display control unit that causes the display unit to display a preview screen in which a selection field for selecting a value of an item included in at least one of the pen information and the meeting identification information is superimposed on the captured image data. ,
The display control unit
A display device that causes the display unit to display only a stroke image indicated by stroke information associated with the value of the selected item when the selection of the value of the item is accepted in the selection field. The pen information is
3. The items include a user ID of a user who uses the electronic pen, information indicating the color of the stroke image drawn with the electronic pen, and information indicating the thickness of the stroke image drawn with the electronic pen. 1. The display device according to 1. The meeting identification information is
3. The display device according to claim 1, wherein said items include a conference ID for identifying a title of said conference, and information indicating the number of times a conference having a title specified by said conference ID has been held. The page generation unit
4. The display device according to claim 3, which generates output data including only stroke information associated with the value of the selected item. The display control unit
5. The pen information associated with the stroke information indicated by the stroke image is displayed in the vicinity of the selected stroke image when the stroke image displayed on the display unit is selected. 1. The display device according to item 1. The page generation unit
Acquiring the captured image data in which the inputted input image and the stroke image are superimposed;
6. The display device according to any one of claims 1 to 5, wherein the captured image data is converted into PDF format to generate output data. A display method using a display device, the display device comprising:
Receiving an input of a stroke image, which is an image of the trajectory of each stroke input by handwriting with an electronic pen,
Meeting specifying information specifying the meeting held when the stroke image was input, pen information related to the electronic pen, stroke information indicating the stroke image , and captured image data obtained by capturing the screen of the display unit. , and store it in the storage unit,
causing the display unit to display a preview screen superimposed on the captured image data with a selection field for selecting a value of an item included in at least one of the pen information and the meeting specifying information;
The display method, wherein when the selection of the value of the item is accepted in the selection column, only the stroke image indicated by the stroke information associated with the value of the selected item is displayed on the display unit. Receiving an input of a stroke image, which is an image of the trajectory of each stroke input by handwriting with an electronic pen,
Meeting specifying information specifying the meeting held when the stroke image was input, pen information relating to the electronic pen, stroke information indicating the stroke image , and captured image data obtained by capturing the screen of the display unit. , and store it in the storage unit,
causing a display unit to display a preview screen in which a selection field for selecting a value of an item included in at least one of the pen information and the meeting identification information is superimposed on the captured image data;
A display program for causing a computer to execute a process of displaying only the stroke image indicated by the stroke information associated with the value of the selected item on the display unit when the selection of the value of the item is accepted in the selection field. .

Images