JP6935744B2 - Data sharing system, information processing device, program, data sharing method - Google Patents

Description

The present invention relates to a data sharing system, an information processing device, a program, and a data sharing method.

High-performance ICT (Information and Communication Technology) equipment has become widespread among individuals, and an increasing number of users are bringing in ICT equipment even in situations where information is shared such as lectures and conferences. Since materials for lectures and conferences are distributed to ICT devices, users can share information in the form of browsing electronic materials at hand. The user can also write supplementary information in the material by using the touch panel function of the ICT device.

As a method of using such an ICT device, there is a form in which feedback is transmitted to the presenter (see, for example, Patent Document 1). Patent Document 1 discloses a feedback information processing system that records the state of the presenter in real time, the participants give feedback in real time, and the presenter can grasp the content of the feedback in real time.

However, with the conventional technology, there is a problem that it is difficult to give concrete feedback to the presentation. That is, in Patent Document 1, only uniform indications such as good or bad are fed back, and participants point out any point of the material and feed back their intentions such as how good or bad. Can't.

In view of the above problems, an object of the present invention is to provide a system capable of giving specific feedback to a presentation.

The present invention is a data sharing system in which a first device transmits image data to one or more second devices, wherein the second device refers to the image data received from the first device. An operation receiving means for accepting drawing by the pointing device, a stroke data generating means for generating stroke data including at least the position, which is thicker as the position of the pointing device stays for a long time, and the above. A second display control means that superimposes a stroke of thickness on the image data and displays it on the display device, and a second communication means that transmits the stroke data generated by the stroke data generation means to the first device. Have.

It is possible to provide a system that can provide specific feedback on the presentation.

It is an example of the figure explaining the outline of the data sharing system. This is an example of a schematic configuration diagram of a data sharing system. This is an example of a schematic hardware configuration diagram of the server. This is an example of a hardware configuration diagram of an electronic blackboard. This is an example of a functional block diagram showing the functions of the explainer terminal, the terminal device, and the server in the data sharing system in a block shape. This is an example of a diagram for explaining a distribution screen created by the screen creation unit of the server according to the screen style. It is a figure which shows an example of the explanatory material designation screen for the explainer or the audience to specify the explanatory material in the past mode. It is an example of the figure explaining the handwriting method of a stroke. It is an example of the figure explaining the position information of a stroke. This is an example of a diagram illustrating a method for the audience to specify the shape of the stroke. This is an example of a sequence diagram showing the overall operation procedure of the data sharing system in the real-time mode. This is an example of a sequence diagram showing a schematic operation procedure of the data sharing system 100 in the past mode. It is a figure which shows an example of the image data and a stroke displayed by the explainer terminal. It is a figure which shows the screen example which the stroke for each audience is displayed together with the image data which was displayed as a thumbnail. It is an example of the figure explaining the color of the overlapping stroke. It is an example of the figure explaining the overlap of strokes of different colors. This is an example of a flowchart showing a procedure in which the display control unit determines the color of the overlapping portion.

Hereinafter, as an example of the embodiment for carrying out the present invention, the data sharing system and the data sharing method performed by the data sharing system will be described with reference to the drawings.

<Overview of the data sharing system of this embodiment>
In the data sharing system 100 of the present embodiment, the explanatory material 8 and the audience 9 share the explanatory material by distributing the image data of the explanatory material explained by the explanatory material 8 to the terminal device 30 owned by the audience 9. The audience 9 can specify the position and attributes of the image data of the explanatory material and feed back the impression of the explanatory material to the explanatory material 8.

FIG. 1 is an example of a diagram illustrating an outline of the data sharing system 100 of the present embodiment. The explainer terminal 10 of the explainer 8 displays the image data of the explanatory material, but the illustrated material is only an example, and the content of the explanatory material may change depending on the situation in which the information is shared.
(1) The explainer terminal 10 of the explainer 8 transmits the image data of the explanatory material to the server 50.
(2) The server 50 transmits the image data to the terminal device 30 of each audience 9 in real time.
(3) Each audience 9 fills in an arbitrary stroke 7 (handwritten information) in the explanatory material. The audience 9 can easily adjust the thickness of the stroke 7. The stroke 7 is preferably translucent. In FIG. 1, it is assumed that the audience 9B handwritten. A predetermined audience 9 out of a plurality of audience 9s is indicated by an alphabet. The terminal device 30 of the audience 9B transmits the stroke 7 to the server 50.
(4) The stroke 7 of the audience 9B is stored in the server 50, and is transmitted to the explainer terminal 10 which is set to display the stroke 7 of the audience 9B on the own terminal. In FIG. 1, the stroke 7 is transmitted only to the explainer terminal 10, but it can also be transmitted to another audience 9A.

With the above procedure, the stroke 7 of each audience 9 is displayed in the explanatory material of the explainer terminal 10. In this way, the explainer 8 can obtain feedback from the audience on the explanatory material in real time.

Audience 9 can, for example, change the thickness so that the feedback is noticeable or less noticeable. The explainer 8 can grasp the degree (strength) of feedback to the explanatory material by the attribute of thickness. In addition, if there is a rule that the feedback that is good for the explanatory material is entered in the blue color and the feedback that is bad is entered in the stroke 7 of the red color, the explainer 8 describes the content of the feedback for the explanatory material with the attribute of color. Can be grasped. In addition, the explainer 8 can grasp the feedback on the material by the attribute of the shape such as "○".

As described above, in the data sharing system 100 of the present embodiment, since the audience fills in the stroke 7 having the position and the attribute for the explanatory material of the explanatory material 8, the audience 9 points to an arbitrary point of the explanatory material. , How good or bad, etc. can be fed back.

<Terminology>
The position is not just a point, but is close to the meaning of a part / area that can be indicated by the pronoun "here".

Further, the attributes of the stroke 7 may be not only the thickness, color, shape, etc., but also the presence / absence of blinking, the line type such as a dotted line, the transparency, and the like.

In addition, handwriting refers to information drawn by freehand. In addition to directly including information drawn with a finger, it also includes information drawn with a mouse or pen.

<System configuration example>
FIG. 2 is an example of a schematic configuration diagram of the data sharing system 100 of this embodiment. The data sharing system 100 includes a server 50 connected via a network N, an explainer terminal 10, and one or more terminal devices 30.

The network N is constructed by a LAN constructed at a base where the explainer terminal 10 and the terminal device 30 are installed, a provider network of a provider that connects the LAN to the Internet, a line provided by a line operator, and the like. Has been done. When the network N has a plurality of LANs, the network is called a WAN or the Internet. The size of the network N is also affected by whether the server 50 is installed inside or outside the facility. In addition, VPN (Virtual Private Network) and wide area Ethernet (registered trademark) may be included. The network N may be constructed either wired or wireless, and may be a combination of wired and wireless. Further, when connected by a mobile phone network such as 3G, LTE (Long Term Evolution), 4G, LAN may not be required.

The server 50 is an information processing device that processes information acquired from the explainer terminal 10 and the terminal device 30 and transmits the information to the explainer terminal 10 and the terminal device 30. Generally, the server 50 is a device that provides some data or some processing result in response to a request from a client device (explainer terminal 10 and terminal device 30 in FIG. 2) connected via a network. The server 50 processes the image data acquired from the explainer terminal 10 into a mode required by each terminal device 30 and transmits the stroke 7 acquired from the terminal device 30 to the explainer terminal 10 and the terminal. It is transmitted to the device 30 that displays the stroke 7.

The explainer terminal 10 is an information processing device that transmits image data of explanatory materials to the server 50. Further, the person who operates the explainer terminal 10 is the explainer 8, and it does not matter whether or not the explanation is actually performed. The explainer terminal 10 may have a function of transmitting image data of explanatory materials, and is, for example, a general PC (Personal Computer), a tablet terminal, a smartphone, a wearable PC such as a wristwatch type or a sunglasses type. Further, the explainer terminal 10 may be an electronic blackboard, or an electronic blackboard may be connected to the explainer terminal 10. The electronic blackboard has at least a touch panel, and the handwritten content drawn by the user is captured as the coordinates of the points and displayed on a large display. In addition, the function of displaying the screen displayed by the PC connected to the PC on the electronic blackboard, the function of saving the screen of the PC displayed on the electronic blackboard and the handwritten content, and sharing the handwritten content with other electronic blackboards in remote locations. It has functions and so on.

When the explainer terminal 10 is an electronic blackboard, the PC of the explainer 8 is connected to the electronic blackboard, and the image data displayed by the PC is displayed on the electronic blackboard. The electronic blackboard transmits this image data to the server 50. Therefore, the image data can be shared even if the explainer terminal 10 is an electronic blackboard.

The terminal device 30 is an information processing device that receives image data of explanatory materials from the server 50. The person who operates the terminal device 30 is called an audience 9. That is, the terminal device 30 shares image data with the explainer terminal 10 and other terminal devices 30. The terminal device 30 further receives handwriting for the image data and transmits it to the server 50 as a stroke 7. The terminal device 30 may have a function of displaying image data of explanatory materials, accepting handwriting, and transmitting stroke data to the server 50. For example, a general PC, tablet terminal, smartphone, wristwatch type, or sunglasses type. A wearable PC or the like may be used. Further, the terminal device 30 may be an electronic blackboard.

As described above, both the explainer terminal 10 and the terminal device 30 may be information processing devices, and one of the terminal devices 30 can be the explainer terminal 10. Further, the explainer terminal 10 and the terminal device 30 may be switched during a meeting or a lesson, and the terminal device 30 for transmitting image data may be the explainer terminal 10.

<Hardware configuration example>
<< Server >>
FIG. 3 is an example of a schematic hardware configuration diagram of the server 50. The server 50 includes a CPU 201 and a memory 202 that enables high-speed access to data used by the CPU 201. The CPU 201 and the memory 202 are connected to other hardware elements of the server 50, such as the graphics driver 204 and the network driver (NIC) 205, via the system bus 203.

The graphics driver 204 is connected to the LCD (Liquid Crystal Display) 206 via a bus to monitor the processing result by the CPU 201. LCD 260 is an example of a display device. Further, the network driver 205 connects the server 50 to the network N at the transport layer level and the physical layer level, and establishes a session between the explainer terminal 10 and the terminal device 30.

An I / O bus bridge 207 is further connected to the system bus 203. On the downstream side of the I / O bus bridge 207, a storage device such as an HDD (hard disk drive) 209 is used by IDE, ATA, ATAPI, Serial ATA, SCSI, USB, etc. via an I / O bus 208 such as PCI. Is connected. HDD 209 stores a program 209p that controls the entire server 50. HDD 209 may be SSD (Solid State Drive).

Further, an input device 210 such as a keyboard and a mouse (called a pointing device) is connected to the I / O bus 208 via a bus such as USB, and receives inputs and commands by an operator such as a system administrator. There is.

It should be noted that the hardware configuration of the server 50 shown in the figure does not need to be housed in one housing or provided as a group of devices, and shows a hardware element that is preferable to be provided in the server 50. .. Further, in order to support cloud computing, the physical configuration of the server 50 of this embodiment does not have to be fixed, and is configured by dynamically connecting and disconnecting hardware resources according to the load. May be done.

<< Hardware configuration of electronic blackboard >>
Subsequently, the hardware configuration of the electronic blackboard will be described with reference to FIG. 4 when the explainer terminal 10 of the present embodiment is the electronic blackboard 2. Note that FIG. 4 is a hardware configuration diagram of the electronic blackboard 2.

As shown in FIG. 4, the electronic blackboard 2 is a CPU 101 that controls the operation of the entire electronic blackboard 2, a ROM 102 that stores a program used to drive the CPU 101 such as an IPL, and a RAM 103 that is used as a work area of the CPU 101. , SSD 104 that stores various data such as programs for the electronic blackboard 2, a network controller 105 that controls communication with the network N, and an external storage controller 106 that controls communication with the USB memory 5.

Further, the electronic blackboard 2 displays a capture device 111 that displays video information as a still image or a moving image on the display of the notebook PC 6, a GPU (Graphics Processing Unit) 112 that specializes in graphics, and an output image from the GPU. It includes a display controller 113 that controls and manages a screen display for output to the display 3 and the video conference terminal 70.

Further, the electronic blackboard 2 includes a sensor controller 114 that controls the processing of the contact sensor 115, and a contact sensor 115 that detects that the electronic pen 4 or the user's hand H or the like touches the display 3. The contact sensor 115 inputs coordinates and detects coordinates by an infrared blocking method. In the method of inputting the coordinates and detecting the coordinates, two light receiving and emitting devices installed at both upper ends of the display 3 radiate a plurality of infrared rays in parallel with the display 3 and are provided around the display 3. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the light path emitted by the light receiving element. The contact sensor 115 outputs an infrared ID (Identification) emitted by two light emitting / receiving devices blocked by the object to the sensor controller 114, and the sensor controller 114 identifies a coordinate position which is a contact position of the object. All the IDs shown below are examples of identification information.

Further, the contact sensor 115 is not limited to the infrared blocking method, but is a touch panel of the capacitance type that identifies the contact position by detecting a change in capacitance, and the contact position is determined by a voltage change of two opposing resistance films. Various detection means such as a touch panel of the resistance film type to be specified and a touch panel of the electromagnetic induction type which detects the electromagnetic induction generated by the contact object coming into contact with the display unit and specifies the contact position may be used.

Further, the electronic blackboard 2 includes an electronic pen controller 116. The electronic pen controller 116 communicates with the electronic pen 4 to determine whether or not there is a touch of the pen tip or a touch of the pen tip on the display 3. The electronic pen controller 116 may determine whether or not there is a touch not only on the pen tip and pen tail of the electronic pen 4, but also on a portion held by the user of the electronic pen 4 and other electronic pen portions.

Further, the electronic blackboard 2 is an address bus for electrically connecting the CPU 101, ROM 102, RAM 103, SSD 104, network controller 105, external storage controller 106, capture device 111, GPU 112, sensor controller 114, and electronic pen controller 116. It is equipped with a bus line 120 such as a data bus and a data bus.

The program for the electronic blackboard 2 may be recorded on a computer-readable recording medium such as a CD-ROM and distributed, or may be distributed from the program distribution server 50.

When the explainer terminal 10 or the terminal device 30 is a general-purpose information processing device, the hardware configuration is the same as that of the server 50, or even if it is different from the server 50, there is no problem in the explanation of the present embodiment. And.

<About functions>
The functions of the explainer terminal 10, the terminal device 30, and the server 50 will be described with reference to FIG. FIG. 5 is an example of a functional block diagram showing the functions of the explainer terminal 10, the terminal device 30, and the server 50 in the data sharing system 100 in a block shape.

<< Explainer terminal >>
The explainer terminal 10 has an operation reception unit 11, a stroke generation unit 12, a display control unit 13, an image acquisition unit 14, and a communication unit 15. Each of these functions possessed by the explainer terminal 10 is realized by the CPU 101 possessed by the electronic blackboard 2 shown in FIG. 4 executing a program stored in the SSD 104 or the like and cooperating with the hardware elements possessed by the electronic blackboard 2. The function or means to be performed. Alternatively, it is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202 shown in FIG. The program 209p may be distributed from the server 50 for program distribution, or may be distributed in a state of being stored in a portable storage medium such as a USB memory or an optical storage medium.

The operation reception unit 11 receives the operation of the explainer 8 with respect to the explainer terminal 10. For example, it accepts not only operations on images such as page switching, enlargement and reduction of explanatory materials, but also drawing of stroke 7 by handwriting. In addition, when the explainer 8 operates the mouse as a pointing device, it accepts operations that can be performed by the mouse, such as clicking, double-clicking, dragging and dropping, and long-pressing the click key. When the explainer 8 operates the touch panel and the finger (or pen) as the pointing device, taps, double taps, swipes, flicks, long presses, etc. are accepted.

The stroke generation unit 12 acquires the handwritten coordinate points received by the operation reception unit 11 and generates stroke data. The stroke 7 refers to one drawing data from the start to the end of handwriting by the explainer 8 or the audience 9. That is, in the case of a mouse, one stroke 7 is from the mouse down event to the mouse up event, and in the case of the touch panel, one stroke 7 is from the touchdown event to the touchup event. As will be described later, the stroke data has attributes such as thickness and color in addition to the coordinates indicating the position. The stroke generation unit 12 generates stroke data every short time such as 0.1 second. As a result, the stroke 7 handwritten by the explainer 8 is reflected in the terminal device 30 of the audience 9 in a short time.

The display control unit 13 displays the explanatory material stored in the explanatory material DB 19 on the display 3 or the LCD 206. The explanatory material may be electronic data that can be displayed by the explainer terminal 10, such as a file created by the presentation software, a file created by the word processing software, a Web page displayed by the browser software, or a PDF file. The display control unit 13 displays one page of the explanatory material on one screen, displays two or more pages, enlarges and displays one page, or reduces and displays one page according to the operation of the explainer 8. do.

Further, the display control unit 13 displays the stroke 7 on the screen based on the stroke data generated by the stroke generation unit 12. Since the screen of the explanatory material is already displayed, the explanatory material is displayed in a state where the stroke 7 is overwritten. That is, the stroke 7 drawn by the explainer 8 is displayed without going through the server 50. The stroke 7 drawn by the explainer 8 is not a feedback for the explanatory material of the explainer 8, but a stroke 7 for explaining to the audience 9.

Further, the display control unit 13 displays the stroke 7 on the display 3 or the LCD 206 based on the stroke data received from the server 50 by the communication unit 15. That is, the stroke 7 drawn by the audience 9 is acquired from the server 50 and displayed. The stroke 7 drawn by the audience 9 is feedback expressing an impression of the explanatory material of the explainer 8.

It is preferable that the display control unit 13 displays the stroke 7 of the explainer 8 and the stroke 7 of the audience 9 in different modes. For example, the stroke 7 of the explainer 8 is permanently displayed until the screen is switched, and the stroke 7 of the audience 9 fades out in a predetermined time (several tens of seconds). By doing so, it is possible to prevent the explanatory material from being hidden by the stroke 7 of the audience 9 while leaving the stroke 7 of the explainer 8.

The image acquisition unit 14 captures one screen displayed on the display 3 or the LCD 206 by the display control unit 13 as one image data. For example, image data is generated from the data stored in the screen memory. The image acquisition unit 14 automatically generates image data. For example, if there is no change in the screen displayed on the display 3 or the LCD 206, image data is generated at regular intervals such as 10 second intervals. When there is a change in the screen displayed on the display 3 or the LCD 206, image data is generated at short intervals such as 0.1 second intervals. Image data may be generated at shorter intervals as the screen changes larger. Whether or not there is a change in the screen can be determined by whether or not the operation reception unit 11 accepts a page switching operation, an enlargement / reduction operation, and the like, and the display control unit 13 updates the screen. In addition, the image acquisition unit 14 may acquire an image by accepting the operation of the explainer 8.

The communication unit 15 transmits and receives various data to and from the server 50. In the present embodiment, the image data is transmitted to the server 50, and the stroke data is received from the server 50.

The explainer terminal 10 has an explanatory material DB 19 constructed by the HDD 209 or the memory 202 shown in FIG. The above-mentioned explanatory material is stored in the explanatory material DB 19.

<< Terminal equipment >>
The terminal device 30 includes a stroke generation unit 31, an operation reception unit 32, a communication unit 33, and a display control unit 34. Each of these functions possessed by the terminal device 30 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202 shown in FIG.

It is assumed that the functions of the stroke generation unit 31 and the operation reception unit 32 of the terminal device 30 are the same as those of the stroke generation unit 12 and the operation reception unit 11 of the explainer terminal 10.

The communication unit 33 transmits and receives various data to and from the server 50. In this embodiment,
Receive image data from server 50,
b. Receive the stroke data for explanation from the server 50,
c. Send the stroke data handwritten by the audience 9 to the server 50,
d. Receive stroke data handwritten by another audience 9 from the server 50,
I do. In addition, b. d is not essential in this embodiment.

The communication unit 33 may periodically inquire the server 50 whether or not there is such data to be received, or may receive the data from the server 50 by push communication.

The display control unit 34 displays the image data received by the communication unit 33 on the LCD 206. In addition, the stroke 7 handwritten by the audience 9 is displayed on the LCD 206, and the stroke 7 of the explainer 8 or another audience 9 received by the communication unit 33 is displayed on the LCD 206. It is preferable that the display control unit 13 displays the stroke 7 of the explainer 8, the stroke 7 written by himself, and the stroke 7 of the other audience 9 in appropriate modes. For example, since the stroke 7 of the explainer 8 is the stroke of the explanation, it is permanently displayed until the screen is switched, and the stroke 7 entered by the explainer 8 is permanently displayed until the screen is switched so as not to forget it. The stroke 7 fades out in a predetermined time (several tens of seconds). By doing so, it is possible to grasp what kind of feedback the other audience 9 has given while leaving the explainer 8 and his / her own stroke 7.

<< Server >>
The server 50 includes a communication unit 51, an image data storage unit 52, a screen creation unit 53, an image data distribution unit 54, a stroke storage unit 55, a stroke distribution unit 56, and a search unit 57. Each of these functions possessed by the server 50 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202 shown in FIG. The program 209p may be distributed from the server 50 for program distribution, or may be distributed in a state of being stored in a portable storage medium such as a USB memory or an optical storage medium.

Further, the server 50 has a storage unit 59 constructed by the HDD 209 or the memory 202 shown in FIG. The storage unit 59 is constructed with an image data storage unit 61, a user information storage unit 62, a stroke data storage unit 63, and a distribution control information storage unit 64. First, these will be described.

表１は画像データ記憶部６１に記憶される画像データに関する情報の一例を示す。画像データ記憶部６１では、画像ＩＤ、授業ＩＤ、時刻、端末ＩＤ、ファイルパス、及び、ページ番号の各項目が管理される。画像ＩＤは、画像データを一意に識別又は特定するための識別情報である。ＩＤはIdentificationの略であり識別子や識別情報という意味である。ＩＤは複数の対象から、ある特定の対象を一意的に区別するために用いられる名称、符号、文字列、数値又はこれらのうち１つ以上の組み合わせをいう。他のＩＤについても同様である。

Table 1 shows an example of information regarding the image data stored in the image data storage unit 61. The image data storage unit 61 manages each item of the image ID, the lesson ID, the time, the terminal ID, the file path, and the page number. The image ID is identification information for uniquely identifying or specifying the image data. ID is an abbreviation for Identification and means an identifier or identification information. An ID refers to a name, a code, a character string, a numerical value, or a combination of one or more of these, which is used to uniquely distinguish a specific object from a plurality of objects. The same applies to other IDs.

The lesson ID is identification information for identifying or identifying a lesson. This lesson provides information for identifying which lesson image data the explanatory material is when used in a school lecture. Therefore, if the explanatory material is explained at the conference, it will be the conference ID, and if it is explained at the conference, it will be the presentation ID or the session ID. The time is the time when the image data was generated (it may be the time received by the server). The terminal ID is identification information for identifying or identifying the explainer terminal 10 that generated the image data. For example, the IP address, the MAC address, the ID of the explainer 8, the terminal name (computer name) of the explainer terminal 10, and the like may be used. The file path is the URL of the resource in which the image data is stored.

The page numbers are serial numbers assigned in order from the first page of the explanatory material. For example, a 10-page explanatory material will have page numbers from 1 to 10. This page number itself does not need to be touched on the explanatory material, and is set by the explainer terminal 10 based on the page switching operation for the explanatory material. With general presentation software, the page switching can be explicitly operated by the user, so that the stroke generation unit 12 can specify the current page number. When the explainer terminal 10 is an electronic blackboard, the electronic blackboard receives a page switching signal or a page number from the PC. When there is no clear delimiter on the page like a Web page, the display range corresponding to the page is specified by the scroll amount (the number of pixels) to the current display position with the head of the explanatory material as a reference.

Since the image ID is assigned by the server 50 and the class ID is a unique value, the explainer terminal 10 or the server 50 sets the image ID, the time is set by the explainer terminal 10, the terminal ID is set by the explainer terminal 10, and the file path. Is set by the server 50, and the page number is set by the explainer terminal 10.

表２は、ストロークデータ記憶部６３に記憶されるストロークデータの一例を示す。ストロークデータ記憶部６３では、ストロークＩＤ、授業ＩＤ、時刻、端末ＩＤ、色、位置情報、太さ、画像ＩＤ、及び、ページ番号の各項目が管理される。授業ＩＤ、端末ＩＤ及び画像ＩＤについては画像データ記憶部６１と同様でよい。

Table 2 shows an example of stroke data stored in the stroke data storage unit 63. The stroke data storage unit 63 manages each item of stroke ID, class ID, time, terminal ID, color, position information, thickness, image ID, and page number. The class ID, terminal ID, and image ID may be the same as those of the image data storage unit 61.

The stroke ID is identification information for uniquely identifying or identifying the stroke 7. The same stroke ID is assigned to one stroke 7 from mouse down (touchdown) to mouse up (touchup). The time is the time when the stroke data was generated. The color is the color of the stroke 7 set by the explainer 8 or the audience 9. The position information is one or more coordinates of the pointing device acquired while one stroke data is generated. The number of coordinates included is affected by the coordinate acquisition speed and the stroke data generation interval. The thickness is the thickness of the stroke 7 set by the explainer 8 or the audience 9. The image ID and the page number are values transmitted from the server 50 to the terminal device 30.

The stroke ID is assigned by the server 50, the time is set by the terminal device 30, the terminal ID is set by the terminal device 30, and the color, position information and thickness are set according to the operation of the explainer 8 or the audience 9. , The image ID and the page number are obtained from the server 50.

Since the stroke ID is associated with the page number as shown in Table 2, the server 50 can identify the handwritten stroke 7 for the page having the explanatory material and transmit it to the explainer terminal 10 or the like.

表３は、ユーザ情報記憶部６２に記憶されるユーザ情報の一例を示す。ユーザ情報記憶部６２では、説明者名・聴衆者名、端末ＩＤ、パスワード、ログイン済み、説明者、画面スタイル、及び配信モードの各目が管理される。説明者名・聴衆者名はユーザ名に相当するものであり、説明者８又は聴衆者９が互いを認識するための氏名やニックネームである。端末ＩＤは上記のように説明者８が使用する説明者端末１０又は各聴衆者名が使用する端末装置３０の識別情報である。パスワードは説明者８又は聴衆者９がサーバ５０から認証を受けるために秘密にしておく情報である。例えば、説明者８は授業ごとにパスワードを決定してメール等で聴衆者９に配信しておき、聴衆者９はこのパスワードでサーバ５０にログインする。これにより、説明者８は授業に端末をログインさせて参加している聴衆者９を特定できる。聴衆者９は端末ＩＤで特定できるため、パスワードは聴衆者９の全員に共通でもよい。あるいは、厳密に個人を認証するために聴衆者９ごとにパスワードを設定する。

Table 3 shows an example of user information stored in the user information storage unit 62. In the user information storage unit 62, each item of the explainer name / audience name, the terminal ID, the password, the logged-in person, the explainer, the screen style, and the distribution mode is managed. The explainer name / audience name corresponds to the user name, and is a name or nickname for the explainer 8 or the audience 9 to recognize each other. The terminal ID is the identification information of the explainer terminal 10 used by the explainer 8 or the terminal device 30 used by each audience name as described above. The password is information that the explainer 8 or the audience 9 keeps secret in order to be authenticated by the server 50. For example, the explainer 8 determines a password for each lesson and distributes it to the audience 9 by e-mail or the like, and the audience 9 logs in to the server 50 with this password. As a result, the explainer 8 can identify the audience 9 who is participating in the lesson by logging in the terminal. Since the audience 9 can be identified by the terminal ID, the password may be common to all the audience 9. Alternatively, a password is set for each audience 9 in order to authenticate the individual strictly.

The logged-in item indicates whether or not the explainer 8 and the audience 9 who can participate in the class are logged in. Alternatively, only the logged-in explainer 8 and audience 9 may be shown. Therefore, the logged-in explainer 8 and the audience 9 are identified. The item of the explainer 8 indicates who is the explainer 8. This is because the image data of the explainer 8 is distributed and shared to the terminal device 30. The screen style is an item for setting the mode of the screen for displaying the explanatory material for each of the explainer 8 or the audience 9. The distribution mode has a real-time mode and a past mode. The real-time mode is a distribution mode in which image data and stroke data are automatically transmitted or received. In the past mode, the explainer 8 or the audience 9 has past image data and strokes. This is a distribution mode in which data is specified and displayed.

表４は、配信制御情報記憶部６４に記憶される配信制御情報の一例を示す。配信制御情報はストロークデータの配信に関する設定である。配信制御情報記憶部６４には、説明者名・聴衆者名、ストローク表示聴衆者１、ストローク表示聴衆者２、ストローク表示聴衆者３…の各項目が管理される。

Table 4 shows an example of the distribution control information stored in the distribution control information storage unit 64. The distribution control information is a setting related to the distribution of stroke data. The distribution control information storage unit 64 manages each item of the explainer name / audience name, the stroke display audience 1, the stroke display audience 2, the stroke display audience 3, and so on.

The name of the explainer and the name of the audience indicate that the distribution settings are for this person. That is, the distribution control information of the explainer name and the audience name is set for each line. For example, "yamada" is set to distribute the stroke data of all the audience 9 from the server 50. On the other hand, only the stroke 7 of "yamada" is delivered to "suzuki", and the stroke 7 of "suzuki" is delivered to "satou" in addition to "yamada".

In this way, the data sharing system 100 of the present embodiment can control which terminal device 30 stroke data is displayed for each of the explainer 8 and each audience 9. In the case of the explainer 8, feedback can be obtained from each audience 9, and in principle, only the stroke data of the explainer 8 can be displayed in the case of the general audience 9.

Since only the explainer 8 has the authority to access the distribution control information storage unit 64, it is possible to restrict the audience 9 from snooping on the stroke data (feedback) of the other audience 9 without permission. For example, it is possible to suppress the leakage of answers in real-time tests (tests) and questionnaires. On the other hand, the explainer 8 associates the stroke data (feedback) of the excellent audience 9 with the arbitrary audience 9 so that the other audience 9 can also refer to the stroke data (feedback). It can be set to "person 1" or the like.

It will be described back to FIG. First, the communication unit 51 receives image data and stroke data from the explainer terminal 10 and stroke data from the terminal device 30. The image data storage unit 52 stores the image data received by the communication unit 51 in the image data storage unit 61. As described above, the image ID is numbered, the lesson ID determined by login is set if necessary, and the file path indicating the storage location of the image data is set.

The screen creation unit 53 performs a process for providing the Web application. A Web application refers to software or a mechanism thereof that operates by coordinating a program in a script language (for example, JavaScript (registered trademark)) that operates on a Web browser and a program on the Web server side, and is used on the Web browser. .. For example, at least screen information that accepts stroke drawing is generated by HTML, JavaScript, or the like. In addition, screen information for displaying a Web page corresponding to the screen style of the explainer 8 or the audience 9 is generated.

When new image data is stored in the image data storage unit 61, the screen creation unit 53 performs processing according to the screen style and sends the image data to the image data distribution unit 54. The image data distribution unit 54 distributes image data to the terminal device 30 of the audience 9 whose session has been established by logging in via the communication unit 51. Since the logged-in audience 9 is clear from the user information storage unit 62, the image data is transmitted to all the logged-in audiences 9. As a method of transmitting image data, there are a method of including image data in screen information such as HTML and a method of transmitting only new image data after transmitting the screen information once. Either transmission method may be adopted in the present embodiment, but the method of transmitting only the image data can reduce the communication load. Ajax, Comet, Web Socket, etc. are known as a communication mechanism for updating only image data.

The stroke storage unit 55 stores the stroke data received by the communication unit 51 from the explainer terminal 10 or the terminal device 30 in the stroke data storage unit 63. As described above, the stroke ID is numbered.

The stroke distribution unit 56 distributes the stroke data stored in the stroke data storage unit 63 to the explainer terminal 10 and the terminal device 30. First, the stroke data transmitted from the terminal device 30 is transmitted to the explainer terminal 10 together with the fact that it is the stroke data of the terminal device with reference to the distribution control information storage unit 64 (based on the setting of all). In the distribution control information storage unit 64, the stroke data transmitted from the terminal device 30 is transmitted to the terminal device set to receive the stroke data of the other terminal device 30 together with the fact that the stroke data is the stroke data of the terminal device. do. Further, the stroke data transmitted from the explainer terminal 10 is transmitted to the terminal device 30 set to be received by the distribution control information storage unit 64 together with the fact that the stroke data is the stroke data of the explainer terminal 10. As a matter of course, it is premised that the destination terminal device 30 or the explainer terminal 10 is logged in.

<Example of screen created by the server>
The audience 9 may want to see the explanatory material in full screen, or may want to see it while inputting text. Therefore, the explainer 8 and the audience 9 can select the screen style.

FIG. 6 is an example of a diagram illustrating a distribution screen 501 created by the screen creation unit 53 of the server 50 according to the screen style. As an example, it is assumed that there are three screen styles in this embodiment. FIG. 6A shows a distribution screen 501a (screen style 1), FIG. 6B shows a distribution screen 501b (screen style 2), and FIG. 6C shows a distribution screen 501c (screen style 3). Screen style 1 is a screen style in which explanatory materials are displayed on the entire distribution screen 501a, screen style 2 is a screen that accepts text input while displaying a part of explanatory materials, and screen style 3 is always text input. It is a screen for doing only.

The explainer 8 or the audience 9 can select a screen style from each distribution screen 501. From the screen style 1 in FIG. 6A, a menu for selecting screen styles 1 to 3 is displayed by right-clicking or the like.

The selection result of the screen style by the explainer 8 or the audience 9 is transmitted to the server 50, and is registered in the user information storage unit 62 in association with each user.

In FIG. 6, the distribution screen 501 is not distinguished between the explainer terminal 10 and the terminal device 30, but the distribution screen 501 may be different between the explainer terminal 10 and the terminal device 30. Even if the same screen style is applied to the terminal device 30 and the explainer terminal 10, at least the functions may be different, and the server 50 provides the explainer terminal 10 with screen information (HTML, JavaScript, CSS) for the explainer terminal. Send.

Further, the explainer 8 or the audience 9 can select the distribution mode of the image data and the stroke data of the explanatory material. FIG. 6D shows an example of the distribution mode selection screen 502. The distribution mode includes a real-time mode and a past mode, and the explainer 8 or the audience 9 can arbitrarily select the distribution mode. The default setting is real-time mode.

The distribution mode selection result by the explainer 8 or the audience 9 is transmitted to the server 50, and is registered in the user information storage unit 62 in association with each user.

FIG. 7 is an explanatory material designation screen 511 for the explainer 8 or the audience 9 to specify the explanatory material in the past mode. The explanatory material designation screen 511 has a lesson ID column 512, a page number column 513, a terminal ID column 514, a time column 515, an OK button 516, and a cancel button 517. The explainer 8 or the audience 9 can display the image data and the stroke data of the past explanatory material by inputting the lesson ID at least in the lesson ID field 512.

The page number field 513, the terminal ID field 514, and the time field 515 are fields for inputting the page number, the terminal ID, and the time, respectively, for the explainer 8 or the audience 9 to narrow down the image data and the stroke data. You can enter it. In this way, the explainer 8 or the audience 9 can specify and view the past image data and stroke data.

<About stroke>
The handwriting method of the stroke 7 will be described with reference to FIG. 8 as feedback to the explanatory material. FIG. 8 is an example of a diagram for explaining the handwriting method of the stroke 7. Although an example of using a touch panel as a pointing device will be described with reference to FIG. 8, a mouse or a pen may be used.
(1) The explainer 8 or the audience 9 traces the area. This area is the location of the explanatory material to which you want to give feedback (Fig. 8 (a)). Since the operation reception unit 32 acquires the coordinates, the stroke generation unit 31 acquires the coordinates after the touchdown. The stroke color before the explainer 8 or the audience 9 selects a color may be a neutral color such as gray.
(2) When the explainer 8 or the audience 9 stops the movement of the hand without releasing the hand from the touch panel, the stroke 7 becomes thicker in proportion to the time when the hand is stopped (FIG. 8 (b)). The stroke generation unit 31 measures the time during which the finger is stopped and stays (the time during which the coordinates do not change), and increases the thickness of the stroke data in proportion to the time. Further, since the thickness is notified to the display control unit 34, the display control unit 34 increases the thickness of the stroke 7.
(3) When the explainer 8 or the audience 9 releases the touch panel, the color selection field 521 is displayed (FIG. 8 (c)). When the operation reception unit 32 detects the touch-up event, the display control unit 34 displays the color selection field 521. It is assumed that which color is displayed is predetermined. In FIG. 8C, two colors may be displayed, but more colors may be displayed.
(4) The explainer 8 or the audience 9 selects a color (FIG. 8 (d)). The operation receiving unit 32 receives a color selection from the touch position and notifies the stroke generation unit 31 and the display control unit 34.
(5) The stroke 7 is colored (FIG. 8 (e)). The display control unit 34 changes the color of the stroke 7 to the notified color.

In this way, the explainer 8 or the audience 9 can specify the thickness and color with a simple operation. The color means, for example, the distinction between "good and bad", and the thickness indicates the degree of emphasis on good and bad. The color may be selected at the beginning of writing the stroke. Further, the explainer 8 or the audience 9 may change the thickness after touching up once.

The explainer 8 or the audience 9 may input the thickness numerically. Alternatively, the thickness may gradually increase as the number of touches with respect to the stroke 7 after releasing the hand increases. Further, while the explainer 8 or the audience 9 is holding his / her hand, the color of the stroke 7 may be changed in order, and the color may be determined at the moment when the hand is released. Alternatively, the color of the stroke 7 may be changed in order according to the touch on the stroke 7 after the hand is released.

Next, the position information of the stroke 7 will be described with reference to FIG. FIG. 9 is an example of a diagram for explaining the position information of the stroke 7. The position information (XRate, YRate) is not the coordinates (pixels) but the width of the image data so that the stroke 7 is displayed at the same position of the image data even if the size of the image data is changed (enlarged or reduced). It is expressed as a ratio to the height.

The origin (0,0) is the upper left corner of the image data. Assuming that the coordinates touched by the pointing device are (x, y), the width of the image data is width, and the height is height, the position information (XRate, YRate) is as follows.
XRate = width / x
YRate = height / y
As described above, the stroke generation unit generates stroke data every short time such as 0.1 second. For example, if the stroke generation unit captures the position information of two points in 0.1 seconds, one stroke data includes the position information of two points. Therefore, the position information for 0.4 seconds is expressed in JSON format as follows.
{"startXRate": "0.4781", "startYRate": "0.7359", "endXRate": "0.4794", "endYRate": "0.7359"},
{"startXRate": "0.4794", "startYRate": "0.7359", "endXRate": "0.4812", "endYRate": "0.7371"},
{"startXRate": "0.4812", "startYRate": "0.7371", "endXRate": "0.4831", "endYRate": "0.7383"},
{"startXRate": "0.4831", "startYRate": "0.7383", "endXRate": "0.4875", "endYRate": "0.7395"},
{"startXRate": "0.4875", "startYRate": "0.7395", "endXRate": "0.4931", "endYRate": "0.7419"},
Since the stroke ID is attached to the stroke data, the explainer terminal 10 and the terminal device 30 can draw the position information constituting the same one stroke 7 as one stroke 7.

FIG. 10 is an example of a diagram illustrating a method in which the audience 9 specifies the shape of the stroke 7. FIG. 10A is an example of a diagram illustrating a method of generating a circular stroke 7. When the explainer 8 or the audience 9 stops the movement of the finger, the thickness gradually increases and a circle is formed. A circle is a stroke with no length. Since the display control unit 34 expands the drawing range evenly by the thickness from the coordinates staying at one point to the periphery, a circle is displayed.

FIG. 10B is an example of a diagram illustrating a method of generating a stroke 7 having a hollow shape. When the explainer 8 or the audience 9 stops the movement of the finger while the start point and the end point are aligned with each other, the thickness gradually increases and the shape becomes hollow. Since such a shape is composed of strokes even if there is a cavity, it can be easily drawn like a stroke such as a line.

FIG. 10C shows a stroke 7 having an arbitrary shape such as a waveform. A certain upper limit may be provided for the thickness in FIGS. 10 (a) to 10 (c). For example, the thickness is limited so that the cavity is not crushed. Further, the display control unit 34 may gradually increase the numerical value indicating the thickness while the hands of the explainer 8 or the audience 9 are stopped so that the thickness can be understood numerically. Further, the explaining person terminal 10 and the terminal device 30 may display a menu by double tapping or the like, and may accept and display a selection of a fixed figure such as a circle, a triangle, or a square.

It is difficult for the explainer 8 to notice if it is a mere point or line, but by handwriting the stroke 7 with a circle or a thick line as in the present embodiment, it becomes easier to appeal the object of interest of the audience 9. Further, since the stroke 7 is classified into a picture such as a mark instead of a character, the manifestation of intention can be easily performed. In addition, the stroke 7 can be drawn in various shapes depending on the person.

<Operation procedure>
FIG. 11 is an example of a sequence diagram showing the overall operation procedure of the data sharing system 100 in the real-time mode.

S1 to S3: First, at least the explainer terminal 10 logs in to the server 50. At school, the chime sounds and the class starts. Most students also log in. By logging in, a session is established between the server 50 and the explainer terminal 10, and between the server 50 and the terminal device 30.

S4: First, the explainer 8 performs a sharing operation in order to share the image data of the explainer terminal 10 with the terminal device 30. The operation reception unit 11 of the explainer terminal 10 accepts this operation, and the communication unit 15 transmits a sharing request to the server 50. Since the communication unit 51 of the server 50 receives the sharing request, the image data storage unit 52 registers the "explainer 8" in association with the explainer terminal 10 of the user information storage unit 62. As a result, the image data of the explainer terminal 10 is shared with the plurality of terminal devices 30.

S5: The image acquisition unit 14 of the explainer terminal 10 generates image data. As described above, image data is generated at least periodically, and when there is a change in the screen of the explainer terminal 10, image data is generated at short intervals.

S6: The communication unit 15 of the explainer terminal 10 transmits the image data to the server 50. A time, a terminal ID, and a page number are set in the image data.

S7: The communication unit 51 of the server 50 receives the image data, and the image data storage unit 52 stores the image data in the image data storage unit 61. The image data storage unit 52 sets the image ID, the lesson ID, and the file path. The image data storage unit 52 detects that the explainer 8 has transmitted the image data based on the terminal ID, and requests the screen creation unit 53 to share the image data.

S8, S9: The screen creation unit 53 detects that the image data has been accumulated in the image data storage unit 61 and creates screen information. The screen creation unit 53 creates screen information corresponding to the screen style at least once at the time of login or the like. After the creation, the screen information corresponding to the screen style is created at the timing when the audience 9 changes the screen style. If there is no change in the screen style, the screen creation unit 53 is logged in and generates image data according to the screen style of the audience 9 in the real-time mode. For example, the size is changed, and image data corresponding to the type of OS and browser is generated. The image data distribution unit 54 distributes image data to the terminal device 30 in the real-time mode while being logged in in order or in parallel.

S10, S11: The communication unit 33 of the terminal device 30 receives the image data. As a result, the display control unit 34 displays the image data on the LCD 206. That is, the image data in the image data display field of the browser is updated.

S12: Next, the audience 9 of the terminal device 30B handwritten the stroke 7. The operation receiving unit 32 receives the input of the stroke 7, and the stroke generating unit 31 generates the stroke data. Further, the display control unit 34 displays the stroke 7. The stroke 7 handwritten by himself does not disappear over time, but the audience 9 can erase it by his own operation.

S13: The communication unit 33 of the terminal device 30B transmits the stroke data to the server 50. In this stroke data, a time, a terminal ID, a color, a position information, a thickness, an image ID, and a page number are set.

S14: The communication unit 51 of the server 50 receives the stroke data, and the stroke storage unit 55 stores the stroke data in the stroke data storage unit 63. The stroke storage unit 55 sets the stroke ID.

S15: The stroke distribution unit 56 detects the accumulation of stroke data and specifies that the explainer terminal 10 and other terminal devices 30 that are designated to receive the stroke data of the transmission source terminal device 30B are stored in the distribution control information storage unit 64. To identify by referring to. For example, since it is known that the stroke data is transmitted to the explainer terminal 10, the stroke distribution unit 56 transmits the stroke data to the explainer terminal 10. At this time, it may be transmitted together that the stroke data is from the terminal device 30. As a result, the explainer terminal 10 can display the stroke data for a certain period of time and then delete it. It may also be transmitted to the terminal device 30A.

S16: Since the communication unit 15 of the explainer terminal 10 receives the stroke data, the display control unit 13 displays the stroke 7. The display control unit 13 determines whether or not the currently displayed page number is the same as the page number of the stroke data, and if they are the same, displays the stroke 7. As a result, it is possible to suppress the display of the stroke 7 for the page before the page is switched after the explainer 8 switches the page.

In this way, the explainer terminal 10 can display the stroke data transmitted by each terminal device 30 in real time. In class, stroke data is transmitted from many terminal devices 30, so that they can be checked together. Further, even if the explainer terminal 10 receives the stroke data of a plurality of terminal devices 30 by the function of JavaScript including the screen information, the explainer 8 specifies an arbitrary audience 9 individually or a plurality of strokes 7 and makes a stroke 7. Can be displayed. Further, it is also possible to display the image data as thumbnails for each audience 9 and display the stroke 7 of each person.

In this way, for example, the explainer 8 superimposes the stroke data of a plurality of audiences 9 or displays only the stroke data of an arbitrary audience 9 to examine the feedback and provide supplementary explanations or explanatory materials. Can be modified.

FIG. 12 is an example of a sequence diagram showing a schematic operation procedure of the data sharing system 100 in the past mode. The process of FIG. 12 may be started at an arbitrary timing during the lesson, or may be started at an arbitrary timing other than the lesson.

S21: The explainer 8 wants to see feedback on a certain page and performs an operation to switch to the past mode. The operation reception unit 11 accepts this operation, and the communication unit 15 requests the switch to the past mode.

S22: It is assumed that the explainer 8 inputs the lesson ID, the page number, and the terminal ID on the explanatory material designation screen 511. Designation other than the class ID is optional. The terminal ID may specify a certain audience 9 (students) or all audiences 9 (all). The communication unit 15 of the explainer terminal 10 transmits a search request including the lesson ID, the page number, and the terminal ID to the server 50.

S23: The communication unit 51 of the server 50 receives the search request, and the search unit 57 determines whether or not the designation of the terminal ID is permitted. That is, it is determined by referring to the distribution control information storage unit 64 whether or not the terminal ID that allows the explainer terminal 10 to display the stroke 7 is specified. If a terminal ID that is not permitted is included, it is preferable to send the corresponding terminal ID and error message to the explainer terminal 10. In the description of FIG. 12, it is assumed that the terminal ID that the explainer terminal 10 is permitted to display the stroke 7 is specified.

S24: The communication unit 51 of the server 50 receives the search request, and the search unit 57 searches the image data storage unit 61. First, the image data having the lesson ID and the page number included in the search request is searched from the image data storage unit 61. Next, if the terminal ID of the search request is a specific individual, the image data is narrowed down by this terminal ID. If the terminal ID is all the audience 9, the image data searched by the lesson ID and the page number may be used.

S25: Next, the search unit 57 of the server 50 searches the stroke data storage unit 63. Similarly, the search may be performed by the lesson ID, the page number, and the terminal ID. Alternatively, since the stroke data is associated with the image ID, the stroke data storage unit 63 may be searched by the image ID of the image data searched in step S23.

S26: The screen creation unit 53 generates screen information including image data and stroke data. Since the stroke data may be overwritten with the image data, the stroke data may be transmitted later.

S27: The communication unit 51 of the server 50 transmits screen information including image data and stroke data to the explainer terminal 10.

S28: The communication unit 15 of the explainer terminal 10 receives screen information including image data and stroke data, and the display control unit 13 displays the image data and stroke data. In the past mode, it is preferable that the stroke 7 does not disappear with the passage of time. This allows the explainer 8 to fully examine the feedback.

<Display example of stroke data>
FIG. 13 shows an example of the image data and the stroke 7 displayed by the explainer terminal 10. The display example of FIG. 13 can be in the real-time mode or the past mode. Two strokes 7A and 7B are displayed in the image data. Since the color of the stroke 7 is translucent, the explainer 8 can see the original image data even if the stroke 7 is displayed.

In FIG. 13, only two strokes 7 overlap, but the more stroke data is transmitted from the terminal device 30, the more the overlapping portion has a statistical property. Person 8 becomes easy to grasp. In particular, since the overlapping portion becomes dark, the position becomes more conspicuous as it is fed back to the same position.

When a plurality of strokes 7 are included as shown in FIG. 13, the explainer 8 or the audience 9 may display a list of students and display only the strokes of any student.

FIG. 14 is a diagram showing an example of a screen in which strokes 7 for each audience 9 are displayed together with image data displayed as thumbnails. The explainer terminal 10 displays the stroke 7 transmitted by the terminal device 30 separately for each terminal device 30 by superimposing it on the image data transmitted to the terminal device 30. Although six image data are displayed in FIG. 14, the explainer 8 can display the stroke data of all the audience 9 by scrolling the screen. Therefore, it is easy to confirm what kind of feedback the individual audience 9 has sent.

Next, the overlapping of strokes will be described. Since the colors of the strokes 7 become darker as they overlap, the explainer 8 can grasp at a glance the points that are often pointed out.

On the other hand, if the color of the overlapping strokes 7 becomes darker, there is a possibility that even a portion that should not be emphasized is emphasized. This will be described with reference to FIG.

FIG. 15 is an example of a diagram illustrating the colors of the overlapping strokes 7. Note that FIG. 15 shows a case where the colors of the strokes 7 are the same. In FIG. 15A, two circular strokes 7 are drawn, but the distance L between the centers of gravity of the two circles is small. When the distance L is small, it can be considered that another audience 9 is feeding back to the same place, so the overlapping portion should be emphasized (the color should be darkened).

On the other hand, in FIG. 15B, the circular stroke 7 and the donut-shaped stroke 7 are drawn, but the distance L between the center of gravity of the circle and the center of gravity of the donut is large. When the distance L is large, even if the strokes 7 overlap, it is considered that each audience 9 is feeding back to another place, so the overlapping portion should not be emphasized (the color should be darkened).

As described above, in the present embodiment, the distance between the overlapping strokes 7 can be calculated and compared with the threshold value to determine the color of the overlapping portion. The overlapping portion can be determined by the pixel positions of the two strokes 7, and the display control unit 13 can control the color of the overlapping portion.

If three or more strokes 7 overlap, pay attention to one stroke 7 and decide whether or not to darken the color of the other strokes 7 that overlap with the stroke 7 based on the distance of the center of gravity. good. FIG. 15C is an example of a diagram illustrating the overlap of the three strokes 7. The overlapping portion of the stroke 7A and the stroke 7B is referred to as the overlapping portion AB, the overlapping portion of the stroke 7B and the stroke 7C is referred to as the overlapping portion BC, and the overlapping portion of the stroke 7A and the stroke 7C is referred to as the overlapping portion AC. Further, the overlapping portion of the three strokes 7 is referred to as an overlapping portion ABC. Moreover, the distance between the centers of gravity of each other is less than the threshold value.

The overlapping portion AB-ABC (the portion of AB that does not contain ABC), the overlapping portion AC-ABC, and the overlapping portion BC-ABC are each thickened by one step. The overlapping portion ABC is thickened by two steps.

If a plurality of strokes 7 having different colors overlap, the meaning of the feedback becomes difficult to understand. Therefore, it is also effective not to overlap regardless of the distance between the centers of gravity. FIG. 16 is an example of a diagram illustrating the overlap of strokes 7 having different colors. When the colors are different, for example, the color having the larger area of the stroke 7 is given priority. This is because when the area is large, it is considered that the audience 9 has a strong will to give feedback. In FIG. 16, since the red stroke 7A has a larger area than the blue stroke 7B, the overlapping portion is displayed in red. The overlapping portion may be displayed in a mixed color of red and blue, or may be displayed in another color such as black.

FIG. 17 is an example of a flowchart showing a procedure in which the display control unit determines the color of the overlapping portion. The process of FIG. 17 starts when the explainer terminal 10 receives the stroke data.

The display control unit 13 pays attention to one stroke 7 and determines whether or not there is another overlapping stroke 7 (S101). If the determination in step S101 is No, the process of FIG. 17 ends.

If the determination in step S101 is Yes, the display control unit 13 determines whether or not the two strokes 7 have the same color (S102).

If the colors are not the same (No in S102), the display control unit 13 determines the overlapping portion to be the color of the stroke 7 having the larger area (S103).

When the colors are the same (Yes in S102), the display control unit 13 determines whether or not the distance between the centers of gravity of the two strokes 7 is equal to or greater than the threshold value (S104).

If it is equal to or greater than the threshold value, the display control unit 13 determines the overlapping portion to be the original color depth (S105). If it is less than the threshold value, the display control unit 13 darkens the color of the overlapping portion by one step (S106).

The display control unit 13 executes the process of FIG. 17 for each stroke 7, but the stroke 7 determined as another stroke 7 in step S101 does not have to be processed. This is because the color of the overlapping portion has already been determined.

<Summary>
As described above, in the data sharing system of the present embodiment, each audience 9 can indicate a manifestation of intention at an arbitrary position of the explanatory material and feed it back to the explainer. The explainer can collectively display the feedback aggregated from each audience 9. In addition, each audience member 9 can indicate the strength and weakness of the intention and the content by a simple operation when expressing the intention.

<Other application examples>
Although the best mode for carrying out the present invention has been described above with reference to examples, the present invention is not limited to these examples, and various modifications are made without departing from the gist of the present invention. And substitutions can be made.

For example, in the present embodiment, the explainer terminal 10 and the terminal device 30 display the image data on the browser, but one or both of the explainer terminal 10 and the terminal device 30 may display the image data on the application.

Further, in the present embodiment, the good and bad are mainly fed back, but it is also possible to give feedback such as easy to see / difficult to see, beautiful / not beautiful, easy to understand / difficult to understand, etc. by giving meaning to the color and thickness. Is.

Further, in the present embodiment, the explainer terminal 10 and the terminal device 30 communicate with each other via the server 50, but the server 50 may not be provided. In this case, the explainer terminal 10 may have the function of the server 50.

Further, the terminal device 30 may transmit voice data to the explainer terminal 10 in addition to the stroke data. The explainer terminal 10 can also transmit voice data in the same manner.

Further, the configuration example shown in FIG. 5 and the like is divided according to the main functions in order to facilitate understanding of the processes of the explainer terminal 10, the terminal device 30, and the server 50. The present invention is not limited by the method of dividing the processing unit or the name. Further, the processing of the explainer terminal 10, the terminal device 30, and the server 50 can be divided into more processing units according to the processing content. It is also possible to divide one processing unit so as to include more processing.

Further, a plurality of servers 50 may exist. The functions of one server 50 may be distributed to a plurality of information processing devices.

The explainer terminal 10 is an example of the first device, the terminal device 30 is an example of the second device, the operation reception unit 32 is an example of the operation reception means, and the stroke generation unit 31 generates stroke data. The display control unit 34 is an example of the second display control means, and the communication unit 33 is an example of the second communication means. The communication unit 15 is an example of the first communication means, and the display control unit 13 is an example of the first display control means.

7: Stroke 8: Explainer 9: Audience 10: Explainer terminal 30: Terminal device 50: Server 100: Data sharing system

Japanese Unexamined Patent Publication No. 2009-048381

Claims (11)

The first device is a data sharing system that transmits image data to one or more second devices.
The second device is
An operation receiving means for receiving drawing by a pointing device for the image data received from the first device, and
Stroke data that becomes thicker as the position of the pointing device stays for a longer period of time, and is a stroke data generation means that generates stroke data including at least the position.
A second display control means for displaying the stroke of the thickness on the display device by superimposing the stroke on the image data,
A second communication means for transmitting the stroke data generated by the stroke data generation means to the first device, and
Data sharing system with. The stroke data generation means
The data sharing system according to claim 1, wherein the pointing device generates the stroke data in which the thickness of the stroke is changed based on the time stayed at the end point of the stroke. When the second display control means detects a touch-up or mouse-up event at the end point of the stroke, the second display control means displays a color selection field for the stroke.
The stroke data generating means sets the color received by the operation receiving means in the stroke data, and sets the stroke data.
The data sharing system according to claim 1 or 2, wherein the second display control means displays the stroke in a color received by the operation reception means. The first device is
A first communication means for receiving the stroke data from each of the second devices,
Based on the stroke data received by the first communication means, a first display control means for displaying one or more of the strokes on top of the image data transmitted to the second device.
The data sharing system according to any one of claims 1 to 3, wherein the data sharing system is characterized by having. The first display control means displays the stroke based on the stroke data transmitted by the second device separately for each of the second devices and superimposed on the image data transmitted to the second device. The data sharing system according to claim 4, wherein the data sharing system is characterized. The data sharing system according to claim 4, wherein when the strokes transmitted from the plurality of second devices overlap, the first display control means darkens the color of the overlapping portions. When the strokes transmitted from the plurality of second devices overlap,
The first display control means compares the distance between the centers of gravity of the two overlapping strokes with the threshold value, and if it is less than the threshold value, the overlapping portion is darkened, and if it is more than the threshold value, the overlapping portion is the original stroke. The data sharing system according to claim 6, wherein the data is displayed in density. It has an information processing device that stores image data transmitted from the first device and stroke data transmitted from the second device and associated with the image data.
The first device specifies the identification information of the image data and requests the image data and the stroke data from the information processing device.
The first communication means receives the image data searched by the information processing apparatus based on the identification information of the image data and the stroke data associated with the searched image data, and receives the stroke data.
The data sharing system according to any one of claims 4 to 7, wherein the first display control means displays a stroke based on the stroke data on top of the image data. An information processing device that shares image data with the first device.
An operation receiving means for receiving drawing by a pointing device for the image data received from the first device, and
Stroke data that becomes thicker as the position of the pointing device stays for a longer period of time, and is a stroke data generation means that generates stroke data including at least the position.
A second display control means for displaying the stroke of the thickness on the display device by superimposing the stroke on the image data,
A second communication means for transmitting the stroke data generated by the stroke data generation means to the first device, and
Information processing device with. An information processing device that shares image data with the first device,
An operation receiving means for receiving drawing by a pointing device for the image data received from the first device, and
Stroke data that becomes thicker as the position of the pointing device stays for a longer period of time, and is a stroke data generation means that generates stroke data including at least the position.
A second display control means for displaying the stroke of the thickness on the display device by superimposing the stroke on the image data,
A second communication means for transmitting the stroke data generated by the stroke data generation means to the first device,
A program to function as. A data sharing method performed by a data sharing system in which the first device transmits image data to one or more second devices.
A step in which the operation receiving means receives drawing by the pointing device for the image data received from the first device, and
The stroke data generation means is a step of generating stroke data that becomes thicker as the position of the pointing device stays for a longer period of time, and includes at least the stroke data including the position.
The second display control means has a step of superimposing the stroke of the thickness on the image data and displaying it on the display device.
A data sharing method in which a second communication means includes a step of transmitting the stroke data generated by the stroke data generation means to the first device.

Images