WO2020189742A1 - Information transmission system, information processing device, and transmission method - Google Patents

Information transmission system, information processing device, and transmission method Download PDF

Info

Publication number
WO2020189742A1
WO2020189742A1 PCT/JP2020/012140 JP2020012140W WO2020189742A1 WO 2020189742 A1 WO2020189742 A1 WO 2020189742A1 JP 2020012140 W JP2020012140 W JP 2020012140W WO 2020189742 A1 WO2020189742 A1 WO 2020189742A1
Authority
WO
WIPO (PCT)
Prior art keywords
page
information
remote conference
shared
joining
Prior art date
Application number
PCT/JP2020/012140
Other languages
French (fr)
Inventor
Masashi Ogasawara
Shigeru Nakamura
Yuichi Kawasaki
Takeshi Homma
Hiroshi Hinohara
Atsushi Miyamoto
Original Assignee
Ricoh Company, Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2020010069A external-priority patent/JP2020161120A/en
Application filed by Ricoh Company, Ltd. filed Critical Ricoh Company, Ltd.
Publication of WO2020189742A1 publication Critical patent/WO2020189742A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/567—Multimedia conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/16—Sequence circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M7/00—Arrangements for interconnection between switching centres
    • H04M7/0024—Services and arrangements where telephone services are combined with data services
    • H04M7/0027—Collaboration services where a computer is used for data transfer and the telephone is used for telephonic communication

Definitions

  • the present invention relates to an information transmission system, an information processing device, and a transmission method.
  • image data are shared among the terminals, by transmitting image data indicating the material being displayed on one terminal to the other terminal via a communication network (see PTL 1).
  • each of the terminals that is to join a remote conference joins the remote conference after downloading the shared information to be shared among the terminals.
  • the shared information is a file containing a plurality of pages
  • the shared information is displayed after all the pages of the shared information are downloaded. Consequently, for example, when the material used (being displayed) in the remote conference is page 4, and when material is downloaded from page 1, the participant cannot immediately display the data currently used, while the data is being downloaded.
  • the data amount of material is large, the network bandwidth is narrow, or the like, it takes longer time to share material, and it takes time to display the material currently used.
  • the present invention has been made in view of the above, and an object of the present invention is to provide an information transmission system, an information processing device, and a transmission method that can reduce the time required for displaying material in a remote conference.
  • an information transmission system is configured to cause a plurality of terminals to perform a remote conference via a network.
  • the information transmission system includes a storage control unit, a display control unit, a determining unit, and a transmitting unit.
  • the storage control unit is configured to store shared information including a plurality of pages to be shared among the plurality of terminals joining the same remote conference.
  • the display control unit is configured to control a page of the shared information displayed on the plurality of terminals joining the same remote conference.
  • the determining unit is configured to determine a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled by the display control unit.
  • the transmitting unit is configured to transmit pages included in the shared information to the terminal in an order determined by the determining unit.
  • Fig. 1 is a schematic diagram of an information transmission system according to the present embodiment.
  • Fig. 2 is a diagram illustrating an example of a hardware configuration of an electronic blackboard.
  • Fig. 3 is a diagram illustrating an example of a hardware configuration of a communication management system.
  • Fig. 4 is a diagram illustrating an example of a configuration of functional blocks of the electronic blackboard.
  • Fig. 5 is a diagram illustrating an example of a configuration of functional blocks of the communication management system.
  • Fig. 6 is a diagram illustrating an example of a derivation flow of a reception starting page derived by a sharing priority determining unit.
  • Fig. 7 is a diagram illustrating an example of a derivation flow of a transmission starting page when a file is being read.
  • Fig. 8 is a diagram illustrating an example of displaying a screen of the display of the electronic blackboard.
  • Fig. 9 is a schematic diagram illustrating an example of material sharing.
  • Fig. 10 is
  • an electronic blackboard is an example of a "terminal”.
  • a communication management system (message server) and a storage server are examples of a “server”.
  • the electronic blackboard, the communication management system (message server), and the storage server are examples of an "information processing device”.
  • Fig. 1 is a schematic diagram of an information transmission system according to the present embodiment. It is to be noted that the remote conference includes a "video conference (may also be referred to as a TV conference)" and the like.
  • the information transmission system includes the electronic blackboards 1, a communication management system 5, and a storage server 7.
  • the information transmission system also includes a relay device for relaying data transmitted and received between the devices and the like.
  • the electronic blackboards 1 at a base A and a base B communicate with each other, by mutually communicating video data and sound data for communication, and shared material data (hereinafter, data (including an image) to be shared may be collectively referred to as shared material) such as image data and stroke data to be shared.
  • shared material data hereinafter, data (including an image) to be shared may be collectively referred to as shared material
  • the stroke data is data required for reproducing (regenerating) a stroke image, and includes coordinate data, data on line width, data on line color, vector data, and the like.
  • the electronic blackboards 1 With the electronic blackboards 1, by transmitting and receiving data (data of a plurality of pages such as image data) of shared material that is shared information, the participants who use the present system can share the same material image.
  • the material image is an image to be displayed on the display of the electronic blackboard 1, and is an image such as material of the conference, a background image to be displayed on the display, a capture screen when the display screen is captured, and the like.
  • the electronic blackboards 1 by transmitting and receiving the stroke data of the stroke image to be shared, the participants who use the present system can share the same stroke image.
  • the stroke image is an image of a line and the like drawn by a user with a handwritten stroke using an electronic pen and the like.
  • the stroke image is displayed by stroke data indicating the points that specify the coordinates on the display.
  • Fig. 1 illustrates two electronic blackboards 1. However, data may also be shared among three or more electronic blackboards when an electronic blackboard joins (is added to) the conference in the middle of the conference.
  • Fig. 1 illustrates the electronic blackboards each installed with a video conference function, as an example of the electronic blackboard 1.
  • the image of the video data may be a moving image or a still image.
  • the electronic blackboard serving as a request source that requests the start of a video conference is indicated as a "starting terminal”.
  • An electronic blackboard serving as a destination (relay destination) that is a request destination is indicated as a "destination terminal”.
  • the communication management system 5 is configured by a computer, and manages login authentication from the electronic blackboard 1, communication status of the electronic blackboard 1, an address list, and the like. Moreover, the communication management system 5 also functions as a message server (an example of a "storage control unit"), and manages operation information and stroke data to be shared among the electronic blackboards 1.
  • the operation information is information indicating operations such as adding, deleting, or writing material to be shared, and changing the display position. Because the operation information is transmitted and received as information for controlling the display on the electronic blackboards 1, the communication management system 5 also functions as a "display control unit". For example, changing the display position is to change the material page to be displayed, such as to change from page 1 to page 2 of the material.
  • the storage server 7 (an example of the “storage control unit”) 7 is configured by a computer, stores the image data of the shared material that is uploaded from the electronic blackboard 1, and causes the electronic blackboard 1 of the other participant to download the image data.
  • the communication management system 5 and the storage server 7 may be configured by a single computer or a plurality of computers in which the units (functions or means) are divided and optionally assigned.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of the electronic blackboard 1.
  • the electronic blackboard 1 includes a central processing unit (CPU) 101, a read only memory (ROM) 102, a random access memory (RAM) 103, a solid state drive (SSD) 104, a network interface (I/F) 105, and an external device connection interface (I/F) 106.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • SSD solid state drive
  • I/F network interface
  • I/F external device connection interface
  • the CPU 101 controls the entire operation of the electronic blackboard 1.
  • the ROM 102 stores therein a computer program used in the CPU 101 and used for driving the CPU 101 such as an initial program loader (IPL).
  • the RAM 103 is used as a work area for the CPU 101.
  • the SSD 104 stores therein various types of data such as a computer program for the electronic blackboard.
  • the network I/F 105 controls communication with a communication network 4.
  • the external device connection I/F 106 is an interface for connecting various external devices.
  • the external device includes a universal serial bus (USB) memory 130, and an external device (microphone 140, a speaker 150, and a camera 160).
  • USB universal serial bus
  • the electronic blackboard 1 includes a capture device 111, a graphics processing unit (GPU) 112, a display controller 113, a touch sensor 114, a sensor controller 115, an electronic pen controller 116, a short range communication circuit 119, an antenna 119a for the short range communication circuit 119, a power switch 122, and selection switches 123.
  • GPU graphics processing unit
  • the capture device 111 causes the display of an external personal computer (PC) 170 to display video information as a still image or a moving image.
  • the GPU 112 is a semiconductor chip that specializes graphics.
  • the display controller 113 controls and manages the displaying of the screen so that an output image from the GPU 112 is output to a display 180 and the like.
  • the touch sensor 114 detects an electronic pen 190, a hand H of a user, or the like that has come into contact with the display 180.
  • the sensor controller 115 controls the process of the touch sensor 114.
  • the touch sensor 114 inputs and detects coordinates using an infrared interception method.
  • the method for inputting and detecting coordinates is a method in which two light emitting and receiving devices installed on both upper ends of the display 180 emit a plurality of infrared rays in parallel with the display 180, and receive the light that is reflected by a reflection member provided on the periphery of the display 180, and that returns on the optical path the same as that of the light emitted by a photodetector.
  • the touch sensor 114 outputs the identifications (IDs) of the infrared rays that are emitted from the two light emitting and receiving devices and that are blocked by an object, to the sensor controller 115.
  • IDs identifications
  • the sensor controller 115 specifies the coordinate position that is the contact location of the object.
  • the electronic pen controller 116 determines whether the pen tip or the pen bottom of the electronic pen 190 has touched the display 180, by communicating with the electronic pen 190.
  • the short range communication circuit 119 is a communication circuit for near field communication (NFC), Bluetooth (registered trademark), and the like.
  • the power switch 122 is a switch for switching ON/OFF of the electric power of the electronic blackboard 1.
  • the selection switches 123 are a group of switches used for adjusting the contrast, color, and the like of the display 180.
  • the electronic blackboard 1 includes a bus line 110.
  • the bus line 110 is an address bus, a data bus, and the like for electrically connecting the components such as the CPU 101 illustrated in Fig. 2.
  • the touch sensor 114 is not limited to the infrared interception method.
  • the touch sensor 114 may also be various detection units such as an electrostatic capacitance type touch panel, a resistance film type touch panel, and an electromagnetic induction type touch panel.
  • the electrostatic capacitance type touch panel specifies the contact location by detecting a change in the electrostatic capacity.
  • the resistance film type touch panel specifies the contact location by a change in voltage of the two facing resistance films.
  • the electromagnetic induction type touch panel specifies the contact location by detecting the electromagnetic induction generated when a contact object comes into contact with a display unit.
  • the electronic pen controller 116 may determine whether a portion of the electronic pen 190 gripped by a user or the other portion of the electronic pen has touched the display unit, in addition to the pen point and the pen bottom of the electronic pen 190.
  • FIG. 3 is a diagram illustrating an example of a hardware configuration of the communication management system 5 according to the present embodiment.
  • the computer serving as an example of the communication management system 5 includes a CPU 501, a ROM 502, a RAM 503, a hard disk (HD) 504, a hard disk drive (HDD) controller 505, a display 506, an external device connection interface (I/F) 508, a network I/F 509, a keyboard 511, a pointing device 512, a digital versatile disc rewritable (DVD-RW) drive 514, a media I/F 516, and a bus line 510.
  • the CPU 501 controls the entire operation of the communication management system 5.
  • the ROM 502 stores therein a computer program used for driving the CPU 501 such as the IPL.
  • the RAM 503 is used as a work area for the CPU 501.
  • the HD 504 stores therein various types of data such as a communication management program.
  • the HDD controller 505 controls reading or writing of various types of data from and to the HD 504 according to the control of the CPU 501.
  • the display 506 displays various types of information such as a cursor, a menu, a window, a character, or an image.
  • the external device connection I/F 508 is an interface for connecting various external devices.
  • the network I/F 509 is an interface for communicating data by using the communication network 4 such as the Internet.
  • the keyboard 511 is a type of input means including a plurality of keys for entering a character, a numerical value, various instructions, and the like.
  • the pointing device 12 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.
  • the DVD-RW drive 514 controls reading or writing (storing) of data from and to the DVD-RW.
  • the DVD-RW drive 514 may also control reading or writing (storing) of data from and to a disk such as Blu-ray (registered trademark) Disc Rewritable (BD-RE), in addition to the DVD-RW drive.
  • the media I/F 516 controls reading or writing (storing) of data from and to a recording medium 515 such as a flash memory.
  • bus line 510 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 501 illustrated in Fig. 3.
  • the hardware configuration of the storage server 7 illustrated in Fig. 1 is the same as the hardware configuration of the communication management system 5, the description thereof will be omitted. However, in the case of the storage server 7, an image storage program is stored in the HD 504.
  • the electronic blackboard 1 includes a transmitting and receiving unit 11a, a reception unit 12a, a video/sound processing unit 13a, a display control unit 14a, a determining unit 15a, a sharing priority determining unit 16a, an image processing unit 17a, a short range communication unit 18a, and a storage/reading processing unit 19a.
  • the units are functions that are implemented or means that function when one of the components illustrated in Fig. 2 is operated by a command from the CPU 101 according to the computer program developed on the RAM 103 from the SSD 104.
  • the electronic blackboard 1 includes a storage unit 1000a configured by the RAM 103 and the like illustrated in Fig. 2.
  • the transmitting and receiving unit 11a transmits and receives various type of data (or information) with the other terminal, device, or system via the communication network 4. Moreover, the transmitting and receiving unit 11a plays a role as a starting unit, and performs a process of starting communication with the other communication terminal such as the electronic blackboard 1. In this example, the transmitting and receiving unit 11a corresponds to a "transmitting unit", a “receiving unit", a “downloading unit”, and the like.
  • the reception unit 12a receives various inputs from the user via the electronic pen 190 and the like.
  • the video/sound processing unit 13a performs the main processing of the video conference function. For example, on the basis of the output signal from the microphone 140 and the output signal from the camera 160, the video/sound processing unit 13a performs digital processing such as encoding of video data and sound data. Moreover, on the basis of the video data and sound data received by the transmitting and receiving unit 11a, the video/sound processing unit 13a generates a video signal and a sound signal. The video/sound processing unit 13a performs a process of combining video data with different resolutions.
  • the display control unit 14a controls outputting of a video signal (image signal) and the like to the display 180.
  • the determining unit 15a performs various determinations.
  • the sharing priority determining unit 16a derives the order of downloading shared material (corresponds to the transmission order when viewed from the transmission side), when joining a remote conference in the middle of the conference.
  • the sharing priority determining unit 16a determines the order of downloading the shared material, while giving a high priority to the order of starting communication.
  • the sharing priority determining unit 16a corresponds to a "determining unit".
  • the order of starting communication indicates the order in which the participant who has joined the conference in the middle of the conference can join the conference immediately, for example, the order in which the shared material currently displayed or the shared material lately used is given a high priority.
  • the image processing unit 17a performs the main processing of the electronic blackboard function. For example, the image processing unit 17a creates a stroke image and stroke data on the basis of stroke of the electronic pen 190 and the like received by the reception unit 12a. The image processing unit 17a also creates a stroke image on the basis of the stroke data received by the transmitting and receiving unit 11a. Moreover, the image processing unit 17a generates an image signal, on the basis of the image data of the material image received by the transmitting and receiving unit 11a.
  • the short range communication unit 18a acquires and provides data between the terminals having a short range communication unit, through a short range wireless communication.
  • the storage/reading processing unit 19a performs a process of storing various types of data in the storage unit 1000a or a recording medium 1010a such as the USB memory 130, and reading out various types of data stored in the storage unit 1000a or the recording medium 1010a.
  • the video data and sound data received when the electronic blackboard 1 communicates with the other terminal are overwritten and stored in the storage unit 1000a every time the data is received.
  • An image is displayed on the display 180 by the video data before being overwritten, and sound is output from the speaker 150 by the sound data before being overwritten.
  • the communication management system 5 includes a transmitting and receiving unit 51, an authentication unit 52, a generation unit 53, a selection unit 54, a determining unit 55, and a storage/reading processing unit 59.
  • the units are functions that are implemented or means that function when one of the components illustrated in Fig. 5 is operated by a command from the CPU 501 according to the communication management program developed on the RAM 503 from the HD 504.
  • the communication management system 5 includes a storage unit 5000 configured by the HD 504.
  • the transmitting and receiving unit 51 transmits and receives various types of data (or information) with the other terminal, device, or system, via the communication network 4.
  • the transmitting and receiving unit 51 corresponds to a "transmitting unit” and a "receiving unit”.
  • the authentication unit 52 performs authentication by searching an authentication management database (DB) 5001.
  • DB authentication management database
  • the generation unit 53 generates a session ID for identifying the communication session.
  • the selection unit 54 performs a process of eventually selecting a single relay device 3 from a plurality of the relay devices 3.
  • the determining unit 55 performs various determinations.
  • the storage/reading processing unit 59 performs a process of storing various types of data in the storage unit 5000, and reading out the various types of data stored in the storage unit 5000.
  • the storage unit 5000 is configured of the authentication management DB 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a communication information management DB 5005, a storage server management DB 5006, and a message management DB 5007.
  • the authentication management DB 5001 passwords for the terminal IDs of the electronic blackboards 1 are managed in an associated manner.
  • the destination names when each of the electronic blackboards 1 is set as the destination, the operation status of the electronic blackboard 1, the reception date and time of login request information, which will be described below, received by the communication management system 5, and IP addresses of the electronic blackboards 1 (communication terminals) are managed in an associated manner, for each of the terminal IDs to identify the electronic blackboards 1 (communication terminals).
  • the destination list management DB 5003 all of the terminal IDs of the destination terminals registered as candidates for the electronic blackboard 1 (destination terminal) are managed in an associated manner, for the terminal ID of the electronic blackboard 1 (starting terminal) that requests to start communication.
  • the candidates of the destination terminal are updated by adding or eliminating a candidate, when a request for adding or eliminating a candidate to and from the communication management system 5 is received from any starting terminal.
  • the session management DB 5004 communication session IDs of the electronic blackboards (communication terminals) are managed.
  • the reception date and time, the IP address of the relay device 3, and the maximum data transmission speed (Mbps) of the relay device 3 are managed in an associated manner.
  • the storage server management DB 5006 the authentication information, the address, and the like of the storage server 7 are managed.
  • message management DB 5007 message information such as operation information is managed.
  • the electronic blackboard (communication terminal) 1 first receives operation information to receive the shared material that is already stored in the communication management system 5.
  • the operation information is information including the total page number, the displayed page, and the like of the shared material.
  • the sharing priority determining unit 16a executes the derivation flow for determining the order of material to be received.
  • the transmitting and receiving unit 11a receives the shared material from the reception starting page derived by the sharing priority determining unit 16a in a predetermined order. For example, the transmitting and receiving unit 11a increments the page number one by one from the reception starting page, and first receives a page with a larger page number with respect to a page being displayed. Then, upon receiving the final page which is the upper limit, the transmitting and receiving unit 11a increments the page number one by one from the first page at the beginning, the page number of which is smaller than the reference, and receives the remaining unreceived page.
  • Fig. 6 is a diagram illustrating an example of a derivation flow of a reception starting page derived by the sharing priority determining unit 16a.
  • the sharing priority determining unit 16a determines whether there is an unreceived page (step S1).
  • the sharing priority determining unit 16a sets the displayed page as the reference page (step S2).
  • the displayed page is a page being displayed on the electronic blackboards that have already joined the conference.
  • the page specified by the terminal of a sharing source of the shared material is also displayed on the electronic blackboards that are joining the conference.
  • the sharing priority determining unit 16a sets the displayed page as the page to be received with the highest priority.
  • the sharing priority determining unit 16a determines whether the reference page (first, the displayed page) is not yet received (step S3).
  • the transmitting and receiving unit 11a is instructed to set the reference page as the reception starting page (step S4). Consequently, the transmitting and receiving unit 11a receives material from the reception starting page in the predetermined order as described above.
  • step S3 when the displayed page set as the reference page has already been received (No at step S3), the same process is performed from step S3 in the predetermined order as described above, in other words, by incrementing the reference page by one (step S5).
  • the transmitting and receiving unit 11a starts receiving from page 4.
  • the transmitting and receiving unit 11a starts receiving from page 5.
  • the derivation process of the reception starting page is performed from page 1 (the page first used).
  • the electronic blackboard (communication terminal) that has joined the conference in the middle of the conference can first receive the displayed page, and then receive from the page that is most likely to be used. Consequently, even when joining the conference in the middle of the conference, the electronic blackboard can join the conference immediately.
  • the electronic blackboard determines the transmission order of the read material.
  • Fig. 7 is a diagram illustrating an example of a derivation flow of a transmission starting page when a file is being read.
  • Fig. 7 is different from Fig. 6 in transmitting instead of receiving, and the explanation of the flow is substantially the same as that of Fig. 6.
  • Step S11 to step S15 in Fig. 7 correspond to step S1 to step S5 in Fig. 6. Because the explanation of Fig. 7 is a repetition of Fig. 6, the description thereof will be omitted.
  • Fig. 8 is a diagram illustrating an example of displaying a screen of the display 180 of the electronic blackboard 1.
  • a menu button 1801 a control button 1802 of shared material, and the like are displayed on a screen 1800 of the electronic blackboard 1. Editing buttons for pen input, line color, line thickness, and the like are disposed in the menu button 1801.
  • the control button 1802 displays thumbnail images of the shared material (in Fig. 8, material from page 1 to page 4 among five pages), and can switch and change the page. Moreover, the control button 1802 can perform an input operation of a captured image.
  • the input page is as follows: (1) A screen on which a handwriting input is performed by a user using an electronic pen (2) By connecting the electronic blackboard with a personal computer (PC) or a tablet computer of a user via the Internet or a cable, a screen of the PC or the tablet computer of the user captured while the screen is displayed on the electronic blackboard (3) An image of the screen of the PC or the tablet computer of a user being captured on which a handwriting input is performed by the user using a pen (4) Pages of material in portable document format (PDF), Power Point, Word, or the like read by a user (5) Material such as PDF, Power Point, or Word read by a user, on which a handwriting input is performed by the user using a pen
  • PDF portable document format
  • Power Point Power Point
  • Word or the like
  • FIG. 9 is a schematic diagram illustrating an example of material sharing. It is assumed that the electronic blackboard (communication terminal) at the base A and the electronic blackboard (communication terminal) at the base B are joining a remote conference, and the electronic blackboard (communication terminal) at a base C (not illustrated) will join the conference in the middle of the conference. In below, the electronic blackboards (communication terminals) are explained using bases such as the bases A, B, and C for the sake of convenience.
  • the base A and the base B both hold the shared material, and when a change is made on the shared material at the base A, the change is also reflected on the shared material at the base B.
  • the operation information (changing the display position) of the shared material at the base A is transmitted to the communication management system 5 (message server).
  • the communication management system 5 Upon receiving the operation information (changing the display position) from the base A, the communication management system 5 stores the operation information, and transmits and broadcasts the operation information to the participants (other bases). Consequently, the base B receives the operation information (changing the display position), and can reflect the change in the shared material at the base B.
  • material is added/deleted to and from the shared material at the base A.
  • the base A uploads the material to the image storage device (storage server) 7.
  • the base A transmits the operation information (in this case, addition of material) to the communication management system 5 (message server).
  • the communication management system 5 Upon receiving the operation information (addition of material) from the base A, the communication management system 5 stores the operation information, and broadcasts and transmits the operation information to the participants.
  • the base B downloads the material from the image storage device (storage server) 7, and adds the material to the shared material.
  • FIG. 10 is a schematic diagram illustrating an example of material sharing when an electronic blackboard has joined the conference in the middle of the conference. It is assumed that the base A and the base B hold the shared material, and the displayed page is page 4. When the base C joins the conference at this point, the base C first obtains the operation information of the material from the communication management system 5 (message server).
  • the communication management system 5 messages server
  • the base C can detect that the displayed page is page 4. Consequently, the base C determines to start receiving from page 4 by the derivation process of the reception starting page, and configures the shared material by downloading the material data of page 4 from the image storage device (storage server) 7. Moreover, because the remote communication most likely proceeds along material, when the configuration of the displayed page is finished, the base C downloads the material of the next page (in this example, page 5), and sequentially downloads the following page and configures the shared material. Then, after downloading the final page (in this example, page 7), the base C downloads the remaining page (page 1, page 2, and page 3) from the first page, and configures the shared material.
  • the base C downloads the remaining page (page 1, page 2, and page 3) from the first page, and configures the shared material.
  • the base C changes the reception starting page accordingly so that the page to be downloaded is from the changed page.
  • the base A transmits the pages from the page required for communication. More specifically, the base A preferentially transmits the page displayed at the base A side. When the page displayed at the base A is changed, the base C changes the page to be preferentially transmitted accordingly.
  • the base C that has joined the conference in the middle of the conference can download the material from the page displayed on the base A and the base B.
  • the base C can join the remote communication immediately.
  • the configuration is illustrated in which the sharing priority determining unit is provided on the communication terminal, and when the communication terminal that has joined the remote conference in the middle of the conference executes the derivation flow described above, the communication terminal that has joined the remote conference in the middle of the conference can receive the page with a high priority from the displayed page.
  • the derivation process may also be performed at the server side such as the communication management system.
  • the derivation flow is executed by providing the sharing priority determining unit on the communication management system.
  • the derivation flow described above is executed, when the communication management system detects the communication terminal that has joined the remote conference in the middle of the conference, and transmits a page with a high priority to the communication terminal from the starting page (mainly, displayed page) determined in the derivation flow. Because the procedure of the derivation flow is substantially the same as that of the communication terminal, the detailed explanation of the flow at the server side will be omitted.
  • the computer program executed by the information processing device of the present embodiment may also be incorporated in the ROM in advance.
  • the computer program executed by the information processing device may also be recorded in a computer-readable recording medium such as a compact disc-read only memory (CD-ROM), a flexible disk (FD), a compact disc-recordable (CD-R), a digital versatile disc (DVD), and the like in an installable or executable file format.
  • the computer program executed by the information processing device may also be stored on a computer connected to a network such as the Internet, and provided by causing a user to download the computer program via the network.
  • the information transmission system can reduce the time required for displaying material in a remote conference.

Abstract

An information transmission system is configured to cause a plurality of terminals to perform a remote conference via a network, and includes: a storage control unit configured to store shared information including a plurality of pages to be shared among the plurality of terminals joining the same remote conference; a display control unit configured to control a page of the shared information displayed on the plurality of terminals joining the same remote conference; a determining unit configured to determine a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled by the display control unit; and a transmitting unit configured to transmit pages included in the shared information to the terminal in an order determined by the determining unit.

Description

INFORMATION TRANSMISSION SYSTEM, INFORMATION PROCESSING DEVICE, AND TRANSMISSION METHOD
The present invention relates to an information transmission system, an information processing device, and a transmission method.
As a system for performing a remote conference such as a video conference, a system has been known in which material is shared among the terminals of the participants at the same time when a remote communication including a video image, sound, and the like is taking place.
In the system for performing a remote conference, image data are shared among the terminals, by transmitting image data indicating the material being displayed on one terminal to the other terminal via a communication network (see PTL 1).
However, conventionally, each of the terminals that is to join a remote conference joins the remote conference after downloading the shared information to be shared among the terminals. For example, when the shared information is a file containing a plurality of pages, the shared information is displayed after all the pages of the shared information are downloaded. Consequently, for example, when the material used (being displayed) in the remote conference is page 4, and when material is downloaded from page 1, the participant cannot immediately display the data currently used, while the data is being downloaded. In the case when the data amount of material is large, the network bandwidth is narrow, or the like, it takes longer time to share material, and it takes time to display the material currently used.
The present invention has been made in view of the above, and an object of the present invention is to provide an information transmission system, an information processing device, and a transmission method that can reduce the time required for displaying material in a remote conference.
According to an aspect of the present invention, an information transmission system is configured to cause a plurality of terminals to perform a remote conference via a network. The information transmission system includes a storage control unit, a display control unit, a determining unit, and a transmitting unit. The storage control unit is configured to store shared information including a plurality of pages to be shared among the plurality of terminals joining the same remote conference. The display control unit is configured to control a page of the shared information displayed on the plurality of terminals joining the same remote conference. The determining unit is configured to determine a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled by the display control unit. The transmitting unit is configured to transmit pages included in the shared information to the terminal in an order determined by the determining unit.
According to an aspect of the present invention, it is possible to reduce the time required for displaying material in a remote conference.
Fig. 1 is a schematic diagram of an information transmission system according to the present embodiment. Fig. 2 is a diagram illustrating an example of a hardware configuration of an electronic blackboard. Fig. 3 is a diagram illustrating an example of a hardware configuration of a communication management system. Fig. 4 is a diagram illustrating an example of a configuration of functional blocks of the electronic blackboard. Fig. 5 is a diagram illustrating an example of a configuration of functional blocks of the communication management system. Fig. 6 is a diagram illustrating an example of a derivation flow of a reception starting page derived by a sharing priority determining unit. Fig. 7 is a diagram illustrating an example of a derivation flow of a transmission starting page when a file is being read. Fig. 8 is a diagram illustrating an example of displaying a screen of the display of the electronic blackboard. Fig. 9 is a schematic diagram illustrating an example of material sharing. Fig. 10 is a schematic diagram illustrating an example of material sharing when joining in the middle.
Hereinafter, embodiments of an information transmission system, an information processing device, a transmission method, and a computer program according to the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, an electronic blackboard is an example of a "terminal". A communication management system (message server) and a storage server are examples of a "server". Moreover, the electronic blackboard, the communication management system (message server), and the storage server are examples of an "information processing device".
Embodiment
First, with reference to Fig. 1, an information transmission system for performing a remote conference while drawing on a plurality of electronic blackboards 1 will be described. Fig. 1 is a schematic diagram of an information transmission system according to the present embodiment. It is to be noted that the remote conference includes a "video conference (may also be referred to as a TV conference)" and the like.
The information transmission system includes the electronic blackboards 1, a communication management system 5, and a storage server 7. The information transmission system also includes a relay device for relaying data transmitted and received between the devices and the like. For example, the electronic blackboards 1 at a base A and a base B communicate with each other, by mutually communicating video data and sound data for communication, and shared material data (hereinafter, data (including an image) to be shared may be collectively referred to as shared material) such as image data and stroke data to be shared. The stroke data is data required for reproducing (regenerating) a stroke image, and includes coordinate data, data on line width, data on line color, vector data, and the like. By transmitting and receiving the video data and sound data for communication, and reproducing the video and sound of the other party, the electronic blackboards 1 can perform remote video communication.
With the electronic blackboards 1, by transmitting and receiving data (data of a plurality of pages such as image data) of shared material that is shared information, the participants who use the present system can share the same material image. The material image is an image to be displayed on the display of the electronic blackboard 1, and is an image such as material of the conference, a background image to be displayed on the display, a capture screen when the display screen is captured, and the like. Moreover, with the electronic blackboards 1, by transmitting and receiving the stroke data of the stroke image to be shared, the participants who use the present system can share the same stroke image. The stroke image is an image of a line and the like drawn by a user with a handwritten stroke using an electronic pen and the like. The stroke image is displayed by stroke data indicating the points that specify the coordinates on the display.
Fig. 1 illustrates two electronic blackboards 1. However, data may also be shared among three or more electronic blackboards when an electronic blackboard joins (is added to) the conference in the middle of the conference.
Fig. 1 illustrates the electronic blackboards each installed with a video conference function, as an example of the electronic blackboard 1. The image of the video data may be a moving image or a still image.
Moreover, the electronic blackboard serving as a request source that requests the start of a video conference is indicated as a "starting terminal". An electronic blackboard serving as a destination (relay destination) that is a request destination is indicated as a "destination terminal".
The communication management system 5 is configured by a computer, and manages login authentication from the electronic blackboard 1, communication status of the electronic blackboard 1, an address list, and the like. Moreover, the communication management system 5 also functions as a message server (an example of a "storage control unit"), and manages operation information and stroke data to be shared among the electronic blackboards 1. The operation information is information indicating operations such as adding, deleting, or writing material to be shared, and changing the display position. Because the operation information is transmitted and received as information for controlling the display on the electronic blackboards 1, the communication management system 5 also functions as a "display control unit". For example, changing the display position is to change the material page to be displayed, such as to change from page 1 to page 2 of the material.
The storage server (an example of the "storage control unit") 7 is configured by a computer, stores the image data of the shared material that is uploaded from the electronic blackboard 1, and causes the electronic blackboard 1 of the other participant to download the image data.
The communication management system 5 and the storage server 7 may be configured by a single computer or a plurality of computers in which the units (functions or means) are divided and optionally assigned.
Moreover, in the present system, it is assumed that a management information session for transmitting and receiving various types of management information is established between the electronic blackboards 1 via the communication management system 5.
Hardware Configuration of Electronic Blackboard
Fig. 2 is a diagram illustrating an example of a hardware configuration of the electronic blackboard 1. As illustrated in Fig. 2, the electronic blackboard 1 includes a central processing unit (CPU) 101, a read only memory (ROM) 102, a random access memory (RAM) 103, a solid state drive (SSD) 104, a network interface (I/F) 105, and an external device connection interface (I/F) 106.
In the above, the CPU 101 controls the entire operation of the electronic blackboard 1. The ROM 102 stores therein a computer program used in the CPU 101 and used for driving the CPU 101 such as an initial program loader (IPL). The RAM 103 is used as a work area for the CPU 101. The SSD 104 stores therein various types of data such as a computer program for the electronic blackboard. The network I/F 105 controls communication with a communication network 4. The external device connection I/F 106 is an interface for connecting various external devices. In this case, for example, the external device includes a universal serial bus (USB) memory 130, and an external device (microphone 140, a speaker 150, and a camera 160).
Moreover, the electronic blackboard 1 includes a capture device 111, a graphics processing unit (GPU) 112, a display controller 113, a touch sensor 114, a sensor controller 115, an electronic pen controller 116, a short range communication circuit 119, an antenna 119a for the short range communication circuit 119, a power switch 122, and selection switches 123.
In the above, the capture device 111 causes the display of an external personal computer (PC) 170 to display video information as a still image or a moving image. The GPU 112 is a semiconductor chip that specializes graphics. The display controller 113 controls and manages the displaying of the screen so that an output image from the GPU 112 is output to a display 180 and the like.
The touch sensor 114 detects an electronic pen 190, a hand H of a user, or the like that has come into contact with the display 180. The sensor controller 115 controls the process of the touch sensor 114.
The touch sensor 114 inputs and detects coordinates using an infrared interception method. The method for inputting and detecting coordinates is a method in which two light emitting and receiving devices installed on both upper ends of the display 180 emit a plurality of infrared rays in parallel with the display 180, and receive the light that is reflected by a reflection member provided on the periphery of the display 180, and that returns on the optical path the same as that of the light emitted by a photodetector. The touch sensor 114 outputs the identifications (IDs) of the infrared rays that are emitted from the two light emitting and receiving devices and that are blocked by an object, to the sensor controller 115. The sensor controller 115 specifies the coordinate position that is the contact location of the object. The electronic pen controller 116 then determines whether the pen tip or the pen bottom of the electronic pen 190 has touched the display 180, by communicating with the electronic pen 190. The short range communication circuit 119 is a communication circuit for near field communication (NFC), Bluetooth (registered trademark), and the like. The power switch 122 is a switch for switching ON/OFF of the electric power of the electronic blackboard 1. For example, the selection switches 123 are a group of switches used for adjusting the contrast, color, and the like of the display 180.
Moreover, the electronic blackboard 1 includes a bus line 110. The bus line 110 is an address bus, a data bus, and the like for electrically connecting the components such as the CPU 101 illustrated in Fig. 2.
The touch sensor 114 is not limited to the infrared interception method. The touch sensor 114 may also be various detection units such as an electrostatic capacitance type touch panel, a resistance film type touch panel, and an electromagnetic induction type touch panel. The electrostatic capacitance type touch panel specifies the contact location by detecting a change in the electrostatic capacity. The resistance film type touch panel specifies the contact location by a change in voltage of the two facing resistance films. The electromagnetic induction type touch panel specifies the contact location by detecting the electromagnetic induction generated when a contact object comes into contact with a display unit. Moreover, the electronic pen controller 116 may determine whether a portion of the electronic pen 190 gripped by a user or the other portion of the electronic pen has touched the display unit, in addition to the pen point and the pen bottom of the electronic pen 190.
Hardware Configuration of Communication Management System and Storage Server
Fig. 3 is a diagram illustrating an example of a hardware configuration of the communication management system 5 according to the present embodiment. The computer serving as an example of the communication management system 5 includes a CPU 501, a ROM 502, a RAM 503, a hard disk (HD) 504, a hard disk drive (HDD) controller 505, a display 506, an external device connection interface (I/F) 508, a network I/F 509, a keyboard 511, a pointing device 512, a digital versatile disc rewritable (DVD-RW) drive 514, a media I/F 516, and a bus line 510.
In the above, the CPU 501 controls the entire operation of the communication management system 5. The ROM 502 stores therein a computer program used for driving the CPU 501 such as the IPL. The RAM 503 is used as a work area for the CPU 501. The HD 504 stores therein various types of data such as a communication management program. The HDD controller 505 controls reading or writing of various types of data from and to the HD 504 according to the control of the CPU 501.
The display 506 displays various types of information such as a cursor, a menu, a window, a character, or an image. The external device connection I/F 508 is an interface for connecting various external devices. The network I/F 509 is an interface for communicating data by using the communication network 4 such as the Internet. The keyboard 511 is a type of input means including a plurality of keys for entering a character, a numerical value, various instructions, and the like. The pointing device 12 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like.
The DVD-RW drive 514 controls reading or writing (storing) of data from and to the DVD-RW. The DVD-RW drive 514 may also control reading or writing (storing) of data from and to a disk such as Blu-ray (registered trademark) Disc Rewritable (BD-RE), in addition to the DVD-RW drive. The media I/F 516 controls reading or writing (storing) of data from and to a recording medium 515 such as a flash memory.
Moreover, the bus line 510 is an address bus, a data bus, or the like for electrically connecting the components such as the CPU 501 illustrated in Fig. 3.
Because the hardware configuration of the storage server 7 illustrated in Fig. 1 is the same as the hardware configuration of the communication management system 5, the description thereof will be omitted. However, in the case of the storage server 7, an image storage program is stored in the HD 504.
Functional Configuration of Electronic Blackboard 1
As illustrated in Fig. 4, the electronic blackboard 1 includes a transmitting and receiving unit 11a, a reception unit 12a, a video/sound processing unit 13a, a display control unit 14a, a determining unit 15a, a sharing priority determining unit 16a, an image processing unit 17a, a short range communication unit 18a, and a storage/reading processing unit 19a. The units are functions that are implemented or means that function when one of the components illustrated in Fig. 2 is operated by a command from the CPU 101 according to the computer program developed on the RAM 103 from the SSD 104. Moreover, the electronic blackboard 1 includes a storage unit 1000a configured by the RAM 103 and the like illustrated in Fig. 2.
The transmitting and receiving unit 11a transmits and receives various type of data (or information) with the other terminal, device, or system via the communication network 4. Moreover, the transmitting and receiving unit 11a plays a role as a starting unit, and performs a process of starting communication with the other communication terminal such as the electronic blackboard 1. In this example, the transmitting and receiving unit 11a corresponds to a "transmitting unit", a "receiving unit", a "downloading unit", and the like. The reception unit 12a receives various inputs from the user via the electronic pen 190 and the like.
The video/sound processing unit 13a performs the main processing of the video conference function. For example, on the basis of the output signal from the microphone 140 and the output signal from the camera 160, the video/sound processing unit 13a performs digital processing such as encoding of video data and sound data. Moreover, on the basis of the video data and sound data received by the transmitting and receiving unit 11a, the video/sound processing unit 13a generates a video signal and a sound signal. The video/sound processing unit 13a performs a process of combining video data with different resolutions.
The display control unit 14a controls outputting of a video signal (image signal) and the like to the display 180. The determining unit 15a performs various determinations.
The sharing priority determining unit 16a derives the order of downloading shared material (corresponds to the transmission order when viewed from the transmission side), when joining a remote conference in the middle of the conference. In this example, the sharing priority determining unit 16a determines the order of downloading the shared material, while giving a high priority to the order of starting communication. The sharing priority determining unit 16a corresponds to a "determining unit". The order of starting communication indicates the order in which the participant who has joined the conference in the middle of the conference can join the conference immediately, for example, the order in which the shared material currently displayed or the shared material lately used is given a high priority.
The image processing unit 17a performs the main processing of the electronic blackboard function. For example, the image processing unit 17a creates a stroke image and stroke data on the basis of stroke of the electronic pen 190 and the like received by the reception unit 12a. The image processing unit 17a also creates a stroke image on the basis of the stroke data received by the transmitting and receiving unit 11a. Moreover, the image processing unit 17a generates an image signal, on the basis of the image data of the material image received by the transmitting and receiving unit 11a.
The short range communication unit 18a acquires and provides data between the terminals having a short range communication unit, through a short range wireless communication.
The storage/reading processing unit 19a performs a process of storing various types of data in the storage unit 1000a or a recording medium 1010a such as the USB memory 130, and reading out various types of data stored in the storage unit 1000a or the recording medium 1010a.
Moreover, the video data and sound data received when the electronic blackboard 1 communicates with the other terminal are overwritten and stored in the storage unit 1000a every time the data is received. An image is displayed on the display 180 by the video data before being overwritten, and sound is output from the speaker 150 by the sound data before being overwritten.
Functional Configuration of Communication Management System
As illustrated in Fig. 5, the communication management system 5 includes a transmitting and receiving unit 51, an authentication unit 52, a generation unit 53, a selection unit 54, a determining unit 55, and a storage/reading processing unit 59. The units are functions that are implemented or means that function when one of the components illustrated in Fig. 5 is operated by a command from the CPU 501 according to the communication management program developed on the RAM 503 from the HD 504. Moreover, the communication management system 5 includes a storage unit 5000 configured by the HD 504.
The transmitting and receiving unit 51 transmits and receives various types of data (or information) with the other terminal, device, or system, via the communication network 4. In this example, the transmitting and receiving unit 51 corresponds to a "transmitting unit" and a "receiving unit". The authentication unit 52 performs authentication by searching an authentication management database (DB) 5001. On the basis of a communication starting request from the electronic blackboard 1, the generation unit 53 generates a session ID for identifying the communication session. The selection unit 54 performs a process of eventually selecting a single relay device 3 from a plurality of the relay devices 3. The determining unit 55 performs various determinations. The storage/reading processing unit 59 performs a process of storing various types of data in the storage unit 5000, and reading out the various types of data stored in the storage unit 5000.
Configuration of Database
The storage unit 5000 is configured of the authentication management DB 5001, a terminal management DB 5002, a destination list management DB 5003, a session management DB 5004, a communication information management DB 5005, a storage server management DB 5006, and a message management DB 5007.
In the authentication management DB 5001, passwords for the terminal IDs of the electronic blackboards 1 are managed in an associated manner. In the terminal management DB 5002, the destination names when each of the electronic blackboards 1 is set as the destination, the operation status of the electronic blackboard 1, the reception date and time of login request information, which will be described below, received by the communication management system 5, and IP addresses of the electronic blackboards 1 (communication terminals) are managed in an associated manner, for each of the terminal IDs to identify the electronic blackboards 1 (communication terminals).
In the destination list management DB 5003, all of the terminal IDs of the destination terminals registered as candidates for the electronic blackboard 1 (destination terminal) are managed in an associated manner, for the terminal ID of the electronic blackboard 1 (starting terminal) that requests to start communication. The candidates of the destination terminal are updated by adding or eliminating a candidate, when a request for adding or eliminating a candidate to and from the communication management system 5 is received from any starting terminal. In the session management DB 5004, communication session IDs of the electronic blackboards (communication terminals) are managed. In the communication information management DB 5005, the reception date and time, the IP address of the relay device 3, and the maximum data transmission speed (Mbps) of the relay device 3 are managed in an associated manner.
In the storage server management DB 5006, the authentication information, the address, and the like of the storage server 7 are managed. In the message management DB 5007, message information such as operation information is managed.
Reception Derivation Flow
Next, a reception flow of shared material when an electronic blackboard joins a conference in the middle of the conference will be described. When an electronic blackboard joins the conference that has already started, the electronic blackboard (communication terminal) 1 first receives operation information to receive the shared material that is already stored in the communication management system 5. The operation information is information including the total page number, the displayed page, and the like of the shared material. In the electronic blackboard 1, on the basis of the received operation information, the sharing priority determining unit 16a executes the derivation flow for determining the order of material to be received.
The transmitting and receiving unit 11a receives the shared material from the reception starting page derived by the sharing priority determining unit 16a in a predetermined order. For example, the transmitting and receiving unit 11a increments the page number one by one from the reception starting page, and first receives a page with a larger page number with respect to a page being displayed. Then, upon receiving the final page which is the upper limit, the transmitting and receiving unit 11a increments the page number one by one from the first page at the beginning, the page number of which is smaller than the reference, and receives the remaining unreceived page.
Fig. 6 is a diagram illustrating an example of a derivation flow of a reception starting page derived by the sharing priority determining unit 16a. First, on the basis of the received operation information, the sharing priority determining unit 16a determines whether there is an unreceived page (step S1).
When there is an unreceived page (Yes at step S1), the sharing priority determining unit 16a sets the displayed page as the reference page (step S2). The displayed page is a page being displayed on the electronic blackboards that have already joined the conference. The page specified by the terminal of a sharing source of the shared material is also displayed on the electronic blackboards that are joining the conference. In other words, the sharing priority determining unit 16a sets the displayed page as the page to be received with the highest priority.
Next, the sharing priority determining unit 16a determines whether the reference page (first, the displayed page) is not yet received (step S3). When the reference page is not yet received (Yes at step S3), the transmitting and receiving unit 11a is instructed to set the reference page as the reception starting page (step S4). Consequently, the transmitting and receiving unit 11a receives material from the reception starting page in the predetermined order as described above.
When there is no unreceived page (No at step S1), all material have been received. Consequently, the derivation process will be finished.
Moreover, when the displayed page set as the reference page has already been received (No at step S3), the same process is performed from step S3 in the predetermined order as described above, in other words, by incrementing the reference page by one (step S5). For example, when the displayed page is page 3, and the page 3 has already been received, the transmitting and receiving unit 11a starts receiving from page 4. When the page 4 has already been received, the transmitting and receiving unit 11a starts receiving from page 5. When the final page has already been received, the derivation process of the reception starting page is performed from page 1 (the page first used).
In this manner, the electronic blackboard (communication terminal) that has joined the conference in the middle of the conference can first receive the displayed page, and then receive from the page that is most likely to be used. Consequently, even when joining the conference in the middle of the conference, the electronic blackboard can join the conference immediately.
When the displayed page on the electronic blackboards that have already joined the conference is changed, while the electronic blackboard (communication terminal) that has joined the conference in the middle of the conference is sequentially receiving material from the reception starting page that is determined by the derivation process described above, the reception will be interrupted. Then, the derivation flow of the reception starting page will be performed again, and the reception starting page will be determined again. Consequently, when the displayed page is changed in the halfway, the electronic blackboard (communication terminal) that has joined the conference in the middle of the conference can correspond to the change immediately, and preferentially receive the changed page that is being used.
Transmission Derivation Flow
When material is read while a remote communication is taking place, the electronic blackboard (communication terminal) determines the transmission order of the read material.
Fig. 7 is a diagram illustrating an example of a derivation flow of a transmission starting page when a file is being read. Fig. 7 is different from Fig. 6 in transmitting instead of receiving, and the explanation of the flow is substantially the same as that of Fig. 6. Step S11 to step S15 in Fig. 7 correspond to step S1 to step S5 in Fig. 6. Because the explanation of Fig. 7 is a repetition of Fig. 6, the description thereof will be omitted.
Fig. 8 is a diagram illustrating an example of displaying a screen of the display 180 of the electronic blackboard 1. As illustrated in Fig. 8, a menu button 1801, a control button 1802 of shared material, and the like are displayed on a screen 1800 of the electronic blackboard 1. Editing buttons for pen input, line color, line thickness, and the like are disposed in the menu button 1801.
The control button 1802 displays thumbnail images of the shared material (in Fig. 8, material from page 1 to page 4 among five pages), and can switch and change the page. Moreover, the control button 1802 can perform an input operation of a captured image.
For example, the input page is as follows:
(1) A screen on which a handwriting input is performed by a user using an electronic pen
(2) By connecting the electronic blackboard with a personal computer (PC) or a tablet computer of a user via the Internet or a cable, a screen of the PC or the tablet computer of the user captured while the screen is displayed on the electronic blackboard
(3) An image of the screen of the PC or the tablet computer of a user being captured on which a handwriting input is performed by the user using a pen
(4) Pages of material in portable document format (PDF), Power Point, Word, or the like read by a user
(5) Material such as PDF, Power Point, or Word read by a user, on which a handwriting input is performed by the user using a pen
Explanation of Sequence of Material Sharing Among Participants
Fig. 9 is a schematic diagram illustrating an example of material sharing. It is assumed that the electronic blackboard (communication terminal) at the base A and the electronic blackboard (communication terminal) at the base B are joining a remote conference, and the electronic blackboard (communication terminal) at a base C (not illustrated) will join the conference in the middle of the conference. In below, the electronic blackboards (communication terminals) are explained using bases such as the bases A, B, and C for the sake of convenience.
The base A and the base B both hold the shared material, and when a change is made on the shared material at the base A, the change is also reflected on the shared material at the base B. For example, it is assumed that the display position of the shared material is changed at the base A. In this case, the operation information (changing the display position) of the shared material at the base A is transmitted to the communication management system 5 (message server). Upon receiving the operation information (changing the display position) from the base A, the communication management system 5 stores the operation information, and transmits and broadcasts the operation information to the participants (other bases). Consequently, the base B receives the operation information (changing the display position), and can reflect the change in the shared material at the base B.
Moreover, material is added/deleted to and from the shared material at the base A. For example, it is assumed that a material image is added. In this case, the base A uploads the material to the image storage device (storage server) 7. Moreover, the base A transmits the operation information (in this case, addition of material) to the communication management system 5 (message server). Upon receiving the operation information (addition of material) from the base A, the communication management system 5 stores the operation information, and broadcasts and transmits the operation information to the participants. Upon receiving the operation information (addition of material), the base B downloads the material from the image storage device (storage server) 7, and adds the material to the shared material.
Explanation of Sequence of Material Sharing When Electronic Blackboard Joins Conference in Middle of Conference
Fig. 10 is a schematic diagram illustrating an example of material sharing when an electronic blackboard has joined the conference in the middle of the conference. It is assumed that the base A and the base B hold the shared material, and the displayed page is page 4. When the base C joins the conference at this point, the base C first obtains the operation information of the material from the communication management system 5 (message server).
From the acquired operation information, the base C can detect that the displayed page is page 4. Consequently, the base C determines to start receiving from page 4 by the derivation process of the reception starting page, and configures the shared material by downloading the material data of page 4 from the image storage device (storage server) 7. Moreover, because the remote communication most likely proceeds along material, when the configuration of the displayed page is finished, the base C downloads the material of the next page (in this example, page 5), and sequentially downloads the following page and configures the shared material. Then, after downloading the final page (in this example, page 7), the base C downloads the remaining page (page 1, page 2, and page 3) from the first page, and configures the shared material.
Moreover, when the displayed page is changed while the page is being shared, the base C changes the reception starting page accordingly so that the page to be downloaded is from the changed page.
Furthermore, for example, when large-sized material is to be shared, such as when the large-sized material is read at the base A, the base A transmits the pages from the page required for communication. More specifically, the base A preferentially transmits the page displayed at the base A side. When the page displayed at the base A is changed, the base C changes the page to be preferentially transmitted accordingly.
In this manner, the base C that has joined the conference in the middle of the conference can download the material from the page displayed on the base A and the base B. Thus, even when the other material not being displayed is not yet downloaded, the base C can join the remote communication immediately.
In the present embodiment, the configuration is illustrated in which the sharing priority determining unit is provided on the communication terminal, and when the communication terminal that has joined the remote conference in the middle of the conference executes the derivation flow described above, the communication terminal that has joined the remote conference in the middle of the conference can receive the page with a high priority from the displayed page. However, the derivation process may also be performed at the server side such as the communication management system. For example, the derivation flow is executed by providing the sharing priority determining unit on the communication management system. In this case, the derivation flow described above is executed, when the communication management system detects the communication terminal that has joined the remote conference in the middle of the conference, and transmits a page with a high priority to the communication terminal from the starting page (mainly, displayed page) determined in the derivation flow. Because the procedure of the derivation flow is substantially the same as that of the communication terminal, the detailed explanation of the flow at the server side will be omitted.
The computer program executed by the information processing device of the present embodiment may also be incorporated in the ROM in advance. Moreover, the computer program executed by the information processing device may also be recorded in a computer-readable recording medium such as a compact disc-read only memory (CD-ROM), a flexible disk (FD), a compact disc-recordable (CD-R), a digital versatile disc (DVD), and the like in an installable or executable file format. Furthermore, the computer program executed by the information processing device may also be stored on a computer connected to a network such as the Internet, and provided by causing a user to download the computer program via the network.
Effects
As described above, the information transmission system according to the present embodiment can reduce the time required for displaying material in a remote conference.
1 Electronic blackboard
11a Transmitting and receiving unit
12a Reception unit
13a Video/sound processing unit
14a Display control unit
15a Determining unit
16a Sharing priority determining unit
17a Image processing unit
18a Short range communication unit
19a Storage/reading processing unit
Japanese Laid-open Patent Publication No. 2011-254453

Claims (11)

  1. 　　An information transmission system configured to cause a plurality of terminals to perform a remote conference via a network, the information transmission system comprising:
    　　a storage control unit configured to store shared information including a plurality of pages to be shared among the plurality of terminals joining the same remote conference;
    　　a display control unit configured to control a page of the shared information displayed on the plurality of terminals joining the same remote conference;
    　　a determining unit configured to determine a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled by the display control unit; and
    　　a transmitting unit configured to transmit pages included in the shared information to the terminal in an order determined by the determining unit.
  2. 　　The information transmission system according to claim 1, wherein the determining unit is configured to determine the transmission order to give highest priority to a page displayed by a terminal joining the same remote conference.
  3. 　　The information transmission system according to claim 2, wherein the transmitting unit is configured to transmit a reference page, a page with a page number larger than a page number of the reference page, and then a page with a page number smaller than the page number of the reference page, the reference page being a page displayed by the terminal joining the same remote conference.
  4. 　　The information transmission system according to claim 3, wherein the determining unit is configure to, in response to a change in a page displayed by the terminal joining the same remote conference, determine the transmission order again based on the page after the change.
  5. 　　The information transmission system according to any one of claims 1 to 4, wherein the determining unit is configured to determine the transmission order in response to the terminal joining the remote conference in middle.
  6. 　　An information processing device configured to perform a remote conference with a plurality of other information processing devices via a network, the information processing device comprising:
    　　a determining unit configured to determine an order of downloading pages of shared information to be displayed on the information processing device joining the same remote conference according to a page of the shared information, display of which is controlled in the information processing device; and
    　　a downloading unit configured to download pages included in the shared information in an order determined by the determining unit.
  7. 　　The information processing device according to claim 6, wherein the determining unit is configured to determine the order of downloading by giving highest priority to a page displayed by an information processing device that is joining the same remote conference.
  8. 　　The information processing device according to claim 7, wherein the downloading unit is configured to download a reference page, a page with a page number larger than a page number of the reference page, and then a page with a page number smaller than the page number of the reference page, the reference page being a page displayed by the information processing device that is joining the same remote conference.
  9. 　　The information processing device according to claim 8, wherein the determining unit is configured to, in response to a change in a page displayed by the information processing device joining the same remote conference, determine the order of downloading again based on the page after change.
  10. 　　An information processing device configured to manage a remote conference among a plurality of terminals, the information processing device comprising:
    　　a storage control unit configured to store shared information including a plurality of pages to be shared among the plurality of terminals joining the same remote conference;
    　　a display control unit configured to control a page of the shared information displayed on the plurality of terminals joining the same remote conference;
    　　a determining unit configured to determine a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled by the display control unit; and
    　　a transmitting unit configured to transmit pages included in the shared information to the terminal in an order determined by the determining unit.
  11. 　　A transmission method for transmitting a plurality of pages included in shared information in an information transmission system configured to cause a plurality of terminals to perform a remote conference, the transmission method comprising:
    　　controlling a page of the shared information displayed on the plurality of terminals joining the same remote conference;
    　　determining a transmission order of pages of the shared information to be transmitted to a terminal joining the same remote conference according to a page of the shared information, display of which is controlled; and
    　　transmitting pages included in the shared information to the terminal in an order determined at the determining.
PCT/JP2020/012140 2019-03-20 2020-03-18 Information transmission system, information processing device, and transmission method WO2020189742A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2019053898 2019-03-20
JP2019-053898 2019-03-20
JP2020-010069 2020-01-24
JP2020010069A JP2020161120A (en) 2019-03-20 2020-01-24 Information transmission system, information processing apparatus, transmission method, and program

Publications (1)

Publication Number Publication Date
WO2020189742A1 true WO2020189742A1 (en) 2020-09-24

Family

ID=70166101

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/012140 WO2020189742A1 (en) 2019-03-20 2020-03-18 Information transmission system, information processing device, and transmission method

Country Status (1)

Country Link
WO (1) WO2020189742A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6573926B1 (en) * 1998-06-30 2003-06-03 Nec Corporation Method for distributing documents in conference system
US7996566B1 (en) * 2008-12-23 2011-08-09 Genband Us Llc Media sharing
JP2011254453A (en) 2010-05-06 2011-12-15 Ricoh Co Ltd Transmission terminal, transmission method, and program for transmission
US20120151336A1 (en) * 2010-12-14 2012-06-14 International Business Machines Corporation Generation and caching of content in anticipation of presenting content in web conferences
EP2840759A1 (en) * 2013-08-21 2015-02-25 Ricoh Company, Ltd. Information processing system, information transmission method and program
US20150149532A1 (en) * 2013-11-27 2015-05-28 Ricoh Company, Ltd. Information processing system, terminal device, and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6573926B1 (en) * 1998-06-30 2003-06-03 Nec Corporation Method for distributing documents in conference system
US7996566B1 (en) * 2008-12-23 2011-08-09 Genband Us Llc Media sharing
JP2011254453A (en) 2010-05-06 2011-12-15 Ricoh Co Ltd Transmission terminal, transmission method, and program for transmission
US20120151336A1 (en) * 2010-12-14 2012-06-14 International Business Machines Corporation Generation and caching of content in anticipation of presenting content in web conferences
EP2840759A1 (en) * 2013-08-21 2015-02-25 Ricoh Company, Ltd. Information processing system, information transmission method and program
US20150149532A1 (en) * 2013-11-27 2015-05-28 Ricoh Company, Ltd. Information processing system, terminal device, and method

Similar Documents

Publication Publication Date Title
US11146695B2 (en) Communication management system, communication system, communication control method, and recording medium
EP3076587B1 (en) Communication terminal, communication system, communication method, and carrier means
JP6582562B2 (en) Communication terminal, communication system, communication method, and program
US11394757B2 (en) Communication terminal, communication system, and method of sharing data
EP3304323B1 (en) Communication terminal, communication control method and recording medium for sharing and displaying stroke data
EP3076588A1 (en) Communication management system, communication terminal, communication system, communication control method, and carrier means
US10511700B2 (en) Communication terminal with first application displaying status of second application
EP3177008A1 (en) Communication terminal, communication system, communication control method, and carrier means
EP3133808B1 (en) Apparatus, system, and method of controlling display of image, and carrier means
US20150341435A1 (en) Communication system, transfer control device, and communication method
US10346121B2 (en) Communication terminal, communication system, display control method, and recording medium
JP7006330B2 (en) Information processing equipment, image sharing system, image sharing method and program
WO2020189742A1 (en) Information transmission system, information processing device, and transmission method
JP6773145B2 (en) Electronic blackboards, communication systems, communication control methods, and programs
JP6819055B2 (en) Communication terminals, communication systems, communication methods, and programs
JP2020161120A (en) Information transmission system, information processing apparatus, transmission method, and program
JP2017118442A (en) Shared terminal, communication system, communication method, and program
JP6776905B2 (en) Communication terminals, communication systems, display control methods, and programs
JP6561617B2 (en) Mobile terminal, communication system, communication method, and program
JP7358934B2 (en) Communication management system, communication system, communication method, and program
US11330117B2 (en) Information processing apparatus, information processing system, and information processing method for receiving an image displayed on an image display apparatus upon detecting a predetermined condition is satisfied
US11343292B2 (en) Information processing apparatus, information processing system, and remote sharing method
JP6812645B2 (en) Communication terminals, communication systems, communication methods, and programs
JP2016195389A (en) Communication management system, communication system, communication management method, and program
JP6736919B2 (en) Communication terminal, communication system, communication method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20716966

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20716966

Country of ref document: EP

Kind code of ref document: A1