WO2022259375A1 - Information sharing system, image processing device, information sharing method, and program - Google Patents

Information sharing system, image processing device, information sharing method, and program Download PDF

Info

Publication number
WO2022259375A1
WO2022259375A1 PCT/JP2021/021781 JP2021021781W WO2022259375A1 WO 2022259375 A1 WO2022259375 A1 WO 2022259375A1 JP 2021021781 W JP2021021781 W JP 2021021781W WO 2022259375 A1 WO2022259375 A1 WO 2022259375A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
video
point
information
display device
Prior art date
Application number
PCT/JP2021/021781
Other languages
French (fr)
Japanese (ja)
Inventor
光洋 我妻
淳 嵯峨田
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2021/021781 priority Critical patent/WO2022259375A1/en
Priority to JP2023527212A priority patent/JPWO2022259375A1/ja
Publication of WO2022259375A1 publication Critical patent/WO2022259375A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present invention relates to a system for dialogue between remote locations.
  • Patent Document 1 There is a conventional technique for having a dialogue by installing cameras at two or more remote locations and transmitting and receiving video and audio to each other (for example, Patent Document 1). With this technology, a person at a certain location can have a dialogue with the other person while looking at the other person's face or the state of the remote location.
  • the present invention has been made in view of the above points. To provide a technology that enables appropriate sharing of information between remote locations without trouble.
  • an information sharing system for sharing information between at least a first point and a second point connected by a network, at least two cameras including a first camera and a second camera at the first point;
  • a video display device is provided at the second point, An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted.
  • transmitted to the video display device at the second point The frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera.
  • An information sharing system is provided that has a higher resolution than the video captured by the camera.
  • the images of people are transmitted and received, and the images of information described in information recording media are transmitted and received appropriately between remote locations without trouble. It becomes possible to share to
  • FIG. 1 is an overall configuration diagram of a communication system according to the present embodiment
  • FIG. 2 is a diagram showing a configuration example of a student-side system
  • FIG. It is a figure which shows the structural example of the teacher side system. It is a figure which shows the structural example of the teacher side system. It is a figure which shows the functional structural example of a camera. It is a figure which shows the structural example in the case of grouping. It is a figure which shows the example of time allocation in the case of grouping. It is a figure which shows the hardware configuration example of an apparatus.
  • an educational site where teachers and students are separated from each other is taken as an example, but this is just an example, and the present invention can be applied to any field.
  • the case of sharing document information handwritten on paper is taken as an example, but the present invention can also be applied to the case of using information recording media other than paper.
  • the present invention can also be applied to information sharing between two points, the present invention can also be applied to information sharing between three or more points.
  • FIG. 1 shows an example of the overall configuration of the system according to the first embodiment.
  • a student side system 100 is arranged at point A
  • a teacher side system 100 is arranged at point B.
  • Point A and point B are geographically separated, point B is remote from point A, and point A is remote from point B.
  • the side on which the student side system 100 is arranged may be called the "student side", and the side on which the teacher side system 200 is arranged may be called the "teacher side".
  • the student side at least one person who is the subject of at least one camera is called a "student”, and similarly, a person on the teacher side is called a "teacher”.
  • the student-side system may be called the student-side device, and the teacher-side system may be called the teacher-side device.
  • the location where the student-side system 100 is located is, for example, the student's home, and the location where the teacher-side system 200 is located is, for example, the classroom or the teacher's home, but is not limited to these.
  • the point A and the point B are connected via a network 300 and can transmit and receive images and data.
  • a control device 400 that controls the operation of the cameras and the like described below may be provided on the network 300 . Also, the control device 400 may be provided in the student side system 100 or in the teacher side system 200 .
  • FIG. 2 shows a configuration example of the student-side system 100.
  • the student-side system 100 has a camera 101, a camera 102, a video display device 103, and a transmission/reception device 104.
  • FIG. 1 shows a configuration example of the student-side system 100.
  • the student-side system 100 has a camera 101, a camera 102, a video display device 103, and a transmission/reception device 104.
  • the camera 101 shoots the student.
  • the camera 102 captures the surface of the paper on which the student has written with a pen, pencil, or the like.
  • the image display device 103 displays images to the students. Note that the camera 101 may be built in the image display device 103 .
  • the transmitting/receiving device 104 transmits the video (video data) captured by the cameras 101 and 102 to the teacher side via the network 300 . Also, the transmission/reception device 104 receives an image captured by the teacher via the network and transmits the image to the image display device 103 . Note that in any of the embodiments, audio is transmitted and received in addition to video, but the description is mainly focused on video.
  • the frame rate for shooting with the camera 101 is higher than the frame rate for shooting with the camera 102 .
  • the camera 101 shoots the student at a frame rate of 30 [fps], for example, and the camera 102 shoots the paper at a frame rate of 1 [fps], for example. Also, for example, the camera 102 shoots with a higher resolution than the camera 101 .
  • shooting at a certain frame rate means recording video at that frame rate.
  • the bit rate (number of bits per unit time) to be transmitted is high, so network bandwidth (network transmission volume) is higher than video shot at low resolution. ).
  • high-resolution video can be transmitted by lowering the frame rate. You can share written information in high resolution.
  • the images captured by the cameras 101 and 102 are transmitted to the teacher through the transmission/reception device 104 and the network 300, respectively. Also, an image of the teacher captured by the teacher is displayed on the image display device 103, so that the students can confirm the image of the teacher.
  • the voice of the student may be captured by the camera 101 and transmitted to the teacher through the transmission/reception device 104 and the network 300 .
  • the teacher's voice may be acquired on the teacher's side, and the teacher's voice may be output from a speaker included in the video display device 103, for example.
  • the setting of the frame rate and resolution for each camera as described above may be performed manually or automatically by the control device 400 .
  • FIG. 3 shows configuration example 1 of the teacher-side system 200 .
  • the teacher-side system 200 has a camera 201 , a video display device 203 and a transmission/reception device 204 .
  • a camera 201 photographs the teacher.
  • the image display device 203 displays images to the teacher.
  • the transmitting/receiving device 204 transmits the video captured by the camera 201 to the teacher via the network 300 .
  • the transmission/reception device 204 receives the video shot by the student via the network and transmits the video to the video display device 203 .
  • the camera 201 shoots the teacher at a frame rate of 30 [fps].
  • An image captured by the camera 201 is transmitted to the student side through the transmission/reception device 204 and the network 300 .
  • the video display device 203 on the teacher side the video of the student taken by the student and the video of the paper written by the student with a pen or pencil are displayed. You can check the video of As described above, the images on paper can display high-resolution images, so the teacher can clearly check even characters handwritten with a pencil.
  • FIG. 4 is a diagram showing configuration example 2 of the teacher-side system 100.
  • a camera 202 is provided in addition to the components of configuration example 1 (FIG. 3).
  • Camera 202 is connected to transceiver 204 .
  • the configuration is the same as configuration example 1 except that a camera 202 is provided.
  • the camera 202 takes a picture of the paper on which the teacher has written with a pen or pencil.
  • the frame rate of photography by the camera 201 is higher than the frame rate of photography by the camera 202 .
  • the camera 201 shoots the teacher at a frame rate of 30 [fps]
  • the camera 202 shoots the paper at a frame rate of 1 [fps].
  • the camera 202 shoots with a higher resolution than the camera 201 .
  • the images captured by the cameras 201 and 202 are transmitted to the student side through the transmission/reception device 204 and the network 300, respectively.
  • the video display device 103 on the student side displays the video of the teacher captured by the teacher and the video of the paper written by the teacher with a pen or pencil. The student can check the video of the teacher and the video of the paper in the teacher's hand.
  • the setting of the frame rate and resolution for each camera as described above may be performed manually or automatically by the control device 400 .
  • a specific operation example of the camera 102 on the student side and the camera 202 on the teacher side will be described.
  • the cameras 102 and 202 are collectively referred to as "camera 10".
  • the camera 10 is a camera that captures images of paper, but the cameras 101 and 201 that capture images of people may also be the cameras 10 described below.
  • the camera 10 shoots a stationary object such as a sheet of paper at a low frame rate, and transmits the low frame rate video (which may be called video data) obtained by shooting.
  • the camera 10 may transmit the photographed image as it is, or may perform processing for vertically inverting the image and transmit the image after the processing.
  • the camera 10 may detect the position of the paper to be photographed, perform perspective projection conversion, and convert only the paper portion into the original shape such as a rectangle and transmit it.
  • the receiving side can see an image of the rectangular sheet of paper as if viewed from above.
  • the camera can be freely arranged. That is, for example, even if the camera is placed diagonally in front of the transmitting side so as not to interfere with the work, the receiving side can see a rectangular image of the paper as if viewed from above.
  • the camera 10 detects the position of the underlay in advance and calculates the perspective projection transformation matrix. You can continue to send with As a result, even if the sending side puts a rectangular sheet of paper on a rectangular underlay and writes on it, even if the rectangular sheet of paper is photographed obliquely, the receiving side will see the paper as if it were viewed from above. You can see an image of a rectangular sheet of paper.
  • the above-described perspective projection conversion processing may be performed by the camera 10 on the transmitting side, may be performed by another device on the transmitting side (eg, a transmitting/receiving device), or may be performed on the receiving side (eg, transmitting/receiving device, image display device, etc.) or any device on the network 300 route.
  • Devices that perform such conversion may be collectively referred to as video processing devices.
  • the control device 400 may also serve as a video processing device.
  • the Hough transform is applied to the image to detect the straight lines at the boundary of the paper, and the coordinates of the point where the four straight lines intersect in or near the image are obtained. Then, a perspective projection transformation matrix in which each point is transformed into each rectangular point can be obtained by solving the 8-element simultaneous equations.
  • markers that can be detected by image processing are printed on paper, and the boundaries of the paper may be detected from the coordinates of the markers.
  • the boundary may be obtained by Hough transform, or the boundary may be obtained by directly detecting the color of the underlay.
  • a marker or the like that can be detected by image processing may be printed on the underlay, and the area to be detected may be calculated.
  • a marker may be printed slightly outside the place where the paper should be placed so that the position can be detected even when the paper is placed thereon, and the detection may be performed again each time the underlay moves.
  • FIG. 5 shows a configuration example of the camera 10 in this embodiment.
  • Camera 10 is a camera that can be used for any of cameras 101 , 102 , 201 and 202 .
  • the recording unit 14 is assumed to be used in Examples 2 and 3, which will be described later.
  • the camera 10 has an imaging unit 11, a conversion processing unit 12, a transmission unit 13, and a recording unit 14.
  • the imaging unit 11 acquires video according to set parameters (frame rate, resolution, etc.).
  • the conversion processing unit 12 performs, for example, the above-described conversion processing (vertical inversion processing, perspective projection conversion processing, etc.) on the video captured by the imaging unit 11 (or the video read from the recording unit 14). . Note that the conversion processing unit 12 may not execute conversion processing.
  • the transmission unit 13 transmits the video.
  • the recording unit 14 records video, reads the recorded video, and transmits it from the transmission unit 13 in response to an instruction or the like.
  • the recording unit 14 may record the video itself captured by the imaging unit 11 or may record the video after conversion by the conversion processing unit 12 .
  • the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 need not be provided in the camera 10. Either the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 may be provided on either the student side, the teacher side, or the network 300 as the video processing device described above. Also, the camera 10 including the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 may be called a video processing device. Also, the conversion processing unit 12 or the recording unit 14 provided in the camera 10, or both the conversion processing unit 12 and the recording unit 14 may be called a video processing device, and the imaging unit 11 may be called a camera.
  • Example 1 There is already a technology that enables a person at a certain point to have a face-to-face conversation as well as voice when conversing with a person at a remote location. However, when expressing the knowledge that emerges from these conversations in diagrams and text, it is not possible to fully convey it through voice and facial expressions alone.
  • Example 2 is an example in which a plurality of people are present at at least one of the plurality of locations.
  • the overall configuration of the system in Example 2 is the same as in Example 1, as shown in FIG.
  • the teacher-side system 200 in the second embodiment there are multiple people (referred to as students) on the student side, and a student-side system 100 for multiple students is provided.
  • the configuration of the teacher-side system 200 in the second embodiment may be the same as that of the teacher-side system 200 described in the first embodiment.
  • the student-side system 100 of the second embodiment is basically the same as the configuration shown in FIG. Any one, any two, or all of them are provided in plurality. In either case, one sound collecting device may be prepared for each student.
  • one camera 101 for photographing a student may be provided for each student. Also, one or more cameras 101 may be provided that capture multiple students.
  • Each student may be provided with one camera 102 for photographing a stationary object such as a paper surface written by a student with a pencil or pen, or the camera 102 may be shared by several students, such as one for every two students. may
  • the image captured by the camera 102 at 1 [fps] continues to be transmitted. Upside-down reversal or perspective projection conversion as described in the first embodiment may be performed.
  • the captured image of the paper may be recorded in the recording unit (for example, the recording unit of the camera 102), and the student who wrote the paper may decide the timing of transmitting the image by himself.
  • each student may operate the camera 102 to instruct the recording unit to transmit an image, or may use an electronic device for instructing the camera 102 to perform an image transmission operation.
  • a student's finger touching a specific place on a piece of paper or underlay may be a video transmission instruction.
  • the camera 102 recognizes that the finger touches a specific place on the paper or underlay in the image, it instructs the recording unit to transmit the image.
  • These recording controls may also be applied in the first and third embodiments.
  • the image display device 203 in the teacher's system 200 displays images of multiple students' sheets transmitted from the student's system 100 .
  • the teacher can display the image of the paper written by a certain student on the image display device 103 in front of the student himself based on the teacher's operation, and can further add to it. .
  • You can interact with your students here. For example, only when the answer is wrong, the writing process of the part other than the answer may be displayed by the teacher's operation to check the writing process.
  • the function of performing control based on the teacher's operation as described above may be provided in the video display device 203 in the teacher-side system 200, or may be provided in a device other than the video display device 203 (for example, the control device 400). .
  • the teacher can check the answers written by the students themselves, or grade them automatically using handwriting recognition technology.
  • Handwriting recognition may be used while improving the recognition accuracy by learning the handwritten characters of individual students.
  • the function of recognizing handwriting may be provided in the video display device 203 in the teacher-side system 200, or may be provided in a device other than the video display device 203 (for example, the control device 400).
  • Example 3 Next, Example 3 will be described.
  • the system configuration of the third embodiment is the same as that of the second embodiment, a plurality of students exist on the student side, and the writings of the plurality of students are displayed on the video display device 203 of the teacher side system 200 .
  • recording is used to efficiently have a dialogue between a teacher and a student.
  • Example 3 multiple students are grouped and recording is used to efficiently create time for checking answers. Specifically, it is as follows.
  • FIG. 6 shows a system configuration example when the students are divided into groups A, B, and C.
  • the configuration of the systems 100A, 100B, and 100C of each group is the same as the configuration of the student-side system 100 described in the second embodiment.
  • the teacher gives a lesson to group A for 30 minutes, and the situation is photographed by the camera 201 and recorded by the recording unit. Recording may be performed by any recording unit on the teacher side, the student side, or on the network 300, but is performed by the recording unit of the camera 201 of the teacher system 200, for example. This allows the teacher to operate recording.
  • Group A practice for 30 minutes.
  • the image of the page is captured by the camera 102 and sent to the video display device 204 on the teacher's side for display. This allows the teacher to check the answers. While the teacher is checking the answers, the recorded video is transmitted to the group B, the group B views the video recording on the video display device, and the group B exercises at the same time as the group A finishes the exercise.
  • the teacher can check the answers of all the students in order for 90 minutes after the 30-minute class.
  • Examples 2 and 3 there may be a plurality of students on the student side and a plurality of teachers on the teacher side.
  • the configuration of the teacher system 200 in that case is the same as that of the student system 100 of the second embodiment.
  • a plurality of any two or all are provided. In either case, one sound collecting device may be prepared for each teacher.
  • multiple teachers may share the time to check the answers.
  • the teacher can collect the writings of all the students at a sufficient resolution almost in real time, and if the place to check on the paper such as the answer is specified in advance, , many answers can be checked at the same time on the screen.
  • All of the video processing device, control device, and video display device described in the first to third embodiments can be implemented by causing a computer to execute a program, for example.
  • This computer may be a physical computer or a virtual machine on the cloud.
  • the video processing device, control device, and video display device will be collectively referred to as "apparatus”.
  • the device can be realized by executing a program corresponding to the processing performed by the device using hardware resources such as a CPU and memory built into the computer.
  • the above program can be recorded in a computer-readable recording medium (portable memory, etc.), saved, or distributed. It is also possible to provide the above program through a network such as the Internet or e-mail.
  • FIG. 8 is a diagram showing a hardware configuration example of the computer.
  • the computer of FIG. 8 has a drive device 1000, an auxiliary storage device 1002, a memory device 1003, a CPU 1004, an interface device 1005, a display device 1006, an input device 1007, an output device 1008, etc., which are interconnected by a bus BS.
  • a program that implements the processing in the computer is provided by a recording medium 1001 such as a CD-ROM or memory card, for example.
  • a recording medium 1001 such as a CD-ROM or memory card
  • the program is installed from the recording medium 1001 to the auxiliary storage device 1002 via the drive device 1000 .
  • the program does not necessarily need to be installed from the recording medium 1001, and may be downloaded from another computer via the network.
  • the auxiliary storage device 1002 stores installed programs, as well as necessary files and data.
  • the memory device 1003 reads and stores the program from the auxiliary storage device 1002 when a program activation instruction is received.
  • the CPU 1004 implements functions related to the device according to programs stored in the memory device 1003 .
  • the interface device 1005 is used as an interface for connecting to a network, various measuring devices, exercise intervention devices, and the like.
  • a display device 1006 displays a GUI (Graphical User Interface) or the like by a program.
  • An input device 1007 is composed of a keyboard, a mouse, buttons, a touch panel, or the like, and is used to input various operational instructions.
  • the output device 1008 outputs the calculation result.
  • This specification discloses at least an information sharing system, a video processing device, an information sharing method, and a program according to the following items.
  • (Section 1) An information sharing system for sharing information between at least a first point and a second point connected by a network, at least two cameras including a first camera and a second camera at the first point; A video display device is provided at the second point, An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted.
  • the frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera.
  • An information sharing system with a higher resolution than the video captured by the camera. A plurality of persons are present at the first point, one person or one person is provided with the first camera, and one person or the plurality of persons are provided with the first camera. 2. Information sharing system according to clause 1, wherein two cameras are provided. (Section 3) The information sharing system includes a recording unit, and the recording unit records the video captured by the second camera, and based on the operation by the person at the first location, the recorded video is transmitted to the second camera.
  • the information sharing system which is transmitted to a video display device at a point.
  • the plurality of persons at the first point are divided into a plurality of groups each containing a plurality of persons, and a camera is provided at the second point, transmitting a video of a person captured by a camera at the second point to a first group at the first point for a predetermined period of time and recording the video; After the predetermined time, the recorded video is transmitted to the second group at the first point for a predetermined time, and during the predetermined time, the video display device at the second point transmits the second group at the first group. 3.
  • the information sharing system according to item 2 or 3, which receives images shot by the camera No. 2.
  • FIG. 5 A video processing device used in the information sharing system according to any one of items 1 to 4, A conversion processing unit that performs perspective projection conversion processing on the image of the information recording medium captured by the second camera so that the shape of the information recording medium looks like the shape of the information recording medium viewed from above.
  • a video processing device comprising: (Section 6) An information sharing method in an information sharing system for sharing information between at least a first point and a second point connected by a network, comprising: At least two cameras including a first camera and a second camera are provided at the first point, and a video display device is provided at the second point, An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitting to the video display device at the second location; The frame rate of the video captured by the second camera is lower than the frame rate of the video captured by the first camera, and the resolution of the video captured by the second camera is higher than that of the first camera. A method of information sharing that is higher than the resolution of the video captured by the camera. (Section 7) A program for causing a computer to function as a conversion processing unit in the video processing device according to item 5.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Provided is an information sharing system for sharing information between at least a first site and a second site connected by a network. At least two cameras including a first camera and a second camera are provided at the first site, and an image display device is provided at the second site. An image of a person captured by the first camera at the first site is transmitted to the image display device at the second site, and information written on an information recording medium and captured by the second camera is transmitted to the image display device at the second site. The frame rate of images captured by the second camera is lower than the frame rate of images captured by the first camera, and the resolution of images captured by the second camera is higher than the resolution of images captured by the first camera.

Description

情報共有システム、映像処理装置、情報共有方法、及びプログラムINFORMATION SHARING SYSTEM, VIDEO PROCESSING DEVICE, INFORMATION SHARING METHOD, AND PROGRAM
 本発明は、遠隔地間で対話を行うシステムに関連するものである。 The present invention relates to a system for dialogue between remote locations.
 2つ又はそれ以上の遠隔地において、それぞれの場所にカメラを設置し、映像と音声を互いに送受信して対話を行うための従来技術が存在する(例えば、特許文献1)。この技術により、ある場所にいる人が、相手の顔や、遠隔地の様子を見ながら、相手と対話をすることができる。 There is a conventional technique for having a dialogue by installing cameras at two or more remote locations and transmitting and receiving video and audio to each other (for example, Patent Document 1). With this technology, a person at a certain location can have a dialogue with the other person while looking at the other person's face or the state of the remote location.
 また、デジタル化された情報、又はその場でデジタル化可能な情報を互いに確認しながら対話を行うための従来技術も存在する。 There are also conventional technologies for conducting dialogue while mutually confirming digitized information or information that can be digitized on the spot.
特開2011-188112号公報JP 2011-188112 A
 例えば、リモートで授業を行う教育の現場においては、手で紙や黒板やホワイトボードなどに記述した情報を、すぐに生徒と教師の間で互いに共有した上で対話を進められることが望ましい。なお、紙、黒板、ホワイトボード等の、情報を見えるように記述(記録)するための媒体を総称して「情報記録媒体」と呼ぶことにする。 For example, in the field of education where classes are held remotely, it is desirable that information written by hand on paper, blackboards, whiteboards, etc., can be shared immediately between students and teachers to proceed with dialogue. Note that media such as paper, blackboards, whiteboards, etc., for visibly describing (recording) information are collectively referred to as "information recording media".
 しかし、上記の目的に従来技術を用いた場合、対話する様子など常に動く物を伝送することを前提に設計されたカメラや映像の圧縮形式などを使用するため、書いた情報を共有するには解像度が不十分である。また、解像度を上げようとすると一秒あたりの伝送量が不十分になることがある。 However, when the conventional technology is used for the above purpose, it is difficult to share written information because it uses a camera designed on the premise of transmitting objects that are constantly moving, such as conversations, and a video compression format. Insufficient resolution. Also, when trying to increase the resolution, the amount of transmission per second may become insufficient.
 上記の課題に対し、共有すべき手書きの文書を、人手で静止画用のカメラで撮影して共有するなどの方法が考えられるが、文書の共有にいちいち手間と時間がかかってしまう。 To address the above issues, it is possible to manually take a handwritten document that should be shared with a camera for still images and share it, but it takes time and effort to share each document.
 すなわち、従来技術では、人物の映像を送受信するとともに、情報記録媒体に記述した情報の映像を手間なく適切に共有することが難しかった。 In other words, with conventional technology, it was difficult to send and receive images of people and to appropriately share images of information written on an information recording medium without trouble.
 本発明は上記の点に鑑みてなされたものであり、遠隔地間で人物の映像を送受信することにより対話を行うシステムにおいて、人物の映像を送受信するとともに、情報記録媒体に記述した情報の映像を遠隔地間で手間なく適切に共有することを可能とする技術を提供することを目的とする。 SUMMARY OF THE INVENTION The present invention has been made in view of the above points. To provide a technology that enables appropriate sharing of information between remote locations without trouble.
 開示の技術によれば、ネットワークで接続された少なくとも第1の地点と第2の地点との間で情報を共有するための情報共有システムであって、
 前記第1の地点において、第1のカメラと第2のカメラを含む少なくとも2つのカメラが備えられ、
 前記第2の地点において、映像表示装置が備えられ、
 前記第1の地点における前記第1のカメラで撮影された人物の映像が前記第2の地点の映像表示装置に送信され、前記第2のカメラで撮影された情報記録媒体に記述された情報が前記第2の地点の映像表示装置に送信され、
 前記第2のカメラにより撮影される映像のフレームレートは、前記第1のカメラにより撮影される映像のフレームレートよりも低く、前記第2のカメラにより撮影される映像の解像度は、前記第1のカメラにより撮影される映像の解像度よりも高い
 情報共有システムが提供される。
According to the disclosed technique, an information sharing system for sharing information between at least a first point and a second point connected by a network,
at least two cameras including a first camera and a second camera at the first point;
A video display device is provided at the second point,
An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitted to the video display device at the second point,
The frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera. An information sharing system is provided that has a higher resolution than the video captured by the camera.
 開示の技術によれば、遠隔地間で人物の映像を送受信することにより対話を行うシステムにおいて、人物の映像を送受信するとともに、情報記録媒体に記述した情報の映像を遠隔地間で手間なく適切に共有することが可能となる。 According to the disclosed technology, in a system that conducts dialogue by transmitting and receiving images of people between remote locations, the images of people are transmitted and received, and the images of information described in information recording media are transmitted and received appropriately between remote locations without trouble. It becomes possible to share to
本実施の形態における通信システムの全体構成図である。1 is an overall configuration diagram of a communication system according to the present embodiment; FIG. 生徒側システムの構成例を示す図である。2 is a diagram showing a configuration example of a student-side system; FIG. 教師側システムの構成例を示す図である。It is a figure which shows the structural example of the teacher side system. 教師側システムの構成例を示す図である。It is a figure which shows the structural example of the teacher side system. カメラの機能構成例を示す図である。It is a figure which shows the functional structural example of a camera. グループ分けをする場合の構成例を示す図である。It is a figure which shows the structural example in the case of grouping. グループ分けをする場合の時間配分の例を示す図である。It is a figure which shows the example of time allocation in the case of grouping. 装置のハードウェア構成例を示す図である。It is a figure which shows the hardware configuration example of an apparatus.
 以下、図面を参照して本発明の実施の形態(本実施の形態)を説明する。以下で説明する実施の形態は一例に過ぎず、本発明が適用される実施の形態は、以下の実施の形態に限られるわけではない。 An embodiment (this embodiment) of the present invention will be described below with reference to the drawings. The embodiments described below are merely examples, and embodiments to which the present invention is applied are not limited to the following embodiments.
 例えば、以下で説明する例では、教師と生徒が離れた場所にいる教育現場を例にとっているが、これは一例であり、本発明はどのような分野にも適用可能である。また、以下の説明では、紙に手書きで記述した文書の情報を共有する場合を例によっているが、本発明は紙以外の情報記録媒体を用いる場合にも適用可能である。また、以下の説明では2地点間での情報共有を示しているが、本発明は3地点以上の間での情報共有にも適用可能である。 For example, in the example explained below, an educational site where teachers and students are separated from each other is taken as an example, but this is just an example, and the present invention can be applied to any field. In the following explanation, the case of sharing document information handwritten on paper is taken as an example, but the present invention can also be applied to the case of using information recording media other than paper. Further, although the following description shows information sharing between two points, the present invention can also be applied to information sharing between three or more points.
 以下、本発明の実施の形態に係る具体的な処理内容として、実施例1~実施例3を説明する。 Examples 1 to 3 will be described below as specific processing contents according to the embodiment of the present invention.
 (実施例1)
  <全体構成例>
 図1に実施例1におけるシステムの全体構成例を示す。図1に示すように、本システムにおいて、地点Aには生徒側システム100が配置され、地点Bには教師側システム100が配置されている。地点Aと地点Bは地理的に離れており、地点Aから見て地点Bは遠隔地であり、地点Bから見て地点Aは遠隔地である。
(Example 1)
<Overall configuration example>
FIG. 1 shows an example of the overall configuration of the system according to the first embodiment. As shown in FIG. 1, in this system, a student side system 100 is arranged at point A, and a teacher side system 100 is arranged at point B. FIG. Point A and point B are geographically separated, point B is remote from point A, and point A is remote from point B.
 生徒側システム100が配置されている側を「生徒側」と呼称し、教師側システム200が配置されている側を「教師側」と呼称する場合がある。生徒側において、少なくとも一つのカメラの被写体となる少なくとも一人の人間を「生徒」と呼称し、同様に教師側にいる人間を「教師」と呼称する。なお、生徒側システムを生徒側装置と呼称し、教師側システムを教師側装置と呼称してもよい。 The side on which the student side system 100 is arranged may be called the "student side", and the side on which the teacher side system 200 is arranged may be called the "teacher side". On the student side, at least one person who is the subject of at least one camera is called a "student", and similarly, a person on the teacher side is called a "teacher". The student-side system may be called the student-side device, and the teacher-side system may be called the teacher-side device.
 生徒側システム100が配置されている場所は例えば生徒の自宅であり、教師側システム200が配置されている場所は例えば教室あるいは教師の自宅であるが、これらに限定されるわけではない。地点Aと地点Bとの間は、ネットワーク300を介して接続されており、映像やデータの送受信が可能である。 The location where the student-side system 100 is located is, for example, the student's home, and the location where the teacher-side system 200 is located is, for example, the classroom or the teacher's home, but is not limited to these. The point A and the point B are connected via a network 300 and can transmit and receive images and data.
 また、以下で説明するカメラ等の動作制御を行う制御装置400がネットワーク300上に備えられてもよい。また、制御装置400は、生徒側システム100の中あるいは教師側システム200の中に備えられてもよい。 Also, a control device 400 that controls the operation of the cameras and the like described below may be provided on the network 300 . Also, the control device 400 may be provided in the student side system 100 or in the teacher side system 200 .
  <生徒側システム100の構成例及び動作例>
 図2に、生徒側システム100の構成例を示す。図2に示すとおり、生徒側システム100は、カメラ101、カメラ102、映像表示装置103、送受信装置104を有する。
<Configuration example and operation example of student-side system 100>
FIG. 2 shows a configuration example of the student-side system 100. As shown in FIG. As shown in FIG. 2, the student-side system 100 has a camera 101, a camera 102, a video display device 103, and a transmission/reception device 104. FIG.
 カメラ101は生徒を撮影する。カメラ102は、生徒が自身の手元でペンや鉛筆などで書き記した紙の紙面を撮影する。映像表示装置103は、生徒に映像を表示する。なお、カメラ101は映像表示装置103に内蔵されたものであってもよい。 The camera 101 shoots the student. The camera 102 captures the surface of the paper on which the student has written with a pen, pencil, or the like. The image display device 103 displays images to the students. Note that the camera 101 may be built in the image display device 103 .
 送受信装置104は、カメラ101、102で撮影された映像(映像データ)を、ネットワーク300を介して教師側へ送信する。また、送受信装置104は、教師側で撮影された映像を、ネットワークを介して受信し、映像表示装置103に送信する。なお、いずれの実施例においても映像に加えて音声も送受信されるが、主に映像に着目して説明を行っている。 The transmitting/receiving device 104 transmits the video (video data) captured by the cameras 101 and 102 to the teacher side via the network 300 . Also, the transmission/reception device 104 receives an image captured by the teacher via the network and transmits the image to the image display device 103 . Note that in any of the embodiments, audio is transmitted and received in addition to video, but the description is mainly focused on video.
 カメラ101は動きのある人物を撮影し、カメラ102はほぼ静止している紙面を撮影するので、カメラ101による撮影のフレームレートは、カメラ102による撮影のフレームレートよりも高い。カメラ101は例えば30[fps]のフレームレートで生徒を撮影し、カメラ102は例えば1[fps]のフレームレートで紙面を撮影する。また、例えば、カメラ102はカメラ101よりも高い解像度で撮影を行う。 Since the camera 101 shoots a moving person and the camera 102 shoots a substantially stationary paper surface, the frame rate for shooting with the camera 101 is higher than the frame rate for shooting with the camera 102 . The camera 101 shoots the student at a frame rate of 30 [fps], for example, and the camera 102 shoots the paper at a frame rate of 1 [fps], for example. Also, for example, the camera 102 shoots with a higher resolution than the camera 101 .
 なお、カメラがあるフレームレートで撮影を行うとは、当該フレームレートで映像を記録することである。 It should be noted that shooting at a certain frame rate means recording video at that frame rate.
 高いフレームレートで撮影された映像を伝送する際には、伝送すべき単位時間あたりのフレームの枚数が多いので、低いフレームレートで撮影された映像に比べて高いネットワーク帯域(ネットワーク伝送量)を要する。 When transmitting video shot at a high frame rate, the number of frames per unit time to be transmitted is large, so a higher network bandwidth (network transmission volume) is required compared to video shot at a low frame rate. .
 また、高い解像度で撮影された映像を伝送する際には、伝送すべきビットレート(単位時間あたりのビット数)が多いので、低い解像度で撮影された映像に比べて高いネットワーク帯域(ネットワーク伝送量)を要する。 Also, when transmitting video shot at high resolution, the bit rate (number of bits per unit time) to be transmitted is high, so network bandwidth (network transmission volume) is higher than video shot at low resolution. ).
 つまり、同じネットワーク帯域であれば、フレームレートを下げることで、高い解像度の映像を伝送できるので、上記のようなフレームレート及び解像度の設定を行うことで、人物の映像を送受信するとともに、紙面に記述した情報を高解像度で共有することができる。 In other words, if the network bandwidth is the same, high-resolution video can be transmitted by lowering the frame rate. You can share written information in high resolution.
 カメラ101及びカメラ102により撮影された映像はそれぞれ送受信装置104とネットワーク300を通じて教師側に送信される。また、映像表示装置103には教師側で撮影された教師の映像が映し出され、生徒は教師の映像を確認することができる。 The images captured by the cameras 101 and 102 are transmitted to the teacher through the transmission/reception device 104 and the network 300, respectively. Also, an image of the teacher captured by the teacher is displayed on the image display device 103, so that the students can confirm the image of the teacher.
 なお、例えばカメラ101により生徒の音声が取得され、当該音声が送受信装置104とネットワーク300を通じて教師側に送信されてもよい。また、教師側で教師の音声が取得され、例えば映像表示装置103が備えるスピーカから教師の音声が出力されてもよい。 It should be noted that, for example, the voice of the student may be captured by the camera 101 and transmitted to the teacher through the transmission/reception device 104 and the network 300 . Also, the teacher's voice may be acquired on the teacher's side, and the teacher's voice may be output from a speaker included in the video display device 103, for example.
 また、上記のような各カメラに対するフレームレート及び解像度の設定は、手動で行ってもよいし、制御装置400により自動的に行ってもよい。 Also, the setting of the frame rate and resolution for each camera as described above may be performed manually or automatically by the control device 400 .
  <教師側システム200の構成例、及び動作例>
 図3に、教師側システム200の構成例1を示す。図3に示すとおり、教師側システム200は、カメラ201、映像表示装置203、送受信装置204を有する。
<Configuration example and operation example of teacher-side system 200>
FIG. 3 shows configuration example 1 of the teacher-side system 200 . As shown in FIG. 3, the teacher-side system 200 has a camera 201 , a video display device 203 and a transmission/reception device 204 .
 カメラ201は教師を撮影する。映像表示装置203は、教師に映像を表示する。送受信装置204は、カメラ201で撮影された映像を、ネットワーク300を介して教師側へ送信する。また、送受信装置204は、生徒側で撮影された映像を、ネットワークを介して受信し、映像表示装置203に送信する。 
 例えば、カメラ201は、30[fps]のフレームレートで教師を撮影する。カメラ201により撮影された映像は、送受信装置204とネットワーク300を通じて生徒側に送信される。
A camera 201 photographs the teacher. The image display device 203 displays images to the teacher. The transmitting/receiving device 204 transmits the video captured by the camera 201 to the teacher via the network 300 . Also, the transmission/reception device 204 receives the video shot by the student via the network and transmits the video to the video display device 203 .
For example, the camera 201 shoots the teacher at a frame rate of 30 [fps]. An image captured by the camera 201 is transmitted to the student side through the transmission/reception device 204 and the network 300 .
 教師側の映像表示装置203には生徒側で撮影された生徒の映像と、生徒が手元でペンや鉛筆などで書き記した紙面の映像が映し出されるので、教師は生徒の映像と生徒の手元の紙面の映像を確認することができる。前述したように、紙面の映像は高解像度の映像を表示することができるので、教師は、鉛筆で手書きした文字でもはっきりと確認できる。 On the video display device 203 on the teacher side, the video of the student taken by the student and the video of the paper written by the student with a pen or pencil are displayed. You can check the video of As described above, the images on paper can display high-resolution images, so the teacher can clearly check even characters handwritten with a pencil.
 図4は、教師側システム100の構成例2を示す図である。構成例2では、構成例1での構成要素(図3)に加えて、カメラ202が備えられる。カメラ202は送受信装置204に接続される。カメラ202が備えられること以外は構成例1と同じである。 FIG. 4 is a diagram showing configuration example 2 of the teacher-side system 100. FIG. In configuration example 2, a camera 202 is provided in addition to the components of configuration example 1 (FIG. 3). Camera 202 is connected to transceiver 204 . The configuration is the same as configuration example 1 except that a camera 202 is provided.
 カメラ202は、教師が手元でペンや鉛筆などで書き記した紙面を撮影する。カメラ201による撮影のフレームレートは、カメラ202による撮影のフレームレートよりも高い。例えば、カメラ201は30[fps]のフレームレートで教師を撮影し、カメラ202は1[fps]のフレームレートで紙面を撮影する。また、例えば、カメラ202はカメラ201よりも高い解像度で撮影を行う。 The camera 202 takes a picture of the paper on which the teacher has written with a pen or pencil. The frame rate of photography by the camera 201 is higher than the frame rate of photography by the camera 202 . For example, the camera 201 shoots the teacher at a frame rate of 30 [fps], and the camera 202 shoots the paper at a frame rate of 1 [fps]. Also, for example, the camera 202 shoots with a higher resolution than the camera 201 .
 カメラ201及びカメラ202により撮影された映像はそれぞれ送受信装置204とネットワーク300を通じて生徒側に送信される。 The images captured by the cameras 201 and 202 are transmitted to the student side through the transmission/reception device 204 and the network 300, respectively.
 上記のようにカメラ202を備えることで、生徒側の映像表示装置103には教師側で撮影された教師の映像と、教師が手元でペンや鉛筆などで書き記した紙面の映像が映し出されるので、生徒は教師の映像と教師の手元の紙面の映像を確認することができる。 By providing the camera 202 as described above, the video display device 103 on the student side displays the video of the teacher captured by the teacher and the video of the paper written by the teacher with a pen or pencil. The student can check the video of the teacher and the video of the paper in the teacher's hand.
 また、上記のような各カメラに対するフレームレート及び解像度の設定は、手動で行ってもよいし、制御装置400により自動的に行ってもよい。 Also, the setting of the frame rate and resolution for each camera as described above may be performed manually or automatically by the control device 400 .
 <カメラの詳細動作例>
 生徒側のカメラ102、及び教師側のカメラ202の具体的な動作例について説明する。ここでは、カメラ102、カメラ202を総称して「カメラ10」とする。なお、以下では、カメラ10は、紙面を撮影するカメラであることを想定しているが、人物を撮影するカメラ101、201についても以下で説明するカメラ10を使用してもよい。
<Example of detailed camera operation>
A specific operation example of the camera 102 on the student side and the camera 202 on the teacher side will be described. Here, the cameras 102 and 202 are collectively referred to as "camera 10". In the following description, it is assumed that the camera 10 is a camera that captures images of paper, but the cameras 101 and 201 that capture images of people may also be the cameras 10 described below.
 カメラ10は、紙面などの静止した物を低いフレームレートで撮影し、撮影で得られた低いフレームレートの映像(映像データと呼んでもよい)を送信する。カメラ10は、撮影された映像をそのまま送信してもよいし、当該映像の上下を反転させる処理を行い、当該処理後の映像を送信してもよい。 The camera 10 shoots a stationary object such as a sheet of paper at a low frame rate, and transmits the low frame rate video (which may be called video data) obtained by shooting. The camera 10 may transmit the photographed image as it is, or may perform processing for vertically inverting the image and transmit the image after the processing.
 また、カメラ10は、撮影する紙の位置を検出して、透視投影変換を施して紙の部分だけを、元の長方形などの形に変換して送信してもよい。これにより、例えば、長方形の紙面が斜めから撮影された場合でも、受信側では、上から紙面を見たような長方形の紙面の映像を見ることができる。また、送信側では、カメラを自由に配置できる。すなわち、例えば、送信側で、カメラを作業の邪魔にならない斜め前方等の位置に配置しても、受信側では、上から紙面を見たような長方形の紙面の映像を見ることができる。 In addition, the camera 10 may detect the position of the paper to be photographed, perform perspective projection conversion, and convert only the paper portion into the original shape such as a rectangle and transmit it. As a result, for example, even when a rectangular sheet of paper is photographed obliquely, the receiving side can see an image of the rectangular sheet of paper as if viewed from above. Also, on the transmitting side, the camera can be freely arranged. That is, for example, even if the camera is placed diagonally in front of the transmitting side so as not to interfere with the work, the receiving side can see a rectangular image of the paper as if viewed from above.
 また、カメラ10は、下敷きなどの位置を予め検出して透視投影変換行列を算出しておき、得られる画像に常にその透視投影変換行列を施した上で下敷きのあった場所だけを特定の形で送信し続けてもよい。これにより、送信側では、例えば、長方形の下敷きの上に長方形の紙を置いて書き込みを行うことで、長方形の紙面が斜めから撮影された場合でも、受信側では、上から紙面を見たような長方形の紙面の映像を見ることができる。 In addition, the camera 10 detects the position of the underlay in advance and calculates the perspective projection transformation matrix. You can continue to send with As a result, even if the sending side puts a rectangular sheet of paper on a rectangular underlay and writes on it, even if the rectangular sheet of paper is photographed obliquely, the receiving side will see the paper as if it were viewed from above. You can see an image of a rectangular sheet of paper.
 上述したような透視投影変換処理は、送信側のカメラ10で行ってもよいし、送信側の他の装置(例:送受信装置など)で行ってもよいし、受信側(例:受信側の送受信装置、映像表示装置など)で行ってもよいし、ネットワーク300経路上のいずれかの装置で行ってもよい。このような変換を行う装置を総称して映像処理装置と呼んでもよい。制御装置400が映像処理装置を兼ねてもよい。 The above-described perspective projection conversion processing may be performed by the camera 10 on the transmitting side, may be performed by another device on the transmitting side (eg, a transmitting/receiving device), or may be performed on the receiving side (eg, transmitting/receiving device, image display device, etc.) or any device on the network 300 route. Devices that perform such conversion may be collectively referred to as video processing devices. The control device 400 may also serve as a video processing device.
 紙の位置検出の具体的方法については、例えば、画像に対してハフ変換を施して紙の境界部分の直線を検出し、4つの直線が画像内またはその付近で交わる点の座標を求める。そして、それぞれの点が長方形の各点に変換される透視投影変換行列を、8元連立方程式を解くことによって求めればよい。あるいは紙に画像処理によって検出可能なマーカーを印刷しておいてマーカーの座標から紙の境界部分を検出してもよい。 As for the specific method of detecting the position of the paper, for example, the Hough transform is applied to the image to detect the straight lines at the boundary of the paper, and the coordinates of the point where the four straight lines intersect in or near the image are obtained. Then, a perspective projection transformation matrix in which each point is transformed into each rectangular point can be obtained by solving the 8-element simultaneous equations. Alternatively, markers that can be detected by image processing are printed on paper, and the boundaries of the paper may be detected from the coordinates of the markers.
 下敷きを用意してその位置を検出するための具体的方法は、境界部分をハフ変換で求めてもよいし、直接、下敷きの色を検出するなどして境界を求めてもよい。下敷きに画像処理によって検出可能なマーカーなどを印刷しておき、検出すべき領域を算出してもよい。また紙を置くべき場所の少し外側にマーカーを印刷し、上に紙を置いた状態でも位置検出ができる状態にした上で、下敷きが動く度に検出し直してもよい。 As a specific method for preparing the underlay and detecting its position, the boundary may be obtained by Hough transform, or the boundary may be obtained by directly detecting the color of the underlay. A marker or the like that can be detected by image processing may be printed on the underlay, and the area to be detected may be calculated. Alternatively, a marker may be printed slightly outside the place where the paper should be placed so that the position can be detected even when the paper is placed thereon, and the detection may be performed again each time the underlay moves.
 <カメラ10の構成例>
 図5に、本実施例におけるカメラ10の構成例を示す。カメラ10は、カメラ101、102、201、202のいずれにも使用可能なカメラである。なお、録画部14は、後述する実施例2,3で使用することを想定しているが、実施例1でも録画部14を用いて録画を行ってもよい。
<Configuration example of camera 10>
FIG. 5 shows a configuration example of the camera 10 in this embodiment. Camera 10 is a camera that can be used for any of cameras 101 , 102 , 201 and 202 . The recording unit 14 is assumed to be used in Examples 2 and 3, which will be described later.
 図5に示すように、カメラ10は、撮像部11、変換処理部12、送信部13、録画部14を有する。 As shown in FIG. 5, the camera 10 has an imaging unit 11, a conversion processing unit 12, a transmission unit 13, and a recording unit 14.
 撮像部11は、設定されたパラメータ(フレームレート、解像度等)に従って、映像を取得する。変換処理部12は、撮像部11で撮影された映像(あるいは録画部14から読み出された映像)に対して、例えば前述したような変換処理(上下反転処理や透視投影変換処理など)を行う。なお、変換処理部12は、変換処理を実行しないこととしてもよい。 The imaging unit 11 acquires video according to set parameters (frame rate, resolution, etc.). The conversion processing unit 12 performs, for example, the above-described conversion processing (vertical inversion processing, perspective projection conversion processing, etc.) on the video captured by the imaging unit 11 (or the video read from the recording unit 14). . Note that the conversion processing unit 12 may not execute conversion processing.
 送信部13は映像を送信する。録画部14は、映像を記録するとともに、指示等に応じて、記録した映像を読み出して送信部13から送信する。録画部14は、撮像部11で撮影された映像そのものを記録してもよいし、変換処理部12により変換後の映像を記録してもよい。 The transmission unit 13 transmits the video. The recording unit 14 records video, reads the recorded video, and transmits it from the transmission unit 13 in response to an instruction or the like. The recording unit 14 may record the video itself captured by the imaging unit 11 or may record the video after conversion by the conversion processing unit 12 .
 なお、変換処理部12又は録画部14、あるいは、変換処理部12と録画部14の両方は、カメラ10内に備えられる必要はない。変換処理部12又は録画部14、あるいは、変換処理部12と録画部14の両方が、前述した映像処理装置として、生徒側、教師側、ネットワーク300のいずれかに備えられてもよい。また、変換処理部12又は録画部14、あるいは、変換処理部12と録画部14の両方を備えるカメラ10を映像処理装置と呼んでもよい。また、カメラ10の中に備えられる変換処理部12又は録画部14、あるいは、変換処理部12と録画部14の両方を映像処理装置と呼び、撮像部11をカメラと呼んでもよい。 Note that the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 need not be provided in the camera 10. Either the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 may be provided on either the student side, the teacher side, or the network 300 as the video processing device described above. Also, the camera 10 including the conversion processing unit 12 or the recording unit 14, or both the conversion processing unit 12 and the recording unit 14 may be called a video processing device. Also, the conversion processing unit 12 or the recording unit 14 provided in the camera 10, or both the conversion processing unit 12 and the recording unit 14 may be called a video processing device, and the imaging unit 11 may be called a camera.
 <実施例1の効果>
 ある地点にいる人が、遠隔地にいる人と対話をする上で、音声だけでなく顔を見ながら対話することを実現する技術は既にある。しかし、その対話の中から生まれた知見を図表や文字によって表現する場合、音声や顔の表情だけでは十分に伝わらない。
<Effect of Example 1>
There is already a technology that enables a person at a certain point to have a face-to-face conversation as well as voice when conversing with a person at a remote location. However, when expressing the knowledge that emerges from these conversations in diagrams and text, it is not possible to fully convey it through voice and facial expressions alone.
 特に紙面に書き込んだ情報を、互いに離れた地点の複数人で共有するためには、既存の映像共有では解像度が不十分であるか、ネットワークの回線速度が不十分である。それに対し、紙面に書き込まれた情報はほぼ静止しているという条件を用いて回線速度が貧弱でも、今書き込んだ情報をほぼリアルタイムで共有できるカメラと回線を、対話用とは別に用意することで「対話の中から生まれた知見」を簡便に伝え合うことができる。なお、紙面共有用の回線と対話用の回線を別に用意することの他、ある回線を紙面共有用及び対話用の両方に使用することとしてもよい。 In particular, in order to share information written on paper with multiple people in remote locations, the resolution of existing video sharing is insufficient, or the line speed of the network is insufficient. On the other hand, by using the condition that the information written on the paper is almost stationary, even if the line speed is poor, by preparing a camera and line that can share the information written now almost in real time, separately from the dialogue. You can easily communicate "knowledge born from dialogue". In addition to separately preparing a line for page sharing and a line for dialogue, one line may be used for both page sharing and dialogue.
 特に、教師が生徒に対して行う授業の様な形態では、生徒側が解像度を気にしながら書き込みをさせるのは非効率であり、紙面に書いた情報をそのまま共有し、教師がその書き込みを見ながら対話ができるのは知識の伝達を効率化させる。 Especially in a class where the teacher gives the students, it is inefficient for the students to write while worrying about the resolution. Being able to have a dialogue makes the transfer of knowledge more efficient.
 (実施例2)
 次に実施例2を説明する。実施例2は、複数地点のうちの少なくともいずれか1つに地点において複数の人がいる場合の例である。実施例2におけるシステムの全体構成は実施例1と同じであり、図1に示したとおりである。
(Example 2)
Next, Example 2 will be described. Example 2 is an example in which a plurality of people are present at at least one of the plurality of locations. The overall configuration of the system in Example 2 is the same as in Example 1, as shown in FIG.
 実施例2では、生徒側に複数の人(生徒と呼称する)が存在し、複数の生徒用の生徒側システム100が備えられる。実施例2における教師側システム200の構成は実施例1で説明した教師側システム200と同じでよい。 In the second embodiment, there are multiple people (referred to as students) on the student side, and a student-side system 100 for multiple students is provided. The configuration of the teacher-side system 200 in the second embodiment may be the same as that of the teacher-side system 200 described in the first embodiment.
 実施例2の生徒側システム100は、基本的には図2に示した構成と同様であるが、実施例2では、複数の生徒に対応して、カメラ101、カメラ102、映像表示装置103のうちのいずれか1つ又はいずれか2つ又は全部が、複数台備えられる。いずれの場合であっても、収音機材については生徒1人に1つずつ用意してもよい。 The student-side system 100 of the second embodiment is basically the same as the configuration shown in FIG. Any one, any two, or all of them are provided in plurality. In either case, one sound collecting device may be prepared for each student.
 例えば、生徒を撮影するカメラ101は、生徒一人に1つずつ備えられてもよい。また、複数の生徒を撮影する1つ又は複数のカメラ101が備えられてもよい。 For example, one camera 101 for photographing a student may be provided for each student. Also, one or more cameras 101 may be provided that capture multiple students.
 生徒が鉛筆やペンなどで書き込んだ紙面などの静止物を撮影するカメラ102についても生徒一人に1つずつ備えられてもよいし、2人に1つなど何人かの生徒でカメラ102を共有してもよい。 Each student may be provided with one camera 102 for photographing a stationary object such as a paper surface written by a student with a pencil or pen, or the camera 102 may be shared by several students, such as one for every two students. may
 生徒の紙面の映像に関しては、生徒一人ずつ1枚の紙の紙面全体の映像を送信してもよいし、特定の位置に解答を書き込む特定の場所を予め定めて印刷した紙を各生徒に配布しておき、当該特定の場所だけを拡大して送信してもよい。 Regarding the image of the student's paper space, it is possible to transmit the image of the entire paper surface of one sheet for each student, or distribute to each student a paper printed with a specific place to write the answer in a specific position Then, only the specific location may be enlarged and transmitted.
 書き込みがなされた紙面の映像の送信に関しては、例えば、カメラ102が1[fps]などで撮影した映像を常に送信し続ける。実施例1で説明したような上下反転や透視投影変換を行ってもよい。 Regarding the transmission of the image of the written paper, for example, the image captured by the camera 102 at 1 [fps] continues to be transmitted. Upside-down reversal or perspective projection conversion as described in the first embodiment may be performed.
 また、例えば、録画部(例えばカメラ102の録画部)に、撮影した紙面の映像を記録しておき、その紙面の書き込みをした生徒が自分で映像を送信するタイミングを決めてもよい。例えば、各生徒が、カメラ102を操作して録画部に映像送信を指示してもよいし、カメラ102への指示を行う電子機器を用いて映像送信操作を行ってもよい。 In addition, for example, the captured image of the paper may be recorded in the recording unit (for example, the recording unit of the camera 102), and the student who wrote the paper may decide the timing of transmitting the image by himself. For example, each student may operate the camera 102 to instruct the recording unit to transmit an image, or may use an electronic device for instructing the camera 102 to perform an image transmission operation.
 また、例えば、生徒が紙や下敷きの特定の場所を指で触ることが映像送信指示であってもよい。この場合、カメラ102が、紙や下敷きの特定の場所を指で触ることを映像で認識した場合に、録画部に対して映像送信を指示する。これらの録画制御は、実施例1、3でも適用されてもよい。 Also, for example, a student's finger touching a specific place on a piece of paper or underlay may be a video transmission instruction. In this case, when the camera 102 recognizes that the finger touches a specific place on the paper or underlay in the image, it instructs the recording unit to transmit the image. These recording controls may also be applied in the first and third embodiments.
 教師側システム200における映像表示装置203には、生徒側システム100から送信されてきた複数の生徒の紙面の映像が表示される。教師は複数の生徒の書き込みを確認した上で、教師の操作に基づいて、ある生徒の書き込んだ紙面の映像を、当該生徒本人の前にある映像表示装置103に映し出し、さらに加筆することができる。ここで生徒と対話してもよい。例えば解答が間違っている場合のみ、教師側の操作によって解答以外の部分の書き込みを表示して、書き込みの過程をチェックしてもよい。 The image display device 203 in the teacher's system 200 displays images of multiple students' sheets transmitted from the student's system 100 . After confirming the writings of a plurality of students, the teacher can display the image of the paper written by a certain student on the image display device 103 in front of the student himself based on the teacher's operation, and can further add to it. . You can interact with your students here. For example, only when the answer is wrong, the writing process of the part other than the answer may be displayed by the teacher's operation to check the writing process.
 上記のような教師の操作に基づく制御を行う機能は、教師側システム200における映像表示装置203が備えても良いし、映像表示装置203以外の装置(例えば、制御装置400)が備えても良い。 The function of performing control based on the teacher's operation as described above may be provided in the video display device 203 in the teacher-side system 200, or may be provided in a device other than the video display device 203 (for example, the control device 400). .
 また、生徒が行った解答の書き込みは教師が自分でチェックしてもよいし、手書きを認識する技術を用いて自動で採点を行ってもよい。手書きの認識については生徒個々人の手書き文字を学習することで認識精度を上げながら利用してもよい。手書きの認識を行う機能は、教師側システム200における映像表示装置203が備えても良いし、映像表示装置203以外の装置(例えば、制御装置400)が備えても良い。 In addition, the teacher can check the answers written by the students themselves, or grade them automatically using handwriting recognition technology. Handwriting recognition may be used while improving the recognition accuracy by learning the handwritten characters of individual students. The function of recognizing handwriting may be provided in the video display device 203 in the teacher-side system 200, or may be provided in a device other than the video display device 203 (for example, the control device 400).
 (実施例3)
 次に、実施例3について説明する。実施例3におけるシステム構成は実施例2と同じであり、生徒側に複数の生徒が存在し、教師側システム200の映像表示装置203には複数の生徒の書き込みが表示される。実施例3では、録画を使って効率的に教師と生徒の間で対話などを行う例について説明する。
(Example 3)
Next, Example 3 will be described. The system configuration of the third embodiment is the same as that of the second embodiment, a plurality of students exist on the student side, and the writings of the plurality of students are displayed on the video display device 203 of the teacher side system 200 . In a third embodiment, an example will be described in which recording is used to efficiently have a dialogue between a teacher and a student.
 例えば30人の生徒がいる場合、教師が30人の提出する書き込みを全てチェックするには時間がかかり、また生徒側も時間を持て余してしまう。 For example, if there are 30 students, it will take time for the teacher to check all the entries submitted by the 30 students, and the students will have too much time.
 そこで、実施例3では、複数の生徒をグループ分けし、録画を用いることで効率的に答案チェックの時間を作り出すこととしている。具体的には下記のとおりである。 Therefore, in Example 3, multiple students are grouped and recording is used to efficiently create time for checking answers. Specifically, it is as follows.
 生徒が30人いるとして、30人を例えば3つのグループA、B、Cに分ける。図6に、生徒側をグループA、B、Cに分けた場合のシステム構成例を示す。各グループのシステム100A、100B、100Cの構成はそれぞれ実施例2で説明した生徒側システム100における構成と同様である。 Assuming that there are 30 students, divide the 30 students into three groups, A, B, and C. FIG. 6 shows a system configuration example when the students are divided into groups A, B, and C. In FIG. The configuration of the systems 100A, 100B, and 100C of each group is the same as the configuration of the student-side system 100 described in the second embodiment.
 図7を参照して、実施例3の動作例を説明する。まず、教師がグループAに30分間授業をするとともに、その様子をカメラ201で撮影するとともに、録画部で録画する。録画は、教師側、生徒側、ネットワーク300上のどの録画部で行ってもよいが、例えば、教師側システム200のカメラ201の録画部で行う。これにより、教師が録画の操作を行うことができる。 An operation example of the third embodiment will be described with reference to FIG. First, the teacher gives a lesson to group A for 30 minutes, and the situation is photographed by the camera 201 and recorded by the recording unit. Recording may be performed by any recording unit on the teacher side, the student side, or on the network 300, but is performed by the recording unit of the camera 201 of the teacher system 200, for example. This allows the teacher to operate recording.
 その後グループAに30分間演習をさせる。その紙面の画像は、カメラ102で撮影され、教師側の映像表示装置204に送られ表示される。これにより、教師は答案チェックを行う。教師が答案をチェックしている間にグループBへ、録画された映像が送信され、グループBでは映像表示装置により録画を視聴し、グループAの演習が終了すると同時にグループBが演習を行う。 Then have Group A practice for 30 minutes. The image of the page is captured by the camera 102 and sent to the video display device 204 on the teacher's side for display. This allows the teacher to check the answers. While the teacher is checking the answers, the recorded video is transmitted to the group B, the group B views the video recording on the video display device, and the group B exercises at the same time as the group A finishes the exercise.
 上記の過程を繰り返すことで、教師は30分の授業後に90分かけて生徒全員の解答を順にチェックすることができる。 By repeating the above process, the teacher can check the answers of all the students in order for 90 minutes after the 30-minute class.
 なお、実施例2及び実施例3において、生徒側に複数の生徒がいるとともに、教師側においても複数の教師がいてもよい。その場合の教師側システム200における構成は、実施例2の生徒側システム100と同様であり、複数の教師に対応して、カメラ201、カメラ202、映像表示装置203のうちのいずれか1つ又はいずれか2つ又は全部が、複数台備えられる。いずれの場合であっても、収音機材については教師1人に1つずつ用意してもよい。 In addition, in Examples 2 and 3, there may be a plurality of students on the student side and a plurality of teachers on the teacher side. The configuration of the teacher system 200 in that case is the same as that of the student system 100 of the second embodiment. A plurality of any two or all are provided. In either case, one sound collecting device may be prepared for each teacher.
 生徒側に複数の生徒がいるとともに、教師側においても複数の教師がいる場合において、答案をチェックする時間においては複数の教師が分担してチェックにあたってもよい。 If there are multiple students on the student side and multiple teachers on the teacher side, multiple teachers may share the time to check the answers.
 <実施例2,3の効果>
 生徒が10人以上程度の規模の場合、生徒自身に鉛筆を動かして作業をさせ、その結果を確認するとなると、紙を提出させて採点してから返却するなどの作業が必要となる。遠隔でその様な作業をするとなると紙に書かれた情報をデジタル化する作業が必要となり、リアルタイムのやり取りが遠隔にできない。
<Effects of Examples 2 and 3>
In the case of a scale of about 10 or more students, if the students themselves move the pencils to do the work, and if the results are to be confirmed, it is necessary to have the students submit the papers, grade them, and then return them. When such work is done remotely, it is necessary to digitize the information written on paper, and real-time exchange cannot be done remotely.
 実施例2、3で説明した技術によれば、教師は生徒全員の書き込みを十分な解像度でほぼリアルタイムに収集することができ、解答など紙の上で確認すべき場所を予め指定しておけば、画面上で多くの解答を同時に確認することができる。 According to the technology described in Examples 2 and 3, the teacher can collect the writings of all the students at a sufficient resolution almost in real time, and if the place to check on the paper such as the answer is specified in advance, , many answers can be checked at the same time on the screen.
 また一定以上の人数の生徒を相手に鉛筆を動かして作業をさせ、さらに教師が確認をするとなると、リアルタイムには生徒毎に十分な時間を取れないことになるが、生徒側を複数のグループに分け、教師からの情報伝達を録画して時間差で作業を進めることによって、教師は生徒の解答など確認すべき書き込みに対して生徒毎に十分な時間を取ることができる。 Also, if more than a certain number of students are asked to move their pencils around and the teacher confirms the work, there will not be enough time for each student in real time. By recording the information transmission from the teacher and progressing the work with a time lag, the teacher can take sufficient time for each student to check the student's answers and other writings.
 (ハードウェア構成例)
 実施例1~3で説明した映像処理装置、制御装置、映像表示装置はいずれも、例えば、コンピュータにプログラムを実行させることにより実現できる。このコンピュータは、物理的なコンピュータであってもよいし、クラウド上の仮想マシンであってもよい。以下、映像処理装置、制御装置、映像表示装置を総称して「装置」と呼ぶ。
(Hardware configuration example)
All of the video processing device, control device, and video display device described in the first to third embodiments can be implemented by causing a computer to execute a program, for example. This computer may be a physical computer or a virtual machine on the cloud. Hereinafter, the video processing device, control device, and video display device will be collectively referred to as "apparatus".
 すなわち、当該装置は、コンピュータに内蔵されるCPUやメモリ等のハードウェア資源を用いて、当該装置で実施される処理に対応するプログラムを実行することによって実現することが可能である。上記プログラムは、コンピュータが読み取り可能な記録媒体(可搬メモリ等)に記録して、保存したり、配布したりすることが可能である。また、上記プログラムをインターネットや電子メール等、ネットワークを通して提供することも可能である。 That is, the device can be realized by executing a program corresponding to the processing performed by the device using hardware resources such as a CPU and memory built into the computer. The above program can be recorded in a computer-readable recording medium (portable memory, etc.), saved, or distributed. It is also possible to provide the above program through a network such as the Internet or e-mail.
 図8は、上記コンピュータのハードウェア構成例を示す図である。図8のコンピュータは、それぞれバスBSで相互に接続されているドライブ装置1000、補助記憶装置1002、メモリ装置1003、CPU1004、インタフェース装置1005、表示装置1006、入力装置1007、出力装置1008等を有する。 FIG. 8 is a diagram showing a hardware configuration example of the computer. The computer of FIG. 8 has a drive device 1000, an auxiliary storage device 1002, a memory device 1003, a CPU 1004, an interface device 1005, a display device 1006, an input device 1007, an output device 1008, etc., which are interconnected by a bus BS.
 当該コンピュータでの処理を実現するプログラムは、例えば、CD-ROM又はメモリカード等の記録媒体1001によって提供される。プログラムを記憶した記録媒体1001がドライブ装置1000にセットされると、プログラムが記録媒体1001からドライブ装置1000を介して補助記憶装置1002にインストールされる。但し、プログラムのインストールは必ずしも記録媒体1001より行う必要はなく、ネットワークを介して他のコンピュータよりダウンロードするようにしてもよい。補助記憶装置1002は、インストールされたプログラムを格納すると共に、必要なファイルやデータ等を格納する。 A program that implements the processing in the computer is provided by a recording medium 1001 such as a CD-ROM or memory card, for example. When the recording medium 1001 storing the program is set in the drive device 1000 , the program is installed from the recording medium 1001 to the auxiliary storage device 1002 via the drive device 1000 . However, the program does not necessarily need to be installed from the recording medium 1001, and may be downloaded from another computer via the network. The auxiliary storage device 1002 stores installed programs, as well as necessary files and data.
 メモリ装置1003は、プログラムの起動指示があった場合に、補助記憶装置1002からプログラムを読み出して格納する。CPU1004は、メモリ装置1003に格納されたプログラムに従って、当該装置に係る機能を実現する。インタフェース装置1005は、ネットワークや各種計測装置、運動介入装置等に接続するためのインタフェースとして用いられる。表示装置1006はプログラムによるGUI(Graphical User Interface)等を表示する。入力装置1007はキーボード及びマウス、ボタン、又はタッチパネル等で構成され、様々な操作指示を入力させるために用いられる。出力装置1008は演算結果を出力する。 The memory device 1003 reads and stores the program from the auxiliary storage device 1002 when a program activation instruction is received. The CPU 1004 implements functions related to the device according to programs stored in the memory device 1003 . The interface device 1005 is used as an interface for connecting to a network, various measuring devices, exercise intervention devices, and the like. A display device 1006 displays a GUI (Graphical User Interface) or the like by a program. An input device 1007 is composed of a keyboard, a mouse, buttons, a touch panel, or the like, and is used to input various operational instructions. The output device 1008 outputs the calculation result.
 (実施の形態の効果)
 本実施の形態に係る技術により、遠隔地間で人物の映像を送受信することにより対話を行うシステムにおいて、人物の映像を送受信するとともに、情報記録媒体に記述した情報の映像を遠隔地間で手間なく適切に共有することが可能となる。すなわち、遠隔地間で手書きの文書をすぐに手間なく共有でき、対話だけでなく文書上での情報のやり取りを適切に実現することが可能となる。
(Effect of Embodiment)
With the technology according to the present embodiment, in a system in which dialogue is performed by transmitting and receiving images of people between remote locations, images of people are transmitted and received, and images of information described in an information recording medium are transmitted and received between remote locations. It is possible to share appropriately without In other words, handwritten documents can be readily shared between remote locations without much effort, and it is possible to appropriately implement not only dialogue but also exchange of information on documents.
 (実施の形態のまとめ)
 本明細書には、少なくとも下記各項の情報共有システム、映像処理装置、情報共有方法、及びプログラムが開示されている。
(第1項)
 ネットワークで接続された少なくとも第1の地点と第2の地点との間で情報を共有するための情報共有システムであって、
 前記第1の地点において、第1のカメラと第2のカメラを含む少なくとも2つのカメラが備えられ、
 前記第2の地点において、映像表示装置が備えられ、
 前記第1の地点における前記第1のカメラで撮影された人物の映像が前記第2の地点の映像表示装置に送信され、前記第2のカメラで撮影された情報記録媒体に記述された情報が前記第2の地点の映像表示装置に送信され、
 前記第2のカメラにより撮影される映像のフレームレートは、前記第1のカメラにより撮影される映像のフレームレートよりも低く、前記第2のカメラにより撮影される映像の解像度は、前記第1のカメラにより撮影される映像の解像度よりも高い
 情報共有システム。
(第2項)
 前記第1の地点に複数の人物が存在し、1人に1つ、又は、複数人に1つの前記第1のカメラが備えられ、1人に1つ、又は、複数人に1つの前記第2のカメラが備えられる
 第1項に記載の情報共有システム。
(第3項)
 前記情報共有システムは録画部を備え、当該録画部が前記第2のカメラで撮影された映像を録画し、前記第1の地点における人物による操作に基づいて、録画された映像が前記第2の地点における映像表示装置に送信される
 第2項に記載の情報共有システム。
(第4項)
 前記第1の地点における前記複数の人物は、それぞれ複数の人物を含む複数のグループに分割され、前記第2の地点にカメラが備えられ、
 前記第2の地点におけるカメラにより撮影した人物の映像を前記第1の地点における第1グループに所定時間だけ送信するとともに、当該映像を録画し、
 前記所定時間後に、録画した映像を前記第1の地点における第2グループに所定時間だけ送信し、その所定時間の間に、前記第2の地点における映像表示装置は、前記第1グループにおける前記第2のカメラで撮影された映像を受信する
 第2項又は第3項に記載の情報共有システム。
(第5項)
 第1項ないし第4項のうちいずれか1項に記載の情報共有システムにおいて使用される映像処理装置であって、
 前記第2のカメラで撮影された情報記録媒体の映像に対して、当該情報記録媒体の形状が当該情報記録媒体を上から見た場合の形状に見えるように透視投影変換処理を施す変換処理部
 を備える映像処理装置。
(第6項)
 ネットワークで接続された少なくとも第1の地点と第2の地点との間で情報を共有するための情報共有システムにおける情報共有方法であって、
 前記第1の地点において、第1のカメラと第2のカメラを含む少なくとも2つのカメラが備えられ、前記第2の地点において、映像表示装置が備えられ、
 前記第1の地点における前記第1のカメラで撮影された人物の映像を前記第2の地点の映像表示装置に送信し、前記第2のカメラで撮影された情報記録媒体に記述された情報を前記第2の地点の映像表示装置に送信し、
 前記第2のカメラにより撮影される映像のフレームレートは、前記第1のカメラにより撮影される映像のフレームレートよりも低く、前記第2のカメラにより撮影される映像の解像度は、前記第1のカメラにより撮影される映像の解像度よりも高い
 情報共有方法。
(第7項)
 コンピュータを、第5項に記載の映像処理装置における変換処理部として機能させるためのプログラム。
(Summary of embodiment)
This specification discloses at least an information sharing system, a video processing device, an information sharing method, and a program according to the following items.
(Section 1)
An information sharing system for sharing information between at least a first point and a second point connected by a network,
at least two cameras including a first camera and a second camera at the first point;
A video display device is provided at the second point,
An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitted to the video display device at the second point,
The frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera. An information sharing system with a higher resolution than the video captured by the camera.
(Section 2)
A plurality of persons are present at the first point, one person or one person is provided with the first camera, and one person or the plurality of persons are provided with the first camera. 2. Information sharing system according to clause 1, wherein two cameras are provided.
(Section 3)
The information sharing system includes a recording unit, and the recording unit records the video captured by the second camera, and based on the operation by the person at the first location, the recorded video is transmitted to the second camera. The information sharing system according to item 2, which is transmitted to a video display device at a point.
(Section 4)
The plurality of persons at the first point are divided into a plurality of groups each containing a plurality of persons, and a camera is provided at the second point,
transmitting a video of a person captured by a camera at the second point to a first group at the first point for a predetermined period of time and recording the video;
After the predetermined time, the recorded video is transmitted to the second group at the first point for a predetermined time, and during the predetermined time, the video display device at the second point transmits the second group at the first group. 3. The information sharing system according to item 2 or 3, which receives images shot by the camera No. 2.
(Section 5)
A video processing device used in the information sharing system according to any one of items 1 to 4,
A conversion processing unit that performs perspective projection conversion processing on the image of the information recording medium captured by the second camera so that the shape of the information recording medium looks like the shape of the information recording medium viewed from above. A video processing device comprising:
(Section 6)
An information sharing method in an information sharing system for sharing information between at least a first point and a second point connected by a network, comprising:
At least two cameras including a first camera and a second camera are provided at the first point, and a video display device is provided at the second point,
An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitting to the video display device at the second location;
The frame rate of the video captured by the second camera is lower than the frame rate of the video captured by the first camera, and the resolution of the video captured by the second camera is higher than that of the first camera. A method of information sharing that is higher than the resolution of the video captured by the camera.
(Section 7)
A program for causing a computer to function as a conversion processing unit in the video processing device according to item 5.
 以上、本実施の形態について説明したが、本発明はかかる特定の実施形態に限定されるものではなく、特許請求の範囲に記載された本発明の要旨の範囲内において、種々の変形・変更が可能である。 Although the present embodiment has been described above, the present invention is not limited to such a specific embodiment, and various modifications and changes can be made within the scope of the gist of the present invention described in the claims. It is possible.
10 カメラ
11 撮像部
12 変換処理部
13 送信部
14 録画部
100 生徒側システム
101 カメラ
102 カメラ
103 映像表示装置
104 送受信装置
200 教師側システム
201 カメラ
202 カメラ
203 映像表示装置
204 送受信装置
300 ネットワーク
1000 ドライブ装置
1001 記録媒体
1002 補助記憶装置
1003 メモリ装置
1004 CPU
1005 インタフェース装置
1006 表示装置
1007 入力装置
1008 出力装置
10 Camera 11 Imaging unit 12 Conversion processing unit 13 Transmission unit 14 Recording unit 100 Student side system 101 Camera 102 Camera 103 Video display device 104 Transmission/reception device 200 Teacher side system 201 Camera 202 Camera 203 Video display device 204 Transmission/reception device 300 Network 1000 Drive device 1001 recording medium 1002 auxiliary storage device 1003 memory device 1004 CPU
1005 interface device 1006 display device 1007 input device 1008 output device

Claims (7)

  1.  ネットワークで接続された少なくとも第1の地点と第2の地点との間で情報を共有するための情報共有システムであって、
     前記第1の地点において、第1のカメラと第2のカメラを含む少なくとも2つのカメラが備えられ、
     前記第2の地点において、映像表示装置が備えられ、
     前記第1の地点における前記第1のカメラで撮影された人物の映像が前記第2の地点の映像表示装置に送信され、前記第2のカメラで撮影された情報記録媒体に記述された情報が前記第2の地点の映像表示装置に送信され、
     前記第2のカメラにより撮影される映像のフレームレートは、前記第1のカメラにより撮影される映像のフレームレートよりも低く、前記第2のカメラにより撮影される映像の解像度は、前記第1のカメラにより撮影される映像の解像度よりも高い
     情報共有システム。
    An information sharing system for sharing information between at least a first point and a second point connected by a network,
    at least two cameras including a first camera and a second camera at the first point;
    A video display device is provided at the second point,
    An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitted to the video display device at the second point,
    The frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera. An information sharing system with a higher resolution than the video captured by the camera.
  2.  前記第1の地点に複数の人物が存在し、1人に1つ、又は、複数人に1つの前記第1のカメラが備えられ、1人に1つ、又は、複数人に1つの前記第2のカメラが備えられる
     請求項1に記載の情報共有システム。
    A plurality of persons are present at the first point, one person or one person is provided with the first camera, and one person or the plurality of persons are provided with the first camera. 2. The information sharing system of claim 1, wherein two cameras are provided.
  3.  前記情報共有システムは録画部を備え、当該録画部が前記第2のカメラで撮影された映像を録画し、前記第1の地点における人物による操作に基づいて、録画された映像が前記第2の地点における映像表示装置に送信される
     請求項2に記載の情報共有システム。
    The information sharing system includes a recording unit, and the recording unit records the video captured by the second camera, and based on the operation by the person at the first location, the recorded video is transmitted to the second camera. 3. The information sharing system according to claim 2, wherein the information is transmitted to a video display device at a point.
  4.  前記第1の地点における前記複数の人物は、それぞれ複数の人物を含む複数のグループに分割され、前記第2の地点にカメラが備えられ、
     前記第2の地点におけるカメラにより撮影した人物の映像を前記第1の地点における第1グループに所定時間だけ送信するとともに、当該映像を録画し、
     前記所定時間後に、録画した映像を前記第1の地点における第2グループに所定時間だけ送信し、その所定時間の間に、前記第2の地点における映像表示装置は、前記第1グループにおける前記第2のカメラで撮影された映像を受信する
     請求項2又は3に記載の情報共有システム。
    The plurality of persons at the first point are divided into a plurality of groups each containing a plurality of persons, and a camera is provided at the second point,
    transmitting a video of a person captured by a camera at the second point to a first group at the first point for a predetermined period of time and recording the video;
    After the predetermined time, the recorded video is transmitted to the second group at the first point for a predetermined time, and during the predetermined time, the video display device at the second point transmits the second group at the first group. 4. The information sharing system according to claim 2 or 3, which receives images shot by two cameras.
  5.  請求項1ないし4のうちいずれか1項に記載の情報共有システムにおいて使用される映像処理装置であって、
     前記第2のカメラで撮影された情報記録媒体の映像に対して、当該情報記録媒体の形状が当該情報記録媒体を上から見た場合の形状に見えるように透視投影変換処理を施す変換処理部
     を備える映像処理装置。
    A video processing device used in the information sharing system according to any one of claims 1 to 4,
    A conversion processing unit that performs perspective projection conversion processing on the image of the information recording medium captured by the second camera so that the shape of the information recording medium looks like the shape of the information recording medium viewed from above. A video processing device comprising:
  6.  ネットワークで接続された少なくとも第1の地点と第2の地点との間で情報を共有するための情報共有システムにおける情報共有方法であって、
     前記第1の地点において、第1のカメラと第2のカメラを含む少なくとも2つのカメラが備えられ、前記第2の地点において、映像表示装置が備えられ、
     前記第1の地点における前記第1のカメラで撮影された人物の映像を前記第2の地点の映像表示装置に送信し、前記第2のカメラで撮影された情報記録媒体に記述された情報を前記第2の地点の映像表示装置に送信し、
     前記第2のカメラにより撮影される映像のフレームレートは、前記第1のカメラにより撮影される映像のフレームレートよりも低く、前記第2のカメラにより撮影される映像の解像度は、前記第1のカメラにより撮影される映像の解像度よりも高い
     情報共有方法。
    An information sharing method in an information sharing system for sharing information between at least a first point and a second point connected by a network, comprising:
    At least two cameras including a first camera and a second camera are provided at the first point, and a video display device is provided at the second point,
    An image of a person captured by the first camera at the first location is transmitted to an image display device at the second location, and information described in the information recording medium captured by the second camera is transmitted. transmitting to the video display device at the second location;
    The frame rate of the video taken by the second camera is lower than the frame rate of the video taken by the first camera, and the resolution of the video taken by the second camera is higher than that of the first camera. A method of information sharing that is higher than the resolution of the video captured by the camera.
  7.  コンピュータを、請求項5に記載の映像処理装置における変換処理部として機能させるためのプログラム。 A program for causing a computer to function as a conversion processing unit in the video processing device according to claim 5.
PCT/JP2021/021781 2021-06-08 2021-06-08 Information sharing system, image processing device, information sharing method, and program WO2022259375A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/021781 WO2022259375A1 (en) 2021-06-08 2021-06-08 Information sharing system, image processing device, information sharing method, and program
JP2023527212A JPWO2022259375A1 (en) 2021-06-08 2021-06-08

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/021781 WO2022259375A1 (en) 2021-06-08 2021-06-08 Information sharing system, image processing device, information sharing method, and program

Publications (1)

Publication Number Publication Date
WO2022259375A1 true WO2022259375A1 (en) 2022-12-15

Family

ID=84425943

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/021781 WO2022259375A1 (en) 2021-06-08 2021-06-08 Information sharing system, image processing device, information sharing method, and program

Country Status (2)

Country Link
JP (1) JPWO2022259375A1 (en)
WO (1) WO2022259375A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05244553A (en) * 1991-11-11 1993-09-21 Canon Inc Picture transmission system, picture processing unit and terminal equipment
JP2013138402A (en) * 2011-11-30 2013-07-11 Nakabayashi Co Ltd Diary system, mobile terminal device, control method, and control program
JP2014175946A (en) * 2013-03-11 2014-09-22 Seiko Epson Corp Imaging apparatus
JP2015119430A (en) * 2013-12-20 2015-06-25 カシオ計算機株式会社 Image reading apparatus, image reading method and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05244553A (en) * 1991-11-11 1993-09-21 Canon Inc Picture transmission system, picture processing unit and terminal equipment
JP2013138402A (en) * 2011-11-30 2013-07-11 Nakabayashi Co Ltd Diary system, mobile terminal device, control method, and control program
JP2014175946A (en) * 2013-03-11 2014-09-22 Seiko Epson Corp Imaging apparatus
JP2015119430A (en) * 2013-12-20 2015-06-25 カシオ計算機株式会社 Image reading apparatus, image reading method and program

Also Published As

Publication number Publication date
JPWO2022259375A1 (en) 2022-12-15

Similar Documents

Publication Publication Date Title
US9830831B2 (en) Mobile handwriting recording instrument and group lecture delivery and response system using the same
CN110263041B (en) Single-interface display method and system of motion trail information
CN106971638B (en) Interactive wireless teaching method
CN102693047A (en) Providing position information in a collaborative environment
EP2759966A1 (en) Method for conducting a collaborative event and system employing same
CN104575138A (en) Scene interaction type multimedia system and application thereof
CN111325853B (en) Remote coaching system and method based on augmented reality glasses
CN111738889A (en) OMO intelligent interactive cloud classroom system supporting multiple terminals
CN108922287A (en) A kind of multimedia interconnection tutoring system and its interconnected method
CN103839451A (en) Informationized paperless classroom teaching system
US20120045746A1 (en) Electronic class system
CN111009162A (en) Interactive teaching system based on PPT demonstration
KR20170098617A (en) Customized training service level management system and method using a digital pen and a cloud server
WO2016190493A1 (en) Interaction-based remote video communication and lecturing system using transparent display
CN203490852U (en) Terminal for electronic teaching
JPWO2017010469A1 (en) Handwriting device and voice / handwriting communication system
CN205177198U (en) System of going over examination papers on line infraduction line
KR20160082291A (en) Image processing apparatus and image processing method thereof
KR101000893B1 (en) Method for sharing displaying screen and device thereof
CN109545012A (en) A kind of shared tutoring system
WO2022259375A1 (en) Information sharing system, image processing device, information sharing method, and program
CN113434081A (en) Teaching system capable of implementing man-machine interaction and facilitating teaching information exchange and use method
JP5037245B2 (en) Information processing system, information output device, medium, information output method and program
KR101753731B1 (en) File conversion devices through a shared document in electronic blackboard
CN204480508U (en) A kind of scene interaction formula multimedia system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21945053

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023527212

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE