JP6334906B2 - Video distribution system and program - Google Patents

Description

  The present invention generally relates to video distribution systems and programs, and more particularly to a video distribution system and program for distributing video of events such as classes, conferences, lectures, and the like to terminal devices.

  2. Description of the Related Art Conventionally, a video distribution system has been proposed in which videos of events such as classes, meetings, lectures, etc. are taken with a camera, and this video is provided to remote users via a network. For example, Patent Literature 1 discloses a content generation system configured to sequentially store instructor shooting data obtained by shooting a lecturer's lecture scenery in a storage device and to transmit content data including the instructor shooting data to a client terminal. Yes.

  In the content generation system described in Patent Document 1, an encoding terminal acquires video data captured by a camera (for instructor imaging) and generates instructor imaging data including moving image data such as MPEG in real time. Since the content data registered in the content server is distributed in response to a request from the client terminal, the client terminal can reproduce and learn the content data at a timing convenient for the student.

  Patent Document 2 describes a lecture recording device that automatically records lectures in a lecture room and generates lecture contents as distribution contents. The lecture recording apparatus described in Patent Document 2 uses recorded lecture data such as video and audio as lecture metadata (including items such as “class subject name”, “start date”, “start”, and “end”). Based on this, it is formed into lecture content and registered in the distribution server. The lecture content is distributed on the Web by the distribution server. Here, video recording starts when the instructor logs in to the lecture terminal in the lecture room, and ends when the “End Lecture” button is pressed.

JP 2009-3446 A JP 2008-172583 A

  By the way, in the configuration as described in Patent Documents 1 and 2, in order to start recording a video, the instructor needs to perform some operation such as logging in to the terminal. Some operation is required for the terminal. Therefore, an administrator such as an instructor takes time and effort to operate the terminal at each event, and there is a possibility that video recording may be missed due to an operation mistake or the like.

  The present invention has been made in view of the above reasons, and an object of the present invention is to provide a video distribution system and a program that saves an administrator's operation and is unlikely to cause a video recording omission.

In order to solve the above-described problem, a video distribution system according to a first aspect of the present invention is a video recording system that is recorded by a camera in accordance with a management unit in which schedules indicating start times and end times of a plurality of events are registered in advance. The video content corresponding to each of the plurality of events in accordance with the schedule , the video content corresponding to each of the events in accordance with the schedule , and the video content in the standard format data for distribution. A conversion unit that converts to a file, a storage unit that stores the data file in association with each of the plurality of events, and one of the plurality of events is specified from the terminal device. The data file corresponding to the event is read from the storage unit and distributed to the terminal device Characterized in that it comprises a distribution unit.

  A video distribution system according to a second aspect of the present invention further includes an extraction unit that extracts a background video excluding a moving body based on a change between a plurality of frames of the video content in the first aspect. The storage unit is configured to store the background video data file as the data file.

  According to a third aspect of the video distribution system of the present invention, in the second aspect, the background video includes a video of an information display board for displaying information, and the extraction unit is configured to include a plurality of frames of the video content. In the information display board, the background image is generated by restoring at least the information displayed on the information display board for the overlapping area hidden by the moving body.

  According to a fourth aspect of the video delivery system of the present invention, in the third aspect, the extraction unit is configured to perform shading correction on the background video.

  A video distribution system according to a fifth aspect of the present invention is characterized in that, in the third or fourth aspect, the video distribution system further includes an identification unit that identifies the type of the information display board by performing image processing on the background video. .

  A video distribution system according to a sixth aspect of the present invention, according to the fifth aspect, further includes a setting unit that sets a shooting condition of the camera, and the setting unit is the information display board identified by the identification unit. The imaging condition is automatically determined in accordance with the type of the camera.

  A video distribution system according to a seventh aspect of the present invention, according to the third or fourth aspect, further includes a setting unit that sets a shooting condition of the camera, and the setting unit is configured to each of the plurality of events in the schedule. When the type of the information display board corresponding to is specified, the photographing conditions according to the type of the information display board are automatically determined according to the schedule. To do.

  According to an eighth aspect of the present invention, in the first or second aspect, the acquisition unit is configured to acquire the information displayed on the information display board as display data from the information display board. The conversion unit is configured to convert the video content and the display data acquired from the information display board into the data file.

  According to a ninth aspect of the video delivery system of the present invention, in any one of the first to eighth aspects, the acquisition unit and the conversion unit are configured to acquire the video content by the acquisition unit, and The conversion is performed at the same time.

  The video distribution system according to a tenth aspect of the present invention is the video distribution system according to any one of the first to ninth aspects, wherein the conversion unit automatically detects when the video content of the same event is divided on the way. The data files are combined and converted into one data file.

The program according to the present invention includes a computer that obtains video content captured by a camera from the camera according to a schedule registered in advance indicating start times and end times of a plurality of events, and the plurality according to the schedule. The video content corresponding to each of the events is read out, associated with the event , the conversion unit converting the video content into a data file in a standard format for distribution, and associated with each of the plurality of events When the storage unit that stores the data file and any one of the plurality of events is specified from the terminal device, the data file corresponding to the specified event is read from the storage unit and sent to the terminal device. A program that functions as a video distribution device including a distribution unit for distribution It is.

  According to the first aspect of the present invention, the acquisition unit acquires video content according to a schedule, and the conversion unit converts the video content into a standard format data file for distribution in association with each of a plurality of events. Further, the storage unit stores the data file in association with each of the plurality of events. Therefore, the video distribution system according to the first embodiment can automate the process from recording to distribution of video content, and does not require any operation by the administrator. There is an advantage that recording omission is difficult to occur.

  According to the second aspect of the present invention, since the moving object image is excluded from the distribution data file, the user can view only the image of the stationary object such as the information display board.

  According to the third aspect of the present invention, since the video of the information display board hidden in the moving body is restored by the extraction unit, the information display board that compensates for the lack of displayed information in a pseudo manner Can be distributed. Therefore, the video distribution system according to the third embodiment can accurately transmit the information displayed on the information display board to the user with no video content.

  According to the fourth aspect of the present invention, the extraction unit clearly distinguishes information on characters, symbols, graphics, and the like displayed on the information display board and other areas from the information display board image. Background image can be extracted.

  According to the fifth aspect of the present invention, the identification unit can automatically identify the type of the information display board in the background video even when the type of information display board used for each event is different.

  According to the sixth aspect of the present invention, even when there are a plurality of types of information display boards, the camera can display information under optimum shooting conditions according to the type of information display board without manually changing camera settings. You can shoot the board.

  According to the seventh aspect of the present invention, the camera can display information with optimal shooting conditions according to the type of the information display board, with simpler processing than when the type of the information display board is determined by the identification unit. The board can be photographed.

  According to the eighth aspect of the present invention, the information displayed on the information display board can be obtained directly from the information display board, not from the video imaged by the camera, so that the user lacks the information. Can be transmitted accurately.

  According to the ninth aspect of the present invention, it is possible to shorten the time taken from the acquisition of the video from the camera to the creation of the data file for distribution.

  According to the tenth aspect of the present invention, even if the video content is divided in the middle of an event due to a communication failure or the like, for example, the conversion unit automatically joins the same event as a data file for distribution. One data file can be created.

1 is a block diagram illustrating a schematic configuration of a video distribution system according to Embodiment 1. FIG. 1 is a schematic diagram illustrating an overall configuration of a video distribution system according to Embodiment 1. FIG. It is explanatory drawing which shows the display screen of the terminal device in Embodiment 1. FIG. It is explanatory drawing which shows the display screen of the terminal device in Embodiment 1. FIG. It is a block diagram which shows schematic structure of the video delivery system which concerns on Embodiment 2. FIG.

(Embodiment 1)
As shown in FIG. 1, the video distribution system 10 according to the present embodiment includes a management unit 11, an acquisition unit 12, a conversion unit 13, a storage unit 14, and a distribution unit 15.

  In the management unit 11, a schedule indicating the start time and end time of a plurality of events is registered in advance. The acquisition unit 12 acquires video content shot by the camera 2 from the camera 2 according to the schedule. The conversion unit 13 converts the video content into a data file in a standard format for distribution in association with each of the plurality of events.

  The accumulation unit 14 accumulates the data file in association with each of the plurality of events. When any one of a plurality of events is designated from the terminal device 3, the delivery unit 15 reads a data file corresponding to the designated event from the storage unit 14 and delivers the data file to the terminal device 3.

  The events here have predetermined start and end times, such as classes, conferences, and lectures at universities and cram schools, and are mainly held in specific spaces such as classrooms and conference rooms. Event. The start time and end time on the schedule may include a date. For a certain event, for example, the start time “December 1, 2013, 9:00” and the end time “December 1, 2013, 10:00 “30 minutes”.

  Hereinafter, the video distribution system 10 according to the present embodiment will be described in detail. However, the video distribution system 10 described below is only an example of the present invention, and the present invention is not limited to the following embodiment. The technical distribution according to the present invention is not limited to this embodiment. Various modifications can be made according to the design or the like as long as they do not depart from the idea.

  In the present embodiment, as an example, a video of a lecture-style lesson (event) performed by a lecturer in a university classroom is taken with the camera 2 and this video is used to provide a student via a network. The configuration and function of the video distribution system 10 will be described. In this example, a person related to the university is an administrator of the video distribution system 10, and a student (student) is a user of the video distribution system 10.

  Here, a class conducted according to a predetermined timetable at a university is taken as an example of an event. In the timetable, for each day of the week from Monday to Friday, classes scheduled to be held in each classroom are assigned for each unit time defined by the start time and end time. For example, the first period on Tuesday (9: 00-10: 30) is “Quantum Mechanics” in Class A, and the second period on Tuesday (10: 40-12: 10) is “Electronics” in Class A, Class B The class is assigned as “Japanese history”.

  The video distribution system 10 of this embodiment distributes the video of such a class together with audio to the terminal device 3 possessed by the student who is the user via the network. As a result, students can take classes conducted at the university even from a remote location. In particular, the video distribution system 10 according to the present embodiment mainly stores (stores) the recorded video content as a data file in the storage unit 14 and reads the video content read from the storage unit 14 in response to a request from the terminal device 3. (Data file) is distributed to the terminal device 3. Therefore, the student can watch the recorded lesson at his convenient time. The video distribution system 10 of the present embodiment further has a function of distributing video of a class being opened to the terminal device 3 in real time.

  However, the video distribution system 10 according to the present invention is not limited to video distribution of such classes, but can be widely applied to video distribution of events in which the start time and end time of meetings, lectures, etc. are determined in advance. It is. The video distribution system 10 only needs to have at least a function for distributing video, and is not an essential function for audio distribution. Furthermore, the video distribution system 10 only needs to have a function of distributing at least the video stored in the storage unit 14, and the function of distributing the video in real time is not an essential function.

  Next, the hardware configuration of the video distribution system 10 of this embodiment will be described with reference to FIG. As shown in FIG. 2, the video distribution system 10 includes a video distribution apparatus 1 connected to a LAN (Local Area Network) switch 4 as a main configuration. The video distribution device 1 is connected to a network 100 such as the Internet via a router (not shown), and the terminal device 3 is connected to the network 100.

  The video distribution apparatus 1 is a computer having a CPU (Central Processing Unit) and a memory. By executing a program stored in the memory, a management unit 11, an acquisition unit 12, a conversion unit 13, and an accumulation unit 14 which will be described later. The function as the distribution unit 15 is realized. The program here is a program that causes a computer to function as the video distribution apparatus 1.

  The video delivery apparatus 1 implements a function as a video delivery apparatus by installing a dedicated application (application software) and executing the application. The computer used as the video distribution apparatus 1 may store the program in a memory in advance, or may receive the program from an electric communication line such as the Internet or from a storage medium in which the program is stored. .

  The LAN switch 4 is a switching hub (layer 2 switch), and is connected to the camera 2 and the microphone 5 as shown in FIG. That is, the video distribution device 1 is connected to the camera 2 and the microphone 5 via a local area network (LAN).

  The camera 2 includes an image sensor (imaging device) such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and converts the captured video into an electrical signal and outputs the electrical signal. Although the video image | photographed with the camera 2 is a moving image here, not only a moving image but a still image may be sufficient. The camera 2 captures the captured video, for example, H.264. H.264 or H.264 The video content is compressed by a codec such as H.265 and output to the video distribution apparatus 1 as video content. As such a camera 2, not a dedicated camera but a general-purpose IP (Internet Protocol) camera (network camera) having a LAN connection function is used.

  The microphone 5 includes a microphone main body 51 that converts sound into an electrical signal, and a microphone amplifier 52. The microphone 5 receives the sound input to the microphone main body 51, for example, G.P. The audio data is output from the microphone amplifier 52 to the video distribution apparatus 1 as audio data of a codec such as 711 or AAC (Advanced Audio Coding). The microphone body 51 and the microphone amplifier 52 may be integrated. Further, the microphone 5 may be integrated (built in) the camera 2.

  The camera 2 and the microphone 5 are installed in a classroom where classes are held. The arrangement and orientation of the camera 2 are set so that at least the entire information display board 6 such as a blackboard or a white board (white board) is reflected. The arrangement and orientation of the microphone 5 are set so that at least the voice of the lecturer H1 who conducts the lesson can be picked up. Preferably, the camera 2 and the microphone 5 are attached to the ceiling of the classroom by a bracket (not shown).

  When there are a plurality of classrooms where classes are held, the camera 2 and the microphone 5 may be installed for each classroom or only in a specific classroom. In the present embodiment, it is assumed that the camera 2 and the microphone 5 are installed in each of “Classroom A”, “Classroom B”, and “Classroom C”. However, in FIG. 2, only one set of the camera 2 and the microphone 5 provided in the classroom A is illustrated, and the illustration of the camera 2 and the microphone 5 provided in the classroom B and the classroom C is omitted.

  The video distribution device 1 does not necessarily have to be wired to the camera 2 and the microphone 5 and receives data (video data, audio data) from the camera 2 and the microphone 5 through wireless communication such as a wireless LAN. It may be configured as follows.

  The terminal device 3 is a personal computer (personal computer), a tablet terminal, a smartphone, or the like owned by a student (user), and has a user interface such as a display function for performing various displays and an input function for receiving user operation input. ing. Further, the terminal device 3 has a function of connecting to the network 100 by wired or wireless communication. Here, the terminal device 3 has a Web browser function, and reproduces (displays) video content distributed from the video distribution device 1 via the network 100. That is, the video distribution device 1 functions as a server and the terminal device 3 functions as a client.

  Specifically, the terminal device 3 is a computer having a CPU and a memory in addition to a user interface and a communication function, and implements a function as a terminal device by executing a program stored in the memory. The program here is a program that causes a computer to function as the terminal device 3.

  The terminal device 3 implements a function as a terminal device by installing a dedicated application (application software) and executing the application. The computer used as the terminal device 3 may store the program in a memory in advance, or may receive the program from an electric communication line such as the Internet or from a storage medium in which the program is stored. However, the terminal device 3 only needs to have at least a Web browser function, and a dedicated application is not essential.

  When there are a plurality of students, the terminal device 3 may be possessed by all the students individually or only by a specific student. In the present embodiment, it is assumed that a plurality of students each have the terminal device 3. However, in FIG. 2, only one terminal device 3 is illustrated, and illustration of the other terminal devices 3 is omitted.

  In this embodiment, the video distribution system 10 includes the video distribution device 1, the camera 2, the terminal device 3, and the microphone 5 and the LAN switch 4 as constituent elements. 1 may be included in the constituent elements. In other words, the video distribution system 10 only needs to be connected so that the video distribution device 1 can communicate with the camera 2 and the terminal device 3, and the camera 2, the terminal device 3, the microphone 5, and the LAN switch 4 are constituent elements. It does not have to be included. Furthermore, the microphone 5 and the LAN switch 4 may be omitted.

  The video distribution system 10 having the above-described configuration does not need to use a special device for any of the camera 2, the microphone 5, and the LAN switch 4, and can use a general-purpose device. Can be suppressed. Furthermore, since a general-purpose computer can be used for the video distribution device 1 and the terminal device 3, the video distribution system 10 can keep the introduction cost low.

  Note that the camera 2 and the microphone 5 are not limited to the above-described configurations, and for example, a camera or a microphone mounted on a smartphone or a tablet terminal may be used.

  Next, the video distribution apparatus 1 which is the main configuration of the video distribution system 10 will be described in detail with reference to FIG. In FIG. 1, the microphone 5 is integrated (built in) the camera 2, and the illustration of the microphone 5 is omitted. Therefore, the data input from the camera 2 to the video distribution device 1 includes video data and audio data. Hereinafter, the video content with audio is simply referred to as “video content”, but it is not essential that the video content has audio.

  In FIG. 1, a plurality of cameras 2 are illustrated. When the cameras 2 are distinguished, the camera 2 installed in the classroom A is “21”, and the camera 2 installed in the classroom B is “22”. “The camera 2 installed in the classroom C is referred to as“ 23 ”. In FIG. 1, the first to third terminal devices 3 are illustrated. When each terminal device 3 is distinguished, the first terminal device 3 is “31” and the second terminal device 3 is “ 32 ”and the third terminal device 3 is referred to as“ 33 ”.

  As shown in FIG. 1, the video distribution device 1 includes a management unit 11, an acquisition unit 12, a conversion unit 13, a storage unit 14, and a distribution unit 15. Here, the video distribution apparatus 1 is divided into a recording block 110 including an acquisition unit 12 and a conversion unit 13 and a distribution block 120 including a distribution unit 15. However, the recording block 110 and the distribution block 120 are only functionally separated and physically integrated. Furthermore, the video distribution apparatus 1 according to the present embodiment includes a recording unit 16 provided in the recording block 110 and a protocol conversion unit 17 provided in the distribution block 120 in addition to the above configuration.

  In addition, the video distribution device 1 may have a user interface such as a display function for performing various displays and an input function for receiving a user operation input. Alternatively, the video distribution device 1 may be configured to use another device as a user interface by communicating with another device such as a personal computer.

  In the management unit 11, schedules indicating start times and end times of a plurality of classes (events) are registered in advance according to the class timetable. Here, when the administrator of the video distribution system 10 (a university official) logs into the video distribution system 10 with the administrator ID, the video distribution apparatus 1 enters the management mode, and the management unit 11 is accessed using the user interface. It becomes possible to register the schedule. Therefore, the administrator of the video distribution system 10 registers the schedule in the management unit 11 by operating the video distribution apparatus 1 in the management mode in advance and inputting start times and end times of a plurality of classes according to the timetable.

  Specifically, the management unit 11 manages a schedule on a calendar using a GUI (Graphical User Interface). That is, for example, as shown in FIG. 3, the management unit 11 manages a schedule on a table TA1 in which cells are set for each day of one month. The administrator of the video distribution system 10 registers a schedule by assigning a lesson scheduled to be held in each classroom for each unit time defined by the start time and end time to each cell of the table TA1. The start time and end time defining the unit time can be changed.

  In the example of FIG. 3, for example, the start time “April 1, 2013” for the “political economy” class held in classroom A on the first period (9: 00-10: 30) on Monday, April 1 “9:00” and end time “10:30 on April 1, 2013”. Similarly, the start time “10:40 on April 1, 2013” for the class of “Mathematics” held in Classroom A in the second period (10: 40-12: 10) on Monday, April 1 The end time is set as “April 1, 2013 12:10”.

  In FIG. 3, the numbers in parentheses indicate the time period. For example, classes assigned to the same unit time, such as “Electronics” and “History of Japan” in the second period on Tuesday. Are classes held in separate classrooms. In addition, the management unit 11 registers each class as an individual class (event) for each start time (including date) and end time (including date) even for the same subject. For example, the first term “political economy” on April 1 (Monday) and the first term “political economy” on April 8 (Monday) are registered as separate classes. The schedule also includes classroom information for identifying the classroom in which each class is held.

  The schedule registered in the management unit 11 in this way can be displayed on the terminal device 3. Here, when the user (student) of the video distribution system 10 logs in to the video distribution system 10 with the user ID, the video distribution apparatus 1 enters the normal mode, and the schedule registered in the management unit 11 is stored in the terminal apparatus 3. Can be displayed. Therefore, the user can confirm the timetable of the class he / she attends by confirming the schedule on the table TA1 as illustrated in FIG.

  In addition, the management unit 11 is not limited to the configuration provided in the video distribution device 1, and may be realized by, for example, another computer that can communicate with the video distribution device 1 or realized by the cloud (cloud computing). May be.

  The acquisition unit 12 acquires video content (with audio) output from the camera 2 by a streaming method using RTSP (Real Time Streaming Protocol). Here, the acquisition unit 12 acquires video content from the camera 2 according to a schedule registered in the management unit 11. Specifically, the acquisition unit 12 reads the schedule from the management unit 11 and starts to acquire video content from the camera 2 of the classroom where the class is held at the start time of any registered class, At the end time of the class, the acquisition of the video content ends.

  Moreover, in the present embodiment, the acquisition unit 12 is configured to be able to acquire video content from a plurality of cameras 21 to 23 in parallel. That is, the acquisition unit 12 can simultaneously acquire images captured by the multiple cameras 21 to 23. Here, it is assumed that the maximum number of cameras 2 from which the acquisition unit 12 can acquire video content in parallel is 20.

  The acquisition unit 12 once records (records) the video content acquired from the camera 2 in a recording unit 16 including a storage device such as a hard disk drive. At this time, the acquisition unit 12 records video content in the recording unit 16 in association with at least a time stamp indicating the shooting date and time, and classroom information indicating a classroom that is the shooting location. The classroom information here is information for identifying individual classrooms A, B, and C, and is associated with the identification information of the camera 2 installed in each classroom in a one-to-one correspondence. Therefore, from the video content recorded in the recording unit 16, the date and time when the video was shot and the classroom where the video was shot can be specified.

  Here, the acquisition unit 12 uses the memory of the video distribution device 1 as a buffer in order to stably record the video content acquired from the camera 2 in the recording unit 16. That is, the acquisition unit 12 may cause a difference between the data transmission speed from the camera 2 and the writing speed to the recording unit 16 depending on the communication status between the video distribution device 1 and the camera 2. . Even in such a case, the acquisition unit 12 can stably continue writing (recording) data to the recording unit 16 by using the memory as a buffer.

  Note that the video distribution device 1 is configured to automatically delete the video content recorded in the recording unit 16 after a certain period (for example, three days) has elapsed.

  The conversion unit 13 converts the video content recorded in the recording unit 16 into a data file in a standard format for distribution in association with each class. In this embodiment, the conversion unit 13 adopts the mp4 file format as the standard format for distribution. However, the conversion unit 13 is not limited to this configuration, and any file format such as flv or avi can be adopted as the standard format.

  Specifically, the conversion unit 13 reads the schedule from the management unit 11, and reads from the recording unit 16 the video content (with audio) of the classroom where the lesson was performed from the start time to the end time of each lesson. Then, the data is converted into a data file in association with the class. As a result, each data file converted (created) by the conversion unit 13 becomes video content in which the contents of the associated class are recorded.

  Here, when converting video data and audio data into a data file for distribution, a general video distribution system performs conversion for both video data and audio data. Even if the same codec as the original video data is used in the converted data file, a general video distribution system generally decodes the video data and then re-encodes it. . However, when such conversion is performed in the video distribution system, the load on the CPU increases and the time required for the conversion also increases.

  Therefore, in the video distribution system 10 according to the present embodiment, the conversion unit 13 uses the video portion (video data) as it is among the video content (with audio) acquired from the camera 2 and changes only the file container. It is configured to file. In other words, the conversion unit 13 is configured to convert the video content included in the video content into a data file without changing the codec. For example, the conversion unit 13 has the codec of the original video data as H.264. H.264, the video data is not decoded or encoded at all. A data file is created using video data as is in the H.264 codec.

  At this time, the conversion unit 13 may use the audio data in the video content as it is, or may once decode and then encode again. That is, for example, when the codec of the original audio data is AAC, the conversion unit 13 does not decode and encode the audio data in the same manner as the video data, and uses the audio data as the AAC codec. Create On the other hand, the codec of the original audio data is G. In the case of 711, the conversion unit 13 creates a data file using the audio data obtained by converting the codec into AAC.

  Thus, since the conversion unit 13 uses the video portion of the video content as it is, the video distribution system 10 can greatly reduce the load on the conversion of the CPU of the video distribution device 1. There are advantages like

  First, as a first advantage, the video distribution system 10 can reduce the time required for the conversion process for converting the video content into a data file for distribution. As an example, the video distribution system 10 can reduce the time required for the conversion process in the conversion unit 13 to about 1.02 times the real time when the camera 2 is shooting a video. For example, in the case of a 90-minute class, the time required for the conversion process is a time obtained by adding about 90 to 120 seconds to the actual time (90 minutes).

  As a second advantage, the acquisition unit 12 and the conversion unit 13 can simultaneously perform acquisition of video content by the acquisition unit 12 and conversion by the conversion unit 13. That is, the video distribution system 10 causes the CPU to simultaneously execute the processing as the acquisition unit 12 and the processing as the conversion unit 13, thereby acquiring the video content by the acquisition unit 12 and the conversion process by the conversion unit 13. Can be executed simultaneously. In the example of the above 90-minute class, the video distribution system 10 starts the acquisition of the video content in the acquisition unit 12 and starts the conversion process in the conversion unit 13 with a delay of about 5 minutes. After completing the acquisition of the video content, the conversion process in the conversion unit 13 is completed within 7 minutes. Therefore, the video distribution system 10 can shorten the time until the data file of the lesson is created after the lesson is completed.

  As a third advantage, the conversion unit 13 can convert a plurality of video contents acquired from each of the plurality of cameras 2 into a data file in parallel. The video distribution system 10, for example, converts the video content captured by the three cameras 21 to 23 at the same time, thereby reducing the time required for the conversion process by about 3 minutes compared to the case of converting each video content individually. It can be shortened to 1. For example, when the CPU of the video distribution apparatus 1 is multi-core, simultaneous conversion can be easily realized by assigning one camera 2 to one core.

  In the present embodiment, the conversion unit 13 has a function of automatically combining and converting into one data file when video content of the same class is divided in the middle. That is, when the video content is divided during the class due to a communication failure between the video distribution device 1 and the camera 2, the conversion unit 13 automatically determines these video content and performs the combining process. Do. Specifically, the conversion unit 13 refers to the schedule, and when the video content shot in a certain classroom is divided into two or more between the start time and the end time of the lesson, It is determined that the video content is a video of the same class, and a combination process is performed.

  The storage unit 14 is composed of a storage device such as a hard disk drive, for example, and stores each data file converted by the conversion unit 13 as described above in a state of being associated with each class on the schedule in a one-to-one correspondence ( save. As a result, a data file made up of video content containing the contents of the lesson is stored in the storage unit 14 in association with each lesson. The video distribution apparatus 1 is configured to automatically delete the data file recorded in the storage unit 14 after a certain period (for example, one month).

  The distribution unit 15 reads the data file stored in the storage unit 14 and distributes the data file to the terminal device 3 via the network 100 (see FIG. 2). In the present embodiment, when the distribution unit 15 receives a distribution request from the terminal device 3, the distribution unit 15 is configured to distribute the data file to the terminal device 3 that has transmitted the distribution request as a response to the distribution request. Yes.

  Specifically, the video distribution device 1 displays the schedule registered in the management unit 11 on the terminal device 3 as a table TA1 as illustrated in FIG. In this state, when an operation for selecting any lesson is performed on the terminal device 3, a distribution request including specific information (information including a lesson start time and an end time and classroom information) specifying the lesson is sent to the terminal. It is transmitted from the device 3 to the video distribution device 1. Upon receiving the distribution request, the video distribution apparatus 1 specifies a class from the specific information included in the distribution request, and reads out a data file corresponding to the class from the storage unit 14 in the distribution unit 15.

  When the distribution unit 15 reads the data file, the distribution unit 15 distributes the data file to the terminal device 3 by an appropriate method of download distribution or streaming distribution. In the case of download distribution, the terminal device 3 can reproduce the video content after completely downloading the data file of the video content. In the case of streaming distribution, the terminal device 3 reproduces a video content data file while downloading it. Here, the streaming includes both progressive download reproduction (pseudo streaming reproduction) and real-time streaming reproduction. In the progressive method, the terminal device 3 stores the data file distributed from the distribution unit 15, but in the real-time method, the terminal device 3 does not store the data file distributed from the distribution unit 15.

  Moreover, in the present embodiment, the distribution unit 15 is configured to be able to distribute data files to a plurality of terminal devices 31 to 33 in parallel. That is, the distribution unit 15 can simultaneously distribute video content to a plurality of terminal devices 31 to 33. Here, it is assumed that the maximum number of terminal devices 3 to which the distribution unit 15 can distribute video content in parallel is 500.

  Further, the video distribution system 10 can perform the distribution of the video content by the distribution unit 15 simultaneously with the acquisition of the video content by the acquisition unit 12 and the conversion process by the conversion unit 13.

  In addition, when there is an attached file in which the material used in the class is converted into a data file, the delivery unit 15 preferably delivers the attached file to the terminal device 3 together with the video content data file. In this case, an administrator of the video distribution system 10 (university official) logs in the video distribution system 10 with an administrator ID and registers an attached file in association with each class on the schedule. The attached file may be accumulated in the accumulation unit 14 or may be accumulated in a storage device other than the accumulation unit 14.

  The terminal device 3 reproduces (displays) the video content distributed from the distribution unit 15 in a format as shown in FIG. 4, for example. In the example of FIG. 4, the video content being played back is displayed in the display window W1 on the left side of the screen, and the detailed information on the lesson corresponding to the video content being played back is displayed in the detail table TA2 on the right side of the screen. An outline of a lesson (date, start time, end time, subject, etc.) corresponding to the video content being reproduced is displayed at the top of the display window W1. The detailed table TA2 includes detailed information regarding the class, such as a semester, a faculty, a subject, a cycle, a time limit, a classroom, a teacher, a reading group, and an attached file. The detailed information is transmitted from the distribution unit 15 to the terminal device 3 together with the video content data file.

  Thereby, the user (student) logs in the video distribution system 10 with the user ID to display the schedule on the terminal device 3 and selects a lesson at a desired date and time on the schedule, thereby The video content can be viewed on the terminal device 3.

  Here, the video distribution system 10 may have a log analysis function, and thereby the distribution status of the video content to the terminal device 3 can be managed. Specifically, the video distribution system 10 can manage the progress status for each user by managing how far the video content of each class has been viewed for each user ID.

  When the acquisition unit 12 acquires video content from a plurality of cameras 21 to 23 in parallel, the video content from the plurality of cameras 21 to 23 is also obtained in each process from the acquisition unit 12 to the distribution unit 15. Are preferably processable in parallel.

  Furthermore, in the video distribution system 10 of the present embodiment, the video distribution device 1 also has a function of live distribution of the video content output from the camera 2 from the distribution unit 15 to the terminal device 3 without making it a data file. ing. Specifically, the video distribution device 1 performs only protocol conversion from RTSP (Real Time Streaming Protocol) to RTMP (Real Time Messaging Protocol) in the protocol conversion unit 17 and distributes the video content from the camera 2 in real time. . In other words, the video distribution device 1 does not store the video content for live distribution in the recording unit 16 or the storage unit 14.

  Thereby, the user (student) can watch the video of the class being opened on the terminal device 3 in real time. Even in the case of using live delivery, the user can select a lesson of a desired date and time on the schedule in the terminal device 3 in the same manner as in the case of delivery of the data file stored in the storage unit 14. The content can be viewed on the terminal device 3. The video for live distribution may be taken by the camera 2 that is common to the cameras 21 to 23 from which the video content is acquired by the acquisition unit 12, or a camera for live distribution may be provided separately. Good.

  Further, the video distribution system 10 does not necessarily require the acquisition unit 12 to directly acquire the video content captured by the camera 2 from the camera 2, but the video content distributed (relayed) by a server (not shown) or the like. The acquisition part 12 may acquire. In other words, for example, in a remote lesson, the video of the lesson is streamed by the server, so the video distribution system 10 may be configured to acquire the streamed video by the acquisition unit 12. Thereby, the video delivery system 10 can transfer the video of the lesson streamed from a remote place to the terminal device 3 as a data file.

  Further, the video distribution system 10 may be configured to always record the video shot by the camera 2 in the recording unit 16. In this case, video content for a certain period (eg, 3 days) going back from the present time is recorded in the recording unit 16. In this case, the conversion unit 13 also cuts out video content recorded in the recording unit 16 for classes that are registered in the schedule afterwards and converts them into data files in a standard format for distribution in association with each class. It is preferable to do. As a result, the video distribution system 10 can create a data file for distribution even for classes registered in the schedule after the class ends, and even if the recording process is omitted due to forgetting to register the class in the schedule. It becomes possible to respond.

  According to the video distribution system 10 of the present embodiment described above, the acquisition unit 12 acquires video content according to a schedule, and the conversion unit 13 is a standard for distribution of video content in association with each of a plurality of classes (events). Convert to a format data file. Furthermore, the storage unit 14 stores a data file in association with each of a plurality of classes (events). For this reason, the video distribution system 10 can automate the process from recording to distribution of video content, and does not require any operation by the administrator. Therefore, the operation of the administrator can be saved, and an operation error can be caused. There is an advantage that omission of video recording hardly occurs.

  Moreover, although the case where the video delivery apparatus 1 consists of one computer was illustrated in this embodiment, the recording block 110 and the delivery block 120 may be different apparatuses, for example. In this case, the recording block 110 and the distribution block 120 are not limited to one-to-one, but may be one-to-many (1: N). If the recording block 110 and the distribution block 120 are separate devices, for example, it is possible to arrange a device equipped with the recording block 110 near the classroom and arrange a device equipped with the distribution block 120 in a remote data center. become. Further, when there are a large number of classrooms to be photographed (for example, 20 or more), if a plurality of apparatuses equipped with the recording blocks 110 are provided, one apparatus equipped with the distribution block 120 is sufficient.

  Below, the example which applies the video delivery system 10 of a structure as mentioned above to uses other than the video delivery of a lesson is shown.

  As a first example, the video distribution system 10 can be used as a system for recording a conference. That is, if a conference room is a reservation system and a conference scheduled to be held in each conference room is assigned for each unit time defined by the start time and end time, the conference is used as an event. The conference can be recorded with the camera 2 installed in the room. In this case, the video distribution system 10 can store the video of each conference taken by the camera 2 in the storage unit 14 as a data file in association with each conference.

  As a second example, the video distribution system 10 can be used as a system for recording the appearance of animals in a zoo. That is, if the cameras 2 are installed in various animal cages, the state of the animals can be recorded by the camera 2 for each unit time defined by the start time and the end time. In this case, for example, “April 1, 9:00 to 10:00: Monkey”, “April 1, 10:00 to 11:00: Lion”, start time, end time, animal An event is represented by a name. The video distribution system 10 can store the video captured by the camera 2 in the storage unit 14 as a data file for each event.

  As a third example, the video distribution system 10 can be used in cooperation with a video conference system that bi-directionally transmits video and audio between remote locations. In this case, the video distribution system 10 acquires the video content shot by the camera of the video conference system by the acquisition unit 12, converts it into a data file for distribution, and stores it in the storage unit 14. Thereby, since the video delivery system 10 can use the camera of the video conference system, the video can be recorded without providing a new camera. Further, in the video conference system, it is possible to leave video captured by the camera as a data file.

(Embodiment 2)
As shown in FIG. 5, the video distribution system 10 according to the present embodiment is different from the video distribution system 10 of the first embodiment in that it further includes an extraction unit 18, an identification unit 19, and a setting unit 20. Hereinafter, the same configurations as those of the first embodiment are denoted by common reference numerals, and description thereof will be omitted as appropriate.

  In the present embodiment, the extraction unit 18, the identification unit 19, and the setting unit 20 are all provided in the recording block 110 of the video distribution device 1.

  The extraction unit 18 is configured to extract a background video excluding a moving body based on a change between a plurality of frames of video content. In this case, the storage unit 14 is configured to store a background video data file as the data file converted by the conversion unit 13. That is, the video content acquired by the acquisition unit 12 from the camera 2 is not only a stationary object such as an information display board 6 (see FIG. 2) such as a blackboard or a white board, but also moved like a lecturer H1 (see FIG. 2). The body is also included. The extraction unit 18 deletes the moving body from the video content and extracts only the still body video as the background video.

  Specifically, the extraction unit 18 takes a difference between a plurality of consecutive frames of the video content before the conversion unit 13, the moving object is in a region where the change amount of the pixel value is equal to or greater than the threshold value, and the other region is stationary. Judge as body. The extraction unit 18 deletes the area determined as a moving body from each frame of the video content, extracts the remaining area (area determined as a stationary body) as a background video, and outputs the background video to the conversion unit 13. As a result, the conversion unit 13 converts only the background video into a data file and stores the data file in the storage unit 14. However, the extraction unit 18 only needs to be able to separate at least the background video and the video of the mobile object, and may be configured to extract the video of the mobile object as a foreground video separately from the background video.

  According to this configuration, since the video of the lecturer H1, which is a moving body, is excluded from the data file for distribution, the user (student) can only view the video of a stationary object such as the information display board 6. Can do. Note that information such as characters, symbols, and graphics displayed on the information display board 6 changes as the instructor H1 writes or erases the information. Extracted as

  Here, the background video includes at least a video of the information display board 6 that displays information. In this case, the extraction unit 18 restores the information displayed on the information display board 6 and generates the background video for the overlapping area hidden by the moving body in the information display board 6 from the plurality of frames of the video content. Is preferred. That is, when there is a lecturer H1 as a moving body in front of the information display board 6, an area overlapping the lecturer H1 in the information display board 6 is an overlapping area. For such overlapping areas, simply deleting the moving object may result in lack of information displayed on the information display board 6 in the first place.

  Therefore, the extraction unit 18 restores the video of the information display board 6 in the portion (overlapping area) hidden by the instructor H1, so that the video of the information display board 6 that artificially compensates for the lack of displayed information ( Background image) can be displayed. Specifically, the extracting unit 18 applies the video at the same position of the past background video to the overlapping region by superimposing the past background video for one or more frames. As a result, the extraction unit 18 can generate the background video by restoring the information displayed on the information display board 6 for the overlapping area.

  The extraction unit 18 is preferably configured to perform shading correction on the background video. That is, the extraction unit 18 corrects the background image so as to eliminate unevenness of density (light quantity) by shading correction. Thereby, the extraction part 18 extracts the background image | video which distinguished clearly the information of the character, symbol, figure, etc. which are displayed on the information display board 6, and the area | region other than the image | video of the information display board 6. FIG. be able to.

  By the way, the information display board 6 has a plurality of types such as a blackboard (chalk board) and white board (marker board) made of materials such as glass, enamel, and plastic, as well as a projector screen, an electronic blackboard (electronic white board), and a digital signage. There is. The electronic blackboard is a device that displays information written on a screen with a stylus or a pen. The light reflectance and color development on the information display board 6 vary greatly depending on the type of the information display board 6. Therefore, the video distribution system 10 according to the present embodiment includes an identification unit 19 as a function for automatically identifying the type of the information display board 6.

  The identification unit 19 is configured to identify the type of the information display board 6 by performing image processing on the background video. That is, the identification unit 19 performs image processing on the background video extracted by the extraction unit 18 to identify the area of the information display board 6 in the background video, and from the light reflectance and color development in this area. The type of the information display board 6 is identified.

  According to this configuration, for example, even when the type of the information display board 6 varies depending on the classroom, the identification unit 19 automatically identifies the type of the information display board 6 in the background video. Therefore, the administrator of the video distribution system 10 does not need to perform an operation for registering the type of the information display board 6 in advance.

  The setting unit 20 is configured to set shooting conditions of the camera 2. The shooting conditions of the camera 2 include at least the shutter speed, the aperture, and the sensitivity. Here, the setting unit 20 is configured to automatically determine the imaging condition according to the type of the information display board 6 identified by the identification unit 19. Specifically, the video distribution apparatus 1 registers in advance the optimum shooting conditions for each type of the information display board 6 in the memory as a condition list, and the setting section 20 identifies the information display board identified by the identification section 19. The optimum shooting conditions for the six types are selected from the condition list. For example, since the white board has higher light reflectance than the blackboard, the sensitivity is set lower in the white board photographing conditions than in the blackboard photographing conditions. The setting unit 20 transmits the selected shooting condition to the camera 2 via the acquisition unit 12 to automatically change the shooting condition of the camera 2. The setting unit 20 may be configured to directly transmit the shooting conditions to the camera 2 instead of via the acquisition unit 12.

  According to the video distribution system 10 of the present embodiment described above, the video of the information display board 6 of the portion (overlapping area) hidden by the lecturer H1 is restored by the extraction unit 18, so that the displayed information is lacking. It is possible to display an image (background image) of the information display board 6 in which the above is simulated. Therefore, even if the lecturer H1 is present in front of the information display board 6 in the data file for distribution, the user (student) can also view the information displayed on the information display board 6 in the portion hidden by the lecturer H1. Can see. Therefore, the video distribution system 10 can accurately transmit the information displayed on the information display board 6 to the user with no video content.

  Further, the identification unit 19 automatically identifies the type of the information display board 6, and the setting unit 20 automatically sets the shooting conditions of the camera 2 according to the type of the information display board 6 identified by the identification unit 19. To decide. Therefore, even when there are a plurality of types of information display boards 6, the camera 2 can shoot the information display board 6 under optimum shooting conditions according to the type of the information display board 6 without manually changing the settings of the camera 2. Can do.

  In the video distribution system 10, it is not essential that the background video includes the video on the information display board 6. In the video distribution system 10, the function of restoring the information displayed on the information display board 6 for the overlapping area in the extraction unit 18 is not essential and can be omitted as appropriate. Further, the shading correction function in the extraction unit 18, the identification unit 19, and the setting unit 20 are not essential components in the video distribution system 10 and can be omitted as appropriate.

  By the way, as a first modification of the present embodiment, the setting unit 20 may determine the shooting condition of the camera 2 according to the schedule instead of the identification result in the identification unit 19. In the first modification, the setting unit 20 changes the type of the information display board 6 according to the schedule when the type of the information display board 6 corresponding to each of a plurality of classes (events) is specified in the schedule. A corresponding photographing condition is automatically determined.

  That is, when the type of the information display board 6 to be used is determined in advance for each class, the type of the information display board 6 can be registered in advance in association with the class in the schedule. In this case, the setting unit 20 selects an optimal shooting condition in accordance with the type of the information display board 6 specified on the schedule. As a result, the video distribution system 10 is simpler than the case where the identification unit 19 determines the type of the information display board 6, and the information display board 6 can be operated under the optimum shooting conditions according to the type of the information display board 6. Can be taken.

  In the first modification as well, the setting unit 20 determines the shooting condition of the camera 2 according to the identification result in the identification unit 19 for classes in which the information display board 6 is not specified on the schedule. It may be.

  As a second modification of the present embodiment, the acquisition unit 12 may be configured to acquire information displayed on the information display board 6 from the information display board 6 as display data. In this case, the conversion unit 13 is configured to convert the video content and the display data acquired from the information display board 6 into a data file.

  That is, the second modified example is that electronic data output from the information display board 6 when the information display board 6 is an information display board of a type that can output displayed information such as an electronic blackboard as electronic data. Is directly acquired by the acquisition unit 12. As a result, the video distribution system 10 can directly acquire the information displayed on the information display board 6 from the information display board 6 instead of from the video captured by the camera 2. Can be transmitted accurately.

  Specifically, when an electronic blackboard having an HDMI (registered trademark) (High-Definition Multimedia Interface) output is used as the information display board 6, the video distribution apparatus 1 uses an HDMI (registered trademark) cable to display the information display board. 6 is electrically connected. The video distribution device 1 is configured to detect activation of the information display board 6 and acquire display data from the information display board 6. The video distribution apparatus 1 may combine the acquired display data with the area of the information display board 6 of the video content for distribution and distribute it in a form included in the video content, or distribute it separately from the video content. Also good. When the display data is distributed separately from the video content, the terminal device 3 displays the content of the display data side by side with the video content playback screen.

  Also in the second modification example, when the information display board 6 is a normal blackboard or white board, the video distribution system 10 uses the information captured on the information display board 6 from the video taken by the camera 2. Will get.

  Other configurations and functions are the same as those of the first embodiment.

DESCRIPTION OF SYMBOLS 1 Video delivery apparatus 10 Video delivery system 11 Management part 12 Acquisition part 13 Conversion part 14 Storage part 15 Distribution part 18 Extraction part 19 Identification part 20 Setting part 2,21-23 Camera 3,31-33 Terminal device

Claims (11)

A management unit in which schedules indicating start times and end times of a plurality of events are registered in advance;
According to the schedule, an acquisition unit that acquires video content shot by the camera from the camera;
A conversion unit that reads out the video content corresponding to each of the plurality of events according to the schedule , associates the video content with the event, and converts the video content into a data file in a standard format for distribution;
A storage unit that stores the data file in association with each of the plurality of events;
A distribution unit that reads out the data file corresponding to the specified event from the storage unit and distributes the data file to the terminal device when any of the plurality of events is specified from the terminal device; Video distribution system. An extraction unit for extracting a background image excluding a moving body based on a change between a plurality of frames of the video content;
The video distribution system according to claim 1, wherein the storage unit is configured to store the data file of the background video as the data file. The background image includes an image of an information display board for displaying information,
The extraction unit restores at least information displayed on the information display board and generates the background video for an overlapping area hidden by the moving body of the information display board from a plurality of frames of the video content. The video distribution system according to claim 2, wherein the video distribution system is configured as described above. The video distribution system according to claim 3, wherein the extraction unit is configured to perform shading correction on the background video. The video distribution system according to claim 3, further comprising an identification unit that identifies a type of the information display board by performing image processing on the background video. A setting unit for setting shooting conditions of the camera;
The video distribution according to claim 5, wherein the setting unit is configured to automatically determine the shooting condition in accordance with a type of the information display board identified by the identification unit. system. A setting unit for setting shooting conditions of the camera;
When the type of the information display board corresponding to each of the plurality of events is specified in the schedule, the setting unit automatically sets the shooting conditions according to the type of the information display board according to the schedule. The video distribution system according to claim 3 or 4, wherein the video distribution system is configured to be determined automatically. The acquisition unit is configured to acquire information displayed on the information display board as display data from the information display board,
The video distribution system according to claim 1 or 2, wherein the conversion unit is configured to convert the video content and the display data acquired from the information display board into the data file. . The said acquisition part and the said conversion part are comprised so that the acquisition of the said video content by the said acquisition part and the conversion in the said conversion part may be performed simultaneously. The any one of Claims 1-8 characterized by the above-mentioned. The video distribution system according to item. The conversion unit is configured to automatically combine and convert into one data file when the video content of the same event is divided in the middle. Item 10. The video distribution system according to any one of Items 1 to 9. Computer
An acquisition unit for acquiring video content shot by a camera from the camera according to a schedule registered in advance indicating start times and end times of a plurality of events;
A conversion unit that reads out the video content corresponding to each of the plurality of events according to the schedule , associates the video content with the event, and converts the video content into a data file in a standard format for distribution;
A storage unit that stores the data file in association with each of the plurality of events;
When any one of the plurality of events is designated from the terminal device, the video delivery device includes a delivery unit that reads the data file corresponding to the designated event from the storage unit and delivers the data file to the terminal device. A program to function.

Images