CN1696923A - Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system - Google Patents
Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system Download PDFInfo
- Publication number
- CN1696923A CN1696923A CN 200410009072 CN200410009072A CN1696923A CN 1696923 A CN1696923 A CN 1696923A CN 200410009072 CN200410009072 CN 200410009072 CN 200410009072 A CN200410009072 A CN 200410009072A CN 1696923 A CN1696923 A CN 1696923A
- Authority
- CN
- China
- Prior art keywords
- courseware
- data
- video
- server computer
- computer system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A system can transmit video and audio data of speaker lecture site and courseware information demonstrated on computer to server and the server carries out synchronous synthesis as well as generates a single stream file for being presented at client end. The server synthesizes the courseware prestored locally with video and audio when demonstrated courseware is preset formula and the server synthesizes cut - off screen video with site video and audio when demonstrated courseware in nonpreset formula so that clarity and definition of demonstrated courseware can be ensured at client end.
Description
Technical field
The present invention relates to multimedia technology and Web education, distance education technique; Be particularly related to the synthetic synchronously storage distribution technology of the multiple medium on a kind of network.
Background technology
Along with the development of the information transmission technology, network communication and various formation transfer service are more and more.The video conference of arising at the historic moment, Web education and long-distance education etc. are also generally accepted by people, and research has in this respect also obtained significant achievement.
Along with the widespread use of video conference and Web education, people more and more experience and utilize network to realize the facility that synchronous live transmission brings for our life.Especially this application is more general in company and enterprise or campus, because the teacher of the personnel of company and enterprise and school often need utilize computer installation to give a lecture to give lessons and allow audience on the network play and listen to, the synchronously synthetic transmission plan that particularly comprises speaker's demonstration courseware and speech live video audio-frequency information enjoys favor especially.But, present multimedia courseware tools all utilize after the speech process finishes again and manually made, and are so not only time-consuming, nor can reflect the process that the speaker gives a lecture, so there is certain difference in the authenticity of the latter made courseware of speech process and speaker's speech.A kind of solution is that the content of directly in speaker's speech courseware being play is recorded, and method is different from digital recording certainly, and it also needs the give a lecture Message Record of operation courseware of speaker is got off, and can repeat in the process of playing.
But mainly there is following defective in present courseware recording method.
At present common courseware recording method need flow the resource of these two parts mutual close fit of needs when giving a lecture to courseware document and video/audio respectively as independently file preservation, again through play again and synchronized positioning after preserve and issue with the file form, can not real-time recording and waste time and energy; Even can real-time recording, also can only save as the form of file, as real-time recording systems such as StreamAuthor commonly used at present, its last courseware that generates is preserved and issue with the file form, be not easy to the strange land server and call automatically and mirror image, influence order program service.
And generally be to adopt the picture of demonstration courseware and speaker's live view all to be recorded the common video/audio method for synchronous of utilization as video these two kinds of videos and audio frequency are carried out synthesizing synchronously during real-time recording, generate a video/audio stream file.This scheme also has 2 deficiencies: so the first is not easy to Network Transmission because demonstration courseware is also very big with the synthetic stream file of preserving of visual form; Therefore it is not easy to the form issue with multiresolution, the poor definition of courseware during broadcast two because demonstration courseware is to record in one section video flowing mode.
Number of patent application is manufacturing-broadcasting system and the method that has disclosed a kind of audio-visual teaching material in the application documents of 02141324.x.This system can reach main cooperation transmitting terminal if CCD and microphone are arranged, and its record is sent to receiving end, teaching material webpage, operating environment, the teaching action of transmitting terminal for common people's reading learning of receiving end; Wherein, transmitting terminal, the picture of in the same time, being seen on simultaneously with screen, and can capture together by the sound that loudspeaker are heard, strung into general multi-medium file again; This invention is after receiving a plurality of video-audio signals, just pairing image of these video-audio signals and sound are integrated into (synchronous recording) in the same multi-medium file, and then, propagate these images and sound (synchronous playing) in the mode of direct propagation multi-medium file; By this, make it when data is transmitted, single File Format is only arranged,, do not have again delay, inharmonic situation to take place can allow receiving end when watching reading.
Above-mentioned application has provided a solution of recording and broadcasting immediately of audio-visual teaching material in the network environment, can realize real-time recording and the function of broadcasting.But still have its imperfection part, at first, the collection of video/audio and synthetic all finish and transmitted to receiving end by transmitting terminal at transmitting terminal in this application, the stream file that this system generated only can be kept at this specific senders at speech place, the program request at any time of inconvenient receiving end.We know, in a working environment, more typical give lessons environment in a campus in, the speaker particularly teacher may be regularly in different places, different classroom speeches gives lessons, if the file that will at every turn give lessons be kept at respectively different transmitting terminals can inconvenient audience or student's program request watch; And because each transmitting terminal all will be born synthetic synchronously work, and this has also just increased the burden of each transmitting terminal, the waste resource.Secondly, the signal that this application mainly uses the screenshotss method to catch demonstration courseware synthesizes transmission, formed is a video/audio stream file, this stream file data volume is big, be unfavorable under the bad situation of network environment, transmitting, and the quality of its played file can not be guaranteed when spectators' amplification is watched.
Summary of the invention
At the server end deficiency that over-burden in the above-mentioned prior art, and record the defective that file transmission quantity in the issuing process is big, play poor definition, the object of the present invention is to provide a kind of system and method, can reduce the transmission quantity of data in the on-demand process, the sharpness of assurance picture, and avoid using the file form to preserve, generate single stream file and make things convenient for the strange land server to call automatically and mirror image.
In order to achieve the above object, the invention provides the synthetic synchronously storage transmission Play System of the multiple medium on a kind of network, this system comprises: speaker's demo end, server computer system and at least one client computer.
Wherein said speaker's demo end comprises that at least a video acquisition device, an audio collecting device and can operate and demonstrate the computing machine of various coursewares.Described video acquisition device directly is connected with server computer system with audio collecting device.Video acquisition device be used to gather speaker's speech the speech scene video information and be sent to server computer system; Audio collecting device is used to gather the live audio picture of speaker's speech and be sent to server computer system; The demonstration courseware computing machine links to each other with server computer system by network, and described demonstration courseware computing machine is used to demonstrate various coursewares, and the true-time operation that the speaker is carried out courseware is recorded and carried out communication with server computer system.
Described server computer system comprises video receiving apparatus, apparatus for receiving audio, data synthesis device and a database.Described video receiving apparatus and apparatus for receiving audio are used for receiving respectively the video acquisition device of speaker's demo end and video, the voice data that audio collecting device is gathered.Data synthesis device is used for the true-time operation data that the speaker to video, voice data and reception carries out courseware to carry out synthetic synchronously and generates stream file being stored in described database, treating that one or more client-requested are transmitted client as a stream on the network, this document is decoded and play by client.
Also comprise a backstage pen recorder in the described demonstration courseware computing machine, this device works in the overall process of speaker's speech.
When demonstration courseware is a predetermined format (PowerPoint for example, Word, during HTML etc.) courseware, this courseware is stored in the server computer system in advance, described backstage pen recorder is used for will sending the record of this courseware feature of mark to server computer when the speaker starts courseware, and the corresponding courseware that server computer system will prestore according to feature location this locality of record also starts; This backstage pen recorder is used for when speaker's speech process is operated courseware simultaneously, record is the current page number, screen current location, the class of operation of operation each time, and be that each operation forms an operation note, be sent to described server computer system immediately.
When demonstration courseware was the courseware of a non-predefined format, described backstage pen recorder was used to grasp the on-screen data of courseware presentation process, was sent to the video receiving apparatus of server computer system as one section video flowing.
Comprise a time adding set in the described server computer system.The audio frequency that video that this device receives for video receiving apparatus and apparatus for receiving audio receive adds time mark respectively.Described time adding set is that the time is added in each courseware operation note that server computer system receives when demonstration courseware is the courseware of a predetermined format, described data synthesis device will extract the related pages and the position data of local this courseware that prestores according to the courseware page of describing in the courseware operation note that receives and courseware frag info, and it is synthetic synchronously to be with time of video, audio frequency and courseware operation note record that synchronous Composite Logo carries out above-mentioned multiple medium.Described time adding set is that the screenshotss data that video receiving apparatus receives are added time mark when demonstration courseware is the courseware of a non-predetermined format, and described data synthesis device will be that synchronous Composite Logo carries out synthesizing synchronously to above-mentioned medium with the time of video, audio frequency and the record of screenshotss data.
Described data synthesis device is stored in the described database for speech each time generates an independent stream file.
As another object of the present invention, the synthetic synchronously storage transmission dissemination method of the multiple medium on a kind of network is provided, described method comprises following steps:
Connect a plurality of acquisition of media device to a server computer system, wherein said acquisition of media device comprises a video acquisition device, an audio collecting device and the computing machine that can operate and demonstrate various coursewares at least.
The various real-time media information that each acquisition of media device will be gathered are sent to this server computer system.This server computer system uses the synthetic single stream file form of various media informations that the medium synthetic method will receive also to store automatically, transmits client as a stream and by client this stream file is resolved and play to treat on the network one or several client terminal playing requests.
Wherein said various media information comprises a video information and an audio-frequency information and a demonstration courseware information at least, described demonstration courseware information be used to write down the speaker above-mentioned operate and the computing machine of demonstration courseware on the operation note of demonstration courseware or the picture of demonstration.
When demonstration courseware was the courseware of a predetermined format (for example PowerPoint, Word, HTML etc.), this courseware was stored in the server computer system in advance.Described demonstration courseware computing machine will send the record of this courseware feature of mark to server computer when the speaker starts courseware.The corresponding courseware that server computer system will prestore according to feature location this locality of record also starts.Simultaneously when in speaker's speech process courseware being operated, this demonstration courseware computing machine will write down the current page number, screen current location, the class of operation of operation each time, and be that each operation forms an operation note, be sent to described server computer system immediately.
When demonstration courseware is the courseware of a non-predefined format, described demonstration courseware computing machine will grasp the on-screen data of courseware presentation process, be sent to server computer system as one section video flowing.
Described server computer system adds time mark respectively for video and the audio stream that receives.Server computer system adds the time for each the courseware operation note that receives when demonstration courseware is the courseware of a predetermined format, described server computer system will extract the related pages of local this courseware that prestores and the data of position according to the courseware page of describing in the courseware operation note that receives and courseware frag info, and it is synthetic synchronously to be with time of video, audio frequency and courseware operation note record that synchronous Composite Logo carries out above-mentioned multiple medium; Described server computer system is that the screenshotss data that video receiving apparatus receives are added time mark when demonstration courseware is the courseware of a non-predetermined format, and described data synthesis device will be that synchronous Composite Logo carries out synthesizing synchronously to above-mentioned medium with the time of video, audio frequency and the record of screenshotss data.
Described server computer system is stored in the described database for speech each time generates an independent stream file.
Especially, for making native system can adapt to Web publishing and the requirement of client VOD system, in server computer system, during the courseware resultant current file of the predetermined format that prestores in server computer system, will be divided into the courseware data that extract this locality some courseware data cells and preserve and transmit as a stream to client as unit.To move the pairing page or courseware fragment combination according to one group of operation note on the time sequencing when cutting apart and constitute a data block together, for this data block is added an index marker and this index marker is made an addition in each operation note that forms this courseware data block.
In the stream file that is generated a document data piece is formed in all courseware operation note meeting of this courseware, because this data block record all is operation coding to courseware, so data volume is less.In client point sowing time, at first the document data block all is sent in the client computer storer, the courseware data block index marker request server of putting down in writing according to each operation note sends corresponding courseware data block successively.
In addition, the strange land server calls and mirror image automatically for convenience, and as preferred mode, the present invention will use self-defining document format to preserve the stream file that is synthesized in server, when demonstration courseware is the document of a predetermined format, will comprise following information in the stream file format:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of operation note;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the file that contains record data then should be put down in writing operation note each time, the structure of described operation note is as described below: comprise the unit index flag data of the time data of some bytes, some bytes and the operational motion data of some bytes, time data, unit index flag data and operational motion data put down in writing respectively in each record accordingly;
(9) demonstration courseware data, these demonstration courseware data are one group of courseware data cell, each data cell comprises: the unit index mark of some bytes, the courseware content data of the page number that contains and this unit;
(10) voice data;
(11) video data;
When demonstration courseware is the document of a non-predetermined format, comprise following information in the stream file format that in described server computer system, generates and preserve:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of screenshotss video;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the data that contain the screenshotss video then should be put down in writing the screenshotss video data;
(9) voice data;
(10) video data.
The synthetic synchronously storage issue of using native system or application this method to carry out online multiple medium will produce useful effect in the following areas.
At first, in order to reduce the burden that transmitting terminal demonstration courseware computing machine and each courseware receive client, the all synthetic and memory functions of the present invention all concentrate on server end and realize, client is only carried out program request by access server, and server will be transferred to the file streaming of institute's program request the client terminal playing of program request.In synchronous recording, server end also can be done direct broadcast or live multicast to client.Each step function of invention is divided more clear and definite, more helps maintenance and function expansion according to the system of this method.Simultaneously with the stream file storage and uniform that generated in the data in server storehouse, also make things convenient for the audient to search and program request.
Secondly, because the present invention preserves at server end in advance to the predefine courseware, therefore when this type of document of demonstration, speaker end only needs the record speaker to the relevant mouse-keyboard information of this courseware operation and be transferred to server end and get final product, start the document associative operation that prestores by server according to this information and synthesize, and do not need to intercept and transmit real-time on-screen data.Reduce the transmission quantity of file, and can guarantee the sharpness of courseware video.
In addition, adopt single document form to preserve, can not make things convenient for the strange land server to call automatically and mirror image so preserve with the form of file because the self-defining stream file of the present invention is preserved form.
Description of drawings
Fig. 1 shows the frame diagram according to computer system of the present invention;
Fig. 2 shows the process flow diagram of the method for the invention;
Fig. 3 shows the self-defining stream file stores form according to the present invention;
Fig. 4 shows the storage format of self-defining another stream file according to the present invention;
Fig. 5 shows the broadcast interface of client of the present invention.
Embodiment
An embodiment of system having thus described the invention, as shown in Figure 1, camera head 101, microphone 102 will directly be connected on the server computer system 105 by common connected mode.The operation and the computing machine 103 of demonstration courseware connect by network and link to each other with a server computer system 105, on the network not the client of given number can by universal mode and server computer system 105 carry out information transmission with alternately.In the computing machine 103 of described operation and demonstration courseware, include the application software that is used for demonstration courseware and gather the backstage pen recorder 104 that the speaker operates the courseware record, described server computer system 105 is equipped with the application software that is used to demonstrate described predetermined format courseware, the video frequency collection card that is used for the receiver, video audio-frequency information, video acquisition software, audio collection card and audio collection software, and comprise the video of promising reception, audio frequency and courseware record add the time adding set 106 of time mark, the multiple medium that receive are synthesized the synchronous synthesizer 107 and the courseware database 108 of a stream file.Camera head 101 and microphone 102 are used to gather the live video and the audio frequency of speaker's speech, and pass to video, the audio collection card of server computer system 105.
When courseware that the speaker demonstrated is the file of predetermined format, during as the PPT form, the speaker at first with the PPT courseware upload in the work at present catalogue of server system.In the speech process, video and audio-frequency information that camera head 101 and microphone 102 are gathered will send on the server computer system 105, time adding set in the server computer system 105 will receive the time of first frame video stream signal stream as 0 moment mark, and be video, the voice data interpolation time mark of follow-up arrival, the time mark of being added is the mistiming of this media data time of arrival and the arrival of the first frame video.The speaker plays on the computing machine 103 of demonstration courseware and when operating this PPT document, backstage pen recorder 104 will write down eigenwert or the title that the speaker operates keyboard or the mouse action and the courseware of this PPT document, and the formation operation note sends to server computer system 105 immediately, described operation note comprises the current page number of operation, mouse button information, mouse screen current location, action messages such as institute's touching dish coding, server computer system 105 will be decided to be this courseware according to the eigenwert or the title of courseware in local work at present catalogue, the time adding set 106 in the server computer system 105 adds time mark with the courseware operation note that is respectively each time simultaneously.Server computer system 105 extracts the courseware page that operation notes put down in writing and frag info and extracts and extract courseware content be used for synthetic synchronously from this courseware that this locality that has been decided to be prestores.
Especially, pen recorder 104 formed operation note forms in backstage can be expressed as
1. the current page number: 4 byte lengths, expression current page number.Default value is 0, represents not redirect; Represent during other values should redirect page number.
2. mouse state: 1 byte length, the no mouse spare of 0 expression is pressed, 1 expression left mouse button, 2 expression right mouse buttons, 3 expression right and left keys are pressed together, and 4 expression left buttons are double-clicked, and 5 expression right buttons are double-clicked, and 6 represent that triple bonds press
3. keyboard ASCII character: the data of 2 double words, the no key of-1 expression is imported, and other have the pairing ASCII character record of keyboard.
4. mouse x coordinate: 4 byte datas, represent the x shaft position at current mouse place
5. mouse y coordinate: 4 byte datas, represent the y shaft position at current mouse place
Data synthesis device 107 carries out synthetic synchronously as synchronous mark with the time mark of carrying on the multiple medium, generate a files in stream media and be stored in the database 108 of server computer system 105.
When courseware that the speaker demonstrated is the file of a non-predetermined format, as an EXE file, backstage pen recorders 104 in the middle of the computing machine 103 of operation and demonstration courseware are set to fixing a period of time that screenshotss are carried out in the display frame of computing machine 103 sends to server system 105 as video flowing at interval, as preferred scheme, can with regular time at interval and this courseware is carried out mouse to the speaker or keyboard operation combines, as triggering the signal that screenshotss are operated.Time adding set 106 in the server computer system 105 holds speaker's picture of camera head 101 and microphone 102 and sound to add time mark with what gather for capture card from the speaker, also is simultaneously that the video flowing of the screenshotss data of computing machine 103 transmissions adds time mark.Data synthesis device 106 utilizes this timestamp with the synthetic files in stream media of above-mentioned multiple media sync, is stored in the database 108 of server computer system 105.
The speaker the on-the-spot video of speech will be by existing track algorithm Technical Follow-Up speaker action and information such as head expression.
A specific embodiment according to the present invention is the campus environment of giving lessons, its process flow diagram as shown in Figure 2, its concrete steps are as follows: the teacher before class wants earlier the courseware upload of the predetermined format that will make to server.The teacher will set classroom environment earlier when multi-media classroom is given lessons then, and this is provided with and mainly comprises three parts: one, recording beginning, open Mike, and gather teacher's teaching recording; Two, camera is opened, and gathers the video recording of teacher's action expression on class; Three, start the backstage pen recorder, described backstage pen recorder will write down the operation of teacher to courseware.Teacher's click courseware or point be during beating keyboard when this device was operated courseware the teacher, produces corresponding operation according to the difference of courseware type.The kind of courseware has a lot, PowerPoint for example, and Word, rtf, PDF, various ways such as htm and EXE, described background application can be taked different response modes according to different courseware types.For the courseware of a non-predefined format, as the EXE courseware, the backstage pen recorder can take to grab the mode that screen is handled, and grasps one section video of the live formation of variation of courseware, and video flowing is dealt into server end.And for PowerPoint, Word, rtf, the courseware of predefined format such as htm and PDF, the backstage pen recorder will be clicked and keyboard knocks and notes and be dealt into server end the page number screen position of courseware operation and left mouse button right button or keyboard ASCII character are also promptly moved the mouse of courseware.The moment that time adding set video receiving apparatus in the server computer system receives the first frame video is set to synthetic synchronously starting point, and promptly this is 0 constantly.All stab for the frame of video that arrives later on server successively, voice data and to the operation of courseware according to this starting point joining day time.
When courseware is the file of a non-predefined format, described backstage pen recorder will send courseware screenshotss video flowing, the instant program request of client for convenience, server can be forwarded to each client terminal playing through synthesizing synchronously immediately with this screenshotss data video flowing and video/audio data, simultaneously synthetic stream file is stored in the database, to treat client program request after a while.This transmission mode has corresponding solution to belong to prior art in video conference application not repeat them here.
According to another specific embodiment of the present invention, consider the restriction of the network bandwidth and transmittability, the present invention will be cut apart according to certain rule courseware when synthetic synchronously in that predefined courseware (as ppt etc.) is carried out, and is that unit is to client transmissions with the divided data piece.Cut apart whole courseware size of the main consideration of rule and corresponding network bandwidth transmission restriction, the courseware after assurance is cut apart can be transferred in the client-cache in the short period of time as packet, is convenient to by this courseware of instruction calls.If the divided data piece is too small, though the transmission of bag is very fast, delay reduces, if but call action is stirred in document too much, especially in the page of distribution different masses, stir, will produce the situation of the corresponding page in the call action file not found, cause malloc failure malloc, thereby need to call corresponding presentation file data, the delay that causes document to stir from server end in real time; If but the divided data piece is excessive, the network latency of courseware data can be very long, causes delay, thereby influence the program request quality.Therefore the present invention is cut apart packet and has been done balance with call action and consider, packet cut apart Shi Budan with courseware in the order of the page divide, and be to constitute a divided file with the pairing page of the set on the time sequencing, can solve the problem that corresponding action can't be pointed to preferably like this.Behind the piecemeal, needn't all download courseware during the client terminal playing courseware, just download one at every turn,, form complete courseware at last along with the needs of playing the page are constantly downloaded new piece.The ability of data transmission under the main modem of consideration of the size condition that courseware is cut apart, so that response speed timely when satisfying program request preferably and beginning, the user of also being convenient to the diverse network bandwidth conditions uses, general courseware data block size should be limited in the modem transmission time at user within the sustainable response time (such as 1-3 in second), and the courseware data block after restriction is cut apart usually is less than the transmission quantity in the above-mentioned time (for example less than 30KB).
If the courseware that the teacher makes is the file of a predefined format, as PowerPoint etc., then the courseware form of Sheng Chenging as shown in Figure 3.If the predefined form of courseware right and wrong that the teacher makes, as the EXE form etc., then the courseware form of Sheng Chenging as shown in Figure 4.The data that will contain operation note in the stream file that the difference of above-mentioned two kinds of forms is to generate at the predefined format courseware, and will contain the data of courseware video in the stream file that generates at the courseware of non-predefined format.
Introduce the form of synthetic new courseware below respectively in conjunction with Fig. 3 and Fig. 4.
As shown in Figure 3:
(1) 12 bytes of the beginning of file are that " streamcourseware " shows that this document is the defined file of the application;
(2) 64 ID that byte is user-defined this document subsequently;
(3) 4 bytes subsequently are version information;
(4) then 4 bytes are types, describe the data that this document contains the data of operation note or contains the screenshotss video, herein owing to therefore the courseware that is a predefined format is the data that contain operation note;
(5) back to back two 8 byte datas are operation notes side-play amount also is the byte number of record data apart from the file reference position, and the byte number of record data length;
(6) back to back two 8 byte datas are video datas side-play amount is the byte number of video data apart from the file reference position, and video data length or byte number;
(7) back to back two 8 byte datas are voice datas side-play amount is the byte number of voice data apart from the file reference position, and voice data length or byte number;
(8) back to back two 8 byte datas are demonstration courseware data side-play amount is the byte number of demonstration courseware apart from the file reference position, and demonstration courseware data length or byte number;
(9) put down in writing the data block of operation note herein, every operation note is expressed as a data block, described record data block structure is as follows: 8 byte time data, 2 block of bytes index data and one 8 byte action data, and time data, piece index data and action data put down in writing respectively in each record accordingly;
(10) demonstration document data, these demonstration courseware data are a series of blocks of data, each blocks of data is made up of 3 parts: the piece index of 2 bytes, the data of this piece behind the page number that contains and the presentation file piecemeal.
(11) voice data;
(12) video data;
As shown in Figure 4:
(1) 12 bytes of the beginning of file are that " streamcourseware " shows that this document is the defined file of the application;
(2) 64 ID that byte is user-defined this document subsequently;
(3) 4 bytes subsequently are version information;
(4) then 4 bytes are types, describe the data that this document contains the data of operation note or contains the screenshotss video, herein owing to therefore the courseware that is a non-predefined format is the data that contain the screenshotss video;
(5) back to back two 8 byte datas are operation notes side-play amount also is the byte number of record data apart from the file reference position, and the data length of operation note or byte number;
(6) back to back two 8 byte datas are video datas side-play amount is the byte number of video data apart from the file reference position, and video data length or byte number;
(7) back to back two 8 byte datas are voice datas side-play amount is the byte number of voice data apart from the file reference position, and voice data length or byte number;
(8) back to back two 8 byte datas are demonstration courseware data side-play amount is the byte number of demonstration courseware apart from the file reference position, and demonstration courseware data length or byte number;
(9) put down in writing the screenshotss video data of monoblock herein;
(10) voice data;
(11) video data;
Figure 5 shows that client end interface according to a specific embodiment of the present invention.This client major function is the data that forward of display server end in real time.Client is a webpage that contains control.This webpage mainly comprises four parts: video player, media controller, courseware chapters and sections structure list and active player.Described video player and media controller are used for broadcast and control decoded video/audio stream.Immediately put sowing time when giving lessons in the classroom, then Video Controller is disabled, because real-time play can only show the situation of giving lessons that the teacher is current.Only at the courseware of predefined format, it is the courseware content of uploading according to the teacher to courseware chapters and sections structure list, and wherein chapters and sections structure elucidation is come out, and is shown as tabular form; Courseware for the EXE form does not then have the chapters and sections structure.Active player is different and different according to the courseware type that the teacher uploads, if what the teacher uploaded is the courseware of a non-predefined format, as the EXE form, what then obtain on the server is one section screenshotss data video flowing, and this moment, active player was exactly a common video media player; If what the teacher uploaded is the courseware of other predefined types, this moment, active player was the self-defining control of the present invention, the major part of this control is the OLE control, thereby this courseware that it is connected on the server obtains the courseware object, then courseware content is presented in the active player, transmits corresponding operation note active player for server and just operate accordingly.For non-instant displaying courseware, can realize switching between the chapters and sections also can realizing the switching of presentation file chapters and sections by clicking corresponding chapters and sections in the chapters and sections structure list by dragging video.Video, presentation file and chapters and sections structure list link mutually.
Client carries out at first entering a sowing time homepage, shown the courseware tabulation that all can program request on the homepage, the user can start customer terminal webpage by clicking courseware, and the address of this courseware of clicking passed to customer terminal webpage as parameter, customer terminal webpage connects according to the courseware in this address and the server database.Then, user end to server sends playing request, after server receives, this courseware is decomposed give birth to tripartite temporary file: audio file, the time video file and remainder.The present invention play-overs video file and audio file on the server according to the mms agreement of Microsoft control media player.Client is from the server operation note piece of the free mark of carrier band up and down.The client media player begins video file and the audio file on the Play Server, and active player is downloaded first courseware blocks of data according to the description of operation note piece and play from this stream file of server.Thereby courseware chapters and sections structure list travels through the chapters and sections structure that whole courseware obtains courseware.And time monitoring device of client terminal start-up, (for example 1 second) obtains current video time by media player at regular intervals, if because the restriction of the network bandwidth, there is not video transmission to come, then the reproduction time according to audio frequency obtains current reproduction time, then, determine operation to courseware applied according to the operation note that has time mark of downloading.Do not send download request if skip operation and the piece that jumps to are downloaded then to server, download this data block from server.
According to another specific embodiment of the present invention, the files in stream media form that generates has multiresolution content release function, client will be monitored network state, when the network condition appearance is congested, for example bandwidth is less than 200bps, client will send signal to server, server system can be given client terminal playing with the sound of the stream file of institute's program request and presentation file and action command prioritised transmission thereof, frame of video in the video packets of data can reduce transmission quantity in transmission course, perhaps be abandoned to reduce the network bandwidth.Therefore the order of the multiple medium prioritised transmission in the stream file is: presentation file and command action (for the document of non-predetermined format, being exactly the snapshot picture), audio files, video file.
According to above description, those of ordinary skill in the art can be easy to implement the certain above-mentioned invention of system and method for the present invention and can obtain implementing in other special shape, and does not deviate from marrow or the basic feature that is disclosed.Therefore be appreciated that the present invention should not limited by the illustrative details in front, but defined by additional claim.
Any reference symbol in claims does not limit claims." comprise " appearance of once not getting rid of other assemblies outside listed in claims, " " before assembly or unit does not get rid of the existence of a plurality of this assemblies or unit.
Claims (26)
1. the synthetic synchronously storage delivery system of the multiple medium on the network, this system comprises: speaker's demo end, server computer system and at least one client computer, wherein said speaker's demo end, at least comprise a video acquisition device, the computing machine of various coursewares can be operated and demonstrate to one audio collecting device and, described video acquisition device directly is connected with server computer system with audio collecting device, video acquisition device be used to gather speaker's speech the speech scene video information and be sent to server computer system, audio collecting device is used to gather the live audio picture of speaker's speech and be sent to server computer system, the demonstration courseware computing machine links to each other with server computer system by network, described demonstration courseware computing machine is used to demonstrate various coursewares, and the true-time operation that the speaker is carried out courseware is recorded and carried out communication with server computer system;
Described server computer system comprises video receiving apparatus, apparatus for receiving audio, data synthesis device and a database, described video receiving apparatus and apparatus for receiving audio are used for receiving respectively the video acquisition device of speaker's demo end and the video that audio collecting device is gathered, voice data, data synthesis device is used for video, the true-time operation data that the speaker of voice data and reception carries out courseware carry out synthetic synchronously and generate stream file being stored in the described database, treating that one or more client-requested are transmitted client as a stream on the network, this document is decoded and play by client;
It is characterized in that, also comprise a backstage pen recorder in the described demonstration courseware computing machine, this device works in the overall process of speaker's speech;
When demonstration courseware is a predetermined format (PowerPoint for example, Word, during HTML etc.) courseware, this courseware is stored in the server computer system in advance, described backstage pen recorder is used for will sending the record of this courseware feature of mark to server computer when the speaker starts courseware, the corresponding courseware that server computer system will prestore according to feature location this locality of record also starts, this backstage pen recorder is used for when speaker's speech process is operated courseware simultaneously, record is the current page number of operation each time, the screen current location, class of operation, and be that each operation forms an operation note, be sent to described server computer system immediately;
When demonstration courseware was the courseware of a non-predefined format, described backstage pen recorder was used to grasp the on-screen data of courseware presentation process, was sent to the video receiving apparatus of server computer system as one section video flowing;
Its feature also is, comprise a time adding set in the described server computer system, the audio frequency that video that this device receives for video receiving apparatus and apparatus for receiving audio receive adds time mark respectively, described time adding set is that the time is added in each courseware operation note that server computer system receives when demonstration courseware is the courseware of a predetermined format, described data synthesis device will extract the related pages and the position data of local this courseware that prestores according to the courseware page of describing in the courseware operation note that receives and courseware frag info, and with video, the time of audio frequency and courseware operation note record is that synchronous Composite Logo carries out synthesizing synchronously to above-mentioned multiple medium; Described time adding set is that the screenshotss data that video receiving apparatus receives are added time mark when demonstration courseware is the courseware of a non-predetermined format, and described data synthesis device will be that synchronous Composite Logo carries out synthesizing synchronously to above-mentioned medium with the time of video, audio frequency and the record of screenshotss data;
Described data synthesis device is stored in the described database for speech each time generates an independent stream file.
2. system according to claim 1, it is characterized in that, when the courseware of demonstration is a non-predetermined format file, described backstage pen recorder will combine as the trigger pip of screenshotss operation the current courseware picture that intercepting is demonstrated according to the time interval and the courseware operational motion of fixed length.
3. system according to claim 1, it is characterized in that, when the courseware of being demonstrated is the courseware of a predetermined format, this courseware is stored in the work at present catalogue of server computer system in advance, described backstage pen recorder will be with the file of this courseware courseware feature by name to server computer system transmit operation record when starting courseware, and server computer system will be located this courseware of local storage according to this courseware title in the work at present catalogue.
4. according to claim 1 or 3 described systems, it is characterized in that, when demonstration courseware is the courseware of a predetermined format, described backstage pen recorder will form operation note for the operation of in the speech process courseware being carried out, and described operation note comprises following composition: the current page number, mouse state, keyboard coding, mouse screen position.
5. system according to claim 4, it is characterized in that, described time adding set serves as synthetic synchronously starting point with the moment that video receiving apparatus receives the first frame video data of video acquisition device transmission, promptly 0 constantly, and the frame of video of Jie Shouing, voice data and courseware operation note subsequently will be write down the mistiming with synchronous starting point.
6. system according to claim 4, it is characterized in that, when described demonstration courseware is the courseware of a predetermined format, the courseware data that the medium synthesizer of server computer system extracts this locality are divided into some unit, as unit to client transmissions, move the pairing page or courseware fragment combination with one group of operation note on the time sequencing when cutting apart and constitute a unit together, and simultaneously this index marker is made an addition in each operation note that forms this courseware unit for this unit adds an index marker.
7. system according to claim 6 is characterized in that, described medium synthesizer is when cutting apart the courseware data, and the size that limits each courseware data cell is within the sustainable modem of the user transmission time.
8. system according to claim 7 is characterized in that, the size of courseware data cell be limited in the modem transmission time at 3 seconds with interior data.
9. system according to claim 7 is characterized in that the courseware data cell is less than 30KB.
10. according to any described system among the claim 6-9, it is characterized in that, described medium synthesizer makes all courseware operation notes form a data block when the stream file that generates, in client point sowing time, at first this data block all is sent in the client computer storer, the courseware data cell index marker request server of putting down in writing according to each operation note sends corresponding courseware data cell successively.
11. system according to claim 10 is characterized in that, when demonstration courseware is the document of a predetermined format, comprises following information in the stream file format that generates and preserve in described server computer system:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of operation note;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the file that contains record data then should be put down in writing operation note each time, the structure of described operation note is as described below: comprise the unit index flag data of the time data of some bytes, some bytes and the operational motion data of some bytes, time data, unit index flag data and operational motion data put down in writing respectively in each record accordingly;
(9) demonstration courseware data, these demonstration courseware data are one group of courseware data cell, each data cell comprises: the unit index mark of some bytes, the courseware content data of the page number that contains and this unit;
(10) voice data;
(11) video data;
Its feature also is, when demonstration courseware is the document of a non-predetermined format, comprises following information in the stream file format that generates and preserve in described server computer system:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of screenshotss video;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the data that contain the screenshotss video then should be put down in writing the screenshotss video data;
(9) voice data;
(10) video data.
12. system according to claim 11 is characterized in that, described client terminal playing uses an IE control to play, and can download automatically when playing.
13. system according to claim 12 is characterized in that, described client is carried out network monitoring to network condition, when listening to the network bandwidth less than 200bps, send message to server computer system, server computer system will be abandoned video information, and the cancellation video connects.
14. the synthetic synchronously storage issue player method of the multiple medium on the network is characterized in that described method comprises following steps:
Connect a plurality of acquisition of media device to a server computer system, wherein said acquisition of media device comprises a video acquisition device, an audio collecting device and the computing machine that can operate and demonstrate various coursewares at least;
The various real-time media information that each acquisition of media device will be gathered are sent to this server computer system, this server computer system uses the synthetic single stream file form of various media informations that the medium synthetic method will receive also to store automatically, transmits client as a stream and by client this stream file is resolved and play to treat on the network one or several client terminal playing requests;
Wherein said various media information comprises a video information and an audio-frequency information and a demonstration courseware information at least, described demonstration courseware information be used to write down the speaker above-mentioned operate and the computing machine of demonstration courseware on the operation note of demonstration courseware or the picture of demonstration;
When the courseware of being demonstrated is a predetermined format (PowerPoint for example, Word, during HTML etc.) courseware, this courseware is stored in the server computer system in advance, described demonstration courseware computing machine will send the record of this courseware feature of mark to server computer when the speaker starts courseware, the corresponding courseware that server computer system will prestore according to feature location this locality of record also starts, simultaneously when in speaker's speech process courseware being operated, this demonstration courseware computing machine will write down the current page number of operation each time, the screen current location, class of operation, and be that each operation forms an operation note, be sent to described server computer system immediately;
When the courseware of demonstration is the courseware of a non-predefined format, described demonstration courseware computing machine will grasp the on-screen data of courseware presentation process, be sent to server computer system as one section video flowing;
Described server computer system adds time mark respectively for video and the audio stream that receives, server computer system adds the time for each the courseware operation note that receives when demonstration courseware is the courseware of a predetermined format, described server computer system will extract the related pages of local this courseware that prestores and the data of position according to the courseware page of describing in the courseware operation note that receives and courseware frag info, and it is synthetic synchronously to be with time of video, audio frequency and courseware operation note record that synchronous Composite Logo carries out above-mentioned multiple medium; Described server computer system is that the screenshotss data that video receiving apparatus receives are added time mark when demonstration courseware is the courseware of a non-predetermined format, and described data synthesis device will be that synchronous Composite Logo carries out synthesizing synchronously to above-mentioned medium with the time of video, audio frequency and the record of screenshotss data;
Described server computer system is stored in the described database for speech each time generates an independent stream file.
15. method according to claim 14, it is characterized in that, when the courseware of being demonstrated is a non-predetermined format file, will combine as the trigger pip of screenshotss operation the current courseware picture that the intercepting courseware is demonstrated according to the time interval and the courseware operational motion of fixed length.
16. method according to claim 14, it is characterized in that, when described demonstration courseware is the courseware of a predetermined format, this courseware is stored in the work at present catalogue of server computer system in advance, described backstage pen recorder will be with the file of this courseware courseware feature by name to server computer system transmit operation record when starting courseware, and server computer system will be located this courseware of local storage according to this courseware title in the work at present catalogue.
17. according to claim 14 or 16 described methods, it is characterized in that, when demonstration courseware is the courseware of a predetermined format, the operation that described demonstration courseware computing machine carries out courseware in the speech process forms operation note, and described operation note comprises following composition: the current page number, mouse state, keyboard coding, mouse screen position.
18. method according to claim 17, it is characterized in that, server computer system serves as synthetic synchronously starting point with the moment that video receiving apparatus receives the first frame video data of video acquisition device transmission, promptly 0 constantly, and the frame of video of Jie Shouing, voice data and courseware operation note subsequently will be write down the mistiming with synchronous starting point.
19. method according to claim 17, it is characterized in that, when described demonstration courseware is the courseware of a predetermined format, server computer system will be divided into some unit to the courseware data that extract this locality when generating stream file, as unit to client transmissions, to move the pairing page or courseware fragment combination with one group of operation note on the time sequencing when cutting apart and constitute a unit together, for adding an index marker and this index marker is made an addition in each operation note that forms this courseware unit in this unit.
20. method according to claim 19 is characterized in that, the size of courseware data cell should be limited in the modem transmission time the user within the sustainable response time.
21. method according to claim 20 is characterized in that, the size of courseware data cell be limited in the modem transmission time at 3 seconds with interior size of data.
22. method according to claim 20 is characterized in that, the size of courseware data cell is less than 30KB.
23. according to any described method among the claim 19-22, it is characterized in that, all courseware operation notes will be formed a data block in the stream file that generates, in client point sowing time, at first this data block all is sent in the client computer storer, the courseware data cell index marker request server of putting down in writing according to each operation note sends corresponding courseware data cell successively.
24. method according to claim 23 is characterized in that, when demonstration courseware is the document of a predetermined format, comprises following information in the stream file format that generates and preserve in described server computer system:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of operation note;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the file that contains record data then should be put down in writing operation note each time, the structure of described operation note is as described below: comprise the unit index flag data of the time data of some bytes, some bytes and the operational motion data of some bytes, time data, unit index flag data and operational motion data put down in writing respectively in each record accordingly;
(9) demonstration courseware data, these demonstration courseware data are one group of courseware data cell, each data cell comprises: the unit index mark of some bytes, the courseware content data of the page number that contains and this unit;
(10) voice data;
(11) video data;
Its feature also is, when demonstration courseware is the document of a non-predetermined format, comprises following information in the stream file format that generates and preserve in described server computer system:
(1) comprises some bytes and be used for description document ID;
(2) comprise some bytes and be used to describe version information;
(3) comprise some bytes and be used for the description document type: mainly describe the data that this document contains the data of operation note or contains the screenshotss video, this moment is for containing the data of screenshotss video;
(4) comprising the side-play amount that some bytes are used to describe operation note also is the byte number of record data apart from the stream file reference position, and the byte number of record data length;
(5) comprising the side-play amount that some bytes are used to describe video data is the byte number of video data apart from the stream file reference position, and the byte number of video data length;
(6) comprising the side-play amount that some bytes are used for the description audio data is the byte number of voice data apart from the stream file reference position, and the byte number of voice data length;
(7) comprising the side-play amount that some bytes are used to describe the demonstration courseware data is the byte number of demonstration courseware apart from the stream file reference position, and the byte number of demonstration courseware data length;
(8) according to the file type in the file header, the data that contain the screenshotss video then should be put down in writing the screenshotss video data;
(9) voice data;
(10) video data.
25. method according to claim 24 is characterized in that, described client terminal playing method is play for using an IE control, can download automatically when playing.
26. method according to claim 25 is characterized in that, described client is carried out network monitoring to network condition, when listening to the network bandwidth less than 200bps, send message to server computer system, server computer system will be abandoned video information, and the cancellation video connects.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100090729A CN100412852C (en) | 2004-05-10 | 2004-05-10 | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100090729A CN100412852C (en) | 2004-05-10 | 2004-05-10 | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1696923A true CN1696923A (en) | 2005-11-16 |
| CN100412852C CN100412852C (en) | 2008-08-20 |
Family
ID=35349652
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100090729A Expired - Fee Related CN100412852C (en) | 2004-05-10 | 2004-05-10 | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100412852C (en) |
Cited By (54)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100429643C (en) * | 2005-12-07 | 2008-10-29 | 段君雷 | Production of multi-media network electronic publication |
| CN102082768A (en) * | 2009-11-30 | 2011-06-01 | 酷手机多媒体股份有限公司 | System to transmit a plurality of files simultaneously through multimedia information service and method thereof |
| CN101552685B (en) * | 2008-04-02 | 2011-06-29 | 圣蓝科技股份有限公司 | Network media information broadcast system, method thereof and executive recording media thereof |
| CN102184174A (en) * | 2010-11-10 | 2011-09-14 | 湖北铂金智慧网络科技有限公司 | Method for recording mouse trace in network |
| CN102404575A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Courseware-oriented video compression coding method |
| CN102682639A (en) * | 2012-05-17 | 2012-09-19 | 江苏中科梦兰电子科技有限公司 | Method for improving synchronous display efficiency of electronic classroom resources |
| CN102932673A (en) * | 2011-08-11 | 2013-02-13 | 阿里巴巴集团控股有限公司 | Video signal and audio signal transmission and synthesis method, system and device |
| CN102982015A (en) * | 2012-11-06 | 2013-03-20 | 陆昀 | Method of producing electronic courseware by utilizing electronic whiteboard and corresponding display method |
| CN103166831A (en) * | 2011-12-14 | 2013-06-19 | 腾讯科技（深圳）有限公司 | Data processing method, terminal and system |
| CN103181177A (en) * | 2010-10-20 | 2013-06-26 | 索尼电脑娱乐公司 | Image processing system, image processing method, dynamic image transmission device, dynamic image reception device, information storage medium, and program |
| CN103246752A (en) * | 2013-05-30 | 2013-08-14 | 北京瑞翔恒宇科技有限公司 | System for associating ppt document with audio |
| CN103384346A (en) * | 2012-12-28 | 2013-11-06 | 深圳海联讯科技股份有限公司 | PPT file processing method and device |
| CN103581569A (en) * | 2013-09-07 | 2014-02-12 | 国家电网公司 | Method and system for recording electric power system teaching courseware |
| CN103702064A (en) * | 2013-12-27 | 2014-04-02 | 三亚中兴软件有限责任公司 | Video conference method, video conference terminal and video conference system |
| CN103763627A (en) * | 2014-01-02 | 2014-04-30 | Tcl集团股份有限公司 | Method and system for realizing real-time video conference |
| CN103794098A (en) * | 2014-01-01 | 2014-05-14 | 广州东软科技有限公司 | Intelligent teaching management system |
| CN103944888A (en) * | 2014-04-02 | 2014-07-23 | 天脉聚源(北京)传媒科技有限公司 | Resource sharing method, device and system |
| CN104063263A (en) * | 2014-06-23 | 2014-09-24 | 华为技术有限公司 | Method and device for secondary flow treatment |
| CN104424242A (en) * | 2013-08-27 | 2015-03-18 | 北大方正集团有限公司 | Multi-media file processing method and system |
| CN104486635A (en) * | 2014-12-17 | 2015-04-01 | 上海交通大学 | Speech direct-broadcasting and recording method based on events |
| CN104540026A (en) * | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content video recoding and replaying method and system |
| CN104539436A (en) * | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content real-time live broadcasting method and system |
| CN104994278A (en) * | 2015-06-30 | 2015-10-21 | 北京竞业达数码科技有限公司 | Method and device for synchronously processing multiple paths of videos |
| CN105376634A (en) * | 2014-08-26 | 2016-03-02 | 天脉聚源（北京）教育科技有限公司 | Synchronous recording method of multiple media |
| CN105450944A (en) * | 2015-11-13 | 2016-03-30 | 北京自由坊科技有限责任公司 | Method and device for synchronously recording and reproducing slides and live presentation speech |
| CN105791950A (en) * | 2014-12-24 | 2016-07-20 | 珠海金山办公软件有限公司 | Power Point video recording method and device |
| CN105812857A (en) * | 2016-03-21 | 2016-07-27 | 时中 | Dynamic interactive lecture system |
| CN105915970A (en) * | 2016-05-17 | 2016-08-31 | 创盛视联数码科技（北京）有限公司 | Network live broadcasting operation command sending method and device as well as reading method and device |
| CN105959718A (en) * | 2016-06-24 | 2016-09-21 | 乐视控股（北京）有限公司 | Real-time interaction method and device in video live broadcasting |
| WO2016150317A1 (en) * | 2015-03-23 | 2016-09-29 | 阿里巴巴集团控股有限公司 | Method, apparatus and system for synthesizing live video |
| CN106101808A (en) * | 2016-07-13 | 2016-11-09 | 乐视控股（北京）有限公司 | A kind of net cast method and device |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| CN106535008A (en) * | 2016-11-04 | 2017-03-22 | 浙江新盛蓝科技有限公司 | Ebh file format and method for reading ebh files |
| CN106604047A (en) * | 2016-12-13 | 2017-04-26 | 天脉聚源(北京)传媒科技有限公司 | Multi-video-stream video direct broadcasting method and device |
| CN106846940A (en) * | 2016-12-29 | 2017-06-13 | 珠海思课技术有限公司 | A kind of implementation method of online live streaming classroom education |
| CN107005721A (en) * | 2016-11-22 | 2017-08-01 | 广州市百果园信息技术有限公司 | Direct broadcasting room pushing video streaming control method and corresponding server and mobile terminal |
| CN107665194A (en) * | 2016-07-27 | 2018-02-06 | 上海拓翎信息科技有限公司 | A kind of data access method of net work teaching system |
| CN108024139A (en) * | 2017-12-08 | 2018-05-11 | 广州视源电子科技股份有限公司 | Playing method and device of network video courseware, terminal equipment and storage medium |
| CN108093066A (en) * | 2017-12-26 | 2018-05-29 | 中国人民解放军海军总医院 | Sea and the on the bank synchronous sharing method and system of medical image data |
| CN108763439A (en) * | 2018-05-25 | 2018-11-06 | 讯飞幻境(北京)科技有限公司 | A kind of method of data synchronization, device, electronic equipment and computer-readable medium |
| CN109547831A (en) * | 2018-11-19 | 2019-03-29 | 网宿科技股份有限公司 | A kind of method, apparatus, calculating equipment and the storage medium of blank and audio video synchronization |
| CN109729418A (en) * | 2019-01-30 | 2019-05-07 | 慧科教育科技集团有限公司 | A kind of teaching programming interactive video recording and broadcasting system and method |
| CN110060033A (en) * | 2019-04-25 | 2019-07-26 | 大连海事大学 | Lecture full information acquires and is intelligently embedded in the on-demand distribution management system of audio |
| CN110995959A (en) * | 2019-12-31 | 2020-04-10 | 安博思华智能科技有限责任公司 | Method and device for synchronously displaying information on double screens |
| CN111163360A (en) * | 2020-01-02 | 2020-05-15 | 腾讯科技（深圳）有限公司 | Video processing method, video processing device, computer-readable storage medium and computer equipment |
| CN111263220A (en) * | 2020-01-15 | 2020-06-09 | 北京字节跳动网络技术有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
| CN111601125A (en) * | 2019-02-21 | 2020-08-28 | 杭州海康威视数字技术股份有限公司 | Recorded and broadcast video abstract generation method and device, electronic equipment and readable storage medium |
| CN112533054A (en) * | 2019-09-19 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Online video playing method and device and storage medium |
| CN112804554A (en) * | 2021-04-06 | 2021-05-14 | 北京百家视联科技有限公司 | Live broadcast playback method, live broadcast playback system, electronic equipment and storage medium |
| CN112987921A (en) * | 2021-02-19 | 2021-06-18 | 车智互联（北京）科技有限公司 | VR scene explanation scheme generation method |
| CN113259705A (en) * | 2021-06-22 | 2021-08-13 | 北京微吼时代科技有限公司 | Method and device for recording and synthesizing video |
| CN115250366A (en) * | 2021-04-27 | 2022-10-28 | 浙江清捷智能科技有限公司 | Live broadcast data processing method and device |
| CN116033204A (en) * | 2022-07-08 | 2023-04-28 | 荣耀终端有限公司 | Screen recording method, electronic equipment and storage medium |
| CN118474455A (en) * | 2024-07-11 | 2024-08-09 | 深圳市江元科技(集团)有限公司 | Method, system and medium for automatically generating video and circularly playing demonstration |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20000064201A (en) * | 2000-08-29 | 2000-11-06 | 이재학 | The database construction system for a remote education utilizing the internet network and its construction method |
| CN1287554C (en) * | 2001-08-10 | 2006-11-29 | 旭联科技股份有限公司 | Audio and video teaching material recording and playback system and method |
| WO2003025816A1 (en) * | 2001-09-21 | 2003-03-27 | Xinics Inc. | System for providing educational contents on internet and method thereof |
| CN1167024C (en) * | 2002-05-09 | 2004-09-15 | 邓祖道 | Digitalized audio-video information resource system for remote education and its implementing method |
| CN1494008A (en) * | 2002-10-29 | 2004-05-05 | 英业达股份有限公司 | Editable and unloading type network teaching system |
-
2004
- 2004-05-10 CN CNB2004100090729A patent/CN100412852C/en not_active Expired - Fee Related
Cited By (74)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100429643C (en) * | 2005-12-07 | 2008-10-29 | 段君雷 | Production of multi-media network electronic publication |
| CN101552685B (en) * | 2008-04-02 | 2011-06-29 | 圣蓝科技股份有限公司 | Network media information broadcast system, method thereof and executive recording media thereof |
| CN102082768A (en) * | 2009-11-30 | 2011-06-01 | 酷手机多媒体股份有限公司 | System to transmit a plurality of files simultaneously through multimedia information service and method thereof |
| CN103181177A (en) * | 2010-10-20 | 2013-06-26 | 索尼电脑娱乐公司 | Image processing system, image processing method, dynamic image transmission device, dynamic image reception device, information storage medium, and program |
| CN102184174A (en) * | 2010-11-10 | 2011-09-14 | 湖北铂金智慧网络科技有限公司 | Method for recording mouse trace in network |
| CN102932673A (en) * | 2011-08-11 | 2013-02-13 | 阿里巴巴集团控股有限公司 | Video signal and audio signal transmission and synthesis method, system and device |
| CN102404575A (en) * | 2011-11-30 | 2012-04-04 | 江苏奇异点网络有限公司 | Courseware-oriented video compression coding method |
| CN103166831A (en) * | 2011-12-14 | 2013-06-19 | 腾讯科技（深圳）有限公司 | Data processing method, terminal and system |
| CN103166831B (en) * | 2011-12-14 | 2016-01-20 | 腾讯科技（深圳）有限公司 | Data processing method, terminal and system |
| CN102682639A (en) * | 2012-05-17 | 2012-09-19 | 江苏中科梦兰电子科技有限公司 | Method for improving synchronous display efficiency of electronic classroom resources |
| CN102982015A (en) * | 2012-11-06 | 2013-03-20 | 陆昀 | Method of producing electronic courseware by utilizing electronic whiteboard and corresponding display method |
| CN103384346A (en) * | 2012-12-28 | 2013-11-06 | 深圳海联讯科技股份有限公司 | PPT file processing method and device |
| CN103384346B (en) * | 2012-12-28 | 2016-09-28 | 深圳海联讯科技股份有限公司 | A kind of method and device of PPT file process |
| CN103246752A (en) * | 2013-05-30 | 2013-08-14 | 北京瑞翔恒宇科技有限公司 | System for associating ppt document with audio |
| CN104424242A (en) * | 2013-08-27 | 2015-03-18 | 北大方正集团有限公司 | Multi-media file processing method and system |
| CN104424242B (en) * | 2013-08-27 | 2017-11-14 | 北大方正集团有限公司 | Multimedia file processing method and system |
| CN103581569A (en) * | 2013-09-07 | 2014-02-12 | 国家电网公司 | Method and system for recording electric power system teaching courseware |
| CN103702064A (en) * | 2013-12-27 | 2014-04-02 | 三亚中兴软件有限责任公司 | Video conference method, video conference terminal and video conference system |
| CN103702064B (en) * | 2013-12-27 | 2019-01-18 | 三亚中兴软件有限责任公司 | A kind of video-meeting method, terminal and system |
| CN103794098A (en) * | 2014-01-01 | 2014-05-14 | 广州东软科技有限公司 | Intelligent teaching management system |
| CN103763627A (en) * | 2014-01-02 | 2014-04-30 | Tcl集团股份有限公司 | Method and system for realizing real-time video conference |
| CN103763627B (en) * | 2014-01-02 | 2017-10-24 | Tcl集团股份有限公司 | A kind of method and system for realizing real-time video conference |
| CN103944888A (en) * | 2014-04-02 | 2014-07-23 | 天脉聚源(北京)传媒科技有限公司 | Resource sharing method, device and system |
| CN104063263B (en) * | 2014-06-23 | 2017-12-22 | 华为技术有限公司 | The method and apparatus of secondary flow processing |
| CN104063263A (en) * | 2014-06-23 | 2014-09-24 | 华为技术有限公司 | Method and device for secondary flow treatment |
| CN105376634A (en) * | 2014-08-26 | 2016-03-02 | 天脉聚源（北京）教育科技有限公司 | Synchronous recording method of multiple media |
| CN104486635A (en) * | 2014-12-17 | 2015-04-01 | 上海交通大学 | Speech direct-broadcasting and recording method based on events |
| CN104540026A (en) * | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content video recoding and replaying method and system |
| CN104540026B (en) * | 2014-12-22 | 2018-02-09 | 杭州施强教育科技有限公司 | A kind of class offerings video recording and back method and system |
| CN104539436B (en) * | 2014-12-22 | 2018-08-07 | 杭州施强教育科技有限公司 | A kind of class offerings real-time live broadcast method and system |
| CN104539436A (en) * | 2014-12-22 | 2015-04-22 | 杭州施强网络科技有限公司 | Lesson content real-time live broadcasting method and system |
| CN105791950A (en) * | 2014-12-24 | 2016-07-20 | 珠海金山办公软件有限公司 | Power Point video recording method and device |
| WO2016150317A1 (en) * | 2015-03-23 | 2016-09-29 | 阿里巴巴集团控股有限公司 | Method, apparatus and system for synthesizing live video |
| CN106162221A (en) * | 2015-03-23 | 2016-11-23 | 阿里巴巴集团控股有限公司 | The synthetic method of live video, Apparatus and system |
| CN106162043A (en) * | 2015-04-14 | 2016-11-23 | 杭州施强网络科技有限公司 | Multimedia file demenstration method in a kind of video conferencing system |
| CN104994278A (en) * | 2015-06-30 | 2015-10-21 | 北京竞业达数码科技有限公司 | Method and device for synchronously processing multiple paths of videos |
| CN105450944A (en) * | 2015-11-13 | 2016-03-30 | 北京自由坊科技有限责任公司 | Method and device for synchronously recording and reproducing slides and live presentation speech |
| CN105812857A (en) * | 2016-03-21 | 2016-07-27 | 时中 | Dynamic interactive lecture system |
| CN105812857B (en) * | 2016-03-21 | 2019-08-02 | 时中 | Dynamic interaction says base system |
| CN105915970A (en) * | 2016-05-17 | 2016-08-31 | 创盛视联数码科技（北京）有限公司 | Network live broadcasting operation command sending method and device as well as reading method and device |
| CN105959718A (en) * | 2016-06-24 | 2016-09-21 | 乐视控股（北京）有限公司 | Real-time interaction method and device in video live broadcasting |
| CN106101808A (en) * | 2016-07-13 | 2016-11-09 | 乐视控股（北京）有限公司 | A kind of net cast method and device |
| CN107665194A (en) * | 2016-07-27 | 2018-02-06 | 上海拓翎信息科技有限公司 | A kind of data access method of net work teaching system |
| CN106535008A (en) * | 2016-11-04 | 2017-03-22 | 浙江新盛蓝科技有限公司 | Ebh file format and method for reading ebh files |
| CN107005721A (en) * | 2016-11-22 | 2017-08-01 | 广州市百果园信息技术有限公司 | Direct broadcasting room pushing video streaming control method and corresponding server and mobile terminal |
| CN107005721B (en) * | 2016-11-22 | 2020-07-24 | 广州市百果园信息技术有限公司 | Live broadcast room video stream push control method, corresponding server and mobile terminal |
| US11616990B2 (en) | 2016-11-22 | 2023-03-28 | Guangzhou Baiguoyuan Information Technology Co., Ltd. | Method for controlling delivery of a video stream of a live-stream room, and corresponding server and mobile terminal |
| WO2018094556A1 (en) * | 2016-11-22 | 2018-05-31 | 广州市百果园信息技术有限公司 | Live-broadcasting room video stream pushing control method, and corresponding server and mobile terminal |
| CN106604047A (en) * | 2016-12-13 | 2017-04-26 | 天脉聚源(北京)传媒科技有限公司 | Multi-video-stream video direct broadcasting method and device |
| CN106846940A (en) * | 2016-12-29 | 2017-06-13 | 珠海思课技术有限公司 | A kind of implementation method of online live streaming classroom education |
| CN108024139A (en) * | 2017-12-08 | 2018-05-11 | 广州视源电子科技股份有限公司 | Playing method and device of network video courseware, terminal equipment and storage medium |
| CN108093066A (en) * | 2017-12-26 | 2018-05-29 | 中国人民解放军海军总医院 | Sea and the on the bank synchronous sharing method and system of medical image data |
| CN108093066B (en) * | 2017-12-26 | 2021-12-28 | 中国人民解放军海军总医院 | Method and system for synchronously sharing marine and onshore medical image data |
| CN108763439A (en) * | 2018-05-25 | 2018-11-06 | 讯飞幻境(北京)科技有限公司 | A kind of method of data synchronization, device, electronic equipment and computer-readable medium |
| CN109547831A (en) * | 2018-11-19 | 2019-03-29 | 网宿科技股份有限公司 | A kind of method, apparatus, calculating equipment and the storage medium of blank and audio video synchronization |
| CN109547831B (en) * | 2018-11-19 | 2021-06-01 | 网宿科技股份有限公司 | Method and device for synchronizing white board and video, computing equipment and storage medium |
| CN109729418A (en) * | 2019-01-30 | 2019-05-07 | 慧科教育科技集团有限公司 | A kind of teaching programming interactive video recording and broadcasting system and method |
| CN111601125A (en) * | 2019-02-21 | 2020-08-28 | 杭州海康威视数字技术股份有限公司 | Recorded and broadcast video abstract generation method and device, electronic equipment and readable storage medium |
| CN110060033A (en) * | 2019-04-25 | 2019-07-26 | 大连海事大学 | Lecture full information acquires and is intelligently embedded in the on-demand distribution management system of audio |
| CN112533054A (en) * | 2019-09-19 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Online video playing method and device and storage medium |
| CN112533054B (en) * | 2019-09-19 | 2023-02-28 | 腾讯科技（深圳）有限公司 | Online video playing method and device and storage medium |
| CN110995959A (en) * | 2019-12-31 | 2020-04-10 | 安博思华智能科技有限责任公司 | Method and device for synchronously displaying information on double screens |
| CN110995959B (en) * | 2019-12-31 | 2022-06-17 | 安博思华智能科技有限责任公司 | Method and device for synchronously displaying information on double screens |
| CN111163360A (en) * | 2020-01-02 | 2020-05-15 | 腾讯科技（深圳）有限公司 | Video processing method, video processing device, computer-readable storage medium and computer equipment |
| CN111263220B (en) * | 2020-01-15 | 2022-03-25 | 北京字节跳动网络技术有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
| CN111263220A (en) * | 2020-01-15 | 2020-06-09 | 北京字节跳动网络技术有限公司 | Video processing method and device, electronic equipment and computer readable storage medium |
| CN112987921A (en) * | 2021-02-19 | 2021-06-18 | 车智互联（北京）科技有限公司 | VR scene explanation scheme generation method |
| CN112987921B (en) * | 2021-02-19 | 2024-03-15 | 车智互联（北京）科技有限公司 | VR scene explanation scheme generation method |
| CN112804554A (en) * | 2021-04-06 | 2021-05-14 | 北京百家视联科技有限公司 | Live broadcast playback method, live broadcast playback system, electronic equipment and storage medium |
| CN115250366A (en) * | 2021-04-27 | 2022-10-28 | 浙江清捷智能科技有限公司 | Live broadcast data processing method and device |
| CN113259705A (en) * | 2021-06-22 | 2021-08-13 | 北京微吼时代科技有限公司 | Method and device for recording and synthesizing video |
| CN116033204A (en) * | 2022-07-08 | 2023-04-28 | 荣耀终端有限公司 | Screen recording method, electronic equipment and storage medium |
| CN116033204B (en) * | 2022-07-08 | 2023-10-20 | 荣耀终端有限公司 | Screen recording method, electronic equipment and storage medium |
| CN118474455A (en) * | 2024-07-11 | 2024-08-09 | 深圳市江元科技(集团)有限公司 | Method, system and medium for automatically generating video and circularly playing demonstration |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100412852C (en) | 2008-08-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1696923A (en) | Networked, multimedia synchronous composed storage and issuance system, and method for implementing the system | |
| CN104902343B (en) | A kind of method, server and the terminal of transmission and playing audio-video and message | |
| CN110234081A (en) | The sending, receiving method and its device and hand-hold electronic equipments of video message | |
| KR20160067126A (en) | Method and apparatus for content delivery | |
| CN1892649A (en) | Interactive news gathering and media production control system | |
| TW200525968A (en) | Embedding a session description message in a real-time control protocol (RTCP) message | |
| JP6398215B2 (en) | Delivery control system, delivery system, delivery control method, and program | |
| CN103096182A (en) | Network television program information sharing method and system | |
| US20060242676A1 (en) | Live streaming broadcast method, live streaming broadcast device, live streaming broadcast system, program, recording medium, broadcast method, and broadcast device | |
| JP6323048B2 (en) | Distribution system, distribution method, and program | |
| CN105657469A (en) | Online crowd funding method, platform and system based on network video broadcast | |
| EP2974319A1 (en) | Distribution control system, distribution control method, and computer-readable storage medium | |
| CN101049014A (en) | Auxiliary content handling over digital communication systems | |
| CN1561637A (en) | System and method for transmitting multimedia information streams, for instance for remote teaching | |
| CN101098470A (en) | P2P technique based stream media program broadcasting/receiving method and apparatus | |
| CN108111872B (en) | Audio live broadcasting system | |
| EP2849455A1 (en) | Distribution management apparatus and distribution management system | |
| WO2014208377A1 (en) | Content supply device, content supply method, program, terminal device, and content supply system | |
| KR20160077066A (en) | Transmission device, transmission method, reception device, and reception method | |
| CN105516090A (en) | Media play method, device and music teaching system | |
| CN105247875A (en) | Distribution control system and distribution system | |
| WO2015007137A1 (en) | Videoconference terminal, secondary-stream data accessing method, and computer storage medium | |
| CN105847904A (en) | Distribution control apparatus and distribution control method | |
| KR20160077067A (en) | Transmission device, transmission method, reception device, and reception method | |
| CN110610727A (en) | Courseware recording and broadcasting system with voice recognition function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160506 Address after: 100055, No. 3, Fengtai District Fortune Plaza, No. 9, Guang'an Road, Beijing, 15a07 Patentee after: Beijing World Network Technology Co., Ltd. Address before: 100871 Beijing the Summer Palace Road, Haidian District, No. 5 Patentee before: Peking University |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20160523 Address after: 100080 Beijing, 8 North two street, Zhongguancun, block sohoA, Haidian District, 602 Patentee after: Billion interactive technology (Beijing) Co., Ltd. Address before: 100055, No. 3, Fengtai District Fortune Plaza, No. 9, Guang'an Road, Beijing, 15a07 Patentee before: Beijing World Network Technology Co., Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20080820 Termination date: 20190510 |