CN110111614A - A kind of method and system that audio-video teaching implementation sound screen is synchronous - Google Patents

A kind of method and system that audio-video teaching implementation sound screen is synchronous Download PDF

Info

Publication number
CN110111614A
CN110111614A CN201910191629.1A CN201910191629A CN110111614A CN 110111614 A CN110111614 A CN 110111614A CN 201910191629 A CN201910191629 A CN 201910191629A CN 110111614 A CN110111614 A CN 110111614A
Authority
CN
China
Prior art keywords
information
handwriting
audio
person
data information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910191629.1A
Other languages
Chinese (zh)
Inventor
张明
张国斌
赵成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Pen Sound Intelligent Technology Co Ltd
Original Assignee
Hangzhou Pen Sound Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Pen Sound Intelligent Technology Co Ltd filed Critical Hangzhou Pen Sound Intelligent Technology Co Ltd
Priority to CN201910191629.1A priority Critical patent/CN110111614A/en
Publication of CN110111614A publication Critical patent/CN110111614A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/60Information retrieval; Database structures therefor; File system structures therefor of audio data
    • G06F16/68Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/686Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The embodiment of the present application proposes a kind of method and system that audio-video teaching implementation sound screen is synchronous, the method includes recording stage and plays the stage;The recording stage includes: the person's handwriting and stamp information of corresponding first time obtained in preset time period, generates handwriting data information;Audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information are obtained, audio data information is generated;The handwriting data information and the audio data information are packaged and generate instructional video data packet;The broadcasting stage includes: to extract the first time stamp information and second timestamp information, generates play time sequence;It is according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.The synchronous method of the audio-video teaching implementation sound screen of the embodiment of the present application, handwriting data information and audio data information are only transmitted in data transmission procedure, reduces volume of transmitted data, reduces communications burden and cost, the delay of the instructional video that can effectively shorten transmission.

Description

A kind of method and system that audio-video teaching implementation sound screen is synchronous
Technical field
This application involves a kind of synchronous method of video teaching technical field more particularly to audio-video teaching implementation sound screen and System.
Background technique
In the environment of networked teaching, majority of case video teaching resources are to record, and need to pass through video after recording Edit is made micro- course either Exquisite Course Website, then uploads to teaching resource platform again, watch for user's program request.
But video teaching resources in the prior art are to record completion plus the record time by record screen means, The data volume of each video teaching resources is very big, so that the transmission quantity of data is larger during transmitting video teaching resources, The delay for increasing communications burden and cost, and instructional video being caused to be transmitted, affects user experience.
Summary of the invention
In view of this, the purpose of the application is to propose a kind of method and system that audio-video teaching implementation sound screen is synchronous, Come solve in the prior art during transmit video teaching resources, the transmission quantity of data is larger, increase communications burden with Cost, and the delay for causing instructional video to be transmitted, the technical issues of affecting user experience.
A kind of side that audio-video teaching implementation sound screen is synchronous is proposed in the one aspect of the application based on above-mentioned purpose Method, including recording stage and broadcasting stage;
Wherein, the recording stage includes:
The person's handwriting and corresponding first time obtained in preset time period stabs information, generates handwriting data information;
Audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information are obtained, sound is generated Frequency data information;
The handwriting data information and the audio data information are packaged and generate instructional video data packet;
The broadcasting stage includes:
The first time stamp information and second timestamp information are extracted, play time sequence is generated;
It is according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
In some embodiments, the person's handwriting is the person's handwriting being written on dot matrix paper, is provided on the dot matrix paper multiple According to the anchor point of array arrangement, the anchor point is for positioning the person's handwriting.
In some embodiments, the person's handwriting obtained in preset time period and corresponding first time stab information, generate Handwriting data information, comprising:
The person's handwriting point obtained in preset time period becomes relative to the change in location information of the anchor point on dot matrix paper and position First time when change stabs information.
In some embodiments, described be packaged the handwriting data information and the audio data information generates teaching view Frequency data packet, comprising:
Scrambled is carried out to the handwriting data information and the audio data information respectively and is compressed, data text is generated Then part is packaged the data file of generation, generate instructional video data packet.
In some embodiments, according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information described And before playing, further includes:
Decompression decryption is carried out to the instructional video data packet, generates corresponding handwriting data information and audio data letter Breath.
In some embodiments, further includes:
The corresponding handwriting data information and audio data information of generation are cached.
Based on above-mentioned purpose, in further aspect of the application, it is also proposed that a kind of audio-video teaching implementation sound screen is synchronous System, comprising:
Record module and playing module;
The module of recording generates person's handwriting for obtaining person's handwriting and stamp information of corresponding first time in preset time period Data information;Audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information are obtained, is generated Audio data information;The handwriting data information and the audio data information are packaged and generate instructional video data packet;
The playing module is for extracting the first time stamp information and second timestamp information, when generating broadcasting Between sequence;It is according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
In some embodiments, the recording module, further includes:
File encryption unit, for carrying out scrambled to the handwriting data information and the audio data information respectively And compress, data file is generated, then the data file of generation is packaged, generates instructional video data packet.
In some embodiments, the recording module, further includes:
Cache unit generates corresponding handwriting data information for carrying out decompression decryption to the instructional video data packet And audio data information, and the corresponding handwriting data information and audio data information of generation are cached.
In some embodiments, further includes:
User management module for managing the registration of user, log in and exit, and receives the information that user terminal is sent, And the shared information between user terminal.
The synchronous method and system of the audio-video teaching implementation sound screen of the embodiment of the present application, only passes in data transmission procedure Defeated handwriting data information and audio data information, reduce volume of transmitted data, reduce communications burden and cost, and can be effective The delay for shortening instructional video transmission, improves user experience.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other Feature, objects and advantages will become more apparent upon:
Fig. 1 is the flow chart of the synchronous method of the audio-video teaching implementation sound screen of the embodiment of the present application one;
Fig. 2 is the flow chart of the synchronous method of the audio-video teaching implementation sound screen of the embodiment of the present application two;
Fig. 3 is the structural schematic diagram of the synchronous system of the audio-video teaching implementation sound screen of the embodiment of the present application three.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to Convenient for description, part relevant to related invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
A kind of synchronous method and system of audio-video teaching implementation sound screen of the embodiment of the present application, using dot matrix paper and has The pen of scanning function is provided with the anchor point according to array arrangement on dot matrix paper, and each anchor point can have respective coordinate, The coordinate can be the absolute coordinate of anchor point, i.e. coordinate of the anchor point on dot matrix paper, be also possible to the opposite seat of anchor point Mark, i.e. coordinate of the current anchor point relative to other anchor points.In writing process, there is the pen tip of the pen of scanning function and determine Relative position between site be it is continually changing, by scanning record pen tip and anchor point between relative position variation, It can determine the person's handwriting that teacher writes, while record the voice of teacher's explanation, complete to record.And in playing process, only play Teacher write person's handwriting and writing process in explanation voice, thus using person's handwriting play instead of traditional record screen, i.e., to The person's handwriting that teacher writes is recorded, rather than is recorded to the picture including teacher, and volume of transmitted data is greatly reduced.
Specifically, as shown in Figure 1, being the process of the method for the audio-video teaching implementation sound screen synchronization of the embodiment of the present application one Figure.From figure 1 it appears that the method that the audio-video teaching implementation sound screen of the present embodiment is synchronous, including two stages, respectively Recording stage and broadcasting stage.Wherein, the recording stage the following steps are included:
S101: the person's handwriting and corresponding first time obtained in preset time period stabs information, generates handwriting data information.
In the present embodiment, it using dot matrix paper and with the pen of scanning function, is provided on dot matrix paper according to array arrangement Anchor point, each anchor point can have respective coordinate, which can be the absolute coordinate of anchor point, i.e. anchor point exists Coordinate on dot matrix paper is also possible to the relative coordinate of anchor point, i.e. coordinate of the current anchor point relative to other anchor points.? In writing process, with scanning function pen pen tip and anchor point between relative position be it is continually changing, pass through scanning The variation for recording the relative position between pen tip and anchor point can determine the person's handwriting that teacher writes.Obtain preset time period First time when the opposite change in location information and change in location with the anchor point on dot matrix paper of interior person's handwriting point stabs information.
During recording the person's handwriting that teacher writes, it is also possible to record stage by stage, for example, can be according to The preset period records the person's handwriting, and the timestamp information for the person's handwriting that record is recorded while recording, in turn Generate handwriting data information.On the one hand, the real-time broadcasting of person's handwriting may be implemented, i.e., played out while teacher writes.By In under normal conditions, user (student) is to watch instructional video by mobile terminal, and user and teacher are not on same sky Between, in order to realize the effect of broadcasting (be broadcast live) in real time, therefore, can be obtained according to the preset period person's handwriting and it is corresponding when Between stab information, such as every five seconds obtain it is primary.Certainly, some instructional videos do not need to realize the effect played in real time, then this is default Period can suitably increase, specifically, can the preset time period determine according to actual needs length.In the present embodiment In, the person's handwriting that notes teacher processed used writes can be write by teacher, and record corresponding timestamp information.
S102: obtaining audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information, Generate audio data information.
While teacher's written handwriting, it will usually the knowledge point being related to the person's handwriting write is explained, therefore, While obtaining the person's handwriting, the audio-frequency information of teacher, i.e. voice of teacher during explanation, and and audio-frequency information are obtained Corresponding second timestamp information, and then generate audio data information.Due to audio-frequency information be it is corresponding with the person's handwriting, because This, the audio-frequency information is also the audio in preset time period, in order to when playing person's handwriting play, person's handwriting and audio realization It is played simultaneously, so that the person's handwriting played is corresponding with the audio broadcast.In the present embodiment, used in can also being write by teacher Notes teacher processed audio, and record corresponding timestamp information.
S103: the handwriting data information and the audio data information are packaged and generate instructional video data packet.
It, can be by the handwriting data information and the audio number after generating handwriting data information and audio data information Instructional video data packet is generated according to information package.It specifically, can be respectively to the handwriting data information and the audio data Information carries out scrambled and compresses, and generates data file, is then packaged to the data file of generation, generates instructional video Data packet.It is of course also possible to the handwriting data information and the audio data information are merged in same file, it is then right This document carries out scrambled and compresses, and generates data file, is then packaged to the data file of generation, generates teaching view Frequency data packet.Instructional video data packet is being generated, terminal device can be sent directly to, is being played in real time to realize, it can also be with It is sent to database, instructional video data packet is stored, and in the playing request of the user terminal received, from database It is middle to call corresponding instructional video data packet, and it is sent to corresponding user terminal, or also can permit user terminal access data Library, to obtain corresponding instructional video data packet.
The broadcasting stage the following steps are included:
S104: the first time stamp information and second timestamp information are extracted, play time sequence is generated.
When user terminal plays out the person's handwriting, when extracting first in the instructional video data packet received first Between stab information and second timestamp information, generate play time sequence, person's handwriting and audio be mapped, to realize person's handwriting With being played simultaneously for audio.
S105: according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
After generating play time sequence, the person's handwriting of recording and audio sync are played.In the present embodiment, pen is being played When mark, need first to carry out the person's handwriting that teacher writes according to the opposite change in location information with the anchor point on dot matrix paper of person's handwriting point Reduction determines the person's handwriting content that teacher writes according to the opposite change in location information with the anchor point on dot matrix paper of person's handwriting point, so The person's handwriting after reduction is played out afterwards, the audio of recording is then directly played for audio.
The synchronous method of the audio-video teaching implementation sound screen of the embodiment of the present application, only transmits person's handwriting in data transmission procedure Data information and audio data information, reduce volume of transmitted data, reduce communications burden and cost, and can effectively shorten religion The delay for learning transmission of video, improves user experience.
As shown in Fig. 2, being the flow chart of the method for the audio-video teaching implementation sound screen synchronization of the embodiment of the present application two.At this In embodiment, the synchronous method of the audio-video teaching implementation sound screen, equally may include two stages, respectively recording rank Section and broadcasting stage.Wherein, the recording stage the following steps are included:
S201: the person's handwriting and corresponding first time obtained in preset time period stabs information, generates handwriting data information.
In the present embodiment, it using dot matrix paper and with the pen of scanning function, is provided on dot matrix paper according to array arrangement Anchor point, each anchor point can have respective coordinate, which can be the absolute coordinate of anchor point, i.e. anchor point exists Coordinate on dot matrix paper is also possible to the relative coordinate of anchor point, i.e. coordinate of the current anchor point relative to other anchor points.? In writing process, with scanning function pen pen tip and anchor point between relative position be it is continually changing, pass through scanning The variation for recording the relative position between pen tip and anchor point can determine the person's handwriting that teacher writes.Obtain preset time period First time when the opposite change in location information and change in location with the anchor point on dot matrix paper of interior person's handwriting point stabs information.
During recording the person's handwriting that teacher writes, it is also possible to record stage by stage, for example, can be according to The preset period records the person's handwriting, and the timestamp information for the person's handwriting that record is recorded while recording, in turn Generate handwriting data information.On the one hand, the real-time broadcasting of person's handwriting may be implemented, i.e., played out while teacher writes.By In under normal conditions, user (student) is to watch instructional video by mobile terminal, and user and teacher are not on same sky Between, in order to realize the effect of broadcasting (be broadcast live) in real time, therefore, can be obtained according to the preset period person's handwriting and it is corresponding when Between stab information, such as every five seconds obtain it is primary.Certainly, some instructional videos do not need to realize the effect played in real time, then this is default Period can suitably increase, specifically, can the preset time period determine according to actual needs length.In the present embodiment In, the person's handwriting that notes teacher processed used writes can be write by teacher, and record corresponding timestamp information.
S202: obtaining audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information, Generate audio data information.
While teacher's written handwriting, it will usually the knowledge point being related to the person's handwriting write is explained, therefore, While obtaining the person's handwriting, the audio-frequency information of teacher, i.e. voice of teacher during explanation, and and audio-frequency information are obtained Corresponding second timestamp information, and then generate audio data information.Due to audio-frequency information be it is corresponding with the person's handwriting, because This, the audio-frequency information is also the audio in preset time period, in order to when playing person's handwriting play, person's handwriting and audio realization It is played simultaneously, so that the person's handwriting played is corresponding with the audio broadcast.In the present embodiment, used in can also being write by teacher Notes teacher processed audio, and record corresponding timestamp information.
S203: scrambled is carried out to the handwriting data information and the audio data information respectively and is compressed, is generated Then data file is packaged the data file of generation, generate instructional video data packet.
It, can be by the handwriting data information and the audio number after generating handwriting data information and audio data information Instructional video data packet is generated according to information package.It specifically, can be respectively to the handwriting data information and the audio data Information carries out scrambled and compresses, and generates data file, is then packaged to the data file of generation, generates instructional video Data packet.Instructional video data packet is being generated, terminal device can be sent directly to, is being played in real time to realize.
The broadcasting stage the following steps are included:
S204: decompression decryption is carried out to the instructional video data packet, generates corresponding handwriting data information and audio number It is believed that breath.
When user terminal plays out the person's handwriting, decompression decryption first is carried out to the instructional video data packet received, Generate corresponding handwriting data information and audio data information.
S205: the corresponding handwriting data information and audio data information of generation are cached.
By caching to the corresponding handwriting data information and audio data information of generation, rendering can be improved Energy.
S206: the first time stamp information and second timestamp information are extracted, play time sequence is generated.
After being cached to the corresponding handwriting data information and audio data information of generation, it can first extract and receive Instructional video data packet in first time stamp information and second timestamp information, play time sequence is generated, by pen Mark and audio are mapped, to realize being played simultaneously for person's handwriting and audio.
S207: according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
After generating play time sequence, the person's handwriting of recording and audio sync are played.In the present embodiment, pen is being played When mark, need first to carry out the person's handwriting that teacher writes according to the opposite change in location information with the anchor point on dot matrix paper of person's handwriting point Reduction determines the person's handwriting content that teacher writes according to the opposite change in location information with the anchor point on dot matrix paper of person's handwriting point, so The person's handwriting after reduction is played out afterwards, the audio of recording is then directly played for audio.
The synchronous method of the audio-video teaching implementation sound screen of the embodiment of the present application, only transmits person's handwriting in data transmission procedure Data information and audio data information, reduce volume of transmitted data, reduce communications burden and cost, and can effectively shorten religion The delay for learning transmission of video, improves user experience.
As shown in figure 3, being the structural schematic diagram of the system of the audio-video teaching implementation sound screen synchronization of the embodiment of the present application three. The synchronous system of the audio-video teaching implementation sound screen of the present embodiment, comprising:
Record module 301 and playing module 302, wherein the recording module 301 may include that handwriting data information is raw again At unit 3011, audio data information generation unit 3012, file encryption unit 3013 and data package generating unit 3014.
The handwriting data information generating unit 3011 be used to obtain person's handwriting in preset time period and it is corresponding first when Between stab information, generate handwriting data information.
Specifically, in the present embodiment, it using dot matrix paper and with the pen of scanning function, is provided on dot matrix paper according to battle array The anchor point of arrangement is arranged, each anchor point can have respective coordinate, which can be the absolute coordinate of anchor point, i.e., fixed Coordinate of the site on dot matrix paper, is also possible to the relative coordinate of anchor point, i.e., current anchor point is relative to other anchor points Coordinate.In writing process, with scanning function pen pen tip and anchor point between relative position be it is continually changing, lead to The variation of relative position between overscanning record pen tip and anchor point can determine the person's handwriting that teacher writes.It obtains default First time stamp when the opposite change in location information and change in location with the anchor point on dot matrix paper of person's handwriting point in the period Information.
During recording the person's handwriting that teacher writes, it is also possible to record stage by stage, for example, can be according to The preset period records the person's handwriting, and the timestamp information for the person's handwriting that record is recorded while recording, in turn Generate handwriting data information.On the one hand, the real-time broadcasting of person's handwriting may be implemented, i.e., played out while teacher writes.By In under normal conditions, user (student) is to watch instructional video by mobile terminal, and user and teacher are not on same sky Between, in order to realize the effect of broadcasting (be broadcast live) in real time, therefore, can be obtained according to the preset period person's handwriting and it is corresponding when Between stab information, such as every five seconds obtain it is primary.Certainly, some instructional videos do not need to realize the effect played in real time, then this is default Period can suitably increase, specifically, can the preset time period determine according to actual needs length.In the present embodiment In, the person's handwriting that notes teacher processed used writes can be write by teacher, and record corresponding timestamp information.
The audio data information generation unit 3012 is for obtaining audio-frequency information corresponding with the person's handwriting and the sound Corresponding second timestamp information of frequency information generates audio data information.
Specifically, while teacher's written handwriting, it will usually the knowledge point being related to the person's handwriting write is explained, Therefore, while obtaining the person's handwriting, the audio-frequency information of teacher, i.e. voice of teacher during explanation, Yi Jiyu are obtained Corresponding second timestamp information of audio-frequency information, and then generate audio data information.Since audio-frequency information is and the person's handwriting pair Answer, therefore, the audio-frequency information is also the audio in preset time period, in order to when playing person's handwriting, make person's handwriting play and Audio realization is played simultaneously, so that the person's handwriting played is corresponding with the audio broadcast.In the present embodiment, teacher can also be passed through The audio of notes teacher processed used is write, and records corresponding timestamp information.
It, can be by the handwriting data information and the audio number after generating handwriting data information and audio data information Instructional video data packet is generated according to information package.It specifically, can be by the file encryption unit 3013 respectively to the person's handwriting Data information and the audio data information carry out scrambled and compress, and generate data file, are then given birth to by the data packet The data file generated at 3014 Duis of unit is packaged, and generates instructional video data packet.
The playing module 302 includes play time sequence generating unit 3021, cache unit 3022 and display unit 3023。
Wherein, the cache unit 3022 generates corresponding for carrying out decompression decryption to the instructional video data packet Handwriting data information and audio data information, and the corresponding handwriting data information and audio data information of generation are delayed It deposits.
The play time sequence generating unit 3021 is used to extract the first time stamp information of the handwriting data information With the second timestamp information of the audio data information, play time sequence is generated.
The display unit 3023 is used for according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information And it plays.
In addition, the system of the present embodiment can also include:
User management module 303 for managing the registration of user, log in and exit, and receives the letter that user terminal is sent Breath, and share the information between user terminal.For example, receiving drawing person's handwriting, text and figure that user terminal is sent Shape etc. establishes synchronous and coherency mechanism, and records and broadcast the message, and the network connection while listening for client particular port is asked Connection is asked and established therewith, transmits the data between user terminal to realize and is carrying out the information between user terminal It is shared.
The synchronous system of the audio-video teaching implementation sound screen of the embodiment of the present application, can obtain and above method embodiment phase Similar technical effect, which is not described herein again.
It should be noted that " first " and " second " involved by the embodiment of the present application, it is therefore intended that distinguish person's handwriting number It is believed that the timestamp of breath and audio data information, and be understood not to identify the handwriting data information and audio data information when Between the restriction stabbed.The technical solution of the application is illustrated in addition, the embodiment of the present application is only exemplary, without should be by It is interpreted as the restriction to technical scheme.Such as, the step S101 and S102 in embodiment can also be carried out simultaneously, rather than Successively carry out.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art Member is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed herein Can technical characteristic replaced mutually and the technical solution that is formed.

Claims (10)

1. a kind of synchronous method of audio-video teaching implementation sound screen, which is characterized in that including recording stage and play the stage;
Wherein, the recording stage includes:
The person's handwriting and corresponding first time obtained in preset time period stabs information, generates handwriting data information;
Audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information are obtained, audio number is generated It is believed that breath;
The handwriting data information and the audio data information are packaged and generate instructional video data packet;
The broadcasting stage includes:
The first time stamp information and second timestamp information are extracted, play time sequence is generated;
It is according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
2. described the method according to claim 1, wherein the person's handwriting is the person's handwriting being written on dot matrix paper Multiple anchor points according to array arrangement are provided on dot matrix paper, the anchor point is for positioning the person's handwriting.
3. according to the method described in claim 2, it is characterized in that, the person's handwriting obtained in preset time period and corresponding the One timestamp information generates handwriting data information, comprising:
When obtaining change in location information and change in location of the person's handwriting point in preset time period relative to the anchor point on dot matrix paper First time stab information.
4. according to the method described in claim 3, it is characterized in that, described by the handwriting data information and the audio data Information package generates instructional video data packet, comprising:
Scrambled is carried out to the handwriting data information and the audio data information respectively and is compressed, data file is generated, Then the data file of generation is packaged, generates instructional video data packet.
5. according to the method described in claim 4, it is characterized in that, it is described according to the play time sequence by each frame Person's handwriting it is synchronous with audio-frequency information and play before, further includes:
Decompression decryption is carried out to the instructional video data packet, generates corresponding handwriting data information and audio data information.
6. according to the method described in claim 5, it is characterized by further comprising:
The corresponding handwriting data information and audio data information of generation are cached.
7. a kind of synchronous system of audio-video teaching implementation sound screen characterized by comprising record module and playing module;
The module of recording generates handwriting data for obtaining person's handwriting and stamp information of corresponding first time in preset time period Information;Audio-frequency information corresponding with the person's handwriting and corresponding second timestamp information of the audio-frequency information are obtained, audio is generated Data information;The handwriting data information and the audio data information are packaged and generate instructional video data packet;
The playing module generates play time sequence for extracting the first time stamp information and second timestamp information Column;It is according to the play time sequence that the person's handwriting of each frame is synchronous with audio-frequency information and play.
8. system according to claim 7, which is characterized in that the recording module, further includes:
File encryption unit, for carrying out scrambled to the handwriting data information and the audio data information respectively and pressing Contracting generates data file, is then packaged to the data file of generation, generates instructional video data packet.
9. system according to claim 8, which is characterized in that the recording module, further includes:
Cache unit generates corresponding handwriting data information and sound for carrying out decompression decryption to the instructional video data packet Frequency data information, and the corresponding handwriting data information and audio data information of generation are cached.
10. system according to claim 9, which is characterized in that further include:
User management module for managing the registration of user, log in and exit, and receives the information that user terminal is sent, and Shared information between user terminal.
CN201910191629.1A 2019-03-14 2019-03-14 A kind of method and system that audio-video teaching implementation sound screen is synchronous Pending CN110111614A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910191629.1A CN110111614A (en) 2019-03-14 2019-03-14 A kind of method and system that audio-video teaching implementation sound screen is synchronous

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910191629.1A CN110111614A (en) 2019-03-14 2019-03-14 A kind of method and system that audio-video teaching implementation sound screen is synchronous

Publications (1)

Publication Number Publication Date
CN110111614A true CN110111614A (en) 2019-08-09

Family

ID=67484353

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910191629.1A Pending CN110111614A (en) 2019-03-14 2019-03-14 A kind of method and system that audio-video teaching implementation sound screen is synchronous

Country Status (1)

Country Link
CN (1) CN110111614A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110444058A (en) * 2019-08-22 2019-11-12 北京北师智慧科技有限公司 Micro- class manufacturing system and micro- teaching system
CN111212320A (en) * 2020-01-08 2020-05-29 腾讯科技(深圳)有限公司 Resource synthesis method, device, equipment and storage medium
CN112351295A (en) * 2020-10-27 2021-02-09 杭州米络星科技(集团)有限公司 Live broadcast playback synchronization method for online education

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008150916A1 (en) * 2007-05-29 2008-12-11 Livescribe, Inc. Enhanced audio recording for smart pen computing systems
CN103336663A (en) * 2013-05-22 2013-10-02 天脉聚源(北京)传媒科技有限公司 Data synchronization method, device and terminal
CN104618786A (en) * 2014-12-22 2015-05-13 深圳市腾讯计算机系统有限公司 Audio/video synchronization method and device
CN105487687A (en) * 2015-11-23 2016-04-13 广州视睿电子科技有限公司 Handwriting display method and apparatus
CN105677273A (en) * 2015-12-31 2016-06-15 田雪松 Lattice-based display method and system
CN106898170A (en) * 2017-04-21 2017-06-27 杭州狮说教育科技有限公司 Key to the exercises teaching method based on voice and digiboard book synchronized playback
CN108881767A (en) * 2018-07-17 2018-11-23 广州飞磨科技有限公司 A method of record shields terminal system and realizes record screen using its

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008150916A1 (en) * 2007-05-29 2008-12-11 Livescribe, Inc. Enhanced audio recording for smart pen computing systems
CN103336663A (en) * 2013-05-22 2013-10-02 天脉聚源(北京)传媒科技有限公司 Data synchronization method, device and terminal
CN104618786A (en) * 2014-12-22 2015-05-13 深圳市腾讯计算机系统有限公司 Audio/video synchronization method and device
CN105487687A (en) * 2015-11-23 2016-04-13 广州视睿电子科技有限公司 Handwriting display method and apparatus
CN105677273A (en) * 2015-12-31 2016-06-15 田雪松 Lattice-based display method and system
CN106898170A (en) * 2017-04-21 2017-06-27 杭州狮说教育科技有限公司 Key to the exercises teaching method based on voice and digiboard book synchronized playback
CN108881767A (en) * 2018-07-17 2018-11-23 广州飞磨科技有限公司 A method of record shields terminal system and realizes record screen using its

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110444058A (en) * 2019-08-22 2019-11-12 北京北师智慧科技有限公司 Micro- class manufacturing system and micro- teaching system
CN111212320A (en) * 2020-01-08 2020-05-29 腾讯科技(深圳)有限公司 Resource synthesis method, device, equipment and storage medium
CN112351295A (en) * 2020-10-27 2021-02-09 杭州米络星科技(集团)有限公司 Live broadcast playback synchronization method for online education

Similar Documents

Publication Publication Date Title
US11252444B2 (en) Video stream processing method, computer device, and storage medium
WO2019205872A1 (en) Video stream processing method and apparatus, computer device and storage medium
WO2019205886A1 (en) Method and apparatus for pushing subtitle data, subtitle display method and apparatus, device and medium
WO2016150317A1 (en) Method, apparatus and system for synthesizing live video
CN110111614A (en) A kind of method and system that audio-video teaching implementation sound screen is synchronous
JP2006503384A (en) Multimedia content service system and method based on user preference and recording medium thereof
KR101358807B1 (en) Method for synchronizing program between multi-device using digital watermark and system for implementing the same
CN109769132B (en) Multi-channel remote live video commentary method based on frame synchronization
CN105704504A (en) A method and apparatus for inserting push information in video direct broadcast
CN109743529A (en) A kind of Multifunctional video conferencing system
CN112437337A (en) Method, system and equipment for realizing live broadcast real-time subtitles
CN107733876A (en) A kind of stream media caption display methods, mobile terminal and storage device
JP2016527792A (en) Video conference terminal, secondary stream data access method, and computer storage medium
CN104202425A (en) Real-time online data transmission system and remote course data transmission method
KR102248097B1 (en) Method for transmiting contents and terminal apparatus using the same
CN108810575A (en) A kind of method and apparatus sending target video
JP5502567B2 (en) Broadcast distribution system, broadcast distribution method, and content viewing program
KR20150112113A (en) Method for managing online lecture contents based on event processing
JP2021090172A (en) Caption data generation device, content distribution system, video reproduction device, program, and caption data generation method
CN107135407B (en) Synchronous method and system in a kind of piano video teaching
CN112995699B (en) Online live broadcast method, live broadcast equipment, live broadcast system and electronic equipment
CN114466145B (en) Video processing method, device, equipment and storage medium
CN114938443A (en) Real-time scoring method for experimental practice test based on streaming media
KR100790803B1 (en) Audio broadcasting system, its method and player for inserting fingerprinting information in real time
KR101565139B1 (en) Method for serving learning resources for multi channel in smart learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190809