CN111428059A - Audio-associated multimedia data playing method and device, electronic equipment and storage medium - Google Patents

Audio-associated multimedia data playing method and device, electronic equipment and storage medium Download PDF

Info

Publication number
CN111428059A
CN111428059A CN202010197093.7A CN202010197093A CN111428059A CN 111428059 A CN111428059 A CN 111428059A CN 202010197093 A CN202010197093 A CN 202010197093A CN 111428059 A CN111428059 A CN 111428059A
Authority
CN
China
Prior art keywords
multimedia data
screen
played
audio
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010197093.7A
Other languages
Chinese (zh)
Inventor
涂序文
金晓峰
徐露
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Zhitong Consulting Co Ltd
Original Assignee
Tutorabc Network Technology Shanghai Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tutorabc Network Technology Shanghai Co ltd filed Critical Tutorabc Network Technology Shanghai Co ltd
Priority to CN202010197093.7A priority Critical patent/CN111428059A/en
Publication of CN111428059A publication Critical patent/CN111428059A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a multimedia data playing method and device associated with audio, electronic equipment and a storage medium, wherein the multimedia data playing method associated with the audio comprises the following steps: responding to the awakening operation of the playing equipment, and determining the current playing information of the played audio data; determining multimedia data to be played from multimedia data associated with the played audio data according to the current playing information; and playing the determined multimedia data to be played on a screen of the playing equipment. The method and the device provided by the invention respond to the awakening of the screen and provide the associated multimedia data for the student while the student listens to the audio course, thereby perfecting the audio course, saving the flow and reducing the requirement on the network bandwidth.

Description

Audio-associated multimedia data playing method and device, electronic equipment and storage medium
Technical Field
The present invention relates to the field of computer applications, and in particular, to a method and an apparatus for playing multimedia data associated with audio, an electronic device, and a storage medium.
Background
With the development of the internet, online education is produced in order to increase the education audience. The current online education mode is mostly online video courses and online video interactive courses and the like. This is suitable for trainees who have continuous and centralisable time. However, for some students who do not have continuous centralizable time, they cannot get good learning experience and high learning efficiency through the time of online video lessons and online video interactive lessons. For these students, audio lessons are a better choice. On the one hand, the learning can be performed by utilizing the fragmentation time; on the other hand, there is no requirement for network bandwidth. Thus, the audio course is suitable for the student to flexibly learn at any time and any place.
However, audio lessons are typically converted from video lessons. It is difficult to provide the user with a complete knowledge structure by audio only.
Therefore, how to provide associated multimedia data to a student while listening to an audio course so as to perfect the audio course is a technical problem to be solved in the field.
Disclosure of Invention
The present invention is directed to a method, an apparatus, an electronic device, and a storage medium for playing multimedia data associated with audio, which overcome at least some of the limitations and disadvantages of the related art.
According to an aspect of the present invention, there is provided a method for playing multimedia data associated with audio, including:
responding to the awakening operation of the playing equipment, and determining the current playing information of the played audio data;
determining multimedia data to be played from multimedia data associated with the played audio data according to the current playing information; and
and playing the determined multimedia data to be played on a screen of the playing equipment.
In some embodiments of the present invention, the current playing information is a current time stamp of the played audio data, the multimedia data associated with the played audio data is indexed by the time stamp,
the determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information includes:
and determining multimedia data to be played according to the multimedia data associated with the audio data played by the current timestamp, wherein the multimedia data to be played is used for performing supplementary display on the content of the audio data played by the current timestamp.
In some embodiments of the present invention, the current playing information is a current text content of the played audio data, which is converted by speech text, the multimedia data associated with the played audio data is indexed by the text content,
the determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information includes:
and determining multimedia data to be played according to the multimedia data associated with the audio data of the self-played current text content, wherein the multimedia data to be played is used for performing supplementary display on the current text content.
In some embodiments of the invention, the audio data associated multimedia data is one or more of courseware, video lesson, network associated data associated with the audio data.
In some embodiments of the invention, the network-associated data is multimedia data crawled from the internet in accordance with the audio data.
In some embodiments of the present invention, the wake-up operation on the playback device includes operating a screen of the playback device or moving the playback device from a first state to a second state.
In some embodiments of the invention, the playback device includes at least a first screen and a second screen.
In some embodiments of the present invention, the first screen is in an awake state, the waking operation on the playback device is a waking operation on a second screen of the playback device, and the determined multimedia data to be played is played on the second screen of the playback device.
In some embodiments of the present invention, the determining, according to the current playing information, multimedia data to be played from multimedia data associated with the audio data includes:
determining first multimedia data to be played according to first multimedia data related to the audio data played by the current playing information;
determining second multimedia data to be played according to second multimedia data related to the audio data played by the current playing information;
correspondingly, the playing the determined multimedia data to be played on the screen of the playing device includes:
and respectively playing the determined first multimedia data to be played and the second multimedia data to be played on a first screen and a second screen of the playing equipment.
In some embodiments of the present invention, the current playing information comprises a current timestamp of the played audio data and a speech-to-text converted current text content of the played audio data,
the first multimedia data to be played is determined according to the first multimedia data related to the audio data played by the current timestamp;
and the two multimedia data to be played are determined according to the second multimedia data related to the self-played audio data of the current text content.
In some embodiments of the present invention, playing the determined first multimedia data to be played and the determined second multimedia data to be played on a first screen and a second screen of the playing device respectively includes:
establishing association of the first multimedia data and the second multimedia data according to the current timestamp and/or the current text content;
updating the multimedia data displayed on one screen in response to the operation on the screen;
and updating the multimedia data displayed on the other screen in a linkage manner according to the association of the first multimedia data and the second multimedia data.
In some embodiments of the present invention, the first screen and the second screen have a screen-close state and a screen-split state.
In some embodiments of the present invention, playing the determined first multimedia data to be played and the determined second multimedia data to be played on a first screen and a second screen of the playing device respectively includes:
judging the combination state of the first screen and the second screen;
if the first screen and the second screen are in a split screen state, the determined first multimedia data to be played and the determined second multimedia data to be played are respectively played on the first screen and the second screen of the playing device;
and if the first screen and the second screen are in a screen closing state, selecting multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
In some embodiments of the present invention, if the first screen and the second screen are in a split screen state, after the playing the determined first multimedia data to be played and the determined second multimedia data to be played on the first screen and the second screen of the playing device respectively, the method further includes:
in response to a first switching operation, interchanging multimedia data played on the first screen and the second screen;
responding to the first screen and the second screen to be switched from a split screen state to a screen-in state, and selecting multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
In some embodiments of the present invention, after the selecting a multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played is played on the combined screen of the first screen and the second screen, the method further includes:
and responding to a second switching operation, and playing the other multimedia data to be played in the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
According to another aspect of the present invention, there is also provided an audio-associated multimedia data playing apparatus, including:
the first determining module is used for responding to the awakening operation of the playing equipment and determining the current playing information of the played audio data;
the second determining module is used for determining multimedia data to be played from the multimedia data related to the played audio data according to the current playing information; and
and the playing control module is used for playing the determined multimedia data to be played on a screen of the playing equipment.
According to still another aspect of the present invention, there is also provided an electronic apparatus, including: a processor; a storage medium having stored thereon a computer program which, when executed by the processor, performs the steps as described above.
According to yet another aspect of the present invention, there is also provided a storage medium having stored thereon a computer program which, when executed by a processor, performs the steps as described above.
Compared with the prior art, the invention has the advantages that:
the invention provides the associated multimedia data for the student by responding to the awakening of the screen while the student listens to the audio course, thereby perfecting the audio course, saving the flow and reducing the requirement on the network bandwidth.
Drawings
The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings.
Fig. 1 shows a flowchart of a multimedia data playing method of associated audio according to an embodiment of the present invention.
Fig. 2 is a schematic diagram of a wake-up playback device according to an embodiment of the present invention.
Fig. 3 is a diagram illustrating a playback device having a first screen and a second screen, the second screen being in a sleep state according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating waking up a second screen according to an embodiment of the present invention.
Fig. 5 illustrates a flowchart for playing multimedia data on a first screen and a second screen according to a specific embodiment of the present invention.
Fig. 6 is a diagram illustrating the playing of multimedia data on a first screen and a second screen according to an embodiment of the present invention.
Fig. 7 is a flowchart illustrating linkage update of multimedia data played by a first screen and a second screen according to an embodiment of the present invention.
Fig. 8 is a flowchart illustrating a play control in a state where the first screen and the second screen are differently combined according to an embodiment of the present invention.
Fig. 9 is a schematic diagram illustrating a screen closing state according to an embodiment of the present invention.
Fig. 10 and 11 are schematic views showing a screen split state according to an embodiment of the present invention.
Fig. 12 is a block diagram illustrating an audio-associated multimedia data playback apparatus according to an embodiment of the present invention.
Fig. 13 schematically illustrates a computer-readable storage medium in an exemplary embodiment of the invention.
Fig. 14 schematically illustrates an electronic device in an exemplary embodiment of the invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the invention and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the steps. For example, some steps may be decomposed, and some steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The method and the device are preferably used for improving the situation that when the playing device is in a dormant state, when a user wants to know further contents of a currently played audio course, the corresponding contents are difficult to display and position, so that the user cannot understand audio data, needs to manually search and find the corresponding contents for understanding, and the user experience is poor.
Fig. 1 shows a flowchart of a multimedia data playing method of associated audio according to an embodiment of the present invention. The multimedia data playing method of the associated audio comprises the following steps:
step S110: in response to a wake-up operation on the playback device, current playback information of the played audio data is determined.
Specifically, the playing device described in each example of the present invention may be a mobile smart device such as a mobile phone, a smart watch, a tablet computer, and a notebook computer.
Specifically, step S110 is performed on the premise that the playback device is in the hibernation state, i.e., the display screen of the playback device does not display any content.
Step S120: and determining multimedia data to be played from the multimedia data associated with the played audio data according to the current playing information.
Step S130: and playing the determined multimedia data to be played on a screen of the playing equipment.
In the audio-associated multimedia data playing method provided by the invention, the students can respond to the awakening of the screen while listening to the audio courses and provide the associated multimedia data for the students, so that the audio courses are perfected, the flow is saved, and the requirement on network bandwidth is reduced.
In some embodiments of the invention, the multimedia data associated with the audio data is one or more of courseware, video lessons, and network-associated data associated with the audio data. Courseware can be played in picture, PPT and PDF formats. In the application of the audio course, the provided audio data is the audio of the video course, so that each audio data can be directly associated with the video course when the audio data is generated. The video lessons are played in the form of video streams. The network associated data is multimedia data crawled from the internet according to the audio data. For example, multimedia data (including text, pictures, video) may be crawled from the internet based on one or more of the title of the audio data, keywords, the teacher of the audio source, and so on. When a plurality of multimedia data are crawled, the multimedia data can be selected according to a set algorithm rule. For example, the dimensions of the keyword frequency, the title similarity calculation, the playing amount, and the like are set according to the algorithm specification, and the present invention can implement more variation modes, which is not described herein. When the played multimedia data contains audio, the played multimedia data can be muted, or the audio data being played can be paused, and the audio of the multimedia data to be played can be played.
In some embodiments of the present invention, the current playing information is a current time stamp of the played audio data, and the multimedia data associated with the played audio data is indexed by the time stamp. The step S120 shown in fig. 1 of determining multimedia data to be played from the multimedia data associated with the audio data according to the current playing information may include the following steps: and determining multimedia data to be played according to the multimedia data associated with the audio data played by the current timestamp, wherein the multimedia data to be played is used for performing supplementary display on the content of the audio data played by the current timestamp.
For example, when the multimedia data is a video session, the audio data is extracted from the corresponding video session, and the audio data and the video session are temporally aligned, so that the time stamp of the audio data and the time stamp of the video session are aligned (even if the audio data is captured during the extraction, the audio data and the video session can be previously operated to correspond to each other at the time stamps). In step S120, according to the current timestamp of the audio data, the position of the video course corresponding to the timestamp can be located, and the video content after the corresponding timestamp of the video course starts is used as the multimedia data to be played, and the video content after the corresponding timestamp of the video course starts is played through step S130.
For example, when the multimedia data is a corresponding courseware, the courseware is generally used in a video course correspondingly, and therefore, the time stamp of the video course can be associated with the content of each page of the courseware (for example, the time of the first page of the courseware is 0:00-3:20, and the time of the second page of the courseware is 3:21-7: 10.). Thus, according to the above, the time stamp of the audio data and the time stamp of the video lesson are matched with each other, and therefore, the time stamp of the audio data is associated with each page of the courseware. In step S120, according to the current timestamp of the audio data, the number of pages of the courseware corresponding to the timestamp can be located, and the current number of pages of the courseware and the courseware are taken as multimedia data to be played, the current number of pages of the courseware is played through step S130, and the number of pages of the courseware is correspondingly switched along with the playing of the audio data.
In some embodiments of the present invention, the current playing information is a current text content of the played audio data, which is converted by a speech text, and the multimedia data associated with the played audio data is indexed by the text content. The step S120 shown in fig. 1 of determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information includes the following steps: and determining multimedia data to be played according to the multimedia data associated with the audio data of the self-played current text content, wherein the multimedia data to be played is used for performing supplementary display on the current text content.
For example, when the multimedia data is a video course, the audio data is extracted from the corresponding video course, and the audio data and the video course are correspondingly consistent. Thus, full text of the audio data that is voice-text converted can be used as an index to the video lesson. Full text may be localized to a specific location of a video lesson in terms of words or sentences. In step S120, according to the matching between the current text content of the played audio data converted by the voice text and the full text, the specific position of the video course can be located by the position of the current text content in the full text, the video content after the specific position of the video course is used as the multimedia data to be played, and the video content after the specific position of the video course is played in step S130.
For example, when the multimedia data is a corresponding courseware, the courseware is generally used in a video course correspondingly, and therefore, the time stamp of the video course can be associated with the content of each page of the courseware (for example, the time of the first page of the courseware is 0:00-3:20, and the time of the second page of the courseware is 3:21-7: 10.). Thus, according to the above, the time stamp of the audio data and the time stamp of the video lesson are matched with each other, and therefore, the time stamp of the audio data is associated with each page of the courseware. In step S120, matching is performed according to the current text content of the played audio data and converted from the voice text with the text content in the courseware, after the visible page number is located, the page number of the courseware corresponding to the timestamp can be located, the current page number of the courseware and the courseware are taken as the multimedia data to be played, the current page number of the courseware is played through step S130, and the page number of the courseware is correspondingly switched along with the playing of the audio data.
For example, when the multimedia data is network-related data, in step S120, according to matching between the current text content of the played audio data and the text data in the network-related data (or subtitles of the video data in the network-related data, text data obtained by converting the voice text of the video data, and text data obtained by recognition in a picture), a position of the network-related data that matches the current text content can be located, and the position of the network-related data that matches the highlight can be used as the multimedia data to be played, and the position of the network-related data that matches the highlight is played in step S130.
In some embodiments of the present invention, the wake-up operation on the playback device includes operating a screen of the playback device or moving the playback device from a first state to a second state. As shown in fig. 2, fig. 2 is a schematic diagram of a wake-up playback device according to an embodiment of the present invention. The mobile phone 201 plays audio data in a sleep state (horizontal state), and the screen of the mobile phone 201 in the sleep state is displayed as a black screen 202. When the mobile phone 201 is lifted from the sleep state (horizontal state) to the second state (vertical state), the mobile phone 201 is awakened. After waking up the handset 201, the screen thereof displays the multimedia data 203 associated with the currently played content of the audio data. Fig. 2 only shows a wake-up mode of the playback device, and the present invention can also implement more variations, which are not described herein.
In some embodiments of the invention, the playback device includes at least a first screen and a second screen. In other words, the playback device may be a folding screen mobile phone, where the first screen and the second screen may be displayed in a folded or combined screen manner. The first screen and the second screen may be connected by a flexible display screen.
In a specific implementation of the foregoing embodiment, the first screen is in an awake state, the waking operation on the playback device is a waking operation on a second screen of the playback device, and the determined multimedia data to be played is played on the second screen of the playback device. This particular implementation is illustrated in fig. 3 and 4. Fig. 3 is a diagram illustrating a playback device having a first screen and a second screen, the second screen being in a sleep state according to an embodiment of the present invention. FIG. 4 is a diagram illustrating waking up a second screen according to an embodiment of the present invention. The playback device in fig. 3 is a mobile phone 210 with a foldable screen. The mobile phone 210 includes a first screen 211 and a second screen 212. The user plays the audio data through the mobile phone 210, and performs operations other than playing the audio data on the first screen 211, such as chatting, shopping, etc., and the second screen 212 is in a dormant state. When the user wants to acquire the associated multimedia data of the currently played audio data, the second screen 212 is woken up and the multimedia data is displayed on the second screen 212. Further, in the embodiments shown in fig. 3 and 4, both the first screen 211 and the second screen 212 are in the on-screen state, and waking up the second screen 212 may include touching the second screen 212 or pressing a physical key that wakes up the second screen 212. In a variation of the above embodiment, the first screen 211 and the second screen 212 are folded, the user plays the audio data through the mobile phone 210, and performs operations other than playing the audio data on the first screen 211, such as chatting, shopping, etc., and the second screen 212 is folded on the back of the first screen 211 (or folded in other ways) and is in a dormant state. When the second screen 212 is switched from the folded state to the screen-closed state, the second screen 212 is wakened up, so that the associated multimedia data is displayed after the second screen 212 is wakened up. The folded state and the screen-closed state can be detected by sensors disposed on the first screen 211 and the second screen 212.
Therefore, through the two screens, when a user conducts operations such as chatting and shopping on one screen, which are unrelated to audio playing, the user can wake up the other screen without exiting the current operation, so that the playing of the multimedia data related to the audio data is realized, the operation flow of the user is reduced, the user can conveniently conduct multi-process operation on the same device, and the user experience is further improved.
In other embodiments where the playback device includes at least a first screen and a second screen, the first screen and the second screen may be woken up simultaneously. Referring to fig. 5 and 6, fig. 5 is a flowchart illustrating playing multimedia data on a first screen and a second screen according to an embodiment of the present invention; fig. 6 is a diagram illustrating the playing of multimedia data on a first screen and a second screen according to an embodiment of the present invention.
Fig. 5 shows the following steps:
step S301: determining first multimedia data to be played according to first multimedia data related to the audio data played by the current playing information;
step S302: determining second multimedia data to be played according to second multimedia data related to the audio data played by the current playing information;
step S303: and respectively playing the determined first multimedia data to be played and the second multimedia data to be played on a first screen and a second screen of the playing equipment.
Wherein, step S301 and step S302 can be executed synchronously or in reverse order. Step S301 and step S302 may be performed in step S120 shown in fig. 1. Step S303 may be performed in step S130.
In particular, in some implementations of the invention, the first multimedia data may be, for example, courseware, and the second multimedia data may be, for example, lesson video; the first multimedia data may be, for example, courseware, and the second multimedia data may be, for example, network-associated data; the first multimedia data may be, for example, a lesson video, and the second multimedia data may be, for example, network-associated data; the first multimedia data may be, for example, one network associated data and the second multimedia data may be, for example, another network associated data. In the above examples, the first multimedia data and the second multimedia data are interchangeable, and the invention is not limited thereto.
As shown in fig. 6, the mobile phone 210 plays audio data and is initially in a sleep state, and when the mobile phone is woken up, the first multimedia data (courseware) is played on the first screen 211 of the mobile phone 210 and the second multimedia data (lesson video) is played on the second screen 212. Therefore, the multi-screen playing equipment is used for simultaneously playing the plurality of associated multimedia data, and the user is further assisted to understand the currently played audio content.
In some implementations of the foregoing embodiment of the present invention, the current playing information includes a current timestamp of the played audio data and a current text content of the played audio data converted by a speech text, and the first multimedia data to be played is determined from first multimedia data associated with the played audio data according to the current timestamp; and the two multimedia data to be played are determined according to the second multimedia data related to the self-played audio data of the current text content.
For example, when the first multimedia data is a course video and the second multimedia data is network-related data, the first multimedia data to be played is determined from the course video associated with the played audio data according to the current timestamp; and the second multimedia data to be played is determined according to the network related data associated with the audio data self-played by the current text content. When the first multimedia data is courseware and the second multimedia data is network related data, the first multimedia data to be played is determined according to the courseware related to the audio data played by the current timestamp; and the second multimedia data to be played is determined according to the network related data associated with the audio data self-played by the current text content. When the first multimedia data is a courseware and the second multimedia data is a course video, the first multimedia data to be played is determined according to the courseware related to the audio data played by the current timestamp; and determining the second multimedia data to be played according to the course video associated with the self-played audio data of the current text content. The specific manner for positioning the multimedia data to be played according to different current playing information and different multimedia data has been described above, and is not described herein again.
Referring now to fig. 7, fig. 7 is a flow chart illustrating the linked update of the multimedia data played by the first screen and the second screen according to an embodiment of the present invention. Fig. 7 shows a specific implementation of the step of playing the determined first multimedia data to be played and the determined second multimedia data to be played on the first screen and the second screen of the playing device, respectively. Fig. 7 shows the following steps:
step S311: establishing association of the first multimedia data and the second multimedia data according to the current timestamp and/or the current text content;
step S312: updating the multimedia data displayed on one screen in response to the operation on the screen;
step S313: and updating the multimedia data displayed on the other screen in a linkage manner according to the association of the first multimedia data and the second multimedia data.
In this embodiment, the display contents of the first screen and the second screen are updated in real time according to the playing of the audio data without the operation of the user. When a user operates one of the screens (for example, through gesture touch operation), the playing content of the one of the screens is updated. For the curriculum video, the updating comprises fast forwarding, rewinding, positioning to a specific time stamp and the like; for the courseware, the updating comprises page turning backwards, page turning forwards, page number positioning and the like; for the network associated data, the updating comprises pulling up, pulling down, positioning to a specific display position and the like.
Therefore, in a specific implementation of the above embodiment, when the first screen displays the course video and the second screen displays the courseware, the course video and the courseware are associated by the timestamp, so that when the user operates the course video to fast forward and backward and locates to the specific timestamp on the first screen, the courseware displayed on the second screen correspondingly turns pages backwards and forwards and locates to the page number; and when the user operates the courseware to turn pages backwards and forwards and position the pages on the second screen, the first screen displays the corresponding fast forward, fast backward and position the specific timestamp of the course video.
In another specific implementation of the foregoing embodiment, when the first screen displays the lesson video and the second screen displays the network-related data, the lesson video and the network-related data are associated by the text information, so that when the user operates the lesson video to fast forward, rewind and position to the specific timestamp on the first screen, the lesson video is pulled up, pulled down and positioned to the specific display position corresponding to the network-related data displayed on the second screen in association with the text information; and when the user operates the corresponding pull-up, pull-down and positioning of the network related data to the specific display position on the second screen, the first screen displays the corresponding fast forward, reverse and positioning of the course video to the specific time stamp.
In another specific implementation of the above embodiment, when the first screen displays courseware and the second screen displays network related data, the courseware and the network related data are associated through text information, so that when a user operates to page the courseware backwards, page the forwards and locate the pages on the first screen, the courseware is pulled up, pulled down and located to a specific display position according to the text information and corresponding to the network related data displayed on the second screen; and when the user operates the network related data to pull up, pull down and position to a specific display position on the second screen, the first screen displays backward page turning, forward page turning and page number positioning.
In a variation of the above embodiment, the playing position of the audio data is also adjusted correspondingly according to the user's operation on the screen.
Therefore, the two screens of the playing device are linked, so that a user can conveniently check the related content on the first screen and the second screen, the user is prevented from operating the first screen and then operating the second screen, the operation flow is reduced, and the user experience is improved.
Further, in some embodiments of the present invention, the playback device includes at least a first screen and a second screen. In other words, the playback device may be a folding screen mobile phone, in which the first screen and the second screen may be displayed in a folded state (split screen state) or in a closed state (closed screen state). The first screen and the second screen may be connected by a flexible display screen. Referring to fig. 8 to 11, fig. 8 is a flowchart illustrating a play control in a state where the first screen and the second screen are combined differently according to an embodiment of the present invention. Fig. 9 is a schematic diagram illustrating a screen closing state according to an embodiment of the present invention. Fig. 10 and 11 are schematic views showing a screen split state according to an embodiment of the present invention.
In the step S130 shown in fig. 1, the step of playing the determined first multimedia data to be played and the determined second multimedia data to be played on the first screen and the second screen of the playing device respectively further includes the steps shown in fig. 8:
step S321: and judging the combination state of the first screen and the second screen.
If the first screen and the second screen are in the split screen state, step S322 is executed: and respectively playing the determined first multimedia data to be played and the second multimedia data to be played on a first screen and a second screen of the playing equipment.
If the first screen and the second screen are in the closed state, executing step S323: and selecting multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
Specifically, when the first screen 211 and the second screen 212 are in the screen-closed state, as shown in fig. 9. The first screen 211 and the second screen 212 in the closed screen state may form a combined screen 213 to display the same multimedia data to be played in combination. The multimedia data to be played can be selected from the first multimedia data to be played and the second multimedia data to be played according to a predefined rule. The predefined rule may be, for example, a priority courseware, but the invention is not limited thereto, and other types of predefined rules are within the scope of the invention.
In the above embodiment, after the first screen 211 and the second screen 212 in the closed screen state can form the combined screen 213 to combine and play multimedia data to be played, the following steps can be further included: in response to a second switching operation, the other multimedia data to be played of the first multimedia data to be played and the second multimedia data to be played is played on the combined screen of the first screen 211 and the second screen 212. The first switching operation is, for example, shaking the mobile phone (which may be sensed by the gyroscope) on the side displayed or the non-displayed side of the combination screen 213, which is not limited by the invention, and other gestures, pressure touch, and physical key pressing manners are within the scope of the invention. Thus, the multimedia data played on the composite screen 213 can be switched by a simple operation to increase the user experience.
Specifically, when the first screen and the second screen are in the split-screen state, as shown in fig. 10 and 11, the second screen 212 of the mobile phone 210 is folded to the back of the first screen 211, the first screen 211 of the mobile phone 210 plays the first multimedia data, and the second screen of the mobile phone 210 plays the second multimedia data. The first multimedia data to be played and the second multimedia data to be played, which are respectively played by the first screen 211 and the second screen 212 in the split-screen state, may also be updated in a linkage manner according to the steps shown in fig. 7, so that when the user turns over from the first screen 211 to the second plane 212, the viewed content is related.
In the above embodiment, after the first multimedia data to be played and the second multimedia data to be played are respectively played on the first screen 211 and the second screen 212 in the split-screen state, the following steps may be further included: in response to a first switching operation, the multimedia data played on the first screen 211 and the second screen 212 are interchanged. The first switching operation is, for example, shaking the mobile phone (which may be sensed by the gyroscope) toward the first screen 211 or the second screen 212, but the invention is not limited thereto, and other gestures, pressure touch, and physical key pressing manners are within the scope of the invention. Thus, the contents of the first screen 211 and the second screen 212 can be switched by a simple operation to increase the user experience.
In the above embodiment, after the first multimedia data to be played and the second multimedia data to be played are respectively played on the first screen 211 and the second screen 212 in the split-screen state, the following steps may be further included: in response to the first screen 211 and the second screen 212 switching from the split screen state to the close screen state (as shown in fig. 9), a multimedia data to be played is selected from the first multimedia data to be played and the second multimedia data to be played for playing on the combined screen 213 of the first screen 211 and the second screen 212. The multimedia data to be played can be selected from the first multimedia data to be played and the second multimedia data to be played according to a predefined rule. The predefined rule may be, for example, a priority courseware, but the invention is not limited thereto, and other types of predefined rules are within the scope of the invention.
The above are merely a plurality of specific implementations of the present invention, and each of the specific implementations may be implemented alone or in combination, and the present invention is not limited thereto.
Fig. 12 is a block diagram illustrating an audio-associated multimedia data playback apparatus according to an embodiment of the present invention. The multimedia data playing apparatus 400 associated with audio comprises a first determining module 410, a second determining module 420, and a playing control module 430.
The first determining module 410 is configured to determine current playing information of the played audio data in response to a wake-up operation on the playing device;
the second determining module 420 is configured to determine multimedia data to be played from multimedia data associated with the played audio data according to the current playing information; and
the playing control module 430 is configured to play the determined multimedia data to be played on the screen of the playing device.
In the multimedia data playing device associated with audio according to the exemplary embodiment of the present invention, the audio lesson is completed, the traffic is saved, and the requirement for the network bandwidth is reduced by providing the associated multimedia data to the trainee in response to the awakening of the screen while the trainee listens to the audio lesson.
Fig. 12 is a schematic diagram of the multimedia data playing apparatus 400 for associated audio provided by the present invention, and the splitting, combining and adding of modules are within the scope of the present invention without departing from the concept of the present invention. The audio-related multimedia data playing apparatus 400 provided by the present invention can be implemented by software, hardware, firmware, plug-in and any combination thereof, which is not limited thereto.
In an exemplary embodiment of the present invention, a computer-readable storage medium is further provided, on which a computer program is stored, which when executed by, for example, a processor, may implement the steps of the audio-associated multimedia data playing method described in any of the above embodiments. In some possible embodiments, the various aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above-mentioned audio-associated multimedia data playback method part of the present description, when said program product is run on the terminal device.
Referring to fig. 13, a program product 700 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including AN object oriented programming language such as Java, C + +, or the like, as well as conventional procedural programming languages, such as the "C" language or similar programming languages.
In an exemplary embodiment of the invention, there is also provided an electronic device that may include a processor and a memory for storing executable instructions of the processor. Wherein the processor is configured to execute the steps of the audio-associated multimedia data playing method in any of the above embodiments via executing the executable instructions.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 500 according to this embodiment of the invention is described below with reference to fig. 14. The electronic device 500 shown in fig. 14 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 14, the electronic device 500 is embodied in the form of a general purpose computing device. The components of the electronic device 500 may include, but are not limited to: at least one processing unit 510, at least one memory unit 520, a bus 530 that couples various system components including the memory unit 520 and the processing unit 510, a display unit 540, and the like.
Wherein the storage unit stores program code, which can be executed by the processing unit 510, to cause the processing unit 510 to perform the steps according to various exemplary embodiments of the present invention described in the above-mentioned audio-associated multimedia data playing method section of the present specification. For example, the processing unit 510 may perform the steps as shown in fig. 1.
The memory unit 520 may include a readable medium in the form of a volatile memory unit, such as a random access memory unit (RAM)5201 and/or a cache memory unit 5202, and may further include a read only memory unit (ROM) 5203.
The memory unit 520 may also include a program/utility 5204 having a set (at least one) of program modules 5205, such program modules 5205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
Bus 530 may be one or more of any of several types of bus structures including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
Electronic device 500 may also communicate with one or more external devices 600 (e.g., keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a tenant to interact with electronic device 500, and/or any device (e.g., router, modem, etc.) that enables electronic device 500 to communicate with one or more other computing devices.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, or a network device, etc.) to execute the above-mentioned multimedia data playing method associated with audio according to the embodiment of the present invention.
Compared with the prior art, the invention has the advantages that:
the invention provides the associated multimedia data for the student by responding to the awakening of the screen while the student listens to the audio course, thereby perfecting the audio course, saving the flow and reducing the requirement on the network bandwidth.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

Claims (18)

1. A method for playing multimedia data associated with audio, comprising:
responding to the awakening operation of the playing equipment, and determining the current playing information of the played audio data;
determining multimedia data to be played from multimedia data associated with the played audio data according to the current playing information; and
and playing the determined multimedia data to be played on a screen of the playing equipment.
2. The audio-associated multimedia data playback method of claim 1, wherein the current playback information is a current time stamp of the played audio data, the multimedia data associated with the played audio data is indexed by the time stamp,
the determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information includes:
and determining multimedia data to be played according to the multimedia data associated with the audio data played by the current timestamp, wherein the multimedia data to be played is used for performing supplementary display on the content of the audio data played by the current timestamp.
3. The audio-associated multimedia data playback method according to claim 1, wherein the current playback information is a current text content of the played audio data that is converted from speech to text, the multimedia data associated with the played audio data is indexed by the text content,
the determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information includes:
and determining multimedia data to be played according to the multimedia data associated with the audio data of the self-played current text content, wherein the multimedia data to be played is used for performing supplementary display on the current text content.
4. The method as claimed in claim 1, wherein the audio-related multimedia data is one or more of courseware, video lesson, and network-related data related to the audio data.
5. The audio-associated multimedia data playback method according to claim 4, wherein the network-associated data is multimedia data crawled from the internet according to the audio data.
6. The method for playing multimedia data associated with audio according to claim 1, wherein the waking operation of the playing device comprises operating a screen of the playing device or moving the playing device from the first state to the second state.
7. The audio-associated multimedia data playback method of claim 1, wherein the playback device includes at least a first screen and a second screen.
8. The audio-associated multimedia data playing method according to claim 7, wherein the first screen is in an awake state, the awake operation for the playing device is an awake operation for a second screen of the playing device, and the determined multimedia data to be played is played on the second screen of the playing device.
9. The method as claimed in claim 7, wherein the determining the multimedia data to be played from the multimedia data associated with the audio data according to the current playing information comprises:
determining first multimedia data to be played according to first multimedia data related to the audio data played by the current playing information;
determining second multimedia data to be played according to second multimedia data related to the audio data played by the current playing information;
correspondingly, the playing the determined multimedia data to be played on the screen of the playing device includes:
and respectively playing the determined first multimedia data to be played and the second multimedia data to be played on a first screen and a second screen of the playing equipment.
10. The audio-associated multimedia data playback method according to claim 9, wherein the current playback information includes a current time stamp of the played audio data and a current text content of the played audio data subjected to the speech-to-text conversion,
the first multimedia data to be played is determined according to the first multimedia data related to the audio data played by the current timestamp;
and the two multimedia data to be played are determined according to the second multimedia data related to the self-played audio data of the current text content.
11. The audio-associated multimedia data playing method of claim 10, wherein playing the determined first multimedia data to be played and the determined second multimedia data to be played on a first screen and a second screen of the playing device respectively comprises:
establishing association of the first multimedia data and the second multimedia data according to the current timestamp and/or the current text content;
updating the multimedia data displayed on one screen in response to the operation on the screen;
and updating the multimedia data displayed on the other screen in a linkage manner according to the association of the first multimedia data and the second multimedia data.
12. The audio-associated multimedia data playing method of claim 9, wherein the first screen and the second screen have a screen-on state and a screen-off state.
13. The audio-associated multimedia data playback method according to claim 12,
the step of playing the determined first multimedia data to be played and the determined second multimedia data to be played on the first screen and the second screen of the playing device respectively comprises:
judging the combination state of the first screen and the second screen;
if the first screen and the second screen are in a split screen state, the determined first multimedia data to be played and the determined second multimedia data to be played are respectively played on the first screen and the second screen of the playing device;
and if the first screen and the second screen are in a screen closing state, selecting multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
14. The method for playing multimedia data associated with audio according to claim 13, wherein if the first screen and the second screen are in a split-screen state, the step of playing the determined first multimedia data to be played and the determined second multimedia data to be played respectively on the first screen and the second screen of the playing device further comprises:
in response to a first switching operation, interchanging multimedia data played on the first screen and the second screen; or
Responding to the first screen and the second screen to be switched from a split screen state to a screen-in state, and selecting multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
15. The method as claimed in claim 13 or 14, wherein the selecting a multimedia data to be played from the first multimedia data to be played and the second multimedia data to be played after playing on the combined screen of the first screen and the second screen further comprises:
and responding to a second switching operation, and playing the other multimedia data to be played in the first multimedia data to be played and the second multimedia data to be played on a combined screen of the first screen and the second screen.
16. An audio-associated multimedia data playback apparatus, comprising:
the first determining module is used for responding to the awakening operation of the playing equipment and determining the current playing information of the played audio data;
the second determining module is used for determining multimedia data to be played from the multimedia data related to the played audio data according to the current playing information; and
and the playing control module is used for playing the determined multimedia data to be played on a screen of the playing equipment.
17. An electronic device, characterized in that the electronic device comprises:
a processor;
memory on which a computer program is stored which, when executed by the processor, carries out the audio-associated multimedia data playback method according to one of claims 1 to 15.
18. A storage medium having stored thereon a computer program for executing the audio-associated multimedia data playback method according to any one of claims 1 to 15 when executed by a processor.
CN202010197093.7A 2020-03-19 2020-03-19 Audio-associated multimedia data playing method and device, electronic equipment and storage medium Pending CN111428059A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010197093.7A CN111428059A (en) 2020-03-19 2020-03-19 Audio-associated multimedia data playing method and device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010197093.7A CN111428059A (en) 2020-03-19 2020-03-19 Audio-associated multimedia data playing method and device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN111428059A true CN111428059A (en) 2020-07-17

Family

ID=71548111

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010197093.7A Pending CN111428059A (en) 2020-03-19 2020-03-19 Audio-associated multimedia data playing method and device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111428059A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468679A (en) * 2021-02-04 2021-03-09 北京拓课网络科技有限公司 Method and device for synchronously playing audio and video courseware and electronic equipment

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101076172A (en) * 2007-07-12 2007-11-21 中兴通讯股份有限公司 Mobile terminal and multimedium playing method therefor
CN104980820A (en) * 2015-06-17 2015-10-14 小米科技有限责任公司 Multimedia file playing method and multimedia file playing device
CN107371058A (en) * 2017-08-04 2017-11-21 深圳市创维软件有限公司 A kind of player method, smart machine and the storage medium of multimedia file sound intermediate frequency data
CN109246472A (en) * 2018-08-01 2019-01-18 平安科技(深圳)有限公司 Video broadcasting method, device, terminal device and storage medium
CN109740000A (en) * 2018-12-25 2019-05-10 维沃移动通信有限公司 A kind of multimedia file processing method and mobile terminal
CN109766305A (en) * 2018-12-11 2019-05-17 中新金桥数字科技(北京)有限公司 Epub e-book text based on android system compares reading method and system with audio-video
CN109814822A (en) * 2018-12-24 2019-05-28 维沃移动通信有限公司 A kind of multimedia control method for playing back, device and terminal device
CN109951733A (en) * 2019-04-18 2019-06-28 北京小米移动软件有限公司 Video broadcasting method, device, equipment and readable storage medium storing program for executing
CN110007844A (en) * 2018-01-05 2019-07-12 中兴通讯股份有限公司 A kind of method of screens switch and the terminal of double screen

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101076172A (en) * 2007-07-12 2007-11-21 中兴通讯股份有限公司 Mobile terminal and multimedium playing method therefor
CN104980820A (en) * 2015-06-17 2015-10-14 小米科技有限责任公司 Multimedia file playing method and multimedia file playing device
CN107371058A (en) * 2017-08-04 2017-11-21 深圳市创维软件有限公司 A kind of player method, smart machine and the storage medium of multimedia file sound intermediate frequency data
CN110007844A (en) * 2018-01-05 2019-07-12 中兴通讯股份有限公司 A kind of method of screens switch and the terminal of double screen
CN109246472A (en) * 2018-08-01 2019-01-18 平安科技(深圳)有限公司 Video broadcasting method, device, terminal device and storage medium
CN109766305A (en) * 2018-12-11 2019-05-17 中新金桥数字科技(北京)有限公司 Epub e-book text based on android system compares reading method and system with audio-video
CN109814822A (en) * 2018-12-24 2019-05-28 维沃移动通信有限公司 A kind of multimedia control method for playing back, device and terminal device
CN109740000A (en) * 2018-12-25 2019-05-10 维沃移动通信有限公司 A kind of multimedia file processing method and mobile terminal
CN109951733A (en) * 2019-04-18 2019-06-28 北京小米移动软件有限公司 Video broadcasting method, device, equipment and readable storage medium storing program for executing

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112468679A (en) * 2021-02-04 2021-03-09 北京拓课网络科技有限公司 Method and device for synchronously playing audio and video courseware and electronic equipment
CN112468679B (en) * 2021-02-04 2021-04-20 北京拓课网络科技有限公司 Method and device for synchronously playing audio and video courseware and electronic equipment

Similar Documents

Publication Publication Date Title
Ranchal et al. Using speech recognition for real-time captioning and lecture transcription in the classroom
US9251717B2 (en) Augmentative and alternative communication language system
US8924853B2 (en) Apparatus, and associated method, for cognitively translating media to facilitate understanding
CN110083319B (en) Note display method, device, terminal and storage medium
US20080033721A1 (en) System for concurrent display and textual annotation of prepared materials by voice-to-text converted input
US20140377722A1 (en) Synchronous presentation of content with a braille translation
KR20170140742A (en) A video providing device and a method for studying ways of english expression
US20140377721A1 (en) Synchronous presentation of content with a braille translation
CN112437353A (en) Video processing method, video processing apparatus, electronic device, and readable storage medium
CN108763552A (en) A kind of learning method and private tutor's machine based on private tutor's machine
US20080066008A1 (en) Visual Control Interface for Controlling Multi-Window Display System
US20230244363A1 (en) Screen capture method and apparatus, and electronic device
CN103413476A (en) Touch electronic pointer
US9137483B2 (en) Video playback device, video playback method, non-transitory storage medium having stored thereon video playback program, video playback control device, video playback control method and non-transitory storage medium having stored thereon video playback control program
CN104978875A (en) Multi-functional intelligent teaching system
WO2022228377A1 (en) Sound recording method and apparatus, and electronic device and readable storage medium
KR20180066709A (en) Mobile terminal of playing moving picture lecture and method of playing related moving picture
CN112286617B (en) Operation guidance method and device and electronic equipment
CN111428059A (en) Audio-associated multimedia data playing method and device, electronic equipment and storage medium
CN113485779A (en) Operation guiding method and device for application program
JP2003202799A (en) Learning system using communication network
CN112114770A (en) Interface guiding method, device and equipment based on voice interaction
CN112565912B (en) Video call method and device, electronic equipment and readable storage medium
KR102485507B1 (en) Method and apparatus for providing online lecture contents
JP2022051500A (en) Related information provision method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210105

Address after: 200030 unit 01, room 801, 166 Kaibin Road, Xuhui District, Shanghai

Applicant after: Shanghai Ping An Education Technology Co.,Ltd.

Address before: 152, 86 Tianshui Road, Hongkou District, Shanghai

Applicant before: TUTORABC NETWORK TECHNOLOGY (SHANGHAI) Co.,Ltd.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20221129

Address after: 4 / F, Times financial center, 4001 Shennan Avenue, Futian District, Shenzhen, Guangdong 518000

Applicant after: PING'AN ZHITONG CONSULTING Co.,Ltd.

Address before: 200030 unit 01, room 801, 166 Kaibin Road, Xuhui District, Shanghai

Applicant before: Shanghai Ping An Education Technology Co.,Ltd.

TA01 Transfer of patent application right