CN113096695B

CN113096695B - Contrast display method and device for contrast display

Info

Publication number: CN113096695B
Application number: CN202010023017.4A
Authority: CN
Inventors: 王宁
Original assignee: Beijing Sogou Technology Development Co Ltd
Current assignee: Beijing Sogou Technology Development Co Ltd
Priority date: 2020-01-09
Filing date: 2020-01-09
Publication date: 2022-10-14
Anticipated expiration: 2040-01-09
Also published as: CN113096695A

Abstract

The embodiment of the invention provides a contrast display method and device and a device for contrast display. The method specifically comprises the following steps: receiving a first input for adjusting a current progress during playing of the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content; responding to the first input, and acquiring the adjustment progress of the first input; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text. The embodiment of the invention can synchronously adjust the audio and the text under the condition that the playing progress of the audio or the displaying progress of the text is changed, so as to improve the accuracy of displaying the text corresponding to the audio.

Description

Contrast display method and device for contrast display

Technical Field

The invention relates to the technical field of computers, in particular to a contrast display method and device and a device for contrast display.

Background

In practical applications, it is often the case that audio is converted into text, and the audio and the text are displayed in contrast. For example, during the process of playing a song using the electronic device, lyrics corresponding to currently played content may be synchronously displayed on a playing interface of the song so that a user may view the currently played audio content in contrast.

However, during the playing of the audio, the user may change the playing progress of the audio by dragging the progress bar of the audio, or may drag the currently displayed lyrics to change the display progress of the lyrics. However, it may happen that the currently played audio content and the currently displayed text cannot be updated synchronously in real time, or the audio content and the text content do not correspond to each other, which causes inaccurate text display and brings inconvenience to the user.

Disclosure of Invention

The embodiment of the invention provides a contrast display method and device and a contrast display device, which can synchronously adjust audio and text under the condition that the playing progress of the audio or the display progress of the text is changed, so as to improve the accuracy of displaying the text corresponding to the audio.

In order to solve the above problem, an embodiment of the present invention discloses a contrast display method, including:

receiving a first input for adjusting a current progress during playing of the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content; responding to the first input, and acquiring the adjustment progress of the first input; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

On the other hand, the embodiment of the invention discloses a contrast display device, which comprises:

the progress adjusting module is used for receiving a first input for adjusting the current progress in the process of playing the multimedia content; wherein the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

the progress determining module is used for responding to the first input and acquiring the adjustment progress of the first input;

and the synchronous updating module is used for synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

In yet another aspect, an embodiment of the present invention discloses an apparatus for contrasting displays, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by the one or more processors, the one or more programs including instructions for:

receiving a first input for adjusting a current progress during playing of the multimedia content; wherein the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

responding to the first input, and acquiring the adjustment progress of the first input;

and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

In yet another aspect, an embodiment of the present invention discloses a machine-readable medium having instructions stored thereon, which when executed by one or more processors, cause an apparatus to perform a cross-display method as described in one or more of the preceding.

The embodiment of the invention has the following advantages:

in the process of playing the multimedia content, a first input for adjusting the current progress can be received, wherein the first input can be used for adjusting the current playing progress of the multimedia content or contrasting the current display progress of a text to obtain the adjustment progress; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

Because the total duration of the multimedia content and the total length of the contrast text have a corresponding relation, the corresponding relation between each playing time point in the multimedia content and the text position in the contrast text can be known according to the corresponding relation. Therefore, in the process of playing the multimedia content, the playing progress of the multimedia content and the display progress of the contrast text can be synchronously adjusted under the condition that the playing progress of the multimedia content or the display progress of the contrast text changes, so that the condition that the currently played multimedia content and the currently displayed text do not correspond to each other can be avoided, the accuracy of displaying the text corresponding to the audio/video is improved, and the synchronous playing and displaying of the sound and the characters are realized.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.

FIG. 1 is a flow chart of the steps of one embodiment of a comparative display method of the present invention;

FIG. 2 is a schematic view of a display interface of an electronic device of the present invention;

FIG. 3 is a schematic view of another electronic device display interface of the present invention;

FIG. 4 is a block diagram of a control display device according to an embodiment of the present invention;

FIG. 5 is a block diagram of an apparatus 800 for contrasting displays of the present invention; and

fig. 6 is a schematic diagram of a server in some embodiments of the invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.

Method embodiment

Referring to fig. 1, a flowchart illustrating steps of an embodiment of a contrast display method according to the present invention is shown, which may specifically include the following steps:

step 101, receiving a first input for adjusting the current progress in the process of playing the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

step 102, responding to the first input, and acquiring the adjustment progress of the first input;

and 103, synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

The contrast display method of the embodiment of the invention can be applied to electronic equipment, and the electronic equipment comprises but is not limited to: a server, a smart phone, a recording pen, a tablet computer, an e-book reader, an MP3 (moving Picture Experts Group Audio Layer III) player, an MP4 (moving Picture Experts Group Audio Layer IV) player, a laptop, a vehicle-mounted computer, a desktop computer, a set-top box, an intelligent tv, a wearable device, etc.

In an optional embodiment of the present invention, the multimedia content may include audio content, and the comparison text may include text information obtained by performing speech recognition on the audio content

Wherein the audio content may be a continuous piece of speech, such as a sentence, a speech, a song, a voiced story, etc. The source of the audio content is not limited by the embodiment of the present invention. For example, the audio content may be a voice segment collected in real time by a recording function of the electronic device; alternatively, the audio content may be a recorded voice clip played back by the electronic device, or the audio content may be an audio file downloaded from a network, such as a song, a vocal story, or the like; alternatively, the audio content may also be voice information or the like input or transmitted or received by the user through the instant messaging application.

It is understood that the specific type of the multimedia content is not limited by the embodiments of the present invention, for example, the multimedia content may further include video content, task reminders, classroom notes, reporter interviews, meeting records, literature creation, electronic diary, and the like.

The control text may be text information matching the multimedia content. For example, for audio content, the control text may be text information obtained by performing speech recognition on the audio content. For video content, audio content in the video content can be extracted first, and then voice recognition is performed on the extracted audio content to obtain a comparison text.

And in the process of playing the multimedia content through the electronic equipment, the contrast text can be synchronously displayed for the user to view in contrast. During the playing of the multimedia content through the electronic device, a first input for adjusting a current progress may be received; wherein the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content. It is understood that the operation type of the first input is not limited by the embodiment of the present invention. For example, the first input may be a drag operation, a click operation, or the like, for a progress bar for playing the multimedia content, so as to adjust a current playing progress of the multimedia content; or, the first input may be a drag, click, or the like operation on the display content of the comparison text to adjust the current display progress of the comparison text. After receiving the first input, the embodiment of the present invention may obtain an adjustment progress of the first input. For example, the current playing progress after the progress bar of the multimedia content is dragged is obtained, or the current display progress after the content is dragged and displayed against the text is obtained. In addition, the embodiment of the invention can also establish the corresponding relation between the total duration of the multimedia content and the total length of the contrast text, so that when a first input of the user for adjusting the current progress is received, the playing progress of the multimedia content and the display progress of the contrast text can be synchronously updated according to the adjusted progress and the corresponding relation, and the condition that the currently played multimedia content and the currently displayed text do not correspond to each other is avoided.

In an optional embodiment of the present invention, the synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and a corresponding relationship between the total duration of the multimedia content and the total length of the comparison text may specifically include:

step S11, determining a first playing time point in the multimedia content corresponding to the adjusting progress and a first position in the contrast text corresponding to the adjusting progress according to the corresponding relation between the total duration of the multimedia content and the total length of the contrast text;

and S12, playing the multimedia content according to the first playing time point, and displaying text information corresponding to the first position in the comparison text.

Specifically, according to the correspondence between the total length of the multimedia content and the total length of the comparison text, the correspondence between each playing time point in the multimedia content and the text position in the comparison text can be obtained, so that, when a certain playing time point (first playing time point) in the multimedia content is determined, the specific position (first position) corresponding to the playing time point in the comparison text can be determined, and further, the text information corresponding to the first position can be obtained. And playing the multimedia content according to the first playing time point, and displaying the text information corresponding to the first position in the comparison text, so that the synchronous updating of the playing progress of the multimedia content and the displaying progress of the comparison text can be realized.

Assuming that the total duration of the multimedia content is T (seconds), the total length of the contrast text is L (bytes), and the first playing time point is T (seconds), the first position p (bytes) can be calculated by the following formula:

p＝(t×L)/T (1)

similarly, when a specific position in the reference text is determined, a specific playing time point corresponding to the position in the multimedia content can be determined. That is, in the case where the first position p is known, the first play time point t may be calculated by:

t＝(p×T)/L (2)

therefore, under the condition of changing the current playing progress (first playing time point) of the multimedia content, the corresponding text position can be accurately positioned in the contrast text; or, under the condition of changing the display progress (first position) of the contrast text, the corresponding playing time point can be accurately positioned in the multimedia content, thereby realizing the synchronous contrast display of the multimedia content and the corresponding text information and realizing the synchronization of the sound and the characters.

In an application example of the present invention, it is assumed that the multimedia content currently played by the electronic device is song a, and the total duration of song a is 3 minutes and 35 seconds (215 seconds). And synchronously displaying the corresponding contrast text of the song A in the process of playing the song A, namely synchronously displaying the lyrics corresponding to the song A, wherein the total length of the lyrics is 448 bytes.

Assuming that the current playing progress of the song a is 1 minute and 20 seconds (80 seconds), that is, the current playing time point of the song a is 80 seconds, at this time, a first input of a user adjusting the current playing progress is received, for example, the first input is a progress bar dragging the song a, and the adjustment progress obtained by the first input is 2 minutes and 15 seconds (135 seconds), that is, the adjusted first playing time point is 135 seconds. According to the corresponding relation between the total length of the song A and the total length of the lyrics, the first position p in the song A corresponding to the adjustment progress can be determined as follows by the formula (1): (135 seconds × 448 bytes)/215 seconds =280 bytes.

Therefore, when the user drags the progress bar of the song a to the playing progress of 135 seconds, the song a can be played from the playing progress of 135 seconds, and meanwhile, after the current playing progress is determined to be changed according to the above expression (1), the corresponding first position p in the lyrics of the progress is adjusted to be 280 bytes, and then the currently displayed lyrics content can be updated to the lyrics content from the position of the 280 bytes.

It should be noted that the first input may be used to adjust a playing progress of the multimedia content or a display progress of the comparison text, that is, the first input may be an operation of adjusting a progress bar of the multimedia content or an operation of adjusting currently displayed text information. In the above example, the current progress can be adjusted by dragging the currently displayed lyric content, and the play time point in the multimedia content can be located by the above formula (2) under the condition that the progress of the displayed text information changes, so that under the condition that any one of the multimedia play content or the text information changes, the other one can realize automatic comparison and update, the synchronous display of the song a and the lyrics can be realized, and the condition that the sound and the text do not correspond to each other under the condition that the current progress is adjusted is avoided.

In an optional embodiment of the present invention, the adjusting the progress may specifically include: a real-time adjustment progress obtained during execution of the first input, or a target adjustment progress obtained after execution of the first input is completed.

In practical application, when a user adjusts the current playing progress of multimedia content, the user can drag the sliding block in the progress bar, and does not loosen the sliding block in the dragging process until the sliding block is dragged to a target position. Likewise, when adjusting the current display progress of the contrast text, the user may drag the currently displayed text content without loosing hands until the desired text content is dragged. It can be seen that, in the process of adjusting the current progress by the user through the first input, the current progress (the current playing progress of the multimedia content or the current display progress of the contrast text) changes in real time during the execution of the first input, until the current progress does not change after the execution of the first input is finished. Therefore, the embodiment of the present invention may obtain a real-time adjustment progress obtained in the process of executing the first input, or obtain a target adjustment progress obtained after the execution of the first input is finished.

In an optional embodiment of the present invention, the synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and a corresponding relationship between the total duration of the multimedia content and the total length of the comparison text specifically may include:

in the process of executing the first input, synchronously updating the playing progress of the multimedia content and the display progress of the contrast text in real time according to the acquired real-time adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text; or

After the execution of the first input is finished, synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the target adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

For synchronously updating the playing progress of the multimedia content and the display progress of the contrast text, the embodiment of the invention can provide two synchronous updating modes. One is to update in real time during execution of the first input, and the other is to update after execution of the first input is finished.

In an application example of the present invention, during playing multimedia content, the electronic device may synchronously display the contrast text of the multimedia content. In the process of playing the multimedia content, the electronic device may receive a dragging operation of a progress bar of the multimedia content by a user to change a current playing progress. In the execution process of the dragging operation, the real-time adjustment progress of the dragging operation can be acquired, and the playing progress of the multimedia content and the display progress of the contrast text are synchronously updated in real time according to the acquired real-time adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text. Therefore, in the process of receiving the progress bar of the multimedia content and executing the dragging operation, the playing progress of the multimedia content and the display progress of the comparison text can be synchronously updated, and a user can conveniently know whether the current dragging progress meets the self requirement in real time.

Likewise, in the process of playing the multimedia content, the electronic device may receive a user's drag operation for the displayed content of the contrast text to change the current display progress. In the execution process of the dragging operation, the real-time adjustment progress of the dragging operation can be acquired, and the playing progress of the multimedia content and the display progress of the contrast text are synchronously updated in real time according to the acquired real-time adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text. Therefore, in the process of receiving the dragging operation executed aiming at the contrast text of the multimedia content, the playing progress of the multimedia content and the display progress of the contrast text can be synchronously updated, and a user can conveniently know whether the current dragging progress meets the self requirement in real time.

In another application example of the present invention, during the process of playing the multimedia content, the electronic device may synchronously display the contrast text of the multimedia content. In the process of playing the multimedia content, the electronic device may receive a dragging operation of a progress bar of the multimedia content by a user to change a current playing progress. After the dragging operation is finished (for example, after the slider is loosened), the target adjustment progress of the dragging operation (for example, the playing progress corresponding to the position where the slider is located after the slider is loosened) can be obtained, and the playing progress of the multimedia content and the display progress of the contrast text are synchronously updated according to the obtained target adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

Likewise, in the process of playing the multimedia content, the electronic device may receive a user's drag operation for the displayed content of the contrast text to change the current display progress. According to the embodiment of the invention, after the dragging operation is finished, the target adjustment progress of the dragging operation can be obtained, and the playing progress of the multimedia content and the display progress of the contrast text are synchronously updated according to the obtained target adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

In an optional embodiment of the present invention, the playing interface of the multimedia content may include a first area and a second area, where the first area is used to display a current playing progress of the multimedia content, and the second area is used to display text information corresponding to the playing progress in the comparison text.

It should be noted that, the embodiment of the present invention does not limit the expression manner of the playing progress of the multimedia content. For example, the current playing progress may be represented by displaying the position of the slider in the progress bar; the current playing progress can also be represented by displaying the current playing time point and the total duration of the multimedia content; and under the condition that the multimedia content is audio content, the current playing progress and the like can be represented by displaying the frequency spectrum information of the audio.

In the process of playing the multimedia content, the embodiment of the invention can display the current playing progress of the multimedia content in the first area and display the text information corresponding to the playing progress in the contrast text in the second area. In this way, the user can more intuitively know the current playing progress of the multimedia content through the display contents of the first area and the second area, and can view the corresponding text information in a contrast manner.

In an optional embodiment of the present invention, the playing interface of the multimedia content may further include a third area, where the third area may be used to display a current playing time point of the multimedia content, and optionally, the third area may also display a total duration of the multimedia content, so that a user may know, in real time, time information of playing the multimedia content through the content displayed in the third area during the process of playing the multimedia content through the electronic device, for example, how long the multimedia content is played. In addition, a series of operations of checking the multimedia file, editing the multimedia file, searching corresponding contents in the multimedia file and the like can be facilitated for the user, and the operation efficiency of the user is improved.

Referring to fig. 2, a schematic diagram of a display interface of an electronic device 201 according to an embodiment of the present invention is shown. As shown in fig. 2, the display interface of the electronic device 201 includes a first region 2011, a second region 2012, and a third region 2013. The progress bar of the currently playing audio content displayed in the first area 2011 may be used to indicate the current playing progress of the audio content. Displayed in the second region 2012 is text information corresponding to the current playing progress of the audio content. Displayed in the third region 2013 are the current playing time point (01).

The first region, the second region, and the third region may be any display regions in a display interface of an electronic device, and the position, the shape, and the display mode of the first region, the second region, and the third region are not limited in the embodiment of the present invention. For example, the first region, the second region, and the third region may be independent display regions, or may be display regions partially or entirely overlapped with each other. For example, when the multimedia content is a video content, the first area may coincide with the second area, for example, the second area may be located in the first area, and of course, the third area may also be located in the first area, and so on.

Embodiments of the present invention may provide the following three alternatives for adjusting the current schedule.

Scheme one

And adjusting the current playing progress of the multimedia content by triggering the progress bar displayed in the first area.

In an optional embodiment of the present invention, the receiving a first input for adjusting the current progress may specifically include: receiving a first operation triggered by the progress bar displayed in the first area;

the obtaining of the adjustment progress of the first input in response to the first input may specifically include: determining an adjustment progress of the first input according to a first adjustment position of the first operation in the progress bar.

The first operation is an adjusting operation triggered by the progress bar displayed in the first area, and a first adjusting position of the first operation in the progress bar can be obtained after the first operation is triggered. The first operation may include any operation such as dragging, sliding, clicking, and the like. For example, the first operation may be a forward or backward sliding progress block, and a position of the progress block after sliding in the progress bar is a first adjustment position of the first operation in the progress bar. Or, the first operation may also be an operation of clicking a certain position in the progress bar, where the clicked position is a first adjustment position of the first operation in the progress bar. From the first adjustment position, an adjustment progress of the first input may be determined.

After the current playing progress of the progress bar in the first region is changed, the text information displayed in the second region may be updated, so that the text information in the second region is automatically and synchronously displayed according to the change of the playing progress of the multimedia content in the first region. Therefore, the sound change and the automatic character synchronization are realized.

Optionally, after the current playing progress of the progress bar in the first area is changed, the current playing time point displayed in the third area may also be updated, so that the display contents in the three areas are automatically and synchronously updated.

Referring to fig. 3, a schematic diagram of another electronic device display interface according to an embodiment of the invention is shown. The display interface in fig. 3 is obtained by dragging the progress bar in the first area 2011 in fig. 2 and then updating the display interface in fig. 2. As shown in fig. 3, after the progress bar in the first area 2011 of fig. 2 is dragged, the progress bar displayed in the first area 3011 of fig. 3 can be obtained. According to the adjustment operation of the progress bar in the first region 2011 in fig. 2, the adjustment progress displayed in the first region 3011 in fig. 3 can be obtained, and the contents displayed in the second region 2012 and the third region 2013 in fig. 2 are synchronously updated according to the adjustment progress, so that the text information displayed in the second region 3012 and the current playing time point displayed in the third region 3012 shown in fig. 3 can be obtained (01.

Scheme two

And adjusting the current display progress of the control text by triggering the text information displayed in the second area.

In an optional embodiment of the present invention, the receiving a first input for adjusting the current progress may specifically include: receiving a second operation triggered by the text information displayed in the second area;

the obtaining the adjustment progress of the first input in response to the first input may specifically include: and determining the adjustment progress of the first input according to a second adjustment position of the second operation in the text message.

The second operation may be an adjustment operation triggered by the text information displayed in the second area, and a second adjustment position of the second operation in the text information may be obtained after the second operation is triggered. The second operation may include any operation such as dragging, sliding, clicking, and the like. For example, the second operation may be dragging text information displayed in the second area forwards or backwards, where a text position where a cursor is located after dragging is a second adjustment position of the second operation in the text information. From the second adjustment position, the adjustment progress of the first input may be determined.

Still taking the above example as an example, assume that the multimedia content being played by the electronic device is song a (the total duration is 215 seconds), and the lyrics corresponding to song a (the total length is 448 bytes) are synchronously displayed. Assuming that the current playing progress of the song a is 80 seconds, that is, the current playing time point of the song a is 80 seconds, at this time, a first input of adjusting the current progress by the user is received, and if the first input is an operation of dragging text information displayed in the second area backwards, the text position (the second adjustment position) where the cursor is located after dragging is 324 bytes. Taking the second adjustment position as the first position p, according to the above formula (2), the first playing time point t can be determined as: (324 bytes × 215 seconds)/448 bytes =155 seconds.

The adjustment progress is 155 seconds according to the first playing time point t. Therefore, when receiving the text information corresponding to the position where the user drags the text information displayed in the second area to 324 bytes, the first playing time point in the multimedia content can be accurately positioned according to the change of the text information display progress, and the multimedia content is played according to the first playing time point for 155 seconds, so that the character change is realized, and the sound is automatically synchronized.

Optionally, after the display progress of the text information in the second region is changed, the current playing time point displayed in the third region may be updated, so that the display contents in the three regions are automatically updated in synchronization.

Scheme three

And adjusting the current progress by changing the playing time point displayed in the third area.

In an optional embodiment of the invention, the method may further comprise:

step S21, receiving a second input for adjusting the playing time point;

and S22, synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the updating time point obtained by the second input and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

The second input may be an adjustment operation triggered by the playing time point displayed in the third region, and the updated time point obtained after the second input triggers the current playing time point may be obtained after the second input triggers the current playing time point. The second input may comprise any operation of clicking, sliding, editing, etc. For example, the second input may be sliding the playing time point displayed in the third area forward or backward, and the updated time point is obtained after sliding. Alternatively, the second input may be editing the current time point to modify the current time point to obtain an updated time point. According to the updating time point and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text, the playing progress of the multimedia content and the display progress of the contrast text can be synchronously updated. For example, assuming that the current playing time point is 1 minute 20 seconds, and the updating time point is 2 minutes 50 seconds by sliding the playing time point backwards, the current playing progress of the multimedia content can be directly jumped to 2 minutes 50 seconds, and the first position of the 2 minutes 50 seconds in the contrast text is determined according to the corresponding relationship between the total duration of the multimedia content and the total length of the contrast text, so that the display progress of the contrast text can be synchronously updated according to the first position.

After the playing time point in the third area is changed, the embodiment of the present invention may also automatically and synchronously update the contents displayed in the first area and the second area according to the adjusted updating time point, thereby implementing the change of the current playing time point and the automatic synchronization of the sound and the characters.

To sum up, in the process of playing the multimedia content, the embodiment of the present invention may receive a first input for adjusting the current progress, where the first input may be used to adjust the current playing progress of the multimedia content or obtain an adjustment progress by referring to the current display progress of the text; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those of skill in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the embodiments of the invention.

Device embodiment

Referring to fig. 4, a block diagram of a contrast display device according to an embodiment of the present invention is shown, where the device may specifically include:

a progress adjustment module 401, configured to receive a first input for adjusting a current progress in a process of playing the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

a progress determination module 402, configured to, in response to the first input, obtain an adjustment progress of the first input;

and a synchronous updating module 403, configured to synchronously update the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and a corresponding relationship between the total duration of the multimedia content and the total length of the comparison text.

Optionally, the adjusting the progress comprises: the real-time adjustment progress obtained in the process of executing the first input, or the target adjustment progress obtained after the execution of the first input is finished.

Optionally, the synchronous updating module 403 may specifically include:

the first updating sub-module is used for synchronously updating the playing progress of the multimedia content and the display progress of the contrast text in real time according to the acquired real-time adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text in the first input execution process; or alternatively

And the second updating submodule is used for synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the target adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text after the execution of the first input is finished.

Optionally, the synchronous updating module 403 may specifically include:

the content determining submodule is used for determining that the adjusting progress corresponds to a first playing time point in the multimedia content and the adjusting progress corresponds to a first position in the contrast text according to the corresponding relation between the total duration of the multimedia content and the total length of the contrast text;

and the synchronous updating submodule is used for playing the multimedia content according to the first playing time and displaying the text information corresponding to the first position in the comparison text.

Optionally, the playing interface of the multimedia content includes a first area and a second area, where the first area is used to display a current playing progress of the multimedia content, and the second area is used to display text information corresponding to the playing progress in the comparison text.

Optionally, the progress adjusting module 401 may specifically include:

the first receiving submodule is used for receiving a first operation triggered by a progress bar displayed in the first area, and the progress bar is used for displaying the current playing progress of the multimedia content; alternatively, the first and second electrodes may be,

and the second receiving submodule is used for receiving a second operation triggered by the text information displayed in the second area.

Optionally, the playing interface of the multimedia content further includes a third area, where the third area is used to display a current playing time point of the multimedia content; the apparatus may further include:

the time updating module is used for receiving a second input used for adjusting the playing time point;

and the content updating module is used for synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the updating time point obtained by the second input and the corresponding relation between the total duration of the multimedia content and the total length of the comparison text.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are all described in a progressive manner, and each embodiment focuses on differences from other embodiments, and portions that are the same and similar between the embodiments may be referred to each other.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

An embodiment of the present invention provides an apparatus for contrasting a display, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by one or more processors comprise instructions for: receiving a first input for adjusting a current progress during playing of the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content; responding to the first input, and acquiring the adjustment progress of the first input; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

FIG. 5 is a block diagram illustrating an apparatus 800 for contrasting displays according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

Referring to fig. 5, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.

The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 806 provides power to the various components of the device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.

The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice information processing mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on radio frequency information processing (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Fig. 6 is a schematic diagram of a server in some embodiments of the invention. The server 1900, which may vary considerably in configuration or performance, may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a sequence of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.

The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform the cross-display method shown in fig. 1.

A non-transitory computer readable storage medium in which instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform a cross-display method, the method comprising: receiving a first input for adjusting a current progress in a process of playing multimedia content; wherein the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content; responding to the first input, and acquiring the adjustment progress of the first input; and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

The embodiment of the invention discloses A1, a contrast display method, which comprises the following steps:

receiving a first input for adjusting a current progress in a process of playing multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

A2, according to the method in A1, the adjusting progress comprises: the real-time adjustment progress obtained in the process of executing the first input, or the target adjustment progress obtained after the execution of the first input is finished.

A3, according to the method described in the step A2, the step of synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the contrast text comprises the steps of:

After the execution of the first input is finished, synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the target adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

A4, according to the method of A1, synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the comparison text, including:

according to the corresponding relation between the total duration of the multimedia content and the total length of the contrast text, determining that the adjustment progress corresponds to a first playing time point in the multimedia content and the adjustment progress corresponds to a first position in the contrast text;

and playing the multimedia content according to the first playing time point, and displaying text information corresponding to the first position in the comparison text.

A5, according to the method in A1, a playing interface of the multimedia content comprises a first area and a second area, wherein the first area is used for displaying the current playing progress of the multimedia content, and the second area is used for displaying text information corresponding to the playing progress in the contrast text.

A6, according to the method in A5, the receiving a first input for adjusting the current progress includes:

receiving a first operation triggered by a progress bar displayed in the first area, wherein the progress bar is used for displaying the current playing progress of the multimedia content; alternatively, the first and second electrodes may be,

receiving a second operation triggered by the text information displayed in the second area.

A7, according to the method in A5, a third area is further included in the playing interface of the multimedia content, and the third area is used for displaying the current playing time point of the multimedia content; the method further comprises the following steps:

receiving a second input for adjusting the playing time point;

and synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the updating time point obtained by the second input and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text.

The embodiment of the invention discloses B8, a contrast display device, which comprises:

and the synchronous updating module is used for synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the comparison text.

B9, according to the device of B8, the adjusting progress comprises the following steps: a real-time adjustment progress obtained during execution of the first input, or a target adjustment progress obtained after execution of the first input is completed.

B10, according to the apparatus in B9, the synchronous update module includes:

a first updating submodule, configured to synchronously update the playing progress of the multimedia content and the display progress of the comparison text in real time according to the obtained real-time adjustment progress and a corresponding relationship between the total duration of the multimedia content and the total length of the comparison text in the process of executing the first input; or

And the second updating sub-module is used for synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the target adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text after the execution of the first input is finished.

B11, the apparatus according to B8, the synchronous update module comprising:

and the synchronous updating sub-module is used for playing the multimedia content according to the first playing time and displaying the text information corresponding to the first position in the comparison text.

And B12, according to the device in B8, a playing interface of the multimedia content comprises a first area and a second area, wherein the first area is used for displaying the current playing progress of the multimedia content, and the second area is used for displaying text information corresponding to the playing progress in the contrast text.

B13, according to the device of B12, the progress adjusting module comprises:

B14, according to the device in B12, a third area is further included in the playing interface of the multimedia content, and the third area is used for displaying the current playing time point of the multimedia content; the device further comprises:

The embodiment of the invention discloses C15, a device for contrasting display, which comprises a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by one or more processors and comprise instructions for:

receiving a first input for adjusting a current progress during playing of the multimedia content; the current progress comprises the current playing progress of the multimedia content and/or the current display progress of contrast text of the multimedia content;

C16, according to the device of C15, the adjustment progress comprises: the real-time adjustment progress obtained in the process of executing the first input, or the target adjustment progress obtained after the execution of the first input is finished.

C17, according to the apparatus in C16, the synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the comparison text includes:

C18, according to the apparatus described in C15, the synchronously updating the playing progress of the multimedia content and the display progress of the comparison text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the comparison text, includes:

And C19, according to the device in C15, a playing interface of the multimedia content comprises a first area and a second area, wherein the first area is used for displaying the current playing progress of the multimedia content, and the second area is used for displaying text information corresponding to the playing progress in the contrast text.

C20, the apparatus according to C19, the receiving a first input for adjusting the current progress, including:

receiving a first operation triggered by a progress bar displayed in the first area, wherein the progress bar is used for displaying the current playing progress of the multimedia content; alternatively, the first and second liquid crystal display panels may be,

C21, according to the apparatus described in C19, a third area is further included in the playing interface of the multimedia content, where the third area is used to display the current playing time point of the multimedia content; the device is also configured to execute, by one or more processors, the one or more programs including instructions for:

receiving a second input for adjusting the playing time point;

The embodiment of the invention discloses a D22, a machine readable medium with instructions stored thereon, which when executed by one or more processors, causes an apparatus to perform a contrast display method as described in one or more of A1 to A7.

Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and should not be taken as limiting the scope of the present invention, which is intended to cover any modifications, equivalents, improvements, etc. within the spirit and scope of the present invention.

The contrast display method, the contrast display device and the device for contrast display provided by the present invention are described in detail above, and specific examples are applied herein to illustrate the principle and the implementation of the present invention, and the description of the above examples is only used to help understand the method of the present invention and the core idea thereof; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A contrast display method, comprising:

responding to the first input, and acquiring the adjustment progress of the first input; the adjustment schedule includes: obtaining a real-time adjustment progress in the process of executing the first input, or obtaining a target adjustment progress after the execution of the first input is finished;

according to the adjustment progress and the corresponding relation between the total duration of the multimedia content and the total length of the comparison text, synchronously updating the playing progress of the multimedia content and the display progress of the comparison text;

the method for adjusting the current progress of the multimedia content includes the following steps that:

receiving a second operation triggered by the text information displayed in the second area;

wherein, the synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the contrast text comprises:

when the first input is used for adjusting the current playing progress of the multimedia content, taking the current playing progress as a first playing time point corresponding to the adjustment progress in the multimedia content, calculating a first product of the first playing time point and the total length of the contrast text, and taking a first numerical value obtained by dividing the first product by the total length of the multimedia content as a first position corresponding to the adjustment progress in the contrast text;

when the first input is used for adjusting the current display progress of contrast texts of the multimedia content, taking the current display progress of the contrast texts as a first position in the contrast texts corresponding to the adjustment progress, calculating a second product of the first position and the total duration of the multimedia content, and taking a second value obtained by dividing the second product by the total length of the contrast texts as a first playing time point in the multimedia content corresponding to the adjustment progress;

2. The method according to claim 1, wherein the synchronously updating the playing progress of the multimedia content and the displaying progress of the comparison text according to the adjustment progress and the corresponding relationship between the total duration of the multimedia content and the total length of the comparison text further comprises:

3. The method according to claim 1, wherein the playing interface of the multimedia content further comprises a third area, and the third area is used for displaying a current playing time point of the multimedia content; the method further comprises the following steps:

receiving a second input for adjusting the playing time point;

4. A contrasting display device, the device comprising:

the progress determining module is used for responding to the first input and acquiring the adjustment progress of the first input; the adjustment schedule includes: obtaining a real-time adjustment progress in the process of executing the first input, or obtaining a target adjustment progress after the execution of the first input is finished;

the synchronous updating module is used for synchronously updating the playing progress of the multimedia content and the display progress of the contrast text according to the adjusting progress and the corresponding relation between the total duration of the multimedia content and the total length of the contrast text;

the playing interface of the multimedia content comprises a first area and a second area, wherein the first area is used for displaying the current playing progress of the multimedia content, the second area is used for displaying text information corresponding to the playing progress in the contrast text, and the progress adjusting module comprises:

a second receiving submodule, configured to receive a second operation triggered for the text information displayed in the second area;

wherein, the synchronous update module comprises:

a content determination submodule, configured to, when the first input is used to adjust a current playing progress of the multimedia content, use the current playing progress as a first playing time point in the multimedia content corresponding to the adjustment progress, calculate a first product of the first playing time point and a total length of the comparison text, and use a first numerical value obtained by dividing the first product by a total length of the multimedia content as a first position in the comparison text corresponding to the adjustment progress; when the first input is used for adjusting the current display progress of contrast texts of the multimedia content, taking the current display progress of the contrast texts as a first position in the contrast texts corresponding to the adjustment progress, calculating a second product of the first position and the total duration of the multimedia content, and taking a second numerical value obtained by dividing the second product by the total length of the contrast texts as a first playing time point in the multimedia content corresponding to the adjustment progress;

5. The apparatus of claim 4, wherein the synchronization update module further comprises:

6. The device according to claim 4, further comprising a third area in the playing interface of the multimedia content, wherein the third area is used for displaying a current playing time point of the multimedia content; the device further comprises:

7. An apparatus for contrasting display, comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein execution of the one or more programs by the one or more processors comprises instructions for performing the contrasting display method of any one of claims 1-3.

8. A machine readable medium having stored thereon instructions which, when executed by one or more processors, cause an apparatus to perform the contrasting display method of any of claims 1 to 3.