CN111190518B - Interaction method and device between first screen and second screen, terminal and storage medium - Google Patents
Interaction method and device between first screen and second screen, terminal and storage medium Download PDFInfo
- Publication number
- CN111190518B CN111190518B CN201911395256.6A CN201911395256A CN111190518B CN 111190518 B CN111190518 B CN 111190518B CN 201911395256 A CN201911395256 A CN 201911395256A CN 111190518 B CN111190518 B CN 111190518B
- Authority
- CN
- China
- Prior art keywords
- interface
- audio
- interactive
- user operation
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/7834—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using audio features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/018—Audio watermarking, i.e. embedding inaudible data in the audio signal
Abstract
The embodiment of the application provides an interaction method, an interaction device, a terminal and a storage medium between a first screen and a second screen. The method comprises the following steps: the client displays first prompt information for prompting a user to participate in interaction; the first prompt message is positioned on a part of a first interface currently displayed by the client; receiving an input first user operation; the first user operation is an operation input according to the first prompt information; the client receives the sound of an audio-visual signal played by another device, the audio-visual signal is embedded with an audio watermark in advance, and the audio watermark is extracted from the sound; and the client displays a second interface, wherein the second interface is an interactive interface corresponding to the audio watermark. By adopting the scheme in the embodiment of the application, the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Description
Technical Field
The present application relates to the field of converged media technologies, and in particular, to an interaction method, an interaction device, a terminal, and a storage medium between a first screen and a second screen.
Background
Two main modes of the current two-screen interaction are two, namely two-dimensional code shaking and WeChat shaking. The two-dimension code means that a user enters an interactive page for program interaction by scanning the two-dimension code displayed on a screen. The shaking of the WeChat means that the user enters the shaking of the WeChat and selects the television, and then the heard television program is identified, so that the user enters an interaction page corresponding to the television program to perform program interaction.
In the process of realizing the application, the inventor thinks that in two interactive forms in the prior art, the interactive security realized through the two-dimensional code is general, needs the user to press close to the screen for scanning, and the recognition accuracy is not high, is difficult to match the problem of different screen sizes. In the scheme of shaking the WeChat, after the television program is identified, the corresponding interactive content is provided by the application, and the interactive data is not controlled by the producer of the broadcast program, so that the high-interaction form is not favorably and flexibly adjusted.
Disclosure of Invention
The embodiment of the application provides an interaction method, an interaction device, a terminal and a storage medium between a first screen and a second screen, which are used for solving at least one problem.
According to a first aspect of embodiments of the present application, there is provided an interaction method, including: the client displays first prompt information for prompting a user to participate in interaction; the first prompt message is positioned on a part of a first interface currently displayed by the client; receiving an input first user operation; the first user operation is an operation input according to the first prompt information; the client receives the sound of an audio-visual signal played by another device, the audio-visual signal is embedded with an audio watermark in advance, and the audio watermark is extracted from the sound; and the client displays a second interface, wherein the second interface is an interactive interface corresponding to the audio watermark.
According to a second aspect of embodiments of the present application, there is provided an interaction apparatus, including: the first display module is used for providing first prompt information for prompting a user to participate in interaction at the client; the first prompt message is positioned on a part of a first interface currently displayed by the client; the operation receiving module is used for receiving input first user operation; the first user operation is an operation input according to the first prompt information; the watermark extraction module is used for triggering the client to receive the sound of the audio-visual signal played by the other equipment, the audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound; and the display module is further used for providing a second interface at the client, and the second interface is an interactive interface corresponding to the audio watermark.
According to a third aspect of embodiments of the present application, there is provided a terminal, including: a display screen, a memory, one or more processors; and one or more modules stored in the memory and configured to be executed by the one or more processors, the one or more modules including instructions for performing the steps of the above-described method.
According to a fourth aspect of embodiments of the present application, there is provided a computer-readable storage medium having a computer program stored thereon; the computer program is executed by a processor to implement the above-described method.
By adopting the interaction method, the interaction device, the interaction terminal and the storage medium between the first screen and the second screen, which are provided by the embodiment of the application, the first prompt information prompting the user to participate in the interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 shows a schematic diagram of an interactive system architecture according to an embodiment of the present application;
FIG. 2 is a flow chart illustrating a method of interaction between a first screen and a second screen according to a first embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a first prompt message displayed in a first interface in the form of a picture;
FIG. 4 is a schematic diagram illustrating a first prompt message in the form of an icon displayed in the upper left corner of a first interface;
fig. 5 shows a flow chart of a method of interaction between a first screen and a second screen according to a second embodiment of the application;
FIG. 6 is a detailed diagram of the second prompt message;
FIG. 7 is a detailed view of a fourth interface when the interaction result is a questionnaire;
FIG. 8 is a flow chart illustrating a method of interaction between a first screen and a second screen according to a third embodiment of the present application;
fig. 9 is a schematic structural diagram of an interaction device between a first screen and a second screen according to a fourth embodiment of the present application;
fig. 10 shows a schematic structural diagram of a terminal according to a fifth embodiment of the present application.
Detailed Description
In the process of realizing the application, the inventor finds that in two interactive forms in the prior art, the interactive safety realized by the two-dimensional code is general, the user needs to be close to the screen for scanning, the recognition accuracy is not high, and the problem that different screen sizes are difficult to match is solved. The main problem of the WeChat shaking is that the interactive data is not controlled by the producer of the broadcast program.
In addition, the inventor finds that the accurate synchronization in real time cannot be achieved by the WeChat shaking, a huge voice recognition server and bandwidth investment are required, and congestion is easily caused at the peak.
In order to solve the above problem, the present application provides an interaction method, an interaction device, a client and a storage medium between a first screen and a second screen, wherein first prompt information prompting a user to participate in interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
The audio watermark realizes the bidirectional transmission of the broadcast television by connecting the App application program and the broadcast television program, can improve the consumption of the broadcast television content through the App program, increases the loyalty of the broadcast television, and can realize the interaction from a simple encyclopedia page to an action situation; for example, purchasing goods viewed on the home screen, auto-logging into a social network, ad targeting, etc., thereby also providing personalized, deeper level program interaction.
In order to make the technical solutions and advantages of the embodiments of the present application more apparent, the following further detailed description of the exemplary embodiments of the present application with reference to the accompanying drawings makes it clear that the described embodiments are only a part of the embodiments of the present application, and are not exhaustive of all embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Fig. 1 shows a schematic structural diagram of an interactive system according to an embodiment of the application.
As shown in fig. 1, an interactive system 100 according to an embodiment of the present application includes:
a program production end 101, a device 102, also called a first screen; client 103, also called a second screen.
In this embodiment, the program producing end 101 generally refers to a system (including a broadcasting system) before the program is distributed to the device 102 for broadcasting, and no further specific distinction is made in this embodiment. In practical implementation, the device 102 may be, for example, a device having a display screen and capable of playing audio and video signals, such as a television, a mobile phone, a tablet computer, and a portable computer, which is not limited in this application. In a specific implementation, the client 103 may be, for example, an APP client installed on a terminal that has a display screen and can receive user input, such as a mobile phone, a tablet computer, and a portable computer, which is not limited in this application.
An audio watermark is first embedded in the audio-visual signal by the programme production end before or during distribution.
For off-line embedding of files, the embedding can be completed by related software through plug-ins in a process or a non-programming system; the real-time SDI and AES streams can be directly embedded in a rebroadcasting vehicle and a broadcasting system. The embedding process also relies on a symmetric watermark key in order to secure the information. This unique private key is used at the embedding end while ensuring complete privacy and watermark information control at the decoding end. The embedded watermark has very good robustness and can continuously maintain good performance in the environments of post-processing, staring, digital network and the like.
It should be understood that, in the embodiment of the present application, both the implementation and the embedding of the audio watermark themselves can be implemented by using the prior art in the prior art, and the detailed description of the present application is omitted here.
In the process of playing programs by the equipment, prompt information for prompting a user to participate in interaction through a client, such as characters and the like, can be displayed at the same time; the client executes an interaction method between the first screen and the second screen according to the first embodiment of the application.
Example one
Fig. 2 shows a flowchart of an interaction method between a first screen and a second screen according to a first embodiment of the present application. As shown in fig. 2, an interaction method between a first screen and a second screen according to a first embodiment of the present application includes:
s201, a client displays first prompt information for prompting a user to participate in interaction; the first prompt message is located on a part of a first interface currently displayed by the client.
In specific implementation, the first prompt message may be displayed in the first interface in the form of a picture. Fig. 3 is a schematic diagram illustrating a first prompt message displayed in a first interface in the form of a picture. In fig. 3, the first prompt message is displayed in the first interface in parallel with other messages.
In specific implementation, the first prompt message may be displayed in the first interface in the form of an icon. For example, the upper left or right corner. It should be understood that the icon may also be displayed at other positions of the first interface, which is not limited in this application. Fig. 4 is a schematic diagram illustrating that the first prompt message is displayed in the form of an icon in the upper left corner of the first interface. In specific implementation, the icon may be an icon similar to "scan", "listen to one sound", "interact", or other form of icon provided in connection with a common metaphor form of an application client providing an interactive function; this is not limited by the present application.
S202, receiving an input first user operation; the first user operation is an operation input according to the first prompt information.
In specific implementation, when the first prompt message is a picture or an icon, the first user operation may be an operation of clicking the first prompt message; when the first prompt information is a prompt character, the first user operation may be a gesture or the like adapted to the prompt character; this is not limited by the present application.
S203, the client receives the sound of the audio-visual signal played by the device, the audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound.
In a specific implementation, the receiving, by the client, the sound of the audiovisual signal played by the device may specifically include: the client receives the sound of the audio-visual signal played by the other equipment through the terminal microphone.
In the implementation, before the client receives the sound of the audio-visual signal played by the device and extracts the audio watermark from the sound, the method further includes: and embedding an audio watermark decoding component in the application corresponding to the first interface. So that the application can effect decoding of the audio watermark.
In particular implementations, the audio watermark decoding component may be distributed in the form of a software development tool (SDK) that contains a library optimized for mobile devices to parse real-time information in broadcast audio content. Application creators can easily use the APIs in these libraries to create their own synchronization applications.
In the specific implementation, an audio watermark decoding component can be embedded in the client; but embedding in an application can achieve this functionality more conveniently and efficiently than embedding in a client. For example, in the form of an application upgrade.
In particular implementations, the audio watermark may include an identifier and a time code; the identifier is used to identify the program content and the time code is used for synchronization.
Specifically, in the embodiment of the present application, a 16-bit audio watermark may be adopted, which includes a 6-bit identifier (also called an identification code) and a 10-bit time code, and this configuration may achieve a maximum of 64 sets with 1 hour per set for 20 minutes of interaction.
And S204, displaying a second interface by the client, wherein the second interface is an interactive interface corresponding to the audio watermark.
In a specific implementation, after the client displays the second interface, the method may further include: receiving input third user operation, wherein the third user operation is interactive operation; and responding to the third user operation, and displaying a fourth interface, wherein the fourth interface comprises an interaction result.
In specific implementation, if the first interface is a traffic application main interface, the second interface may be a traffic safety questionnaire; if the first interface is the E-commerce application main interface, the second interface can be a commodity purchasing interface; if the first interface is a main interface of the video application, the second interface can be a forum or a bullet screen speaking interface.
Specifically, the user may trigger the reception of a sound of a program played in, for example, a television, such as a traffic public service advertisement, through a traffic application, such as a first prompt message (e.g., a moving picture) provided on a main interface of the taxi-taking software; and identifying the audio watermark in the advertisement, then triggering and displaying a traffic safety questionnaire interface, and enabling the user to participate in interaction by filling in the questionnaire.
The user may also trigger the reception of a sound of a program, e.g., a concert or a tv series, played in, e.g., a tv, via a first prompt message (e.g., listen-to-listen icon) provided on a main interface of a shopping software, e.g., naobao, kyoto, etc., by an e-commerce application; and identifying the audio watermark in the concert or television show, and then triggering and displaying a purchasing interface of clothes or accessory goods of a performer in the concert or television show, so that a user participates in interaction by viewing the goods or purchasing the goods.
The user may also trigger the reception of the sound of a program played in, for example, a television, such as a football or basketball game, etc., through a first prompt (e.g., an interactive icon) provided on a main interface of a video application, such as youku, a central television station, etc.; and identifies an audio watermark in a football or basketball game and then triggers an interactive interface (e.g., a forum or a bullet-screen speech interface) displaying the football or basketball game, and the user participates in the interaction by presenting a sense of speech or an expression.
By adopting the interaction method between the first screen and the second screen provided by the embodiment of the application, the first prompt information prompting the user to participate in the interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Example two
In the process of playing the program by the device, the client may further execute an interaction method between the first screen and the second screen according to the second embodiment of the present application. In the embodiment of the present application, some steps are the same as those in the interaction method of the first embodiment, and therefore, for implementation, reference may be made to implementation of the interaction method of the first embodiment, and repeated details are not described again.
Fig. 5 shows a flowchart of an interaction method between a first screen and a second screen according to a second embodiment of the present application. As shown in fig. 5, an interaction method between a first screen and a second screen according to a second embodiment of the present application includes:
s501, a client displays first prompt information for prompting a user to participate in interaction; the first prompt message is located on a part of a first interface currently displayed by the client.
S502, receiving an input first user operation; the first user operation is an operation input according to the first prompt information.
S503, responding to the first user operation, the client displays a third interface, wherein the third interface comprises second prompt information for triggering to receive sound;
and S504, receiving the input second user operation, wherein the second user operation is an operation executed according to the second prompt information.
In particular implementations, the second cue information may be a graphical metaphor associated with a sound. Fig. 6 shows a specific diagram of the second prompt message. As shown in fig. 6, the second prompt message may be a ripple pattern. It should be understood that the illustrations herein are for purposes of example only and are not intended to limit the present application.
And S505, the client receives the sound of the audio-visual signal played by the equipment, the audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound.
And S506, the client displays a second interface, wherein the second interface is an interactive interface corresponding to the audio watermark.
And S507, receiving input third user operation, wherein the third user operation is interactive operation.
And S508, responding to the third user operation, and displaying a fourth interface, wherein the fourth interface comprises an interaction result.
FIG. 7 shows a detailed view of the fourth interface when the interaction result is a questionnaire. It should be understood that the illustrations herein are for purposes of example only and are not intended to limit the present application.
By adopting the interaction method between the first screen and the second screen provided by the embodiment of the application, the first prompt information prompting the user to participate in the interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
EXAMPLE III
In the process of playing the program by the device, the client and the device may further execute an interaction method between the first screen and the second screen according to the third embodiment of the present application. In the embodiment of the present application, some steps are consistent with those in the interaction method of the first embodiment and the second embodiment, and therefore, for implementation, reference may be made to implementation of the interaction method of the first embodiment and the second embodiment, and repeated details are not repeated.
Fig. 8 shows a flowchart of an interaction method between a first screen and a second screen according to a third embodiment of the present application. As shown in fig. 8, the method for interaction between a first screen and a second screen according to the third embodiment of the present application includes:
s801, preloading a plurality of events at equipment; the events correspond to the interactive information respectively.
In particular implementations, the event may be, for example, inserting an advertisement, displaying an emoticon, displaying an advertisement pop-up, and so forth. The corresponding interactive information may be, for example, corresponding text, corresponding emoticons, or clicking corresponding selection buttons, etc. input by the user at the client. And are not limited herein.
S802, the client displays first prompt information for prompting a user to participate in interaction; the first prompt message is located on a part of a first interface currently displayed by the client.
S803, receiving the input first user operation; the first user operation is an operation input according to the first prompt information.
S804, responding to the first user operation, the client displays a third interface, wherein the third interface comprises second prompt information for triggering to receive sound;
and S805, receiving the input second user operation, wherein the second user operation is an operation executed according to the second prompt message.
S806, the client receives the sound of the audio-visual signal played by the device, the audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound.
And S807, displaying a second interface by the client, wherein the second interface is an interactive interface corresponding to the audio watermark.
And S808, receiving an input third user operation, wherein the third user operation is an interactive operation.
And S809, responding to the third user operation, inquiring the event corresponding to the interactive information by the equipment, and displaying the event.
By adopting the interaction method between the first screen and the second screen provided by the embodiment of the application, the first prompt information prompting the user to participate in the interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Based on the same inventive concept, the embodiment of the present application further provides an interactive apparatus, and as the principle of solving the problem by the apparatus is similar to the method provided in the first, second, or third embodiment of the present application, the implementation of the apparatus may refer to the implementation of the method, and repeated parts are not described again.
Example four
Fig. 9 is a schematic structural diagram of an interaction device between a first screen and a second screen according to a fourth embodiment of the present application. As shown in fig. 9, an interaction apparatus 900 between a first screen and a second screen according to a fourth embodiment of the present application includes: a first display module 901, configured to provide a first prompt message prompting a user to participate in an interaction at a client; the first prompt message is positioned on a part of a first interface currently displayed by the client; an operation receiving module 902, configured to receive an input first user operation; the first user operation is an operation input according to the first prompt information; a watermark extraction module 903, configured to trigger the client to receive sound of an audiovisual signal played by another device, where the audiovisual signal is embedded with an audio watermark in advance, and extract the audio watermark from the sound; the first display module 901 is further configured to provide a second interface at the client, where the second interface is an interactive interface corresponding to the audio watermark.
In specific implementation, the first prompt message may be displayed in the first interface in the form of a picture.
In a specific implementation, the first prompt message may be displayed in the form of an icon in the upper left corner or the upper right corner of the first interface.
In a specific implementation, the first prompt message may be displayed in the form of an icon in the upper left corner or the upper right corner of the first interface.
In a specific implementation, the first display module may be further configured to: providing a third interface at the client in response to the first user operation, the third interface including second prompt information triggering reception of the sound; and the operation receiving module is also used for receiving an input second user operation, and the second user operation is an operation executed according to the second prompt information.
In particular implementations, the second cue information may be a graphical metaphor associated with a sound.
In particular implementation, the first interface may be a traffic application main interface, and the second interface may be a traffic safety questionnaire; or the first interface can be an e-commerce application main interface, and the second interface can be a commodity purchasing interface; or the first interface can be a main interface of the video application, and the second interface can be a forum or bullet screen speaking interface.
In specific implementation, the apparatus for interaction between a first screen and a second screen according to the fourth embodiment of the present application may further include: a loading module to preload a plurality of events at a device; the plurality of events respectively correspond to a plurality of interactive messages; and the second display module is used for responding to the third user operation, inquiring the event corresponding to the interactive information at the equipment and displaying the event.
By adopting the interaction device between the first screen and the second screen provided by the embodiment of the application, the first prompt information prompting the user to participate in interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Based on the same inventive concept, the embodiment of the present application further provides a terminal, and as the principle of solving the problem of the terminal is similar to the method provided in the first, second, or third embodiment of the present application, the implementation of the terminal may refer to the implementation of the method, and repeated details are not repeated.
EXAMPLE five
Fig. 10 shows a schematic structural diagram of a terminal according to a fifth embodiment of the present application.
As shown in fig. 10, a terminal 1000 according to the fifth embodiment of the present application includes: a display 1001, memory 1002, one or more processors 1003; and one or more modules stored in the memory and configured to be executed by the one or more processors, the one or more modules including instructions for performing the steps of the interaction method in the first, second or third embodiments of the present application.
By adopting the terminal provided by the embodiment of the application, the first prompt information for prompting the user to participate in interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
Based on the same inventive concept, embodiments of the present application further provide a computer-readable storage medium, and since the principle of solving the problem of the computer-readable storage medium is similar to the method provided in the first, second, or third embodiments of the present application, the implementation of the computer-readable storage medium may refer to the implementation of the method, and repeated details are not repeated.
EXAMPLE six
A computer-readable storage medium according to a sixth embodiment of the present application, having a computer program stored thereon; the computer program is executed by a processor to implement the above-described method.
By adopting the computer-readable storage medium in the embodiment of the application, the first prompt message for prompting the user to participate in the interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the flexible control of the interactive information.
EXAMPLE seven
The seventh embodiment of the present application provides an application of the interaction method according to the embodiment of the present application in an interactive activity.
Specifically, the activity flow of the application includes:
1. making an interactive advertisement (first prompt message) by the traffic application APP;
2. embedding an audio watermark in the public transport advertisement by a program producer through a watermark embedding system;
3. a background of the traffic application APP is implanted with a decoding component of an audio watermark of a public service traffic advertisement and interactive content matched with the decoding component;
4. public traffic advertisements provided by program producers are broadcasted by a certain television station, and users are prompted to participate in interaction by using a traffic application APP;
5. a traffic application APP user listens to the sound of public service traffic advertisements through the APP and participates in interaction;
6. and the traffic application APP counts advertisement audience situation and interaction related data.
In specific implementation, the traffic application management background can also adjust interactive contents (interactive contents such as answers, red packages, coupons, lotteries, games, advertisements and the like) according to needs, so as to realize a new mode of television program interaction.
By adopting the application in the embodiment of the application, the first prompt information prompting the user to participate in interaction is displayed at the client; after receiving input first user operation, a client receives sound which is played by another device and is embedded with audio watermark audio-visual signals in advance, and extracts audio watermark from the sound; displaying an interactive interface corresponding to the audio watermark; the audio-visual signal can be accurately identified; and the program producer can embed different audio watermarks in the audio-visual signal according to the requirement, thereby realizing the control of the interactive information.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (18)
1. An interaction method, comprising:
the client displays first prompt information for prompting a user to participate in interaction; the first prompt message is positioned on one part of a first interface currently displayed by the client;
receiving an input first user operation; the first user operation is an operation input according to the first prompt message;
the method comprises the steps that a client receives sound of an audio-visual signal played by another device, an audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound;
the client displays a second interface, wherein the second interface is an interactive interface corresponding to the audio watermark;
receiving input third user operation, wherein the third user operation is interactive operation;
responding to the third user operation, another device inquires an event corresponding to the interactive information and displays the event, wherein a plurality of events are preloaded at the other device before the other device inquires the event corresponding to the interactive information, and the events respectively correspond to the interactive information.
2. The interaction method according to claim 1, wherein the receiving, by the client, the sound of the audiovisual signal played by the other device specifically comprises:
the client receives the sound of the audio-visual signal played by the other equipment through the terminal microphone.
3. The interaction method according to claim 1, wherein the first prompt message is displayed in the first interface in the form of a picture or an icon.
4. The interaction method according to claim 3, wherein the first prompt message is displayed in the form of an icon in the upper left corner or the upper right corner of the first interface.
5. The interactive method of claim 1, wherein after receiving the input first user operation, before the client receives sound of an audiovisual signal played by another device, further comprising:
responding to the first user operation, the client displays a third interface, wherein the third interface comprises second prompt information for triggering to receive sound;
and receiving an input second user operation, wherein the second user operation is an operation executed according to the second prompt message.
6. The interactive method of claim 5, wherein the second cue information is a graphical metaphor associated with a sound.
7. The interaction method of claim 1, wherein the first interface is a traffic application home interface and the second interface is a traffic safety questionnaire; or the first interface is an e-commerce application main interface, and the second interface is a commodity purchasing interface; or the first interface is a video application main interface, and the second interface is a forum or bullet screen speaking interface.
8. The interactive method of claim 1, further comprising, before the client receives the sound and extracts the audio watermark from the sound:
and embedding an audio watermark decoding component in the application corresponding to the first interface.
9. The interactive method of claim 1, wherein the audio watermark comprises an identifier and a time code; the identifier is used to identify the program content and the time code is used for synchronization.
10. The interactive method of claim 1, further comprising, after the client displays the second interface:
receiving an input third user operation, wherein the third user operation is an interactive operation;
and responding to the third user operation, and displaying a fourth interface, wherein the fourth interface comprises an interaction result.
11. An interactive apparatus, comprising:
the first display module is used for providing first prompt information for prompting a user to participate in interaction at the client; the first prompt message is positioned on one part of a first interface currently displayed by the client;
the operation receiving module is used for receiving input first user operation; the first user operation is an operation input according to the first prompt message;
the watermark extraction module is used for triggering the client to receive the sound of the audio-visual signal played by another device, wherein the audio watermark is embedded in the audio-visual signal in advance, and the audio watermark is extracted from the sound;
the first display module is further configured to provide a second interface at the client, where the second interface is an interactive interface corresponding to the audio watermark;
a loading module to preload a plurality of events at another device; the plurality of events respectively correspond to a plurality of interactive messages;
the operation receiving module is further used for receiving input third user operation, and the third user operation is interactive operation;
and the second display module is used for responding to the third user operation, inquiring the event corresponding to the interactive information at another device and displaying the event.
12. The interaction device according to claim 11, wherein the first prompt message is displayed in the first interface in the form of a picture or an icon.
13. The interaction device according to claim 12, wherein the first prompt message is displayed in the form of an icon on the upper left corner or the upper right corner of the first interface.
14. The interactive device of claim 11, wherein the first display module is further configured to:
providing a third interface at the client in response to the first user operation, the third interface including second prompt information triggering reception of a sound;
the operation receiving module is further configured to receive an input second user operation, where the second user operation is an operation executed according to the second prompt information.
15. The interactive apparatus of claim 14, wherein the second cue information is a graphical metaphor associated with a sound.
16. The interaction device of claim 11, wherein the first interface is a traffic application home interface and the second interface is a traffic safety questionnaire; or the first interface is an e-commerce application main interface, and the second interface is a commodity purchasing interface; or the first interface is a main interface of the video application, and the second interface is a forum or bullet screen speaking interface.
17. A terminal, comprising: a display screen, a memory, one or more processors; and one or more modules stored in the memory and configured to be executed by the one or more processors, the one or more modules comprising instructions for performing the steps of the method of any of claims 1-10.
18. A computer-readable storage medium, having stored thereon a computer program; the computer program is executed by a processor to implement the method of any one of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911395256.6A CN111190518B (en) | 2019-12-30 | 2019-12-30 | Interaction method and device between first screen and second screen, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911395256.6A CN111190518B (en) | 2019-12-30 | 2019-12-30 | Interaction method and device between first screen and second screen, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111190518A CN111190518A (en) | 2020-05-22 |
| CN111190518B true CN111190518B (en) | 2022-05-17 |
Family
ID=70707950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911395256.6A Active CN111190518B (en) | 2019-12-30 | 2019-12-30 | Interaction method and device between first screen and second screen, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111190518B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104320719A (en) * | 2014-11-14 | 2015-01-28 | 武汉大学 | Television program interaction participating method and system based on audio watermarking |
| CN105392022A (en) * | 2015-11-04 | 2016-03-09 | 北京符景数据服务有限公司 | Audio watermark-based information interaction method and device |
| WO2016054343A1 (en) * | 2014-10-02 | 2016-04-07 | Signal Enterprises, Inc. | Digital audio programming and distribution platform architecture |
| CN106131589A (en) * | 2016-06-21 | 2016-11-16 | 无锡天脉聚源传媒科技有限公司 | A kind of TV interaction recognition methods and device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442671B (en) * | 2007-11-21 | 2010-12-08 | 华为技术有限公司 | Method and apparatus for embedding and extracting digital information |
| CN104041057A (en) * | 2012-01-06 | 2014-09-10 | 汤姆逊许可公司 | Method and system for providing a graphical representation on a second screen of social messages related to content on a first screen |
| TW201528803A (en) * | 2014-01-10 | 2015-07-16 | Waystorm Co Ltd | Advertisement distribution system and method for controlling operations of mobile electronic device thereof |
| CN106331743A (en) * | 2015-07-03 | 2017-01-11 | 上海尚恩华科网络科技股份有限公司 | Video interaction system and method based on audio watermarking |
| CN105635841A (en) * | 2015-12-28 | 2016-06-01 | 北京正奇联讯科技有限公司 | Interaction broadcast control method and system |
| CN108712666B (en) * | 2018-04-04 | 2021-07-09 | 聆刻互动（北京）网络科技有限公司 | Interactive audio watermark-based mobile terminal and television interaction method and system |
-
2019
- 2019-12-30 CN CN201911395256.6A patent/CN111190518B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016054343A1 (en) * | 2014-10-02 | 2016-04-07 | Signal Enterprises, Inc. | Digital audio programming and distribution platform architecture |
| CN104320719A (en) * | 2014-11-14 | 2015-01-28 | 武汉大学 | Television program interaction participating method and system based on audio watermarking |
| CN105392022A (en) * | 2015-11-04 | 2016-03-09 | 北京符景数据服务有限公司 | Audio watermark-based information interaction method and device |
| CN106131589A (en) * | 2016-06-21 | 2016-11-16 | 无锡天脉聚源传媒科技有限公司 | A kind of TV interaction recognition methods and device |
Non-Patent Citations (1)
| Title |
|---|
| 音频数字水印在电视播出互动中的应用;黄振川;《现代电视技术》;20190515(第05期);64-68,85 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111190518A (en) | 2020-05-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11778138B2 (en) | System and methods providing supplemental content to internet-enabled devices synchronized with rendering of first content | |
| US10291942B2 (en) | Interactive broadcast system and method | |
| CN105007515A (en) | Method and device for generating interaction feedback information of interaction television system | |
| US9352228B2 (en) | Methods and systems for processing gaming data | |
| CN108989883B (en) | Live broadcast advertisement method, device, equipment and medium | |
| CN106028169A (en) | Lottery interaction method and device | |
| CN103957464A (en) | Advertisement distributing method and system | |
| CN105007517A (en) | Method and device for generating interactive information of interactive television system | |
| CN105407390A (en) | Method and device for recommending television programs for interactive television system | |
| CN105120319A (en) | Method for pushing interaction information of television interaction system | |
| CN111190518B (en) | Interaction method and device between first screen and second screen, terminal and storage medium | |
| KR20150141265A (en) | Apparatus for providing contents inserted music and advertisement based on music sharing service and method thereof | |
| CN105392062A (en) | Method and device for pushing interactive information of interactive television system | |
| CN105072497A (en) | Method and device for generating interactive TV video signal | |
| CN112926546A (en) | Bullet screen sending method, bullet screen sending device, bullet screen equipment and readable storage medium | |
| TWI606726B (en) | Instant interaction method and system for mobile device and program | |
| CN105120350A (en) | Television interactive system management platform | |
| CN111213133B (en) | Command processing server, program, system, command execution program, and command processing method | |
| TW200839671A (en) | Cross-platform advertisement method and device for digital TV | |
| US10780353B2 (en) | Methods and systems for processing gaming data | |
| CN105120348A (en) | Push information management method and device used for television interactive system | |
| CN105072498A (en) | Method and device for configuring interaction information for TV program | |
| CN105407388A (en) | Interactive information configuration method and device for interactive television system | |
| CN105407396A (en) | Interaction information generating method and device of interactive television system | |
| CN105407389A (en) | Method and device for pushing interaction feedback information for interactive television system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |