CN104869467A

CN104869467A - Information output method and system for media playing, and apparatuses

Info

Publication number: CN104869467A
Application number: CN201510137007.2A
Authority: CN
Inventors: 俄万有
Original assignee: Tencent Technology Beijing Co Ltd
Current assignee: Tencent Technology Beijing Co Ltd
Priority date: 2015-03-26
Filing date: 2015-03-26
Publication date: 2015-08-26
Anticipated expiration: 2035-03-26
Also published as: CN104869467B

Abstract

The application discloses an information output method for media playing. When a media file is played at a first user terminal or terminal equipment binding to the first user terminal, a server receives voice comment information that is about the media file by a first user and is sent by the first user terminal; when the server is going to send output information that corresponds to the voice comment information and is about a second user, the type of the output information is determined according to a type of output information allowed to be received by the second user and/or feature information of the media file, and output information of the type is obtained according to the voice comment information; the output information with the type is sent to a second user terminal corresponding to the second user or terminal equipment binding to the second user terminal. In addition, the application also discloses corresponding apparatuses and a system. On the basis of the disclosed technical scheme, voice comments can be made during media playing.

Description

Information output method, device and system in media playing

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method, an apparatus, and a system for outputting information during media playing.

Background

Currently, more and more users play media files online (e.g., watch online video or listen to online audio) through terminal devices, and more particularly, watch live sports events, listen to online broadcasts, etc. In order to perform real-time interaction with users who play the same media file (for example, watch the same video) at the same time, each user can issue own comments on the content of the media file in the form of characters while watching the same. The text comment information of the user will appear in the interface (such as video picture) of the media playing. For the playing of video files, this approach is also called "barrage video".

Disclosure of Invention

The embodiment of the invention provides a method, a device and a system for outputting information in media playing, so that voice comments are realized in the media playing.

The technical scheme of the invention is realized as follows:

an information output method in media playing, comprising:

when a media file is played on a first user terminal or a terminal device bound with the first user terminal, a server receives voice comment information of a first user for the media file, wherein the voice comment information is sent by the first user terminal;

when the server prepares to send output information corresponding to the voice comment information, wherein the output information is output information of a second user, the type of the output information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the type of the output information is obtained according to the voice comment information; and sending the type of output information to a second user terminal corresponding to the second user or terminal equipment bound with the second user terminal.

An information output method in media playing, comprising:

when a media file is played, a user terminal receives voice comment information aiming at the media file, which is input by a first user;

the user terminal sends the voice comment information to a server for processing the voice comment information, wherein when the server prepares to send output information corresponding to the voice comment information, the output information is output information of a second user, the type of the output information of the second user corresponding to the voice comment information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the output information of the second user of the type is obtained according to the voice comment information;

and the user terminal or the terminal equipment bound with the user terminal receives second output information sent by the server and outputs the second output information to the first user.

A server, comprising:

the receiving module is used for receiving voice comment information of a first user aiming at a media file, which is sent by a first user terminal, when the media file is played on the first user terminal or a terminal device bound with the first user terminal;

the output information type determining module is used for determining the type of the output information according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file when the output information corresponding to the voice comment information is prepared to be sent, wherein the output information is the output information of the second user;

the output information acquisition module is used for acquiring the type of output information according to the voice comment information;

and the sending module is used for sending the type of output information to a second user terminal corresponding to the second user or terminal equipment bound with the second user terminal.

A user terminal, comprising:

the receiving module is used for receiving voice comment information aiming at the media file, which is input by a first user, when the media file is played;

the sending module is used for sending the voice comment information to a server used for processing the voice comment information, wherein when the server prepares to send output information corresponding to the voice comment information, the output information is output information of a second user, the type of the output information of the second user corresponding to the voice comment information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the output information of the second user of the type is obtained according to the voice comment information.

A terminal device, comprising:

the receiving module is used for receiving output information corresponding to first voice comment information from a server for processing the voice comment information, wherein the output information is output information of a first user, the first voice comment information aims at a played media file, an address of the server is also received, the address is provided for a user terminal bound by the terminal equipment, so that the user terminal can send second voice comment information input by the first user to the server or send the second voice comment information input by the first user and a type of the first user, which allows the first user to receive the output information, and the second voice comment information aims at the media file; when the server prepares to send output information corresponding to the second voice comment information, wherein the output information is output information of a second user, the type of the output information of the second user corresponding to the second voice comment information is determined according to the type of the output information allowed to be received by the second user and/or the feature information of the media file, and the output information of the second user of the type is obtained according to the second voice comment information;

and the output module is used for outputting the output information of the first user received by the receiving module to the first user.

An information output system in media playback, comprising:

the system comprises a user terminal, a server and a server, wherein the user terminal is used for receiving voice comment information aiming at a media file input by a first user when the media file is played, sending the voice comment information to the server for processing the voice comment information, determining the type of output information of a second user corresponding to the voice comment information according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file when the server is ready to send the output information corresponding to the voice comment information, and obtaining the output information of the second user of the type according to the voice comment information;

the terminal equipment bound with the user terminal is used for receiving second output information sent by the server and outputting the second output information to the first user; wherein the second output information corresponds to second voice comment information for the media file.

An information output system in media playing comprises a voice server, a first user terminal, a terminal device bound with the first user terminal, a second user terminal and a terminal device bound with the second user terminal, wherein:

the terminal equipment bound with the first user terminal is used for responding to an instruction from the first terminal to play a media file and providing an address of the voice server;

the first user terminal is used for acquiring the address of the voice server from the terminal equipment bound with the first user terminal, receiving voice comment information aiming at the media file and input by a first user when the media file is played, and sending the voice comment information to the voice server according to the acquired address of the voice server;

the second user terminal is used for acquiring the address of the voice server from the terminal equipment bound with the second user terminal, and sending the type of the second user allowed to receive the output information to the voice server according to the address of the voice server;

the voice server is used for receiving the type of the second user, which allows the second user to receive the output information, receiving the voice comment information, determining the type of the output information according to the type of the second user, which allows the second user to receive the output information, and/or the feature information of the media file when the voice server prepares to send the output information corresponding to the voice comment information, and obtaining the type of the output information according to the voice comment information; sending the type of output information to the terminal equipment bound with the second user terminal;

the terminal device bound with the second user terminal is used for responding to an instruction from the second terminal to play the media file, providing the address of the voice server, receiving the type of output information sent by the voice server, and outputting the type of output information to the second user.

An information output system in media playing comprises a voice server, a first user terminal and a second user terminal, wherein:

the first user terminal is used for receiving voice comment information aiming at the media file and input by a first user when the media file is played, and sending the voice comment information to the voice server;

the voice server is used for receiving the voice comment information sent by the first user terminal, when the voice server prepares to send output information corresponding to the voice comment information, wherein the output information is output information of a second user, the type of the output information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the type of the output information is obtained according to the voice comment information; and sending the type of output information to a second user terminal corresponding to the second user.

And the second user terminal is used for receiving the output information sent by the voice server and outputting the output information to the second user.

According to the method, the device and the system provided by the embodiment of the invention, when the server prepares to send the output information corresponding to the voice comment information, wherein the output information is the output information of a second user, the type of the output information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the type of the output information is obtained according to the voice comment information. In this way, voice comments can be implemented in the media playback. Further, for receiving the voice comment information, the server can obtain different types of output information according to the requirements of the user and/or the characteristics of the video, so that the user terminal or the terminal device bound with the user terminal can output the output information to the user, and comment information displayed in media playing is more diverse.

Drawings

FIG. 1 is a flow chart of an information output method in media playing according to an embodiment of the present invention;

FIG. 2 is a flowchart illustrating an information output method for media playing according to another embodiment of the present invention;

FIG. 3 is a flowchart illustrating an information output method for media playing according to another embodiment of the present invention;

fig. 4 is a schematic diagram illustrating a two-dimensional code of an address of a server for processing voice comment information displayed on a terminal device bound to a user terminal according to an embodiment of the present invention;

fig. 5 is a schematic structural diagram of a server according to an embodiment of the present invention;

fig. 6 is a schematic structural diagram of a user terminal according to an embodiment of the present invention;

fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention;

fig. 8 is a schematic structural diagram of an information output system in media playing according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an information output system in media playing according to another embodiment of the present invention;

fig. 10 is a schematic structural diagram of an information output system in media playing according to another embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

With the popularization of intelligent terminal devices (e.g., intelligent televisions), users can watch media files through the intelligent terminal devices. However, the input device (e.g., smart remote control) of the smart terminal device does not usually have a text input function. When a user watches a media file on the intelligent terminal device, comment information of the video cannot be published through the input device bound with the intelligent terminal device.

In view of this, an embodiment of the present invention provides an information output method in media playing. According to the method provided by the embodiment of the invention, when the server prepares to send the output information of the second user corresponding to the voice comment information, the type of the output information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the type of the output information is obtained according to the voice comment information. In this way, voice comments can be implemented in the media playback. Further, for the received voice comment information, the server can obtain different types of output information according to the requirements of the user and/or the characteristics of the video, so that the user terminal or the terminal device bound with the user terminal can output the output information to the user. Therefore, the comment information is displayed more flexibly in the media playing process.

For the "barrage video", due to the limitation of the text input speed of the user, the comment information of the user may not be displayed in the commented media playing interface. Particularly, when the number of words of the comment information of the user is large, the real-time property of comment information display cannot be ensured. According to the method provided by the embodiment of the invention, the speed of inputting the comment information by the user in a voice mode is higher than that in a text input mode, so that the real-time property of the comment information is ensured.

Fig. 1 is a flowchart of an information output method in media playing according to an embodiment of the present invention. As shown in fig. 2, the method includes the following steps.

Step 101, when a media file is played on a first user terminal or a terminal device bound with the first user terminal, a server receives voice comment information of a first user for the media file, which is sent by the first user terminal.

In this step, the media file may be a video file, an audio file, a picture, a slide show, or the like. The media file may be played on the first user terminal. When the first user terminal is bound to another terminal device, the media file may be played on the terminal device bound to the first user terminal.

And step 102, when the server prepares to send the output information of the second user corresponding to the voice comment information, determining the type of the output information according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and obtaining the type of the output information according to the voice comment information.

In this step, the type of output information may include text and/or speech.

In one embodiment of the invention, the type of the output information corresponding to the voice comment information can be determined according to the type of the output information allowed to be received by the second user and the characteristic information of the media file. Specifically, if the type of the output information allowed to be received is voice, determining that the type of the output information is voice; if the type of the output information which is allowed to be received is the character, determining that the type of the output information is the character; if the type of the output information allowed to be received is voice and characters, determining the type of the output information according to the characteristic information of the media file.

In one embodiment of the invention, the characteristic information of the media file may include attributes of the media file. Attributes of media files include sound rich video and image rich media files. When a user is enjoying a media file with rich sound, the audio of the media file itself, for example, a singing, a talk show, and the like, is mainly concerned. That is, for a user who is enjoying a media file that is rich in sound, the audio of the media file itself is more important than the picture of the media file. When a user is enjoying a media file with rich images, the user is mainly concerned about the images of the media file itself, for example, a sports event live broadcast. That is, for a user who is enjoying the image-rich media file, the picture of the media file itself is more important than the audio of the media file.

In an embodiment of the present invention, if the type of the output information allowed to be received is voice or text, the type of the output information may be determined according to the feature information of the media file as follows. If the attribute of the media file is a media file with rich sound, determining the type of the output information as characters; and if the attribute of the media file is the media file with rich images, determining the type of the output information as voice.

In an embodiment of the present invention, if the type of the output information allowed to be received is voice or text, the type of the output information may be determined according to the feature information of the media file in the following manner. If the attribute of the media file is the media file with rich sound, determining the type of the output information as characters; if the attribute of the media file is the media file with rich images, judging whether the type of the output information to be sent is determined to be that the playing of the output information with the previous type of the second user being the voice is influenced or not, if so, determining the characters of the output information, otherwise, determining the voice of the output information.

In one embodiment of the invention, the characteristic information of the media file includes the attribute of the media file and the playing time window of the audio of the media file itself. And in the audio time window of the media file, the second user terminal or the terminal equipment bound with the second user terminal plays the audio of the media file. If the type of the output information allowed to be received is voice and text, the type of the output information can be determined according to the characteristic information of the media file in the following mode. If the attribute of the media file is a media file with rich sound, determining the type of the output information as characters; if the attribute of the media file is the media file with rich images, judging whether the type of the output information to be sent is determined to be that the voice can influence the playing of the audio of the media file or the output information with the previous type of the second user as the voice according to the playing time window of the audio of the media file, if so, determining that the type of the output information is characters, otherwise, determining the voice of the output information.

In one embodiment of the invention, the server may determine the type of output information based on the characteristic information of the media file. The characteristic information of the media file may include attributes of the media file. If the attribute of the media file is a media file with rich sound, determining the type of the output information as characters; and if the attribute of the media file is the media file with rich images, determining the type of the output information as voice.

In one embodiment of the invention, the server may determine the type of output information based on the type of output information the second user is allowed to receive. If the type of the output information which is allowed to be received is voice, determining that the type of the output information is voice; and if the type of the output information allowed to be received is the character, determining that the type of the output information is the character.

And 103, sending the type output information to a second user terminal corresponding to the second user or a terminal device bound with the second user terminal, so that the second user terminal or the terminal device bound with the second user terminal can output the type output information to the second user.

If the determined type of the output information is voice, the server takes the voice comment information as the output information; and if the determined type of the output information is the character, converting the voice comment information into character information, and taking the character information as the output information.

Fig. 2 is a flowchart of an information output method in media playing according to an embodiment of the present invention. As shown in fig. 2, the method includes the following steps.

Step 201, when playing a media file, a user terminal receives voice comment information for the media file, which is input by a first user.

Step 202, the user terminal sends the voice comment information to a server for processing the voice comment information, wherein when the server prepares to send first output information of a second user corresponding to the voice comment information, the server determines the type of the first output information corresponding to the voice comment information according to the type of the second user allowed to receive the output information and/or the characteristic information of the media file, and obtains the type of the first output information according to the voice comment information.

Step 203, the user terminal or the terminal device bound with the user terminal receives the second output information sent by the server and outputs the second output information to the first user.

In this step, the second output information may be output information corresponding to the voice comment information sent by the user terminal of the first user, or output information corresponding to the voice comment information sent by the user terminals of other users.

In this step, when the media file is played on the user terminal, the user terminal receives the second output information sent by the server and outputs the second output information to the first user. When the media file is played on the terminal equipment bound with the user terminal, the terminal equipment bound with the user terminal receives second output information sent by the server and outputs the second output information to the first user.

If the type of the second output information is voice and the playing of the second output information can affect the audio playing of the media file, the audio of the media file is played according to the first audio playing parameter, and the second output information is played according to the second audio playing parameter.

In an embodiment of the present invention, before step 201, the method may further include: the user terminal obtains the address of the server by scanning the two-dimensional code displayed on the terminal device bound with the user terminal;

and sending the voice comment information to the server, or sending the voice comment information and the type of the first user allowed to receive the output information to the server.

According to the method provided by the embodiment of the invention, when the server prepares to send the output information of the second user corresponding to the voice comment information, the type of the output information is determined according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and the type of the output information is obtained according to the voice comment information. In this way, voice comments can be implemented in the media playback. .

Fig. 3 is a flowchart of an information output method in media playing according to an embodiment of the present invention. In this embodiment, taking the played media file as a video file as an example, as shown in fig. 3, the method includes the following steps.

In step 300, the first user terminal obtains an address of a server (hereinafter referred to as a voice server) for processing voice comment information.

Each video file is bound with a voice server and used for processing voice comment information of the video. Video information of the video file. The video information of the video file and the address of the voice server corresponding to the video file may be stored together in a server for processing video information (hereinafter referred to as a video server).

In an embodiment of the present invention, the first user terminal is not bound to another terminal device, and the video file is played on the first user terminal. The first user terminal may obtain the address from the video server. Specifically, when a video playing instruction input by a user is received, the first user terminal sends a video playing request to the video server, where the video playing request is used to request to acquire video information to be played and an address of the voice server corresponding to the video file. And after receiving the video playing request, the video server returns the video information of the video file and the corresponding voice server address to the first user terminal.

In one embodiment of the invention, the first user terminal may be bound to another terminal device. The video file is played on the terminal device. The first user terminal may obtain the address through a hardware device bound thereto. Specifically, when a video playing instruction input by a user is received, the first user terminal sends a video playing request to the hardware device, where the video playing request is used to request to acquire video information to be played and an address of a corresponding voice server. And the hardware equipment sends the video playing request to a video server. And after receiving the video playing request, the video server returns the video information of the video file and the address of the corresponding voice server to the terminal equipment.

As shown in fig. 4, while playing the video file, the terminal device may display the address in the form of a two-dimensional code in a two-dimensional code display area 412 in a video display interface 411. And the first user terminal obtains the address of the corresponding voice server by scanning the two-dimensional code displayed on the terminal equipment.

Step 301, when the video file is played, the first user terminal receives voice comment information for the video file, which is input by the first user.

In one embodiment of the present application, the first user may input the voice comment information through a device (e.g., a built-in microphone) having a voice input function on the first user terminal. In another embodiment of the present application, the voice server may be preset with commonly used voice comment information, such as applause, screaming, applause, crying, whistling, etc. The first user can select one preset voice comment message through the first user terminal. For example, the first user selects the preset voice comment information by pressing a key corresponding to the preset voice comment information on the first user terminal.

Step 302, according to the address of the corresponding voice server, the first user terminal sends the voice comment information to the voice server.

Step 303, after receiving the voice comment information, the voice server determines whether a voice comment information queue of a second user playing the video file is full, if so, deletes the voice comment information, otherwise, stores the voice comment information in the voice comment information queue.

The voice server establishes a corresponding voice comment information queue for each user watching the video file. And storing the voice comment information of other users who watch the video file and are received by the voice server in the voice comment information queue of the user according to a first-in first-out principle. In an embodiment of the present invention, when the voice server extracts the voice comment information located at the head of the queue from the voice comment information queue of the user, it is ready to send the output information corresponding to the extracted voice comment information to the user terminal device corresponding to the user or the terminal device bound to the user terminal device corresponding to the user, so that the user terminal device or the terminal device bound to the user terminal device is output to the user.

In an embodiment of the present invention, in order to ensure real-time performance of output information corresponding to voice comment information, a time interval between a time when the voice server receives the voice comment information and a time when the voice server sends the output information corresponding to the voice comment information to the user terminal or a terminal device bound to the user terminal is smaller than an output delay threshold. Otherwise, the user terminal or the terminal device bound with the user terminal cannot output the output information corresponding to the voice comment information to the user while the video picture of the comment is played. In one embodiment of the present invention, the output delay threshold of the comment information of the video file can be obtained by modeling the video file according to the characteristic information of the video file. The output delay threshold may be different for video files of different characteristics. For example, for a video file with a fast change in picture content (e.g., a video live of a jackpot game F1), the output latency threshold is small. For video files with slowly changing picture content (e.g., natural scene appreciation), the output delay threshold is large. In one embodiment of the invention, a queue mode can be adopted to ensure the real-time output of the comment information. Specifically, the length of the voice comment information queue of the user can be determined according to the processing capacity of the voice server and the output delay threshold value, so that within the time length corresponding to the output delay threshold value, the output information corresponding to all the voice comment information cached in the voice comment information queue can be sent to the user terminal or the terminal device bound with the user terminal.

And step 304, when the voice server prepares to send the output information of the second user corresponding to the voice comment information, determining the type of the output information according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file.

In an embodiment of the present invention, the voice server may determine the type of the output information corresponding to the voice comment information according to the type of the second user allowed to receive the output information and the feature information of the media file. Specifically, if the type of the output information allowed to be received by the second user is voice, the type of the output information can be determined to be voice; if the type of the output information allowed to be received by the second user is the character, the type of the output information can be determined to be the character; if the type of the output information allowed to be received by the second user is voice and text, the type of the output information can be determined according to the characteristic information of the video.

The characteristic information of the video may include attributes of the video. The attributes of video include sound-rich video and image-rich video. When a user is watching a video with rich sound, the user mainly focuses on the audio of the video itself, for example, a variety program such as singing, talk show, etc. That is, for a user who is watching a video rich in sound, the audio of the video itself is more important than the picture of the video. When a user is watching a video rich in images, the user is mainly concerned with the images of the video itself, for example, a sports event live. That is, for a user who is watching the video rich in images, the picture of the video itself is more important than the audio of the video.

In an embodiment of the present invention, if the type of the output information allowed to be received by the second user is voice and text, the voice server may determine the type of the output information according to the feature information of the video in the following manner. If the attribute of the video is a media file with rich sound, the type of the output information can be determined to be characters. And if the attribute of the video is the media file with rich images, determining the type of the output information as voice.

In an embodiment of the present invention, if the type of the output information allowed to be received by the second user is voice and text, the voice server may further determine the type of the output information according to the feature information of the video in the following manner. If the attribute of the video is a media file with rich sound, the type of the output information can be determined to be characters. If the attribute of the video is a video with rich sound, judging whether the type of the output information to be sent is determined to be that the playing of the output information with the previous type of the second user as the sound is influenced, if so, determining the characters of the output information, otherwise, determining the sound of the output information.

In an embodiment of the present invention, it may be determined whether the type of the output information to be sent is determined as voice, which may affect the playing of the previous output information of which the type is voice of the second user, by: and judging whether the time interval between the output time of the output information with the previous type of voice and the current time is greater than the duration of the output information with the previous type of voice, if so, determining that the playing of the output information with the previous type of voice of the second user cannot be influenced if the type of the output information to be sent is determined to be the voice.

The characteristic information of the video may also include a playing time window of the audio of the video itself. Within the audio time window of the video itself, the audio of the video itself will be played.

In an embodiment of the present invention, if the type of the output information allowed to be received by the second user is voice and text, the voice server may determine the type of the output information according to the feature information of the video in the following manner. If the attribute of the video is a media file with rich sound, the type of the output information can be determined to be characters. When the type of the output information allowed to be received by the second user is voice and characters, if the attribute of the video is a media file with rich sound, according to the playing time window of the audio of the video, judging whether the type of the output information to be sent is determined to be that the voice can influence the playing of the audio of the media file or the previous output information of the second user with the voice, if so, determining that the type of the output information is characters, and if not, determining the voice of the output information.

In an embodiment of the present invention, if the current time is used as the start time point, and another time that is after the current time and has a time interval with the current time as the duration of the voice comment information is used as the end time point, when any time period from the start time point to the end time point falls within the playing time window of the video self-audio, it may be determined that the type of the output information to be sent will affect the video self-audio playing if the type of the output information is determined to be voice.

In one embodiment of the invention, the voice server may determine the type of output information based on the characteristic information of the video. In one embodiment of the invention, the characteristic information of the video includes attributes of the video. If the attribute of the video is the video with rich sound, determining the type of the output information as characters; and if the attribute of the video is rich video, determining the type of the output information to be voice.

In another embodiment of the present invention, the voice server may further determine the type of the output information according to the feature information of the video by: if the attribute of the video is the video with rich sound, determining the type of the output information as characters; if the attribute of the video is a video with rich sound, whether the type of the output information to be sent is determined as the voice can influence the playing of the output information with the previous type of the second user as the voice can be further judged, if so, the characters of the output information are determined, and if not, the voice of the output information is determined.

Whether the playing of the output information with the previous type of the voice of the second user is affected by determining the type of the output information to be sent as the voice can be judged by the following method: and judging whether the time interval between the output time of the output information with the previous type of voice and the current time is greater than the duration of the output information with the previous type of voice, if so, determining whether the playing of the output information with the previous type of voice of the second user is influenced by determining whether the type of the output information to be sent is the voice.

In another embodiment of the present invention, the feature information of the video may further include a playing time window of the audio of the video itself. The voice server can determine the type of output information according to the characteristic information of the video in the following way: if the attribute of the video is the video with rich sound, determining the type of the output information as characters; if the attribute of the video is rich video, judging whether the type of the output information to be sent is determined to be voice or not to influence the playing of the audio of the media file or the output information of which the previous type of the second user is voice according to the playing time window of the audio of the video, if so, determining that the type of the output information is characters, and otherwise, determining the voice of the output information.

In an embodiment of the present invention, if a current time is used as a start time point, and another time whose time interval from the current time is the duration of the voice comment information is used as an end time point, when any time period from the start time point to the end time point falls within a playing time window of the video self-audio, it may be determined that if the type of the output information to be sent is determined as voice, the video self-audio playing will be affected.

In one embodiment of the invention, the voice server may determine the type of output information based on the type of output information the second user is allowed to receive. In an embodiment of the present invention, if the type of the output information allowed to be received by the second user is voice, determining that the type of the output information is voice; and if the type of the output information allowed to be received by the second user is the character, determining that the type of the output information is the character.

Step 305, the voice server obtains the output information of the type according to the voice comment information.

And if the determined type of the output information is voice, taking the voice comment information as the output information. And if the determined type of the output information is the character, converting the voice comment information into character information, and taking the character information as the output information.

Step 306, the voice server sends the output information of the type to a second user terminal corresponding to the second user or a terminal device bound with the second user terminal.

If the video is played on the second user terminal, the voice server sends the output information of the type to the second user terminal, and the output information is output to the second user on the second user terminal.

If the video is played on the terminal equipment bound with the second user terminal, the voice server sends the output information of the type to the terminal equipment bound with the second user terminal, and the output information is output to the second user on the terminal equipment bound with the second user terminal.

In an embodiment of the present invention, correspondingly, after the second user terminal or the terminal device bound to the second user terminal receives the output information of the type, if the type of the output information is voice and the playing of the output information affects the audio playing of the media file itself, in order to reduce the influence of the playing of the output information on the audio playing of the media file itself, the second user terminal or the terminal device bound to the second user terminal may play the audio of the video itself and the output information by using different audio playing parameters. For example, the audio of the video itself is played according to the first audio playing parameter, and the output information is played according to the second audio playing parameter.

In an embodiment of the present invention, before step 302, the method may further include: the voice server acquires video identification information corresponding to the first user.

In one embodiment of the invention, according to the acquired address of the voice server, the first user terminal sends the video identification information to a server for processing voice comment information. Correspondingly, the voice server receives the video identification information sent by the first user terminal, and obtains the characteristic information of the video from the video server according to the video identification information.

In another embodiment of the present invention, after the video server receives the video playing request, the video server pushes the video identification information corresponding to the first user to the voice server.

In an embodiment of the present invention, before step 302, the method may further include: the voice server obtains the type of the first user's permission to receive the output information.

In one embodiment of the invention, according to the acquired address of the server for processing the voice comment information, the first user terminal sends the type of the output information which is allowed to be received by the first user to the server for processing the voice comment information. According to the received type of the output information allowed to be received by the first user, the voice server can determine the type of the output information of the first user corresponding to the voice comment information.

After obtaining the video identification information corresponding to the first user and the type of the output information which the first user allows to receive, the voice server may associate the first user identification information with the type of the output information which the first user allows to receive and the video identification information corresponding to the first user. After the association process is completed, the voice server sends an association success message to the first user terminal. In this way, the first user terminal can send the voice comment information to the voice server according to the address of the corresponding voice server.

The information output method in media playing proposed by the embodiment of the present invention is explained above. The following describes an apparatus and a system provided by an embodiment of the present invention with reference to the drawings.

Fig. 5 is a schematic structural diagram of a server according to an embodiment of the present invention. As shown in fig. 5, the server 500 includes the following modules:

a receiving module 501, configured to receive voice comment information of a first user for a media file, where the voice comment information is sent by a first user terminal when the media file is played on the first user terminal or a terminal device bound to the first user terminal;

an output information type determining module 502, configured to determine, when preparing to send output information of a second user corresponding to the voice comment information, a type of the output information according to a type of the second user that allows receiving the output information and/or feature information of the media file;

an output information obtaining module 503, configured to obtain type output information according to the voice comment information;

a sending module 504, configured to send the type of output information to a second user terminal corresponding to the second user or a terminal device bound to the second user terminal, so that the second user terminal or the terminal device bound to the second user terminal is output to the second user.

In one embodiment of the present invention, the output information type determining module 502 is configured to:

if the type of the output information which is allowed to be received is voice, determining that the type of the output information is voice;

if the type of the output information which is allowed to be received is the character, determining that the type of the output information is the character;

if the type of the output information allowed to be received is voice and characters, determining the type of the output information according to the characteristic information of the media file.

In an embodiment of the present invention, the output information obtaining module 503 is configured to:

if the determined type of the output information is voice, taking the voice comment information as the output information;

and if the determined type of the output information is the character, converting the voice comment information into character information, and taking the character information as the output information.

The modules 501 and 504 may be instruction modules stored in the memory 510 of the server 500, and the instruction modules include instructions executable by a processor. When the processor 511 in the server 500 executes the instructions in the modules 501 and 504, various functions of the modules 501 and 504 can be implemented.

Fig. 6 is a schematic structural diagram of a user terminal according to an embodiment of the present invention. As shown in fig. 6, the user terminal 600 may include the following modules:

the receiving module 601 is configured to receive voice comment information for a media file, which is input by a first user, when the media file is played;

the sending module 602 is configured to send the voice comment information to a server for processing the voice comment information, where when the server prepares to send output information of a second user corresponding to the voice comment information, according to a type of the second user that allows receiving the output information and/or feature information of a media file, the type of the output information of the second user corresponding to the voice comment information is determined, and according to the voice comment information, output information of the second user of the type is obtained.

In an embodiment of the present invention, the receiving module 601 is further configured to receive a second output message sent by the server;

the user terminal further comprises an output module 603 for outputting the second output information to the first user.

In an embodiment of the present invention, the user terminal further includes an obtaining module 603.

An obtaining module 603, configured to obtain an address of a server by scanning a two-dimensional code displayed on a terminal device bound to a user terminal;

the sending module 602 is further configured to send the voice comment information to the server according to the address of the server; or the server is further used for sending the voice comment information and the type of the first user allowed to receive the output information to the server according to the address of the server.

The module 601 and 603 may be instruction modules stored in the memory 610 of the ue 600, and the instruction modules include instructions executable by the processor. When the processor 611 in the ue 600 executes the instructions in the module 601 and 603, various functions of the module 601 and 603 can be implemented.

Fig. 7 is a schematic structural diagram of a terminal device according to an embodiment of the present invention. As shown in fig. 7, the terminal device 700 may include the following modules:

the receiving module 701 is configured to receive output information of a first user corresponding to first voice comment information from a server for processing the voice comment information, where the first voice comment information is for a played media file, receive an address of the server, and provide the address to a user terminal bound to a terminal device, so that the user terminal sends, to the server, second voice comment information input by the first user or sends the second voice comment information input by the first user and a type of the first user that allows receiving of the output information, where the second voice comment information is for the media file; when the server prepares to send the output information of the second user corresponding to the second voice comment information, determining the type of the output information of the second user corresponding to the second voice comment information according to the type of the output information allowed to be received by the second user and/or the characteristic information of the media file, and obtaining the output information of the second user of the type according to the second voice comment information;

an output module 702, configured to output the output information of the first user received by the receiving module 701 to the first user.

In an embodiment of the present application, the output module 702 is further configured to output the address of the server in the form of a two-dimensional code.

The modules 701 and 702 may be instruction modules stored in the memory 710 of the terminal device 700, and the instruction modules include instructions executable by the processor. When the processor 711 in the terminal device 700 executes the instructions in the modules 701 and 702, various functions of the modules 701 and 702 may be implemented.

Fig. 8 is a schematic structural diagram of an information output system in media playing according to an embodiment of the present invention. As shown in fig. 8, the system may include: user terminal 801, terminal equipment 802 bound with the user terminal. Wherein,

the user terminal 801 is used for sending the voice comment information to a server for processing the voice comment information, wherein when the server prepares to send output information of a second user corresponding to the voice comment information, the type of the output information of the second user corresponding to the voice comment information is determined according to the type of the output information allowed to be received by the second user and/or characteristic information of a media file, and the output information of the second user of the type is obtained according to the voice comment information;

and the terminal device 802 bound with the user terminal is configured to receive the second output information sent by the server, and output the second output information to the first user.

In an embodiment of the present application, the user terminal 801 is further configured to obtain an address of a server by scanning a two-dimensional code displayed on a terminal device bound to the user terminal, and send voice comment information to the server according to the address of the server; or the server is further used for sending the voice comment information and the type of the first user allowed to receive the output information to the server according to the address of the server.

Fig. 9 is a schematic structural diagram of an information output system in media playing according to an embodiment of the present invention. As shown in fig. 9, the system may include: voice server 901, first user terminal 902, second user terminal 903, wherein:

the first user terminal 902 is configured to receive voice comment information for a media file, which is input by a first user, when the media file is played, and send the voice comment information to the voice server 901;

the voice server 901 is configured to receive voice comment information, which is sent by a first user terminal and is specific to a media file, of a first user, and when the voice server 901 prepares to send output information of a second user corresponding to the voice comment information, determine a type of the output information according to a type of the second user that is allowed to receive the output information and/or feature information of the media file, and obtain the type of the output information according to the voice comment information; and sending the type of output information to a second user terminal 903 corresponding to a second user.

And the second user terminal 903 is configured to receive the output information sent by the voice server 901, and output the output information to the second user.

In one embodiment of the invention, the system further comprises: a media server 904. The media server 904 is configured to provide the voice server 901 with feature information of the media file.

Fig. 10 is a schematic structural diagram of an information output system in media playing according to an embodiment of the present invention. As shown in fig. 10, the system may include: a voice server 1001, a first user terminal 1002, a second user terminal 1003, a terminal device 1004 bound with the first user terminal, a terminal device 1005 bound with the second user terminal, wherein:

a terminal device 1004 bound to the first user terminal for playing the media file in response to an instruction from the first terminal, providing a two-dimensional code of an address of the voice server 1001;

the first user terminal 1002 is configured to scan a two-dimensional code displayed on the terminal device 1004 bound thereto, acquire an address of the voice server 1001, receive voice comment information for a media file input by a first user when the media file is played, and send the voice comment information to the voice server 1001 according to the acquired address of the voice server 1001;

the second user terminal 1003 acquires the address of the voice server 1001 by using the two-dimensional code displayed on the terminal device 1005 bound therewith, and transmits the type of the second user permitted to receive the output information to the voice server 1001 according to the address of the voice server 1001;

the voice server 1001 is used for receiving the type of the second user which allows the output information to be received, receiving the voice comment information, determining the type of the output information according to the type of the second user which allows the output information to be received and/or the characteristic information of the media file when the voice server 1001 prepares to send the output information of the second user corresponding to the voice comment information, and obtaining the type of the output information according to the voice comment information; transmitting the output information of the type to a terminal device 1005 bound with the second user terminal;

and a terminal device 1005 bound to the second user terminal, for playing the media file in response to an instruction from the second terminal, providing the two-dimensional code of the address of the voice server 1001, receiving the type of output information transmitted by the voice server 1001, and outputting the type of output information to the second user.

In one embodiment of the present application, the system further comprises: media server 1006, configured to provide feature information of the media file to voice server 1001.

Specific use scenarios of the information output method, apparatus and system in media playing provided by the present invention are given below as examples. In a use scene, a plurality of people watch videos through the same intelligent television. Everyone respectively through respective terminal equipment publish the pronunciation comment information to this video to through the pronunciation or the word comment information of smart television receipt to this video. In another use scenario, multiple people watch the same video through different smart televisions respectively. For example, several people watch a video through the same smart tv in one room, while several other people watch the video through another smart tv in another room. At the moment, each person respectively issues voice comment information through respective terminal equipment, and receives voice or text comment information aiming at the video through the smart television in the respective room.

The information output system and method embodiments in the server, the user terminal, the terminal device, and the media playing provided by the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the method embodiments and are not described herein again.

In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. The functional modules of the embodiments may be located in one terminal or network node, or may be distributed over a plurality of terminals or network nodes.

In addition, each of the embodiments of the present invention can be realized by a data processing program executed by a data processing apparatus such as a computer. It is clear that the data processing program constitutes the invention. Further, the data processing program, which is generally stored in one storage medium, is executed by directly reading the program out of the storage medium or by installing or copying the program into a storage device (such as a hard disk and/or a memory) of the data processing device. Such a storage medium therefore also constitutes the present invention. The storage medium may use any type of recording means, such as a paper storage medium (e.g., paper tape, etc.), a magnetic storage medium (e.g., a flexible disk, a hard disk, a flash memory, etc.), an optical storage medium (e.g., a CD-ROM, etc.), a magneto-optical storage medium (e.g., an MO, etc.), and the like.

The invention therefore also provides a storage medium in which a data processing program is stored which is designed to carry out any one of the embodiments of the method according to the invention described above.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims

1. An information output method in media playing, comprising:

2. The method of claim 1, wherein the determining the type of the output information corresponding to the voice comment information according to the type of the output information allowed to be received by the second user and the feature information of the media file comprises:

if the type of the output information allowed to be received is voice, determining that the type of the output information is voice;

if the type of the output information allowed to be received is a character, determining that the type of the output information is the character;

and if the type of the output information allowed to be received is voice and characters, determining the type of the output information according to the characteristic information of the media file.

3. The method of claim 2, wherein the characteristic information of the media file includes an attribute of the media file;

the determining the type of the output information according to the feature information of the media file comprises:

if the attribute of the media file is a media file with rich sound, determining the type of the output information as characters;

and if the attribute of the media file is the media file with rich images, determining the type of the output information as voice.

4. The method of claim 2, wherein the characteristic information of the media file includes an attribute of the media file;

if the attribute of the media file is a media file with rich images, judging whether the type of the output information to be sent is determined to be that voice can influence the playing of the output information with the previous type of the second user being voice, if so, determining characters of the output information, otherwise, determining the voice of the output information.

5. The method of claim 2, wherein the characteristic information of the media file comprises attributes of the media file and a playing time window of the audio of the media file itself;

if the attribute of the media file is the media file with rich images, judging whether the type of the output information to be sent is determined to be that voice can influence the playing of the audio of the media file or the output information of which the previous type of the second user is voice according to the playing time window of the audio of the media file, if so, determining that the type of the output information is characters, otherwise, determining the voice of the output information.

6. The method of claim 1, wherein the characteristic information of the media file includes an attribute of the media file;

the determining the type of the output information according to the feature information of the media file includes:

7. The method of claim 1, wherein the determining the type of output information based on the type of output information the second user is allowed to receive comprises:

and if the type of the output information allowed to be received is a character, determining that the type of the output information is the character.

8. The method of any of claims 1-7, wherein the obtaining the type of output information from the voice comment information comprises:

9. An information output method in media playing, comprising:

10. The method of claim 9, wherein said outputting the second output information to the first user comprises:

if the type of the second output information is voice and the playing of the second output information can affect the audio playing of the media file, the audio of the media file is played according to a first audio playing parameter, and the second output information is played according to a second audio playing parameter.

11. The method of claim 9, further comprising:

the user terminal obtains the address of the server by scanning the two-dimensional code displayed on the terminal equipment bound with the user terminal;

12. A server, comprising:

13. The server of claim 12, wherein the output information type determination module is to:

14. The server of claim 12, wherein the output information acquisition module is to:

15. A user terminal, comprising:

16. The user terminal of claim 15, wherein the receiving module is further configured to receive second output information sent by the server;

the user terminal further comprises an output module for outputting the second output information to the first user.

17. The user terminal of claim 15, further comprising:

the acquisition module is used for acquiring the address of the server by scanning the two-dimensional code displayed on the terminal equipment bound with the user terminal;

the sending module is further used for sending the voice comment information to the server according to the address of the server; or, the server is further configured to send the voice comment information and the type of the first user permitted to receive the output information to the server according to the address of the server.

18. A terminal device, comprising:

the receiving module is used for receiving output information corresponding to first voice comment information from a server for processing the voice comment information, wherein the output information is output information of a first user, the first voice comment information aims at a played media file, an address of the server is also received, the address is provided for a user terminal bound by the terminal equipment, so that the user terminal can send second voice comment information input by the first user to the server or send the second voice comment information input by the first user and a type of the first user, which allows the first user to receive the output information, and the second voice comment information aims at the media file; when the server prepares to send output information of a second user corresponding to the second voice comment information, determining the type of the output information corresponding to the second voice comment information according to the type of the output information allowed to be received by the second user and/or the feature information of the media file, wherein the output information is output information of the second user, and obtaining the output information of the second user of the type according to the second voice comment information;

19. The terminal device of claim 18, wherein the output module is further configured to output the address of the server in the form of a two-dimensional code.

20. An information output system in media playing, comprising:

21. An information output system in media playing is characterized by comprising a voice server, a first user terminal, a terminal device bound with the first user terminal, a second user terminal and a terminal device bound with the second user terminal, wherein:

the second user terminal is used for acquiring the address of the voice server from the terminal equipment bound with the second user terminal, and sending the type of the second user, which allows receiving and outputting information, to the voice server according to the address of the voice server;

22. The system of claim 21, further comprising:

and the media server is used for providing the feature information of the media file for the voice server.

23. An information output system in media playing is characterized by comprising a voice server, a first user terminal and a second user terminal, wherein:

24. The system of claim 23, further comprising: