CN105959823A - Message presentation method and device for video direct broadcast application - Google Patents

Message presentation method and device for video direct broadcast application Download PDF

Info

Publication number
CN105959823A
CN105959823A CN201610361788.8A CN201610361788A CN105959823A CN 105959823 A CN105959823 A CN 105959823A CN 201610361788 A CN201610361788 A CN 201610361788A CN 105959823 A CN105959823 A CN 105959823A
Authority
CN
China
Prior art keywords
communication information
message
converted
speech message
described communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610361788.8A
Other languages
Chinese (zh)
Inventor
赵子龙
刘鹏飞
汤晓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201610361788.8A priority Critical patent/CN105959823A/en
Publication of CN105959823A publication Critical patent/CN105959823A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention discloses a message presentation method and a device for a video direct broadcast application and relates to the technical field of terminals. The method comprises steps that a communication message sent by a second user terminal is acquired through a direct broadcast application program of a first user terminal; a voice message converted from the communication message is acquired; the communication message is displayed, and the voice message converted from the communication message is displayed. When an anchor is not convenient to check a character message from a user, the anchor can timely acquire the information from the user, so feedback can be made timely, not only can video playing carried out by the video direct broadcast application be smoothly realized, but also interestingness of the video direct broadcast application can be improved, and thereby user viscosity of the video direct broadcast application can be improved. When voice messages sent by other spectators are displayed on a screen of the second user terminal, the voice messages can be directly received by the user, and checking the messages of the other spectators becomes more convenient for the user.

Description

Message exhibiting method in net cast application and device
Technical field
It relates to field of terminal technology, particularly relate to the message exhibiting method in a kind of net cast application And device.
Background technology
Along with popularizing of net cast application, got more and more by the user of net cast application with anchor exchange. At present, user, when with anchor exchange, generally realizes with the form of word message.
In correlation technique, when user is mutual with main broadcaster, first passing through the net cast application in user terminal will The net cast application that word message sends to main broadcaster's terminal, this word message of main broadcaster's terminal demonstration.User When seeing the programme televised live of main broadcaster, also it is to read the word message that other the spectators users rolled in picture send.
Summary of the invention
For overcoming problem present in correlation technique, the disclosure provides the message exhibition in a kind of net cast application Existing method and device.
First aspect according to disclosure embodiment, it is provided that the message exhibiting method in a kind of net cast application, Described method includes:
By the live application program of first user terminal, obtain the communication information that the second user terminal sends;
Obtain the speech message converted by described communication information, described converted by described communication information Speech message for when described communication information is word message, by converted for described word message;
Show described communication information, and play the speech message converted by described communication information.
In conjunction with first aspect, in the first possible implementation of above-mentioned first aspect, described broadcasting by The speech message that described communication information is converted, including:
Obtain the gender information of the user sending described communication information;
The speech message converted by described communication information is play with the sound that described gender information is corresponding.
In conjunction with first aspect, in the implementation that the second of above-mentioned first aspect is possible, described acquisition The communication information that two user terminals send, obtains the speech message being transformed by described communication information, including:
Receive the communication information that server sends and the speech message being transformed by described communication information, described Communication information is first sent to described server by described second user terminal, described is converted by described communication information Speech message for when described server determines that described communication information is word message, by described word Message is converted.
In conjunction with first aspect, in the third possible implementation of above-mentioned first aspect, described acquisition by The speech message that described communication information is converted, including:
Judge that described communication information is word message or speech message;
When described communication information is word message, in this locality, described communication information is converted to speech message.
In conjunction with the third possible implementation of first aspect, possible the 4th kind of above-mentioned first aspect In implementation, described before described communication information is converted to speech message by this locality, also include:
Judge whether present mode is predetermined to be the pattern that word is automatically converted to voice;
When present mode is predetermined to be the pattern that word is automatically converted to voice, perform described in this locality Communication information is converted to the step of speech message.
In conjunction with first aspect, in the 5th kind of possible implementation of above-mentioned first aspect, described broadcasting by The speech message that described communication information is converted, including:
Obtain current setup information;
Judge whether present mode is predetermined to be automatic played voice message pattern according to described configuration information;
When present mode is predetermined to be automatic played voice message pattern, plays and changed by described communication information Speech message;
When present mode is not predetermined to be automatic played voice message pattern, default speech message detected During play operation, play the speech message converted by described communication information.
In conjunction with the third possible implementation of first aspect, possible the 6th kind of above-mentioned first aspect In implementation, after the described communication information of described judgement is word message or speech message, also include:
When described communication information is speech message, automatically play described communication information.
Second aspect according to disclosure embodiment, it is provided that the message demonstration device in a kind of net cast application, Described device includes:
Acquisition module, for by the live application program of first user terminal, obtaining the second user terminal and send out The communication information sent;
Described acquisition module, is additionally operable to obtain by the converted speech message of described communication information, described by The converted speech message of described communication information is for when described communication information is word message, by described literary composition Word message is converted;
Display module, for showing the communication information that described acquisition module obtains;
Playing module, for playing the voice converted by described communication information that described acquisition module obtains Message.
In conjunction with second aspect, in the first possible implementation of above-mentioned second aspect, described broadcasting mould Block includes:
First acquiring unit, for obtaining the gender information of the user sending described communication information;
First broadcast unit, sound corresponding to gender information obtained for described first acquiring unit play by The speech message that described communication information is converted.
In conjunction with second aspect, in the implementation that the second of above-mentioned second aspect is possible, described acquisition mould Block includes:
Receive unit, for receiving communication information that server sends and being transformed by described communication information Speech message, described communication information is first sent to described server by described second user terminal, described by institute State speech message that communication information is transformed for determining that described communication information is word message when described server Time, by converted for described word message.
In conjunction with second aspect, in the third possible implementation of above-mentioned second aspect, described acquisition mould Block includes:
First judging unit, is used for judging that described communication information is word message or speech message;
First converting unit, is used for when described first judging unit judges that communication information is word message, In this locality, described communication information is converted to speech message.
In conjunction with the third possible implementation of second aspect, possible the 4th kind of above-mentioned second aspect In implementation, described acquisition module also includes:
Second judging unit, is automatically converted to voice for judging whether present mode is predetermined to be by word Pattern;
When described second judging unit, second converting unit, for judging that present mode is predetermined to be word When being automatically converted to the pattern of voice, in this locality, described communication information is converted to speech message.
In conjunction with second aspect, in the 5th kind of possible implementation of above-mentioned second aspect, described broadcasting mould Block includes:
Second acquisition unit, is used for obtaining current setup information;
3rd judging unit, judges present mode for the configuration information obtained according to described second acquisition unit Whether it is predetermined to be automatic played voice message pattern;
Second broadcast unit, broadcasts automatically for judging that present mode is predetermined to be when described 3rd judging unit When putting speech message pattern, play the speech message converted by described communication information;
When described 3rd judging unit, 3rd broadcast unit, for judging that present mode is not predetermined to be automatically During played voice message pattern, when default speech message play operation being detected, play and disappeared by described communication Cease converted speech message.
In conjunction with the third possible implementation of second aspect, possible the 6th kind of above-mentioned second aspect In implementation, described acquisition module also includes:
4th broadcast unit, for when described communication information is speech message, automatically plays described communication and disappears Breath.
The third aspect according to disclosure embodiment, it is provided that the message demonstration device in a kind of net cast application, Described device includes:
Processor;
For storing the memorizer of processor executable;
Wherein, described processor is configured to:
By the live application program of first user terminal, obtain the communication information that the second user terminal sends;
Obtain the speech message converted by described communication information, described converted by described communication information Speech message for when described communication information is word message, by converted for described word message;
Show described communication information, and play the speech message converted by described communication information.
Embodiment of the disclosure that the technical scheme of offer can include following beneficial effect:
When determining that the communication information from the second user terminal is word message, disclosure embodiment provides In method, first user terminal by being converted to speech message by this communication information, and is showing that this communication disappears While breath, play the speech message converted by this communication information, thus ensure to use first user eventually The main broadcaster of end is in some occasions being not easy to check the word message from user, it is possible to know in real time to use by oneself The information at family, and make feedback in time, it is possible not only to ensure the video ratio of net cast application plays smoothly, And the interest of net cast application can be increased such that it is able to increase user's viscosity of net cast application. It addition, user is when watching the programme televised live of main broadcaster, the speech message sent for other spectators, when these Message is when the screen of the second user terminal shows, user can directly listen to, so that user checks it The operation of the message of his spectators also becomes convenient.
It should be appreciated that it is only exemplary and explanatory that above general description and details hereinafter describe, The disclosure can not be limited.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet the present invention Embodiment, and for explaining the principle of the present invention together with description.
Fig. 1 is the message exhibiting method in applying according to a kind of net cast shown in an exemplary embodiment Flow chart.
Fig. 2 is the message exhibiting method in applying according to a kind of net cast shown in an exemplary embodiment Implementation environment schematic diagram.
Fig. 3 is the message exhibiting method in applying according to a kind of net cast shown in an exemplary embodiment Flow chart.
Fig. 4 is the message exhibiting method in applying according to the another kind of net cast shown in an exemplary embodiment Implementation environment schematic diagram.
Fig. 5 is the message exhibiting method in applying according to the another kind of net cast shown in an exemplary embodiment Flow chart.
Fig. 6 is the message demonstration device in applying according to a kind of net cast shown in an exemplary embodiment Block diagram.
Fig. 7 is the block diagram according to a kind of playing module shown in an exemplary embodiment.
Fig. 8 is the message demonstration device in applying according to a kind of net cast shown in an exemplary embodiment Block diagram.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Following retouches Stating when relating to accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element. Embodiment described in following exemplary embodiment does not represent all embodiment party consistent with the present invention Formula.On the contrary, they only with describe in detail in appended claims, the present invention some in terms of mutually one The example of the apparatus and method caused.
Fig. 1 is the message exhibiting method in applying according to a kind of net cast shown in an exemplary embodiment Flow chart.Message exhibiting method in this net cast application is used in first user terminal, this first user Terminal is the terminal that main broadcaster uses.As it is shown in figure 1, the message exhibiting method in this net cast application includes Following steps.
In a step 101, by the live application program of first user terminal, obtain the second user terminal and send out The communication information sent.
In a step 102, obtain the speech message converted by this communication information, should be by this communication information Converted speech message is when this communication information is word message, by converted for this word message.
In step 103, show this communication information, and play the voice by this communication information is converted and disappear Breath.
In the disclosed embodiments, when determining that the communication information from the second user terminal is word message, Disclosure embodiment provide method in, first user terminal by this communication information is converted to speech message, And while showing this communication information, play the speech message converted by this communication information, thus protect Card uses the main broadcaster of first user terminal at some occasions being not easy to check the word message from user, energy Enough know the information from user in real time, and make feedback in time, be possible not only to ensure that net cast application is broadcast The video ratio put smoothly, and can increase the interest of net cast application such that it is able to increases video User's viscosity of live application.It addition, user is when watching the programme televised live of main broadcaster, other spectators are sent out The speech message sent, user can directly listen to, so that user checks the operation of the message of other spectators Also it is convenient to become.
In another embodiment of the disclosure, play the speech message converted by this communication information, including:
Obtain the gender information of the user sending this communication information;
The speech message converted by this communication information is play with the sound that this gender information is corresponding.
In another embodiment of the disclosure, this acquisition second user terminal send communication information, obtain by The speech message that this communication information is transformed, including:
Receive the communication information that server sends and the speech message being transformed by this communication information, this communication Message is first sent to server by the second user terminal, should by the speech message that is transformed of this communication information For when this server determines that described communication information is word message, by converted for this word message.
In another embodiment of the disclosure, this acquisition is by the converted speech message of this communication information, bag Include:
Judge that this communication information is word message or speech message;
When this communication information is word message, in this locality, this communication information is converted to speech message.
In another embodiment of the disclosure, before this communication information is converted to speech message by this locality, also Including:
Judge whether present mode is predetermined to be the pattern that word is automatically converted to voice;
When present mode is predetermined to be the pattern that word is automatically converted to voice, perform this to be led in this locality Letter message is converted to the step of speech message.
In another embodiment of the disclosure, play the speech message converted by this communication information, including:
Obtain current setup information;
Judge whether present mode is predetermined to be automatic played voice message pattern according to this configuration information;
When present mode is predetermined to be automatic played voice message pattern, play changed by this communication information and The speech message become;
When present mode is not predetermined to be automatic played voice message pattern, default speech message detected During play operation, play the speech message converted by this communication information.
In another embodiment of the disclosure, it is judged that after this communication information is word message or speech message, Also include:
When this communication information is speech message, automatically play this communication information.
Above-mentioned all optional technical schemes, all can be according to arbitrarily combining the alternative embodiment forming the disclosure, this This is repeated by open embodiment the most one by one.
Fig. 2 is the message exhibiting method in applying according to a kind of net cast shown in an exemplary embodiment Implementation environment schematic diagram.As in figure 2 it is shown, this implementation environment includes the second user terminal 201 and first user Terminal 202.Wherein, the terminal that first user terminal 202 uses for main broadcaster, the second user terminal is that user makes Terminal.Second user terminal 201 and first user terminal 202 are connected by network, and this network is permissible For cable network, it is also possible to for wireless network.Wherein, the second user terminal 201 and first user terminal 202 On be mounted on net cast application program, user can be by the video installed on the second user terminal 201 Live application program interacts with main broadcaster, the live performance that i.e. viewing main broadcaster sends.
Wherein, the second user terminal 201 and first user terminal 202 can be all desk computer, intelligence Mobile phone, panel computer, E-book reader, MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert's compression standard audio frequency aspect 3) player, MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio frequency aspect 3) player, on knee portable Computer and wearable smart machine, such as any one in Intelligent bracelet etc..
In conjunction with the implementation environment schematic diagram shown in Fig. 2, Fig. 3 is according to the one shown in an exemplary embodiment The flow chart of the message exhibiting method in net cast application.In net cast application described in this embodiment Message exhibiting method is applied in first user terminal.As it is shown on figure 3, the message in this net cast application Exhibiting method comprises the following steps.
In step 301, by the live application program of first user terminal, obtain the second user terminal and send out The communication information sent.
In conjunction with the implementation environment schematic diagram shown in Fig. 2, this embodiment is whole with the second user terminal and first user End has directly communicated the message exhibiting method in the net cast application that disclosure embodiment provides, The most in this embodiment, communication information is directly sent to first user terminal by the second user terminal, and first uses Communication information is also directly sent to the second user terminal by family terminal.Therefore, in this embodiment, first user Terminal, when obtaining the communication information that the second user terminal sends, is connect by the live application program installed on it The communication information receiving the second user terminal transmission realizes.
In step 302, it is judged that this communication information is word message or speech message;When this communication information During for word message, perform step 303;When this communication information is speech message, perform step 305.
Wherein, owing to different types of communication information often has different forms, such as, speech message Form is mp3 etc., and the form of image information is jpg etc., and therefore, first user terminal is judging this communication When message is word message or speech message, can first resolve this communication information, obtain this communication information Form;Then, determine that this communication information is word message or speech message according to the form of this communication information.
In step 303, in this locality, this communication information is converted to speech message.
In the disclosed embodiments, when this communication information is word message, first user terminal is used first This communication information is converted to speech message by family terminal local.Wherein, disappear communication information is converted to voice During breath, can be applied or change plug-in unit by conversion and realize.
Alternatively, in disclosure embodiment, communication information is converted to voice in this locality and disappears by first user terminal During breath, can be that first user terminal pre-sets conversion automatically, on this basis, when determining communication information During for word message, it is automatically obtained conversion;Can also be that first user terminal is determining that this communication information is for literary composition During word message, realize conversion according to the operation of user.Therefore, in this locality, communication information is converted to voice disappear Before breath, first user terminal can also judge whether present mode is predetermined to be and word is automatically converted to language The pattern of sound.When present mode is predetermined to be the pattern that word is automatically converted to voice, then perform at this Communication information is converted to the step of speech message by ground.When present mode is not predetermined to be, word is changed automatically During for the pattern of voice, then detect whether to receive the finger that word message is converted to speech message that user sends Order, and when this instruction being detected, perform to be converted to by communication information the step of speech message in this locality.
Wherein, when judging whether present mode is predetermined to be the pattern that word is automatically converted to voice, the One user terminal can first obtain the configuration information of self, and searches whether to exist automatically in this configuration information Word is automatically converted to the data of the pattern of voice, automatically word is turned automatically when this configuration information exists During the data of the pattern being changed to voice, it may be determined that present mode is predetermined to be and word is automatically converted to voice Pattern;Otherwise, it determines present mode is not predetermined to be the pattern that word is automatically converted to voice.
When being predetermined to be the pattern that word is automatically converted to voice, determining that communication information is word message Time, directly change, change easy to operate and conversion speed ratio is very fast.
In step 304, show this communication information, and play the voice by this communication information is converted and disappear Breath, end operation.
Due in some special screnes, such as, main broadcaster runs, body-building, driving etc., when second uses Family terminal to the message that first user terminal sends be word message time, main broadcaster's not easy-to-read, therefore, In the disclosed embodiments, main broadcaster, when showing this communication information, while display communication message, also can Play the speech message converted by this communication information.
Alternatively, when playing by the speech message that communication information is converted, can be to disappear in display communication While breath, directly play the speech message converted by this communication information, it is also possible to according to main broadcaster Operate and play the speech message converted by this communication information.Therefore, disclosure embodiment play by During the converted speech message of this communication information, can (1) to step (4) come real as follows Existing:
(1), current setup information is obtained.
Wherein, current setup information is the information of the state that can reflect that current first user terminal is configured to, Can know what kind of function is first user terminal currently have been assigned by current setup information.
(2), judge whether present mode is predetermined to be automatic played voice message pattern according to configuration information; When present mode is predetermined to be automatic played voice message pattern, perform step (3);When present mode not When being predetermined to be automatic played voice message pattern, perform step (4).
Wherein, judge whether present mode is predetermined to be automatic played voice message pattern according to configuration information Mode and above-mentioned steps 303 judge whether present mode is predetermined to be the mould that word is automatically converted to voice The principle of formula is similar, specifically can be found in the content in above-mentioned steps 303, and here is omitted.
(3), the speech message converted by this communication information is play.
Wherein, when playing by the speech message that this communication information is converted, can be broadcast by preset audio frequency Put application or plug-in unit realizes.
This kind of mode, while showing this communication information, plays the language converted by this communication information automatically Sound message so that show this communication information and the operation playing the speech message converted by this communication information Coherent, it is simple to main broadcaster knows the content of the communication information from user in real time, and then makes feedback in time.
(4), when default speech message play operation being detected, this is play converted by communication information Speech message.
This kind of mode is that the speech message converted by this communication information is play in operation based on main broadcaster, makes Obtaining main broadcaster controls whether play the speech message converted by this communication information, main broadcaster can be in conjunction with self institute Place's occasion and determining whether plays this by the converted speech message of this communication information.
Alternatively, when playing by the speech message that this communication information is converted, for the use of different sexes Family, can use different sound to play out.Therefore, the language converted by this communication information is being play During sound message, it is also possible to first obtain the gender information of the user sending communication information and corresponding with gender information Sound play by the converted speech message of this communication information.Such as, when user is male, permissible The sound of male plays the speech message converted by this communication information.When user is women, can be with female Property sound play by the converted speech message of this communication information.
Further, for same sex, it is also possible to arrange multiple different sound, such as, " Li Yifeng " Sound, " yellow Bohai Sea sound etc. ", main broadcaster can select sound to play out according to the hobby of oneself.
The speech message converted by this communication information is play so that the sound of broadcasting is more by this kind of mode Tool interest such that it is able to improve main broadcaster and experience, and then user's viscosity can be increased.
In step 305, communication information is automatically play.
In this embodiment, when this communication information is speech message, can automatically play this communication information. Wherein, when automatically playing communication information, it is also possible to by the broadcasting described in above-mentioned steps 304 by communicating The mode of the speech message that message is converted realizes, and specifically can be found in the content in above-mentioned steps 304, this Place repeats no more.
The method that disclosure embodiment provides, is that word disappears when determining from the communication information of the second user terminal During breath, first user terminal by being converted to speech message by this communication information, and is showing this communication information While, play the speech message converted by this communication information, thus ensure to use first user terminal Main broadcaster in some occasions being not easy to check the word message from user, it is possible to know in real time from user Information, and make feedback in time, be possible not only to ensure the video ratio of net cast application plays smoothly, And the interest of net cast application can be increased such that it is able to increase user's viscosity of net cast application. It addition, user is when watching the programme televised live of main broadcaster, the speech message sent for other spectators, when these Message is when the screen of the second user terminal shows, user can directly listen to, so that user checks it The operation of the message of his spectators also becomes convenient.
Fig. 4 is the message exhibiting method in applying according to the another kind of net cast shown in an exemplary embodiment Implementation environment schematic diagram.As shown in Figure 4, this implementation environment includes the second user terminal 401, first user Terminal 402 and server 403.Wherein, the terminal that first user terminal 202 uses for main broadcaster, the second user Terminal is the terminal that user uses.Second user terminal 401 and first user terminal 402 pass through network respectively Being connected with server 403, this network can be cable network, it is also possible to for wireless network.Wherein, second Net cast application program, server 403 it is mounted on user terminal 401 and first user terminal 402 Net cast service can be provided.User can be answered by the net cast installed on the second user terminal 401 Interact with main broadcaster by program, the live performance that i.e. viewing main broadcaster sends.
Wherein, server 403 can be a single server, it is also possible to be a server cluster. When server 403 is a single server, this alone server complete the embodiment of the present invention takes Business function performed by device;When server 403 is a server cluster, by each clothes in this cluster Business device has coordinated the message exhibiting method in the net cast application that the embodiment of the present invention provides.
Wherein, the second user terminal 401 and first user terminal 402 can be all desk computer, intelligence Mobile phone, panel computer, E-book reader, MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert's compression standard audio frequency aspect 3) player, MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert's compression standard audio frequency aspect 3) player, on knee portable Computer and wearable smart machine, such as any one in Intelligent bracelet etc..
In conjunction with the implementation environment schematic diagram shown in above-mentioned Fig. 4, Fig. 5 illustrates according to an exemplary embodiment The flow chart of the message exhibiting method in another kind of net cast application, the message exhibition in this net cast application Existing method is in first user terminal.As it is shown in figure 5, the message exhibiting method in this net cast application Comprise the following steps.
In step 501, by the live application program of first user terminal, obtain the second user terminal and send out The communication information sent, obtains by the converted speech message of this communication information, this communication information change and The speech message become is when server determines that this communication information is word message, and word message is converted.
In conjunction with the implementation environment shown in Fig. 4, in this embodiment, the second user terminal and first user terminal Being interacted by server, the i.e. second user terminal sends to the message of first user terminal and by first User terminal sends to the message of the second user terminal, is required to first to send to server, by server again under Send out.Therefore, in this embodiment, obtaining the communication information that user terminal sends, and acquisition is being led to by this When believing the speech message of message transformation, first user terminal is by receiving the communication information that server sends And the speech message being transformed by this communication information realizes.
Specifically, server is when receiving the communication information from the second user terminal, it is also possible to first judging should Communication information is word message or speech message;When this communication information is word message, this communication is disappeared Breath is converted to speech message.Wherein, server judges that this communication information is word message or speech message Mode and word message is converted to the mode of speech message, uses with in step 302 and step 303 first Terminal judges this communication information in family is the mode of word message or speech message, and is changed by communication information Mode for speech message is similar to, and specifically can be found in the content in above-mentioned steps 302 and step 303, herein Repeat no more.
Further, server is before being converted to speech message by this communication information, it is also possible to judge first Whether the present mode of user terminal is predetermined to be the pattern that word is automatically converted to voice;Work as first user When the present mode of terminal is predetermined to be the pattern that word is automatically converted to voice, perform to turn communication information It is changed to the step of speech message.
Wherein, server judges whether the present mode of first user terminal is predetermined to be and is automatically changed by word For first user terminal judges present mode in the mode of the pattern of voice, with above-mentioned steps 303 whether by advance The principle being set to be automatically converted to word the pattern of voice is similar to, and specifically can be found in above-mentioned steps 303 Content, portion repeats again herein.
In step 502, display communication message, and play the speech message converted by communication information.
The principle of this step is similar to the principle in above-mentioned steps 304, specifically can be found in above-mentioned steps 304 Content, here is omitted.
Alternatively, when server determines that this communication information is speech message, this communication is directly disappeared by server Breath sends to first user terminal, and first user terminal plays communication information automatically.
The method that disclosure embodiment provides, when first user terminal determines the communication from the second user terminal When message is word message, by this communication information being converted to speech message, and showing this communication information While, play the speech message converted by this communication information, thus ensure to use first user terminal Main broadcaster in some occasions being not easy to check the word message from user, it is possible to know in real time from user Information, and make feedback in time, be possible not only to ensure the video ratio of net cast application plays smoothly, And the interest of net cast application can be increased such that it is able to increase user's viscosity of net cast application. It addition, user is when watching the programme televised live of main broadcaster, the speech message sent for other spectators, when these Message is when the screen of the second user terminal shows, user can directly listen to, so that user checks it The operation of the message of his spectators also becomes convenient.
Fig. 6 is the message demonstration device frame in applying according to a kind of net cast shown in an exemplary embodiment Figure.With reference to Fig. 6, the message demonstration device in this net cast application includes:
Acquisition module 601, for by the live application program of first user terminal, obtaining the second user terminal The communication information sent;
Acquisition module 601, is additionally operable to obtain the speech message converted by this communication information, this communication disappears Ceasing converted speech message is when this communication information is word message, by converted for this word message;
Display module 602, for showing this communication information that acquisition module 601 obtains;
Playing module 603, for playing the voice converted by this communication information that acquisition module 601 obtains Message.
With reference to Fig. 7, this playing module 603 includes:
First acquiring unit 6031, for obtaining the gender information of the user sending this communication information;
First broadcast unit 6032, for the sound that the gender information with the first acquiring unit 6031 acquisition is corresponding Play the speech message converted by this communication information.
In another embodiment of the disclosure, acquisition module 601 includes:
Receive unit, for receiving the communication information that server sends and the language being transformed by this communication information Sound message, communication information is first sent to server by the second user terminal, this communication information is transformed Speech message is when this server determines that this communication information is word message, by converted for this word message.
In another embodiment of the disclosure, acquisition module 601 includes:
First judging unit, is used for judging that this communication information is word message or speech message;
First converting unit, is used for when this first judging unit judges that this communication information is word message, In this locality, this communication information is converted to speech message.
In another embodiment of the disclosure, acquisition module 601 also includes:
Second judging unit, is automatically converted to voice for judging whether present mode is predetermined to be by word Pattern;
When this second judging unit, second converting unit, for judging that present mode is predetermined to be by word certainly When moving the pattern being converted to voice, in this locality, this communication information is converted to speech message.
In another embodiment of the disclosure, playing module 603 includes:
Second acquisition unit, is used for obtaining current setup information;
For the configuration information obtained according to this second acquisition unit, 3rd judging unit, judges that present mode is No it is predetermined to be automatic played voice message pattern;
When the 3rd judging unit, second broadcast unit, for judging that present mode is predetermined to be broadcasting automatically During speech message pattern, play the speech message converted by this communication information;
3rd broadcast unit, broadcasts automatically for judging that present mode is not predetermined to be when the 3rd judging unit When putting speech message pattern, when default speech message play operation being detected, play and turned by this communication information The speech message changed.
In another embodiment of the disclosure, acquisition module 601 also includes:
4th broadcast unit, for when this communication information is speech message, plays this communication information automatically.
In the disclosed embodiments, determine from the second user terminal communication message for civilian when first user terminal During word message, by this communication information being converted to speech message, and while showing this communication information, Play the speech message converted by this communication information, thus ensure that the main broadcaster using first user terminal exists Some occasions being not easy to check the word message from user, it is possible to know the information from user in real time, And make feedback in time, it is possible not only to ensure the video ratio of net cast application plays smoothly, and can Increase the interest of net cast application such that it is able to increase user's viscosity of net cast application.It addition, User is when watching the programme televised live of main broadcaster, and the speech message sent for other spectators, when these message exist When the screen of the second user terminal shows, user can directly listen to, so that user checks other spectators The operation of message also become convenient.
About the device in above-described embodiment, wherein modules performs the concrete mode of operation relevant The embodiment of the method is described in detail, explanation will be not set forth in detail herein.
Fig. 8 is to represent according to a kind of message in net cast is applied shown in an exemplary embodiment The block diagram of device 800.Such as, device 800 can be mobile phone, computer, digital broadcast terminal, Messaging devices, game console, tablet device, armarium, body-building equipment, personal digital assistant Deng.
With reference to Fig. 8, device 800 can include following one or more assembly: processes assembly 802, memorizer 804, power supply module 806, multimedia groupware 808, audio-frequency assembly 810, the interface of input/output (I/O) 812, sensor cluster 814, and communications component 816.
Process assembly 802 and generally control the integrated operation of device 800, such as with display, call, number The operation being associated according to communication, camera operation and record operation.Process assembly 802 and can include one or many Individual processor 820 performs instruction, to complete all or part of step of above-mentioned method.Additionally, process Assembly 802 can include one or more module, it is simple to process between assembly 802 and other assemblies is mutual. Such as, process assembly 802 and can include multi-media module, to facilitate multimedia groupware 808 and to process assembly Mutual between 802.
Memorizer 804 is configured to store various types of data to support the operation at device 800.These The example of data includes any application program for operation on device 800 or the instruction of method, contact person Data, telephone book data, message, picture, video etc..Memorizer 804 can be by any kind of volatile Property or non-volatile memory device or combinations thereof realize, such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory EPROM (EPROM), Programmable read only memory (PROM), read only memory (ROM), magnetic memory, flash memory, Disk or CD.
The various assemblies that power supply module 806 is device 800 provide power supply.Power supply module 806 can include electricity Management system, one or more power supplys, and other generate, manage and distribute power supply phase with for device 800 The assembly of association.
The screen of one output interface of offer that multimedia groupware 808 is included between described device 800 and user Curtain.In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).As Really screen includes that touch panel, screen may be implemented as touch screen, to receive the input signal from user. Touch panel includes that one or more touch sensor is with the gesture on sensing touch, slip and touch panel. Described touch sensor can not only sense touch or the border of sliding action, but also detects and described touch Or slide relevant persistent period and pressure.In certain embodiments, multimedia groupware 808 includes one Individual front-facing camera and/or post-positioned pick-up head.When device 800 is in operator scheme, such as screening-mode or video During pattern, front-facing camera and/or post-positioned pick-up head can receive the multi-medium data of outside.Each preposition take the photograph As head and post-positioned pick-up head can be fixing optical lens systems or have focal length and optical zoom energy Power.
Audio-frequency assembly 810 is configured to output and/or input audio signal.Such as, audio-frequency assembly 810 includes One mike (MIC), when device 800 is in operator scheme, such as call model, logging mode and voice During recognition mode, mike is configured to receive external audio signal.The audio signal received can be entered One step is stored in memorizer 804 or sends via communications component 816.In certain embodiments, audio-frequency assembly 810 also include a speaker, are used for exporting audio signal.
I/O interface 812 provides interface, above-mentioned peripheral interface for processing between assembly 802 and peripheral interface module Module can be keyboard, puts striking wheel, button etc..These buttons may include but be not limited to: home button, sound Amount button, start button and locking press button.
Sensor cluster 814 includes one or more sensor, for providing various aspects for device 800 State estimation.Such as, what sensor cluster 814 can detect device 800 opens/closed mode, assembly Relative localization, the most described assembly is display and the keypad of device 800, and sensor cluster 814 is also Device 800 or the position change of 800 1 assemblies of device, user and depositing that device 800 contacts can be detected Or do not exist, device 800 orientation or acceleration/deceleration and the variations in temperature of device 800.Sensor cluster 814 Proximity transducer can be included, be configured to when there is no any physical contact depositing of object near detection ?.Sensor cluster 814 can also include optical sensor, such as CMOS or ccd image sensor, is used for Imaging applications uses.In certain embodiments, this sensor cluster 814 can also include that acceleration passes Sensor, gyro sensor, Magnetic Sensor, pressure transducer or temperature sensor.
Communications component 816 is configured to facilitate the logical of wired or wireless mode between device 800 and other equipment Letter.Device 800 can access wireless network based on communication standard, such as WiFi, 2G or 3G, or they Combination.In one exemplary embodiment, communication component 816 receives wide from outside via broadcast channel The broadcast singal of broadcast management system or broadcast related information.In one exemplary embodiment, described communication set Part 816 also includes near-field communication (NFC) module, to promote junction service.Such as, can in NFC module Based on RF identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra broadband (UWB) skill Art, bluetooth (BT) technology and other technologies realize.
In the exemplary embodiment, device 800 can by one or more application specific integrated circuits (ASIC), Digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), Field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are real Existing, it is used for performing said method.
In the exemplary embodiment, a kind of non-transitory computer-readable storage medium including instruction is additionally provided Matter, such as, include the memorizer 804 of instruction, and above-mentioned instruction can be performed by the processor 820 of device 800 with complete Become said method.Such as, described non-transitory computer-readable recording medium can be ROM, random access memory Memorizer (RAM), CD-ROM, tape, floppy disk and optical data storage devices etc..
A kind of non-transitory computer-readable recording medium, when the instruction in described storage medium is by mobile terminal Processor perform time so that mobile terminal is able to carry out as involved by above-mentioned Fig. 1 or Fig. 3 embodiment Plant the message exhibiting method in net cast application.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to this Other bright embodiment.The application is intended to any modification, purposes or the adaptations of the present invention, These modification, purposes or adaptations are followed the general principle of the present invention and include that the disclosure is not disclosed Common knowledge in the art or conventional techniques means.Description and embodiments is considered only as exemplary , true scope and spirit of the invention are pointed out by claim below.
It should be appreciated that the invention is not limited in accurate knot described above and illustrated in the accompanying drawings Structure, and various modifications and changes can carried out without departing from the scope.The scope of the present invention is only by appended Claim limits.

Claims (15)

1. the message exhibiting method in a net cast application, it is characterised in that described method includes:
By the live application program of first user terminal, obtain the communication information that the second user terminal sends;
Obtain the speech message converted by described communication information, described converted by described communication information Speech message for when described communication information is word message, by converted for described word message;
Show described communication information, and play the speech message converted by described communication information.
Method the most according to claim 1, it is characterised in that described broadcasting is turned by described communication information The speech message changed, including:
Obtain the gender information of the user sending described communication information;
The speech message converted by described communication information is play with the sound that described gender information is corresponding.
Method the most according to claim 1, it is characterised in that described acquisition the second user terminal sends Communication information, obtain the speech message that is transformed by described communication information, including:
Receive the communication information that server sends and the speech message being transformed by described communication information, described Communication information is first sent to described server by described second user terminal, described is converted by described communication information Speech message for when described server determines that described communication information is word message, by described word Message is converted.
Method the most according to claim 1, it is characterised in that described acquisition is turned by described communication information The speech message changed, including:
Judge that described communication information is word message or speech message;
When described communication information is word message, in this locality, described communication information is converted to speech message.
Method the most according to claim 4, it is characterised in that described in this locality by described communication information Before being converted to speech message, also include:
Judge whether present mode is predetermined to be the pattern that word is automatically converted to voice;
When present mode is predetermined to be the pattern that word is automatically converted to voice, perform described in this locality Communication information is converted to the step of speech message.
Method the most according to claim 1, it is characterised in that described broadcasting is turned by described communication information The speech message changed, including:
Obtain current setup information;
Judge whether present mode is predetermined to be automatic played voice message pattern according to described configuration information;
When present mode is predetermined to be automatic played voice message pattern, plays and changed by described communication information Speech message;
When present mode is not predetermined to be automatic played voice message pattern, default speech message detected During play operation, play the speech message converted by described communication information.
Method the most according to claim 4, it is characterised in that the described communication information of described judgement is literary composition After word message or speech message, also include:
When described communication information is speech message, automatically play described communication information.
8. the message demonstration device in a net cast application, it is characterised in that described device includes:
Acquisition module, for by the live application program of first user terminal, obtaining the second user terminal and send out The communication information sent;
Described acquisition module, is additionally operable to obtain by the converted speech message of described communication information, described by The converted speech message of described communication information is for when described communication information is word message, by described literary composition Word message is converted;
Display module, for showing the communication information that described acquisition module obtains;
Playing module, for playing the voice converted by described communication information that described acquisition module obtains Message.
Device the most according to claim 8, it is characterised in that described playing module includes:
First acquiring unit, for obtaining the gender information of the user sending described communication information;
First broadcast unit, plays for the sound corresponding with the gender information of described first acquiring unit acquisition The speech message converted by described communication information.
Device the most according to claim 8, it is characterised in that described acquisition module includes:
Receive unit, for receiving communication information that server sends and being transformed by described communication information Speech message, described communication information is first sent to described server by described second user terminal, described by institute State speech message that communication information is transformed for determining that described communication information is word message when described server Time, by converted for described word message.
11. devices according to claim 8, it is characterised in that described acquisition module includes:
First judging unit, is used for judging that described communication information is word message or speech message;
When described first judging unit, first converting unit, for judging that described communication information is word message Time, in this locality, described communication information is converted to speech message.
12. devices according to claim 11, it is characterised in that described acquisition module also includes:
Second judging unit, is automatically converted to voice for judging whether present mode is predetermined to be by word Pattern;
When described second judging unit, second converting unit, for judging that present mode is predetermined to be word When being automatically converted to the pattern of voice, in this locality, described communication information is converted to speech message.
13. devices according to claim 8, it is characterised in that described playing module includes:
Second acquisition unit, is used for obtaining current setup information;
3rd judging unit, judges present mode for the configuration information obtained according to described second acquisition unit Whether it is predetermined to be automatic played voice message pattern;
Second broadcast unit, broadcasts automatically for judging that present mode is predetermined to be when described 3rd judging unit When putting speech message pattern, play the speech message converted by described communication information;
When described 3rd judging unit, 3rd broadcast unit, for judging that present mode is not predetermined to be automatically During played voice message pattern, when default speech message play operation being detected, play and disappeared by described communication Cease converted speech message.
14. devices according to claim 11, it is characterised in that described acquisition module also includes:
4th broadcast unit, for when described communication information is speech message, automatically plays described communication and disappears Breath.
Message demonstration device in 15. 1 kinds of net cast application, it is characterised in that described device includes:
Processor;
For storing the memorizer of processor executable;
Wherein, described processor is configured to:
By the live application program of first user terminal, obtain the communication information that the second user terminal sends;
Obtain the speech message converted by described communication information, described converted by described communication information Speech message for when described communication information is word message, by converted for described word message;
Show described communication information, and play the speech message converted by described communication information.
CN201610361788.8A 2016-05-26 2016-05-26 Message presentation method and device for video direct broadcast application Pending CN105959823A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610361788.8A CN105959823A (en) 2016-05-26 2016-05-26 Message presentation method and device for video direct broadcast application

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610361788.8A CN105959823A (en) 2016-05-26 2016-05-26 Message presentation method and device for video direct broadcast application

Publications (1)

Publication Number Publication Date
CN105959823A true CN105959823A (en) 2016-09-21

Family

ID=56910728

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610361788.8A Pending CN105959823A (en) 2016-05-26 2016-05-26 Message presentation method and device for video direct broadcast application

Country Status (1)

Country Link
CN (1) CN105959823A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106682976A (en) * 2016-12-19 2017-05-17 天脉聚源(北京)传媒科技有限公司 Method and apparatus for auctioning objects
CN106685808A (en) * 2017-01-17 2017-05-17 百度在线网络技术(北京)有限公司 Live event flow message passing method and device
CN109168017A (en) * 2018-10-16 2019-01-08 深圳市三叶虫科技有限公司 A kind of net cast interaction systems and living broadcast interactive mode based on intelligent glasses
CN109413261A (en) * 2018-09-03 2019-03-01 珠海格力电器股份有限公司 Reminding method and terminal device during a kind of application is interactive
CN109474831A (en) * 2018-08-31 2019-03-15 北京潘达互娱科技有限公司 A kind of live streaming voice-transmission system, method, electronic equipment and storage medium
CN111107320A (en) * 2020-02-23 2020-05-05 国都建业建设集团(北京)有限公司 Interior decoration construction remote monitering system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1941747A (en) * 2005-09-27 2007-04-04 腾讯科技(深圳)有限公司 Demand telecommunicating method and system
CN103632670A (en) * 2013-11-30 2014-03-12 青岛英特沃克网络科技有限公司 Voice and text message automatic conversion system and method
CN103634681A (en) * 2013-11-29 2014-03-12 腾讯科技(成都)有限公司 Method, device, client end, server and system for live broadcasting interaction
CN104754396A (en) * 2015-03-12 2015-07-01 腾讯科技(北京)有限公司 Curtain popup data display method and device
CN104869467A (en) * 2015-03-26 2015-08-26 腾讯科技(北京)有限公司 Information output method and system for media playing, and apparatuses
CN105100511A (en) * 2014-05-23 2015-11-25 三星电子株式会社 System and method of providing voice-message call service

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1941747A (en) * 2005-09-27 2007-04-04 腾讯科技(深圳)有限公司 Demand telecommunicating method and system
CN103634681A (en) * 2013-11-29 2014-03-12 腾讯科技(成都)有限公司 Method, device, client end, server and system for live broadcasting interaction
CN103632670A (en) * 2013-11-30 2014-03-12 青岛英特沃克网络科技有限公司 Voice and text message automatic conversion system and method
CN105100511A (en) * 2014-05-23 2015-11-25 三星电子株式会社 System and method of providing voice-message call service
CN104754396A (en) * 2015-03-12 2015-07-01 腾讯科技(北京)有限公司 Curtain popup data display method and device
CN104869467A (en) * 2015-03-26 2015-08-26 腾讯科技(北京)有限公司 Information output method and system for media playing, and apparatuses

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106682976A (en) * 2016-12-19 2017-05-17 天脉聚源(北京)传媒科技有限公司 Method and apparatus for auctioning objects
CN106685808A (en) * 2017-01-17 2017-05-17 百度在线网络技术(北京)有限公司 Live event flow message passing method and device
CN109474831A (en) * 2018-08-31 2019-03-15 北京潘达互娱科技有限公司 A kind of live streaming voice-transmission system, method, electronic equipment and storage medium
CN109413261A (en) * 2018-09-03 2019-03-01 珠海格力电器股份有限公司 Reminding method and terminal device during a kind of application is interactive
CN109168017A (en) * 2018-10-16 2019-01-08 深圳市三叶虫科技有限公司 A kind of net cast interaction systems and living broadcast interactive mode based on intelligent glasses
CN111107320A (en) * 2020-02-23 2020-05-05 国都建业建设集团(北京)有限公司 Interior decoration construction remote monitering system

Similar Documents

Publication Publication Date Title
CN105959823A (en) Message presentation method and device for video direct broadcast application
CN105100829B (en) Video content intercept method and device
CN104168503B (en) The method and device of shared video information
CN106331761A (en) Live broadcast list display method and apparatuses
CN105120191A (en) Video recording method and device
CN106162230A (en) The processing method of live information, device, Zhu Boduan, server and system
CN112738544B (en) Live broadcast room interaction method and device, electronic equipment and storage medium
CN105450736A (en) Method and device for establishing connection with virtual reality
CN113065008A (en) Information recommendation method and device, electronic equipment and storage medium
CN104092749A (en) Method and device for synchronizing photos
CN111327916B (en) Live broadcast management method, device and equipment based on geographic object and storage medium
CN104202624A (en) Method and device for transmitting picture
CN104391711A (en) Method and device for setting screen protection
CN105120301A (en) Video processing method and apparatus, and intelligent equipment
CN106101773A (en) Content is with shielding method, device and display device
CN105898573A (en) Method and device for multimedia file playing
CN104035674A (en) Picture displaying method and device
CN104903844A (en) Method for rendering data in a network and associated mobile device
CN105872573A (en) Video playing method and apparatus
CN106375178A (en) Message display method and device based on instant messaging
CN107147567A (en) Position information share method, equipment and system
CN112131473B (en) Information recommendation method, device, equipment and storage medium
CN106453609A (en) Method and device for retrieving mobile terminal
US20090239577A1 (en) Method and system for multimedia captures with remote triggering
CN114285938B (en) Equipment recommendation method and device and computer readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160921

RJ01 Rejection of invention patent application after publication