CN104808964B - A kind of information processing method and client - Google Patents

A kind of information processing method and client Download PDF

Info

Publication number
CN104808964B
CN104808964B CN201510221669.8A CN201510221669A CN104808964B CN 104808964 B CN104808964 B CN 104808964B CN 201510221669 A CN201510221669 A CN 201510221669A CN 104808964 B CN104808964 B CN 104808964B
Authority
CN
China
Prior art keywords
input information
information
input
instruction
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510221669.8A
Other languages
Chinese (zh)
Other versions
CN104808964A (en
Inventor
左洪涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Beijing Co Ltd
Original Assignee
Tencent Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Beijing Co Ltd filed Critical Tencent Technology Beijing Co Ltd
Priority to CN201510221669.8A priority Critical patent/CN104808964B/en
Publication of CN104808964A publication Critical patent/CN104808964A/en
Application granted granted Critical
Publication of CN104808964B publication Critical patent/CN104808964B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a kind of information processing method and client.Methods described includes:When detection multimedia messages are in broadcast state, the first input information is detected;The first input information is used to characterize operation input information;When determining that the first input information meets the first preparatory condition, the input information of collection second;The second input information is used to characterize speech input information;The second input information is identified, is text information by predetermined manner conversion the second input information, when determining that the text information meets the second preparatory condition, exports the text information.

Description

A kind of information processing method and client
Technical field
The present invention relates to the information processing technology, and in particular to a kind of information processing method and client.
Background technology
In the playing process of multimedia messages (being specially Online Video), user manually can enter inputting word information Row comment, can so increase the interaction between user, lift the participation of user.
But present inventor at least has found correlation technique during the embodiment of the present application technical scheme is realized In following technical problem be present:
It is the input that can not realize voice remark information in the playing process of multimedia messages.How multimedia is realized The input of voice remark information in the playing process of information, in correlation technique, for the problem, it there is no effective solution.
The content of the invention
To solve existing technical problem, the embodiment of the present invention provides a kind of information processing method and client, energy Enough realize the input of voice messaging when multimedia messages play.
To reach above-mentioned purpose, what the technical scheme of the embodiment of the present invention was realized in:
The embodiments of the invention provide a kind of information processing method, methods described includes:
When detection multimedia messages are in broadcast state, the first input information is detected;The first input information is used for Characterize operation input information;
When determining that the first input information meets the first preparatory condition, the input information of collection second;Second input Information is used to characterize speech input information;
The second input information is identified, is text information by predetermined manner conversion the second input information, determines institute When stating text information the second preparatory condition of satisfaction, the text information is exported.
In such scheme, when the collection second inputs information, methods described also includes:
The instruction of generation first, the sound for the broadcast window for reducing the multimedia messages based on the described first instruction control are defeated Go out parameter;
Accordingly, when the described second input information stops collection, methods described also includes:
The instruction of generation second, the sound for the broadcast window for recovering the multimedia messages based on the described second instruction control are defeated Go out parameter.
In such scheme, when the determination text information meets the second preparatory condition, methods described also includes:
Obtain the current reproduction time parameter of the multimedia messages;
Accordingly, the output text information, including:Export the text information and the time parameter.
It is described to determine that the first input information meets the first preparatory condition in such scheme, including:
Based on described first input information generation first instruction, judge it is described first instruct whether with the first preset instructions Match somebody with somebody, obtain the second judged result;
When second judged result is that the described first instruction matches with first preset instructions, described first is determined Input information and meet the first preparatory condition.
In such scheme, the input of collection second information, including:
When detecting the first input information for meeting the first preparatory condition, collection the second input information;
Accordingly, when the first input information of the first preparatory condition of the satisfaction stops, the second input letter is stopped The collection of breath.
It is described to determine that the text information meets the second preparatory condition in such scheme, including:
Text information described in output display;
The 3rd input information for the text information is detected, is referred to based on the described 3rd input information generation second Order;
When confirming that second instruction characterizes confirmation response instruction, determine that the text information meets the second preparatory condition.
The embodiment of the present invention additionally provides a kind of client, and the client includes:Detection unit, collecting unit, analysis Unit and output unit;Wherein,
The detection unit, when being in broadcast state for detecting multimedia messages, detect the first input information;It is described First input information is used to characterize operation input information;
The collecting unit, when determining that the first input information meets the first preparatory condition for the detection unit, The input information of collection second;The second input information is used to characterize speech input information;
The analytic unit, for identifying the second input information of the collecting unit collection, turn by predetermined manner It is text information to change the second input information;
The output unit, for determining that the text information after the analytic unit conversion meets the second preparatory condition When, export the text information.
In such scheme, the client also includes control unit, for collecting unit collection the second input information When, the instruction of generation first, the sound for the broadcast window for reducing the multimedia messages based on the described first instruction control exports ginseng Number;It is additionally operable to, when the described second input information stops collection, the instruction of generation second, recover institute based on the described second instruction control State the sound output parameter of the broadcast window of multimedia messages.
In such scheme, the analytic unit, when being additionally operable to determine that the text information meets the second preparatory condition, obtain The current reproduction time parameter of the multimedia messages;
Accordingly, the output unit, for exporting the text information and the time parameter.
In such scheme, the detection unit, for being instructed based on the described first input information generation first, described in judgement Whether the first instruction matches with the first preset instructions, obtains the second judged result;When the described first instruction is preset with described first During instructions match, determine that the first input information meets the first preparatory condition.
In such scheme, the detection unit, when being additionally operable to detect the first input information for meeting the first preparatory condition, The enabled collecting unit collection the second input information.
In such scheme, the client also includes display unit, after analytic unit conversion described in output display Text information;
The detection unit, it is additionally operable to detect the 3rd input of the text information shown for the display unit Information, based on the described 3rd input information the second instruction of generation;When confirming that second instruction characterizes confirmation response instruction, it is determined that The text information meets the second preparatory condition.
Information processing method provided in an embodiment of the present invention and client, broadcast state is in by detecting multimedia messages When, detect the first input information;The first input information is used to characterize operation input information;Determine the first input letter When breath meets the first preparatory condition, the input information of collection second;The second input information is used to characterize speech input information;Know Not described second input information, it is text information by predetermined manner conversion the second input information, determines the text information When meeting the second preparatory condition, the text information is exported.In this way, using the technical scheme of the embodiment of the present invention, realize more When media information (i.e. Internet video) plays, the input of comment information is realized by way of phonetic entry, enriches more matchmakers Comment input mode in the playing process of body information, the manually operated of increase user is avoided, improves the operating body of user Test.
Brief description of the drawings
Fig. 1 is the schematic flow sheet of the information processing method of the embodiment of the present invention one;
Fig. 2 is the schematic flow sheet of the information processing method of the embodiment of the present invention two;
Fig. 3 is the schematic diagram of a scenario of the input of collection second information in the embodiment of the present invention two;
Fig. 4 is the schematic diagram of a scenario of the input of detection the 3rd information in the embodiment of the present invention two;
Fig. 5 is the schematic diagram of a scenario of the output character information in the embodiment of the present invention two;
Fig. 6 is the first composition structural representation of the client of the embodiment of the present invention;
Fig. 7 is second of composition structural representation of the client of the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawings and specific embodiment the present invention is further detailed explanation.
Embodiment one
The embodiments of the invention provide a kind of information processing method.Fig. 1 is the information processing method of the embodiment of the present invention one Schematic flow sheet;As shown in figure 1, described information processing method includes:
Step 101:When detection multimedia messages are in broadcast state, the first input information is detected;First input Information is used to characterize triggering input information.
Information processing method described in the present embodiment is applied in client, and the client can be specifically intelligent hand The mobile terminals such as machine, tablet personal computer, it is of course also possible to be personal computer (PC, Personal Computer), one electromechanics The fixed terminals such as brain.Then in this step, the request message for sending multimedia messages, the response of the request message is received After message, the first input information is detected, including:The client sends the request message of multimedia messages, receives described After the response message of request message, the first input information is detected.
Here, the multimedia messages are specially network multimedia information, i.e., described multimedia information storage is in multimedia In playing platform (such as Tengxun's video playback platform);The multimedia messages are specifically as follows Internet video.The client needs The request message of multimedia messages is sent to the multimedia platform, receives the response message of the request message. In practical application, so that the multimedia platform is Tengxun's video playback platform as an example, it can be understood as, user passes through described Client opens " Tengxun's video " client, selects viewing XX videos by the client, i.e., to Tengxun's video playback platform Send the playing request of the XX videos;After Tengxun's video playback platform success response, the client receives institute The success response message of XX videos is stated, i.e., described " Tengxun's video " client commences play out the XX videos.As another implementation Mode, user can also open " Tengxun's video " webpage by webpage, select viewing XX videos by the webpage, i.e., to Tengxun Video playback platform sends the playing request of the XX videos;After Tengxun's video playback platform success response, the net Page receives the success response message of the XX videos, i.e., described " Tengxun's video " client commences play out the XX videos.
The first input information described in this step is touched for what is detected when the multimedia messages are in broadcast state Hair input message.
Specifically, the first input message is the triggering input message for physical button, touching for virtual key Hair input message, or the triggering input message of operating gesture is characterized, it is certainly not limited to the example of above-mentioned triggering input message.
As the another embodiment of the present embodiment, before the input of detection first information, methods described also includes: The broadcast window of the multimedia messages is detected, when determining that the broadcast window of the multimedia messages meets three preparatory conditions, Detect the first input information.
Wherein it is determined that the broadcast window of the multimedia messages meets the 3rd preparatory condition, including:Judge the multimedia Whether the proportionate relationship of the size of the broadcast window of information and the size of the viewing area of client reaches first threshold, obtains the One judged result;When the size of broadcast window of first judged result for the multimedia messages and the viewing area of client When the proportionate relationship of the size in domain reaches first threshold, determine that the broadcast window of the multimedia messages meets the 3rd default article Part.
Specifically, the first threshold (such as 2/3,3/4,4/5 or 1) can be pre-configured with, can also be according to user Operating habit sets itself.The ratio of the size of the broadcast window of the multimedia messages and the size of the viewing area of client Whether example relation reaches first threshold, it can be understood as, whether text can also be presented in the current viewing area of the client The entrance of word input (the word input is specially text reviews input), namely whether can also be defeated in current viewing area Enter text information;When the broadcast window of the multimedia messages size and client viewing area size proportionate relationship When reaching first threshold, it can be understood as, the entrance that word inputs, i.e. institute is not presented in the current viewing area of the client State word input entrance be hidden, or the multimedia messages broadcast window lower section, it is necessary to which page will currently be shown Dragging downwards can just make the entrance of the word input exposed.Preferably, when the first threshold is 1, show described The size of the broadcast window of multimedia messages is equal sized with the viewing area of the client, namely the multimedia messages Broadcast window be in played in full screen pattern.
Step 102:When determining that the first input information meets the first preparatory condition, the input information of collection second;It is described Second input information is used to characterize speech input information.
Here, it is described to determine that the first input information meets the first preparatory condition, including:Based on the described first input letter The instruction of breath generation first, judges whether first instruction matches with the first preset instructions, obtains the second judged result;When described When first instruction matches with first preset instructions, determine that the first input information meets the first preparatory condition.
Accordingly, the input of collection second information, including:Detect the first input information for meeting the first preparatory condition When, collection the second input information;Accordingly, when the first input information of the first preparatory condition of the satisfaction stops, in The only collection of the second input information.
Described in the present embodiment first input information can be for physical button triggering input message, for virtually by The triggering input message of key, naturally it is also possible to be the triggering input message for characterizing operating gesture;When described for physical button Triggering input message, for virtual key triggering input message or characterize corresponding to the triggering input message of operating gesture the When one instruction matches with the first preset instructions, it may be determined that the first input information meets the first preparatory condition;Wherein, described One preset instructions are used for voice enabled collecting unit, trigger the voice collecting unit and start to gather speech input information (i.e. institute State the second input information);The voice collecting unit can be specifically the microphone in the client.
Specifically, as the first embodiment, when the described first input information is the triggering input for physical button During message, the physical button can be sound button in the client, power button, return key (Home key) etc.. The triggering input message for physical button is different from the prior art for the conventional triggering input of the physical button Message, the first instruction corresponding with the described first input information is pre-configured with for the described first input information.In the present embodiment In, so that the physical button is sound button as an example, corresponding first instruction of long-press input information of the sound button;Work as detection When being operated to the long-pressing gesture for the sound button, namely detect that the long-press for the sound button inputs information When, generation the first instruction corresponding with long-press input information, that is, determine that the first input information meets the first default bar Part.
As second of embodiment, when the described first input information is to input message for the triggering of virtual key, The virtual key can be the virtual key for being exclusively used in generation first and instructing being pre-configured with.In the present embodiment, when detecting For the virtual key input information when, such as when detecting the single-click operation for the virtual key, generation and institute The first instruction corresponding to input information is stated, that is, determines that the first input information meets the first preparatory condition.
As the third embodiment, when the described first input information inputs message to characterize the triggering of operating gesture, The triggering input message of the sign operating gesture can be that the touch control unit of the client detects and described first instructs Corresponding gesture operation inputs information;The gesture operation such as " C " font gesture operation, " O " font gesture operation etc..This In embodiment, so that the gesture operation is " O " font gesture operation as an example, when the touch control unit of the client detects sign During the input information of " O " font gesture operation, the instruction of generation first, that is, determine that the first input information meets the first default bar Part.
Step 103:The second input information is identified, is believed by the predetermined manner conversion second input information for word Breath, when determining that the text information meets the second preparatory condition, export the text information.
In this step, the second input information (i.e. speech input information) is collected, the described second input information is known Do not change, obtain text information.The conversion regime of specific voice conversion word can use any conversion side of the prior art Formula, repeat no more here.
It is described to determine that the text information meets the second preparatory condition in the present embodiment, including:Word described in output display Information;The 3rd input information for the text information is detected, based on the described 3rd input information the second instruction of generation;Really When recognizing the second instruction sign confirmation response instruction, determine that the text information meets the second preparatory condition.
Specifically, the client has display unit (i.e. display screen);Changed by the display unit output display Text information afterwards, so that the user of the client carries out checking whether to meet needs.Here the 3rd input information It can be the triggering input message for virtual key, or characterize the triggering input message of operating gesture.
As the first embodiment, when the described 3rd input information is to input message for the triggering of virtual key, When the display unit of the client exports the text information, while two virtual keys are exported, the first virtual key is used In confirming to respond, the second virtual key, which is used to cancel, to be responded;Disappear when detecting that the triggering for first virtual key inputs During breath, show that user confirms that the text information meets needs, generation characterizes the second instruction for confirming response instruction, based on described Second instruction exports the text information to the comment processing system of multimedia platform;It is empty for described second when detecting When intending the triggering input message of button, show that user confirms that the text information is unsatisfactory for needing, generation sign is cancelled response and referred to 3rd instruction of order, the text information is deleted based on the described 3rd instruction.
As second of embodiment, when the described 3rd input information inputs message to characterize the triggering of operating gesture, When the display unit of the client exports the text information, can be grasped by the touch control unit detection gesture of the client Make input information;Two kinds of gesture operation input information and its corresponding instruction can be pre-configured with the client;The first hand Gesture operation input information corresponding second instruction (confirming response instruction) (such as " V " font gesture operation input information), second Gesture operation input information corresponding 3rd instruction (cancelling response instruction) (such as " X " font gesture operation input information).For example, When detecting that " V " font gesture operation inputs information, generation inputs information corresponding second with " V " the font gesture operation Instruction, the text information is exported to the comment processing system of multimedia platform based on the described second instruction;When detecting When " X " font gesture operation inputs information, generation the 3rd instruction corresponding with " X " font gesture operation input information, base The text information is deleted in the described 3rd instruction.
As one of which embodiment, when the determination text information meets the second preparatory condition, methods described Also include:Obtain the current reproduction time parameter of the multimedia messages;Accordingly, the output text information, including: Export the text information and the time parameter.
Here, after it is determined that the text information meets the needs of user, the current broadcasting of the multimedia messages is obtained Time parameter, the current reproduction time parameter of the multimedia messages is specially current play time;Further, it is based on The reproduction time parameter and text information generation text reviews information output valve server end, so as to the server end The reproduction time state modulator can be based on and export the text information.Specifically, the server end is based on preset strategy Export the text information;The preset strategy can be that the time based on reproduction time parameter corresponding to the text information is first After be sequentially output;Certainly, it is suitable to be not limited to the above-mentioned time order and function according to reproduction time parameter for the preset strategy of the server end Sequence, repeat no more here.
Using the technical scheme of the embodiment of the present invention, when realizing multimedia messages (i.e. Internet video) broadcasting, pass through language The mode of sound input realizes the input of comment information, enriches the comment input mode in the playing process of multimedia messages, The manually operated of increase user is avoided, improves the operating experience of user.
The information processing method of the embodiment of the present invention is described in detail with embodiment below.
Embodiment two
The embodiment of the present invention additionally provides a kind of information processing method.Fig. 2 is the information processing side of the embodiment of the present invention two The schematic flow sheet of method;As shown in Fig. 2 methods described includes:
Step 201:When detection multimedia messages are in broadcast state, the first input information is detected;First input Information is used to characterize triggering input information.
Information processing method described in the present embodiment is applied in client, and the client can be specifically intelligent hand The mobile terminals such as machine, tablet personal computer, it is of course also possible to be the fixed terminals such as PC, integrated computer.Then in this step, the hair The request message of multimedia messages is sent, after the response message for receiving the request message, detects the first input information, is wrapped Include:The client sends the request message of multimedia messages, after the response message for receiving the request message, detects the One input information.
Here, the multimedia messages are specially network multimedia information, i.e., described multimedia information storage is in multimedia In playing platform (such as Tengxun's video playback platform);The multimedia messages are specifically as follows Internet video.The client needs The request message of multimedia messages is sent to the multimedia platform, receives the response message of the request message. In practical application, so that the multimedia platform is Tengxun's video playback platform as an example, it can be understood as, user passes through described Client opens " Tengxun's video " client, selects viewing XX videos by the client, i.e., to Tengxun's video playback platform Send the playing request of the XX videos;After Tengxun's video playback platform success response, the client receives institute The success response message of XX videos is stated, i.e., described " Tengxun's video " client commences play out the XX videos.As another implementation Mode, user can also open " Tengxun's video " webpage by webpage, select viewing XX videos by the webpage, i.e., to Tengxun Video playback platform sends the playing request of the XX videos;After Tengxun's video playback platform success response, the net Page receives the success response message of the XX videos, i.e., described " Tengxun's video " client commences play out the XX videos.
The first input information described in this step is touched for what is detected when the multimedia messages are in broadcast state Hair input message.
Specifically, the first input message is the triggering input message for physical button, touching for virtual key Hair input message, or the triggering input message of operating gesture is characterized, it is certainly not limited to the example of above-mentioned triggering input message.
As the another embodiment of the present embodiment, before the input of detection first information, methods described also includes: The broadcast window of the multimedia messages is detected, when determining that the broadcast window of the multimedia messages meets three preparatory conditions, Detect the first input information.
Wherein it is determined that the broadcast window of the multimedia messages meets the 3rd preparatory condition, including:Judge the multimedia Whether the proportionate relationship of the size of the broadcast window of information and the size of the viewing area of client reaches first threshold, obtains the One judged result;When the size of broadcast window of first judged result for the multimedia messages and the viewing area of client When the proportionate relationship of the size in domain reaches first threshold, determine that the broadcast window of the multimedia messages meets the 3rd default article Part.
Specifically, the first threshold (such as 2/3,3/4,4/5 or 1) can be pre-configured with, can also be according to user Operating habit sets itself.The ratio of the size of the broadcast window of the multimedia messages and the size of the viewing area of client Whether example relation reaches first threshold, it can be understood as, whether text can also be presented in the current viewing area of the client The entrance of word input (the word input is specially text reviews input), namely whether can also be defeated in current viewing area Enter text information;When the broadcast window of the multimedia messages size and client viewing area size proportionate relationship When reaching first threshold, it can be understood as, the entrance that word inputs, i.e. institute is not presented in the current viewing area of the client State word input entrance be hidden, or the multimedia messages broadcast window lower section, it is necessary to which page will currently be shown Dragging downwards can just make the entrance of the word input exposed.Preferably, when the first threshold is 1, show described The size of the broadcast window of multimedia messages is equal sized with the viewing area of the client, namely the multimedia messages Broadcast window be in played in full screen pattern.
Step 202:When determining that the first input information meets the first preparatory condition, the input information of collection second, and it is raw Into the first instruction, the sound output parameter of the broadcast window based on the described first instruction control reduction multimedia messages;Institute The second input information is stated to be used to characterize speech input information.
Here, it is described to determine that the first input information meets the first preparatory condition, including:Based on the described first input letter The instruction of breath generation first, judges whether first instruction matches with the first preset instructions, obtains the second judged result;When described When first instruction matches with first preset instructions, determine that the first input information meets the first preparatory condition.
Accordingly, the input of collection second information, including:Detect the first input information for meeting the first preparatory condition When, collection the second input information;Accordingly, when the first input information of the first preparatory condition of the satisfaction stops, in The only collection of the second input information.
Described in the present embodiment first input information can be for physical button triggering input message, for virtually by The triggering input message of key, naturally it is also possible to be the triggering input message for characterizing operating gesture;When described for physical button Triggering input message, for virtual key triggering input message or characterize corresponding to the triggering input message of operating gesture the When one instruction matches with the first preset instructions, it may be determined that the first input information meets the first preparatory condition;Wherein, described One preset instructions are used for voice enabled collecting unit, trigger the voice collecting unit and start to gather speech input information (i.e. institute State the second input information);The voice collecting unit can be specifically the microphone in the client.Specifically, described One input information is for triggering for physical button inputs message, the triggering for virtual key inputs message or characterized and operates The specific implementation of the triggering input message of gesture repeats no more here as described in embodiment one.In the present embodiment, with described First input information be for virtual key triggering input message exemplified by, Fig. 3 be the embodiment of the present invention two in gather second Input the schematic diagram of a scenario of information;With reference to shown in figure 3, the virtual key is " pinning comment " button shown in Fig. 3;Work as inspection When measuring the triggering input message for described " pinning comment " button, generation meets that the first of first preset instructions refer to Order, the speech input information of the client is enabled based on the described first instruction.
In the present embodiment, when the collection second inputs information, the sound of the broadcast window of the multimedia messages is controlled Output parameter reduces, that is, reduces the wave volume of the broadcast window of the multimedia messages, or even reduce the multimedia messages The wave volume of broadcast window be zero;Based on this, when gathering the second input information, multimedia messages are on the one hand avoided Interference of the sound to the phonetic entry is played, on the other hand realizes user again during the multimedia messages are watched Phonetic entry is realized, improves the operating experience of user.
Step 203:When the first input information of the first preparatory condition of the satisfaction stops, stop the second input letter The collection of breath, and the second instruction is generated, recover the sound of the broadcast window of the multimedia messages based on the described second instruction control Sound output parameter;The second input information is used to characterize speech input information.
In the present embodiment, the second input of speech input information collection information based on the client (i.e. believe by phonetic entry Breath);As shown in figure 3, specifically, when starting to detect the meet first preparatory condition first input information, that is, detect During to trigger action for " pinning comment " button, the voice collecting unit of the client starts to gather voice defeated Enter;When detecting that the first input information for meeting first preparatory condition stops, i.e., for described " pinning comment " button Trigger action stop when, stop it is described second input information collection;Pressed equivalent to " comment is pinned " described in operating body triggering During key, the voice collecting unit of the client starts to gather speech input information;The operating body leaves described " pin a little Comment " button when, the voice collecting unit of the client also stops to gather speech input information.
In the present embodiment, when the collection for detecting the second input information stops, namely meet the first preparatory condition First input information stop when, control the sound output parameter of the broadcast window of the multimedia messages to revert to initial value, Namely when detecting that the triggering for the virtual key shown in Fig. 3 inputs message abort, recover broadcasting for the multimedia messages Put the sound output of window.
Step 204:The second input information is identified, is believed by the predetermined manner conversion second input information for word Breath, text information described in output display.
In this step, the second input information (i.e. speech input information) is collected, the described second input information is known Do not change, obtain text information.The conversion regime of specific voice conversion word can use any conversion side of the prior art Formula, repeat no more here.
Specifically, the client has display unit (i.e. display screen);Changed by the display unit output display Text information afterwards, so that the user of the client carries out checking whether to meet needs.Fig. 4 is to be examined in the embodiment of the present invention two Survey the schematic diagram of a scenario of the 3rd input information;As shown in figure 4, the broadcast window in the multimedia messages shows the word letter Breath.
Step 205:The 3rd input information for the text information is detected, based on the described 3rd input information generation Second instruction, when confirming that second instruction characterizes confirmation response instruction, export the text information.
Specifically, when the display unit of the client exports the text information, while two virtual keys are exported, " confirmation " button and " cancellation " button as shown in Figure 4." confirmation " button is used to confirm to respond, and " cancellation " button is used to cancel sound Should;When detecting that the triggering for described " confirmation " button inputs message, show that user confirms that the text information meets need Will, generation characterizes the second instruction for confirming response instruction, and exporting the text information to multimedia based on the described second instruction broadcasts It is laid flat the comment processing system of platform;When detecting that the triggering for described " cancellation " button inputs message, show that user confirms The text information is unsatisfactory for needing, and generation characterizes the 3rd instruction for cancelling response instruction, and institute is deleted based on the described 3rd instruction State text information.
Fig. 5 is the schematic diagram of a scenario of the output character information in the embodiment of the present invention two;Pin is detected as shown in figure 5, working as When triggering to " confirmation " button inputs message, generation characterizes the second instruction for confirming that response instructs, based on described second Instruction exports the text information to the comment processing system of multimedia platform, so as to commenting for the multimedia platform The text information is handled (i.e. for the comment information of the multimedia messages) by processing system;The processing procedure Addition can be included to store or add described more in the database of the comment processing system of the multimedia platform Carry out exporting in the broadcasting page of media information etc., repeat no more here.
Using the technical scheme of the embodiment of the present invention, when realizing multimedia messages (i.e. Internet video) broadcasting, pass through language The mode of sound input realizes the input of comment information, enriches the comment input mode in the playing process of multimedia messages, The manually operated of increase user is avoided, improves the operating experience of user.
Embodiment three
The embodiment of the present invention additionally provides a kind of client, and Fig. 6 is the first composition of the client of the embodiment of the present invention Structural representation.As shown in fig. 6, the client includes:Detection unit 61, collecting unit 62, analytic unit 63 and output are single Member 64;Wherein,
The detection unit 61, when being in broadcast state for detecting multimedia messages, detect the first input information;Institute State the first input information be used for characterize operation input information;
The collecting unit 62, determine that the first input information meets the first preparatory condition for the detection unit 61 When, the input information of collection second;The second input information is used to characterize speech input information;
The analytic unit 63, the second input information gathered for identifying the collecting unit 62, by default side Formula conversion the second input information is text information;
The output unit 64, for determining that the text information after the conversion of analytic unit 63 meets that second is default During condition, the text information is exported.
Specifically, the detection unit 61, for based on described first input information the first instruction of generation, judging described the Whether one instruction matches with the first preset instructions, obtains the second judged result;When the described first instruction and the described first default finger During order matching, determine that the first input information meets the first preparatory condition.
Further, the detection unit 61, when being additionally operable to detect the first input information for meeting the first preparatory condition, Enable the collecting unit 62 and gather the second input information.
Specifically, the client also includes display unit 60, after being converted for analytic unit described in output display 63 Text information;
The detection unit 61, it is additionally operable to detect the 3rd of the text information for the display unit 60 display Information is inputted, based on the described 3rd input information the second instruction of generation;When confirming that second instruction characterizes confirmation response instruction, Determine that the text information meets the second preparatory condition.
Alternatively, the analytic unit, it is additionally operable to determine that the text information meets the second preparatory condition When, obtain the current reproduction time parameter of the multimedia messages;
Accordingly, the output unit, for exporting the text information and the time parameter.
Information processing method described in the present embodiment is applied in client, and the client can be specifically intelligent hand The mobile terminals such as machine, tablet personal computer, it is of course also possible to be the fixed terminals such as PC, integrated computer.The multimedia messages are specific For network multimedia information, i.e., described multimedia information storage is in multimedia platform (such as Tengxun's video playback platform); The multimedia messages are specifically as follows Internet video.The client need to send multimedia letter to the multimedia platform The request message of breath, receive the response message of the request message.
The first input message is for triggering for physical button inputs message, the triggering input for virtual key disappears Breath, or the triggering input message of operating gesture is characterized, it is certainly not limited to the example of above-mentioned triggering input message.
As the first embodiment, when the described first input information is to input message for the triggering of physical button, The physical button can be sound button in the client, power button, return key (Home key) etc..It is described to be directed to The triggering input message of physical button is different from the conventional triggering input message for being directed to the physical button in the prior art, for The first input information is pre-configured with the first instruction corresponding with the described first input information.In the present embodiment, with described Physical button is corresponding first instruction of long-press input information of the sound button exemplified by sound button;Institute is directed to when detecting State sound button long-pressing gesture operation when, namely detect for the sound button long-press input information when, generation with First instruction corresponding to the long-press input information, that is, determine that the first input information meets the first preparatory condition.
As second of embodiment, when the described first input information is to input message for the triggering of virtual key, The virtual key can be the virtual key for being exclusively used in generation first and instructing being pre-configured with.In the present embodiment, when detecting For the virtual key input information when, such as when detecting the single-click operation for the virtual key, generation and institute The first instruction corresponding to input information is stated, that is, determines that the first input information meets the first preparatory condition.
As the third embodiment, when the described first input information inputs message to characterize the triggering of operating gesture, The triggering input message of the sign operating gesture can be that the touch control unit of the client detects and described first instructs Corresponding gesture operation inputs information;The gesture operation such as " C " font gesture operation, " O " font gesture operation etc..This In embodiment, so that the gesture operation is " O " font gesture operation as an example, when the touch control unit of the client detects sign During the input information of " O " font gesture operation, the instruction of generation first, that is, determine that the first input information meets the first default bar Part.
Specifically, the client has display unit (i.e. display screen);Changed by the display unit output display Text information afterwards, so that the user of the client carries out checking whether to meet needs.Here the 3rd input information It can be the triggering input message for virtual key, or characterize the triggering input message of operating gesture.
As the first embodiment, when the described 3rd input information is to input message for the triggering of virtual key, When the display unit exports the text information, while two virtual keys are exported, the first virtual key is used to confirm to ring Should, the second virtual key, which is used to cancel, to be responded;When detecting that the triggering for first virtual key inputs message, show User confirms that the text information meets needs, and generation characterizes the second instruction for confirming response instruction, based on the described second instruction The text information is exported to the comment processing system of multimedia platform;Second virtual key is directed to when detecting During triggering input message, show that user confirms that the text information is unsatisfactory for needing, generation, which characterizes, cancels the 3rd of response instruction Instruction, the text information is deleted based on the described 3rd instruction.
As second of embodiment, when the described 3rd input information inputs message to characterize the triggering of operating gesture, When the display unit exports the text information, the touch control unit detection gesture operation input letter of the client can be passed through Breath;Two kinds of gesture operation input information and its corresponding instruction can be pre-configured with the client;The first gesture operation is defeated Enter information (such as " V " font gesture operation input information) corresponding second to instruct and (confirm response instruction), second of gesture operation Information (such as " X " font gesture operation input information) the corresponding 3rd is inputted to instruct and (cancel response instruction).Detected for example, working as When " V " font gesture operation inputs information, generation the second instruction corresponding with " V " font gesture operation input information, base The text information is exported to the comment processing system of multimedia platform in the described second instruction;When detecting " X " font When gesture operation inputs information, generation instructs with " X " font gesture operation input information the corresponding 3rd, based on described the The text information is deleted in three instructions.
As a kind of embodiment in the present embodiment, the analytic unit 63, it is additionally operable to the detection unit 61 and detects To before the first input information, the broadcast window of the multimedia messages is detected, determines the broadcast window of the multimedia messages When meeting three preparatory conditions, trigger the detection unit 61 and detect the first input information.
Wherein, the analytic unit 63, for the size and initial play of the broadcast window for judging the multimedia messages Whether the proportionate relationship of size reaches first threshold, obtains the first judged result;When first judged result is more matchmakers When the size of the broadcast window of body information reaches first threshold with the proportionate relationship of initial play size, the multimedia letter is determined The broadcast window of breath meets the 3rd preparatory condition.
Specifically, the first threshold (such as 2/3,3/4,4/5 or 1) can be pre-configured with, can also be according to user Operating habit sets itself.The ratio of the size of the broadcast window of the multimedia messages and the size of the viewing area of client Whether example relation reaches first threshold, it can be understood as, whether text can also be presented in the current viewing area of the client The entrance of word input (the word input is specially text reviews input), namely whether can also be defeated in current viewing area Enter text information;When the broadcast window of the multimedia messages size and client viewing area size proportionate relationship When reaching first threshold, it can be understood as, the entrance that word inputs, i.e. institute is not presented in the current viewing area of the client State word input entrance be hidden, or the multimedia messages broadcast window lower section, it is necessary to which page will currently be shown Dragging downwards can just make the entrance of the word input exposed.Preferably, when the first threshold is 1, show described The size of the broadcast window of multimedia messages is equal sized with the viewing area of the client, namely the multimedia messages Broadcast window be in played in full screen pattern.
It will be appreciated by those skilled in the art that in the client of the embodiment of the present invention each processing unit function, can refer to The associated description of aforementioned information processing method and understand, each processing unit in the client of the embodiment of the present invention, realization can be passed through The analog circuit of function described in the embodiment of the present invention and realize, can also be by performing the function described in the embodiment of the present invention Operation of the software on intelligent terminal and realize.
Example IV
The embodiment of the present invention additionally provides a kind of client, and Fig. 7 is second of composition of the client of the embodiment of the present invention Structural representation;As shown in fig. 7, the client includes:Detection unit 61, collecting unit 62, analytic unit 63, output unit 64 and control unit 65;Wherein,
The detection unit 61, when being in broadcast state for detecting multimedia messages, detect the first input information;Institute State the first input information be used for characterize operation input information;
The collecting unit 62, determine that the first input information meets the first preparatory condition for the detection unit 61 When, the input information of collection second;The second input information is used to characterize speech input information;
The analytic unit 63, the second input information gathered for identifying the collecting unit 62, by default side Formula conversion the second input information is text information;
The output unit 64, for determining that the text information after the conversion of analytic unit 63 meets that second is default During condition, the text information is exported;
Described control unit 65, when inputting information for collecting unit collection second, the instruction of generation first, based on institute State the sound output parameter that the first instruction control reduces the broadcast window of the multimedia messages;It is additionally operable to when the described second input When information stops collection, generation second instructs, and recovers the broadcast window of the multimedia messages based on the described second instruction control Sound output parameter.
Specifically, the detection unit 61, for based on described first input information the first instruction of generation, judging described the Whether one instruction matches with the first preset instructions, obtains the second judged result;When the described first instruction and the described first default finger During order matching, determine that the first input information meets the first preparatory condition.
Further, the detection unit 61, when being additionally operable to detect the first input information for meeting the first preparatory condition, Enable the collecting unit 62 and gather the second input information.
Specifically, the client also includes display unit 60, after being converted for analytic unit described in output display 63 Text information;
The detection unit 61, it is additionally operable to detect the 3rd of the text information for the display unit 60 display Information is inputted, based on the described 3rd input information the second instruction of generation;When confirming that second instruction characterizes confirmation response instruction, Determine that the text information meets the second preparatory condition.
Described in the present embodiment first input information can be for physical button triggering input message, for virtually by The triggering input message of key, naturally it is also possible to be the triggering input message for characterizing operating gesture;When described for physical button Triggering input message, for virtual key triggering input message or characterize corresponding to the triggering input message of operating gesture the When one instruction matches with the first preset instructions, it may be determined that the first input information meets the first preparatory condition;Wherein, described One preset instructions are used for voice enabled collecting unit, trigger the voice collecting unit and start to gather speech input information (i.e. institute State the second input information);The voice collecting unit can be specifically the microphone in the client.Specifically, described One input information is for triggering for physical button inputs message, the triggering for virtual key inputs message or characterized and operates The specific implementation of the triggering input message of gesture repeats no more here as described in embodiment one.
During second input of the collection of collecting unit 62 information, described control unit 65 controls broadcasting for the multimedia messages The sound output parameter for putting window reduces, that is, reduces the wave volume of the broadcast window of the multimedia messages, or even reduce institute The wave volume for stating the broadcast window of multimedia messages is zero;Based on this, when gathering the second input information, on the one hand avoid Interference of the broadcasting sound of multimedia messages to the phonetic entry, user is on the other hand realized again and is watching the multimedia Phonetic entry is realized during information, improves the operating experience of user.Accordingly, when the collecting unit 62 stops to gather Second input information when, namely meet the first preparatory condition first input information stop when, control the multimedia messages The sound output parameter of broadcast window reverts to initial value, namely recover the broadcast window of the multimedia messages sound it is defeated Go out.
It will be appreciated by those skilled in the art that in the client of the embodiment of the present invention each processing unit function, can refer to The associated description of aforementioned information processing method and understand, each processing unit in the client of the embodiment of the present invention, realization can be passed through The analog circuit of function described in the embodiment of the present invention and realize, can also be by performing the function described in the embodiment of the present invention Operation of the software on intelligent terminal and realize.
In embodiments of the present invention, the analytic unit 63 and control unit 65 in the client, in actual applications may be used By the central processing unit (CPU, Central Processing Unit) in the client, digital signal processor (DSP, Digital Signal Processor) or programmable gate array (FPGA, Field-Programmable Gate Array) Realize;Detection unit 61 in the client, it can be combined in actual applications by the touch control detection unit in the client CPU, DSP or FPGA are realized;Collecting unit 62 in the client, in actual applications can be by the Mike in the client Wind is realized;Display unit 60 in the client, in actual applications can be real by the display screen or display of the client It is existing.
In several embodiments provided herein, it should be understood that disclosed apparatus and method, it can be passed through Its mode is realized.Apparatus embodiments described above are only schematical, for example, the division of the unit, is only A kind of division of logic function, there can be other dividing mode when actually realizing, such as:Multiple units or component can combine, or Another system is desirably integrated into, or some features can be ignored, or do not perform.In addition, shown or discussed each composition portion Point mutual coupling or direct-coupling or communication connection can be the INDIRECT COUPLINGs by some interfaces, equipment or unit Or communication connection, can be electrical, mechanical or other forms.
The above-mentioned unit illustrated as separating component can be or may not be physically separate, show as unit The part shown can be or may not be physical location, you can positioned at a place, can also be distributed to multiple network lists In member;Partly or entirely unit therein can be selected to realize the purpose of this embodiment scheme according to the actual needs.
In addition, each functional unit in various embodiments of the present invention can be fully integrated into a processing unit, also may be used To be each unit individually as a unit, can also two or more units it is integrated in a unit;It is above-mentioned Integrated unit can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
One of ordinary skill in the art will appreciate that:Realizing all or part of step of above method embodiment can pass through Programmed instruction related hardware is completed, and foregoing program can be stored in a computer read/write memory medium, the program Upon execution, the step of execution includes above method embodiment;And foregoing storage medium includes:It is movable storage device, read-only Memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or Person's CD etc. is various can be with the medium of store program codes.
Or if the above-mentioned integrated unit of the present invention is realized in the form of software function module and is used as independent product Sale in use, can also be stored in a computer read/write memory medium.Based on such understanding, the present invention is implemented The part that the technical scheme of example substantially contributes to prior art in other words can be embodied in the form of software product, The computer software product is stored in a storage medium, including some instructions are causing a computer equipment (can be with It is personal computer, server or network equipment etc.) perform all or part of each embodiment methods described of the present invention. And foregoing storage medium includes:Movable storage device, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes Medium.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (12)

1. a kind of information processing method, it is characterised in that methods described includes:
When detection multimedia messages are in broadcast state, the first input information is detected;The first input information is used to characterize Operation input information;
When determining that the first input information meets the first preparatory condition, the input information of collection second;The second input information For characterizing speech input information;
The second input information is identified, is text information by predetermined manner conversion the second input information, determines the text When word information meets the second preparatory condition, the text information is exported;
Wherein, before the input of detection first information, methods described also includes:Detect the broadcasting window of the multimedia messages Mouthful, when determining that the size of the broadcast window of the multimedia messages meets three preparatory conditions, detection the first input information.
2. according to the method for claim 1, it is characterised in that during the input of collection second information, methods described is also wrapped Include:
The instruction of generation first, the sound for the broadcast window for reducing the multimedia messages based on the described first instruction control export ginseng Number;
Accordingly, when the described second input information stops collection, methods described also includes:
The instruction of generation second, the sound for the broadcast window for recovering the multimedia messages based on the described second instruction control export ginseng Number.
3. according to the method for claim 1, it is characterised in that described to determine that the text information meets the second preparatory condition When, methods described also includes:
Obtain the current reproduction time parameter of the multimedia messages;
Accordingly, the output text information, including:Export the text information and the time parameter.
4. according to the method for claim 1, it is characterised in that described to determine that the first input information meets that first is default Condition, including:
Based on described first input information the first instruction of generation, judge whether first instruction matches with the first preset instructions, Obtain the second judged result;
When second judged result is that the described first instruction matches with first preset instructions, first input is determined Information meets the first preparatory condition.
5. according to the method for claim 4, it is characterised in that the input of collection second information, including:
When detecting the first input information for meeting the first preparatory condition, collection the second input information;
Accordingly, when the first input information of the first preparatory condition of the satisfaction stops, the second input information is stopped Collection.
6. according to the method for claim 1, it is characterised in that described to determine that the text information meets the second default bar Part, including:
Text information described in output display;
The 3rd input information for the text information is detected, based on the described 3rd input information the second instruction of generation;
When confirming that second instruction characterizes confirmation response instruction, determine that the text information meets the second preparatory condition.
7. a kind of client, it is characterised in that the client includes:Detection unit, collecting unit, analytic unit and output are single Member;Wherein,
The detection unit, when being in broadcast state for detecting multimedia messages, detect the broadcasting window of the multimedia messages Mouthful, when determining that the size of the broadcast window of the multimedia messages meets three preparatory conditions, detect the first input information;Institute State the first input information be used for characterize operation input information;
The collecting unit, when determining that the first input information meets the first preparatory condition for the detection unit, collection Second input information;The second input information is used to characterize speech input information;
The analytic unit, for identifying the second input information of the collecting unit collection, institute is converted by predetermined manner It is text information to state the second input information;
The output unit, during for determining that the text information after analytic unit conversion meets the second preparatory condition, Export the text information.
8. client according to claim 7, it is characterised in that the client also includes control unit, for described During collecting unit collection the second input information, the instruction of generation first, the multimedia letter is reduced based on the described first instruction control The sound output parameter of the broadcast window of breath;It is additionally operable to when the described second input information stops collection, the instruction of generation second, base Recover the sound output parameter of the broadcast window of the multimedia messages in the described second instruction control.
9. client according to claim 7, it is characterised in that the analytic unit, be additionally operable to determine the word letter When breath meets the second preparatory condition, the current reproduction time parameter of the multimedia messages is obtained;
Accordingly, the output unit, for exporting the text information and the time parameter.
10. client according to claim 7, it is characterised in that the detection unit, for based on the described first input The instruction of information generation first, judges whether first instruction matches with the first preset instructions, obtains the second judged result;Work as institute When stating the first instruction and being matched with first preset instructions, determine that the first input information meets the first preparatory condition.
11. client according to claim 10, it is characterised in that the detection unit, be additionally operable to detect satisfaction During the first input information of one preparatory condition, the collecting unit collection the second input information is enabled.
12. client according to claim 7, it is characterised in that the client also includes display unit, for exporting Show the text information after the analytic unit conversion;
The detection unit, it is additionally operable to detect the 3rd input letter of the text information shown for the display unit Breath, based on the described 3rd input information the second instruction of generation;When confirming that second instruction characterizes confirmation response instruction, institute is determined State text information and meet the second preparatory condition.
CN201510221669.8A 2015-05-04 2015-05-04 A kind of information processing method and client Active CN104808964B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510221669.8A CN104808964B (en) 2015-05-04 2015-05-04 A kind of information processing method and client

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510221669.8A CN104808964B (en) 2015-05-04 2015-05-04 A kind of information processing method and client

Publications (2)

Publication Number Publication Date
CN104808964A CN104808964A (en) 2015-07-29
CN104808964B true CN104808964B (en) 2018-03-20

Family

ID=53693822

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510221669.8A Active CN104808964B (en) 2015-05-04 2015-05-04 A kind of information processing method and client

Country Status (1)

Country Link
CN (1) CN104808964B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110008334B (en) * 2017-08-04 2023-03-14 腾讯科技(北京)有限公司 Information processing method, device and storage medium
CN109150408B (en) * 2018-09-30 2022-06-24 联想(北京)有限公司 Information processing method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103546819A (en) * 2013-10-30 2014-01-29 乐视致新电子科技(天津)有限公司 Method and device for controlling display text of smart TV
CN104010222A (en) * 2014-04-28 2014-08-27 小米科技有限责任公司 Method, device and system for displaying comment information
CN104125491A (en) * 2014-07-07 2014-10-29 乐视网信息技术(北京)股份有限公司 Audio comment information generating method and device and audio comment playing method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6178578B2 (en) * 2013-01-22 2017-08-09 株式会社 ミックウェア Information processing device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103546819A (en) * 2013-10-30 2014-01-29 乐视致新电子科技(天津)有限公司 Method and device for controlling display text of smart TV
CN104010222A (en) * 2014-04-28 2014-08-27 小米科技有限责任公司 Method, device and system for displaying comment information
CN104125491A (en) * 2014-07-07 2014-10-29 乐视网信息技术(北京)股份有限公司 Audio comment information generating method and device and audio comment playing method and device

Also Published As

Publication number Publication date
CN104808964A (en) 2015-07-29

Similar Documents

Publication Publication Date Title
CN103914238B (en) Method and device for achieving integration of controls in interface
CN104765993B (en) A kind of method and apparatus of Anti-addiction
CN106648535A (en) Live client voice input method and terminal device
CN105690385B (en) Call method and device are applied based on intelligent robot
CN104184731B (en) A kind of method for information display, apparatus and system
CN105719646A (en) Voice control music playing method and voice control music playing apparatus
CN104144239B (en) A kind of voice supplemental communication method and apparatus
CN108052265A (en) For using the method and apparatus of Drawing Object control content
CN104866226B (en) A kind of terminal device and its control method
CN104144108B (en) A kind of message responding method, apparatus and system
CN103888573B (en) Mobile terminal setting method and device for the blind
CN104541239A (en) Text select and enter
CN107122119A (en) Information processing method, device, electronic equipment and computer-readable recording medium
CN105183347B (en) A kind of input method operating method and electric terminal
CN106155492A (en) The method and apparatus of batch processing information
CN107358953A (en) Sound control method, mobile terminal and storage medium
CN106468987B (en) Information processing method and client
CN106055260B (en) A kind of reading screen method and device of safety keyboard
CN107277075A (en) Authentication device and authentication method
CN107272890A (en) A kind of man-machine interaction method and device based on gesture identification
CN104808964B (en) A kind of information processing method and client
CN107564196A (en) Storing apparatus control method and device
CN104915003A (en) Somatosensory control parameter adjusting method, somatosensory interaction system and electronic equipment
CN108446063A (en) Processing method, device, storage medium and the electronic device of object
CN108268184A (en) The method for pushing and device of data and mobile equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant