Specific embodiment
In order that those skilled in the art more fully understand the technical scheme in the application, below in conjunction with the application reality
The accompanying drawing in example is applied, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described implementation
Example is only some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, this area is common
The every other embodiment that technical staff is obtained under the premise of creative work is not made, should all belong to the application protection
Scope.
Fig. 1 is a kind of a kind of herein described method flow diagram of embodiment of chat data input method.Although the application
There is provided such as following embodiments or method operating procedure shown in the drawings or apparatus structure, but based on routine or without creative
Work can include more or less operating procedure or modular unit in methods described or device.In logicality not
In the step of in the presence of necessary causality or structure, the execution sequence of these steps or the modular structure of device are not limited to the application
Embodiment or execution sequence shown in the drawings or modular structure.The device in practice of described method or modular structure or end
During the products application of end, according to embodiment or method shown in the drawings or modular structure can carry out order execution or hold parallel
Row (environment of such as parallel processor or multiple threads, the even implementation environment including distributed treatment).
Specifically as described in Figure 1, a kind of a kind of embodiment of chat data input method that the application is provided can include:
S1:Obtain the picture to be identified chosen.
The embodiment of the present application is input into the chat scenario of mobile phone terminal instant messaging application chat message with user as should
Illustrated with scene.Fig. 2 is the process schematic of the picture to be identified of acquisition user's selection in a kind of embodiment of the application,
In Fig. 2, user wants to send the relevant information of the company of cold drug producer that good friend 1 seeks advice to good friend.Now, user can chat
Picture is selected by corresponding function button in the dialog interface of its scene.Specifically, picture library can be chosen in some embodiments
In the picture that has preserved as picture to be identified.In the application scenarios of the application such as Fig. 2, a kind of implementation method can be logical for user
Cross the picture to be identified of acquisition of taking pictures.As shown in 2-1 in Figure 2, user can click on the camera that " taking pictures " button starts mobile phone,
Then the back side against photograph subject-flu drug packing box is taken pictures, and obtains a shooting picture, 2-2 in such as Fig. 2.If with
Family determines to use the pictures, then can click on " using photo " and be confirmed, you can obtain picture to be identified, 2- in such as Fig. 2
3。
It is of course also possible, as described before, the picture of terminal localization directly (can also be stored system by user herein from picture library or photograph album
One be referred to as picture library) in choose one group of picture as picture to be identified described herein.In other some embodiment applications
In scene, described picture to be identified can also be the picture that screenshot capture is obtained, or in the dialog box of current chat interface
Chat record in the picture etc. chosen.Therefore, the herein described a kind of embodiment for obtaining the picture to be identified that user chooses
In, the picture to be identified chosen that obtains can include:
S101:Triggering command based on user opens filming apparatus;With the shooting that user is obtained by the filming apparatus
Picture is used as picture to be identified.
Above-mentioned S101 goes in the implementation of most application scenarios.Certainly, it is described to obtain choosing in another embodiment
The picture to be identified for taking can include:
S102:The local photo chosen from this map office of user is obtained, the described local photo using selection is used as waiting to know
Other picture;
S103:The chat picture chosen in chat record of user is obtained, the chat picture using selection is used as waiting to know
Other picture;
S104:Triggering command based on user performs screenshot capture, the sectional drawing picture obtained using the screenshot capture as
Picture to be identified.
Described screen result can include such as mobile phone terminal full screen printscreen, or PC terminals drag the part of rectangular block
The implementation method of sectional drawing.In the present embodiment, picture to be identified can be obtained using various ways, improve user and utilize Chart recognition
The flexibility of chat message is rapidly input, it is convenient for the user to operate, improve Consumer's Experience.
In the present embodiment application scenarios, user can be taken pictures by the cam device of mobile phone, quickly and easily be obtained
Take pending picture.This implement scene can be applied and run into rarely used word input, more document clip information input (entity
Information input on books or business card), cumbersome information input (such as French, it is more long and including the network address of Various Complex character)
Deng when, user can directly pass through mobile phone photograph, it would be desirable to which the information being input in chat scenario is included in shooting figure piece.This
Sample, can remove the operation such as many handwriting inputs of user, character/code identification from during subsequent treatment, realize Speed Chat content
Information input, aids in user input, improves convenience.In addition, the picture to be identified that the acquisition described in the present embodiment is chosen exists
The picture to be identified that user chooses can be included in some embodiment application scenarios, it is also possible to including electronic equipment using certain calculation
The picture that method is chosen, or other pictures to be identified obtained according to setting reading rule selection etc..
S2:Receive drawing on the picture to be identified and take manipulation instruction, determine the identification figure in the picture to be identified
Block
After obtaining picture to be identified, user can draw the band of position for taking and needing identification on the picture to be identified, such as
The a certain style of writing word that is shown in picture to be identified, a certain piece of bar code etc..Fig. 3 is that user draws and takes in a kind of embodiment of the application
Identification region, the implementation process schematic diagram for determining identification segment.User can repeatedly be edited on the picture to be identified,
Multiple discontinuous regions are such as chosen, or cancels stroke some for the multiple regions for taking or multiple, drawn again and take.User selects
After good content, the completion instruction of setting, click " completion " button in such as Fig. 3, it is determined that final this time to be identified can be triggered
The content recognized the need for taking is drawn in picture.In the present embodiment, user on screen draw take selection content operation can be by end
End equipment recognizes, produces and draw accordingly extract operation instruction.Mobile phone can be received and read user on mobile phone screen to be identified
The extract operation of drawing of picture is instructed, the manipulation behavior according to user, it is determined that where the information content of final this time demand identification one
Individual or multiple identification segments, user is smeared by gesture and draws three pieces taken out identification segments in such as Fig. 3.
Reception drawing on the picture to be identified described in the present embodiment takes manipulation instruction can be included receiving user
Act directly on the drawing for generation on the picture to be identified and take manipulation instruction, it is also possible to including the user that electronic equipment is detected
What indirectly-acting was produced on the picture to be identified draws extract operation instruction, even acquires other-end equipment/function
Component/physics sensing apparatus etc. are applied to the extract operation of drawing produced on picture to be identified and instruct.
As shown in Figure 3, in the embodiment of the present application, the mode that user stroke takes the information content in selection picture can include
The mode that gesture is smeared is chosen, is replicated, and user can on a terminal screen directly by the continuously slipping selected one piece of identification of finger
Segment.The application others implementation methods in be not limited to that, in other embodiments user can also by felt pen, swash
The physical instrument modes such as light pen, magnetic optical induction pen are directly or indirectly drawn on picture to be identified and take identification segment.Wherein, it is described
Finger touch to draw to take and can include directly being drawn with finger taking, it is also possible to it is fixed using the virtual paintbrush, head and the tail (or multiple) that provide
The instruments such as position cursor, analog mouse are drawn on picture to be identified and take region.Therefore, a kind of chat data input that the application is provided
In a kind of embodiment of method, described stroke is taken manipulation instruction and includes being acted on using at least one implementation method in following and wait to know
The director data produced on other picture:
S201:Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
S202:User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
S203:Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
In concrete implementation mode, described limbs touching is common can to include finger slip on a terminal screen,
Can certainly be other limbs of user, such as toe or nose.Described magnetic induction or photoinduction can include being drawn every sky
The mode for taking, described acrognosis should include the implementation methods such as gesture induction, eyes (Rotation of eyeball) sensing.
Instructed by the extract operation of drawing for receiving user, it may be determined that one or more knowledge gone out in the picture to be identified
Other segment.After user confirms, these identification segments can be replicated preservation in the buffer.
S3:The information content of the identification segment is identified, the information content for identifying is linked into chat scenario
In.
Drawn according to user and take selected identification segment, carry out picture recognition treatment.To can be obtained in the embodiment of the present application
Each identification segment image information be converted into corresponding text message, the text message that then will can be identified after conversion
It is linked into the chat scenario of user.In specific such as the present embodiment application scenarios, user draws the three identification segments for taking, and this three
Individual identification segment is view data, including pixel color, gray scale, gradient etc..Can by image recognition technology by this three
The character information included in individual identification segment is converted into corresponding text.Specifically recognize the information content in the identification segment
Implementation method can using local processing unit be identified picture character identification conversion, it would however also be possible to employ by it is described identification scheme
Block uploads to remotely/cloud server and carries out image recognition processing, the recognition result that then the reception server is returned, and is identified
The information content of segment.
Fig. 4 is that the information content that identification segment is processed in herein described chat data input method and be will identify that is accessed
The process schematic of chat scenario, as shown in figure 4, drawing three taken identification segments Block_1, Block_2, Block_ to user
3 carry out image recognition respectively, are translated into corresponding content of text " Beijing Tongrentang development in science and technology share ", " Co., Ltd
Pharmaceutical factory ", " www.tongrentangkj.com ".Then these text information contents that can be will identify that are linked into user
Currently with the chat scenario of good friend in.The specific implementation that accesses can include the information content default copy that for example will identify that
To in pasting boards, the information content that user will identify that in the information input frame of chat scenario dialog interface by paste operation
It is input in chat message edit box, as shown in Figure 4.
Certainly, the present embodiment provide method not only can rapidly inputting with the text message in picture, in practical application
Middle user be again may be by taking pictures when running into rarely used word, draw and take rarely used word, and rarely used word is converted into text character is carried out
Input, greatly improves user's chat message data speed, and aids in user input, recognizes rarely used word.
Using herein described embodiment, can be in chat scenario by reading the picture that user chooses, Ran Houshi
Do not go out the image content that user chooses on the picture, corresponding content of text messages can be translated into, it is possible to will
The information content for identifying is linked into the chat scenario of user.So, by way of picture recognition, can be with quick obtaining figure
Content in piece, helps user to realize that the information in chat scenario rapidly inputs.Can solve to use using the application embodiment
Family will not or uncomfortable use character or touch keypad puzzlement, help recognize in rarely used word, quick obtaining picture character letter
Breath, multi-faceted auxiliary user input improves Consumer's Experience.
As described above, recognizing the implementation method of the information content in the identification segment can use local processing unit
It is identified picture character identification conversion, it would however also be possible to employ the identification segment is uploaded into remotely/cloud server carries out figure
As identifying processing.In a kind of implementation method that the application is provided, can use and segment is preferentially identified by server-side
Identification, conversion process etc..So, because usual server-side is calculated, disposal ability is strong, memory space is big, identification channel is more
Deng, quickly the identification segment that user stroke obtains can be processed, recognition result is returned into client, improve treatment effect
Rate.Therefore, it is described to identify the identification segment in a kind of a kind of embodiment of herein described chat data input method
The information content can include:
S301:The identification segment is sent to preset service end and is identified matching treatment;Receive what service end was returned
Identification matching result.
Specifically, if above-mentioned identifying user is when the information content of stroke three identification segments for taking on drug packing box is caught a cold,
Certain server carries out image knowledge in this three identifications segment Block_1, Block_2, Block_3 being sent into service end
Manage in other places.Three taken identifications segment Block_1, Block_2, Block_3 are such as drawn to user carries out image recognition respectively, by it
Be converted into corresponding content of text " Beijing Tongrentang development in science and technology share ", " pharmaceutical factory of Co., Ltd ",
“www.tongrentangkj.com”.Then can be using this three content of text for identifying as identification matching treatment result
Return to user mobile phone client.Certainly, other embodiments can also be by service end side by this three texts for identifying
This content is spliced into a content of text " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory
Www.tongrentangkj.com " returns to client, or this three content of text splicings that client-side will be received
Merge into a content of text.
Certainly, in other embodiments, recognizing the image real time transfer of segment can also be processed in local terminal, such as
Hardware facility is more powerful in itself for mobile phone terminal, or terminal be PC or server, then it is described identify it is described identification segment letter
Breath content can include:
S302:Segment is recognized described in localization identification matching treatment, identification matching result is obtained.
Local identification matching treatment can carry out pictorial information identification under offline condition, or save customer flow, if
Localization identifying processing ability is stronger, then can improve the recognition efficiency of identification segment.
In another application scenarios, can set, if preferentially carried out using remote server under terminal networking state
The treatment such as database identification, matching, if suspension or not meeting long-range identification condition, can be localized identification,
With treatment.Therefore, in another embodiment of herein described method, the information content for identifying the identification segment can
To include:
S303:In the case where network traffic conditions are met, the identification segment is sent to preset service end and is identified matching
Treatment, and receive the identification matching result of service end return;Otherwise, segment is recognized described in localization identification matching treatment, is obtained
Identification matching result.
During image recognition processing, some identification segments may existence information be complete, resolution ratio is relatively low, local
Incompleteness etc., now server-side can further be entered in database according to the result of image recognition processing of identification segment
Row matching, perfect, correction, supplement etc. obtain the last information content for identifying.Therefore, herein described a kind of chat data
In another embodiment of input method, the identification matching treatment can include:
S3011:Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained;
In presetting database matching described image identification content, described image identification content is optimized according to matching result, after generation optimization
Identification matching result;
Accordingly, it is described to receive knowledge of the identification matching result including receiving after the optimization that service end is returned that service end is returned
Other matching result.
For example, above-mentioned identification segment Block_1 is drawn when taking in the last character " part " is not completely contained in, such as Fig. 5 institutes
The user for showing draws the incomplete Block_1 identification segment schematic diagrames for taking on picture to be identified.During Fig. 5 is a kind of embodiment of the application
The implementation process schematic diagram of Statistical error matching treatment result.Service end to three identification segment Block_1, Block_2,
Three content of text " Beijing Tongrentang development in science and technology strand ", " Co., Ltd's pharmacy are obtained after the identification of Block_3 database matchings
Factory ", " www.tongrentangkj.com ".Then this three content of text are further corrected and is spliced after improving
" Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory www.tongrentangkj.com ", then service end can be by
Identification matching result after this information is improved returns to user mobile phone terminal.Certainly, service end can also carry out other intelligence
Energy optimization processing etc., the text message ending and all characters for such as identifying Block_2 and Block_3 are respectively " factories " and " w ",
Then may be considered different language or state different semantic components, then space can be added between Block_2 and Block_3.
Similarly, accordingly, the content of text that Block_1 is identified with Block_2 can be with when being matched in the database of service end
So one perfect information of presence " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory " is inquired, therefore can be straight
Connect and spliced the text message that Block_1 and Block_2 is identified.
The image text information in identification segment can be identified in the application scenarios of embodiment described above, is converted
It is corresponding character text information, a view data Block_1 described above turns into " Beijing after being converted into character text information
Some chinese characters of Tongrentang development in science and technology share ".Chat data input method described herein is not limited to that,
In other embodiments, user is drawn during the segment regioinvertions that take can also include identifying segment for the corresponding information content
Code or coding information, such as identify the Quick Response Code or bar code in segment.In other application scenarios, user can be drawn
English word is such as translated into Chinese by the foreign languages translation in the identification segment for taking into appointed language.Even, in application scenes
In can identify the information contents such as the watermark, the goods links that are included in segment, extract these watermarks or goods links information
In can sending it to the chat scenario of user afterwards.So, user can obtain to be identified by mobile phone photograph or screenshotss etc.
Picture, then draws the segment for taking and needing identification, further identifies the dominant or recessive information content included in segment, or
Translated accordingly, changed, the much information input in user's chat scenario is aided in significantly, improved input speed and effect
Rate, helps user's identification pictorial information, improves Consumer's Experience.Therefore, a kind of herein described chat data input method is another
In a kind of embodiment, the information content for identifying the identification segment can include:
S311:The view data in the identification segment is identified, and is converted into corresponding text message.
It is described to identify the identification segment in a kind of another embodiment of herein described chat data input method
The information content can include performing it is following at least one treatment:
S312:Translate the code/coding information in the identification segment;
S313:If the text message for identifying is comprising carrying out the need for pre-setting translating the first languages, by described the
The text message of one languages translates into the text message of the second languages;
S314:Acquisition is arranged on the hiding information in the identification segment, and the hiding information includes but is not limited to picture
Watermark, commodity page link address, telephone number etc..
Code/coding information described in above-mentioned S322 can be such as Quick Response Code or bar code, rub this code, such as user
The barcode size or text field taken in Fig. 3 is drawn, corresponding binary system/ten's digit or other corresponding information can be translated into.
In S333, such as one section of english information is included in described identification segment, then in can obtaining picture in the present embodiment implementation process
English character information, and add these English character information translation after Chinese information, as shown in fig. 6, Fig. 6 be the application use
Draw a kind of embodiment schematic diagram of a scenario for taking identification region and recognizing pattern information content in family.It is described in some other embodiment
If identification segment includes some hiding informations, user may be not aware that in the presence of these recessive informations, then the application implementation in advance
Example can obtain these hiding informations when treatment is identified to identification segment, present it to user.Taken as user draws
Commodity page link address comprising this picture to be identified, then this commodity page chain that can be will identify that in identification segment
Together as the information content for identifying, can be sent in chat scenario for the commodity page link address by user for ground connection location.
It is general, if user is drawn in the identification segment for taking comprising polytype information content, the institute that can be identified
There is the information content to be all linked into the input frame of chat scenario.The one section of Chinese text T1 for such as being identified from segment and one section
English text T2, is then also turned over English text T2 therein when server or client locally recognize that segment is processed
Translate, generate corresponding cypher text T3.In addition, the bar code also drawn user in another piece of identification segment for taking is converted into
Corresponding 13 metric digital text T4.So, can be by above-mentioned polytype identification matching in a kind of implementation method
As a result these four text messages of T1, T2, T3, T4 are all linked into user's chat scenario, used as the chat data of user input.
Fig. 7 is that the application provides a kind of application scenarios schematic diagram that the information content that will identify that is linked into chat scenario, such as Fig. 7 institutes
Show, in another embodiment application scenarios, if identifying polytype information content, can in another embodiment
To allow user to select to need the information content species as input data.Specifically, a kind of chat data that the application is provided is defeated
Enter in another embodiment of method, methods described can also include:
When the information content for identifying includes polytype identification matching result, different type identification is provided the user
The option of matching result;And, obtain the identification matching result of user's selection;
Accordingly, it is described to include the chat scenario that the information content for identifying is linked into user:Obtained described
The identification matching result of the user's selection for taking is linked into the chat scenario of user.
Recognize that matching result can be including these four text messages of T1, T2, T3, T4 in application scenarios as described above.
Then the mode of these four text messages user's notice board can be showed user, user can therefrom select one or many
Individual text message is used as the data for needing to be input in chat scenario.Certainly, the division of type identification matching result can be with
Customized design, as described above in T1 and T2 can be merged into an identification matching result T1 ', the T1 ' can be expressed as from
User draws the information content of Direct Recognition output in the identification segment for taking, and T3, T4 etc. are then by further translation, code
The information content that identification, Data Format Transform etc. are obtained.
Obviously, allow user to select to need as the information content species of input data, some users can be facilitated to carry out defeated
Enter the selection of information, meet some user's requests, improve the user experience of these scene demands.
In some embodiments of the present application, the information content for identifying can be linked into the chat of user, specifically
Can include that the information content that will identify that is replicated in implementation and paste the defeated of dialog interface in user's current chat scene
In entering information editing's frame, as shown in Figure 4.Now, user can by click information send button will include identify described in
The chat data of the information content sends.Certainly, user can also be in input information editing's frame of chat scenario to described
The information content for identifying carries out editing and processing etc..In another embodiment of the application, it is also possible in chat scenario directly
The information content straight hair that will identify that is seen off, as the chat message that user has sent, as shown in figure 8, Fig. 8 is this Shen
Another application scenarios schematic diagram during the information content that will identify that is linked into chat scenario please be provided.Certainly, will identify that
The information content be linked into implementation method in the chat scenario of user and can also include other designs, such as be added to expression
Storehouse etc., can specifically be designed according to demand, realize facility, quick, auxiliary, the flexible information input of user, herein
Do not do and explain one by one.Therefore, it is described by the knowledge in a kind of another embodiment of herein described chat data input method
The information content not gone out is linked into the chat scenario of user at least one implementation method that can include using in following:
S321:Using the information content for identifying as data cached storage, the stickup instruction based on user will caching
Data is activation is in the text edit box of chat scenario;
S322:Using the information content for identifying as having been enter into disappearing in current chat scene Chinese version edit box
Breath content;
S323:Using the information content for identifying as the message content sent in the chat scenario of user;
S324:The information content for identifying is added to the information collection column of user.
Information collection column described in above-mentioned can include the expression column of user, can be with while storage user's expression information
Simultaneously or the packet information content that is obtained by picture to be identified of storage.Can also include being carried out using single functional module
Storage, as sent voice, picture, functional unit of video conversation etc..User can be so facilitated to check what is recognized in the later stage
The information content, or conveniently quickly will generate factory's information on the preferable cold drug of effect in for example above-mentioned application scenarios later
It is shared with other good friends etc..In above-mentioned S321, the information content for identifying can first temporary cache in pasting boards, the stand-by head of a household
Just the information content is shown in text edit box by ejection function option and after selecting paste functionality.In S322, then can be with
The information content that directly will identify that is sent in text edit box, facilitates the quick succinct input demand of some users.Certainly,
In S323, then the information content that more fast and efficiently can directly will identify that is sent to good friend.Each of S321~S324
Implementation method can individually be implemented, and certainly, in application scenes, the application is not precluded from using the group of plurality of mode
Close implementation method identification information is linked into the chat scenario of user.Accessed using the chat data of various ways, Ke Yifang
Just flexibly, each implementation method can realize that quickly, easily chat data is input into, and meets the user's need under some scenes
Ask, improve the chat application experience of these users.
In the application scenes for implementing the application, user is often the hope of randomness by some information on material object
Be input into as chat message, or fall in rarely used word or None- identified foreign language, icon, coding etc..In these applications
Under scene, user can generally be taken material object is taken pictures with terminal such as mobile phone camera, and then smearing is drawn to be taken and needed on photo
Seek the rarely used word of identification or one section of text message replicating etc., user can be helped to rapidly input, and the side of input
Formula is convenient, flexible, and the information input experience effect lifting of user is obvious.Therefore, the application provides a kind of specific chat message
In another embodiment of input mode, methods described can include:
Triggering command based on user opens filming apparatus, obtains the shooting figure that user is obtained by the filming apparatus
Piece;
Obtain user and the identification segment for taking is drawn on the shooting picture;
Match cognization goes out the information content of the identification segment, and the information content for identifying is sent into chat scenario
Text edit box in.
The chat data input method shown in above-mentioned each embodiment that the application is provided, can pass through in chat scenario
Take pictures etc. and to obtain picture to be identified, user is drawn into information access that figure identifies in chat scenario, realize the text of view data
The input auxiliary such as this conversion, rarely used word identification, the identification of coding/code, translation, implicit information, helps user to realize passing through picture
Snap information input, and auxiliary information is input into, there is provided the identification of flexile remote information, the selection input of polymorphic type information
Deng, the chat message input convenience of instant messaging application is greatly improved, improve Consumer's Experience.It is to be particularly noted that on
Each embodiment is stated to be described by the way of progressive, what each embodiment was stressed be it is different from other embodiment it
Place, different implementation sections can be used mutually between each embodiment.Although above-mentioned one kind is illustrated at long-range matching
Reason identification module, explanation illustrates segment code translation, languages conversion, obtains hiding information etc. in another embodiment, it is clear that
The mutual result of each embodiment is used for reference, it is possible to achieve remote service end carries out segment code translation, languages conversion etc., it is also possible to eventually
End localization is processed etc..So, even if the embodiment of the present application does not provide such implementation method directly, it is apparent that logical
Cross read the application each embodiment can other embodiment that mutually combinations of features is realized deformation, conversion, extended, these realities
Applying mode should all belong within the practical range of the application protection.
Based on chat data input method described herein, the application provides a kind of chat data input unit.It is described
Device can be used for the information input in instant messaging application in the multiple terminal equipment such as mobile phone, flat board, PC, server, PDA,
Can be integrated in the functional unit of instant messaging application (such as application program module), help user to realize by pictorial manner
Snap information is input into.Fig. 9 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as
Shown in Fig. 9, described device can include:
Picture acquisition module 101, can be used for obtaining the picture to be identified chosen;
Segment draws modulus block 102, can be used for receiving drawing on the picture to be identified and takes manipulation instruction, it is determined that described
Identification segment in picture to be identified;
Graphic blocks identifying module 103, can be used for identifying the information content of the identification segment;
MIM message input module 104, can be used for being linked into the information content for identifying in chat scenario.
Using the embodiment of herein described device, can in chat scenario by reading the picture that user chooses,
Then the image content that user chooses on the picture is identified, corresponding content of text messages can be translated into, and
The information content that can be will identify that is linked into the chat scenario of user.So, by way of picture recognition, can be quick
The content in picture is obtained, helps user to realize that the information in chat scenario rapidly inputs.Can be with using the application embodiment
Solve user will not or uncomfortable use character or touch keypad puzzlement, during help recognizes rarely used word, quick obtaining picture
Character information, multi-faceted auxiliary user input improves Consumer's Experience.
Figure 10 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Figure 10
Shown, the picture acquisition module 101 can include:
Taking module 1011, can be used for providing the user photograph taking option, and the triggering command based on user is opened
Filming apparatus;
Picture confirms module 1012, can be used for obtaining the shooting photo that user is obtained by the filming apparatus;And base
The confirmation of current shooting photo is used to instruct the picture to be identified that the current shooting photo is chosen as user in user.
In the present embodiment application scenarios, user can be taken pictures by the cam device of mobile phone, quickly and easily be obtained
Take pending picture.This implement scene can be applied and run into rarely used word input, more document clip information input (entity
Information input on books or business card), cumbersome information input (such as French, it is more long and including the network address of Various Complex character)
Deng when, user can directly pass through mobile phone photograph, it would be desirable to which the information being input in chat scenario is included in shooting figure piece.This
Sample, can remove the operation such as many handwriting inputs of user, character/code identification from during subsequent treatment, realize Speed Chat content
Information input, aids in user input, improves convenience.
Figure 11 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Figure 11
It is shown, the picture acquisition module 101 can include it is following at least one:
It is local to choose module 1013, can be used for obtaining the local photo that user chooses from this map office, with what is chosen
Local photo is used as picture to be identified;
Chat record picture chooses module 1014, can be used for obtaining the chat picture that user chooses in chat record,
Using the chat picture chosen as picture to be identified;
Screenshot capture chooses module 1015, can be used for the triggering command based on user and performs screenshot capture, with the screen
The sectional drawing picture that curtain sectional drawing is obtained is used as picture to be identified.
As described above, user (herein can also directly unitedly call the picture storage of terminal localization from picture library or photograph album
Be picture library) in choose one group of picture as picture to be identified described herein.In other some embodiment application scenarios
In, described picture to be identified can also be the picture of screenshot capture acquisition, or chatting in the dialog box of current chat interface
Picture chosen in its record etc..In the present embodiment, picture to be identified can be obtained using various ways, improve user using figure
Table identification rapidly inputs the flexibility of chat message, convenient for the user to operate, improves Consumer's Experience.
As described above, recognizing the implementation method of the information content in the identification segment can use local processing unit
It is identified picture character identification conversion, it would however also be possible to employ the identification segment is uploaded into remotely/cloud server carries out figure
As identifying processing.Figure 12 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as
Shown in Figure 12, the graphic blocks identifying module 103 can include:
Long-range identification module 1031, can be used for recognizing that segment is sent to preset service end and is identified at matching by described
Reason;Receive the identification matching result that service end is returned;
Local identification module 1032, to change and recognize segment described in identification matching treatment in which can be used for, and obtains identification matching knot
Really;
Identification module select unit 1033, can be used for according to the treatment rule long-range identification module 1031 of selection for setting or
Local identification module 1032 recognizes the information content of the segment.
Described treatment rule can be configured according to design requirement, such as preferentially using long-range identification module 1031 or
It is preferential to recognize segment using 1032 resume modules of local identification, or certain Rule of judgment is set, such as meeting network service
Under the conditions of, local identification module 1032;Otherwise, processed using 1033 pairs of identification segments of identification module select unit.
During image recognition processing, some identification segments may existence information be complete, resolution ratio is relatively low, local
Incompleteness etc., now server-side can according to identification segment image recognition processing result further be carried out in database
Matching, perfect, correction, supplement etc. obtain the last information content for identifying.Therefore, a kind of herein described chat data is defeated
Enter in device another kind embodiment, the identification matching treatment can include:
Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained;
In presetting database matching described image identification content, described image identification content is optimized according to matching result, it is raw
Into the identification matching result after optimization;
Accordingly, it is described to receive knowledge of the identification matching result including receiving after the optimization that service end is returned that service end is returned
Other matching result.
Identification segment Block_1 as described in above-mentioned embodiment draws the last character " part " when taking and is not completely contained in
It is interior, but complete " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory " letter can be obtained by database matching inquiry
Breath, treatment is optimized to loss of learning that may be present, mistake.
In a kind of herein described chat data input unit another kind embodiment, the graphic blocks identifying module includes:
Text identification module, for identifying the view data in the identification segment, and is converted into corresponding text envelope
Breath.In a kind of herein described chat data input unit another kind embodiment, the graphic blocks identifying module identifies the knowledge
The information content of other segment can obtain the information content including at least one treatment of the execution in following:
Translate the code/coding information in the identification segment;
If the text message for identifying the need for pre-setting comprising carrying out translating the first languages, by first languages
Text message translate into the text message of the second languages;
Acquisition is arranged on the hiding information in the identification segment.
The image text information in identification segment can be identified in the application scenarios of embodiment described above, is converted
It is corresponding character text information, a view data Block_1 described above turns into " Beijing after being converted into character text information
Some chinese characters of Tongrentang development in science and technology share ".Chat data input method described herein is not limited to that,
In other embodiments, user is drawn during the segment regioinvertions that take can also include identifying segment for the corresponding information content
Code or coding information, such as identify the Quick Response Code or bar code in segment.In other application scenarios, user can be drawn
English word is such as translated into Chinese by the foreign languages translation in the identification segment for taking into appointed language.Even, in application scenes
In can identify the information contents such as the watermark, the goods links that are included in segment, extract these watermarks or goods links information
In can sending it to the chat scenario of user afterwards.So, user can obtain to be identified by mobile phone photograph or screenshotss etc.
Picture, then draws the segment for taking and needing identification, further identifies the dominant or recessive information content included in segment, or
Translated accordingly, changed, the much information input in user's chat scenario is aided in significantly, improved input speed and effect
Rate, helps user's identification pictorial information, improves Consumer's Experience.
In another embodiment application scenarios of herein described device, if identifying polytype information content,
User can be then allowed to select to need as the information content species of input data in another embodiment.Figure 13 is the application institute
A kind of a kind of modular structure schematic diagram of embodiment of chat data input unit is stated, as shown in figure 13,
Described information input module 104 can include:
Input information choice module 1041, can be used for including polytype identification matching when the information content for identifying
When as a result, the option that different type recognizes matching result is provided the user;And, obtain the identification matching result of user's selection;
As a result input module 1042, the identification matching result that can be used for user's selection of the acquisition is linked into user's
In chat scenario.
Obviously, allow user to select to need as the information content species of input data, some users can be facilitated to carry out defeated
Enter the selection of information, meet some user's requests, improve the user experience of these scene demands.
MIM message input module 104 can be wrapped described in a kind of herein described chat data input unit another kind embodiment
Include it is following at least one module:
Caching input module, can be used for the information content for identifying as data cached storage, based on user
Stickup instruction be sent to data cached in the text edit box of chat scenario;
First method input module, can be used for the information content for identifying as having been enter into current chat
Message content in scape Chinese version edit box;
Second method input module, can be used for using the information content for identifying as in the chat scenario of user
The message content for sending;
Gallery module, can be used for being added to the information content for identifying the information collection column of user.
Information collection column described in above-mentioned can include the expression column of user, can be with while storage user's expression information
Simultaneously or the packet information content that is obtained by picture to be identified of storage, it is also possible to carried out including the single functional module of use
Storage.
In embodiments herein, the information content for identifying can be linked into the chat of user, concrete implementation
Can include that the information content that will identify that replicates the input letter for pasting dialog interface in user's current chat scene in mode
In breath edit box.Now, user can will include the chat of the described information content for identifying by click information send button
Data is activation is gone out.Certainly, user can also be in input information editing's frame of chat scenario in the information for identifying
Appearance carries out editing and processing etc..In another embodiment, it is also possible to the information content straight hair that directly be will identify that in chat scenario
See off, as the chat message that user has sent.Certainly, the information content that will identify that is linked into the chat of user
Implementation method in scape can also include other designs, such as be added to expression storehouse, can specifically carry out according to demand
Design, realizes facility, quick, auxiliary, the flexible information input of user.
In physical end such as mobile phone, user can on a terminal screen directly by the continuously slipping selected one piece of knowledge of finger
Other segment.The application others implementation methods in be not limited to that, in other embodiments user can also by felt pen,
The physical instrument modes such as laser pen, magnetic optical induction pen are directly or indirectly drawn on picture to be identified and take identification segment.Therefore, institute
In stating another embodiment of device, described stroke is taken manipulation instruction and can include being made using at least one implementation method in following
With the director data produced on picture to be identified:
Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
Wherein, described finger touches to draw to take can be included directly being drawn with finger taking, it is also possible to use the virtual picture for providing
The instruments such as pen, head and the tail (or multiple) positioning cursor, analog mouse are drawn on picture to be identified and take region.
The chat data input unit shown in above-mentioned each embodiment that the application is provided, can pass through in chat scenario
Take pictures etc. and to obtain picture to be identified, user is drawn into information access that figure identifies in chat scenario, realize the text of view data
The input auxiliary such as this conversion, rarely used word identification, the identification of coding/code, translation, implicit information, helps user to realize passing through picture
Snap information input, and auxiliary information is input into, there is provided the identification of flexile remote information, the selection input of polymorphic type information
Deng, the chat message input convenience of instant messaging application is greatly improved, improve Consumer's Experience.
As it was previously stated, the chat data input method or device of the application offer can be used for mobile phone, flat board, PC, service
Information input in the multiple terminal equipment such as device, PDA in instant messaging application, can be integrated in the function group of instant messaging application
In part (such as application program module), help user to realize being input into by the snap information of pictorial manner, improve user's instant messaging
Using or terminal experience.Therefore, the application also provides a kind of communicating terminal, specifically, in a kind of embodiment, it is described logical
News terminal can include processing unit, wherein,
The processing unit can be configured to, and can be used for obtaining the picture to be identified chosen;Can be also used for receiving
Drawing on the picture to be identified takes manipulation instruction, determines the identification segment in the picture to be identified;Can be also used for knowing
Do not go out the information content of the identification segment, and the information content for identifying is sent to communication interface designated area position
Put.
In the application scenes for implementing the application, when user is chatted using communication terminal, often randomness
Hope be input into some information on material object as chat message, or fall in rarely used word or None- identified is outer
Text, icon, coding etc..Under these application scenarios, user can generally take to be carried out with terminal such as mobile phone camera to material object
Take pictures, then smearing is drawn and takes the rarely used word that demand is recognized on photo or the one section of text message for replicating etc..Therefore, originally
Application also provides a kind of being taken pictures especially with filming apparatus and obtains pending picture and carry out the communication terminal of chat message input,
Then user is drawn and takes segment with acquisition picture of taking pictures, and is converted to text, page turning, decoding etc., and user can be helped to rapidly input,
And input mode is convenient, flexible, the information input experience effect lifting of user is obvious.Specifically, one kind that the application is provided
In a kind of embodiment of communicating terminal, the communicating terminal can include filming apparatus and processor, wherein,
Even if the triggering command that the communication terminal is based on user opens filming apparatus, the picture shooting for responding user refers to
Order;
The processor is configured to, for obtaining the shooting picture that user is obtained by the filming apparatus;It is additionally operable to
Receive user's drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;Also use
In the information content for identifying the identification segment, and the communication interface that the information content for identifying is sent to user is referred to
Determine regional location.
Figure 14 is that a kind of instant communication terminal of chat data input chat data in the chat scenario that the application is provided shows
It is intended to.
Although mentioning different pending picture acquisition modes in teachings herein, smearing is drawn and takes identification figure on picture
Block, database matching identification, image recognition, identification information are linked into the various sequential manners of user's scene, message and send/connect
The description of the information interaction approach etc. received/judge, but, the application be not limited to must be database data storage rule,
Situation described by industry communication standard, image recognition technology standard or embodiment etc., some professional standards or using making by oneself
Right way of conduct formula or embodiment description practice processes on embodiment amended slightly can also realize above-described embodiment it is identical, etc.
The implementation result being anticipated that after same or close or deformation.Using the data acquisition after these modifications or deformation, storage, judgement, place
The embodiment of the acquisitions such as reason mode, within the scope of still may belong to the optional embodiment of the application.
Although this application provides the method operating procedure as described in embodiment or flow chart, based on conventional or noninvasive
The means of the property made can include more or less operating procedures.The step of being enumerated in embodiment order is only numerous steps
A kind of mode in execution sequence, unique execution sequence is not represented.When device or client production in practice is performed, can
Performed or executed in parallel (such as at parallel processor or multithreading with according to embodiment or method shown in the drawings order
The environment of reason, even distributed data processing environment).Term " including ", "comprising" or its any other variant be intended to contain
Lid nonexcludability is included, so that process, method, product or equipment including a series of key elements not only will including those
Element, but also other key elements including being not expressly set out, or also include being this process, method, product or equipment
Intrinsic key element.In the absence of more restrictions, be not precluded from the process including the key element, method, product or
Also there are other identical or equivalent elements in person's equipment.
Unit, device or module that above-described embodiment is illustrated etc., can specifically be realized by computer chip or entity, or
Realized by the product with certain function.For convenience of description, describe to be divided into various modules point with function during apparatus above
Do not describe.Certainly, can the function of each module is real in same or multiple softwares and/or hardware when the application is implemented
It is existing, it is also possible to will to realize that the module of same function is realized etc. by the combination of multiple submodule or subelement.Dress described above
It is only schematical to put embodiment, for example, the division of the unit, only a kind of division of logic function, when actually realizing
There can be other dividing mode, such as multiple units or component can combine or be desirably integrated into another system, or one
A little features can be ignored, or not perform.It is another, shown or discussed coupling or direct-coupling or communication link each other
Connecing can be that the INDIRECT COUPLING or communication connection of device or unit can be electrical, mechanical or other shapes by some interfaces
Formula.
It is also known in the art that in addition to realizing controller in pure computer readable program code mode, it is complete
Entirely can by by method and step carry out programming in logic come cause controller with gate, switch, application specific integrated circuit, may be programmed
Logic controller realizes identical function with the form of embedded microcontroller etc..Therefore this controller is considered one kind
Hardware component, and the device for realizing various functions included to its inside can also be considered as the structure in hardware component.Or
Person even, can be used to realizing that the device of various functions is considered as not only being the software module of implementation method but also can be hardware
Structure in part.
The application can be described in the general context of computer executable instructions, such as program
Module.Usually, program module includes performing particular task or realizes routine, program, object, the group of particular abstract data type
Part, data structure, class etc..The application can also be in a distributed computing environment put into practice, in these DCEs,
Task is performed by the remote processing devices connected by communication network.In a distributed computing environment, program module can
With in the local and remote computer-readable storage medium including including storage device.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can
Realized by the mode of software plus required general hardware platform.Based on such understanding, the technical scheme essence of the application
On the part that is contributed to prior art in other words can be embodied in the form of software product, the computer software product
Can store in storage medium, such as ROM/RAM, magnetic disc, CD, including some instructions are used to so that a computer equipment
(can be personal computer, mobile terminal, server, or network equipment etc.) performs each embodiment of the application or implementation
Method described in some parts of example.
Each embodiment in this specification is described by the way of progressive, same or analogous portion between each embodiment
Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.The application can be used for crowd
In more general or special purpose computing system environments or configuration.For example:Personal computer, server computer, handheld device or
Portable set, laptop device, multicomputer system, the system based on microprocessor, set top box, programmable electronics set
Standby, network PC, minicom, mainframe computer, the DCE including any of the above system or equipment etc..
Although depicting the application by embodiment, it will be appreciated by the skilled addressee that the application have it is many deformation and
Change is without deviating from spirit herein, it is desirable to which appended claim includes these deformations and changes without deviating from the application's
Spirit.