CN106909270A - Chat data input method, device and communicating terminal - Google Patents

Chat data input method, device and communicating terminal Download PDF

Info

Publication number
CN106909270A
CN106909270A CN201610576551.1A CN201610576551A CN106909270A CN 106909270 A CN106909270 A CN 106909270A CN 201610576551 A CN201610576551 A CN 201610576551A CN 106909270 A CN106909270 A CN 106909270A
Authority
CN
China
Prior art keywords
identification
user
picture
chat
identified
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610576551.1A
Other languages
Chinese (zh)
Inventor
金雯彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Advantageous New Technologies Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201610576551.1A priority Critical patent/CN106909270A/en
Publication of CN106909270A publication Critical patent/CN106909270A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/63Scene text, e.g. street names

Abstract

The application provides a kind of chat data input method, device and communicating terminal.Methods described includes:Obtain the picture to be identified chosen;Receive drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;The information content of the identification segment is identified, the information content for identifying is linked into chat scenario.Using each embodiment in the application, character information in user's identification rarely used word, quick obtaining picture etc. can be helped, multi-faceted auxiliary user input improves Consumer's Experience.

Description

Chat data input method, device and communicating terminal
Technical field
The application belongs to the technical field of data processing in instant messaging application, more particularly to a kind of chat data input side Method, device and communicating terminal.
Background technology
With developing rapidly for mobile communication technology, IM (InstantMessaging, immediate communication tool) has turned into people Live in an essential part.User can be by IM softwares such as QQ, wechat, nail nail etc., in real time with friend, same The contact persons such as thing, household are communicated, and greatly facilitate the daily exchange demand of people.
At present, user can be believed in immediate communication tool with being input into word, voice, expression, picture etc. in chat scenario Breath.These chat messages can be generally directly inputted in chat by modes such as the input through keyboard of user, expression or picture selections In the dialog interface of scene.Although user can be input into diversified chat message in existing immediate communication tool, this The mode that the input mode of kind chat message is all based on the keyboard spelling or expression, picture selection of user etc. is directly inputted to merely In its scene.And in other application scenarios, such as rarely used word that will not spell of user, user or uncomfortable will not use keyboard Input, or user needs some of extracts or inquiry picture information to be sent to other side, such as checks official's network address, search paper In certain formula implication, etc., in this case, the information input mode in existing chat scenario is difficult to quick, side Just these use demands for meeting user.User now is often hand-written inquiry rarely used word or character input picture one by one Website information of middle commodity etc., user is cumbersome, and chat message input is slow, and the experience of user's chat application is poor.
The content of the invention
The application purpose is to provide a kind of chat data input method, device and communicating terminal, can be schemed by reading Information in piece, is translated into text character etc. and realizes rapidly inputting for the information content in chat scenario, greatly improves user The experience of chat application.
What a kind of chat data input method, device and the communicating terminal that the application is provided were realized in:
A kind of chat data input method, methods described includes:
Obtain the picture to be identified chosen;
Receive drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;
The information content of the identification segment is identified, the information content for identifying is linked into chat scenario.
A kind of chat data input method, methods described includes:
Triggering command based on user opens filming apparatus, obtains the shooting figure that user is obtained by the filming apparatus Piece;
Obtain user and the identification segment for taking is drawn on the shooting picture;
Match cognization goes out the information content of the identification segment, and the information content for identifying is sent into chat scenario Text edit box in.
A kind of chat data input unit, described device includes:
Picture acquisition module, for obtaining the picture to be identified chosen;
Segment draws modulus block, and manipulation instruction is taken for receiving drawing on the picture to be identified, determines described to be identified Identification segment in picture;
Graphic blocks identifying module, the information content for identifying the identification segment;
MIM message input module, for the information content for identifying to be linked into chat scenario.
A kind of communicating terminal, including processing unit,
The processing unit is configured to, for obtaining the picture to be identified chosen;It is additionally operable to receive described to be identified Drawing on picture takes manipulation instruction, determines the identification segment in the picture to be identified;It is additionally operable to identify the identification segment The information content, and the information content for identifying is sent to communication interface designated area position.
A kind of communicating terminal, including filming apparatus and processor,
Triggering command based on user opens filming apparatus, responds the picture shooting instruction of user;
The processor is configured to, for obtaining the shooting picture that user is obtained by the filming apparatus;It is additionally operable to Receive user's drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;Also use In the information content for identifying the identification segment, and the communication interface that the information content for identifying is sent to user is referred to Determine regional location.
A kind of chat data input method, device and communicating terminal that the application is provided, can pass through in chat scenario The picture that user chooses is read, the image content that user chooses on the picture is then identified, phase can be translated into The content of text messages answered, it is possible to which the information content that will identify that is linked into the chat scenario of user.So, by picture Know otherwise, with the content in quick obtaining picture user can be helped to realize that the information in chat scenario rapidly inputs.Utilize The application embodiment can solve user will not or uncomfortable use character or touch keypad puzzlement, help recognize it is uncommon Character information in word, quick obtaining picture etc., multi-faceted auxiliary user input improves Consumer's Experience.
Brief description of the drawings
In order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art, below will be to embodiment or existing The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this Some embodiments described in application, for those of ordinary skill in the art, are not paying the premise of creative labor Under, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of method flow diagram of embodiment of a kind of chat data input method that the application is provided;
Fig. 2 is the process schematic of the picture to be identified of acquisition user's selection in a kind of embodiment of the application;
Fig. 3 is that user draws the implementation process schematic diagram for taking identification region, determining identification segment in a kind of embodiment of the application;
Fig. 4 is that the information content that identification segment is processed in herein described chat data input method and be will identify that is accessed The process schematic of chat scenario;
Fig. 5 is the implementation process schematic diagram of Statistical error matching treatment result in a kind of embodiment of the application;
Fig. 6 is that the application user draws a kind of embodiment schematic diagram of a scenario for taking identification region and recognizing pattern information content;
Fig. 7 is that the application provides a kind of application scenarios signal that the information content that will identify that is linked into chat scenario Figure;
Fig. 8 is that the application provides another application scenarios signal that the information content that will identify that is linked into chat scenario Figure;
Fig. 9 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit;
Figure 10 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit;
Figure 11 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit;
Figure 12 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit;
Figure 13 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit;
Figure 14 is that a kind of instant communication terminal of chat data input chat data in the chat scenario that the application is provided shows It is intended to.
Specific embodiment
In order that those skilled in the art more fully understand the technical scheme in the application, below in conjunction with the application reality The accompanying drawing in example is applied, the technical scheme in the embodiment of the present application is clearly and completely described, it is clear that described implementation Example is only some embodiments of the present application, rather than whole embodiments.Based on the embodiment in the application, this area is common The every other embodiment that technical staff is obtained under the premise of creative work is not made, should all belong to the application protection Scope.
Fig. 1 is a kind of a kind of herein described method flow diagram of embodiment of chat data input method.Although the application There is provided such as following embodiments or method operating procedure shown in the drawings or apparatus structure, but based on routine or without creative Work can include more or less operating procedure or modular unit in methods described or device.In logicality not In the step of in the presence of necessary causality or structure, the execution sequence of these steps or the modular structure of device are not limited to the application Embodiment or execution sequence shown in the drawings or modular structure.The device in practice of described method or modular structure or end During the products application of end, according to embodiment or method shown in the drawings or modular structure can carry out order execution or hold parallel Row (environment of such as parallel processor or multiple threads, the even implementation environment including distributed treatment).
Specifically as described in Figure 1, a kind of a kind of embodiment of chat data input method that the application is provided can include:
S1:Obtain the picture to be identified chosen.
The embodiment of the present application is input into the chat scenario of mobile phone terminal instant messaging application chat message with user as should Illustrated with scene.Fig. 2 is the process schematic of the picture to be identified of acquisition user's selection in a kind of embodiment of the application, In Fig. 2, user wants to send the relevant information of the company of cold drug producer that good friend 1 seeks advice to good friend.Now, user can chat Picture is selected by corresponding function button in the dialog interface of its scene.Specifically, picture library can be chosen in some embodiments In the picture that has preserved as picture to be identified.In the application scenarios of the application such as Fig. 2, a kind of implementation method can be logical for user Cross the picture to be identified of acquisition of taking pictures.As shown in 2-1 in Figure 2, user can click on the camera that " taking pictures " button starts mobile phone, Then the back side against photograph subject-flu drug packing box is taken pictures, and obtains a shooting picture, 2-2 in such as Fig. 2.If with Family determines to use the pictures, then can click on " using photo " and be confirmed, you can obtain picture to be identified, 2- in such as Fig. 2 3。
It is of course also possible, as described before, the picture of terminal localization directly (can also be stored system by user herein from picture library or photograph album One be referred to as picture library) in choose one group of picture as picture to be identified described herein.In other some embodiment applications In scene, described picture to be identified can also be the picture that screenshot capture is obtained, or in the dialog box of current chat interface Chat record in the picture etc. chosen.Therefore, the herein described a kind of embodiment for obtaining the picture to be identified that user chooses In, the picture to be identified chosen that obtains can include:
S101:Triggering command based on user opens filming apparatus;With the shooting that user is obtained by the filming apparatus Picture is used as picture to be identified.
Above-mentioned S101 goes in the implementation of most application scenarios.Certainly, it is described to obtain choosing in another embodiment The picture to be identified for taking can include:
S102:The local photo chosen from this map office of user is obtained, the described local photo using selection is used as waiting to know Other picture;
S103:The chat picture chosen in chat record of user is obtained, the chat picture using selection is used as waiting to know Other picture;
S104:Triggering command based on user performs screenshot capture, the sectional drawing picture obtained using the screenshot capture as Picture to be identified.
Described screen result can include such as mobile phone terminal full screen printscreen, or PC terminals drag the part of rectangular block The implementation method of sectional drawing.In the present embodiment, picture to be identified can be obtained using various ways, improve user and utilize Chart recognition The flexibility of chat message is rapidly input, it is convenient for the user to operate, improve Consumer's Experience.
In the present embodiment application scenarios, user can be taken pictures by the cam device of mobile phone, quickly and easily be obtained Take pending picture.This implement scene can be applied and run into rarely used word input, more document clip information input (entity Information input on books or business card), cumbersome information input (such as French, it is more long and including the network address of Various Complex character) Deng when, user can directly pass through mobile phone photograph, it would be desirable to which the information being input in chat scenario is included in shooting figure piece.This Sample, can remove the operation such as many handwriting inputs of user, character/code identification from during subsequent treatment, realize Speed Chat content Information input, aids in user input, improves convenience.In addition, the picture to be identified that the acquisition described in the present embodiment is chosen exists The picture to be identified that user chooses can be included in some embodiment application scenarios, it is also possible to including electronic equipment using certain calculation The picture that method is chosen, or other pictures to be identified obtained according to setting reading rule selection etc..
S2:Receive drawing on the picture to be identified and take manipulation instruction, determine the identification figure in the picture to be identified Block
After obtaining picture to be identified, user can draw the band of position for taking and needing identification on the picture to be identified, such as The a certain style of writing word that is shown in picture to be identified, a certain piece of bar code etc..Fig. 3 is that user draws and takes in a kind of embodiment of the application Identification region, the implementation process schematic diagram for determining identification segment.User can repeatedly be edited on the picture to be identified, Multiple discontinuous regions are such as chosen, or cancels stroke some for the multiple regions for taking or multiple, drawn again and take.User selects After good content, the completion instruction of setting, click " completion " button in such as Fig. 3, it is determined that final this time to be identified can be triggered The content recognized the need for taking is drawn in picture.In the present embodiment, user on screen draw take selection content operation can be by end End equipment recognizes, produces and draw accordingly extract operation instruction.Mobile phone can be received and read user on mobile phone screen to be identified The extract operation of drawing of picture is instructed, the manipulation behavior according to user, it is determined that where the information content of final this time demand identification one Individual or multiple identification segments, user is smeared by gesture and draws three pieces taken out identification segments in such as Fig. 3.
Reception drawing on the picture to be identified described in the present embodiment takes manipulation instruction can be included receiving user Act directly on the drawing for generation on the picture to be identified and take manipulation instruction, it is also possible to including the user that electronic equipment is detected What indirectly-acting was produced on the picture to be identified draws extract operation instruction, even acquires other-end equipment/function Component/physics sensing apparatus etc. are applied to the extract operation of drawing produced on picture to be identified and instruct.
As shown in Figure 3, in the embodiment of the present application, the mode that user stroke takes the information content in selection picture can include The mode that gesture is smeared is chosen, is replicated, and user can on a terminal screen directly by the continuously slipping selected one piece of identification of finger Segment.The application others implementation methods in be not limited to that, in other embodiments user can also by felt pen, swash The physical instrument modes such as light pen, magnetic optical induction pen are directly or indirectly drawn on picture to be identified and take identification segment.Wherein, it is described Finger touch to draw to take and can include directly being drawn with finger taking, it is also possible to it is fixed using the virtual paintbrush, head and the tail (or multiple) that provide The instruments such as position cursor, analog mouse are drawn on picture to be identified and take region.Therefore, a kind of chat data input that the application is provided In a kind of embodiment of method, described stroke is taken manipulation instruction and includes being acted on using at least one implementation method in following and wait to know The director data produced on other picture:
S201:Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
S202:User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
S203:Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
In concrete implementation mode, described limbs touching is common can to include finger slip on a terminal screen, Can certainly be other limbs of user, such as toe or nose.Described magnetic induction or photoinduction can include being drawn every sky The mode for taking, described acrognosis should include the implementation methods such as gesture induction, eyes (Rotation of eyeball) sensing.
Instructed by the extract operation of drawing for receiving user, it may be determined that one or more knowledge gone out in the picture to be identified Other segment.After user confirms, these identification segments can be replicated preservation in the buffer.
S3:The information content of the identification segment is identified, the information content for identifying is linked into chat scenario In.
Drawn according to user and take selected identification segment, carry out picture recognition treatment.To can be obtained in the embodiment of the present application Each identification segment image information be converted into corresponding text message, the text message that then will can be identified after conversion It is linked into the chat scenario of user.In specific such as the present embodiment application scenarios, user draws the three identification segments for taking, and this three Individual identification segment is view data, including pixel color, gray scale, gradient etc..Can by image recognition technology by this three The character information included in individual identification segment is converted into corresponding text.Specifically recognize the information content in the identification segment Implementation method can using local processing unit be identified picture character identification conversion, it would however also be possible to employ by it is described identification scheme Block uploads to remotely/cloud server and carries out image recognition processing, the recognition result that then the reception server is returned, and is identified The information content of segment.
Fig. 4 is that the information content that identification segment is processed in herein described chat data input method and be will identify that is accessed The process schematic of chat scenario, as shown in figure 4, drawing three taken identification segments Block_1, Block_2, Block_ to user 3 carry out image recognition respectively, are translated into corresponding content of text " Beijing Tongrentang development in science and technology share ", " Co., Ltd Pharmaceutical factory ", " www.tongrentangkj.com ".Then these text information contents that can be will identify that are linked into user Currently with the chat scenario of good friend in.The specific implementation that accesses can include the information content default copy that for example will identify that To in pasting boards, the information content that user will identify that in the information input frame of chat scenario dialog interface by paste operation It is input in chat message edit box, as shown in Figure 4.
Certainly, the present embodiment provide method not only can rapidly inputting with the text message in picture, in practical application Middle user be again may be by taking pictures when running into rarely used word, draw and take rarely used word, and rarely used word is converted into text character is carried out Input, greatly improves user's chat message data speed, and aids in user input, recognizes rarely used word.
Using herein described embodiment, can be in chat scenario by reading the picture that user chooses, Ran Houshi Do not go out the image content that user chooses on the picture, corresponding content of text messages can be translated into, it is possible to will The information content for identifying is linked into the chat scenario of user.So, by way of picture recognition, can be with quick obtaining figure Content in piece, helps user to realize that the information in chat scenario rapidly inputs.Can solve to use using the application embodiment Family will not or uncomfortable use character or touch keypad puzzlement, help recognize in rarely used word, quick obtaining picture character letter Breath, multi-faceted auxiliary user input improves Consumer's Experience.
As described above, recognizing the implementation method of the information content in the identification segment can use local processing unit It is identified picture character identification conversion, it would however also be possible to employ the identification segment is uploaded into remotely/cloud server carries out figure As identifying processing.In a kind of implementation method that the application is provided, can use and segment is preferentially identified by server-side Identification, conversion process etc..So, because usual server-side is calculated, disposal ability is strong, memory space is big, identification channel is more Deng, quickly the identification segment that user stroke obtains can be processed, recognition result is returned into client, improve treatment effect Rate.Therefore, it is described to identify the identification segment in a kind of a kind of embodiment of herein described chat data input method The information content can include:
S301:The identification segment is sent to preset service end and is identified matching treatment;Receive what service end was returned Identification matching result.
Specifically, if above-mentioned identifying user is when the information content of stroke three identification segments for taking on drug packing box is caught a cold, Certain server carries out image knowledge in this three identifications segment Block_1, Block_2, Block_3 being sent into service end Manage in other places.Three taken identifications segment Block_1, Block_2, Block_3 are such as drawn to user carries out image recognition respectively, by it Be converted into corresponding content of text " Beijing Tongrentang development in science and technology share ", " pharmaceutical factory of Co., Ltd ", “www.tongrentangkj.com”.Then can be using this three content of text for identifying as identification matching treatment result Return to user mobile phone client.Certainly, other embodiments can also be by service end side by this three texts for identifying This content is spliced into a content of text " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory Www.tongrentangkj.com " returns to client, or this three content of text splicings that client-side will be received Merge into a content of text.
Certainly, in other embodiments, recognizing the image real time transfer of segment can also be processed in local terminal, such as Hardware facility is more powerful in itself for mobile phone terminal, or terminal be PC or server, then it is described identify it is described identification segment letter Breath content can include:
S302:Segment is recognized described in localization identification matching treatment, identification matching result is obtained.
Local identification matching treatment can carry out pictorial information identification under offline condition, or save customer flow, if Localization identifying processing ability is stronger, then can improve the recognition efficiency of identification segment.
In another application scenarios, can set, if preferentially carried out using remote server under terminal networking state The treatment such as database identification, matching, if suspension or not meeting long-range identification condition, can be localized identification, With treatment.Therefore, in another embodiment of herein described method, the information content for identifying the identification segment can To include:
S303:In the case where network traffic conditions are met, the identification segment is sent to preset service end and is identified matching Treatment, and receive the identification matching result of service end return;Otherwise, segment is recognized described in localization identification matching treatment, is obtained Identification matching result.
During image recognition processing, some identification segments may existence information be complete, resolution ratio is relatively low, local Incompleteness etc., now server-side can further be entered in database according to the result of image recognition processing of identification segment Row matching, perfect, correction, supplement etc. obtain the last information content for identifying.Therefore, herein described a kind of chat data In another embodiment of input method, the identification matching treatment can include:
S3011:Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained; In presetting database matching described image identification content, described image identification content is optimized according to matching result, after generation optimization Identification matching result;
Accordingly, it is described to receive knowledge of the identification matching result including receiving after the optimization that service end is returned that service end is returned Other matching result.
For example, above-mentioned identification segment Block_1 is drawn when taking in the last character " part " is not completely contained in, such as Fig. 5 institutes The user for showing draws the incomplete Block_1 identification segment schematic diagrames for taking on picture to be identified.During Fig. 5 is a kind of embodiment of the application The implementation process schematic diagram of Statistical error matching treatment result.Service end to three identification segment Block_1, Block_2, Three content of text " Beijing Tongrentang development in science and technology strand ", " Co., Ltd's pharmacy are obtained after the identification of Block_3 database matchings Factory ", " www.tongrentangkj.com ".Then this three content of text are further corrected and is spliced after improving " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory www.tongrentangkj.com ", then service end can be by Identification matching result after this information is improved returns to user mobile phone terminal.Certainly, service end can also carry out other intelligence Energy optimization processing etc., the text message ending and all characters for such as identifying Block_2 and Block_3 are respectively " factories " and " w ", Then may be considered different language or state different semantic components, then space can be added between Block_2 and Block_3. Similarly, accordingly, the content of text that Block_1 is identified with Block_2 can be with when being matched in the database of service end So one perfect information of presence " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory " is inquired, therefore can be straight Connect and spliced the text message that Block_1 and Block_2 is identified.
The image text information in identification segment can be identified in the application scenarios of embodiment described above, is converted It is corresponding character text information, a view data Block_1 described above turns into " Beijing after being converted into character text information Some chinese characters of Tongrentang development in science and technology share ".Chat data input method described herein is not limited to that, In other embodiments, user is drawn during the segment regioinvertions that take can also include identifying segment for the corresponding information content Code or coding information, such as identify the Quick Response Code or bar code in segment.In other application scenarios, user can be drawn English word is such as translated into Chinese by the foreign languages translation in the identification segment for taking into appointed language.Even, in application scenes In can identify the information contents such as the watermark, the goods links that are included in segment, extract these watermarks or goods links information In can sending it to the chat scenario of user afterwards.So, user can obtain to be identified by mobile phone photograph or screenshotss etc. Picture, then draws the segment for taking and needing identification, further identifies the dominant or recessive information content included in segment, or Translated accordingly, changed, the much information input in user's chat scenario is aided in significantly, improved input speed and effect Rate, helps user's identification pictorial information, improves Consumer's Experience.Therefore, a kind of herein described chat data input method is another In a kind of embodiment, the information content for identifying the identification segment can include:
S311:The view data in the identification segment is identified, and is converted into corresponding text message.
It is described to identify the identification segment in a kind of another embodiment of herein described chat data input method The information content can include performing it is following at least one treatment:
S312:Translate the code/coding information in the identification segment;
S313:If the text message for identifying is comprising carrying out the need for pre-setting translating the first languages, by described the The text message of one languages translates into the text message of the second languages;
S314:Acquisition is arranged on the hiding information in the identification segment, and the hiding information includes but is not limited to picture Watermark, commodity page link address, telephone number etc..
Code/coding information described in above-mentioned S322 can be such as Quick Response Code or bar code, rub this code, such as user The barcode size or text field taken in Fig. 3 is drawn, corresponding binary system/ten's digit or other corresponding information can be translated into. In S333, such as one section of english information is included in described identification segment, then in can obtaining picture in the present embodiment implementation process English character information, and add these English character information translation after Chinese information, as shown in fig. 6, Fig. 6 be the application use Draw a kind of embodiment schematic diagram of a scenario for taking identification region and recognizing pattern information content in family.It is described in some other embodiment If identification segment includes some hiding informations, user may be not aware that in the presence of these recessive informations, then the application implementation in advance Example can obtain these hiding informations when treatment is identified to identification segment, present it to user.Taken as user draws Commodity page link address comprising this picture to be identified, then this commodity page chain that can be will identify that in identification segment Together as the information content for identifying, can be sent in chat scenario for the commodity page link address by user for ground connection location.
It is general, if user is drawn in the identification segment for taking comprising polytype information content, the institute that can be identified There is the information content to be all linked into the input frame of chat scenario.The one section of Chinese text T1 for such as being identified from segment and one section English text T2, is then also turned over English text T2 therein when server or client locally recognize that segment is processed Translate, generate corresponding cypher text T3.In addition, the bar code also drawn user in another piece of identification segment for taking is converted into Corresponding 13 metric digital text T4.So, can be by above-mentioned polytype identification matching in a kind of implementation method As a result these four text messages of T1, T2, T3, T4 are all linked into user's chat scenario, used as the chat data of user input. Fig. 7 is that the application provides a kind of application scenarios schematic diagram that the information content that will identify that is linked into chat scenario, such as Fig. 7 institutes Show, in another embodiment application scenarios, if identifying polytype information content, can in another embodiment To allow user to select to need the information content species as input data.Specifically, a kind of chat data that the application is provided is defeated Enter in another embodiment of method, methods described can also include:
When the information content for identifying includes polytype identification matching result, different type identification is provided the user The option of matching result;And, obtain the identification matching result of user's selection;
Accordingly, it is described to include the chat scenario that the information content for identifying is linked into user:Obtained described The identification matching result of the user's selection for taking is linked into the chat scenario of user.
Recognize that matching result can be including these four text messages of T1, T2, T3, T4 in application scenarios as described above. Then the mode of these four text messages user's notice board can be showed user, user can therefrom select one or many Individual text message is used as the data for needing to be input in chat scenario.Certainly, the division of type identification matching result can be with Customized design, as described above in T1 and T2 can be merged into an identification matching result T1 ', the T1 ' can be expressed as from User draws the information content of Direct Recognition output in the identification segment for taking, and T3, T4 etc. are then by further translation, code The information content that identification, Data Format Transform etc. are obtained.
Obviously, allow user to select to need as the information content species of input data, some users can be facilitated to carry out defeated Enter the selection of information, meet some user's requests, improve the user experience of these scene demands.
In some embodiments of the present application, the information content for identifying can be linked into the chat of user, specifically Can include that the information content that will identify that is replicated in implementation and paste the defeated of dialog interface in user's current chat scene In entering information editing's frame, as shown in Figure 4.Now, user can by click information send button will include identify described in The chat data of the information content sends.Certainly, user can also be in input information editing's frame of chat scenario to described The information content for identifying carries out editing and processing etc..In another embodiment of the application, it is also possible in chat scenario directly The information content straight hair that will identify that is seen off, as the chat message that user has sent, as shown in figure 8, Fig. 8 is this Shen Another application scenarios schematic diagram during the information content that will identify that is linked into chat scenario please be provided.Certainly, will identify that The information content be linked into implementation method in the chat scenario of user and can also include other designs, such as be added to expression Storehouse etc., can specifically be designed according to demand, realize facility, quick, auxiliary, the flexible information input of user, herein Do not do and explain one by one.Therefore, it is described by the knowledge in a kind of another embodiment of herein described chat data input method The information content not gone out is linked into the chat scenario of user at least one implementation method that can include using in following:
S321:Using the information content for identifying as data cached storage, the stickup instruction based on user will caching Data is activation is in the text edit box of chat scenario;
S322:Using the information content for identifying as having been enter into disappearing in current chat scene Chinese version edit box Breath content;
S323:Using the information content for identifying as the message content sent in the chat scenario of user;
S324:The information content for identifying is added to the information collection column of user.
Information collection column described in above-mentioned can include the expression column of user, can be with while storage user's expression information Simultaneously or the packet information content that is obtained by picture to be identified of storage.Can also include being carried out using single functional module Storage, as sent voice, picture, functional unit of video conversation etc..User can be so facilitated to check what is recognized in the later stage The information content, or conveniently quickly will generate factory's information on the preferable cold drug of effect in for example above-mentioned application scenarios later It is shared with other good friends etc..In above-mentioned S321, the information content for identifying can first temporary cache in pasting boards, the stand-by head of a household Just the information content is shown in text edit box by ejection function option and after selecting paste functionality.In S322, then can be with The information content that directly will identify that is sent in text edit box, facilitates the quick succinct input demand of some users.Certainly, In S323, then the information content that more fast and efficiently can directly will identify that is sent to good friend.Each of S321~S324 Implementation method can individually be implemented, and certainly, in application scenes, the application is not precluded from using the group of plurality of mode Close implementation method identification information is linked into the chat scenario of user.Accessed using the chat data of various ways, Ke Yifang Just flexibly, each implementation method can realize that quickly, easily chat data is input into, and meets the user's need under some scenes Ask, improve the chat application experience of these users.
In the application scenes for implementing the application, user is often the hope of randomness by some information on material object Be input into as chat message, or fall in rarely used word or None- identified foreign language, icon, coding etc..In these applications Under scene, user can generally be taken material object is taken pictures with terminal such as mobile phone camera, and then smearing is drawn to be taken and needed on photo Seek the rarely used word of identification or one section of text message replicating etc., user can be helped to rapidly input, and the side of input Formula is convenient, flexible, and the information input experience effect lifting of user is obvious.Therefore, the application provides a kind of specific chat message In another embodiment of input mode, methods described can include:
Triggering command based on user opens filming apparatus, obtains the shooting figure that user is obtained by the filming apparatus Piece;
Obtain user and the identification segment for taking is drawn on the shooting picture;
Match cognization goes out the information content of the identification segment, and the information content for identifying is sent into chat scenario Text edit box in.
The chat data input method shown in above-mentioned each embodiment that the application is provided, can pass through in chat scenario Take pictures etc. and to obtain picture to be identified, user is drawn into information access that figure identifies in chat scenario, realize the text of view data The input auxiliary such as this conversion, rarely used word identification, the identification of coding/code, translation, implicit information, helps user to realize passing through picture Snap information input, and auxiliary information is input into, there is provided the identification of flexile remote information, the selection input of polymorphic type information Deng, the chat message input convenience of instant messaging application is greatly improved, improve Consumer's Experience.It is to be particularly noted that on Each embodiment is stated to be described by the way of progressive, what each embodiment was stressed be it is different from other embodiment it Place, different implementation sections can be used mutually between each embodiment.Although above-mentioned one kind is illustrated at long-range matching Reason identification module, explanation illustrates segment code translation, languages conversion, obtains hiding information etc. in another embodiment, it is clear that The mutual result of each embodiment is used for reference, it is possible to achieve remote service end carries out segment code translation, languages conversion etc., it is also possible to eventually End localization is processed etc..So, even if the embodiment of the present application does not provide such implementation method directly, it is apparent that logical Cross read the application each embodiment can other embodiment that mutually combinations of features is realized deformation, conversion, extended, these realities Applying mode should all belong within the practical range of the application protection.
Based on chat data input method described herein, the application provides a kind of chat data input unit.It is described Device can be used for the information input in instant messaging application in the multiple terminal equipment such as mobile phone, flat board, PC, server, PDA, Can be integrated in the functional unit of instant messaging application (such as application program module), help user to realize by pictorial manner Snap information is input into.Fig. 9 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Shown in Fig. 9, described device can include:
Picture acquisition module 101, can be used for obtaining the picture to be identified chosen;
Segment draws modulus block 102, can be used for receiving drawing on the picture to be identified and takes manipulation instruction, it is determined that described Identification segment in picture to be identified;
Graphic blocks identifying module 103, can be used for identifying the information content of the identification segment;
MIM message input module 104, can be used for being linked into the information content for identifying in chat scenario.
Using the embodiment of herein described device, can in chat scenario by reading the picture that user chooses, Then the image content that user chooses on the picture is identified, corresponding content of text messages can be translated into, and The information content that can be will identify that is linked into the chat scenario of user.So, by way of picture recognition, can be quick The content in picture is obtained, helps user to realize that the information in chat scenario rapidly inputs.Can be with using the application embodiment Solve user will not or uncomfortable use character or touch keypad puzzlement, during help recognizes rarely used word, quick obtaining picture Character information, multi-faceted auxiliary user input improves Consumer's Experience.
Figure 10 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Figure 10 Shown, the picture acquisition module 101 can include:
Taking module 1011, can be used for providing the user photograph taking option, and the triggering command based on user is opened Filming apparatus;
Picture confirms module 1012, can be used for obtaining the shooting photo that user is obtained by the filming apparatus;And base The confirmation of current shooting photo is used to instruct the picture to be identified that the current shooting photo is chosen as user in user.
In the present embodiment application scenarios, user can be taken pictures by the cam device of mobile phone, quickly and easily be obtained Take pending picture.This implement scene can be applied and run into rarely used word input, more document clip information input (entity Information input on books or business card), cumbersome information input (such as French, it is more long and including the network address of Various Complex character) Deng when, user can directly pass through mobile phone photograph, it would be desirable to which the information being input in chat scenario is included in shooting figure piece.This Sample, can remove the operation such as many handwriting inputs of user, character/code identification from during subsequent treatment, realize Speed Chat content Information input, aids in user input, improves convenience.
Figure 11 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Figure 11 It is shown, the picture acquisition module 101 can include it is following at least one:
It is local to choose module 1013, can be used for obtaining the local photo that user chooses from this map office, with what is chosen Local photo is used as picture to be identified;
Chat record picture chooses module 1014, can be used for obtaining the chat picture that user chooses in chat record, Using the chat picture chosen as picture to be identified;
Screenshot capture chooses module 1015, can be used for the triggering command based on user and performs screenshot capture, with the screen The sectional drawing picture that curtain sectional drawing is obtained is used as picture to be identified.
As described above, user (herein can also directly unitedly call the picture storage of terminal localization from picture library or photograph album Be picture library) in choose one group of picture as picture to be identified described herein.In other some embodiment application scenarios In, described picture to be identified can also be the picture of screenshot capture acquisition, or chatting in the dialog box of current chat interface Picture chosen in its record etc..In the present embodiment, picture to be identified can be obtained using various ways, improve user using figure Table identification rapidly inputs the flexibility of chat message, convenient for the user to operate, improves Consumer's Experience.
As described above, recognizing the implementation method of the information content in the identification segment can use local processing unit It is identified picture character identification conversion, it would however also be possible to employ the identification segment is uploaded into remotely/cloud server carries out figure As identifying processing.Figure 12 is a kind of a kind of herein described modular structure schematic diagram of embodiment of chat data input unit, such as Shown in Figure 12, the graphic blocks identifying module 103 can include:
Long-range identification module 1031, can be used for recognizing that segment is sent to preset service end and is identified at matching by described Reason;Receive the identification matching result that service end is returned;
Local identification module 1032, to change and recognize segment described in identification matching treatment in which can be used for, and obtains identification matching knot Really;
Identification module select unit 1033, can be used for according to the treatment rule long-range identification module 1031 of selection for setting or Local identification module 1032 recognizes the information content of the segment.
Described treatment rule can be configured according to design requirement, such as preferentially using long-range identification module 1031 or It is preferential to recognize segment using 1032 resume modules of local identification, or certain Rule of judgment is set, such as meeting network service Under the conditions of, local identification module 1032;Otherwise, processed using 1033 pairs of identification segments of identification module select unit.
During image recognition processing, some identification segments may existence information be complete, resolution ratio is relatively low, local Incompleteness etc., now server-side can according to identification segment image recognition processing result further be carried out in database Matching, perfect, correction, supplement etc. obtain the last information content for identifying.Therefore, a kind of herein described chat data is defeated Enter in device another kind embodiment, the identification matching treatment can include:
Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained;
In presetting database matching described image identification content, described image identification content is optimized according to matching result, it is raw Into the identification matching result after optimization;
Accordingly, it is described to receive knowledge of the identification matching result including receiving after the optimization that service end is returned that service end is returned Other matching result.
Identification segment Block_1 as described in above-mentioned embodiment draws the last character " part " when taking and is not completely contained in It is interior, but complete " Beijing Tongrentang Technology Development Co.ltd. Pharmaceutical Factory " letter can be obtained by database matching inquiry Breath, treatment is optimized to loss of learning that may be present, mistake.
In a kind of herein described chat data input unit another kind embodiment, the graphic blocks identifying module includes:
Text identification module, for identifying the view data in the identification segment, and is converted into corresponding text envelope Breath.In a kind of herein described chat data input unit another kind embodiment, the graphic blocks identifying module identifies the knowledge The information content of other segment can obtain the information content including at least one treatment of the execution in following:
Translate the code/coding information in the identification segment;
If the text message for identifying the need for pre-setting comprising carrying out translating the first languages, by first languages Text message translate into the text message of the second languages;
Acquisition is arranged on the hiding information in the identification segment.
The image text information in identification segment can be identified in the application scenarios of embodiment described above, is converted It is corresponding character text information, a view data Block_1 described above turns into " Beijing after being converted into character text information Some chinese characters of Tongrentang development in science and technology share ".Chat data input method described herein is not limited to that, In other embodiments, user is drawn during the segment regioinvertions that take can also include identifying segment for the corresponding information content Code or coding information, such as identify the Quick Response Code or bar code in segment.In other application scenarios, user can be drawn English word is such as translated into Chinese by the foreign languages translation in the identification segment for taking into appointed language.Even, in application scenes In can identify the information contents such as the watermark, the goods links that are included in segment, extract these watermarks or goods links information In can sending it to the chat scenario of user afterwards.So, user can obtain to be identified by mobile phone photograph or screenshotss etc. Picture, then draws the segment for taking and needing identification, further identifies the dominant or recessive information content included in segment, or Translated accordingly, changed, the much information input in user's chat scenario is aided in significantly, improved input speed and effect Rate, helps user's identification pictorial information, improves Consumer's Experience.
In another embodiment application scenarios of herein described device, if identifying polytype information content, User can be then allowed to select to need as the information content species of input data in another embodiment.Figure 13 is the application institute A kind of a kind of modular structure schematic diagram of embodiment of chat data input unit is stated, as shown in figure 13,
Described information input module 104 can include:
Input information choice module 1041, can be used for including polytype identification matching when the information content for identifying When as a result, the option that different type recognizes matching result is provided the user;And, obtain the identification matching result of user's selection;
As a result input module 1042, the identification matching result that can be used for user's selection of the acquisition is linked into user's In chat scenario.
Obviously, allow user to select to need as the information content species of input data, some users can be facilitated to carry out defeated Enter the selection of information, meet some user's requests, improve the user experience of these scene demands.
MIM message input module 104 can be wrapped described in a kind of herein described chat data input unit another kind embodiment Include it is following at least one module:
Caching input module, can be used for the information content for identifying as data cached storage, based on user Stickup instruction be sent to data cached in the text edit box of chat scenario;
First method input module, can be used for the information content for identifying as having been enter into current chat Message content in scape Chinese version edit box;
Second method input module, can be used for using the information content for identifying as in the chat scenario of user The message content for sending;
Gallery module, can be used for being added to the information content for identifying the information collection column of user.
Information collection column described in above-mentioned can include the expression column of user, can be with while storage user's expression information Simultaneously or the packet information content that is obtained by picture to be identified of storage, it is also possible to carried out including the single functional module of use Storage.
In embodiments herein, the information content for identifying can be linked into the chat of user, concrete implementation Can include that the information content that will identify that replicates the input letter for pasting dialog interface in user's current chat scene in mode In breath edit box.Now, user can will include the chat of the described information content for identifying by click information send button Data is activation is gone out.Certainly, user can also be in input information editing's frame of chat scenario in the information for identifying Appearance carries out editing and processing etc..In another embodiment, it is also possible to the information content straight hair that directly be will identify that in chat scenario See off, as the chat message that user has sent.Certainly, the information content that will identify that is linked into the chat of user Implementation method in scape can also include other designs, such as be added to expression storehouse, can specifically carry out according to demand Design, realizes facility, quick, auxiliary, the flexible information input of user.
In physical end such as mobile phone, user can on a terminal screen directly by the continuously slipping selected one piece of knowledge of finger Other segment.The application others implementation methods in be not limited to that, in other embodiments user can also by felt pen, The physical instrument modes such as laser pen, magnetic optical induction pen are directly or indirectly drawn on picture to be identified and take identification segment.Therefore, institute In stating another embodiment of device, described stroke is taken manipulation instruction and can include being made using at least one implementation method in following With the director data produced on picture to be identified:
Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
Wherein, described finger touches to draw to take can be included directly being drawn with finger taking, it is also possible to use the virtual picture for providing The instruments such as pen, head and the tail (or multiple) positioning cursor, analog mouse are drawn on picture to be identified and take region.
The chat data input unit shown in above-mentioned each embodiment that the application is provided, can pass through in chat scenario Take pictures etc. and to obtain picture to be identified, user is drawn into information access that figure identifies in chat scenario, realize the text of view data The input auxiliary such as this conversion, rarely used word identification, the identification of coding/code, translation, implicit information, helps user to realize passing through picture Snap information input, and auxiliary information is input into, there is provided the identification of flexile remote information, the selection input of polymorphic type information Deng, the chat message input convenience of instant messaging application is greatly improved, improve Consumer's Experience.
As it was previously stated, the chat data input method or device of the application offer can be used for mobile phone, flat board, PC, service Information input in the multiple terminal equipment such as device, PDA in instant messaging application, can be integrated in the function group of instant messaging application In part (such as application program module), help user to realize being input into by the snap information of pictorial manner, improve user's instant messaging Using or terminal experience.Therefore, the application also provides a kind of communicating terminal, specifically, in a kind of embodiment, it is described logical News terminal can include processing unit, wherein,
The processing unit can be configured to, and can be used for obtaining the picture to be identified chosen;Can be also used for receiving Drawing on the picture to be identified takes manipulation instruction, determines the identification segment in the picture to be identified;Can be also used for knowing Do not go out the information content of the identification segment, and the information content for identifying is sent to communication interface designated area position Put.
In the application scenes for implementing the application, when user is chatted using communication terminal, often randomness Hope be input into some information on material object as chat message, or fall in rarely used word or None- identified is outer Text, icon, coding etc..Under these application scenarios, user can generally take to be carried out with terminal such as mobile phone camera to material object Take pictures, then smearing is drawn and takes the rarely used word that demand is recognized on photo or the one section of text message for replicating etc..Therefore, originally Application also provides a kind of being taken pictures especially with filming apparatus and obtains pending picture and carry out the communication terminal of chat message input, Then user is drawn and takes segment with acquisition picture of taking pictures, and is converted to text, page turning, decoding etc., and user can be helped to rapidly input, And input mode is convenient, flexible, the information input experience effect lifting of user is obvious.Specifically, one kind that the application is provided In a kind of embodiment of communicating terminal, the communicating terminal can include filming apparatus and processor, wherein,
Even if the triggering command that the communication terminal is based on user opens filming apparatus, the picture shooting for responding user refers to Order;
The processor is configured to, for obtaining the shooting picture that user is obtained by the filming apparatus;It is additionally operable to Receive user's drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;Also use In the information content for identifying the identification segment, and the communication interface that the information content for identifying is sent to user is referred to Determine regional location.
Figure 14 is that a kind of instant communication terminal of chat data input chat data in the chat scenario that the application is provided shows It is intended to.
Although mentioning different pending picture acquisition modes in teachings herein, smearing is drawn and takes identification figure on picture Block, database matching identification, image recognition, identification information are linked into the various sequential manners of user's scene, message and send/connect The description of the information interaction approach etc. received/judge, but, the application be not limited to must be database data storage rule, Situation described by industry communication standard, image recognition technology standard or embodiment etc., some professional standards or using making by oneself Right way of conduct formula or embodiment description practice processes on embodiment amended slightly can also realize above-described embodiment it is identical, etc. The implementation result being anticipated that after same or close or deformation.Using the data acquisition after these modifications or deformation, storage, judgement, place The embodiment of the acquisitions such as reason mode, within the scope of still may belong to the optional embodiment of the application.
Although this application provides the method operating procedure as described in embodiment or flow chart, based on conventional or noninvasive The means of the property made can include more or less operating procedures.The step of being enumerated in embodiment order is only numerous steps A kind of mode in execution sequence, unique execution sequence is not represented.When device or client production in practice is performed, can Performed or executed in parallel (such as at parallel processor or multithreading with according to embodiment or method shown in the drawings order The environment of reason, even distributed data processing environment).Term " including ", "comprising" or its any other variant be intended to contain Lid nonexcludability is included, so that process, method, product or equipment including a series of key elements not only will including those Element, but also other key elements including being not expressly set out, or also include being this process, method, product or equipment Intrinsic key element.In the absence of more restrictions, be not precluded from the process including the key element, method, product or Also there are other identical or equivalent elements in person's equipment.
Unit, device or module that above-described embodiment is illustrated etc., can specifically be realized by computer chip or entity, or Realized by the product with certain function.For convenience of description, describe to be divided into various modules point with function during apparatus above Do not describe.Certainly, can the function of each module is real in same or multiple softwares and/or hardware when the application is implemented It is existing, it is also possible to will to realize that the module of same function is realized etc. by the combination of multiple submodule or subelement.Dress described above It is only schematical to put embodiment, for example, the division of the unit, only a kind of division of logic function, when actually realizing There can be other dividing mode, such as multiple units or component can combine or be desirably integrated into another system, or one A little features can be ignored, or not perform.It is another, shown or discussed coupling or direct-coupling or communication link each other Connecing can be that the INDIRECT COUPLING or communication connection of device or unit can be electrical, mechanical or other shapes by some interfaces Formula.
It is also known in the art that in addition to realizing controller in pure computer readable program code mode, it is complete Entirely can by by method and step carry out programming in logic come cause controller with gate, switch, application specific integrated circuit, may be programmed Logic controller realizes identical function with the form of embedded microcontroller etc..Therefore this controller is considered one kind Hardware component, and the device for realizing various functions included to its inside can also be considered as the structure in hardware component.Or Person even, can be used to realizing that the device of various functions is considered as not only being the software module of implementation method but also can be hardware Structure in part.
The application can be described in the general context of computer executable instructions, such as program Module.Usually, program module includes performing particular task or realizes routine, program, object, the group of particular abstract data type Part, data structure, class etc..The application can also be in a distributed computing environment put into practice, in these DCEs, Task is performed by the remote processing devices connected by communication network.In a distributed computing environment, program module can With in the local and remote computer-readable storage medium including including storage device.
As seen through the above description of the embodiments, those skilled in the art can be understood that the application can Realized by the mode of software plus required general hardware platform.Based on such understanding, the technical scheme essence of the application On the part that is contributed to prior art in other words can be embodied in the form of software product, the computer software product Can store in storage medium, such as ROM/RAM, magnetic disc, CD, including some instructions are used to so that a computer equipment (can be personal computer, mobile terminal, server, or network equipment etc.) performs each embodiment of the application or implementation Method described in some parts of example.
Each embodiment in this specification is described by the way of progressive, same or analogous portion between each embodiment Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.The application can be used for crowd In more general or special purpose computing system environments or configuration.For example:Personal computer, server computer, handheld device or Portable set, laptop device, multicomputer system, the system based on microprocessor, set top box, programmable electronics set Standby, network PC, minicom, mainframe computer, the DCE including any of the above system or equipment etc..
Although depicting the application by embodiment, it will be appreciated by the skilled addressee that the application have it is many deformation and Change is without deviating from spirit herein, it is desirable to which appended claim includes these deformations and changes without deviating from the application's Spirit.

Claims (23)

1. a kind of chat data input method, it is characterised in that methods described includes:
Obtain the picture to be identified chosen;
Receive drawing on the picture to be identified and take manipulation instruction, determine the identification segment in the picture to be identified;
The information content of the identification segment is identified, the information content for identifying is linked into chat scenario.
2. a kind of chat data input method as claimed in claim 1, it is characterised in that the figure to be identified that the acquisition is chosen Piece includes:
Triggering command based on user opens filming apparatus;The shooting picture obtained by the filming apparatus using user is used as treating Identification picture.
3. a kind of chat data input method as claimed in claim 1, it is characterised in that the figure to be identified that the acquisition is chosen Piece includes:
The local photo chosen from this map office of user is obtained, using the local photo of selection as picture to be identified;
The chat picture chosen in chat record of user is obtained, using the chat picture of selection as picture to be identified;
Triggering command based on user performs screenshot capture, and the sectional drawing picture obtained using the screenshot capture is used as figure to be identified Piece.
4. a kind of chat data input method as claimed in claim 1, it is characterised in that described to identify the identification segment The information content include using any one implementation method in following:
The identification segment is sent to preset service end and is identified matching treatment;Receive the identification matching knot that service end is returned Really;
Segment is recognized described in localization identification matching treatment, identification matching result is obtained;
In the case where network traffic conditions are met, the identification segment is sent to preset service end and is identified matching treatment, and connect Receive the identification matching result that service end is returned;Otherwise, segment is recognized described in localization identification matching treatment, obtains identification matching knot Really.
5. a kind of chat data input method as claimed in claim 4, it is characterised in that the identification matching treatment includes:
Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained;
In presetting database matching described image identification content, described image identification content is optimized according to matching result, generated excellent Identification matching result after change;
Accordingly, it is described to receive identification of the identification matching result including receiving after the optimization that service end is returned that service end is returned With result.
6. a kind of chat data input method as claimed in claim 1, it is characterised in that described to identify the identification segment The information content include:
The view data in the identification segment is identified, and is converted into corresponding text message.
7. a kind of chat data input method as claimed in claim 1, it is characterised in that described to identify the identification segment The information content include performing it is following at least one treatment obtain the information content:
Translate the code/coding information in the identification segment;
If the text message for identifying the need for pre-setting comprising carrying out translating the first languages, by the text of first languages This information translates into the text message of the second languages;
Acquisition is arranged on the hiding information in the identification segment.
8. a kind of chat data input method as claimed in claims 6 or 7, it is characterised in that methods described also includes:
When the information content for identifying includes polytype identification matching result, different type identification matching is provided the user The option of result;And, obtain the identification matching result of user's selection;
Accordingly, it is described to include the chat scenario that the information content for identifying is linked into user:By the acquisition The identification matching result of user's selection is linked into the chat scenario of user.
9. a kind of chat data input method as claimed in claim 1, it is characterised in that described by the information for identifying Content is linked into the chat scenario of user to be included using at least one implementation method in following:
The information content for identifying as data cached storage, the stickup instruction based on user are sent to data cached In the text edit box of chat scenario;
Using the information content for identifying as the message content having been enter into current chat scene Chinese version edit box;
Using the information content for identifying as the message content sent in the chat scenario of user;
The information content for identifying is added to the information collection column of user.
10. a kind of chat data input method as claimed in claim 1, it is characterised in that described stroke takes manipulation instruction and include The director data produced on picture to be identified is acted on using at least one implementation method in following:
Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
11. a kind of chat data input methods, it is characterised in that methods described includes:
Triggering command based on user opens filming apparatus, obtains the shooting picture that user is obtained by the filming apparatus;
Obtain user and the identification segment for taking is drawn on the shooting picture;
Match cognization goes out the information content of the identification segment, and the information content for identifying is sent to the text of chat scenario In this edit box.
12. a kind of chat data input units, it is characterised in that described device includes:
Picture acquisition module, for obtaining the picture to be identified chosen;
Segment draws modulus block, and manipulation instruction is taken for receiving drawing on the picture to be identified, determines the picture to be identified In identification segment;
Graphic blocks identifying module, the information content for identifying the identification segment;
MIM message input module, for the information content for identifying to be linked into chat scenario.
A kind of 13. chat data input units as claimed in claim 12, it is characterised in that the picture acquisition module bag Include:
Taking module, for providing the user photograph taking option, and the triggering command based on user opens filming apparatus;
Picture confirms module, for obtaining the shooting photo that user is obtained by the filming apparatus;And based on user using work as The picture to be identified that the current shooting photo is chosen in the preceding confirmation instruction for shooting photo as user.
14. a kind of chat data input units as claimed in claim 12, it is characterised in that the picture acquisition module includes At least one in following:
It is local to choose module, for obtaining the local photo that user chooses from this map office, using the local photo of selection as Picture to be identified;
Chat record picture chooses module, for obtaining the chat picture that user chooses in chat record, with the chat chosen Picture is used as picture to be identified;
Screenshot capture chooses module, and screenshot capture is performed for the triggering command based on user, is obtained with the screenshot capture Sectional drawing picture is used as picture to be identified.
A kind of 15. chat data input units as claimed in claim 12, it is characterised in that the graphic blocks identifying module bag Include:
Long-range identification module, matching treatment is identified for the identification segment to be sent into preset service end;Receive service Hold the identification matching result for returning;
Local identification module, for recognizing segment described in groundization identification matching treatment, obtains identification matching result;
Identification module select unit, for selecting long-range identification module or local identification module to know according to the treatment rule for setting The information content of not described segment.
A kind of 16. chat data input units as claimed in claim 15, it is characterised in that the identification matching treatment bag Include:
Image recognition processing is carried out to the identification segment, the image recognition content of the identification segment is obtained;
In presetting database matching described image identification content, described image identification content is optimized according to matching result, generated excellent Identification matching result after change;
Accordingly, it is described to receive identification of the identification matching result including receiving after the optimization that service end is returned that service end is returned With result.
A kind of 17. chat data input units as claimed in claim 12, it is characterised in that the graphic blocks identifying module bag Include:
Text identification module, for identifying the view data in the identification segment, and is converted into corresponding text message.
A kind of 18. chat data input units as claimed in claim 12, it is characterised in that the graphic blocks identifying module identification Go out at least one treatment of the information content of the identification segment including execution in following to obtain the information content:
Translate the code/coding information in the identification segment;
If the text message for identifying the need for pre-setting comprising carrying out translating the first languages, by the text of first languages This information translates into the text message of the second languages;
Acquisition is arranged on the hiding information in the identification segment.
A kind of 19. chat data input unit as described in claim 17 or 18, it is characterised in that described information input module Including:
Input information choice module, for being use when the information content for identifying includes polytype identification matching result Family provides the option that different type recognizes matching result;And, obtain the identification matching result of user's selection;
As a result input module, the chat scenario for the identification matching result that the user of the acquisition selects to be linked into user In.
20. a kind of chat data input units as claimed in claim 12, it is characterised in that described information input module includes At least one module in following:
Caching input module, for using the information content for identifying as data cached storage, the stickup based on user to refer to Order is sent to data cached in the text edit box of chat scenario;
First method input module, for using the information content for identifying as having been enter into current chat scene Chinese version Message content in edit box;
Second method input module, for using the information content for identifying as having sent in the chat scenario of user Message content;
Gallery module, the information collection column for the information content for identifying to be added to user.
21. a kind of chat data input units as claimed in claim 12, it is characterised in that described stroke takes manipulation instruction and include The director data produced on picture to be identified is acted on using at least one implementation method in following:
Touch to draw with the limbs of picture to be identified on the touchscreen by user and take identification region;
User is drawn using felt pen, laser pen, magnetic optical induction pen, limbs induction mode and takes identification region;
Identification region is taken using the virtual instrument that takes stroke of drawing for providing.
22. a kind of communicating terminals, it is characterised in that including processing unit,
The processing unit is configured to, for obtaining the picture to be identified chosen;It is additionally operable to receive in the picture to be identified On draw take manipulation instruction, determine the identification segment in the picture to be identified;It is additionally operable to identify the letter of the identification segment Breath content, and the information content for identifying is sent to communication interface designated area position.
A kind of 23. communicating terminals, including filming apparatus and processor, it is characterised in that
Triggering command based on user opens filming apparatus, responds the picture shooting instruction of user;
The processor is configured to, for obtaining the shooting picture that user is obtained by the filming apparatus;It is additionally operable to receive User's drawing on the picture to be identified takes manipulation instruction, determines the identification segment in the picture to be identified;It is additionally operable to know Do not go out the information content of the identification segment, and the communication interface that the information content for identifying is sent to user is specified into area Domain position.
CN201610576551.1A 2016-07-20 2016-07-20 Chat data input method, device and communicating terminal Pending CN106909270A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610576551.1A CN106909270A (en) 2016-07-20 2016-07-20 Chat data input method, device and communicating terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610576551.1A CN106909270A (en) 2016-07-20 2016-07-20 Chat data input method, device and communicating terminal

Publications (1)

Publication Number Publication Date
CN106909270A true CN106909270A (en) 2017-06-30

Family

ID=59207309

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610576551.1A Pending CN106909270A (en) 2016-07-20 2016-07-20 Chat data input method, device and communicating terminal

Country Status (1)

Country Link
CN (1) CN106909270A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106325750A (en) * 2016-08-26 2017-01-11 曹蕊 Character recognition method and system applied in terminal equipment
CN107451582A (en) * 2017-07-13 2017-12-08 安徽声讯信息技术有限公司 A kind of graphics context identifying system and its recognition methods
CN107948048A (en) * 2017-10-31 2018-04-20 阿里巴巴集团控股有限公司 Forward the method, apparatus and electronic equipment of chat message
CN108108093A (en) * 2017-12-06 2018-06-01 珠海市魅族科技有限公司 A kind of data inputting method, device, terminal and readable storage device
CN108345509A (en) * 2018-01-22 2018-07-31 维沃移动通信有限公司 A kind of message method and mobile terminal
CN108429782A (en) * 2017-09-12 2018-08-21 腾讯科技(深圳)有限公司 Information-pushing method, device, terminal and server
CN108830126A (en) * 2018-06-20 2018-11-16 上海凌脉网络科技股份有限公司 A kind of product marketing interactive approach based on digital image recognition
CN110045897A (en) * 2019-03-12 2019-07-23 维沃移动通信有限公司 A kind of information display method and terminal device
CN110309517A (en) * 2019-07-02 2019-10-08 北京百度网讯科技有限公司 Expression official documents and correspondence processing method, device, system and storage medium
CN110764685A (en) * 2019-10-24 2020-02-07 上海掌门科技有限公司 Method and device for identifying two-dimensional code
CN110837307A (en) * 2019-09-29 2020-02-25 上海萌家网络科技有限公司 Input method and system thereof
CN111126301A (en) * 2019-12-26 2020-05-08 腾讯科技(深圳)有限公司 Image processing method and device, computer equipment and storage medium
CN111985467A (en) * 2020-08-20 2020-11-24 厦门美图之家科技有限公司 Chat record screenshot processing method and device, computer equipment and storage medium
CN114448926A (en) * 2020-11-06 2022-05-06 北京陌陌信息技术有限公司 Method, system, equipment and storage medium for quick photo chat

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1997185A (en) * 2005-12-31 2007-07-11 北京华旗数码影像技术研究院有限责任公司 Mobile communication terminal for receiving the watermark information and its system and watermark embedding method
CN101087356A (en) * 2006-06-05 2007-12-12 中国移动通信集团公司 Mobile processing system and mobile processing method of 2D code information
CN101464903A (en) * 2009-01-09 2009-06-24 江阴明伦科技有限公司 OCR picture and text recognition and retrieval method and system through web mode
CN102999752A (en) * 2012-11-15 2013-03-27 广东欧珀移动通信有限公司 Method and device for quickly identifying local characters in picture and terminal
CN103778452A (en) * 2014-01-10 2014-05-07 惠州Tcl移动通信有限公司 Two-dimension code encoding method, two-dimension code decoding method, two-dimension code encoding system and two-dimension code decoding method based on mobile phone
CN103914539A (en) * 2014-04-01 2014-07-09 百度在线网络技术(北京)有限公司 Information search method and device
CN104281827A (en) * 2013-07-02 2015-01-14 腾讯科技(深圳)有限公司 Method and device for recognizing two-dimensional code
CN104850849A (en) * 2015-04-27 2015-08-19 小米科技有限责任公司 Method, device and terminal for sending character
CN105095446A (en) * 2015-07-24 2015-11-25 百度在线网络技术(北京)有限公司 Medicine search processing method, server and terminal device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1997185A (en) * 2005-12-31 2007-07-11 北京华旗数码影像技术研究院有限责任公司 Mobile communication terminal for receiving the watermark information and its system and watermark embedding method
CN101087356A (en) * 2006-06-05 2007-12-12 中国移动通信集团公司 Mobile processing system and mobile processing method of 2D code information
CN101464903A (en) * 2009-01-09 2009-06-24 江阴明伦科技有限公司 OCR picture and text recognition and retrieval method and system through web mode
CN102999752A (en) * 2012-11-15 2013-03-27 广东欧珀移动通信有限公司 Method and device for quickly identifying local characters in picture and terminal
CN104281827A (en) * 2013-07-02 2015-01-14 腾讯科技(深圳)有限公司 Method and device for recognizing two-dimensional code
CN103778452A (en) * 2014-01-10 2014-05-07 惠州Tcl移动通信有限公司 Two-dimension code encoding method, two-dimension code decoding method, two-dimension code encoding system and two-dimension code decoding method based on mobile phone
CN103914539A (en) * 2014-04-01 2014-07-09 百度在线网络技术(北京)有限公司 Information search method and device
CN104850849A (en) * 2015-04-27 2015-08-19 小米科技有限责任公司 Method, device and terminal for sending character
CN105095446A (en) * 2015-07-24 2015-11-25 百度在线网络技术(北京)有限公司 Medicine search processing method, server and terminal device

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106325750A (en) * 2016-08-26 2017-01-11 曹蕊 Character recognition method and system applied in terminal equipment
CN107451582A (en) * 2017-07-13 2017-12-08 安徽声讯信息技术有限公司 A kind of graphics context identifying system and its recognition methods
CN108429782B (en) * 2017-09-12 2020-11-06 腾讯科技(深圳)有限公司 Information pushing method and device, terminal and server
CN108429782A (en) * 2017-09-12 2018-08-21 腾讯科技(深圳)有限公司 Information-pushing method, device, terminal and server
WO2019052460A1 (en) * 2017-09-12 2019-03-21 腾讯科技(深圳)有限公司 Information pushing method, storage medium, terminal device, and server
US11140315B2 (en) 2017-09-12 2021-10-05 Tencent Technology (Shenzhen) Company Limited Method, storage medium, terminal device, and server for managing push information
CN107948048A (en) * 2017-10-31 2018-04-20 阿里巴巴集团控股有限公司 Forward the method, apparatus and electronic equipment of chat message
WO2019085600A1 (en) * 2017-10-31 2019-05-09 阿里巴巴集团控股有限公司 Method and apparatus for forwarding chat information, and electronic device
TWI771480B (en) * 2017-10-31 2022-07-21 開曼群島商創新先進技術有限公司 Method, device and electronic device for forwarding chat information
CN107948048B (en) * 2017-10-31 2021-02-26 创新先进技术有限公司 Method and device for forwarding chat information and electronic equipment
CN108108093A (en) * 2017-12-06 2018-06-01 珠海市魅族科技有限公司 A kind of data inputting method, device, terminal and readable storage device
CN108345509A (en) * 2018-01-22 2018-07-31 维沃移动通信有限公司 A kind of message method and mobile terminal
CN108830126A (en) * 2018-06-20 2018-11-16 上海凌脉网络科技股份有限公司 A kind of product marketing interactive approach based on digital image recognition
CN108830126B (en) * 2018-06-20 2021-08-27 上海凌脉网络科技股份有限公司 Product marketing interaction method based on intelligent image identification
CN110045897A (en) * 2019-03-12 2019-07-23 维沃移动通信有限公司 A kind of information display method and terminal device
CN110309517A (en) * 2019-07-02 2019-10-08 北京百度网讯科技有限公司 Expression official documents and correspondence processing method, device, system and storage medium
CN110309517B (en) * 2019-07-02 2023-10-17 北京百度网讯科技有限公司 Expression document processing method, device, system and storage medium
CN110837307A (en) * 2019-09-29 2020-02-25 上海萌家网络科技有限公司 Input method and system thereof
CN110764685A (en) * 2019-10-24 2020-02-07 上海掌门科技有限公司 Method and device for identifying two-dimensional code
CN111126301A (en) * 2019-12-26 2020-05-08 腾讯科技(深圳)有限公司 Image processing method and device, computer equipment and storage medium
CN111126301B (en) * 2019-12-26 2022-01-11 腾讯科技(深圳)有限公司 Image processing method and device, computer equipment and storage medium
CN111985467A (en) * 2020-08-20 2020-11-24 厦门美图之家科技有限公司 Chat record screenshot processing method and device, computer equipment and storage medium
CN111985467B (en) * 2020-08-20 2024-03-29 厦门美图之家科技有限公司 Chat record screenshot processing method and device, computer equipment and storage medium
CN114448926A (en) * 2020-11-06 2022-05-06 北京陌陌信息技术有限公司 Method, system, equipment and storage medium for quick photo chat

Similar Documents

Publication Publication Date Title
CN106909270A (en) Chat data input method, device and communicating terminal
US20180314882A1 (en) Sorting and displaying digital notes on a digital whiteboard
CN106484266A (en) A kind of text handling method and device
TWI627540B (en) A font cloud service system
CN106575291A (en) Detecting selection of digital ink
JP6986187B2 (en) Person identification methods, devices, electronic devices, storage media, and programs
CN106575300A (en) Image based search to identify objects in documents
CN102681870A (en) Automatically performing an action upon a login
CN109997111A (en) Contents processing across application
CN105045800A (en) Information search system and method
CN111565143B (en) Instant messaging method, equipment and computer readable storage medium
CN107203498A (en) A kind of method, system and its user terminal and server for creating e-book
KR101567555B1 (en) Social network service system and method using image
CN104267974B (en) The call method and device of business interface
US20160350062A1 (en) Remote screen display system, remote screen display method and non-transitory computer-readable recording medium
CN111259183B (en) Image recognition method and device, electronic equipment and medium
CN114067797A (en) Voice control method, device, equipment and computer storage medium
Choi et al. Arclassnote: Augmented reality based remote education solution with tag recognition and shared hand-written note
KR20170055345A (en) Social Network Service and Program using Cartoon Image Extraction and Transformation system and method using image
CN113238686B (en) Document processing method and device and electronic equipment
WO2018194853A1 (en) Enhanced inking capabilities for content creation applications
CN112084780B (en) Coreference resolution method, device, equipment and medium in natural language processing
CN114283422A (en) Handwritten font generation method and device, electronic equipment and storage medium
KR20150097250A (en) Sketch retrieval system using tag information, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor
US11010978B2 (en) Method and system for generating augmented reality interactive content

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1238370

Country of ref document: HK

TA01 Transfer of patent application right

Effective date of registration: 20201015

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Innovative advanced technology Co.,Ltd.

Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant before: Advanced innovation technology Co.,Ltd.

Effective date of registration: 20201015

Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands

Applicant after: Advanced innovation technology Co.,Ltd.

Address before: Greater Cayman, British Cayman Islands

Applicant before: Alibaba Group Holding Ltd.

TA01 Transfer of patent application right
RJ01 Rejection of invention patent application after publication

Application publication date: 20170630

RJ01 Rejection of invention patent application after publication
REG Reference to a national code

Ref country code: HK

Ref legal event code: WD

Ref document number: 1238370

Country of ref document: HK