CN104978577A

CN104978577A - Information processing method, information processing device and electronic device

Info

Publication number: CN104978577A
Application number: CN201410136461.1A
Authority: CN
Inventors: 贾沛; 孙林; 薛苏葵; 李众庆
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2014-04-04
Filing date: 2014-04-04
Publication date: 2015-10-14
Anticipated expiration: 2034-04-04
Also published as: CN104978577B

Abstract

The embodiment of the present invention discloses an information processing method, an information processing device and an electronic device. The information processing method comprises the steps of obtaining a first image, wherein the first image at least comprises a first type of mark; carrying out the character identification on the first image to obtain the first content, wherein the first content comprises a plurality of characters; determining a character correlated with the first type of mark in the first content; obtaining a processing instruction corresponding to the first type of mark; processing the character correlated with the first type of mark to obtain the second content according to the processing instruction, wherein the second content is different from the first content. The first type of mark can be the mark of the concerned character of a reader, and the character correlated with the first type of mark can comprise the character marked by the first type of mark and/or the character added by a user. After the processing instruction corresponding to the first type of mark is obtained, the obtained instruction is applied to process the character correlated with the first type of mark to obtain the second content, so that the mark or the added character blends in the original text automatically.

Description

Information processing method, device and electronic equipment

Technical field

The present invention relates to technical field of information processing, more particularly, relate to a kind of information processing method, device and electronic equipment.

Background technology

At present, people are in reading process, as read paper book or e-book, or viewing file or presentation file, frequent needs carry out some marks to paid close attention to word, or add some literature records for paid close attention to word, but, the word of the mark that reader does or interpolation can not incorporate original text automatically, electronic equipment can not automatically arrange the word of reader's concern and the word of mark or interpolation and export, therefore, reader also needs manually to be rearranged by the word of the word in original and interpolation to form a new document.

At present, reader can only manually arrange, and e.g., copies with pen, or, arranged by keyboard input computer, the word marking or add can be incorporated with the word in original.

Summary of the invention

The object of this invention is to provide a kind of information processing method and system, automatically can not incorporate the technical matters of original text with the word solving mark that reader does or interpolation.

For achieving the above object, the invention provides following technical scheme:

A kind of information processing method, be applied to electronic equipment, described method comprises:

Obtain the first image, in described first image, at least comprise first kind mark;

Carry out character recognition to described first image, obtain first content, described first content comprises several characters;

Determine to mark with the described first kind character be associated in described first content;

Obtain and mark corresponding processing instruction with the described first kind;

Mark with the described first kind character be associated according to described processing instruction pair to process, obtain the second content, described second content is different from described first content.

Said method, preferably, described first kind mark comprises: the first kind mark inputted by user; Before acquisition first image, described method also comprises:

Record the generation track of described first kind mark;

After described first image of acquisition, also comprised determine to mark with the described first kind character be associated in described first content before:

First kind mark in first image described in the generation track identification marked according to the described first kind.

Said method, preferably, describedly in described first content, determine that marking with the described first kind character be associated comprises:

The first character group in the label range that marks in the described first kind is determined in described first content;

Determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation;

Described second character group is different from described first character group.

Said method, preferably, described determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation and comprise:

Determine and the second character group that distance that the described first kind marks is minimum is and the described first kind mark between meet the second character group presetting incidence relation.

Determine second character group identical with the color of described first character group be and the described first kind mark between meet and preset the second character group of incidence relation.

Judge whether there is connector between described first kind mark and described second character group;

When determining to there is connector between described first kind mark and described second character group, determine and the described first kind mark between there is connector the second character group be and the described first kind mark between the second character group of satisfied default incidence relation.

Said method, preferably, describedly marks according to described processing instruction pair and the described first kind character be associated and carries out process and comprise:

Described first character group is replaced by described second character group.

Adjust the described position of the first character group in described first content, delete described second character group.

Described first character group and described second character group are combined as trigram according to the first preset rules.

Said method, preferably, is describedly combined as trigram by described first character group and described second character group according to the first preset rules and comprises:

According to the position relationship preset, described first character group and described second character group are combined as trigram.

When there is the connector containing points relationship between described first kind mark and described second character group, according to described points relationship, described first character group and described second character group are combined as trigram.

Said method, preferably, described electronic equipment is provided with voice acquisition module, and described method also comprises:

Record the rise time of described first kind mark;

The voice gathered by described voice acquisition module are divided into multiple sound bite;

Sound bite acquisition time being comprised the rise time of described first kind mark is identified as the 3rd content;

Extract from described 3rd content and meet the 3rd the 4th pre-conditioned character group between described first character group;

Described trigram group and described 4th character group are combined as the 5th character group according to the second preset rules.

Said method, preferably, described extraction from described 3rd content meets the 3rd pre-conditioned the 4th character group with described first character group and comprises:

Extract the keyword in described first character group;

From described 3rd content, extract synon 4th character group comprising extracted keyword or comprise extracted keyword, described 4th character group is made up of continuously arranged character in described 3rd content.

A kind of signal conditioning package, be applied to electronic equipment, described device comprises:

Image collection module, for obtaining the first image, at least comprises first kind mark in described first image;

First identification module, for carrying out character recognition to described first image, obtain first content, described first content comprises several characters;

Relevant character determination module, marks with the described first kind character be associated for determining in described first content;

Instruction acquisition module, marks corresponding processing instruction for obtaining with the described first kind;

First processing module, process for marking with the described first kind character be associated according to described processing instruction pair, obtain the second content, described second content is different from described first content.

Said apparatus, preferably, described first kind mark comprises: the first kind mark inputted by user; Described device also comprises:

First logging modle, for recording the generation track of described first kind mark;

Mark determination module, the generation track for marking according to the described first kind determines the first kind mark in described first image.

Said apparatus, preferably, described relevant character determination module comprises:

First determining unit, for determining the first character group in the label range that marks in the described first kind in described first content;

Second determining unit, for determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation;

Said apparatus, preferably, described second determining unit comprises:

First determines subelement, for the second character group that the distance determined and the described first kind marks is minimum be and the described first kind mark between meet and preset the second character group of incidence relation.

Said apparatus, preferably, described second determining unit comprises:

Second determines subelement, for determine second character group identical with the color of described first character group be and the described first kind mark between meet and preset the second character group of incidence relation.

Said apparatus, preferably, described second determining unit comprises:

Judgment sub-unit, for judging whether there is connector between described first kind mark and described second character group;

3rd determines subelement, during for judging to there is connector between described first kind mark and described second character group in described judgment sub-unit, determine and the described first kind mark between there is connector the second character group be and the described first kind mark between the second character group of satisfied default incidence relation.

Said apparatus, preferably, described first processing module comprises:

First processing unit, for replacing described first character group by described second character group.

Said apparatus, preferably, described first processing module comprises:

Second processing unit, for adjusting the described position of the first character group in described first content, deletes described second character group.

Said apparatus, preferably, described first processing module comprises:

3rd processing unit, for being combined as trigram by described first character group and described second character group according to the first preset rules.

Said apparatus, preferably, described 3rd processing unit comprises:

First process subelement, for being combined as trigram according to the position relationship preset by described first character group and described second character group.

Said apparatus, preferably, described 3rd processing unit comprises:

Second process subelement, during for there is the connector containing points relationship between described first kind mark and described second character group, is combined as trigram according to described points relationship by described first character group and described second character group.

Said apparatus, preferably, described electronic equipment is provided with voice acquisition module, and described device also comprises:

Second logging modle, for recording the rise time of described first kind mark;

Divide module, for the voice gathered by described voice acquisition module are divided into multiple sound bite;

Second identification module, the sound bite for rise time acquisition time being comprised described first kind mark is identified as the 3rd content;

Extraction module, meets the 3rd the 4th pre-conditioned character group for extracting from described 3rd content between described first character group;

Second processing module, for being combined as the 5th character group by described trigram group and described 4th character group according to the second preset rules.

Said apparatus, preferably, described extraction module comprises:

First extraction unit, for extracting the keyword in described first character group;

Second extraction unit, for extracting synon 4th character group comprising extracted keyword or comprise extracted keyword from described 3rd content, described 4th character group is made up of continuously arranged character in described 3rd content.

A kind of electronic equipment, comprises the signal conditioning package as above described in any one.

Known by above scheme, a kind of information processing method that the application provides, is applied to electronic equipment, obtains the first image, at least comprises first kind mark in described first image; Carry out character recognition to described first image, obtain first content, described first content comprises several characters; Determine to mark with the described first kind character be associated in described first content; Obtain and mark corresponding processing instruction with the described first kind; Mark with the described first kind character be associated according to described processing instruction pair to process, obtain the second content, described second content is different from described first content.

In the embodiment of the present application, described first kind mark can be the mark that reader carries out paid close attention to word, mark with the first kind character be associated and can comprise character that the first kind marks and/or the word that user adds, after acquisition marks corresponding processing instruction with the first kind, the instruction pair that application obtains marks with the first kind character be associated and processes (replacement, deletion, sequence, combination etc. as word), obtain the second content, achieve and automatic arranging is carried out to word, make the word marking or add automatically incorporate original text.

Accompanying drawing explanation

In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.

A kind of realization flow figure of the information processing method that Fig. 1 provides for the embodiment of the present application;

Fig. 2 for determining in first content of providing of the embodiment of the present application and the first kind mark between meet the realization flow figure of the second character group presetting incidence relation;

A kind of structural representation of the signal conditioning package that Fig. 3 provides for the embodiment of the present application;

A kind of structural representation of the relevant character determination module that Fig. 4 provides for the embodiment of the present application;

A kind of structural representation of the second determining unit that Fig. 5 provides for the embodiment of the present application;

The another kind of structural representation of the second determining unit that Fig. 6 provides for the embodiment of the present application;

Another structural representation of the second determining unit that Fig. 7 provides for the embodiment of the present application;

A kind of structural representation of the first processing module that Fig. 8 provides for the embodiment of the present application;

The another kind of structural representation of the first processing module that Fig. 9 provides for the embodiment of the present application;

Another structural representation of the first processing module that Figure 10 provides for the embodiment of the present application;

A kind of structural representation of the 3rd processing unit that Figure 11 provides for the embodiment of the present application;

The another kind of structural representation of the 3rd processing unit that Figure 12 provides for the embodiment of the present application;

The another kind of structural representation of the signal conditioning package that Figure 13 provides for the embodiment of the present application;

A kind of structural representation of the extraction module that Figure 14 provides for the embodiment of the present application;

The image of certain the displaying document gathered in certain meeting that Figure 15 provides for the embodiment of the present application.

Term " first ", " second ", " the 3rd " " 4th " etc. (if existence) in instructions and claims and above-mentioned accompanying drawing are for distinguishing similar part, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged in the appropriate case, so that the embodiment of the application described herein can be implemented with the order except illustrated here.

Embodiment

Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.

The information processing method that the embodiment of the present application provides, application of installation are in electronic equipment.

Refer to Fig. 1, a kind of realization flow figure of the information processing method that Fig. 1 provides for the embodiment of the present application, can comprise:

Step S11: obtain the first image, at least comprises first kind mark in described first image;

Described first image can be by the image of electronic equipment by camera collection, also can be the image that electronic equipment passes through to intercept and capture the display unit display of the electronic equipment that the content in video memory obtains on display adapter.

Described first kind mark can be figure, as being a closed curve, as rectangle, circular, or irregular closed curve etc., also can be straight line, curve or color stripes etc., can also be other figure, as pentagram, triangle etc.

Step S12: carry out character recognition to described first image, obtain first content, described first content comprises several characters;

Optical character identification (Optical Character Recognition, OCR) can be passed through and obtain first content.

Step S13: determine to mark with the described first kind character be associated in described first content;

Wherein, described first kind mark can directly be determined by carrying out figure identification to the first image.

In the embodiment of the present application, described first kind mark can to there being a label range, and such as, if the described first kind is labeled as closure mark, as closed curve, then the scope of first kind mark can be the inner determined scope of this closed curve;

If the first kind is labeled as open mark, as straight line or curve or the linear structure that is made up of some independent drawings (as pentagram or warning triangle etc.), the then scope of first kind mark top a line of linear structure that can be this straight line or curve or be made up of some independent drawings, or a line below, or two straight line (or two curves, or two linear structures) in the middle of a line, preferably, a line above straight line or curve or linear structure can be obtained the label range of curve as straight line; And if the first kind is labeled as an independently figure, as being a pentagram etc., then, the first kind mark scope can be meet between this pentagram preset relation character (character as the shortest in the distance between pentagram, or, and the distance between pentagram is the shortest, and the first side being positioned at pentagram is (as top, or below, or lower right side, or lower left side, or other direction) character) a line at place or a paragraph at place etc.;

Mark with the first kind character be associated and can refer at least one character in the label range that marks in the described first kind.

Step S14: obtain and mark corresponding processing instruction with the described first kind;

In the embodiment of the present application, the processing instruction that different first kind marks is corresponding different, even identical mark, according to the relation between itself and character, processing instruction that also can be corresponding different.Such as, when the described first kind is labeled as with bar straight line, if straight line is in the bottom of character, then can comprise the processing instruction of the character that the described first kind marks: retain the character that the described first kind marks, namely not delete the character that the first kind marks; And if straight line is in the centre of character, then can comprise the processing instruction of the character that the described first kind marks: delete the character that the described first kind marks.

Step S15: mark with the described first kind character be associated according to described processing instruction pair and process, obtain the second content, described second content is different from described first content.

Wherein, carry out process can comprise marking with the first kind character be associated: the replacement, deletion, sequence, combination etc. of character, can also comprise the editor to character itself, as the amendment etc. of font.

A kind of information processing method that the embodiment of the present application provides, is applied to electronic equipment, obtains the first image, at least comprises first kind mark in described first image; Carry out character recognition to described first image, obtain first content, described first content comprises several characters; Determine to mark with the described first kind character be associated in described first content; Obtain and mark corresponding processing instruction with the described first kind; Mark with the described first kind character be associated according to described processing instruction pair to process, obtain the second content, described second content is different from described first content.

In the embodiment of the present application, described first kind mark can be the mark that reader carries out paid close attention to word, mark with the first kind character be associated and can comprise character that the first kind marks and/or the word that user adds, after acquisition marks corresponding processing instruction with the first kind, the instruction pair that application obtains marks with the first kind character be associated and processes (as the replacement of word, delete, sequence, combination etc.), obtain the second content, achieve and automatic summary finishing is carried out to inherited literal, the word marking or add is made automatically to incorporate original text.

In above-described embodiment, preferably, described first kind mark can comprise: the first kind mark inputted by user; Can also comprise before described first image of acquisition:

Record the generation track of described first kind mark;

The generation track of described first kind mark can refer to the coordinate of each point that the described first kind marks.

The generation track of described first kind mark can when user inputs first kind mark, is pointed or the moving thus determine the generation track that the first kind marks of pen by camera identification;

Described first kind mark also can be obtained by sensor, concrete,

In the electronic equipment with infrared array formula touch-screen, pen or the track of finger on screen are obtained by infrared array formula sensor, then repaint to show on screen through coordinate matching.Therefore, in the embodiment of the present application, the generation track of described first kind mark can be obtained by infrared array formula sensor.

In the electronic equipment with capacitor induction type touch-screen, the upper capacitive transducer that pen or the track of finger on screen are attached by screen surface obtains, and then repaints to show on screen through coordinate matching.Therefore, in the embodiment of the present application, the generation track of described first kind mark also can be obtained by capacitive transducer.

Be that in the electronic equipment of mouse, the input trajectory of mouse is obtained by mouse sensor at input equipment, and repaint to show on screen by system.Therefore, in the embodiment of the present application, the generation track of described first kind mark also can be obtained by mouse sensor.

After described first image of acquisition, can also comprise determine to mark with the described first kind character be associated in described first content before:

In the embodiment of the present application, the generation track marked by the first kind is identified the first kind mark in the first image, improves the accuracy of first kind marker recognition.

In above-described embodiment, preferably, describedly in first content, determine that marking the character be associated can comprise with the first kind:

Wherein, described second character group is different from described first character group.

That is, the second character group is from first content, determined character group in the content except described first character group.

Wherein, described second character group can be the character group obtained by handwriting recongnition; Described second character group also can be mark marked character group by Equations of The Second Kind, and described Equations of The Second Kind mark marks different from the described first kind.

Above-described embodiment, preferably, described determine in first content and the described first kind mark between meet and preset the second character group of incidence relation and can comprise:

Determine and the described first kind mark between minimum the second character group of distance be and the described first kind mark between meet the second character group presetting incidence relation.

When calculating the distance between first kind mark and the second character group, the matching of virtual rectangle frame can be carried out (if described first is labeled as rectangle frame, without matching to the outline of the character group in the label range of described first mark, direct use), determine the first virtual rectangle frame, and the matching of virtual rectangle frame is carried out to the outline of the second character group, obtain the second virtual box, the distance between the central point of the first virtual rectangle frame and the central point of the second virtual rectangle frame can be defined as the first kind and mark and and distance between character group.

In above-described embodiment, preferably, described determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation and can comprise:

If the color of the second character group is identical with the color of the first character group, then determine this second character group be and the first kind mark between meet and preset the second character group of incidence relation.

In above-described embodiment, preferably, described determine in described first content and the described first kind mark between meet preset incidence relation the second character group realization flow figure as shown in Figure 2, can comprise:

Step S21: judge whether there is connector between described first kind mark and described second character group;

Described connector can be straight line or the curve with default line end, and e.g., described connector can be arrow, also can be the connector with other line end, as deng.

Step S22: when determining to there is connector between described first kind mark and described second character group, determine and the described first kind mark between there is connector the second character group be and the described first kind mark between the second character group of satisfied default incidence relation.

Above-described embodiment, preferably, describedly marks according to described processing instruction pair and the described first kind character be associated and carries out process and can comprise:

In the embodiment of the present application, marking corresponding processing instruction with the described first kind can be delete the character in described first kind label range, and the second character group is added in scope that the first kind marks.

Such as, described first kind mark can be positioned at the straight line in the middle of described first character group, i.e. strikethrough, so, the first character group can be deleted, and add described second character group in the position of former first character group.

In above-described embodiment, preferably, describedly mark according to described processing instruction pair and the described first kind character be associated and carry out process and can comprise:

In the embodiment of the present application, semantics recognition can be carried out to the second character group, determine the position of the first character group in first content according to the semanteme of the second character group, and delete the second character group.As, suppose that the second character group is for " important ", so, can by default exchange rule, by other character group reversing of position in the first character group and first content, so that user is when reading, preferentially can see that the first character group or reminding user are noted the first character group.

In the embodiment of the present application, the first character group and the second character group can be combined as a new character group, namely the first character group and the second character group all retain.

In the embodiment of the present application, trigram can be formed obtain outline information needed for user or main contents (i.e. trigram) by extracting the first character group and the second character group, thus promote the efficiency that user obtains outline information or main contents.

In above-described embodiment, preferably, describedly described first character group and described second character group are combined as trigram according to the first preset rules can comprise:

In the embodiment of the present application, according to the position relationship of the first character group and the second character group, the two can be combined, such as, suppose that the first character group " A1 " is on the left side of the second character group " A2 ", so, the first character group and the second character group can be combined as " A1A2 ", and if the first character group " A1 " on the right of the second character group " A2 ", so, the first character group and the second character group can be combined as " A2A1 ".Again such as, if the first character group A1 " in the top of the second character group " A2 "; so; the first character group and the second character group can be combined as " A1A2 "; and if the first character group " A1 " in the below of the second character group " A2 "; so, the first character group and the second character group can be combined as " A2A1 ".

In the embodiment of the present application, the described connector containing points relationship can refer to the connector with default line end, and e.g., the described connector containing points relationship can refer to arrow.Concrete, the first character group and the second character group can be combined as trigram by the sensing according to connector.Such as, suppose to exist between the first character group " A1 " and the second character group " A2 " arrow connector →, i.e. " A1 → A2 ", so, first character group and the second character group can be combined as " A1A2 ", and if exist between the first character group " A1 " and the second character group " A2 " arrow connector ←, i.e. " A1 ← A2 ", so, can the first character group and the second character group be combined as " A2A1 ".

In above-described embodiment, may exist between first character group and the second character group simultaneously multiple incidence relation (as while location relation and points relationship), in such cases, priority can be given for each incidence relation, such as, the priority of points relationship can higher than the priority of unknown relation, concrete, suppose that the first character group " A1 " is positioned at the left side of the second character group " A2 ", but there is the arrow being pointed to the first character group " A1 " by the second character group " A2 " between the first character group " A1 " and the second character group " A2 ", so, first character group and the second character group can be combined as " A2A1 ", instead of be combined as " A1A2 " according to position relationship.

In above-described embodiment, the first character group and the second character group can continuous arrangements (e.g., being in line), also can discontinuously arrange (e.g., lining up two row).

In above-described embodiment, preferably, described electronic equipment is also provided with voice acquisition module, in the information processing method that the embodiment of the present application provides, can also comprise:

Record the rise time of described first kind mark;

In the embodiment of the present application, when marking text with first kind mark, the rise time of record first kind mark.

Preferably, the source direction of gathered voice can be determined by microphone array, according to the source direction of described collection voice, gathered voice are divided into multiple sound bite.Wherein, described microphone array at least comprises two microphones.

Further, in order to improve the degree of accuracy of voice source direction, after by the source direction (for convenience of describing, being primary source direction by the voice source direction determined by microphone array) of described microphone array determination voice, can also comprise:

By the image in the determined primary source direction of image acquisition device;

After determining primary source direction, turned to by the camera lens of image collecting device determined primary source direction to gather the image in this direction.

Pass through gathered image and judge whether determined primary source direction has people speaking;

When judging that determined primary source direction has people to speak, determine that primary source direction is the source direction of voice.

In the embodiment of the present application, for each sound bite, also record the acquisition time of sound bite, when there is section overlapping time the rise time that acquisition time and the described first kind of sound bite marks, this sound bite is identified as the 3rd content.

Described trigram and described 4th character group are combined as the 5th character group according to the second preset rules.

In the embodiment of the present application, the 4th character group is extracted from the 3rd content obtained by speech recognition, and the 4th character group and trigram are combined as the 5th character group, wherein, in described 5th character group, trigram and the 4th character group can continuous arrangements (e.g., being in line), also can discontinuously arrange (e.g., lining up two row).

In above-described embodiment, preferably, described extraction from described 3rd content meets the 3rd pre-conditioned the 4th character group with described first character group and can comprise:

Extract the keyword in described first character group;

Wherein, described 4th character group can be the short sentence (e.g., by a determined short sentence of comma) in described 3rd content, also can be the long sentence comprising two or more short sentences;

Described 4th character group can be the character group comprising extracted all keywords, also can be the character group (namely only include keyword that part extracts or do not comprise extracted keyword) comprising the keyword that preset number is extracted.

Corresponding with embodiment of the method, the embodiment of the present application also provides a kind of signal conditioning package, and a kind of structural representation of the signal conditioning package that the embodiment of the present application provides as shown in Figure 3, can comprise:

Image collection module 31, the first identification module 32, relevant character acquisition module 33, instruction acquisition module 34 and the first processing module 35; Wherein,

Image collection module 31, for obtaining the first image, at least comprises first kind mark in described first image;

Described first image can be by the image of electronic equipment by camera collection, also can be the image at the interface by its display unit display had that electronic equipment obtains.

First identification module 32, for carrying out character recognition to described first image, obtains first content, and described first content comprises several characters;

Relevant character determination module 33 marks with the described first kind character be associated for determining in described first content;

In the embodiment of the present application, described first kind mark can to there being a label range, such as, if the described first kind is labeled as a closed curve, then the scope of first kind mark can be the inner determined scope of this closed curve, if and the is labeled as straight line or curve, then the scope of first kind mark can be two determined scopes of end points of this straight line or curve; And if the first kind is labeled as a pentagram, then, the scope of first kind mark can be the character (character as the shortest in the distance between pentagram meeting preset relation between this pentagram, or, and the distance between pentagram is the shortest, and be positioned at the character of the first side of pentagram) row at place or the paragraph at place etc.;

Instruction acquisition module 34 marks corresponding processing instruction for obtaining with the described first kind;

First processing module 35 processes for marking with the described first kind character be associated according to described processing instruction pair, and obtain the second content, described second content is different from described first content.

A kind of signal conditioning package that the embodiment of the present application provides, is applied to electronic equipment, obtains the first image, at least comprises first kind mark in described first image; Carry out character recognition to described first image, obtain first content, described first content comprises several characters; Determine to mark with the described first kind character be associated in described first content; Obtain and mark corresponding processing instruction with the described first kind; Mark with the described first kind character be associated according to described processing instruction pair to process, obtain the second content, described second content is different from described first content.

In above-described embodiment, preferably, described first mark can comprise: the first kind mark inputted by user; That is, before acquisition first image, described first kind mark is manually inputted by user.

Described device also comprises:

In the embodiment of the present application, when user inputs the first mark, the generation track of record first kind mark.

Described first kind mark also can be obtained by sensor, concrete,

Mark determination module, is connected with described relevant character acquisition module 33 with described first logging modle, described image collection module 31 respectively, and the generation track for marking according to the described first kind determines the first kind mark in described first image.

In above-described embodiment, preferably, a kind of structural representation of described relevant character determination module 33 as shown in Figure 4, can comprise:

First determining unit 41 and the second determining unit 42; Wherein,

First determining unit 41 for determining the first character group in the label range that marks in the described first kind in described first content;

Second determining unit 42 for determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation;

Above-described embodiment, preferably, a kind of structural representation of described second determining unit 42 as shown in Figure 5, can comprise:

First determines subelement 51, for the second character group that the distance determined and the described first kind marks is minimum be and the described first kind mark between meet and preset the second character group of incidence relation.

In above-described embodiment, the another kind of structural representation of described second determining unit 42 as shown in Figure 6, can comprise:

Second determines subelement 61, for determine second character group identical with the color of described first character group be and the described first kind mark between meet and preset the second character group of incidence relation.

In above-described embodiment, another structural representation of described second determining unit 42 as shown in Figure 7, can comprise:

Judgment sub-unit 71, for judging whether there is connector between described first kind mark and described second character group;

3rd determines subelement 72, during for judging to there is connector between described first kind mark and described second character group in described judgment sub-unit 71, determine and the described first kind mark between there is connector the second character group be and the described first kind mark between the second character group of satisfied default incidence relation.

In above-described embodiment, preferably, a kind of structural representation of described first processing module 35 as shown in Figure 8, can comprise:

First processing unit 81, for replacing described first character group by described second character group.

In above-described embodiment, preferably, the another kind of structural representation of described first processing module 35 as shown in Figure 9, can comprise:

Second processing unit 91, for adjusting the described position of the first character group in described first content, deletes described second character group.

In above-described embodiment, preferably, another structural representation of described first processing module 35 as shown in Figure 10, can comprise:

3rd processing unit 101, for being combined as trigram by described first character group and described second character group according to the first preset rules.

In above-described embodiment, preferably, a kind of structural representation of described 3rd processing unit 101 as shown in figure 11, can comprise:

First process subelement 111, for being combined as trigram according to the position relationship preset by described first character group and described second character group.

In above-described embodiment, preferably, the another kind of structural representation of described 3rd processing unit 101 as shown in figure 12, can comprise:

Second process subelement 121, during for there is the connector containing points relationship between described first kind mark and described second character group, is combined as trigram according to described points relationship by described first character group and described second character group.

In another embodiment of the application, electronic equipment is also provided with voice acquisition module, and the another kind of structural representation of the signal conditioning package that the embodiment of the present application provides as shown in figure 13, can also comprise:

Second logging modle 131, divides module 132, second identification module 133, extraction module 134 and the second processing module 135; Wherein,

Second logging modle 131 is for recording the rise time of described first kind mark;

Divide module 132 for the voice gathered by described voice acquisition module are divided into multiple sound bite;

Second identification module 133 is identified as the 3rd content for the sound bite of rise time acquisition time being comprised described first kind mark;

Extraction module 134 meets the 3rd the 4th pre-conditioned character group for extracting from described 3rd content between described first character group;

Second processing module 135 is for being combined as the 5th character group by described trigram group and described 4th character group according to the second preset rules.

In above-described embodiment, preferably, a kind of structural representation of described extraction module 134 as shown in figure 14, can comprise:

First extraction unit 141, for extracting the keyword in described first character group;

Second extraction unit 142, for extracting synon 4th character group comprising extracted keyword or comprise extracted keyword from described 3rd content, described 4th character group is made up of continuously arranged character in described 3rd content.

The embodiment of the present application also provides a kind of electronic equipment, and this electronic equipment has the signal conditioning package as above described in any embodiment.

The information processing method that the embodiment of the present application provides and device, can automatically arrange paper document, such as, reader is when reading paper document, some notes are done in paper document of being everlasting, or mark, when needing to arrange the document of described reading, can by the image of camera collection paper document, then Text region is carried out to gathered image, obtain first content, in this first content, the existing character obtained by the identification of printing word, has again the character obtained by the handwritten word identification of reader; In first content, determine to mark with the first kind character that (i.e. reader do in paper document mark) be associated; Obtain and mark corresponding processing instruction with the first kind; According to and the described first kind mark corresponding processing instruction pair and mark with the described first kind character be associated and process, obtain the second content, described second content is different from described first content.Described second content is exactly the content after arranging first content.

The information processing method that the embodiment of the present application provides and device can also be used for extracting meeting summary, after generally meeting adjourned, need to arrange to obtain meeting summary to conference content, current meeting summary is all manually completed by staff, its extraction rate is slower, the information processing method provided by the embodiment of the present application and device, can extract meeting summary automatically.

Concrete, can in conference process, gather the image of the document shown, as shown in figure 15, Figure 15 is the image that certain collection in certain meeting shows document, wherein, the character (as letter and number) of existing e-text in the shown document shown, also there is participant in handwritten character (as " breakthrough ", " defence "), also have the mark (as rectangle frame) that participant does, and connector (as arrow).After collection image, the image of collection is carried out character recognition, identify character (comprising e-text character and handwritten character) wherein, the character determining to be associated with rectangle frame (comprise character in rectangle frame and and rectangle frame between there is the handwritten character of arrow connector), wherein, arrow connector is there is between the rectangle frame at " SmartConnected Devices WW " place and " breakthrough ", therefore, " Smart Connected Devices WW " and " breakthrough " are all the character group be associated with the rectangle frame at " Smart Connected DevicesWW " place, there is arrow connector between the rectangle frame at " PC in China, Germany " place and " defence ", therefore, " PC in China, Germany " and " defence " are all the character group be associated with the rectangle frame at " PC in China, Germany " place,

In this application example, the character be associated for same rectangle frame can be extracted, and according to the points relationship of the connector between character group, the character group be associated with same rectangle frame is combined, concrete, " Smart Connected Devices WW " and " breakthrough " can be combined as meeting summary:

" Smart Connected Devices WW breaks through "

" PC in China, Germany " and " defence " is combined as meeting summary:

" PC in China, Germany defend "

" defence " sensing " PC in China, Germany " and the arrow points between " if PC in China; Germany " and " defence " is served as reasons, then preferential according to points relationship principle, " PC inChina, Germany " and " defence " can be combined as:

" defence PC in China, Germany "

Carry out in process in meeting, have participant to make a speech, in this application example, the rise time of rectangle frame can also be recorded, and gather the voice messaging of participant, and gathered voice are divided into multiple sound bite according to voice source direction, the sound bite corresponding with the rise time of rectangle frame is determined according to the acquisition time of sound bite and the rise time of rectangle frame, the sound bite corresponding with rectangle frame is identified as character, and therefrom extract the character be associated with the content in rectangle frame, as, keyword is extracted in content from rectangle frame, from the character obtained by speech recognition, character group is extracted according to the keyword extracted, and the character group of extraction and the aforementioned meeting summary obtained are combined again, form more detailed meeting summary, as, in this application example, the meeting summary formed is as follows:

" Smart Connected Devices WW breaks through

Whole world smart mobile phone shipment

The innovation that the whole world is dull and stereotyped

PC in China, Germany defend

Chinese market, PC, upgrades

German market "

Those of ordinary skill in the art can recognize, in conjunction with unit and the algorithm steps of each example of embodiment disclosed herein description, can realize with the combination of electronic hardware or computer software and electronic hardware.These functions perform with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can use distinct methods to realize described function to each specifically should being used for, but this realization should not thought and exceeds scope of the present invention.

Those skilled in the art can be well understood to, and for convenience and simplicity of description, the specific works process of the system of foregoing description, device and unit, with reference to the corresponding process in preceding method embodiment, can not repeat them here.

In several embodiments that the application provides, should be understood that disclosed system, apparatus and method can realize by another way.Such as, device embodiment described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical, machinery or other form.

The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.

If described function using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprising some instructions in order to make a computer equipment (can be personal computer, server, or the network equipment etc.) perform all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various can be program code stored medium.

To the above-mentioned explanation of the disclosed embodiments, professional and technical personnel in the field are realized or uses the present invention.To be apparent for those skilled in the art to the multiple amendment of these embodiments, General Principle as defined herein can without departing from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention can not be restricted to these embodiments shown in this article, but will meet the widest scope consistent with principle disclosed herein and features of novelty.

Claims

1. an information processing method, is applied to electronic equipment, it is characterized in that, described method comprises:

2. method according to claim 1, is characterized in that, described first kind mark comprises: the first kind mark inputted by user; Before acquisition first image, described method also comprises:

Record the generation track of described first kind mark;

3. method according to claim 1 and 2, is characterized in that, describedly in described first content, determines that marking with the described first kind character be associated comprises:

4. method according to claim 3, is characterized in that, described determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation and comprise:

5. method according to claim 3, is characterized in that, described determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation and comprise:

6. method according to claim 3, is characterized in that, described determine in described first content and the described first kind mark between meet and preset the second character group of incidence relation and comprise:

7. method according to claim 3, is characterized in that, describedly marks according to described processing instruction pair and the described first kind character be associated and carries out process and comprise:

8. method according to claim 3, is characterized in that, describedly marks according to described processing instruction pair and the described first kind character be associated and carries out process and comprise:

9. method according to claim 3, is characterized in that, describedly marks according to described processing instruction pair and the described first kind character be associated and carries out process and comprise:

10. method according to claim 9, is characterized in that, describedly described first character group and described second character group are combined as trigram according to the first preset rules comprise:

11. methods according to claim 9, is characterized in that, describedly described first character group and described second character group are combined as trigram according to the first preset rules comprise:

12. methods according to claim 9, it is characterized in that, described electronic equipment is provided with voice acquisition module, described method also comprises:

Record the rise time of described first kind mark;

13. methods according to claim 12, is characterized in that, described extraction from described 3rd content meets the 3rd pre-conditioned the 4th character group with described first character group and comprise:

Extract the keyword in described first character group;

14. 1 kinds of signal conditioning packages, are applied to electronic equipment, it is characterized in that, described device comprises:

15. devices according to claim 14, is characterized in that, described first kind mark comprises: the first kind mark inputted by user; Described device also comprises:

16. devices according to claims 14 or 15, it is characterized in that, described relevant character determination module comprises:

17. devices according to claim 16, is characterized in that, described second determining unit comprises:

18. devices according to claim 16, is characterized in that, described second determining unit comprises:

19. transposition according to claim 16, is characterized in that, described second determining unit comprises:

20. devices according to claim 16, is characterized in that, described first processing module comprises:

21. devices according to claim 16, is characterized in that, described first processing module comprises:

22. transposition according to claim 16, is characterized in that, described first processing module comprises:

23. devices according to claim 22, is characterized in that, described 3rd processing unit comprises:

24. devices according to claim 22, is characterized in that, described 3rd processing unit comprises:

25. devices according to claim 22, it is characterized in that, described electronic equipment is provided with voice acquisition module, described device also comprises:

Second logging modle, for recording the rise time of described first kind mark;

26. devices according to claim 25, is characterized in that, described extraction module comprises:

27. 1 kinds of electronic equipments, is characterized in that, comprise the signal conditioning package as described in claim 14-26 any one.