CN109886266A - Method, relevant apparatus and the system of image procossing - Google Patents

Abstract

The present invention provides a kind of image processing method, relevant apparatus and systems.This method comprises: obtaining picture frame, every frame picture frame includes text image and tool image；According to described image frame, the status information of tool indicated by the tool image is obtained；According to the status information of the tool, the target area in the text image is determined；To the corresponding target image editor in the target area or search inquiry, or, carrying out identifying/font conversion/language translation/search inquiry to the target character in the target image.The technical solution of the embodiment of the present invention be conducive to by tool obtain target image, avoid by hand take pictures, by hand delineation etc. cumbersome step play, simplify from books obtain target image path, better meet the demand of people.

Description

Method, relevant apparatus and the system of image procossing

Technical field

The present invention relates to text conversion field more particularly to a kind of image processing method, relevant apparatus and systems.

Background technique

In life, people are frequently necessary to divide some local texts, figure, the rough draft on text in the form of picture It enjoys or record storage.In the prior art, it to text entire scan or after taking pictures, relies on to touch and gets rid of delineation target area by hand Domain, reprocesses target area correspondence image content, and step plays the local bat of time adjustment focal length progress that is more, or spending many It takes the photograph, it is complicated for operation.It follows that the prior art in terms of the processing of image there are inefficient so that user experience compared with Difference.

Summary of the invention

The embodiment of the invention provides image processing method, relevant device and systems, implement the embodiment of the present invention, can mention The efficiency of high target image processing, and then the experience of user is promoted, it meets the needs of users.

In a first aspect, the equipment includes: that image obtains the embodiment of the invention provides a kind of equipment for image procossing Modulus block, tool information obtain module, area determination module and processing module；Wherein, described image obtains module, for obtaining Picture frame is taken, every frame picture frame includes text image and tool image；The tool information obtains module, for according to the figure As frame, the status information of tool indicated by the tool image is obtained；Wherein, the status information of the tool is the tool Static nature or the tool motion profile；The static nature of the tool is used to indicate the attribute of the tool, institute The static nature for stating tool includes lines, color, transverse shapes, vertical shape, height, two or more in hot spot Combination；The area determination module determines the target area in the text image for the status information according to the tool Domain；The processing module is used for the corresponding target image editor in the target area or search inquiry, or, to the target Target character in image carries out identifying/font conversion/language translation/search inquiry.

It can be seen that equipment of the embodiment of the present invention is where by determining target image to the identification of tool state information The target image in the region is reprocessed in region, so that the processing of target image has region guiding performance, is easily achieved.It can be with Understand, tool as indicative tool, instruction to target image so that the processing to target image has directionality, because And the processing of target image is more simple and efficient, and then be more able to satisfy the demand of user, promote the experience of user.

Based in a first aspect, in possible embodiment, in the status information according to the tool, determine described in In terms of target area in text image, the area determination module is specifically used for: including cross in the static nature of the tool To shape and vertical shape combination in the case where, it is described that area is formed by according to the tool transverse shapes and vertical shape Domain determines the target area in the text image, for example, the transverse shapes include the group of one or more regular shapes It closes, the regular shape such as round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon, etc., for example, described vertical Shape includes the combination of one or more regular shapes, the regular shape is for example round, oval, rectangular, rectangle, it is trapezoidal, Diamond shape, polygon, etc.；It is described in the case where the static nature of the tool includes one or more coloured shapes According to region pointed by a kind of shape for having particular color of the tool or there are many shapes of particular color to be formed Region, determine the target area in the text image；It include one or more having lines in the static nature of the tool Shape in the case where, region pointed by the shape for having a kind of specific lines according to the tool or there are many special The shape for determining lines is formed by region, determines the target area in the text image；In the static nature packet of the tool Hot spot is included, and in the case that the hot spot includes at least one of luminous point, light line or light region, it is described according to the work The region that region indicated by the hot spot of tool or the hot spot are covered, determines the target area in the text image.

Based in a first aspect, described image frame is multiframe in possible embodiment；Described according to described image Frame obtains the status information aspect of tool indicated by the tool image, and the tool information obtains module and is specifically used for: institute State the calibration position for determining the text image in tool and every frame image in every frame picture frame in the multiple image frame Relative position between setting；It is relatively described to obtain the tool for the relative position according to determined by every frame picture frame Demarcate the motion profile of position.

Based in a first aspect, the motion profile includes straight line, class straight line, non-closed song in possible embodiment One of line, closure class curve or multiple combinations.

Based in a first aspect, in possible embodiment, in the status information according to the tool, determine described in In terms of target area in text image, the area determination module is specifically used for: when the motion profile include straight line or When class straight line, the determination is located at the first side of the straight line or class straight line or the target area of second side；When the fortune When dynamic rail mark includes non-closed curve, the determination is located at the first side of the non-closed curve or the target area of second side Domain, alternatively, after the formation closed curve by non-closed curve described in process of fitting treatment, it is described to pass through closed curve institute shape At region, determine the target area in the text image；It is described to pass through when the motion profile includes closure class curve The closed curve is formed by region, determines the target area in the text image, alternatively, described pass through process of fitting treatment institute It is described that region is formed by by the related closed curve after stating closed curve formation association closed curve, determine the text Target area in this image.

Based in a first aspect, the target area comprises at least one of the following in possible embodiment: with the work Has region that is neighbouring and accommodating single or multiple texts；Area that is neighbouring with the tool and accommodating uniline or multline text Domain；And receiving single-row or multiple row text region neighbouring with the tool；It is neighbouring with the tool and have specific shape The region of shape, wherein the specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon, Or multiple combinations.

Based in a first aspect, the target area comprises at least one of the following in possible embodiment: in the work The region of the single or multiple texts of receiving on direction indicated by the static nature of tool；Indicated by the static nature of the tool The region for accommodating uniline or multline text on direction；Receiving on the direction indicated by the static nature of the tool it is single-row or The region of multiple row text；The region with specific shape on the direction indicated by the static nature of the tool, wherein described Specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

Based in a first aspect, the equipment application includes: equipment in equipment, the equipment in possible embodiment Picture frame is obtained, every frame picture frame includes text image and tool image；The equipment obtains the work according to described image frame Has the status information of tool indicated by image；Wherein, the status information of the tool be the tool static nature or The motion profile of the tool；The static nature of the tool is used to indicate the attribute of the tool, and the static state of the tool is special Sign includes two or more the combination in lines, color, transverse shapes, vertical shape, height, hot spot；The equipment According to the status information of the tool, the target area in the text image is determined；The equipment is to the target area pair The target image editor answered or search inquiry, or, carrying out identifying/font conversion/language to the target character in the target image Say translation/search inquiry.

Based in a first aspect, the equipment includes terminal or server in possible embodiment.

Second aspect, the embodiment of the invention provides a kind of methods for image procossing, which comprises obtains figure As frame, every frame picture frame includes text image and tool image；According to described image frame, obtain indicated by the tool image The status information of tool；Wherein, the status information of the tool is the movement of the static nature or the tool of the tool Track；The static nature of the tool is used to indicate the attribute of the tool, and the static nature of the tool includes lines, face Color, transverse shapes, vertical shape, height, two or more the combination in hot spot；Believed according to the state of the tool Breath, determines the target area in the text image；To the corresponding target image editor in the target area or search inquiry, Or, carrying out identifying/font conversion/language translation/search inquiry to the target character in the target image.

Based on second aspect, in possible embodiment, the status information according to the tool determines the text Target area in this image, comprising: include the combined feelings of transverse shapes Yu vertical shape in the static nature of the tool It is described that region is formed by according to the tool transverse shapes and vertical shape under condition, determine the target in the text image Region；It is described according to the tool in the case where the static nature of the tool includes one or more coloured shapes The shape for having a kind of particular color pointed by region or be formed by region there are many shape of particular color, determine institute State the target area in text image；Include the case where one or more textured shapes in the static nature of the tool Under, region pointed by the shape for having a kind of specific lines according to the tool or the shape there are many specific lines It is formed by region, determines the target area in the text image；It include hot spot in the static nature of the tool, and described In the case that hot spot includes at least one of luminous point, light line or light region, the hot spot according to the tool is signified The region that the region or the hot spot shown is covered, determines the target area in the text image.

Based on second aspect, in possible embodiment, described image frame is multiframe；According to described image frame, obtain The status information of tool indicated by the tool image, specifically includes: every frame figure in the determination multiple image frame As the relative position of the text image in the tool and every frame image in frame demarcated between position；It is described according to described every Relative position determined by frame picture frame obtains the motion profile of the relatively described calibration position of the tool.

Based on second aspect, in possible embodiment, the motion profile includes straight line, class straight line, non-closed song One of line, closure class curve or multiple combinations.

Based on second aspect, in possible embodiment, the status information according to the tool determines the text Target area in this image, comprising: when the motion profile includes straight line or class straight line, the determination is located at described straight The target area of the first side or second side of line or class straight line；It is described when the motion profile includes non-closed curve The target area for determining the first side or second side that are located at the non-closed curve, alternatively, described by described in process of fitting treatment It is described that region is formed by by the closed curve after non-closed curve forms closed curve, it determines in the text image Target area；It is described that region is formed by by the closed curve when the motion profile includes closure class curve, really Target area in the fixed text image, alternatively, described form association closed curve by closed curve described in process of fitting treatment Afterwards, described that region is formed by by the related closed curve, determine the target area in the text image.

Based on second aspect, in possible embodiment, the target area is comprised at least one of the following: with the work Has region that is neighbouring and accommodating single or multiple texts；Area that is neighbouring with the tool and accommodating uniline or multline text Domain；And receiving single-row or multiple row text region neighbouring with the tool；It is neighbouring with the tool and have specific shape The region of shape, wherein the specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon, Or multiple combinations.

Based on second aspect, in possible embodiment, the target area is comprised at least one of the following: in the work The region of the single or multiple texts of receiving on direction indicated by the static nature of tool；Indicated by the static nature of the tool The region for accommodating uniline or multline text on direction；Receiving on the direction indicated by the static nature of the tool it is single-row or The region of multiple row text；The region with specific shape on the direction indicated by the static nature of the tool, wherein described Specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

Based on second aspect, in possible embodiment, the method is applied to terminal, which comprises terminal Picture frame is obtained, every frame picture frame includes text image and tool image；The terminal obtains the work according to described image frame Has the status information of tool indicated by image；Wherein, the status information of the tool be the tool static nature or The motion profile of the tool；The static nature of the tool is used to indicate the attribute of the tool, and the static state of the tool is special Sign includes two or more the combination in lines, color, transverse shapes, vertical shape, height, hot spot；The terminal According to the status information of the tool, the target area in the text image is determined；The terminal is to the target area pair The target image editor answered or search inquiry, or, carrying out identifying/font conversion/language to the target character in the target image Say translation/search inquiry.

Based on second aspect, in possible embodiment, the method is applied to server, which comprises clothes Business device obtains picture frame, and every frame picture frame includes text image and tool image；The server is obtained according to described image frame The status information of tool indicated by the tool image；Wherein, the status information of the tool is that the static state of the tool is special The motion profile of sign or the tool；The static nature of the tool is used to indicate the attribute of the tool, the tool Static nature includes lines, color, transverse shapes, vertical shape, height, two or more the combination in hot spot；Institute Server is stated according to the status information of the tool, determines the target area in the text image；The server is to described The corresponding target image editor in target area or search inquiry, or, carrying out identifying/word to the target character in the target image Body conversion/language translation/search inquiry.

Based on second aspect, in possible embodiment, the method be applied to system, the system comprises terminal with And server, which comprises system obtains picture frame, and every frame picture frame includes text image and tool image；The system System obtains the status information of tool indicated by the tool image according to described image frame；Wherein, the state letter of the tool Breath is the static nature of the tool or the motion profile of the tool；The static nature of the tool is for indicating the work The attribute of tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, two kinds in hot spot Or two or more combination；The system determines the target area in the text image according to the status information of the tool； The system is to the corresponding target image editor in the target area or search inquiry, or, to the target in the target image Character carries out identifying/font conversion/language translation/search inquiry.

The third aspect, the embodiment of the invention provides a kind of equipment for image procossing, the equipment includes: that image obtains Modulus block, tool information obtain module, area determination module, communication module and processing module；Wherein, described image obtains mould Block, for obtaining picture frame, every frame picture frame includes text image and tool image；The tool information obtains module, is used for According to described image frame, the status information of tool indicated by the tool image is obtained；Wherein, the status information of the tool For the static nature of the tool or the motion profile of the tool；The static nature of the tool is for indicating the tool Attribute, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, two kinds in hot spot or Two or more combinations；The area determination module determines in the text image for the status information according to the tool Target area；The communication module is used for, and the target area in the text image is sent to server, so that the clothes Business device obtains processing result according to the target area in the text image, and the processing result includes to the target area pair The target image editor answered or search inquiry, or, carrying out identifying/font conversion/language to the target character in the target image Say the obtained result of translation/search inquiry；The communication module is also used to, and receives the processing result.

Based on the third aspect, in possible embodiment, in the status information according to the tool, determine described in In terms of target area in text image, the area determination module is specifically used for: including cross in the static nature of the tool To shape and vertical shape combination in the case where, it is described that area is formed by according to the tool transverse shapes and vertical shape Domain determines the target area in the text image；It include one or more coloured shapes in the static nature of the tool In the case where shape, region pointed by the shape for having a kind of particular color according to the tool or there are many specific face The shape of color is formed by region, determines the target area in the text image；It include one in the static nature of the tool In the case where kind or a variety of textured shapes, area pointed by the shape for having a kind of specific lines according to the tool Domain is formed by region there are many shape of specific lines, determines the target area in the text image；In the work In the case that the static nature of tool includes hot spot, and the hot spot includes at least one of luminous point, light line or light region, The region that the region according to indicated by the hot spot of the tool or the hot spot are covered, determines in the text image Target area.

Based on the third aspect, in possible embodiment, described image frame is multiframe；Described according to described image Frame obtains the status information aspect of tool indicated by the tool image, and the tool information obtains module and is specifically used for: institute State the calibration position for determining the text image in tool and every frame image in every frame picture frame in the multiple image frame Relative position between setting；It is relatively described to obtain the tool for the relative position according to determined by every frame picture frame Demarcate the motion profile of position.

Based on the third aspect, in possible embodiment, the motion profile includes straight line, class straight line, non-closed song One of line, closure class curve or multiple combinations.

Based on the third aspect, in possible embodiment, in the status information according to the tool, determine described in In terms of target area in text image, the area determination module is specifically used for: when the motion profile include straight line or When class straight line, the determination is located at the first side of the straight line or class straight line or the target area of second side；When the fortune When dynamic rail mark includes non-closed curve, the determination is located at the first side of the non-closed curve or the target area of second side Domain, alternatively, after the formation closed curve by non-closed curve described in process of fitting treatment, it is described to pass through closed curve institute shape At region, determine the target area in the text image；It is described to pass through when the motion profile includes closure class curve The closed curve is formed by region, determines the target area in the text image, alternatively, described pass through process of fitting treatment institute It is described that region is formed by by the related closed curve after stating closed curve formation association closed curve, determine the text Target area in this image.

Based on the third aspect, in possible embodiment, the target area is comprised at least one of the following: with the work Has region that is neighbouring and accommodating single or multiple texts；Area that is neighbouring with the tool and accommodating uniline or multline text Domain；And receiving single-row or multiple row text region neighbouring with the tool；It is neighbouring with the tool and have specific shape The region of shape, wherein the specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon, Or multiple combinations.

Based on the third aspect, in possible embodiment, the target area is comprised at least one of the following: in the work The region of the single or multiple texts of receiving on direction indicated by the static nature of tool；Indicated by the static nature of the tool The region for accommodating uniline or multline text on direction；Receiving on the direction indicated by the static nature of the tool it is single-row or The region of multiple row text；The region with specific shape on the direction indicated by the static nature of the tool, wherein described Specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

Fourth aspect, the embodiment of the invention provides a kind of system for image procossing, the system comprises terminal with And server；Wherein, the terminal is used for, and obtains picture frame, every frame picture frame includes text image and tool image；The end End is also used to, and according to described image frame, obtains the status information of tool indicated by the tool image；Wherein, the tool Status information be the tool static nature or the tool motion profile；The static nature of the tool is used for table Show that the attribute of the tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, hot spot In two or more combination；The terminal is also used to, and according to the status information of the tool, determines the text diagram Target area as in, and for the target area in the text image to be sent to the server；The server For obtaining processing result according to the target area in the text image, the processing result includes to the target area Corresponding target image editor or search inquiry, or, the target character in the target image identify/font conversion/ Language translation/search inquiry is obtained as a result, and for the processing result to be sent to the terminal；The terminal is also For receiving the processing result.

Based on fourth aspect, in possible embodiment, in the terminal according to the status information of the tool, determine In terms of target area in the text image, the terminal is specifically used for: including lateral shape in the static nature of the tool In the case where the combination of shape and vertical shape, the terminal is formed by area according to the tool transverse shapes and vertical shape Domain determines the target area in the text image；It include one or more coloured shapes in the static nature of the tool In the case where shape, terminal region according to pointed by a kind of shape for having particular color of the tool or there are many special The shape for determining color is formed by region, determines the target area in the text image；In the static nature packet of the tool In the case where including one or more textured shapes, the terminal is according to a kind of shape institute for having specific lines of the tool The region of direction is formed by region there are many shape of specific lines, determines the target area in the text image； It include hot spot in the static nature of the tool, and the hot spot includes at least one of luminous point, light line or light region In the case where, the region that terminal region according to indicated by the hot spot of the tool or the hot spot are covered determines Target area in the text image.

Based on fourth aspect, in possible embodiment, described image frame is multiframe；Described according to described image Frame obtains the status information aspect of tool indicated by the tool image, and the terminal is specifically used for: the terminal determines institute It states between the tool in every frame picture frame in multiple image frame and the calibration position of the text image in every frame image Relative position；Terminal relative position according to determined by every frame picture frame, obtains the relatively described calibration of the tool The motion profile of position.

Based on fourth aspect, in possible embodiment, the motion profile includes straight line, class straight line, non-closed song One of line, closure class curve or multiple combinations.

Based on fourth aspect, in possible embodiment, in the terminal according to the status information of the tool, determine In terms of target area in the text image, the terminal is specifically used for: when the motion profile includes that straight line or class are straight When line, the terminal determines the target area of the first side or second side that are located at the straight line or class straight line；When the fortune When dynamic rail mark includes non-closed curve, the terminal determines the target of the first side or second side that are located at the non-closed curve Region, alternatively, the terminal is closed by described after the terminal forms closed curve by non-closed curve described in process of fitting treatment It closes curve and is formed by region, determine the target area in the text image；When the motion profile includes closure class curve When, the terminal is formed by region by the closed curve, the target area in the text image is determined, alternatively, institute After terminal is stated by the formation association closed curve of closed curve described in process of fitting treatment, the terminal passes through the related closed curve It is formed by region, determines the target area in the text image.

Based on fourth aspect, in possible embodiment, the target area is comprised at least one of the following: with the work Has region that is neighbouring and accommodating single or multiple texts；Area that is neighbouring with the tool and accommodating uniline or multline text Domain；And receiving single-row or multiple row text region neighbouring with the tool；It is neighbouring with the tool and have specific shape The region of shape, wherein the specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon, Or multiple combinations.

Based on fourth aspect, in possible embodiment, which is characterized in that the target area includes following at least one Kind: the region of the single or multiple texts of receiving on the direction indicated by the static nature of the tool；In the quiet of the tool The region for accommodating uniline or multline text on direction indicated by state feature；On the direction indicated by the static nature of the tool Single-row or multiple row text the region of receiving；The area with specific shape on the direction indicated by the static nature of the tool Domain, wherein the specific shape includes one of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or a variety of Combination.

5th aspect, the embodiment of the invention provides a kind of tool for image procossing, the tool is used to indicate existing The target area of text in real environment；When near the text that the tool is located in the actual environment, trigger equipment or Person's system target area according to indicated by the tool handles the target image in the text.

Based on the 5th aspect, in possible embodiment, the tool is specifically used for: by the static state of the tool The target area of feature or the text in motion profile instruction actual environment；When the tool is located at the text in the actual environment When near this, triggering target area according to indicated by the static nature of the tool or motion profile is handled in the text Target image；The static nature of the tool is used to indicate the attribute of the tool, the static nature of the tool include lines, Color, transverse shapes, vertical shape, height, two or more the combination in hot spot；

It include transverse shapes and perpendicular in the static nature of the tool in possible embodiment based on the 5th aspect To shape combination in the case where, the tool described is formed according to the tool transverse shapes with vertical shape for triggering Region, determine the target area in the text image；It include one or more having color in the static nature of the tool Shape in the case where, the tool is for triggering pointed by the shape for having a kind of particular color according to the tool Region is formed by region there are many shape of particular color, determines the target area in the text image；Described In the case that the static nature of tool includes one or more textured shapes, the tool is described according to for triggering Region pointed by a kind of shape for having specific lines of tool is formed by region there are many shape of specific lines, really Target area in the fixed text image；It include hot spot in the static nature of the tool, and the hot spot includes luminous point, light In the case where at least one of lines or light region, it is signified that the tool is used to trigger the hot spot according to the tool The region that the region or the hot spot shown is covered, determines the target area in the text image.

It obtains the tool after identification facility it can be seen that implementing tool provided by fifth aspect present invention and points out Target text in target image, simplify the manual steps of the target image in processing target text, and then promoted User experience, meets the needs of users.

6th aspect, the present invention provides the equipment of another image procossing, including processor, memory, communication interface And one or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by upper Processor execution is stated, above procedure is included the steps that for executing the instruction in the embodiment of the present application first aspect either method.

7th aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein above-mentioned computer-readable Storage medium storage is used for the computer program and data of electronic data interchange, wherein above-mentioned computer program makes computer Execute the step some or all of as described in the embodiment of the present application second aspect either method.

Eighth aspect, the embodiment of the present application provide a kind of computer program product, wherein above-mentioned computer program product Non-transient computer readable storage medium including storing computer program, above-mentioned computer program are operable to make to calculate Machine executes the step some or all of as described in the embodiment of the present application second aspect either method.The computer program product It can be a software installation packet.

Detailed description of the invention

In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with It obtains other drawings based on these drawings.

Fig. 1 is a kind of system architecture diagram of image procossing provided in an embodiment of the present invention；

Fig. 2 is a kind of structural schematic diagram of image processing equipment provided in an embodiment of the present invention；

Fig. 3 is a kind of application scenario diagram of image procossing provided in an embodiment of the present invention；

Fig. 4 is the application scenario diagram of another image procossing provided in an embodiment of the present invention；

Fig. 5 is a kind of method flow diagram of image procossing provided in an embodiment of the present invention；

Fig. 6 is the method flow diagram of another image procossing provided in an embodiment of the present invention；

Fig. 7 is the method flow diagram of another image procossing provided in an embodiment of the present invention；

Fig. 8 is the structural schematic diagram of another image processing equipment provided in an embodiment of the present invention；

Fig. 9 (a) -9 (c) is some schematic diagram of a scenario determined according to tool progress region；

Figure 10 (a) -10 (c) is that other carry out the schematic diagram of a scenario that region determines according to tool；

Figure 11 (a) -11 (d) is that other carry out the schematic diagram of a scenario that region determines according to tool；

Figure 12 is a kind of schematic diagram of a scenario determined according to tool progress region；

Figure 13 (a) -13 (b) is that other carry out the schematic diagram of a scenario that region determines according to tool.

Specific embodiment

In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the present invention, not For limiting the present invention.Obviously, the described embodiment is only a part of the embodiment of the present invention, rather than whole implementation Example.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts Every other embodiment, should fall within the scope of the present invention.It is described in detail separately below.

Description and claims of this specification and term " first " in above-mentioned attached drawing, " first " etc. are for distinguishing Different objects, are not use to describe a particular order.In addition, term " includes " and their any deformations, it is intended that covering Non-exclusive includes.Such as contain series of steps or the process, method, system, product or equipment of module are not limited to Listed step or module, but optionally further comprising the step of not listing or module, or optionally further comprising for this A little process, methods, the other steps or module of product or equipment inherently.

With reference to Fig. 1, Fig. 1 is a kind of system architecture diagram of image procossing of the embodiment of the present invention.As shown in Figure 1, the system 10 include: equipment 101 and tool 102.

Wherein, equipment 101 has the function of identification facility 102.Equipment 101 can be realized by identification facility 102 and be identified Content (target character in as follows) in region indicated by the tool 102.

It wherein, can be in the computer system of equipment 101 in order to allow equipment 101 to have the function of identification facility 102 The model data of tool 102 is prestored, the tool for identification of tool 102 can also be prestored in the computer system of equipment 101 Method model, for example construct the model of identification facility 102 by the way of artificial neural network training, equipment can also be passed through 101 obtain 102 model data of tool from server side, and equipment 101 and tool 102 can also be made to establish using other modes and joined System, is not specifically limited herein.It in practical applications, can be by the way that tool be stored in advance in the computer system of equipment 101 102 one or more graphic feature comes so that equipment 101 is contacted with the foundation of tool 102, when the shooting of equipment 101 contains tool 102 picture, alternatively, when equipment 101 gets the picture comprising tool 102, equipment can direct extracting tool 102 figure As feature is matched with pre-set image feature, to complete identification facility 102.And in the image comprising tool 102 of acquisition When may because of shooting angle, shooting light, artificial mobile etc. factor influence and lead to captured 102 image of tool It not exclusively coincide, thus a threshold value can be preset, matching result falls into preset threshold value in 101 system of equipment When, it is concluded that successful match conclusion, which is that for equipment 101 to the process of the identification of tool 102, equipment 101 can be into one Step is according to the 102 processing target image of tool.Tool 102 can also be stored in advance in equipment 101 by way of mathematical description One or more characteristics of image, equipment 101 can also be by prestoring the pattern (such as two dimensional code) of specific encoding law, equipment 101 can also prestore contrasting foundation of the model of tool 102 as identification by other means, and the process identified, principle are same Graphic feature is prestored, for other modeling patterns, and will not be described here in detail.

In addition, equipment 101 can also by wireless technology (such as bluetooth, WiFi) or cable technology and tool 102 into Row connection.Equipment 101 being capable of identification facility 102.

Wherein, equipment 101 can be motion scan equipment, and equipment can also can be.Equipment 101 can be mobile phone, read Equipment, electronic dictionary, scanner and other mobile device equipment that can be carried out scanning or take pictures.Tool 102 also known as assists Tool is the tool that one kind is used to refer to target character region (referred to as target area), and having can be identified by equipment 101 Characteristics of image.Tool 102 may include fixed device (showing a kind of fixed device as shown in figure 1), laser aid (such as laser Hot spot, Fig. 1 are not shown), at least one of biological characteristic (such as finger, Fig. 1 are not shown).

It should be noted that wherein, tool 102 can also be removable tools, can be mounted in equipment, certainly, the work Tool can also be fixed in equipment, a part as equipment.

Wherein, target image is the image in the region of the instruction of tool 102, points out target image, then benefit by tool 102 Tool 102 is identified with equipment 101, intercept target image, later, equipment 101 carries out subsequent processing to the target image again, such as Shared or scan for inquiry, etc., in addition, equipment 101 can be with the target character in recognition target image.

Wherein, target character is the content of text for needing input equipment 101.It is obtained including equipment 101 according to tool 102 The target character in target area in text.Target character can be a character, target character in text and be also possible to text Multiple characters in this are not construed as limiting the number of target character in the present embodiment.

For example, user is during reading papery text, encounter do not recognize or do not know content of text when, When needing to inquire or broadcast, this can not be recognized with tool 102 by using equipment 101 or unapprehended content is directly defeated Enter into equipment 101, in other words, the target image of target area is pointed out by tool 102, recycle equipment 101 to tool 102 identifications, and then target image pointed by identification facility is obtained, later, equipment 101 is again to the target word in the target image Symbol carries out subsequent processing, such as translated or carried out to read aloud, etc..

It follows that by using object content provided in an embodiment of the present invention handle system 10, by equipment 101 with The collective effect of tool 102 improves the efficiency to the target image processing in text, and then improves processing target image Efficiency more meets the needs of people.

In the following, a kind of equipment of image procossing provided in an embodiment of the present invention is discussed in detail.Referring to fig. 2, the present invention is implemented The image processing equipment 20 that example provides, comprising: image collection module 201, tool information obtain module 202, area determination module 203 and processing module 204.

It should be noted that for image processing equipment 20 shown in Fig. 2 is terminal.

In the following, each functional module to the equipment 20 is described as follows:

(1) image collection module 201: during the present invention is implemented, image collection module 201 obtains a frame or multiframe for shooting Picture frame, every frame picture frame include text image and tool image；In the specific implementation, shooting can be determined according to specific needs The frame number of picture frame is obtained, for example, when needing to determine the target area in text image according to the static nature of tool, figure It is a frame as obtaining the picture frame frame number that the shooting of module 201 obtains, and is needing to determine text according to the motion profile of tool When target area in image, the picture frame frame number that the shooting of image collection module 201 obtains is multiframe.In practical applications, may be used With by controlling image collection module 201 to the external setting of equipment mode, such as in a static mode, default obtains a frame figure As frame, in a dynamic mode, default obtains multiple image frame.

(2) tool information obtains module 202: tool information obtains module 202 and is used for according to a frame or multiple image Frame obtains the status information of tool indicated by the tool image.

On the one hand, when described image frame is a frame, at this point, the status information of the tool includes the static state spy of the tool Sign, specifically, the static nature of the tool is used to indicate that the attribute of the tool, the static nature of the tool to can be pose, shape One or more of shape, lines, color, length, width, width, height, hot spot.

On the other hand, when described image frame is multiframe, the status information of the tool includes the motion profile of the tool, In, the motion profile includes one of straight line, class straight line, non-closed curve, closure class curve or multiple combinations；Specifically , tool information obtain module 202 be used to determine tool in every frame picture frame in aforementioned multiple image frame with it is corresponding often Relative position between the calibration position of text image in frame image and the phase according to determined by corresponding every frame picture frame To position, the motion profile of the relatively described calibration position of the tool is obtained, wherein the calibration position is the one of any selection A specific position, i.e. reference position.

(3) area determination module 203: area determination module 203 is used for according to the status information of the tool, determine described in Target area in text image.

Wherein, when the status information of the tool is the static nature of the tool, area determination module 203 can be according to The different static natures of tool, determine the target area in the text image；Specifically, in the static nature of the tool Including shape, and in the case where the combination of the shape transverse shapes and vertical shape, the area determination module 203 can basis The transverse shapes of the tool and vertical shape are formed by region, determine the target area in the text image；Described The static nature of tool includes shape, and the shape includes dot-shapes or dot-shapes and transverse shapes, vertical shape At least one of combination in the case where, the area determination module 203 can be according to dot-shapes or dot-shapes and horizontal It is formed by region to the combination of at least one of shape, vertical shape, determines the target area in the text image；? In the case that the static nature of the tool includes one or more coloured shapes, the area determination module 203 can root Region pointed by the shape for having a kind of particular color according to the tool is formed by there are many shape of particular color Region determines the target area in the text image；It include one or more textured in the static nature of the tool In the case where shape, the area determination module 203 can be according to pointed by a kind of shape for having specific lines of the tool Region is formed by region there are many shape of particular color, determines the target area in the text image；Described The static nature of tool includes hot spot, and the hot spot includes the case where at least one in luminous point, light line or light region Under, the area determination module 203 can the area that is covered of the region according to indicated by the hot spot of the tool or the hot spot Domain determines the target area in the text image；It include pose in the static nature of the tool, and the pose includes position In the case where setting with posture, the area determination module 203 passes through described in the identification of the relative position of the tool and the equipment The pose of tool determines the target area in the text image.

Wherein, when the status information of the tool is the motion profile of the tool, specifically, working as the motion profile packet Include straight line perhaps class straight line when determine the target area of the first side or second side that are located at the straight line or class straight line；When When the motion profile includes non-closed curve, the first side or second side target area for being located at the non-closed curve are determined Domain alternatively, after forming closed curve by non-closed curve described in process of fitting treatment, then by the closed curve is formed by area Domain determines the target area in the text image；It is bent by the closure when the motion profile includes closure class curve Line is formed by region, determines the target area in the text image, wherein identifies that the position of the tool can be basis Tool and the mathematical coordinates relation derivation of equipment obtain.

(5) processing module 204: processing module 204 is used to execute with next the corresponding target image in the target area Kind or a variety of operations: interception sharing is carried out to the target image in the target area；To the target figure in the target area As scanning for inquiring；Target character in the target image is identified；By the text importing in the target character To the display screen of the equipment；Voice broadcast is carried out to the text in the target character；To the text in the target character Carry out font conversion；Language translation is carried out to the text in the target character；Text is carried out to the text in the target character This editor；Text in the target character is scanned for inquiring.

Wherein, which gives user's selection there may be plurality of application scenes mode, and included a variety of of existing system answer With scene mode (such as half-light environment, strong optical mode etc.), also there is customized scene, same tool is under different application scenarios There can be different Parameters variations, and a kind of tool parameters correction mode can be provided for different application scene, and will correction Tool parameters afterwards are stored as a kind of application scenarios, it is contemplated that the feature (such as color, curvature of a curve) of tool itself and are Built in system or the tool characteristics of importing are variant, which may be that the error of camera system itself is brought, it may be possible to work as front ring Caused by border factor (light, temperature), it is also possible to which tool itself produces certain deviation or micro- in production or using link The distortion of amount, system needs the parameter using true tool under currently used environment as effective parameter, to improve identification Accuracy rate and speed；The process of the correcting mode is as follows: place the tool above in a given plane (for example the plane can be A blank sheet of paper or an other kinds of plane), and adjust each key feature on camera, tool and tool it Between relativeness reach system requirements, at this time control photographing device take pictures and calculate the ginseng of the key feature of tool at this time Number, and the parameter is substituted or is adjusted original parameter as the parameter under application scenarios, or as the parameter under customized scene

Wherein, which supports one mode, can carry out typing for the finger characteristic of a people in this mode, Or by the way of deep learning, learnt by various states of the equipment to finger, to improve the speed and essence of identification Degree.For example, placing a letter " A ", while user's finger is directed toward A, system, which will do it, takes pictures or images, and user can be continuous The shape or replacement finger for converting common finger shape and entire hand, are taken pictures or are imaged when being directed toward letter A；System can root The feature extraction of hand is carried out according to the image of shooting, or obtains user's finger finger tip for identification or the model of direction.

Wherein, which can also support plurality of application scenes mode: locking mode, battery saving mode and other moulds Formula, in a locking mode, equipment can suspend the new delineation region of identification, and in a power saving mode, the frequency taken pictures is reduced or do not clapped According into both modes, there are several types of possible operating methods: system according to user within a certain period of time operation frequency The input device controls that degree judgement, facility instruction export, manually pass through.

It should be noted that each functional module image of equipment obtains module, work in the case where equipment is server Have data obtaining module, area determination module, processing module and communication module, wherein the image collection module of the equipment with The difference of image collection module 201 is the picture frame for obtaining terminal upload in Fig. 2, handles mould in processing module and Fig. 2 The difference of block 204 is for the corresponding target image editor in the target area or search inquiry, or, to the target figure Target character as in carries out identifying/font conversion/language translation/search inquiry, other aspects, image collection module, tool Image collection module 201 in data obtaining module, area determination module, processing module and Fig. 2, tool information obtain module 202, Area determination module 203, processing module 204 are identical, obtain mould to image collection module 201, tool information in Fig. 2 referring to above-mentioned The description of block 202, area determination module 203, processing module 204, details are not described herein again.In addition, the equipment further includes communication mould Block, the communication module are used to carry out processing module that treated that data are transferred to corresponding terminal.

In the following, tool provided in an embodiment of the present invention is described in further detail.In order to be used to refer to the text in actual environment This target area, the embodiment of the invention provides corresponding tools；Near the text that tool is located in the actual environment When, equipment target area according to indicated by the tool can be triggered and determine target image in the text.

Wherein, tool is located at the text in the actual environment and nearby can be tool and connect with the text in actual environment Touching, certainly, which can not also contact with the text in actual environment, that is to say, that tool can in actual environment Have a certain distance between text, if tool and text all in the coverage of equipment, and picture captured by the equipment The relative position of target image in the tool and text can be embodied.

Wherein, it might have different static natures on tool.

In order to make it easy to understand, being classified according to function to static nature on tool, it is believed that the static nature on tool can There can be five classes, which can determine according to the usage scenario of tool, not necessarily exist simultaneously, in the following, respectively Five classes static nature that may be present is discussed in detail:

(1) regional choice feature for doing the feature of regional choice, for example may be used to determine target area orientation or standard The feature of true position, the rule that two or three terminals as described in Fig. 9 (a) can be defined according to the computer system of equipment Then determine a rectangular area.

(2) instruction features, for triggering the feature that equipment generates instruction, for example some feature moves on to some position of tool On can indicate a kind of instruction.

Herein, instruction can be notice system enter energy-saving mode, closing system, freeze to export, restart system, power-off, Adjust one or more of instruction such as recognition speed, it should be noted that tool can be issued by following two mode Instruction:

One is active mode, tool itself contains active circuit, at this time can be by key or switch or voice come real The sending now instructed, the instruction of sending trigger corresponding device systems by wired or wireless mode and respond.

Another kind is passive mode, and the equipment that the variation of tool itself is triggered generates corresponding instruction.Tool itself becomes The change for changing corresponding parameter caused by the change that can be a certain feature on tool, such as by some rectangular length on tool Degree narrows, and the variation of tool itself can be the relationship between element corresponding to each feature, such as by some is rectangular on tool Shape and triangle are put off till together, and the spatial relationship that the variation of tool itself can be between each feature and photographing device is become Change, such as by tool turn or will at tool one remove shot region, it should be noted that when tool overturn when, tool Another side occur and then shooting of presenting before less than, in this case, corresponding some features may be hidden, and Other features occur and new spatial relationship occur.Relevant parameter or relationship caused by the variation of tool itself meet equipment When middle computer system is defined regular, once being identified by equipment, then it can trigger the equipment and generate corresponding instruction.It can manage Solution is, wherein each rule all corresponds to a kind of instruction, and the computer system of equipment can define multiple rule and corresponding Instruction.For example, hand can also export a kind of placement state as a kind of tool to correspond to a kind of instruction, for example the five fingers open It can indicate equipment closing or other.

(3) tool identity characteristic can be bar code for determining the ID number of tool or the feature of tool types, and two Tie up code or other patterns or shape.

One or more patterns are enclosed on tool, can be using the pattern as the feature of auxiliary positioning, it can also should Number or type feature of the pattern as tool.The computer system of corresponding equipment identifies corresponding pattern, can be to it Decoding can carry out comparing with the equipment or server later, and carry out certification or other subsequent processings.

(4) supplemental characteristic, for the feature of auxiliary positioning and auxiliary corrective tool.In the initial stage of positioning, Ke Yifu The position of determining tool is helped, can also assist determining tool location, finally calculate when band of position calculating is not known Target text region.Supplemental characteristic can also be used to auxiliary corrective tool characteristics, for example, being characterized in change on tool In the case where, then can feature to be stored in update the system, be characterized in such as projecting in adjustable situation on tool The color or reconfigurable of equipment output, also adjustable tool is set as tool in equipment in specific application scenarios In the case where correction mode, the characteristic element inherent parameters, relationship between each characteristic element, each can be adjusted according to operating guidance Relationship, photographing device between characteristic element and photographing device and the relationship between auxiliary plane.

(5) operating characteristics operate tool convenient for user, and in specific application, operating characteristics can be tool On a component, such as can be a handle, this feature may not can be identified by system, but can also may be with preceding 4 A characteristic crossover merges.

Element corresponding to the above five classes static nature is the static nature element of the tool, these five types of static nature elements In one or more elements may be simultaneously at least one of for five class static nature elements, that is to say, that the same element Characteristic element that may simultaneously as different static natures, and the position of existing characteristic element may be in the front of tool, it can It can be in the reverse side of tool, it is also possible to which, in the side of tool, it is not limited in the embodiment of the present invention.

In one embodiment, which can indicate the text in actual environment by the static nature of the tool Target area, when the tool appears near the text in the actual environment, triggering equipment is special according to the static state of the tool The indicated target area of sign identifies the target character in the text.

Wherein, the static nature of tool refers to the feature that tool itself is presented in the stationary case, and these are static Containing that can know another characteristic by corresponding equipment in feature, in other words, certain static natures of the tool can be by the equipment Computer system detected by, and data corresponding to these static natures can and the data of equipment storage inside match. The internal feature of the tool changes or change in location, can trigger equipment according to static nature corresponding on the tool and determine mesh Mark region, it should be noted that the corresponding static nature parameter of static nature can change, still can quilt after variation The computer system of equipment identifies.

In a possible embodiment, the static nature of tool can be pose, shape, lines, color, length, width, height One or more of degree, hot spot.

Wherein, the static nature of the tool can be shape, and further, the shape of the tool can be the cross of the tool To shape, vertical shape, the shape of the tool is also possible to the combination of the transverse shapes of the tool and the vertical shape of the tool, The tool can trigger corresponding equipment region or transverse shapes according to indicated by the transverse shapes of the tool, vertical shape It is formed by region with vertical shape, determines the target area in the text image.Furthermore, it is possible in embodiment, in tool In the case where biological characteristic, the shape of tool can also be shape corresponding to biological characteristic, such as the finger of people, palm Shape etc..

Wherein, the static nature of the tool can be in dot-shapes or dot-shapes and transverse shapes, vertical shape The combination of at least one in the case where, the tool can trigger corresponding equipment according to dot-shapes or dot-shapes with The combination of at least one of transverse shapes, vertical shape is formed by region, determines the target area in the text image.

Wherein, the static nature of the tool can be one or more coloured shapes, which can trigger accordingly Equipment region according to pointed by a kind of shape for having particular color of the tool or there are many particular color shape shape At region, determine the target area in the text image.

Wherein, in the case that the static nature of the tool can be one or more textured shapes, which can be with It triggers corresponding equipment region according to pointed by a kind of shape for having specific lines of the tool or there are many specific face The shape of color is formed by region, determines the target area in the text image.

Wherein, the static nature of the tool can be hot spot, wherein hot spot includes in luminous point, light line or light region At least one in the case where, the tool can trigger corresponding equipment region according to indicated by the hot spot of the tool or The region that the hot spot is covered determines the target area in the text image.Specifically, the hot spot of the tool can be Laser facula, wherein laser facula can be the group of one or more of laser spot, laser lines or laser region It closes, which can be used to trigger corresponding equipment region according to indicated by the laser facula of the tool or laser facula institute The region of covering determines the target area in the text image.

Wherein, tool can be fixed with the position of corresponding equipment, at this point it is possible to using the pose of the tool as touching Hair tool determines the static nature of target area, wherein the pose can be position and posture.In the computer system of equipment The relative positional relationship of target area indicated by the pose of tool pose and tool is prestored in advance, which can be used to trigger Corresponding equipment passes through the pose of the tool, determines the target area in text image.

In one embodiment, which can indicate the text in actual environment by the motion profile of the tool Target area, specifically, triggering equipment according to the tool when the tool occurs near the text in the actual environment Target area indicated by motion profile determines the target image in the text.

Wherein, the motion profile of tool refers to the fortune that can reflect target area caused by movement of the tool relative to text Dynamic rail mark.

In a possible embodiment, the motion profile of the tool can be straight line, and the motion profile of the tool can be class Straight line, the motion profile of the tool can also be that non-closed curve, the motion profile of the tool can also be closure class curve, should The motion profile of tool can also be straight line, class straight line, non-closed curve, any combination or multiple combinations for being closed class curve.

For example, the tool is for triggering described set when the motion profile of the tool is straight line or class straight line Standby determine is located at the straight line or the first side of class straight line or the target area of second side；When the motion profile of the tool is non- When closed curve, which is used to trigger the equipment and determines the target for being located at non-closed first side of curve or second side Region, alternatively, passing through after the tool is for triggering the equipment by non-closed curve formation closed curve described in process of fitting treatment The closed curve is formed by region, determines the target area in the text image；When the motion profile packet of the tool When including closure class curve, the tool is formed by region by the closed curve for triggering the equipment, described in determination Target area in text image, wherein class straight line refers to user when drawing straight line by tool, because of manual operation, What is drawn is not absolute straight line, but is generally regarded as line processing, and equipment can be just fitted by algorithm and is in line It is handled.

In the following, citing description the present embodiments relate to it is several using terminal as the image processing application scene of equipment.

Referring to Fig. 3, in target image processing scene, in scene shown in Fig. 3, tool is the dress being fixedly connected with equipment It sets.For the ease of indicating, the region of dotted line delineation is target area, and the image in the target area is the target figure in text Picture, " Hello " are the target character in target image, and tool is fixed in equipment, and equipment can directly determine work by tool Has the signified target image being located above, further, equipment can identify the target character in the target image " Hello ", certainly, the equipment can also carry out subsequent processing for the target character, as shown, in the display screen of the equipment Upper display.

Referring to fig. 4, in target image processing scene, in scene shown in Fig. 4, tool is finger (the biology spy of people Sign), the motion profile of dotted line representational tool in figure, the region of motion profile delineation is target area, the image in target area For target image, tool is separated with equipment, and equipment determines target area by the motion profile of tool, is obtained according to target area To target image, target image can be intercepted and share an other users, after can also being identified with the target character in target image Other users are shared with, target character is " How are you Hello, world ".

Based on above system structure, device structure and tool, figure provided in an embodiment of the present invention is described further below As the implementation method of processing.

Fig. 5 is referred to, Fig. 5 is a kind of flow diagram of the implementation method of image procossing provided in an embodiment of the present invention. As shown in figure 5, described image processing method includes:

S501, picture frame is obtained.

Wherein, every frame picture frame includes text image and tool image.

S502, according to described image frame, obtain the status information of tool indicated by tool image.

Wherein, the status information of the tool is the static nature of the tool or the motion profile of the tool；Institute The static nature for stating tool is used to indicate that the attribute of the tool, the static nature of the tool to include lines, color, lateral shape Shape, vertical shape, height, two or more the combination in hot spot.

S503, according to the status information of the tool, determine the target area in the text image.

S504, to the corresponding target image editor in the target area or search inquiry, or, in the target image Target character carries out identifying/font conversion/language translation/search inquiry.

It should be noted that when the status information of the tool is the static nature of the tool, s501, s502, S503, s504 are identical as s601, s602, s603, s604 in Fig. 6, please refer to and hereafter retouch to s601, s602, s603, s604 It states, details are not described herein again.When the status information of the tool be the tool motion profile when, s501, s502, s503, S504 is identical as s701, s702, s703, s704 in Fig. 7, please refers to the description hereafter to s701, s702, s703, s704, herein It repeats no more.

Fig. 6 is referred to, Fig. 6 is a kind of flow diagram of the implementation method of image procossing provided in an embodiment of the present invention. As shown in fig. 6, described image processing method includes:

S601, a frame picture frame is obtained.

Wherein, tell that a frame picture frame includes text image and tool image.

Wherein, obtaining a frame picture frame can be system one frame picture frame of acquisition, and system can have terminal and server；It obtains It takes a frame picture frame to be also possible to equipment and obtains a frame picture frame, wherein equipment can be terminal, can also be server.

In the case where equipment is server, equipment obtain a frame picture frame can be corresponding terminal delete choosing and upload One frame picture frame can also be and delete the frame selected from the multiple image frame that terminal uploads, and be also possible to from terminal upload Part is intercepted in one frame picture frame, the frame that can also be the multiple image frame synthesis that terminal uploads again, is not especially limited. Wherein, terminal, which is taken pictures, generates the implementation of picture frame, the description referring to the case where hereafter equipment is terminal, no longer superfluous herein It states.

In the following, the case where equipment is terminal, is described in detail:

Equipment, which obtains a frame picture frame, can be the picture frame that equipment carries out shooting generation by camera, further according to shooting Obtained picture frame obtains a frame picture frame.Wherein, equipment can be a frame by the picture frame that camera carries out shooting generation, Equipment can be multiframe by the picture frame that camera carries out shooting generation, wherein the frame picture frame that equipment obtains can be The frame selected from multiple image frame is also possible to the one of a part formation intercepted out from a frame picture frame of generation Frame can also be the frame for synthesizing multiple image frame, wherein equipment by camera carry out shooting obtain the frame picture frame contain There are text image and tool image.

Wherein, it takes pictures and generates picture frame and can specifically be accomplished by the following way:

During shooting, the computer system of equipment can identify the clarity of captured picture, root by algorithm The particular content of shooting is determined according to the clarity, can generate image for the whole region that camera coverage is covered, Image can also be generated for the regional area under the rule of the computer system settings of the equipment, for example, model as defined in rule It encloses and is no more than 1 times of tool width or other measurements above the tool that can be.

In specific application scenarios, the computer system of equipment can be caused by the operation for detecting user's triggering It takes pictures and initiates shooting generation picture frame when requesting at once, equipment is also possible to the positional relationship phase between the tool of detecting and text Shooting is automatically initiated to system after fixation and generates picture frame, the computer system of equipment can also be according to preset time interval It carries out shooting and calculates generation picture frame, specifically, can be after request is taken pictures in user's sending, wait for a period of time or referring to Initiation shooting of fixing time generates picture frame.The computer system of equipment can also be in the instruction for receiving tool sending, according to finger It enables and carries out the picture frame of shooting generation immediately, or, picture frame is generated according to corresponding instruction delay or timed shooting.

In possible scene, before equipment generates picture frame, it is also possible to which the region that can choose shooting detects After taking pictures may image may be distorted, need accordingly to adjust the region of shooting according to the changing features on tool, For example, equipment detects that target area pointed by tool corresponds to rectangular area before taking pictures, but since shooting angle problem should Region becomes parallelogram region, and equipment then needs the characteristics of image on extracting tool, is pushed away according to the feature of parallelogram The situation of change for measuring target area determines the region taken pictures, as shown in Figure 11 (d).

Equipment supports plurality of application scenes mode to select to user simultaneously, can be the included plurality of application scenes mould of equipment Formula, such as half-light environment, strong optical mode, are also possible to the customized scene of user, same tool is in different application scenarios There can be different Parameters variations down, provide a kind of tool parameters correction mode for different application scene, and will be after correction Tool parameters are stored as a kind of application scenarios.When the feature for detecting tool itself, such as color, curvature of a curve and equipment The tool characteristics for presetting or importing in advance are variant, and system needs the parameter by true tool under currently used environment to make For effective parameter, the accuracy rate and speed identified with raising, wherein difference may be the error of camera system itself, may It is caused by current environment factor (such as light, temperature etc.), it is also possible to which tool itself is produced in production or using link Certain deviation or micro distortion.The process of the correcting mode is as follows: place the tool above in a given plane (such as should Plane can be a blank sheet of paper or an other kinds of plane), and adjust each on camera, tool and tool Relativeness between feature controls photographing device at this time and takes pictures and calculate the pass of tool at this time when reaching system requirements The parameter of key feature, and the parameter is substituted as the parameter under application scenarios, or as the parameter under customized scene.

S602, according to the frame picture frame, obtain the static nature of tool indicated by tool image.

Wherein, described according to the frame picture frame, the static nature for obtaining tool indicated by tool image can be System obtains the static nature of tool indicated by tool image according to the frame picture frame, and system can have terminal and clothes Business device；It is described according to the frame picture frame, the static nature for obtaining tool indicated by tool image is also possible to equipment root According to the frame picture frame, the static nature of tool indicated by tool image is obtained, wherein equipment can be terminal, may be used also To be server.

Wherein, the static nature of tool be used to representational tool attribute, the static nature of tool can be pose, shape, The combination of one or more of lines, color, length, width, height, hot spot:

The static nature of the tool can be shape, and further, shape can be transverse shapes, can be vertical shape Shape, can also be the combination of transverse shapes Yu vertical shape, and the static nature of the tool is also possible to one or more have color Shape combination, the static nature of the tool is also possible to the combination of one or more textured shapes, the tool it is quiet State feature is also possible to hot spot, and further, hot spot can be one or more in luminous point, light line or light region Combination, wherein hot spot can be laser facula, and laser facula can be in laser spot, laser lines or laser region One or more combination.In addition, the static nature of the tool can be pose, further, position and posture can be. The static nature of the tool can also be other features that tool is showed under static state, the embodiment of the present invention to this not It limits.

In the following, obtaining the feelings of the static nature of tool indicated by tool image according to the frame picture frame to equipment Condition is described in detail.

Wherein, equipment obtains the static nature of tool indicated by tool image according to the frame picture frame.

Specifically, there is parameter corresponding to one or more static natures pre- by the system of equipment on every kind of tool itself It first stores, wherein storage mode can be picture mode, be also possible to mathematical description mode, be also possible to specifically encode rule The pattern (such as two dimensional code) of rule, equipment identify the tool image in picture frame, extract the static nature of the tool image.It needs It is bright, it element corresponding to the relationship and each static nature on tool between element corresponding to each static nature and takes the photograph As the relationship between head may have fixed part, it is also possible to there is unfixed part.In addition, when multiple types of tools is used in combination When, equipment can identify a kind of tool or multiple types of tools, wherein tool can be active equipment, it is also possible to inactive component.

S603, according to the static nature of the tool, determine the target area in the text image.

Wherein, the static nature according to the tool, determining that the target area in the text image can be is System determines the target area in the text image, system can have terminal and server according to the static nature of the tool； The static nature according to the tool determines that the target area in the text image is also possible to equipment according to the work The static nature of tool determines the target area in the text image, wherein equipment can be terminal, can also be server.

In the following, to equipment according to the static nature of the tool, the case where determining the target area in the text image It is described in detail:

The computer system of equipment is identified according to the relevant parameter of the static nature of the tool stored obtained It is stored in bonding apparatus system or define quiet in picture frame after the more specific location information of the corresponding feature of the tool The derivation related to the relative positional relationship of text of state feature calculates target area corresponding to target character, wherein should Positional relationship can be the relativeness of certain static nature on the direction and tool of character.For example, using finger as tool Specific application scenarios in, rule can be with the pointing direction of finger under corresponding finger mode apart from finger it is nearest one Region corresponding to row word or a word is target area.

During target area in the text image for determining region, in order to solve the mesh in picture frame obtained Region is marked because of the problem of of deforming the problem of shooting angle, equipment according to the upper changing features of regional choice tool and Corresponding adjustment target area, for example, if target area indicated by tool is rectangular area, since shooting angle problem is being schemed In picture frame, target area indicated by the tool may will become parallelogram region, then, obtaining the target in picture frame Region wait, equipment can according in picture frame on tool feature variation, deduce target area in conjunction with the feature of parallelogram Situation of change later, the target area can be intercepted out to complete the determination of target area.

It should be noted that equipment determines in the text image according to the static nature of the tool by taking equipment as an example Target area, the premise realized is as follows:, can be by user to the tool firstly, the choice phase in target area The selection of target area is expressed in the adjustment of relationship between internal feature, can also by user to equipment, tool it is each Both any relationship adjusts to express a target area in this three of text object corresponding to a static nature, target character Domain selection.Based on premise, equipment determines that the target area in the text image can lead to according to the static nature of the tool Cross following two mode:

First is that equipment, by preset fixed relationship, the specific space of the tool and target area that adjust in conjunction with user is closed System obtains the computer of equipment in image according to the instruction of the static nature of tool under the instruction of default rule or mode The good target area of systemic presupposition.Wherein, preset fixed relationship can be the tool preset, equipment shoots overlay area, Positional relationship where target area between plane three, it should be noted that the positional relationship between this three can be production The included fixed relationship of product, can also be determined by manual intervention.For example, in the position of the camera of equipment and tool In the case where fixation, change the positional relationship of tool and target text region, such as mobile tool or moving object region, at this point, The pose of tool is pre-stored in the computer system of equipment, and the relativeness of the pose of tool and target area is also pre- It is first stored in the computer system of equipment, at this point, equipment can be determined directly in target image frame according to the pose of tool Target area, without analysis picture frame in tool just can determine that position of the target area in picture.It is with a kind of equipment Electronic dictionary citing, tool and electronic dictionary position are fixed, and are placed the tool above below text, electronic dictionary can be according to tool Pose combination default rule confirm target area, in specific application scenarios, default rule can be externally presented as Analytical model, a kind of corresponding analytical model of a rule, the analytical model can be individual character mode, single line mode, multiline mode, And equipment can show that analytical model allows user to select, after equipment detects user to the selection of analytical model, using corresponding Rule determine target area indicated by the pose of tool, and analytical model can also have a kind of mode of default.Due to work Tool, equipment camera have a fixed relationship preset, there are fixed pass in the coverage area of camera shooting and tool position System, as long as entire electronic dictionary to be moved on to the lower section of text together with tool at this time, computer dictionary does not need analysis picture frame at this time The specific location of middle tool directly determines target area in picture frame, certainly, equipment according to the pose combination preset rules of tool Target text region can also be determined by the tool of tool in analysis picture frame.As shown in figure 12, under individual character mode, when Tool is located at the lower section of character " Hello ", and electronic dictionary can directly determine target character region.

First is that equipment determines target area according to the relative positional relationship of tool in picture frame and target area.It is specific and Speech, equipment combine the position of preset characteristic element and target area by calculating the tool characteristics elements position in picture frame Relationship is set, determines the specific location of target area.For example, unfixed in the relative position of the camera of equipment and tool In the case of, picture frame is obtained, according to corresponding tool shape, the one or more color and shapes, one in picture frame on tool The static natures such as kind or a variety of textured shapes, hot spot determine the position of target area in conjunction with corresponding preset rules.

Further, target area can be region that is neighbouring with the tool and accommodating single or multiple texts, mesh Mark region is also possible to region that is neighbouring with the tool and accommodating uniline or multline text, target area can also be with The tool is neighbouring and accommodates single-row or multiple row text region, target area can also be it is neighbouring with the tool and Region with specific shape, wherein the specific shape includes round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon One of or multiple combinations.Wherein, target area with the static nature of tool be reference, specific size and with tool The relativeness in region indicated by static nature is carried out by equipment according to different usage scenarios customized.

It is as follows, by taking several tools that can determine rectangular area as an example, specifically describes and determined by the static nature of tool Target area:

Similar tool can indicate target area by different static natures, can be in conjunction with reference to Fig. 9 (a) and figure 10(a)。

The same static nature of same tool can determine different target areas by the variation of position, can refer to Fig. 9 (a), Fig. 9 (b) and Fig. 9 (c), Figure 10 (a), Figure 10 (b) and Figure 10 (c), Figure 13 (a) and Figure 13 (b).

Different tools can determine same target region according to different rules.It can be with reference to Fig. 9 (a) Figure 11 (a), figure Shown in 12 and Figure 13 (a).

The whole realization process of target area in order to facilitate understanding, describes in conjunction with abovementioned steps: adjustment equipment camera, It is placed on text top or front, mixes up angle, camera shooting area overlay text, camera focal length meeting auto-focusing to text In sheet, camera is also possible to fixed focal length at this time, just again motionless later, when tool moves on to target character lower section, equipment A photo can be shot every 0.5s (time interval can be customized) according to the pre-set rule of computer system, One image of every shooting just calculates the provincial characteristics of the tool specific location in picture, detects the region in multiple continuous images There is no opposite variations for feature, then start to determine target area.The problem of due to shooting angle, area in image after the picture is taken Target area indicated by characteristic of field may change, for example, the rectangular area of script may will become parallelogram, So, equipment can determine the region of parallelogram according to the shape in the image again of tool, later, intercept out one in parallel Quadrangle when interception, can remove the image section for belonging to tool.Rectangular area after interception can be carried out subsequent processing by equipment. If to indicate the region of other different length and width again, need to adjust the effective length of tool horizontally and vertically, and movement should Below tool to specific region.In the following, several possible makes of demonstration, described color actually only wherein one below The representation method of kind provincial characteristics, can also pass through other representations.

S604, the corresponding target image in the target area is handled.

Wherein, it is described to the corresponding target image in the target area carry out processing can be system to the target area Corresponding target image is handled, and system can have terminal and server；It is described to the corresponding target figure in the target area It is also possible to equipment as carrying out processing the corresponding target image in the target area is handled, wherein equipment can be end End, can also be server.

Wherein, the equipment, which carries out processing to the corresponding target image in the target area, can be to the target area Corresponding target image executes one or more of operation: interception point can be carried out to the target image in the target area It enjoys；Target image in the target area can be scanned for inquiring；It can be to the target character in the target image It is identified；It can be by the text importing in the target character to the display screen of the equipment；It can be to the target character In text carry out voice broadcast；Font conversion can be carried out to the text in the target character；It can be to the target word Text in symbol carries out language translation；Text editing can be carried out to the text in the target character；It can also be to the mesh Text in marking-up symbol scans for inquiry, etc..

Wherein, equipment is handled and can be accomplished by the following way to the corresponding target image in the target area: first First, changed according to the characteristic element on tool come indicating area, then, first is that target directly can be obtained according to indicating area Image can all carry out entire document second is that can recorde target tool institute identified areas present position on picture at this time The post-processing of target area is post-processed and then extracted according to the position recorded before as a result, such as can be by full wafer text Shelves all translations are completed and then select post-processing result to corresponding region.

When target object is the target character in target image, equipment to the target character in the target area into After row identification, one or more of operation can also be executed to the target character of the identification as needed: such as can be with By the text importing in the target character to the display screen of the equipment, the text in the target character can also be carried out Voice broadcast, font conversion can also be carried out to the text in the target character can also be to the text in the target character Language translation is carried out, text editing can also be carried out to the text in the target character, it can also be in the target character Text scan for inquiring, equipment can according to need to after being identified to target character be directed to target character carry out Other operations, it is not limited in the embodiment of the present invention.

It certainly, further include to by processing result after handling picture frame in the case where equipment is server Be sent to corresponding terminal, for example, server can interception target area in target image after, by the target figure As being transferred to corresponding terminal, in order to which terminal carries out subsequent operation, such as shown in display screen, server can also identify After target character in target image, target character is scanned for inquiring, then query result is transferred to terminal, in order to end End carries out subsequent operation, shows such as in display screen, is broadcasted by buzzer.

It should be noted that s601, s602, s603, s604 can be all or part of in terminal or server Complete, that is, can be terminal complete independently s601, s602, s603, s604, be also possible to server complete independently s601, S602, s603, s604 are also possible to terminal and complete some of steps, and server completes remaining step, and e.g., terminal is completed S601, s602, s603, server completes s604 or terminal completes s601, s602, and server completes s603, s604, etc., It is not especially limited.

It can be seen that the method for implementing second aspect image procossing obtains the mesh that the tool is pointed out after identification facility The target image in text is marked, simplifies the manual steps of the target image in processing target text, and then improve use Family experience, meets the needs of users.

Fig. 7 is referred to, Fig. 7 is that the process of the implementation method of another target image processing provided in an embodiment of the present invention is shown It is intended to.As shown in fig. 7, the target image processing method includes:

701, multiple image frame is obtained.

Wherein, obtaining multiple image frame can be system acquisition multiple image frame, and system can have terminal and server；It obtains It takes multiple image frame to be also possible to equipment and obtains multiple image frame, wherein equipment can be terminal, can also be server.

In the occasion for determining target area with the motion profile of tool, tool can draw a circle to approve a mesh by motion profile Region is marked, can be existed according to default rule to tool to obtain motion profile and unobstructed target area, the equipment of tool Image comprising tool and text in motion process, which take pictures, generates image to record the motion profile of the tool.With convenient After acquisition multiple image frame that can be selective from the image of generation, some or certain spies of tool in comprehensive multiple image frame The relativeness for levying element and target area, obtains the motion track and unobstructed target area relative to target text of tool Domain.

In the following, the case where obtaining multiple image frame to equipment is described in detail:

Wherein, equipment can be terminal, can also be server.

In the case where equipment is server, equipment obtain multiple image frame can be corresponding terminal delete choosing and upload Multiple image frame can also be and delete the multiframe selected from the multiple image frame that terminal uploads, wherein terminal, which is taken pictures, generates image The implementation of frame, the description referring to the case where hereafter equipment is terminal, details are not described herein again.

In the following, the case where equipment is terminal, is described in detail:

Wherein, equipment can determine end shooting process by following two mode: generating and refer to one is artificial triggering The end control that specifically can be in artificial selection triggering equipment to terminate is enabled, such as " end " button can also be and manually adjust The phychology triggering equipment of tool generates shooting END instruction, and one is the state changes of detection instrument motion profile, such as speed to become Change (slowing or move stopping), as unclosed circuit completed, (equipment is under straight line pattern, and curvature of curve generation is larger Variation), as tool suddenly disappears (equipment selects under finger mode, and the feature of finger instruction target area suddenly disappears).

Wherein, in the scene with the motion profile of tool to indicate target area, it is possible that tool shelter target area The case where domain, such as, the case where the motion profile of tool is for enclosed region or approximate enclosed region, tool is being moved Track generate during may shelter target region, if tool is that throw light may not block, then the acquisition needed One frame picture frame or multiple image frame, obtain more accurate target area to the integrated treatment of multiple image frame, and picture frame It obtains, can be obtained in the beginning or end or midway shooting of equipment dynamic mode, following is a brief introduction of two different processing Mode:

First is that equipment, which can be constrained, does not have shelter target area in the initial phase of motor pattern or ending phase and tool When domain, equipment carries out the acquisition of picture frame according to preset rules, and the acquisition of picture frame and the starting of motor pattern can be independence Operation, be also possible to equipment and automatically continuously complete.

Second is that the process relationship of picture frame acquisition and motor pattern can not be constrained, passed through by system to the direct of picture frame The picture frame that target area is not blocked is picked out in processing.

In specific application scenarios, equipment in the case where image pickup mode or quick burst mode, can support from Some pictures are extracted by the rule of equipment setting inside a series of images frame, highest extraction speed can be with shooting speed one It causes.

S702, according to the multiple image frame, obtain the motion profile of tool indicated by tool image.

Wherein, described according to the multiple image frame, the motion profile for obtaining tool indicated by tool image can be System obtains the motion profile of tool indicated by tool image according to the multiple image frame, system can have terminal and clothes Business device；It is described according to the multiple image frame, obtain tool indicated by tool image motion profile can be equipment according to The multiple image frame obtains the motion profile of tool indicated by tool image, wherein equipment can be terminal, can be with It is server.

In the following, with equipment according to the multiple image frame, for the motion profile for obtaining tool indicated by tool image, It describes in detail:

Wherein, according to the multiple image frame, the motion profile for obtaining tool indicated by tool image can lead to equipment Cross following manner realization: equipment determines in tool and every frame image in every frame picture frame in the multiple image frame Relative position between the calibration position of text image and then the relative position according to determined by every frame picture frame, are obtained Obtain the motion profile of the relatively described calibration position of the tool.

Herein, according to the multiple image frame, the motion profile for obtaining tool indicated by tool image can be equipment Equipment determines target area according to the running track of a certain default characteristic element of tool and the relative positional relationship of target area, if It is standby to obtain tool and target area whithin a period of time according to carrying out shooting acquired picture frame to the motion profile of tool Relative positional relationship, arranged according to the two positional relationship for being preset in equipment, derive the specific location of target area.

In the process of processing to picture frame, since the extraction frame number of picture frame is limited, then by tool in text On relative position may be it is discrete, later, discrete point is obtained complete curve by fit approach by equipment, the curve The motion profile of the corresponding tool, the motion profile can be straight line or curve or closed circle.Certainly, the movement rail of tool Mark is also possible to straight line, non-closed curve or any combination for being closed class curve.

S703, according to the motion profile of the tool, determine the target area in the text image.

Wherein, the motion profile according to the tool, determining that the target area in the text image can be is System determines the target area in the text image, system can have terminal and server according to the motion profile of the tool； The motion profile according to the tool determines that the target area in the text image can be equipment according to the tool Motion profile, determine the target area in the text image, wherein equipment can be terminal, can also be server.

In the following, with equipment according to the motion profile of the tool, for determining the target area in the text image, into Row is discussed in detail:

Equipment can determine that target area, such as rule may is that according to rule predetermined by the motion profile It is a closed circle if it is the motion profile, then using the region in closed circle as target area.It should be noted that one In a specific application scenarios, target character region is determined using finger as tool cooperating equipment, available various shapes Region.

Wherein, can also be to the post-processing of motion profile after equipment obtains motion profile, it can setting according to system It is fixed, track post-process or do not handle, such as the shape that fitting is in line, rectangle, heart, circle are preset, or by one A approximation enclosed region is fitted to region that enclosed region etc. will finally obtain after post treatment as target area.

When motion profile is straight line, equipment determination can will be located at a certain range above straight line according to default rule Interior region is as target area, and when the motion profile is non-closed curve, equipment can also be according to pre-set rule Then determine above the non-closed curve a certain range of region as target area, alternatively, equipment can be by fitting at After managing non-closed curve formation closed curve, the region that closed curve is drawn a circle to approve determines the target area in the text image Domain, when the motion profile is closure class curve, equipment can will be located at the region in the closed curve according to preset rules, It is determined as the target area in text image, alternatively, forming association closed curve (such as by one by the process of fitting treatment closed curve It is a myopia rectangle closed curve be fitted to a rectangular curve) after, then by it is described correlation closed curve be formed by region, Determine the target area in the text image.

S704, the corresponding target image in the target area is handled.

This step is referring to the above-mentioned description to step 604 in Fig. 6.

Elaborate the equipment of the embodiment of the present invention and correlation technique in detail above, be based on same inventive concept, below after It is continuous that the other equipment equipment of the embodiment of the present invention is provided.

It should be noted that s701, s702, s703, s704 can be all or part of in terminal or server Complete, that is, can be terminal complete independently s701, s702, s703, s704, be also possible to server complete independently s701, S702, s703, s704 are also possible to terminal and complete some of steps, and server completes remaining step, and e.g., terminal is completed S701, s702, s703, server completes s704 or terminal completes s701, s702, and server completes s703, s704, etc., It is not especially limited.

It can be seen that the equipment for implementing second aspect image procossing obtains the mesh that the tool is pointed out after identification facility The target image in text is marked, simplifies the manual steps of the target image in processing target text, and then improve use Family experience, meets the needs of users.

Referring to Fig. 8, Fig. 8 is the structural schematic diagram of another image processing equipment provided in an embodiment of the present invention.As schemed Show, the functional module of equipment can implement the present invention program by the combination of hardware, software or hardware and software.A kind of specific In embodiment, equipment can also be realized by the software as described in Fig. 2 embodiment.The those skilled in the art should manage Solution, functional module described below can be combined or are separated into several sub-blocks to implement the present invention program.Therefore, this hair Above-described content can be supported to any possible combination or separation of hereafter functional module or further definition in bright.Below Expansion specifically describes.

Based on same inventive concept, the embodiment of the invention provides the equipment that another is used for image procossing.With reference to figure 8, Fig. 8 be a kind of structural schematic diagram of equipment provided in an embodiment of the present invention.

In the following, specifically introducing the case where equipment is terminal with reference to Fig. 8:

At this point, as shown in figure 8, the equipment 80 includes: camera 801a, processor 802, memory 803 and bus 804.Wherein, camera 801a, processor 802 and memory 803 are communicatively coupled by bus 804.

Memory 803 include but is not limited to be random access memory (English: Random Access Memory, referred to as: RAM), read-only memory (English: Read-Only Memory, referred to as: ROM), Erasable Programmable Read Only Memory EPROM (English: Erasable Programmable Read Only Memory, referred to as: EPROM) or portable read-only memory (English: Compact Disc Read-Only Memory, referred to as: CD-ROM), which (such as deposits for dependent instruction and data Store up picture frame).

Camera 801a obtains a frame or multiple image frame for shooting.

Processor 802 can be one or more central processing units (English: Central Processing Unit, letter Claim: CPU), in the case where processor 802 is a CPU, which can be monokaryon CPU, be also possible to multi-core CPU.

The processor 802 in 80 in the equipment is for reading the program code stored in the memory 803, to implement The function of modules in Fig. 2 embodiment.

In the following, specifically introducing the case where equipment is server with reference to Fig. 8:

As shown in figure 8, the equipment 80 includes: transceiver 801b, processor 802, memory 803 and bus 804.Its In, transceiver 801b, processor 802 and memory 803 are communicatively coupled by bus 804.

Wherein, transceiver 801b is used to obtain picture frame from corresponding terminal, and by the processing result to picture frame It is transferred to corresponding terminal, in order to which corresponding terminal carries out subsequent operation.

Wherein, the description of processor 802, memory 803 is the description in terminal referring to above equipment, no longer superfluous herein It states.

Based on same inventive concept, the embodiment of the invention provides a kind of systems, including equipment and tool, wherein institute Stating equipment can be equipment described in Fig. 1 to Fig. 8 any embodiment, and the tool can be any implementation of Fig. 1 to Figure 13 (b) Tool described in example.

The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity The computer program of subdata exchange, the computer program make computer execute any as recorded in above method embodiment Some or all of method step, above-mentioned computer include electronic equipment.

The embodiment of the present application also provides a kind of computer program product, and above-mentioned computer program product includes storing calculating The non-transient computer readable storage medium of machine program, above-mentioned computer program are operable to that computer is made to execute such as above-mentioned side Some or all of either record method step in method embodiment.The computer program product can be a software installation Packet, above-mentioned computer includes electronic equipment.

It need to be noted that: each technical characteristic of above embodiments can be combined arbitrarily, to make description letter Clean, combination not all possible to each technical characteristic in above-described embodiment is all described, as long as however, these technologies are special Contradiction is not present in the combination of sign, all should be considered as described in this specification.

The embodiments described above only express several embodiments of the present invention, and the description thereof is more specific and detailed, but simultaneously Limitations on the scope of the patent of the present invention therefore cannot be interpreted as.It should be pointed out that for those of ordinary skill in the art For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to guarantor of the invention Protect range.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.

In addition, part same and similar between each embodiment in this specification may refer to each other.Especially for above-mentioned For the embodiment of device and hardware device, since it is substantially similar to the method embodiment, so be described relatively simple, it is related Place is referring to the explanation in embodiment of the method.

Invention described above embodiment is not intended to limit the scope of the present invention..

Claims (36)

1. a kind of equipment for image procossing, which is characterized in that the equipment includes: that image collection module, tool information obtain Modulus block, area determination module and processing module；Wherein,

Described image obtains module, and for obtaining picture frame, every frame picture frame includes text image and tool image；

The tool information obtains module, for obtaining the shape of tool indicated by the tool image according to described image frame State information；Wherein, the status information of the tool is the static nature of the tool or the motion profile of the tool；It is described The static nature of tool is used to indicate that the attribute of the tool, the static nature of the tool to include lines, color, lateral shape Shape, vertical shape, height, two or more the combination in hot spot；

The area determination module determines the target area in the text image for the status information according to the tool；

The processing module is used for the corresponding target image editor in the target area or search inquiry, or, to the target Target character in image carries out identifying/font conversion/language translation/search inquiry.

2. equipment according to claim 1, which is characterized in that in the status information according to the tool, determine institute In terms of stating the target area in text image, the area determination module is specifically used for:

It is described according to the tool in the case where the static nature of the tool includes the combination of transverse shapes and vertical shape Transverse shapes and vertical shape are formed by region, determine the target area in the text image；

It is described according to the tool in the case where the static nature of the tool includes one or more coloured shapes Have region pointed by a kind of shape of particular color or there are many shapes of particular color to be formed by region, determine described in Target area in text image；

It is described according to the tool in the case where the static nature of the tool includes one or more textured shapes Have region pointed by a kind of shape of specific lines or there are many shapes of specific lines to be formed by region, determine described in Target area in text image；

Include hot spot in the static nature of the tool, and the hot spot include in luminous point, light line or light region at least In the case where one, the region that the region according to indicated by the hot spot of the tool or the hot spot are covered is determined Target area in the text image.

3. equipment according to claim 1, which is characterized in that described image frame is multiframe；Described according to described image Frame obtains the status information aspect of tool indicated by the tool image, and the tool information obtains module and is specifically used for:

The tool in every frame picture frame in the determination multiple image frame and the text image in every frame image Demarcate the relative position between position；

The relative position according to determined by every frame picture frame obtains the movement of the relatively described calibration position of the tool Track.

4. equipment according to claim 3, which is characterized in that the motion profile includes straight line, class straight line, non-closed song One of line, closure class curve or multiple combinations.

5. equipment according to claim 4, which is characterized in that in the status information according to the tool, determine institute In terms of stating the target area in text image, the area determination module is specifically used for:

When the motion profile includes straight line perhaps class straight line, the determination is located at the first side of the straight line or class straight line Or the target area of second side；

When the motion profile includes non-closed curve, the determination is located at the first side or second of the non-closed curve The target area of side, alternatively, after the formation closed curve by non-closed curve described in process of fitting treatment, it is described to be closed by described It closes curve and is formed by region, determine the target area in the text image；

It is described that region is formed by by the closed curve when the motion profile includes closure class curve, determine described in Target area in text image, alternatively, after the formation association closed curve by closed curve described in process of fitting treatment, it is described It is formed by region by the related closed curve, determines the target area in the text image.

6. equipment according to claim 1 or 2, which is characterized in that the target area comprises at least one of the following:

Region that is neighbouring with the tool and accommodating single or multiple texts；

Region that is neighbouring with the tool and accommodating uniline or multline text；

And receiving single-row or multiple row text region neighbouring with the tool；

Region neighbouring with the tool and with specific shape, wherein the specific shape includes round, ellipse, side One of shape, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

7. equipment according to claim 1 or 2, which is characterized in that the target area comprises at least one of the following:

The region of the single or multiple texts of receiving on the direction indicated by the static nature of the tool；

The region for accommodating uniline or multline text on the direction indicated by the static nature of the tool；

Single-row or multiple row text the region of receiving on the direction indicated by the static nature of the tool；

The region with specific shape on the direction indicated by the static nature of the tool, wherein the specific shape includes One of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

8. equipment according to claim 1-7, which is characterized in that the equipment application is in equipment, the equipment Include:

Equipment obtains picture frame, and every frame picture frame includes text image and tool image；

The equipment obtains the status information of tool indicated by the tool image according to described image frame；Wherein, the work The status information of tool is the static nature of the tool or the motion profile of the tool；The static nature of the tool is used for Indicate that the attribute of the tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, light Two or more combination in spot；

The equipment determines the target area in the text image according to the status information of the tool；

The equipment is to the corresponding target image editor in the target area or search inquiry, or, in the target image Target character carries out identifying/font conversion/language translation/search inquiry.

9. equipment according to claim 1-7, which is characterized in that the equipment is terminal or server.

10. a kind of method of image procossing, which is characterized in that the described method includes:

Picture frame is obtained, every frame picture frame includes text image and tool image；

According to described image frame, the status information of tool indicated by the tool image is obtained；Wherein, the state of the tool Information is the static nature of the tool or the motion profile of the tool；The static nature of the tool is for indicating described The attribute of tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, two in hot spot Kind or two or more combinations；

According to the status information of the tool, the target area in the text image is determined；

To the corresponding target image editor in the target area or search inquiry, or, to the target character in the target image It carries out identifying/font conversion/language translation/search inquiry.

11. according to the method described in claim 10, it is characterized in that, the status information according to the tool, determines institute State the target area in text image, comprising:

It is described according to the tool in the case where the static nature of the tool includes the combination of transverse shapes and vertical shape Transverse shapes and vertical shape are formed by region, determine the target area in the text image；

It is described according to the tool in the case where the static nature of the tool includes one or more coloured shapes Have region pointed by a kind of shape of particular color or there are many shapes of particular color to be formed by region, determine described in Target area in text image；

It is described according to the tool in the case where the static nature of the tool includes one or more textured shapes Have region pointed by a kind of shape of specific lines or there are many shapes of specific lines to be formed by region, determine described in Target area in text image；

Include hot spot in the static nature of the tool, and the hot spot include in luminous point, light line or light region at least In the case where one, the region that the region according to indicated by the hot spot of the tool or the hot spot are covered is determined Target area in the text image.

12. according to the method described in claim 10, it is characterized in that, described image frame is multiframe；According to described image frame, obtain The status information for obtaining tool indicated by the tool image, specifically includes:

The tool in every frame picture frame in the determination multiple image frame and the text image in every frame image Demarcate the relative position between position；

The relative position according to determined by every frame picture frame obtains the movement of the relatively described calibration position of the tool Track.

13. according to the method for claim 12, which is characterized in that the motion profile includes straight line, class straight line, non-closed One of curve, closure class curve or multiple combinations.

14. according to the method for claim 13, which is characterized in that the status information according to the tool determines institute State the target area in text image, comprising:

When the motion profile includes straight line perhaps class straight line, the determination is located at the first side of the straight line or class straight line Or the target area of second side；

When the motion profile includes non-closed curve, the determination is located at the first side or second of the non-closed curve The target area of side, alternatively, after the formation closed curve by non-closed curve described in process of fitting treatment, it is described to be closed by described It closes curve and is formed by region, determine the target area in the text image；

It is described that region is formed by by the closed curve when the motion profile includes closure class curve, determine described in Target area in text image, alternatively, after the formation association closed curve by closed curve described in process of fitting treatment, it is described It is formed by region by the related closed curve, determines the target area in the text image.

15. method described in 0 or 11 according to claim 1, which is characterized in that the target area comprises at least one of the following:

Region that is neighbouring with the tool and accommodating single or multiple texts；

Region that is neighbouring with the tool and accommodating uniline or multline text；

And receiving single-row or multiple row text region neighbouring with the tool；

Region neighbouring with the tool and with specific shape, wherein the specific shape includes round, ellipse, side One of shape, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

16. method described in 0 or 11 according to claim 1, which is characterized in that the target area comprises at least one of the following:

The region of the single or multiple texts of receiving on the direction indicated by the static nature of the tool；

The region for accommodating uniline or multline text on the direction indicated by the static nature of the tool；

Single-row or multiple row text the region of receiving on the direction indicated by the static nature of the tool；

The region with specific shape on the direction indicated by the static nature of the tool, wherein the specific shape includes One of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

17. the described in any item methods of 0-16 according to claim 1, which is characterized in that the method is applied to terminal, the side Method includes:

Terminal obtains picture frame, and every frame picture frame includes text image and tool image；

The terminal obtains the status information of tool indicated by the tool image according to described image frame；Wherein, the work The status information of tool is the static nature of the tool or the motion profile of the tool；The static nature of the tool is used for Indicate that the attribute of the tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, light Two or more combination in spot；

The terminal determines the target area in the text image according to the status information of the tool；

The terminal is to the corresponding target image editor in the target area or search inquiry, or, in the target image Target character carries out identifying/font conversion/language translation/search inquiry.

18. the described in any item methods of 0-16 according to claim 1, which is characterized in that the method is applied to server, described Method includes:

Server obtains picture frame, and every frame picture frame includes text image and tool image；

The server obtains the status information of tool indicated by the tool image according to described image frame；Wherein, described The status information of tool is the static nature of the tool or the motion profile of the tool；The static nature of the tool is used In the attribute for indicating the tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, Two or more combination in hot spot；

The server determines the target area in the text image according to the status information of the tool；

The server is to the corresponding target image editor in the target area or search inquiry, or, in the target image Target character carry out identifying/font conversion/language translation/search inquiry.

19. the described in any item methods of 0-16 according to claim 1, which is characterized in that the method is applied to system, the system System includes terminal and server, which comprises

System obtains picture frame, and every frame picture frame includes text image and tool image；

The system obtains the status information of tool indicated by the tool image according to described image frame；Wherein, the work The status information of tool is the static nature of the tool or the motion profile of the tool；The static nature of the tool is used for Indicate that the attribute of the tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, light Two or more combination in spot；

The system determines the target area in the text image according to the status information of the tool；

The system is to the corresponding target image editor in the target area or search inquiry, or, in the target image Target character carries out identifying/font conversion/language translation/search inquiry.

20. a kind of equipment for image procossing, which is characterized in that the equipment includes: that image collection module, tool information obtain Modulus block, area determination module, communication module and processing module；Wherein,

Described image obtains module, and for obtaining picture frame, every frame picture frame includes text image and tool image；

The tool information obtains module, for obtaining the shape of tool indicated by the tool image according to described image frame State information；Wherein, the status information of the tool is the static nature of the tool or the motion profile of the tool；It is described The static nature of tool is used to indicate that the attribute of the tool, the static nature of the tool to include lines, color, lateral shape Shape, vertical shape, height, two or more the combination in hot spot；

The area determination module determines the target area in the text image for the status information according to the tool；

The communication module is used for, and the target area in the text image is sent to server, so that the server root Processing result is obtained according to the target area in the text image, the processing result includes to the corresponding mesh in the target area Logo image editor or search inquiry, or, the target character in the target image identify/font conversion/language translation/ The obtained result of search inquiry；

The communication module is also used to, and receives the processing result.

21. equipment according to claim 20, which is characterized in that in the status information according to the tool, determine In terms of target area in the text image, the area determination module is specifically used for:

It is described according to the tool in the case where the static nature of the tool includes the combination of transverse shapes and vertical shape Transverse shapes and vertical shape are formed by region, determine the target area in the text image；

It is described according to the tool in the case where the static nature of the tool includes one or more coloured shapes Have region pointed by a kind of shape of particular color or there are many shapes of particular color to be formed by region, determine described in Target area in text image；

It is described according to the tool in the case where the static nature of the tool includes one or more textured shapes Have region pointed by a kind of shape of specific lines or there are many shapes of specific lines to be formed by region, determine described in Target area in text image；

Include hot spot in the static nature of the tool, and the hot spot include in luminous point, light line or light region at least In the case where one, the region that the region according to indicated by the hot spot of the tool or the hot spot are covered is determined Target area in the text image.

22. equipment according to claim 20, which is characterized in that described image frame is multiframe；Described according to the figure As frame, in terms of the status information for obtaining tool indicated by the tool image, the tool information obtains module and is specifically used for:

The tool in every frame picture frame in the determination multiple image frame and the text image in every frame image Demarcate the relative position between position；

The relative position according to determined by every frame picture frame obtains the movement of the relatively described calibration position of the tool Track.

23. equipment according to claim 22, which is characterized in that the motion profile includes straight line, class straight line, non-closed One of curve, closure class curve or multiple combinations.

24. equipment according to claim 23, which is characterized in that in the status information according to the tool, determine In terms of target area in the text image, the area determination module is specifically used for:

When the motion profile includes straight line perhaps class straight line, the determination is located at the first side of the straight line or class straight line Or the target area of second side；

When the motion profile includes non-closed curve, the determination is located at the first side or second of the non-closed curve The target area of side, alternatively, after the formation closed curve by non-closed curve described in process of fitting treatment, it is described to be closed by described It closes curve and is formed by region, determine the target area in the text image；

It is described that region is formed by by the closed curve when the motion profile includes closure class curve, determine described in Target area in text image, alternatively, after the formation association closed curve by closed curve described in process of fitting treatment, it is described It is formed by region by the related closed curve, determines the target area in the text image.

25. the equipment according to claim 20 or 21, which is characterized in that the target area comprises at least one of the following:

Region that is neighbouring with the tool and accommodating single or multiple texts；

Region that is neighbouring with the tool and accommodating uniline or multline text；

And receiving single-row or multiple row text region neighbouring with the tool；

Region neighbouring with the tool and with specific shape, wherein the specific shape includes round, ellipse, side One of shape, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

26. the equipment according to claim 20 or 21, which is characterized in that the target area comprises at least one of the following:

The region of the single or multiple texts of receiving on the direction indicated by the static nature of the tool；

The region for accommodating uniline or multline text on the direction indicated by the static nature of the tool；

Single-row or multiple row text the region of receiving on the direction indicated by the static nature of the tool；

The region with specific shape on the direction indicated by the static nature of the tool, wherein the specific shape includes One of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

27. a kind of system for image procossing, which is characterized in that the system comprises terminal and servers；Wherein,

The terminal is used for, and obtains picture frame, every frame picture frame includes text image and tool image；

The terminal is also used to, and according to described image frame, obtains the status information of tool indicated by the tool image；Its In, the status information of the tool is the static nature of the tool or the motion profile of the tool；The tool it is quiet State feature is used to indicate the attribute of the tool, and the static nature of the tool includes lines, color, transverse shapes, vertical shape Shape, height, two or more the combination in hot spot；

The terminal is also used to, and according to the status information of the tool, determines the target area in the text image, Yi Jiyong In the target area in the text image is sent to the server；

The server is used for, and obtains processing result according to the target area in the text image, the processing result includes To the corresponding target image editor in the target area or search inquiry, or, being carried out to the target character in the target image Identification/font conversion/language translation/search inquiry is obtained as a result, and described for the processing result to be sent to Terminal；

The terminal is also used to, and receives the processing result.

28. system according to claim 27, which is characterized in that in the terminal according to the status information of the tool, In terms of determining the target area in the text image, the terminal is specifically used for:

In the case where the static nature of the tool includes the combination of transverse shapes and vertical shape, the terminal is according to Tool transverse shapes and vertical shape are formed by region, determine the target area in the text image；

In the case where the static nature of the tool includes one or more coloured shapes, the terminal is according to the work Region pointed by a kind of shape for having particular color of tool is formed by region there are many shape of particular color, determines Target area in the text image；

In the case where the static nature of the tool includes one or more textured shapes, the terminal is according to the work Region pointed by a kind of shape for having specific lines of tool is formed by region there are many shape of specific lines, determines Target area in the text image；

Include hot spot in the static nature of the tool, and the hot spot include in luminous point, light line or light region at least In the case where one, the region that terminal region according to indicated by the hot spot of the tool or the hot spot are covered, Determine the target area in the text image.

29. system according to claim 27, which is characterized in that described image frame is multiframe；Described according to the figure As frame, in terms of the status information for obtaining tool indicated by the tool image, the terminal is specifically used for:

The terminal determines the text diagram in tool and every frame image in every frame picture frame in the multiple image frame Relative position between the calibration position of picture；

Terminal relative position according to determined by every frame picture frame obtains the relatively described calibration position of the tool Motion profile.

30. system according to claim 29, which is characterized in that the motion profile includes straight line, class straight line, non-closed One of curve, closure class curve or multiple combinations.

31. system according to claim 30, which is characterized in that in the terminal according to the status information of the tool, In terms of determining the target area in the text image, the terminal is specifically used for:

When the motion profile includes straight line perhaps class straight line, the terminal, which is determined, is located at the of the straight line or class straight line Side or the target area of second side；

When the motion profile includes non-closed curve, the terminal determine the first side for being located at the non-closed curve or The target area of second side, alternatively, after the terminal forms closed curve by non-closed curve described in process of fitting treatment, the end End is formed by region by the closed curve, determines the target area in the text image；

When the motion profile includes closure class curve, the terminal is formed by region by the closed curve, determines Target area in the text image, alternatively, the terminal forms association closure song by closed curve described in process of fitting treatment After line, the terminal is formed by region by the related closed curve, determines the target area in the text image.

32. the system according to claim 27 or 28, which is characterized in that the target area comprises at least one of the following:

Region that is neighbouring with the tool and accommodating single or multiple texts；

Region that is neighbouring with the tool and accommodating uniline or multline text；

And receiving single-row or multiple row text region neighbouring with the tool；

Region neighbouring with the tool and with specific shape, wherein the specific shape includes round, ellipse, side One of shape, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

33. the system according to claim 27 or 28, which is characterized in that the target area comprises at least one of the following:

The region of the single or multiple texts of receiving on the direction indicated by the static nature of the tool；

The region for accommodating uniline or multline text on the direction indicated by the static nature of the tool；

Single-row or multiple row text the region of receiving on the direction indicated by the static nature of the tool；

The region with specific shape on the direction indicated by the static nature of the tool, wherein the specific shape includes One of round, oval, rectangular, rectangle, trapezoidal, diamond shape, polygon or multiple combinations.

34. a kind of tool for image procossing, which is characterized in that the tool is used to indicate the mesh of the text in actual environment Mark region；When near the text that the tool is located in the actual environment, equipment or system are triggered according to the tool Indicated target area handles the target image in the text.

35. tool according to claim 34, which is characterized in that the tool is specifically used for:

The target area of the text in actual environment is indicated by the static nature or motion profile of the tool；

When near the text that the tool is located in the actual environment, the static nature according to the tool or movement are triggered Target area indicated by track handles the target image in the text；The static nature of the tool is for indicating the work The attribute of tool, the static nature of the tool include lines, color, transverse shapes, vertical shape, height, two kinds in hot spot Or two or more combination.

36. tool according to claim 35, which is characterized in that the static nature of the tool include transverse shapes with In the case where the combination of vertical shape, the tool is described according to the tool transverse shapes and vertical shape institute shape for triggering At region, determine the target area in the text image；

In the case where the static nature of the tool includes one or more coloured shapes, the tool is for triggering institute State the region according to pointed by a kind of shape for having particular color of the tool or the shape institute shape there are many particular color At region, determine the target area in the text image；

In the case where the static nature of the tool includes one or more textured shapes, the tool is for triggering institute State the region according to pointed by a kind of shape for having specific lines of the tool or the shape institute shape there are many specific lines At region, determine the target area in the text image；

Include hot spot in the static nature of the tool, and the hot spot include in luminous point, light line or light region at least In the case where one, the tool is for triggering the region according to indicated by the hot spot of the tool or hot spot institute The region of covering determines the target area in the text image.