CN110059207A - Processing method, device, storage medium and the electronic equipment of image information - Google Patents
Processing method, device, storage medium and the electronic equipment of image information Download PDFInfo
- Publication number
- CN110059207A CN110059207A CN201910272638.3A CN201910272638A CN110059207A CN 110059207 A CN110059207 A CN 110059207A CN 201910272638 A CN201910272638 A CN 201910272638A CN 110059207 A CN110059207 A CN 110059207A
- Authority
- CN
- China
- Prior art keywords
- image
- information
- voice messaging
- current display
- display interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Finance (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the present application discloses processing method, device, storage medium and the electronic equipment of a kind of image information, wherein for the embodiment of the present application by obtaining voice messaging, semantic according to voice messaging generates screenshot instruction；According to the image of screenshot command interception current display interface to obtain target image；The characteristic parameter for extracting target image determines the corresponding displaying information of target image according to characteristic parameter；It will show that information is shown to current display interface.Displaying information relevant to the image of current display interface is shown directly in current display interface by obtaining voice messaging with this, it is swift to operate, improve the treatment effeciency of image information.
Description
Technical field
This application involves field of information processing more particularly to a kind of processing method of image information, device, storage medium and
Electronic equipment.
Background technique
With the development of electronic technology, shopping at network has become a kind of novel shopping way of hot topic, since network is purchased
The convenience of the diversity of commodity and shopping at network in object, shopping at network have become the selection of more and more users, Yong Huke
To search relevant merchandise news in the server of shopping at network by the keyword of commodity or the image of commodity, thus
Quickly buy suitable commodity.
But it when getting relevant merchandise news by commodity image during shopping at network at present, generally requires
First Manual interception downloads the commodity image from network, then uploads interface by relevant image and uploads the commodity image
Background server to shopping at network scans for, and can just obtain relevant merchandise news, and operating process is cumbersome, leads to processing
Low efficiency.
Summary of the invention
The embodiment of the present application provides processing method, device, storage medium and the electronic equipment of a kind of image information, can be with
The step of merchandise news is searched by image is reduced, to improve the treatment effeciency of image information.
In a first aspect, the embodiment of the present application provides a kind of processing method of image information, comprising:
Voice messaging is obtained, semantic according to the voice messaging generates screenshot instruction；
According to the image of screenshot command interception current display interface to obtain target image；
The characteristic parameter for extracting the target image determines that the target image is corresponding according to the characteristic parameter
Show information；
The displaying information is shown to the current display interface.
Second aspect, the embodiment of the present application provide a kind of processing unit of image information, comprising:
Module is obtained, for obtaining voice messaging, semantic according to the voice messaging generates screenshot instruction；
Interception module, for according to the image of screenshot command interception current display interface to obtain target image；
Determining module is determined described for extracting the characteristic parameter of the target image according to the characteristic parameter
The corresponding displaying information of target image；
Display module, for showing the displaying information to the current display interface.
The third aspect, storage medium provided by the embodiments of the present application, is stored thereon with computer program, when the computer
When program is run on computers, so that the computer is executed such as the described image information that the application any embodiment provides
Processing method.
Fourth aspect, electronic equipment provided by the embodiments of the present application, including processor and memory, the memory have meter
Calculation machine program, the processor is by calling the computer program, for executing the institute provided such as the application any embodiment
State the processing method of image information.
For the embodiment of the present application by obtaining voice messaging, semantic according to the voice messaging generates screenshot instruction；According to
The image of screenshot command interception current display interface is to obtain target image；Extract the characteristic parameter of the target image, root
The corresponding displaying information of the target image is determined according to the characteristic parameter；The displaying information is shown to described current aobvious
Show on interface.It is directly shown in current display interface with this by voice messaging and shows information, it is swift to operate, improve image
The treatment effeciency of information.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the flow diagram of the processing method of image information provided by the embodiments of the present application.
Fig. 2 is another flow diagram of the processing method of image information provided by the embodiments of the present application.
Fig. 3 is the application scenarios schematic diagram of the processing method of image information provided by the embodiments of the present application.
Fig. 4 is the another application schematic diagram of a scenario of the processing method of image information provided by the embodiments of the present application.
Fig. 5 is the module diagram of the processing unit of image information provided by the embodiments of the present application.
Fig. 6 is another module diagram of the processing unit of image information provided by the embodiments of the present application.
Fig. 7 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Fig. 8 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Specific embodiment
Schema is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one
It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by
It is considered as limitation the application other specific embodiments not detailed herein.
Term as used herein " module " can regard the software object to execute in the arithmetic system as.It is somebody's turn to do herein not
Same component, module, engine and service can be regarded as the objective for implementation in the arithmetic system.And the device and method being somebody's turn to do herein is excellent
Being implemented in the form of software for choosing, can also be implemented on hardware, certainly within the application protection scope.
The embodiment of the present application provides a kind of processing method of image information, the executing subject of the processing method of the image information
It can be the processing unit of image information provided by the embodiments of the present application, or be integrated with the electricity of the processing unit of the image information
Sub- equipment, wherein the processing unit of the image information can be realized by the way of hardware or software.Wherein, electronic equipment can
To be smart phone, tablet computer, palm PC (PDA, Personal Digital Assistant) etc..
Referring to Fig. 1, Fig. 1 is the flow diagram of the processing method of image information provided by the embodiment of the present application, it should
The processing method of image information may comprise steps of:
In step s101, voice messaging is obtained, semantic according to voice messaging generates screenshot instruction.
Wherein, the voice messaging of user is obtained, and the semanteme of the voice messaging is analyzed, when the language of the voice messaging
When justice meets preset condition, screenshot instruction is generated.For example, the voice messaging of user's input be " this thing how much " or
" how expensive this is ", electronic equipment are analyzed the semanteme of the voice messaging to obtain the language that the voice messaging is inquiry purchase
Justice, when the semanteme of the voice messaging meets preset condition at this time, semantic according to the voice messaging generates screenshot instruction.
In some embodiments, voice messaging is obtained, semantic according to the voice messaging generates the step of screenshot instructs,
May include:
(1) start voice assistant, obtain voice messaging, and analyze the semanteme of voice messaging；
(2) when in the semanteme for analyzing the voice messaging including predetermined keyword, screenshot instruction is generated.
Wherein, when receiving the enabled instruction of voice assistant, start voice assistant, receive user's by voice assistant
Voice messaging, " this thing how much " voice messaging as user inputs be, is analyzed the semanteme of above-mentioned voice messaging
To obtain above-mentioned voice messaging as purchase, the relevant semanteme of price, when including default close in the semanteme for analyze the voice messaging
Keyword for example money, price, how much, it is how expensive, when the associative keys such as buying, sell, generate screenshot instruction.
In step s 102, according to the image of screenshot command interception current display interface to obtain target image.
Wherein, the image of current display interface can be intercepted, directly according to screenshot instruction to obtain comprising current entire screen
The target image of curtain display content, or user is received to the touching instruction of screen, according to touching instruction after generating screenshot instruction
The target area of current display interface is chosen, and intercepts the display content of target area in current display interface to obtain target figure
Picture.Further, the format of target image can be joint photo expert group (Joint Photographic Expert
Group, JPEG) or drawing swap file (Drawing Exchange Format, DXF) etc. format.
In some embodiments, according to the image of screenshot command interception current display interface to obtain the step of target image
It suddenly, later can also include: the target image to be shown in current display interface, and default behaviour can be carried out to target image
Make, such as share the target image, preservation or delete the target image etc., it should be noted that after obtaining the target image
The target image, which can be, to be stored in the terminal in a manner of caching, after user selects to delete the target image, the target
Image is deleted the processing step for no longer carrying out subsequent image information.
In step s 103, the characteristic parameter for extracting target image determines that target image is corresponding according to characteristic parameter
Displaying information.
Wherein it is possible to extract mesh using convolutional neural networks (Convolutional Neural Networks, CNN)
The global characteristics and local feature of logo image, and determine according to global characteristics and local feature the displaying information of target image.
Further, global characteristics refer to that the integrity attribute of image, common global characteristics include color characteristic, textural characteristics and shape
Feature.Local feature is then the feature extracted from image local area, including edge, angle point, line, curve and special attribute
Region etc..Common local feature includes angle point class and region class two major classes describing mode.For example, target image is with special
The white clothes of black decorative pattern may search for out the white clothing with various black decorative pattern according to the global characteristics of the target image
Image is taken, the black decorative pattern in the image searched at this time is not the accurate special black decorative pattern in target image, according only to
Global characteristics, which carry out picture search, will lead to search result inaccuracy, but characteristic parameter is combined local feature, that is, combine
After the linear feature of special black decorative pattern, the image of the white clothes with special black decorative pattern just can accurately be matched,
To improve the accuracy rate of the search of image.
Further, which can be corresponding merchandise news of target image either object detail information etc.
Deng, in conjunction with local feature and global characteristics found out on network the corresponding merchandise news of corresponding object or object details letter
Breath is as displaying information.
In step S104, it will show that information is shown to current display interface.
Wherein it is possible to will show that information and target image are shown together to the current display interface, for example, can incite somebody to action
It shows that information is covered to being shown on target image, or will show that information and target image are shown according to a certain percentage respectively
To the different display areas of current display interface.
In some embodiments, it will show that information shows the step to the current display interface, may include:
(1) target image is reduced by preset ratio, the target image after diminution is shown to current display interface
First display area；
(2) the displaying information is shown to the second display area of the current display interface.
Wherein, target image can specifically be reduced by preset ratio, for example, be contracted to original image two/
One, or the diminution of target image is adaptively carried out according to the area of the first display area, so that complete target image is shown
First for showing in the first display area of current display interface, and the target image after diminution being shown to current display interface shows
Show region.Meanwhile the relevant displaying information such as corresponding merchandise news of target image that will acquire either object detail information
It shows to the second display area of current display interface.
From the foregoing, it will be observed that the processing method of image information provided by the embodiments of the present application, by obtaining voice messaging, according to this
The semantic of voice messaging generates screenshot instruction；According to the image of screenshot command interception current display interface to obtain target image；
The characteristic parameter for extracting the target image determines the corresponding displaying information of the target image according to this feature parameter；It should
Show that information is shown to the current display interface.With this by obtain voice messaging show directly in current display interface and
The relevant displaying information of the image of current display interface, it is swift to operate, to improve the treatment effeciency of image information.
Citing is further described below for the method according to described in above-described embodiment.
Referring to Fig. 2, Fig. 2 is another flow diagram of the processing method of image information provided by the embodiments of the present application.
And please referring collectively to the application scenarios signal that Fig. 3 and Fig. 4, Fig. 3 are the processing method of image information provided by the embodiments of the present application
Figure, Fig. 4 are the another application schematic diagram of a scenario of the processing method of image information provided by the embodiments of the present application.Specifically, should
The processing method of image information includes:
In step s 201, start voice assistant, obtain voice messaging, and analyze the semanteme of voice messaging.
Wherein, as shown in the first display content 1 of current display interface in Fig. 3, user is browsing phase by mobile terminal
It, can be with when the case where browsing to a certain picture and wonder the merchandise news of object in the pictorial information when closing pictorial information
Voice assistant 10 is directly initiated, relevant merchandise news is obtained by voice assistant 10, such as user wonders current display circle
When the merchandise news of the mug in the first display content 1 in face, voice assistant 10 can be directly initiated, and say " this cup
Son how much " etc. related voices information, voice assistant the image of the mug can be scanned for obtain relevant commodity
Information.
Specifically, starting voice assistant 10, the language when voice assistant 10 is when receiving the enabled instruction of voice assistant 10
Sound assistant 10 is shown with preset icon in current display interface or the voice assistant 10 can not also be shown in running background
Show to current display interface, the voice messaging of user's input is obtained by the voice assistant 10, and analyzes the language of the voice messaging
Justice.For example, " this how much " voice messaging of user's input be, semanteme and the purchase, valence of the voice messaging can analyze out
Lattice are related.Wherein, the generating mode of the enabled instruction of language assists 10 may include long-pressing function key, long-pressing screen or reception
Voice assistant enabled instruction is generated when to default starting voice.
In step S202, when in the semanteme for analyzing voice messaging including predetermined keyword, screenshot instruction is generated.
Wherein, it when analyzing the semanteme in voice messaging includes predetermined keyword relevant to purchase and price, generates
Screenshot instruction.The predetermined keyword can for it is how expensive, how much, the keywords such as buy, sell.For example, the voice messaging of user's input
For " this thing how much ", can analyze out in the semanteme of the voice messaging includes predetermined keyword " how much ", is sentenced at this time
Being set to includes predetermined keyword in the semanteme of the voice messaging, therefore screenshot instruction can be generated according to voice messaging.
In step S203, according to the image of screenshot command interception current display interface to obtain screenshot image.
Wherein, the image of current display interface can be intercepted, directly according to screenshot instruction to obtain comprising current entire screen
The screenshot image of curtain display content, or user is received to the touching instruction of screen, according to touching instruction after generating screenshot instruction
The target area of current display interface is chosen, and intercepts the display content of target area in current display interface to obtain screenshot figure
Picture.Further, the format of screenshot image can be joint photo expert group or drawing swap file etc. format.At this point,
When executing according to the image of screenshot command interception current display interface to obtain the process of screenshot image, current display interface
Display content becomes the second display content 2 of current display interface as shown in Figure 3, i.e. the display content of current display interface is
The screenshot image.
In some embodiments, according to the image of screenshot command interception current display interface to obtain the step of screenshot image
Suddenly, later further include: the selected instruction for receiving user determines target image according to selected instruction, and directly executes step
S208.Instruction is selected to the frame of screenshot image for example, obtaining user, is determined according to the location information of marquee corresponding to the instruction
Target image out.
In some embodiments, according to the image of screenshot command interception current display interface to obtain the step of screenshot image
Suddenly, further includes: when screenshot failure, automatically generate screenshot instruction again after preset time, and cut again according to screenshot instruction
The image of current display interface is taken to obtain screenshot image.Further, the number of record screenshot failure, when time of screenshot failure
When number is greater than preset value, the step of voice assistant terminates the Image Information Processing is closed.For example, when screenshot failure, after 1 second
Screenshot instruction is automatically generated, the image of current display interface is intercepted again to obtain screenshot image according to screenshot instruction.In addition
After the number of screenshot failure is greater than 5 times, terminates screenshot and close voice assistant to terminate the processing step of the image information.
In step S204, image segmentation is carried out to screenshot image, generates multiple sub- segmented images.
Wherein it is possible to carry out object detection to the screenshot image, this is determined according to the corresponding characteristic parameter of different objects
One or more objects in screenshot image, and corresponding object frame is generated, image is carried out to screenshot image according to the object frame
Segmentation generates multiple sub- segmented images containing different objects.
In step S205, object detection is carried out to multiple sub- segmented images, it is corresponding with each sub- segmented image of determination
Object information.
Wherein, object detection is carried out to multiple sub- segmented images, extracts each sub- segmentation figure by convolutional neural networks
The characteristic parameter of picture determines the object information of each sub- segmented image according to characteristic parameter.
In step S206, when including object information in the semanteme for detect voice messaging, according to object information from multiple
Corresponding Target Segmentation image is determined in sub- segmented image.
Wherein, when carrying out semantic analysis to voice messaging, when in the semanteme for detecting voice messaging including object information,
Target Segmentation image is then determined from above-mentioned multiple sub- segmented images according to object information.For example, the voice messaging obtained is
" this cup how much ", can detecte includes " cup " this object information in the semanteme of the voice messaging, at this time can be with
Determine that cup is the information on target object of screenshot image, obtaining the sub- segmented image that object information in sub- segmented image is cup is
Target Segmentation image.
In step S207, using Target Segmentation image as target image.
Wherein, using the determining Target Segmentation image for containing information on target object as target image, to save processing
Time.
In step S208, the characteristic parameter of target image is extracted, determines that target image is corresponding according to characteristic parameter
Displaying information.
Wherein, in order to better illustrate the application, which is illustrated by taking merchandise news as an example, extracts target
The global characteristics and local feature of image, and determine according to global characteristics and local feature the displaying information of target image.Example
Such as, the color characteristic, related relief features and cup-shape feature of the mug target image are extracted as global characteristics, is mentioned
It takes out decorative pattern lines in mug and moves towards feature and lines intersection feature as local feature, and according to color characteristic, phase
It closes relief features, cup-shape feature, decorative pattern lines and moves towards feature and lines intersection feature from network server end search
Determine that corresponding one or more moves towards feature to the color characteristic, related relief features, cup-shape feature, decorative pattern lines
And the similar merchandise news of lines intersection feature, specifically, the merchandise news search when such as Fig. 4 in current display interface
Third show the shown of content 3, need to carry out the information load of short time, and after target image is reduced at this time with preset ratio
It shows to the first display area 20 of current display interface.
In some embodiments, after the step of determining target image corresponding displaying information according to characteristic parameter,
Further include: when that can not determine to show information accordingly according to characteristic parameter, prompting message is generated by voice assistant；Working as
Preceding display interface generates selected frame accordingly, receives the adjustment that user selectes frame to this, selectes frame to obtain target；Obtain target
The location information of selected frame, redefines target image according to the location information, and return to step S208 to regenerate
Show information.
In step S209, target image is reduced by preset ratio, the target image after diminution is shown to current aobvious
Show first display area at interface.
It wherein,, can after step S207 determines target image as shown in the third display content 3 of Fig. 4 current display interface
To reduce target image by preset ratio, and the target image after diminution is shown to the first viewing area of current display interface
Domain 20 shows the target image after diminution to current aobvious for example, target image to be contracted to the one third of original image size
Show first display area 20 at interface.
In step S210, according to the purchaser record information of user, the evaluation information of commodity, commodity price information or commodity
Sales volume information is ranked up processing to displaying information.
Wherein, as in Fig. 4 current display interface the 4th display content 4 shown in, by corresponding sort algorithm according to
Purchaser record, information on commodity comment or the Sales Volume of Commodity information at family are ranked up processing to merchandise news, for example, according to user's
The commodity that user bought preferentially are come the forefront of merchandise news by purchaser record, or according to evaluation information, high by evaluating
Commodity come the forefront of merchandise news, or the high commodity of sales volume are preferentially drained into the forefront of the merchandise news.
In some embodiments, the pricing information of commodity, the merchant site information of commodity or preferential letter be can be combined with
Breath is ranked up merchandise news, for example, the forefront that the merchandise news will be come apart from the commodity of nearest businessman, or will be by
Low-cost merchandise news is come to the forefront of the merchandise news according to commodity price, or the maximum commodity of preferential dynamics are believed
Breath preferentially comes the forefront of the merchandise news.
In step S211, the merchandise news after sequence is shown to the second display area of current display interface.
Wherein, as in Fig. 4 current display interface the 4th display content 4 shown in, by a plurality of merchandise news after sequence according to
Secondary the second display area 30 for being shown in current display interface, specifically, the content of the merchandise news of display may include commodity
Image, commodity price, product name or sales volume etc..Further, user can be by clicking the second of current display interface
The merchandise news of display area 30 gets the purchase information of the commodity, to complete the purchase of the commodity.
In some embodiments, the merchandise news after sequence is shown to the second display area of current display interface
After step, further includes: receive user to the sliding action of screen, to generate information slip instruction, referred to according to information sliding
The second display area of control current display interface is enabled to show different merchandise news.For example, when user is in the second display area
When finger upward sliding, the merchandise news that second display area is shown at this time is updated to new merchandise news, so as to user's
To the access of new merchandise news.
From the foregoing, it will be observed that the processing method of image information provided by the embodiments of the present application, by obtaining voice messaging, according to this
The semantic of voice messaging generates screenshot instruction；According to the image of screenshot command interception current display interface to obtain target image；
The characteristic parameter for extracting the target image determines the corresponding displaying information of the target image according to this feature parameter；It should
Show that information is shown to the current display interface.With this by obtain voice messaging show directly in current display interface and
The relevant displaying information of the image of current display interface, it is swift to operate, improve the treatment effeciency of image information.
For the processing method convenient for better implementation image information provided by the embodiments of the present application, the embodiment of the present application is also mentioned
For a kind of device of processing method based on above-mentioned image information.The wherein processing method of the meaning of noun and above-mentioned image information
In it is identical, specific implementation details can be with reference to the explanation in embodiment of the method.
Referring to Fig. 5, Fig. 5 is the module diagram of the processing unit of image information provided by the embodiments of the present application.Specifically
For, the processing unit 300 of the image information, comprising: obtain module 31, interception module 32, determining module 33 and display module
34。
Module 31 is obtained, for obtaining voice messaging, semantic according to the voice messaging generates screenshot instruction.
Wherein, module 31 is obtained by obtaining the voice messaging of user, and the semanteme of the voice messaging is analyzed, when
When the semanteme of the voice messaging meets preset condition, screenshot instruction is generated.For example, the voice messaging of user's input is " this east
West how much " or " how expensive this is ", electronic equipment the semanteme of the voice messaging is analyzed to obtain the voice messaging and be
It inquires the semanteme of purchase, screenshot instruction is generated according to the semantic of the voice messaging at this time.
Interception module 32, for according to the image of screenshot command interception current display interface to obtain target image.
Wherein, interception module 32 can directly intercept the image of current display interface according to screenshot instruction, to be included
The target image of current entire screen display content；Or touching instruction of the user to screen, root are received after generating screenshot instruction
According to touching instruction choose current display interface target area, and intercept the display content of target area in current display interface with
Obtain target image.Further, the format of target image can be joint photo expert group or drawing swap file etc.
Format.
Determining module 33 determines the target according to this feature parameter for extracting the characteristic parameter of the target image
The corresponding displaying information of image.
Wherein it is determined that module 33 can use global characteristics and the part spy that convolutional neural networks extract target image
It levies, and determines the displaying information of target image according to global characteristics and local feature.Further, global characteristics refer to image
Integrity attribute, common global characteristics include color characteristic, textural characteristics and shape feature.Local feature is then from image office
The feature extracted in portion region, including edge, angle point, line, curve and region of special attribute etc..Common local feature includes
Angle point class and region class two major classes describing mode.
For example, target image is the white clothes with special black decorative pattern, it can according to the global characteristics of the target image
To search out the white clothes image for having various black decorative pattern, the black decorative pattern in the image searched at this time is not accurately
Special black decorative pattern in target image, carrying out picture search according only to global characteristics will lead to search result inaccuracy, still
Characteristic parameter is combined into local feature, that is, after the linear feature for combining special black decorative pattern, just can accurately match band
There is the image of the white clothes of special black decorative pattern, to improve the accuracy rate of the search of image.
Display module 34, for showing the displaying information to the current display interface.
Wherein, display module 34 can be used for show that information and target image are shown together to the current display interface
On.
In some embodiments, referring to Fig. 6, Fig. 6 is the processing unit of image information provided by the embodiments of the present application
Another module diagram.The acquisition module 31 of the processing unit 300 of the image information, comprising: acquisition submodule 311 and analysis
Submodule 312.
Acquisition submodule 311 obtains voice messaging, and analyze the semanteme of the voice messaging for starting voice assistant.
Wherein, acquisition submodule 311 is used for when receiving the enabled instruction of voice assistant, starts voice assistant, pre-
If obtaining the voice messaging of user in the time, and the semanteme of the voice messaging is analyzed, for example, when the starting for receiving voice assistant
When voice, start voice assistant, voice messaging in the 30 seconds time after obtaining starting voice assistant, and analyze the voice messaging
Semanteme.
Submodule 312 is analyzed, for generating screenshot when in the semanteme for analyzing the voice messaging including predetermined keyword
Instruction.
Wherein, analysis submodule 312 is used to generate when in the semanteme for analyzing the voice messaging including predetermined keyword
Screenshot instruction.Such as the voice messaging is " price of this thing ", when including default in the semanteme for analyze the voice messaging
Keyword " price " generates screenshot instruction according to the semantic of voice messaging at this time.
In some embodiments, which is specifically used for the figure according to screenshot command interception current display interface
As to obtain screenshot image；Image segmentation is carried out to screenshot image, generates multiple sub- segmented images, and determine the sub- segmentation figure
Target Segmentation image as in；Using the Target Segmentation image as target image.
In some embodiments, which is specifically used for carrying out object detection to multiple sub- segmented image,
With each sub- corresponding object information of segmented image of determination；When in the semanteme for detect the voice messaging include the object information
When, corresponding Target Segmentation image is determined from multiple sub- segmented image according to the object information.
In some embodiments, which is specifically used for reducing the target image by preset ratio, will contract
Target image after small is shown to the first display area of the current display interface；The displaying information is shown to the current display
Second display area at interface.
In some embodiments, when showing the displaying information to the second display area of the current display interface,
The display module 33 is also used to according to the purchaser record information of user, the evaluation information of commodity, commodity price information or commodity pin
Amount information is ranked up processing to the merchandise news；Second that merchandise news after sequence is shown to the current display interface shows
Show region.
From the foregoing, it will be observed that the processing unit of image information provided by the embodiments of the present application, obtains module 31 by obtaining voice
Information, semantic according to the voice messaging generate screenshot instruction；Interception module 32 is according to screenshot command interception current display interface
Image to obtain target image；Determining module 33 extracts the characteristic parameter of the target image, is determined according to this feature parameter
The corresponding displaying information of the target image out；Display module 34 shows the displaying information to the current display interface.With this
Displaying information relevant to the image of current display interface is shown directly in current display interface by obtaining voice messaging, is grasped
Make fast, to improve the treatment effeciency of image information.
Citing is further described below for the processing method of the image information according to described by above-described embodiment.
The embodiment of the present application also provides a kind of electronic equipment.Referring to Fig. 7, electronic equipment 500 include processor 501 and
Memory 502.Wherein, processor 501 and memory 502 are electrically connected.
The processor 500 is the control centre of electronic equipment 500, utilizes various interfaces and the entire electronic equipment of connection
Various pieces, the computer program in memory 502 by operation or load store, and call and be stored in memory
Data in 502 execute the various functions of electronic equipment 500 and handle data, to carry out whole prison to electronic equipment 500
Control.
The memory 502 can be used for storing software program and module, and processor 501 is stored in memory by operation
502 computer program and module, thereby executing various function application and data processing.Memory 502 can mainly include
Storing program area and storage data area, wherein storing program area can computer needed for storage program area, at least one function
Program (such as sound-playing function, image player function etc.) etc.；Storage data area, which can be stored, uses institute according to electronic equipment
The data etc. of creation.In addition, memory 502 may include high-speed random access memory, it can also include non-volatile memories
Device, for example, at least a disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memory
502 can also include Memory Controller, to provide access of the processor 501 to memory 502.
In the embodiment of the present application, the processor 501 in electronic equipment 500 can be according to following step, by one or one
The corresponding instruction of the process of a above computer program is loaded into memory 502, and is stored in by the operation of processor 501
Computer program in reservoir 502, thus realize various functions, it is as follows: voice messaging to be obtained, according to the semanteme of the voice messaging
Generate screenshot instruction；
According to the image of screenshot command interception current display interface to obtain target image；
The characteristic parameter for extracting the target image determines that the corresponding displaying of the target image is believed according to this feature parameter
Breath；
The displaying information is shown to the current display interface.
In some embodiments, when obtaining voice messaging, when according to the semantic generation screenshot instruction of the voice messaging, locate
Reason device 501 can specifically execute following steps:
Start voice assistant, obtains voice messaging, and analyze the semanteme of the voice messaging；
When in the semanteme for analyzing the voice messaging including predetermined keyword, screenshot instruction is generated.
In some embodiments, when according to the image of screenshot command interception current display interface to obtain target image
When, processor 501 can specifically execute following steps:
According to the image of screenshot command interception current display interface to obtain screenshot image；
Image segmentation is carried out to screenshot image, generates multiple sub- segmented images, and determine the mesh in the sub- segmented image
Mark segmented image；
Using the Target Segmentation image as target image.
In some embodiments, when determining the Target Segmentation image in the sub- segmented image, processor 501 can be with
It is specific to execute following steps:
Object detection is carried out to multiple sub- segmented image, with each sub- corresponding object information of segmented image of determination；
When in the semanteme for detecting the voice messaging including the object information, divided according to the object information from multiple son
It cuts and determines corresponding Target Segmentation image in image.
In some embodiments, when showing the displaying information to the current display interface, processor 501 can be with
It is specific to execute following steps:
The target image is reduced by preset ratio, the target image after diminution is shown to the of the current display interface
One display area；
The displaying information is shown to the second display area of the current display interface.
In some embodiments, when showing that information includes merchandise news, this shows the displaying information current aobvious to this
When showing second display area at interface, processor 501 can specifically execute following steps:
According to the purchaser record information of user, the evaluation information of commodity, commodity price information or Sales Volume of Commodity information to this
Show that information is ranked up processing；
Merchandise news after sequence is shown to the second display area of the current display interface.
From the foregoing, it will be observed that electronic equipment provided by the embodiments of the present application, by obtaining voice messaging, according to the language of voice messaging
Justice generates screenshot instruction；According to the image of screenshot command interception current display interface to obtain target image；Extract target figure
The characteristic parameter of picture determines the corresponding displaying information of target image according to characteristic parameter；It will show that information is shown to current aobvious
Show on interface.With this by obtain voice messaging shown directly in current display interface it is related to the image of current display interface
Displaying information, it is swift to operate, improve the treatment effeciency of image information.
Also referring to Fig. 8, in some embodiments, electronic equipment 500 can also include: display 503, radio frequency electrical
Road 504, voicefrequency circuit 505 and power supply 506.Wherein, wherein display 503, radio circuit 504, voicefrequency circuit 505 and
Power supply 506 is electrically connected with processor 501 respectively.
The display 503 be displayed for information input by user or be supplied to user information and various figures
User interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof.Display
503 may include display panel, in some embodiments, can use liquid crystal display (Liquid Crystal
Display, LCD) or the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) match
Set display panel.
The radio circuit 504 can be used for transceiving radio frequency signal, with by wireless communication with the network equipment or other electronics
Equipment establishes wireless telecommunications, the receiving and transmitting signal between the network equipment or other electronic equipments.
The voicefrequency circuit 505 can be used for providing the audio between user and electronic equipment by loudspeaker, microphone and connecing
Mouthful.
The power supply 506 is used to all parts power supply of electronic equipment 500.In some embodiments, power supply 506 can
With logically contiguous by power-supply management system and processor 501, thus charged, discharged by power-supply management system realization management,
And the functions such as power managed.
Although being not shown in Fig. 8, electronic equipment 500 can also include camera, bluetooth module etc., and details are not described herein.
The embodiment of the present application also provides a kind of storage medium, which is stored with computer program, when the computer
When program is run on computers, so that the computer executes the processing method of the image information in any of the above-described embodiment, than
Such as: obtaining voice messaging, semantic according to the voice messaging generates screenshot instruction；According to screenshot command interception current display interface
Image to obtain target image；The characteristic parameter for extracting the target image determines the target figure according to this feature parameter
As corresponding displaying information；The displaying information is shown to the current display interface.
In the embodiment of the present application, storage medium can be magnetic disk, CD, read-only memory (Read Only Memory,
ROM) or random access memory (Random Access Memory, RAM) etc..
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, reference can be made to the related descriptions of other embodiments.
It should be noted that for the processing method of the image information of the embodiment of the present application, this field common test people
Member is understood that realize all or part of the process of the processing method of the image information of the embodiment of the present application, is that can pass through calculating
Machine program is completed to control relevant hardware, which can be stored in a computer-readable storage medium, such as
It is stored in the memory of electronic equipment, and is executed by least one processor in the electronic equipment, in the process of implementation may be used
The process of the embodiment of processing method including such as image information.Wherein, the storage medium being somebody's turn to do can for magnetic disk, CD, read-only deposit
Reservoir, random access memory etc..
For the processing unit of the image information of the embodiment of the present application, each functional module can integrate to be handled at one
In chip, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module.
Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.The collection
If at module realized in the form of software function module and when sold or used as an independent product, also can store
In one computer-readable storage medium, which is for example read-only memory, disk or CD etc..
Above to a kind of processing method of image information, device, storage medium and electronics provided by the embodiment of the present application
Equipment is described in detail, and specific examples are used herein to illustrate the principle and implementation manner of the present application, with
The explanation of upper embodiment is merely used to help understand the present processes and its core concept；Meanwhile for the technology of this field
Personnel, according to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion this theory
Bright book content should not be construed as the limitation to the application.
Claims (10)
1. a kind of processing method of image information characterized by comprising
Voice messaging is obtained, semantic according to the voice messaging generates screenshot instruction；
According to the image of screenshot command interception current display interface to obtain target image；
The characteristic parameter for extracting the target image determines the corresponding displaying of the target image according to the characteristic parameter
Information；
The displaying information is shown to the current display interface.
2. the method according to claim 1, wherein the acquisition voice messaging, according to the voice messaging
Semanteme generates the step of screenshot instruction, comprising:
Start voice assistant, obtains voice messaging, and analyze the semanteme of the voice messaging；
When in the semanteme for analyzing the voice messaging including predetermined keyword, screenshot instruction is generated.
3. method according to claim 1 or 2, which is characterized in that described according to screenshot command interception current display interface
Image to obtain target image the step of, comprising:
According to the image of screenshot command interception current display interface to obtain screenshot image；
Image segmentation is carried out to screenshot image, generates multiple sub- segmented images, and determine the target in the sub- segmented image
Segmented image；
Using the Target Segmentation image as target image.
4. according to the method described in claim 3, it is characterized in that, the Target Segmentation determined in the sub- segmented image
The step of image, comprising:
Object detection is carried out to the multiple sub- segmented image, with each sub- corresponding object information of segmented image of determination；
When in the semanteme for detecting the voice messaging including the object information, according to the object information from the multiple
Corresponding Target Segmentation image is determined in sub- segmented image.
5. the method according to claim 1, wherein described show the displaying information to the current display
Step on interface, comprising:
The target image is reduced by preset ratio, the target image after diminution is shown to the of the current display interface
One display area；
The displaying information is shown to the second display area of the current display interface.
6. according to the method described in claim 5, it is characterized in that, the displaying information includes merchandise news, it is described will be described
Show the step of information is shown to the second display area of the current display interface, comprising:
According to the purchaser record information of user, the evaluation information of commodity, commodity price information or Sales Volume of Commodity information to the quotient
Product information is ranked up processing；
Merchandise news after sequence is shown to the second display area of the current display interface.
7. a kind of processing unit of image information characterized by comprising
Module is obtained, for obtaining voice messaging, semantic according to the voice messaging generates screenshot instruction；
Interception module, for according to the image of screenshot command interception current display interface to obtain target image；
Determining module determines the target according to the characteristic parameter for extracting the characteristic parameter of the target image
The corresponding displaying information of image；
Display module, for showing the displaying information to the current display interface.
8. device according to claim 7, which is characterized in that the acquisition module, comprising:
Acquisition submodule obtains voice messaging, and analyze the semanteme of the voice messaging for starting voice assistant；
Submodule is analyzed, for when in the semanteme for analyzing the voice messaging including predetermined keyword, generating screenshot instruction.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program on computers
When operation, so that the computer executes the processing method of image information as described in claim 1.
10. a kind of electronic equipment, including processor and memory, the memory have computer program, which is characterized in that described
Processor is by calling the computer program, for executing the processing method of image information as described in claim 1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910272638.3A CN110059207A (en) | 2019-04-04 | 2019-04-04 | Processing method, device, storage medium and the electronic equipment of image information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910272638.3A CN110059207A (en) | 2019-04-04 | 2019-04-04 | Processing method, device, storage medium and the electronic equipment of image information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110059207A true CN110059207A (en) | 2019-07-26 |
Family
ID=67318383
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910272638.3A Pending CN110059207A (en) | 2019-04-04 | 2019-04-04 | Processing method, device, storage medium and the electronic equipment of image information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110059207A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111128139A (en) * | 2019-12-18 | 2020-05-08 | 苏州思必驰信息科技有限公司 | Non-invasive voice test method and device |
| CN112287691A (en) * | 2020-11-10 | 2021-01-29 | 深圳市天彦通信股份有限公司 | Conference recording method and related equipment |
| CN112702638A (en) * | 2019-10-23 | 2021-04-23 | 阿里巴巴集团控股有限公司 | Information processing method, device and system and control method of video playing equipment |
| CN113296722A (en) * | 2021-04-17 | 2021-08-24 | 中天智领（北京）科技有限公司 | Control method and device of display all-in-one machine, computer storage medium and display all-in-one machine |
| CN113542206A (en) * | 2020-11-27 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Image processing method and device and computer readable storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102074235A (en) * | 2010-12-20 | 2011-05-25 | 上海华勤通讯技术有限公司 | Method of video speech recognition and search |
| CN102707879A (en) * | 2012-04-17 | 2012-10-03 | 上海量明科技发展有限公司 | Method for selecting image contour of screenshot area, client and system |
| CN104346370A (en) * | 2013-07-31 | 2015-02-11 | 阿里巴巴集团控股有限公司 | Method and device for image searching and image text information acquiring |
| CN105373552A (en) * | 2014-08-25 | 2016-03-02 | 中兴通讯股份有限公司 | Display terminal based data processing method |
| CN105608230A (en) * | 2016-02-03 | 2016-05-25 | 南京云创大数据科技股份有限公司 | Image retrieval based business information recommendation system and image retrieval based business information recommendation method |
| CN106201177A (en) * | 2016-06-24 | 2016-12-07 | 维沃移动通信有限公司 | A kind of operation execution method and mobile terminal |
| CN106775561A (en) * | 2016-12-07 | 2017-05-31 | 广东小天才科技有限公司 | One kind cuts topic method, device and smart machine |
| CN107480236A (en) * | 2017-08-08 | 2017-12-15 | 深圳创维数字技术有限公司 | A kind of information query method, device, equipment and medium |
| CN108416018A (en) * | 2018-03-06 | 2018-08-17 | 北京百度网讯科技有限公司 | Screenshotss searching method, device and intelligent terminal |
-
2019
- 2019-04-04 CN CN201910272638.3A patent/CN110059207A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102074235A (en) * | 2010-12-20 | 2011-05-25 | 上海华勤通讯技术有限公司 | Method of video speech recognition and search |
| CN102707879A (en) * | 2012-04-17 | 2012-10-03 | 上海量明科技发展有限公司 | Method for selecting image contour of screenshot area, client and system |
| CN104346370A (en) * | 2013-07-31 | 2015-02-11 | 阿里巴巴集团控股有限公司 | Method and device for image searching and image text information acquiring |
| CN105373552A (en) * | 2014-08-25 | 2016-03-02 | 中兴通讯股份有限公司 | Display terminal based data processing method |
| CN105608230A (en) * | 2016-02-03 | 2016-05-25 | 南京云创大数据科技股份有限公司 | Image retrieval based business information recommendation system and image retrieval based business information recommendation method |
| CN106201177A (en) * | 2016-06-24 | 2016-12-07 | 维沃移动通信有限公司 | A kind of operation execution method and mobile terminal |
| CN106775561A (en) * | 2016-12-07 | 2017-05-31 | 广东小天才科技有限公司 | One kind cuts topic method, device and smart machine |
| CN107480236A (en) * | 2017-08-08 | 2017-12-15 | 深圳创维数字技术有限公司 | A kind of information query method, device, equipment and medium |
| CN108416018A (en) * | 2018-03-06 | 2018-08-17 | 北京百度网讯科技有限公司 | Screenshotss searching method, device and intelligent terminal |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112702638A (en) * | 2019-10-23 | 2021-04-23 | 阿里巴巴集团控股有限公司 | Information processing method, device and system and control method of video playing equipment |
| CN111128139A (en) * | 2019-12-18 | 2020-05-08 | 苏州思必驰信息科技有限公司 | Non-invasive voice test method and device |
| CN112287691A (en) * | 2020-11-10 | 2021-01-29 | 深圳市天彦通信股份有限公司 | Conference recording method and related equipment |
| CN112287691B (en) * | 2020-11-10 | 2024-02-13 | 深圳市天彦通信股份有限公司 | Conference recording method and related equipment |
| CN113542206A (en) * | 2020-11-27 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Image processing method and device and computer readable storage medium |
| CN113542206B (en) * | 2020-11-27 | 2023-07-04 | 腾讯科技（深圳）有限公司 | Image processing method, device and computer readable storage medium |
| CN113296722A (en) * | 2021-04-17 | 2021-08-24 | 中天智领（北京）科技有限公司 | Control method and device of display all-in-one machine, computer storage medium and display all-in-one machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110059207A (en) | Processing method, device, storage medium and the electronic equipment of image information | |
| US11328004B2 (en) | Method and system for intelligently suggesting tags for documents | |
| US20170255650A1 (en) | Data access based on content of image recorded by a mobile device | |
| CN108319489A (en) | Startup method, apparatus, storage medium and the electronic equipment of five application page | |
| US20150339373A1 (en) | Graphical interface for relevance-based rendering of electronic messages from multiple accounts | |
| RU2740785C2 (en) | Image processing method and equipment, electronic device and graphical user interface | |
| CN107291962B (en) | Searching method, searching device, storage medium and electronic equipment | |
| CN108363792A (en) | Link generation method, device, storage medium and the electronic equipment of five application page | |
| RU2703956C1 (en) | Method of managing multimedia files, an electronic device and a graphical user interface | |
| CN105653636A (en) | Information processing method and apparatus as well as information processing apparatus | |
| WO2021208633A1 (en) | Method and device for determining item name, computer apparatus, and storage medium | |
| CN108334608A (en) | Link generation method, device, storage medium and the electronic equipment of five application page | |
| CN109086680A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN105378728A (en) | Apparatus and method for representing and manipulating metadata | |
| US10515289B2 (en) | System and method of generating a semantic representation of a target image for an image processing operation | |
| CN108921941A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN104699700A (en) | Searching method and device | |
| CN111611490A (en) | Resource searching method, device, equipment and storage medium | |
| CN111464716A (en) | Certificate scanning method, device, equipment and storage medium | |
| US9201900B2 (en) | Related image searching method and user interface controlling method | |
| CN112954046B (en) | Information transmission method, information transmission device and electronic equipment | |
| WO2017107855A1 (en) | Picture searching method and device | |
| CN106991179A (en) | Data-erasure method, device and mobile terminal | |
| WO2021017238A1 (en) | Text generation method and apparatus | |
| CN106294549A (en) | A kind of image processing method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190726 |
|
| RJ01 | Rejection of invention patent application after publication |