WO2020044099A1

WO2020044099A1 - Service processing method and apparatus based on object recognition

Info

Publication number: WO2020044099A1
Application number: PCT/IB2018/057167
Authority: WO
Inventors: 黄龙飞; 廖科海
Original assignee: 优视科技新加坡有限公司
Priority date: 2018-08-29
Filing date: 2018-09-18
Publication date: 2020-03-05
Also published as: CN109040461A

Abstract

Disclosed are a service processing method and apparatus based on object recognition. One particular embodiment of the method comprises: a terminal acquiring an image to be recognized; determining a target object contained in the image to be recognized; receiving a customized operation based on the target object by a user; providing a customized service for the user according to the target object and the customized operation with regard to the target object. In the scenario of image recognition, after a corresponding target object is recognized from an image to be recognized, information or a relevant service required by a user can be provided for the user according to a customized operation by the user. The method can effectively improve the degree of freedom and convenience of a user obtaining information, and enrich the application of the scenario.

Description

An object recognition-based business processing method and device application requires a Chinese patent application submitted to the Chinese Patent Office on August 29, 2018, with an application number of 201810998407.6, and the invention name is "A method and device for business processing based on object recognition" Priority, the entire contents of which are incorporated herein by reference. Technical field

The present application relates to the field of computer technology, and specifically to the field of Internet technology, and in particular, to a method and an apparatus for business processing based on object recognition. Background technique

With the development of information technology, terminals (such as mobile phones) have more and more functions, which are widely used in people's daily life and work. The intelligentization of terminals has become one of the main development directions.

In the prior art, a terminal with a shooting function has been developed from simply shooting to being able to identify a photographed object. For example, a user can use a mobile phone to shoot a plant, and the terminal can identify a plant to be photographed. The introduction information is displayed to the user.

Based on the existing technology, a more intelligent object recognition and business processing method is needed. Summary of the Invention

The purpose of this application is to provide a method and device for business processing based on object recognition, which is used to solve the problem of relatively single business after identification in certain physical recognition scenarios.

In a first aspect, an embodiment of the present application provides a service processing method based on object recognition, including: a terminal obtaining an image to be recognized;

Determining a target object included in the image to be identified;

Receiving a user-defined operation based on the target object;

Providing the user with a custom service according to the target object and a custom operation for the target object.

In a second aspect, an embodiment of the present application further provides an object recognition-based service processing apparatus, including: an image acquisition module configured to acquire an image to be identified;

An object determination module configured to determine a target object included in the image to be identified;

The operation receiving module is configured to receive a user-defined operation based on the target object; the business processing module is configured to provide the user with a customized service according to the target object and the customized operation for the target object.

According to a third aspect, an embodiment of the present application further provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the foregoing method in the present application. According to a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and the program is implemented by a processor to implement the foregoing method in the present application.

The object recognition-based business processing method and device provided in this application, in a scene of image recognition, after identifying a corresponding target object from an image to be identified, the user can provide the user with a Required information or related business. This method can effectively improve the freedom and convenience for users to obtain information, and make the application of this scenario more abundant. BRIEF DESCRIPTION OF THE DRAWINGS

Other features, objects, and advantages of the present application will become more apparent by reading the detailed description of the non-limiting embodiments with reference to the following drawings:

FIG. 1 is a schematic diagram of interaction between a user and a terminal according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of an object recognition-based business processing method according to an embodiment of the present application; FIG. 3 is a schematic flowchart of an object recognition-based business processing method provided in an embodiment of the present application;

FIG. 4a is a schematic diagram of a label editing control in a shooting interface according to an embodiment of the present application; FIG. 4b is a schematic view showing a display effect of a custom label in a search result interface provided by an embodiment of the present application;

5 is a schematic diagram of a label editing control in a search result interface provided by an embodiment of the present application; FIG. 6 is a schematic flowchart of a business processing method based on object recognition in another specific application scenario provided by the embodiment of the present application;

FIG. 7a is a schematic diagram of a content tag displayed after identifying a person according to an embodiment of the present application; FIG. 7b is a schematic diagram of a content tag displayed after identifying a place according to an embodiment of the present application; A schematic flowchart of a business processing method based on object recognition in a specific application scenario;

FIG. 9 is a schematic structural diagram of a service processing device based on object recognition provided by an embodiment of the present application; FIG. 10 is a structural schematic diagram of an electronic device provided by an embodiment of the present application. detailed description

The following describes the present application in detail with reference to the accompanying drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related invention, rather than limiting the invention. It should also be noted that, for convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The application will be described in detail below with reference to the drawings and embodiments.

In the existing business scenarios, some applications with physical identification functions usually provide pre-matched data to users after identifying the corresponding physical objects. For example, some applications can identify the plant image captured by the terminal. The name of the plant, the subject it belongs to, etc., and this information is displayed to the user.

Another example: Some shopping applications provide a physical identification function. After identifying the corresponding physical object, you can automatically search for products with the same or similar appearance and display the search results to the user. Step by step, select and purchase the products displayed.

However, for the existing recognition methods, the information related to the recognition results is usually set in advance, and is strongly related to the purpose of recognition. It is difficult for users to determine the information they want to obtain, and it is difficult to obtain further customized information. service.

For this reason, in the embodiment of the present application, a method for business processing based on object recognition is provided. After identifying a target object, a user-defined business service can be provided.

Referring to FIG. 1, a schematic diagram of an architecture adopted in an embodiment of the present application is shown. As shown in FIG. 1, the terminal may perform recognition processing on an image containing a target object, and provide users with corresponding services according to a user-defined operation instruction.

Generally, the terminal can be considered as a device with an image acquisition function, such as a mobile phone, a tablet computer, a notebook computer, a smart watch, a smart glasses, a smart camera, a computer, and the like. Of course, in order to achieve image acquisition, it is also feasible that the terminal is connected to an external (non-terminal) image acquisition device (such as an independent camera). In some embodiments, the terminal may not have an image acquisition function, and the image data including the target object may be obtained through data transmission.

In the embodiment of the present application, the target object may be a person, an animal, a plant, a building, a commodity, a texture, an icon, a text, etc. obtained by shooting, or may be a virtual image, a texture, an icon, Text, etc. Of course, as shown in FIG. 1, the terminal can perform real-world shooting to identify the target object, and can also obtain and receive an image containing the target object for identification. It should not be construed as limiting the present application.

Based on the above-mentioned architecture shown in FIG. 1, the technical solutions provided in the embodiments of the present application will be described in detail below.

Continuing to refer to FIG. 2, an embodiment of the present application provides a method for service processing based on object recognition, which specifically includes the following steps:

Step S201: The terminal acquires an image to be identified.

The image content of the image to be identified includes a target object. For the target object, reference may be made to the foregoing content, and details are not described herein again.

As mentioned above, in a feasible manner, a user may use a terminal to perform image acquisition on a target object, thereby obtaining an image to be identified. In another feasible way, the terminal may also directly obtain a picture or video containing the target object waiting to be identified. Of course, in this case, the terminal may communicate with other devices (terminal, server, or network device), storage medium ( (Such as: mobile disk, U disk, etc.) to perform data transmission to obtain the image to be identified. The specific implementation of the above two methods depends on the needs of practical applications, and is not limited herein.

Step S203: Determine a target object included in the image to be identified.

In the embodiment of the present application, determining a target object included in an image to be identified may be considered as extraction and determination of target object features, and may be specifically implemented by a corresponding image feature recognition algorithm, model, or a combination thereof, such as: deep learning Algorithms, neural network models, etc. are not repeated here.

Step S205: Receive a user-defined operation based on the target object.

In the embodiment of the present application, the custom operation issued by the user is usually related to the purpose the user wants to achieve. For example, in one embodiment, the user may set, based on the plant identified by the mobile phone, The tag "pattern #" is set. This operation indicates that the user wants to obtain relevant information using the plant as a pattern, such as: a picture with the plant as a background, a product with the plant pattern, and the like.

It should be understood that, in the embodiment of the present application, the custom operation is not limited to adding a label, but may also be a sharing operation or a storage operation for some or all target objects, which will be specifically determined according to actual application requirements. Here, It is not specifically limited.

In addition, it needs to be explained here that the timing of receiving the user-defined operation in this step may be received in advance, or may be received after the target object is determined. The specific will depend on the actual application scenario. Restrictions on this application.

Step S207: Provide a customized service for the user according to the target object and a custom operation for the target object.

After the target objects and user-defined operations are determined, users can be provided with corresponding customized services. It should be understood that the customized services provided to users in different application scenarios are different. In an exemplary scenario, it is determined from a to-be-recognized image that the target object contained therein is a certain plant, and the user sets a tag "tag # 图 #" for the plant. The product with the plant pattern is found in the picture, and the search result is provided to the user.

Through the above steps, in the scene of image recognition, after the corresponding target object is identified from the image to be identified, the user can provide the user with the information or related services required by the user according to the user's custom operation. This method can effectively improve the freedom and convenience for users to obtain information, and make the application of this scenario more powerful.

For the above steps, the execution subject may generally be the terminal itself, and in some embodiments, an App running on the terminal may also be used as the execution subject. In other embodiments, it may also maintain communication with the terminal. Connected server. In addition, during the execution of the above steps, the execution subject may change. For example, the execution subject of step S201 may be the terminal itself, and the execution subject of step S203 may be a server. Of course, the specific will be determined according to the actual application situation, which should not be understood as limiting the present application.

The interaction mode between the terminal and the server shown in FIG. 1 is not the only way. In other embodiments, the terminal itself has sufficient processing performance and storage space. Then, the terminal can directly obtain the real-world data collected by the terminal. Processing without uploading to the server. It can be understood that the devices and the numbers of the terminals and servers used in FIG. 1 are only exemplary. In actual applications, the specific interaction method, the type of equipment, and the number of equipment used between the terminal and the server will be determined according to the actual application situation, which should not be construed as limiting this application.

The above method of the present application will be described in detail below with reference to specific application scenarios.

scene one

The user can use the physical recognition function in the shopping application to perform shooting recognition on a certain physical object, and the shopping application can find the same or similar businesses in the corresponding product database based on the identified physical object.

Mouth

In this scenario, the shopping application can determine the category to which the photographed object belongs through the support of the recognition algorithm or the recognition model, so as to search under this category and provide the user with product information of the same category. A simple example: Suppose a user uses a shopping app on a mobile phone to take a photo of a water glass, Then, the shopping application can recognize that the category corresponding to the subject is "water cup", and find the same or similar product pictures (with product links) in the category in the product database, and finally display it on the search results page to user.

Obviously, the above method has certain limitations. In some cases, the user may not want to find a product such as a cup, but a garment with a cup pattern. In this case, in some shopping applications, multiple product categories (such as "tops", "skirts", "bottoms", etc.) are set on the search page based on physical identification, and users can switch between different product categories. To find the corresponding categories of products, but these product categories are set in advance by the service provider, and users cannot define them themselves.

To this end, with continued reference to FIG. 3, a method for business processing based on object recognition in this scenario is shown. As shown in FIG. 3, the method may specifically include the following steps:

Step S301: Determine a target object included in the image to be identified.

For the process of determining the target object in this step, and the definition of the target object, reference may be made to the foregoing content, which will not be repeated here.

Step S303: Receive a custom label input by the user.

In the embodiment of the present application, a user can be provided with an editing function of a custom label, in other words, the user can input a self-defined label based on the editing function.

As a feasible implementation manner, if a user uses a shooting function in a shopping application to shoot a target object, a label editing control may be provided to the user in a shooting interface (specifically, an interface where the target object has been captured), and the label The form of the edit control can be shown in Figure 4a. When the user clicks the label editing control, it is deemed that the user has triggered the editing function of the custom label, and a label input box pops up. The user can edit the corresponding label name in the label input box by himself, and can provide the user with such as "Save ”Button, the user can store the tags entered by the user after clicking.

It should be understood that the custom tags edited by the user will be displayed on the search result page, and the display order of the custom tags takes precedence over other default category tags, as shown in FIG. 4b.

As another feasible implementation, the label editing function may be triggered in the product search result interface. Specifically, a label editing control is provided at one end (head or end) of the category label bar of the product search result interface. As shown in Figure 5, at the end of the category label bar, a control with a shape of "+" is provided. Then, when the user clicks the control, the label editing function can be triggered.

Step S305: According to the target object and the custom label, search for an established product database that matches the custom label and is the same or similar to the target object.

In other words, in this scenario, the image characteristics of the target object and the custom label are used as search conditions in the search process to search in the product database.

What needs to be explained here is that the user-defined input tags have strong randomness, so in order to be able to search based on the tags entered by the user, in this embodiment of the present application, it is necessary to perform semantic recognition on the custom tags during the search process. Search based on the results of semantic recognition.

It should be understood that, in actual applications, the recognition accuracy of user-defined tags by background algorithms or models tends to be more and more accurate with the number of users and the number of users. There is usually a deviation in the recognition results of user-defined labels.

Therefore, as a feasible way in the embodiment of the present application, when a user is in the process of customizing a label, In this way, the user can be guided to input based on a preset label category,

For example: Assume that the custom label that the user wants to enter is "the pattern that appears on the top of the shirt" and the standard label is "the pattern of the top." Then, when the user enters the custom label, the content of the standard label can be displayed For the user to choose, or to present it to the user by means of prompt information (for example: to show the user the prompt message "Is the label entered a shirt pattern?") For the user to choose.

Obviously, this method can more effectively standardize the custom labels entered by the user, and avoid discrepancies in recognition caused by the custom labels being too arbitrary.

As another feasible way in the embodiment of the present application, the background algorithm or model may perform recognition training on a user-defined label. In this process, it is very likely that the recognition result does not match the result expected by the user, and the user's feedback can be received in order to optimize and adjust the algorithm or model. For example, you can provide users with query information (such as: Are you satisfied with the search results?) And options on the recognition results page, so that you can receive user feedback on options. Obviously, as the number of users and / or the number of operations increases, the algorithm or model can be optimized more effectively.

From the above, it can be seen that in the scene of shooting search using a shopping application, the user can define corresponding tags for the shooting target object, so as to achieve a more accurate subdivision search. This search method can also be more to a certain extent Fits the user's search purpose.

Scene two

The user can use the terminal to obtain images of target objects such as people and actual locations, so as to provide users with corresponding services based on the above target objects.

Specifically, in this scenario, an embodiment of the present application provides a service processing method based on object recognition. As shown in FIG. 6, the method may specifically include the following steps:

Step S601: Acquire an image to be processed.

The to-be-processed image includes a target object such as a person or an actual location.

In this scenario, the actual location may be considered as a spatial place located in a certain geographical location in the real world, and may include, but is not limited to: buildings (such as office buildings, shopping malls, etc.), streets, squares, or lines Stores (eg: restaurants, coffee shops, etc.).

The person in question can be regarded as a public figure (such as: celebrities, dignitaries, etc.).

Based on this, the acquisition of the image to be processed in this step can be considered as the user shooting the actual person / place through the terminal, shooting the picture containing the person / place, or acquiring the image containing the person / place via the network

Step S603: Determine a target object included in the image to be processed and an internal answer label corresponding to the target object.

The target object can be determined by a corresponding algorithm or model, so it will not be repeated here.

In this scenario, the terminal and / or the server usually also store a content tag matching the target object. After the target object is determined from the image to be processed, an internal answer label matching the target object can be further determined.

The content tags may include, but are not limited to, the target object's profile, news, social, booking, and strategy tags. In a feasible manner, the content label may be predefined by the service provider; In another feasible manner, the content label may also be determined based on a user's report, customization, and the like. Of course, this should not be construed as limiting the present application.

In a simple example, as shown in FIG. 7a, when a user uses a mobile phone to shoot a public figure (that is, a target object), the content label of the public figure may be displayed in the shooting interface, such as: the name of the public figure, Age and related news.

Step S605: Receive a user's selection operation for the content tag.

The user can issue selection operations such as clicking, pressing, dragging, sliding, etc. on the content tags in order to obtain relevant internal answers.

Step S607: According to the selection operation, provide content matching the content tag to the user.

In this scenario, the content that matches the content label can be a website, a detail page, a related article, a social circle, and so on. Continuing the above example, suppose that the user clicks on the label "#related news #" in Figure 7a, and will jump to the news page to show the user the news related to the public figure.

As another example: as shown in FIG. 7b, after a user takes a picture of a hotel, the hotel can display the hotel booking, check-in guide, and other tags on the shooting interface. When the user selects the "# 票票 #" tag, it will jump to The hotel's official website or a third-party ticketing platform.

The above examples should not be construed as limiting the present application.

It should be noted that in this scenario, in addition to selecting a corresponding content tag, the user can also customize the editing content tag or edit the content corresponding to the content tag. Specifically, in addition to the above recognition of people, places, etc., other target objects can also be identified, but it should be understood that the background algorithm or model cannot guarantee a completely accurate recognition rate, and therefore, as a feasible implementation manner For target objects that cannot be accurately identified, users can be provided with similar "guess" results.

For example: The user uses the terminal to photograph a car, and after the background algorithm / model recognition, the "guess" result that can be displayed to the user is "this may be a Mercedes-Benz XX model car".

Further, according to the "guess" result, the user can edit the corresponding content label by himself to correct the "guess" result. Scene three

In the scenario where users share pictures, the current picture sharing is usually sharing pictures. Of course, the pictures described here can be considered as being taken by the user through a terminal, screenshots, or obtained through the network, and can also be cropped, Add filters, Timory mouthpieces and other image processed pictures. However, it lacks the ability to share some of the content in the picture or the target object separately after extraction.

Therefore, in this scenario, an embodiment of the present application provides a service processing method based on object recognition. As shown in FIG. 8, the method may specifically include the following steps:

Step S801: Obtain a picture to be processed.

The to-be-processed picture described herein may be considered to be a picture that contains content to be shared. As mentioned above, there are many sources for the pictures to be processed, such as: users take pictures, take screenshots, or obtain them from other users through data transmission, or obtain them through the network.

Step S803: Determine a target object included in the picture to be processed. Similar to the foregoing, the target object included in the to-be-processed picture here can be considered to be an image of a person, an animal, a plant, a building, a commodity, a texture, an icon, a text and the like included in the to-be-processed picture. It can be a virtual image, texture, icon, text, etc. generated by image processing technologies such as rendering. No more-enumeration here.

In this scenario, the target object in the picture to be processed can also be determined based on the corresponding recognition algorithm or model. In a feasible implementation manner, after the target objects included in the picture to be processed are determined, contour lines can be used to outline different target objects in the picture, so that the user can perform operations in subsequent processes. .

Of course, the use of contour lines here is only one possible implementation, and should not be construed as limiting the present application.

Step S805: Receive a sharing extraction operation of the user, extract the target object as content to be shared, and perform sharing.

The share extraction operation sent by the user may specifically be operations such as pressing, clicking, and dragging on the target object. By issuing the share extraction operation, the user can also select the corresponding target object. Furthermore, the target object selected by the user can be extracted to form content to be shared for sharing.

Of course, for the sharing and sending process, the existing technology is relatively mature, so it will not be repeated here. With the above content, in the scenario of picture sharing, the above method in the embodiment of the present application is adopted, so that users can share more detailed picture content instead of sharing all pictures, especially in the design of graphics / images In the field, this method can reduce the reprocessing operation of the picture content by the receiver. The above is the terminal control method provided in the embodiment of the present application. Based on the same idea, the embodiment of the present application also provides a corresponding object-based service processing device.

Specifically, with continued reference to FIG. 9, a service processing device based on object recognition provided in an embodiment of the present application is shown. The device includes:

An image acquisition module 901, configured to acquire an image to be identified;

An object determining module 902 is configured to determine a target object included in the image to be identified; an operation receiving module 903 is configured to receive a user-defined operation based on the target object; a business processing module 904 is configured to perform a target operation based on the target object And a custom operation for the target object to provide the user with a custom service.

The device shown in FIG. 9 can be applied in different scenarios.

scene one :

Further, the operation receiving module 903 is configured to receive a custom label input by a user for the target object.

Further, the operation receiving module 903 is configured to monitor a user's trigger operation for the label editing control in the shooting interface, and after the trigger operation is detected, a tag input box is provided in the shooting interface to obtain the A custom label entered by the user for the target object in the label input box.

Further, the operation receiving module 903 is configured to monitor a user in a search result interface. For a trigger operation on a label editing control, after the trigger operation is detected, a label input box is provided in the shooting interface, and a custom label input by the user for the target object in the label input box is obtained. .

Further, the business processing module 904 is configured to find, according to the target object and the custom label, an established product database that matches the custom label and is the same as or similar to the target object. .

Scenario 2:

Further, the image acquisition module 901 is configured to acquire an image to be processed.

Further, the object determining module 902 is configured to determine a target object included in the image to be processed and an internal answer label corresponding to the target object.

Further, the operation receiving module 903 is configured to receive a user's selection operation for the content tag.

Further, the service processing module 904 is configured to provide content matching the content tag to the user according to the selection operation.

Scenario three:

Further, the image acquisition module 901 is configured to acquire a picture to be processed.

Further, the object determining module 902 is configured to determine a target object included in the picture to be processed.

Further, the operation receiving module 903 is configured to receive a sharing extraction operation of the user.

Further, the service processing module 904 is configured to extract the target object as content to be shared, and perform sharing.

For the device described in the foregoing embodiments, a corresponding computer-readable storage medium is also provided in the embodiments of the present application, and the computer-readable medium may be included in the device described in the foregoing embodiments; or may exist separately. It is not assembled into the device. The computer-readable storage medium may be configured to store one or more computer programs; when the one or more computer programs are executed by one or more processors, so that the one or more processors implement the foregoing embodiments As described in the device section.

In addition, a corresponding electronic device is also provided in the embodiment of the present application. In other words, the apparatus in the foregoing embodiment of the present application may be implemented on the electronic device. Generally, as shown in FIG. 10, the electronic device may include: one or more processors, a communication interface, a storage medium, and a communication bus, where:

The processor, the communication interface, and the storage medium complete communication with each other through a communication bus.

The communication interface may be an interface of a communication module, such as an interface of a GSM module.

The storage medium may be, but is not limited to, a random access storage medium (Random Access Memory, RAM), a read-only storage medium (Read Only Memory, ROM), a programmable read-only storage medium (Programmable Read-Only Memory, PROM), Erasable read-only storage media

Programmable Read-Only Memory (EPROM), Electric Erasable Programmable Read-Only Memory (EEPROM), etc.

The processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc .; it may also be a digital signal processor (DSP), a dedicated Integrated circuits (ASICs), off-the-shelf programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. Various methods, steps, and logical block diagrams disclosed in the embodiments of the present application may be implemented or executed. A general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

Further, for the device shown in FIG. 9, the processor may be specifically configured to: the terminal acquires an image to be identified, determines a target object included in the image to be identified, and receives a user-defined operation based on the target object according to The target object and a custom operation for the target object provide the user with a custom service.

Each embodiment in this application is described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the device, device, and medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple. For related parts, refer to the description of the method embodiments, which will not be described here again.

So far, specific embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims may be performed in a different order and still achieve the desired result. In addition, the processes depicted in the figures do not necessarily require the particular order shown or sequential order to achieve the desired result. In certain embodiments, multitasking and parallel processing may be advantageous.

In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing a method shown in a flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through a communication section, and / or installed from a removable medium. When the computer program is executed by a central processing unit (CPU), the aforementioned functions defined in the method of the present application are executed. It should be noted that the computer-readable medium described in this application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the foregoing. The computer-readable storage medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programming read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In this application, a computer-readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium may include a data signal that is included in baseband or propagated as part of a carrier wave, and which carries computer-readable program code. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium The code may be transmitted using any suitable medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for performing the operations of the present application may be written in one or more programming languages or a combination thereof, the programming languages including an object-oriented programming language such as Java, Smalltalk, C ++, and also conventional Procedural programming language-such as "C" or similar programming language. The program code can be executed entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as through the Internet using an Internet service provider) connection).

The flowchart and block diagrams in the accompanying drawings illustrate the architecture, functions, and operations of possible implementations of the system, method, and computer program product according to various embodiments of the present application. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, which contains one or more functions for implementing a specified logical function Executable instructions. It should also be noted that in some alternative implementations, the functions marked in the boxes may also occur in a different order than those marked in the drawings. For example, two successively represented boxes may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs the specified function or operation. Or, it can be implemented by a combination of dedicated hardware and computer instructions.

The modules described in the embodiments of the present application may be implemented by software or hardware. The described module may also be provided in a processor, for example, it may be described as: A processor includes an image acquisition module, an object determination module, an operation receiving module, and a business processing module. The names of these modules do not constitute a limitation on the unit itself in some cases. For example, the image acquisition module may also be described as a “module for acquiring an image to be identified”.

The expressions "first", "second", "the first", or "the second" used in various embodiments of the present disclosure may modify various components regardless of order and / or importance However, these expressions do not limit the corresponding components. The above expressions are only configured for the purpose of distinguishing elements from other elements. For example, the first user equipment and the second user equipment represent different user equipments, although both are user equipments. For example, without departing from the scope of the present disclosure, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

When an element (eg, a first element) is referred to as being "(operably or communicably) coupled" or "(operably or communicably) coupled to" another element (eg, a second element) When an element (for example, a second element) or "connected to" another element (for example, a second element) is understood to mean that one element is directly connected to the other element or the one element is via another element (for example, The third element) is indirectly connected to the other element. On the contrary, it can be understood that when an element (for example, the first element) is called "directly connected" or "directly coupled" to another element (the second element), no element (for example, the third element) is inserted between the two elements. Between people. The above description is only a preferred embodiment of the present application and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to the technical solution of the specific combination of the above technical features, but also covers the above technical features or Other technical solutions formed by arbitrarily combining their equivalent features. For example, a technical solution formed by replacing the above features with technical features disclosed in the present application (but not limited to) with similar functions.

Claims

Claim

1. A business processing method based on object recognition, which comprises:

The terminal acquires an image to be identified;

Determining a target object included in the image to be identified;

Receiving a user-defined operation based on the target object;

2. The method according to claim 1, wherein receiving a user-defined operation based on the target object comprises:

Receiving a custom label input by a user for the target object.

3. The method according to claim 2, wherein receiving a custom label input by the user for the target object comprises:

Monitor the trigger operation of the user on the label editing control in the shooting interface;

After the triggered operation is detected, a label input box is provided in the shooting interface; and a custom label input by the user for the target object in the label input box is obtained.

4. The method according to claim 2, wherein receiving a custom label input by the user for the target object comprises:

Monitor the user's trigger action on the label edit control in the search results interface;

5. The method according to claim 2, wherein providing the user with a custom service according to the target object and a custom operation for the target object comprises:

According to the target object and the custom label, an established product database is searched for an item that matches the custom label and is the same as or similar to the target object.

6. A service processing device based on object recognition, comprising:

An image acquisition module configured to acquire an image to be identified;

An object determining module is configured to determine a target object included in the image to be identified; an operation receiving module is configured to receive a user-defined operation based on the target object; a business processing module is configured to according to the target object and to the target object; The custom operation of the target object provides the user with a custom service.

7. The device according to claim 6, wherein the operation receiving module is configured to receive a custom label input by a user for the target object.

8. The device according to claim 7, wherein the operation receiving module is configured to monitor a trigger operation of a user on a label editing control in a shooting interface, and when the trigger operation is detected, the A label input box is provided in the shooting interface, and a custom label input by the user for the target object in the label input box is obtained.

9. The device according to claim 7, wherein the operation receiving module is configured to monitor a user's trigger operation on a label editing control in a search result interface, and when the detected touch After the sending operation, a label input box is provided in the shooting interface, and a custom label input by the user for the target object in the label input box is obtained.

10. The device according to claim 9, wherein the service processing module is configured to find, based on the target object and the custom label, an established product database that matches the custom label. And the same or similar products as the target object.

11. An electronic device comprising: one or more processors;

A storage device for storing one or more programs;

When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 5.

12. A computer-readable storage medium having stored thereon a computer program, characterized in that when the program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.