WO2017107672A1 - 一种信息处理方法和装置、一种用于信息处理的装置 - Google Patents

一种信息处理方法和装置、一种用于信息处理的装置 Download PDF

Info

Publication number
WO2017107672A1
WO2017107672A1 PCT/CN2016/104233 CN2016104233W WO2017107672A1 WO 2017107672 A1 WO2017107672 A1 WO 2017107672A1 CN 2016104233 W CN2016104233 W CN 2016104233W WO 2017107672 A1 WO2017107672 A1 WO 2017107672A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
dish
food
name
restaurant
Prior art date
Application number
PCT/CN2016/104233
Other languages
English (en)
French (fr)
Inventor
邢真臻
卜海亮
何理
Original Assignee
北京搜狗科技发展有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京搜狗科技发展有限公司 filed Critical 北京搜狗科技发展有限公司
Publication of WO2017107672A1 publication Critical patent/WO2017107672A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9537Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants

Definitions

  • the present application relates to the field of Internet information processing technologies, and in particular, to an information processing method, an information processing apparatus, and an apparatus for information processing.
  • User A is losing weight in order to control the diet, which needs to record the calories contained in the food he consumes every day.
  • User A needs to input the dishes in the search engine during each meal.
  • the user sometimes encounters the problem that the dish is not cooked by the user or personally, so the dish is seen at the table, but the name of the dish is not known; Alternatively, the user is busy eating or chatting and is not convenient to input text; therefore, the manner of obtaining information through the search engine increases the difficulty for the user to obtain information, thereby affecting the efficiency of the user to obtain information.
  • embodiments of the present application have been made in order to provide an information processing method, a corresponding information processing apparatus, and an apparatus for information processing that overcome the above problems or at least partially solve the above problems, and can reduce the difficulty of acquiring information, and Can improve the efficiency of obtaining information.
  • an information processing method including:
  • the name of the dish corresponding to the food picture is output.
  • an information processing apparatus including:
  • An obtaining module configured to obtain a food picture of the user, and geographic location information corresponding to the food picture
  • a first determining module configured to determine a restaurant corresponding to the geographical location information
  • a search module configured to search in a restaurant picture corresponding to the restaurant to obtain a result picture of the same or similar result as the food picture;
  • a second determining module configured to determine a name of the dish corresponding to the food picture according to the name of the dish corresponding to the result of the food item
  • the first output module is configured to output a name of the dish corresponding to the food picture.
  • the present application discloses an apparatus for information processing, including a memory, and one or more programs, wherein one or more programs are stored in a memory and configured to be processed by one or more Executing the one or more programs includes instructions for performing the following operations:
  • the name of the dish corresponding to the food picture is output.
  • the embodiment of the present application automatically identifies and outputs the name of the dish corresponding to the food picture of the user.
  • the embodiment of the present application can automatically output the name of the dish corresponding to the food picture without the user knowing the name of the dish or entering the text.
  • the acquisition can be reduced. The difficulty of information and the efficiency of obtaining information;
  • the user A needs to input the name of the dish in the search engine to obtain the calories included in the dish by the result provided by the search engine; and the embodiment of the present application can automatically output the name of the dish corresponding to the food picture. Since the operation of inputting characters by the user can be saved, the difficulty of acquiring information can be reduced, and the efficiency of acquiring information can be improved;
  • the embodiment of the present application determines the restaurant near the user according to the geographical location information corresponding to the food picture, and obtains the same as the food picture within the range of the food picture corresponding to the restaurant or a similar result food picture, and then determining the name of the food corresponding to the food picture according to the name of the dish corresponding to the result of the food picture; on the one hand, since the range of the corresponding food picture of the above restaurant is much smaller than the range of the traditional Internet picture, The embodiment of the present application can reduce the comparison range of the picture matching as much as possible, thereby ensuring the speed of the food picture recognition. On the other hand, the correspondence between the restaurant picture corresponding to the restaurant and the food picture actually provided by the same restaurant is relatively high. The application embodiment can ensure the accuracy of food picture recognition;
  • the embodiment of the present application may further output related information of the name of the dish corresponding to the food picture, which obtains related information of the dish through the search engine with respect to the existing solution, and the related information such as the calorie corresponding to the dish may be automatically provided to the user. Therefore, the efficiency of the user to obtain information can be further improved;
  • the embodiment of the present application can improve the processing efficiency of the food picture when applied to the processing flow of uploading and backup of the food picture;
  • the operation of the present invention can also improve the uploading efficiency of food pictures.
  • Embodiment 1 is a flow chart showing the steps of Embodiment 1 of an information processing method according to the present application;
  • 3 is an example of outputting related information of a dish name corresponding to the food picture according to an embodiment of the present application
  • Embodiment 4 is a flow chart showing the steps of Embodiment 2 of an information processing method of the present application.
  • FIG. 5 is a flow chart showing the steps of Embodiment 3 of an information processing method according to the present application.
  • FIG. 6 is a structural block diagram of an embodiment of an information processing apparatus of the present application.
  • FIG. 7 is a block diagram of an apparatus 800 for inputting of the present application.
  • FIG. 8 is a schematic structural diagram of a server in some embodiments of the present application.
  • FIG. 9 is a block diagram of a computing device for performing an information processing method according to the present application.
  • FIG. 10 is a storage unit for holding or carrying program code implementing the information processing method according to the present application.
  • FIG. 1 a flow chart of a first embodiment of an information processing method of the present application is shown, which may specifically include the following steps:
  • Step 101 Obtain a food picture of the user, and geographic location information corresponding to the food picture;
  • the embodiment of the present application can be applied to an application (such as an information processing program) of a terminal such as a PC (Personal Computer, Personal Computer), a mobile phone, a tablet computer, etc., when the application acquires When the user's food picture is displayed, the food name corresponding to the food picture can be automatically recognized and outputted. Thus, the embodiment of the present application can automatically output the food picture corresponding to the food item if the user does not know the name of the dish or enters the text.
  • an application such as an information processing program
  • a terminal such as a PC (Personal Computer, Personal Computer), a mobile phone, a tablet computer, etc.
  • the name so that the user can quickly obtain the name of the dish, or obtain further information according to the name of the dish (such as applying the name of the dish to the search engine to obtain further calories, etc.), thereby saving the user's input of text, thereby reducing The difficulty of obtaining information and the efficiency of obtaining information.
  • the food picture may be a picture containing food, and the embodiment of the present application does not limit the specific food picture.
  • the client can obtain the food picture uploaded by the user.
  • the information processing program client hereinafter referred to as the client
  • detects the operation of uploading the food picture by the user the corresponding food can be obtained. image.
  • the user B uploads a gourmet picture in the friend circle of the WeChat
  • the client of the embodiment of the present application can detect and acquire the above-mentioned gourmet picture.
  • the client of the embodiment of the present application can also provide an uploading interface, so that the user can upload the food image through the uploading interface.
  • the specific upload interface is not limited.
  • the client can obtain the food picture taken by the user.
  • the user A is losing weight, and in order to control the diet, it is necessary to record the calories contained in the food that he consumes every day, that is, in the course of each meal, Knowing the calories of the dishes; the user A can take a picture of the food corresponding to the food through a photographing module having a photographing function, such as a camera, before the meal, and the client of the embodiment of the present application can detect the photographing operation and obtain the corresponding photographing operation. Food picture.
  • the technical solution A3 can be applied
  • the server can receive the food picture sent by the client. After obtaining the food picture uploaded or photographed by the user, the client may send the acquired food picture to the server, and the server identifies the name of the food corresponding to the food picture.
  • the amount of computation of the client can be greatly reduced, that is, the resource consumption of the client can be greatly reduced, thereby improving the running time and running efficiency of the client, and improving the practicability of the client; It also has the advantage of rich computing resources on the server side (cloud resources in the cloud server), so that the recognition accuracy and recognition efficiency of the dish name corresponding to the food picture can be improved.
  • the geographical location information corresponding to the food picture may be used to reflect the geographical location information of the food corresponding to the food picture.
  • the geographic location information corresponding to the food image may specifically include: geographic location information carried by the food image and/or geographic location information of a terminal to which the food image belongs.
  • the geographic location information may be represented by information such as latitude and longitude.
  • the specific representation manner of the geographical location information is not limited in the embodiment of the present application.
  • the shooting module running thereon can write GPS information of the shooting location into the picture.
  • the above GPS information can be read from the EXIF (Exchangeable Image File) information of the picture.
  • EXIF Exchangeable Image File
  • user A eats at the restaurant " ⁇ " (the restaurant address is No. 193, Dongzhimennei Street, Dongcheng District), and he wants to know the calories of a dish on the dinner table, so he uses the mobile phone to shoot the dish to get the corresponding
  • the food picture can carry the geographical location information of the current shooting mobile phone, that is, the geographical location information of the food dish.
  • the food picture does not carry geographical location information (for example, the food picture is In the case of shooting with a camera without a GPS function, according to the user's consumption attribute for the dish and the non-separation characteristic between the user and the mobile phone, the geographical location information of the terminal to which the food picture belongs may be used as the food item corresponding to the food picture. Geographic location information.
  • Step 102 Determine a restaurant corresponding to the geographical location information
  • the restaurant corresponding to the geographical location information may be used to represent a restaurant in the vicinity of the geographic location information, which may specifically include: N restaurants closest to the geographical location information, or distances from the geographic location information. a restaurant or the like that is smaller than the first threshold; wherein, due to the densely distributed characteristics of the restaurant in some locations, the degree of discrimination of the restaurant is likely to be low, so in order to avoid missing the restaurant where the food corresponding to the food picture is located, the above N and the above may be
  • the value of a threshold is set to be larger; and because the characteristics of the sparse distribution of the restaurant in some locations are easy to make the discrimination of the restaurant higher, the value of the above N and the first threshold may be set smaller.
  • the embodiment does not limit the specific values of N and the first threshold.
  • the step of determining the restaurant corresponding to the geographical location information includes: searching, according to the geographical location information, a mapping relationship between the geographic location information and the restaurant, to obtain a location The restaurant that corresponds to the geographical location information.
  • the restaurant list corresponding to the geographical location information may be obtained, for example, when the geographical location information is the latitude and longitude near the street, the vicinity of the street can be obtained.
  • Restaurant list is not limited in the embodiment of the present application.
  • the process of determining the mapping relationship between the geographic location information and the restaurant may include: pre-fetching information of all the restaurants on the Internet, where the information of the restaurant may specifically include a restaurant name, a restaurant address, The menu picture, the menu picture corresponding to the dish name in the menu, and the above restaurant address is converted into the geographical location information in the form of latitude and longitude, thereby obtaining the first mapping relationship between the restaurant name and the geographical location information, or the restaurant name and the dish name. And a second mapping relationship between the food picture and the geographical location information, wherein the first mapping relationship and the second mapping relationship may be stored in a restaurant database.
  • Step 103 Perform a search in the restaurant picture corresponding to the restaurant to obtain a result dish picture that is the same as or similar to the food picture;
  • the restaurant picture corresponding to the restaurant can be used to indicate the dish picture corresponding to the menu in the restaurant menu.
  • the restaurant picture corresponding to the restaurant may be obtained from the restaurant picture library of the restaurant.
  • the mapping relationship between the restaurant name and the food picture can be recorded in the restaurant picture library, and the mapping relationship between the restaurant name and the food picture can be found to obtain the food picture corresponding to the restaurant.
  • the dish picture may also be grabbed from the webpage, and a mapping relationship between the dish picture and the restaurant name of the dish may be established.
  • Many commonly used food websites, review websites, group purchase websites or forum websites, etc. will have restaurant information and food information of the restaurant, including the name of the restaurant, the location, the restaurant picture and the name of the dish.
  • the website information and the restaurant information of the restaurant can be obtained by webpage crawling, and the mapping relationship between the dish image and the restaurant name of the dish is established.
  • the photos posted by the web user of the network user, the photos posted by the circle of friends, and the like may be used to obtain the information of the restaurant picture and the restaurant belonging to the dish, and establish a picture of the dish and The mapping relationship of the restaurant name to which the dish belongs.
  • users have been very developed by uploading and publishing information using mobile terminals. When users dine at a restaurant, they will take photos and upload them to a weblog or circle of friends for favorite or satisfied dishes. The publishing platform will be released, and the name of the restaurant will be indicated on the posting theme to recommend to friends. Based on this situation, information related to the dishes published by the network user can be obtained, and the dish picture and the dish can be obtained. Information about the restaurant, and establish a mapping relationship between the dish image and the name of the restaurant to which the dish belongs.
  • the user even if the user does not indicate the name of the restaurant, based on the current mobile terminal having a GPS positioning function, the user will mark the GPS information of the location where the photo was taken when the photo was taken, and the location can be located and found according to the GPS information. Corresponding restaurant information, thereby establishing a mapping relationship between the dish image and the restaurant name of the dish.
  • mapping relationship between the dish picture and the restaurant name of the dish may be obtained by using the above method.
  • the process of searching in the restaurant picture corresponding to the restaurant may specifically include: extracting a first picture feature of the food picture, and then performing a picture search, and the first The picture feature is matched with the second picture feature of the restaurant picture corresponding to the restaurant. If the matching rate is within a certain threshold range (eg, >95%), the two are considered to be the same or similar. For the food picture and the result of the matching rate within a certain threshold range, if there is only a slight difference between the two, such as whether there is a difference between the watermark, the small picture and the big picture, then the subtle difference is eliminated, the two are the same. The picture; if there are differences between the two, except for subtle differences, the two are similar pictures.
  • a certain threshold range eg, >95%)
  • the picture feature of the picture may be extracted by: generating a corresponding flag string for the picture, where the specific process of generating the corresponding flag string for the picture may include: firstly Reduce the size to remove the image details, preserve the structure and shading; then convert the image to grayscale, calculate the average of the grayscale in the grayscale image, and compare the grayscale of each pixel of the image with the average; The result is a combination of the flag string, which is the flag string corresponding to the picture.
  • the above flag string can be composed of flag bits. In this way, in the matching process, the flag strings of the two pictures can be compared. The more bits with the same flag bit, the higher the matching rate of the two pictures, or the fewer the number of bits with different flag bits, then two. The matching rate of the images is higher.
  • the conversion of the grayscale features into the flag is only an example.
  • the visual features such as the texture, the shape, the color, and the like of the image can be extracted, and the visual features are converted into the flag.
  • the specific process of extracting the picture features of the picture and matching the picture features of the two pictures is not limited.
  • Step 104 Determine, according to the name of the dish corresponding to the result of the food, the name of the dish corresponding to the food picture;
  • the result of the same or similar food picture as the food picture is obtained from the restaurant picture corresponding to the restaurant, and the restaurant matches the geographical location information corresponding to the food picture, so it can be considered
  • the probability that the dish corresponding to the result of the food picture and the dish corresponding to the food picture belong to the same restaurant is relatively large, so that the name of the dish corresponding to the result of the food picture can be used as the basis for obtaining the name of the dish corresponding to the food picture.
  • the embodiment of the present application may provide a name of the dish corresponding to the result of the result, and determine The following technical scheme of the food name corresponding to the food picture:
  • the dish name corresponding to the result dish picture can be directly used as the dish name corresponding to the food picture.
  • step 101 can obtain the geographical location information of the food picture, and step 102 can determine the geographical location information.
  • Corresponding restaurants may specifically include: ⁇ (NO.3 ⁇ ), Wushan grilled fish, ⁇ Fresh melon hot pot, scented scent, etc.
  • step 103 may search in the corresponding restaurant picture of the restaurant to obtain
  • the food pictures have the same or similar three results of the food pictures, and the food names corresponding to the three result dishes are: "Spicy Grilled Fish”, “Spicy Grilled Fish” and "Spicy Lobster", then the 3 The name of the dish is provided to the user for the user to select.
  • the result food pictures may be selected according to the matching rate.
  • the M result food pictures with the highest matching rate may be selected, and the present application implements For the specific value of M, there is no limitation.
  • the step of determining the name of the dish corresponding to the food picture according to the name of the dish corresponding to the result of the food item may specifically include:
  • Step S1 performing a search in the Internet menu picture to obtain a reference food picture that is the same as or similar to the food picture;
  • Step S2 screening the result dish image according to the reference dish picture, and using the dish name corresponding to the result of the screening result as the dish name corresponding to the food picture.
  • Internet food pictures can be used to represent pictures of dishes collected in the Internet, which can be derived from websites such as food websites, social networking websites, business websites, etc. Specifically, food pictures and corresponding text descriptions can be retrieved from the above websites, and The result of the capture is the mapping relationship between the Internet dish image and the dish name.
  • the process of searching in the Internet menu picture is similar to the process of searching in the restaurant picture corresponding to the restaurant, so it will not be described here, and mutual reference may be made.
  • the number of reference pictures is far greater than the number of the resulting pictures. Therefore, the reference picture can be used as the evaluation result and the screening result is effective. in accordance with.
  • the step S2 of filtering the result menu image according to the reference food picture may specifically include:
  • Step S21 screening the result food picture according to the number of the first reference food pictures that are the same as or similar to the result food picture; or
  • the result food pictures may be sorted in descending order of the number of the first reference food pictures that are the same as or similar to the result food picture, and the top P result food pictures arranged in front are selected, or Select the resulting dish image with the number greater than the second threshold.
  • Step S22 screening the result dish picture according to the number of the second reference dish pictures that are the same as or similar to the result dish picture and the dish name matches the dish name corresponding to the result dish picture.
  • the matching of the dish name corresponding to the second reference dish image and the dish name corresponding to the result dish image may be used to indicate that the characters corresponding to the two dish names match, and the specifics may include: two dishes having the same or similar names, for example, The "spicy lobster" and the “spicy shrimp" are similar to the name of the dish, etc., and the specific conditions of the matching of the two dish names and the corresponding matching process are not limited in the embodiment of the present application.
  • Step 105 Output a name of the dish corresponding to the food picture.
  • the client may display the dish name corresponding to the food picture in the vicinity of the food picture.
  • the name of the dish corresponding to the food picture may be displayed in a lower area of the food picture of the user: “Spicy roasted “Fish”, “Spicy Grilled Fish” and “Spicy Lobster”, wherein the above-mentioned dish name can be displayed by the control for the user to select.
  • the method of the embodiment of the present application may further include: outputting related information of the name of the dish corresponding to the food picture. Since the user can be provided with richer information automatically, the efficiency of the user to obtain information can be further improved.
  • the above related information may specifically include at least one of a calorie, an ingredient, a cuisine, a preparation time, a taste, a recipe, a production method, a restaurant, and the like. It can be understood that the embodiment of the present application does not limit specific related information. For example, referring to FIG. 3, an example of outputting related information of a dish name corresponding to the above food picture is shown in the embodiment of the present application, wherein, in the case where the user selects the “spicy lobster” shown in FIG. 2, the image may be further output. "Spicy Lobster" information on calories, main ingredients, accessories, spices, cuisine, preparation time, taste, etc.
  • the related information may specifically include at least one of the following information:
  • the restaurant corresponding to the dish name and meeting the preset position condition and/or the preset recommendation condition.
  • a recipe, a production method or a calorie of the dish name can be searched for in a search engine, a food-related website, or a food-related APP (Application, Application, or Wikipedia APP), and displayed. To the user.
  • a search engine a food-related website
  • a food-related APP Application, Application, or Wikipedia APP
  • a restaurant that meets the preset position condition and/or the preset recommendation degree can be searched for on the search engine, or the food-related website, or the food-related APP, and displayed to the user.
  • the preset position condition may be used to limit the distance between the geographical location information of the restaurant and the geographical location information corresponding to the food image, and the distance may be less than a distance threshold, and the distance threshold may be 500 m or the like.
  • the distance threshold is not limited; the preset recommendation degree condition may be used to constrain the recommendation degree of the restaurant, and the recommendation degree may be obtained based on the user's behaviors such as the evaluation behavior, the like behavior, the recommendation behavior, and the like of the restaurant.
  • the preset recommendation degree is The condition may be that the recommendation degree is greater than the recommendation degree threshold, or the preset recommendation degree condition may be that the ranking result of the recommendation degree is ranked in the first N digits, etc., and N is a natural number greater than or equal to 1, and the embodiment of the present application is specific to the preset recommendation. Degree conditions are not limited.
  • step 101 to the step 105 in the embodiment of the present application may be performed by the client, or may be performed by the server, or may be performed by the client and the server. No restrictions.
  • the embodiment of the present application can automatically output the name of the dish corresponding to the food picture without the user knowing the name of the dish or entering the text.
  • the user quickly obtains the name of the dish, or obtains further information according to the name of the dish (for example, applying the name of the dish to a search engine to obtain further calories, etc.), since the operation of inputting characters by the user can be saved, the difficulty of obtaining information can be reduced. And can improve the efficiency of obtaining information;
  • the user A needs to input the name of the dish in the search engine to obtain the calories included in the dish by the result provided by the search engine; and the embodiment of the present application can automatically output the name of the dish corresponding to the food picture. Since the operation of inputting characters by the user can be saved, the difficulty of acquiring information can be reduced, and the efficiency of acquiring information can be improved;
  • the embodiment of the present application determines the restaurant near the user according to the geographical location information corresponding to the food picture, and obtains the same as the food picture within the range of the food picture corresponding to the restaurant. Or a similar result food picture, and then determining the food name corresponding to the food picture according to the food name corresponding to the result food picture; on the one hand, since the range of the corresponding food picture of the above restaurant is much smaller than the traditional Internet picture range, The embodiment of the present application can reduce the comparison range of the picture matching as much as possible, thereby ensuring the speed of the food picture recognition. On the other hand, the correspondence between the restaurant picture corresponding to the restaurant and the food picture actually provided by the same restaurant is high, therefore, The embodiment of the present application can ensure the accuracy of food picture recognition;
  • the embodiment of the present application may further output related information of the name of the dish corresponding to the food picture, which obtains related information of the dish through the search engine relative to the existing solution, and may automatically provide the user with related information such as calories corresponding to the dish. Therefore, the efficiency of the user to obtain information can be further improved;
  • the embodiment of the present application is applied to a processing flow of uploading, backing, beautifying, etc. of a food picture. Cheng Cheng, can also improve the processing efficiency of food pictures;
  • the embodiment of the present application can automatically output the name of the dish corresponding to the food picture.
  • the present application implements The example can also improve the uploading efficiency of food pictures.
  • the embodiment of the present application can automatically output the name of the dish corresponding to the food picture, so that the user inputs the item name into the food picture through a selection operation.
  • FIG. 4 a flow chart of the steps of the second embodiment of the information processing method of the present application is shown, which may specifically include the following steps:
  • Step 401 The client obtains a food picture of the user and geographic location information corresponding to the food picture.
  • Step 402 The client sends the food picture and the geographical location information corresponding to the food picture to the server.
  • Step 403 After receiving the food picture and the geographic location information corresponding to the food picture, the server determines the restaurant corresponding to the geographical location information;
  • Step 404 The server performs a search in the restaurant picture corresponding to the restaurant to obtain a result dish picture that is the same as or similar to the food picture;
  • Step 405 The server determines, according to the name of the dish corresponding to the result of the food, the name of the dish corresponding to the food picture;
  • Step 406 The server outputs the name of the dish corresponding to the food picture to the client.
  • Step 407 After receiving the name of the dish corresponding to the food picture, the client displays the name of the dish corresponding to the food picture.
  • the embodiment obtains the food picture of the user, the geographical location information corresponding to the food picture, and the name of the dish corresponding to the food picture.
  • the line is displayed, and the name of the dish corresponding to the food picture is identified by the server; since a large amount of computing work is performed in the server, the amount of calculation of the client can be greatly reduced, that is, the resource consumption of the client can be greatly reduced, thereby improving
  • the running time and running efficiency of the client can improve the practicability of the client; and it can also take advantage of the rich computing resources of the server side (cloud resources in the cloud server), thereby improving the recognition accuracy and identification of the dish name corresponding to the food picture. effectiveness.
  • FIG. 5 a flow chart of the steps of the third embodiment of the information processing method of the present application is shown, which may specifically include the following steps:
  • Step 501 The client obtains a photo of the food photographed by the user, and location information included in the photo of the food;
  • Step 502 The client sends the food picture and the geographical location information corresponding to the food picture to the server.
  • Step 503 The server receives the food picture and geographic location information corresponding to the food picture.
  • Step 504 The server determines the restaurant corresponding to the geographical location information, and performs a search in the restaurant picture corresponding to the restaurant to obtain a result dish picture that is the same as or similar to the food picture;
  • Step 505 The server searches in the Internet menu picture to obtain a reference picture picture that is the same as or similar to the food picture.
  • Step 506 The server selects the result dish picture according to the reference dish picture, and uses the dish name corresponding to the selected dish picture as the dish name corresponding to the food picture.
  • the user extracts the picture features of the food picture, and obtains tens of thousands of reference pictures with a matching rate within a certain threshold range from the Internet food picture library.
  • These reference dishes can include a large number of "Kung Pao Chicken” Ding” related pictures, but also included more "Spicy Chicken”, “Sweet and Sour Ridge” and other similar pictures.
  • Step 504 can obtain a list of several restaurants in the vicinity according to the location of the restaurant where the user photographs, and further obtain all the food pictures and the name of the dishes of the restaurants. After matching the picture features of the food picture and the picture picture, the result picture and the result are obtained.
  • the corresponding dish name is "Kung Pao Chicken”.
  • Step 506 may perform comprehensive processing on the information outputted in step 504 and step 505.
  • the comprehensive processing result indicates that “Kung Pao Chicken” has the highest probability of appearing in the reference food picture, Output this result for the dish name.
  • Step 507 The server outputs the name of the dish corresponding to the food picture to the client.
  • Step 508 After receiving the name of the dish corresponding to the food picture, the client displays the name of the dish corresponding to the food picture.
  • FIG. 6 a structural block diagram of an embodiment of an information processing apparatus of the present application is shown, which may specifically include the following modules:
  • the obtaining module 601 is configured to obtain a food picture of the user and geographic location information corresponding to the food picture;
  • a first determining module 602 configured to determine a restaurant corresponding to the geographic location information
  • the searching module 603 is configured to perform a search in the restaurant picture corresponding to the restaurant to obtain a result dish picture that is the same as or similar to the food picture;
  • a second determining module 604 configured to determine a name of the food corresponding to the food picture according to the name of the dish corresponding to the result of the food item;
  • the first output module 605 is configured to output a name of the dish corresponding to the food picture.
  • the first determining module 602 may specifically include:
  • the search sub-module is configured to perform a search in the mapping relationship between the geographic location information and the restaurant according to the geographical location information, to obtain a restaurant corresponding to the geographic location information.
  • the second determining module 604 may specifically include:
  • a first determining submodule configured to use the name of the dish corresponding to the result dish image as the name of the dish corresponding to the food picture;
  • a second determining sub-module configured to perform a search in the Internet menu picture to obtain a reference food picture that is the same as or similar to the food picture; filter the result food picture according to the reference food picture, and filter the image As a result, the dish name corresponding to the dish image is used as the dish name corresponding to the food picture.
  • the second determining sub-module may specifically include:
  • a first screening unit configured to filter the result dish image according to the number of the first reference dish pictures that are the same as or similar to the result dish picture;
  • a second screening unit configured to perform the result image on the basis of the number of the second reference menu pictures that are the same as or similar to the result menu picture and the dish name matches the dish name corresponding to the result menu picture filter.
  • the geographic location information corresponding to the food image may specifically include: geographic location information carried by the food image and/or geographic location information of a terminal to which the food image belongs.
  • the acquiring module 601 may specifically include:
  • a first obtaining sub-module located at the client, for obtaining a picture of the food uploaded by the user;
  • a second obtaining sub-module located at the client, for obtaining a picture of the food photographed by the user;
  • the third obtaining sub-module is located at the server, and is configured to receive a food picture sent by the client.
  • the apparatus may further include:
  • a second output module configured to output information about the name of the dish corresponding to the food picture.
  • the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • FIG. 7 is a block diagram of an apparatus 800 for information processing, according to an exemplary embodiment.
  • device 800 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a gaming console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • device 800 can include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, And a communication component 816.
  • Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • Processing component 802 can include one or more processors 820 to execute instructions to perform all or part of the steps of the above described methods.
  • processing component 802 can include one or more modules to facilitate interaction between component 802 and other components.
  • processing component 802 can include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.
  • Memory 804 is configured to store various types of data to support operation at device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phone book data, messages, pictures, videos, and the like.
  • the memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Electrically erasable programmable read only memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • Power component 806 provides power to various components of device 800.
  • Power component 806 can include A power management system, one or more power sources, and other components associated with generating, managing, and distributing power for device 800.
  • the multimedia component 808 includes a screen between the device 800 and the user that provides an output interface.
  • the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor may sense not only the boundary of the touch or sliding action, but also the duration and pressure associated with the touch or slide operation.
  • the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 810 is configured to output and/or input an audio signal.
  • the audio component 810 includes a microphone (MIC) that is configured to receive an external audio signal when the device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode.
  • the received audio signal may be further stored in memory 804 or transmitted via communication component 816.
  • the audio component 810 also includes a speaker for outputting an audio signal.
  • the I/O interface 812 provides an interface between the processing component 802 and the peripheral interface module, which may be a keyboard, a click wheel, a button, or the like. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.
  • Sensor assembly 814 includes one or more sensors for providing device 800 with a status assessment of various aspects.
  • sensor assembly 814 can detect an open/closed state of device 800, a relative positioning of components, such as the display and keypad of device 800, and sensor component 814 can also detect a change in position of one component of device 800 or device 800. The presence or absence of user contact with device 800, device 800 orientation or acceleration/deceleration, and temperature variation of device 800.
  • Sensor assembly 814 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact.
  • Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 814 can also include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature transmitter. Sensor.
  • Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices.
  • the device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component 816 receives broadcast signals or broadcast associated information from an external broadcast management system via a broadcast channel.
  • the communication component 816 also includes a near field communication (NFC) module to facilitate short range communication.
  • NFC near field communication
  • the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
  • RFID radio frequency identification
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • device 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic component implementation for performing the above methods.
  • non-transitory computer readable storage medium comprising instructions, such as a memory 804 comprising instructions executable by processor 820 of apparatus 800 to perform the above method.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • a non-transitory computer readable storage medium when instructions in the storage medium are executed by a processor of a mobile terminal, enabling the mobile terminal to perform an information processing method, the method comprising: acquiring a food picture of the user, And the geographical location information corresponding to the food image; determining a restaurant corresponding to the geographical location information; performing a search in the food picture corresponding to the restaurant to obtain a result food picture identical or similar to the food picture; Determining the name of the dish corresponding to the result of the food, determining the name of the dish corresponding to the food picture; and outputting the name of the item corresponding to the food picture.
  • FIG. 8 is a schematic structural diagram of a server in some embodiments of the present application.
  • the server 1900 can vary considerably depending on configuration or performance, and can include one or more central processing units (CPUs) 1922 (eg, one or more processors) and memory 1932, one or one The above storage medium 1942 or storage medium 1930 of data 1944 (eg, one or one storage device in Shanghai).
  • the memory 1932 and the storage medium 1930 may be short-term storage or persistent storage.
  • the program stored in the storage medium 1930 may include a One or more modules (not shown), each module may include a series of instruction operations on the server.
  • central processor 1922 can be configured to communicate with storage medium 1930, which performs a series of instruction operations in storage medium 1930.
  • Server 1900 may also include one or more power sources 1926, one or more wired or wireless network interfaces 1950, one or more input and output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941.
  • power sources 1926 For example, Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
  • Figure 9 illustrates a computing device for performing an information processing method in accordance with the present invention.
  • the computing device conventionally includes a processor 1410 and a program product or readable medium in the form of a memory 1420.
  • the memory 1420 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, or a ROM.
  • Memory 1420 has a memory space 1430 for program code 1431 for performing any of the method steps described above.
  • storage space 1430 for program code may include various program code 1431 for implementing various steps in the above methods, respectively.
  • These program codes can be read from or written to one or more program products.
  • These program products include program code carriers such as memory cards.
  • Such a program product is typically a portable or fixed storage unit as described with reference to FIG.
  • the storage unit may have storage segments, storage spaces, and the like that are similarly arranged to the storage 1420 in the computing device of FIG.
  • the program code can be compressed, for example, in an appropriate form.
  • the storage unit includes readable code 1431', ie, code that can be read by, for example, a processor such as 1410, which when executed by the computing device causes the computing device to perform various steps in the methods described above .

Abstract

一种信息处理方法和装置、一种用于信息处理的装置,其中的信息处理方法具体包括:获取用户的食物图片、及所述食物图片对应的地理位置信息(101);确定所述地理位置信息对应的餐厅(102);在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片(103);依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称(104);输出所述食物图片对应的菜品名称(105)。该方法和装置能够降低获取信息的难度,且能够提高获取信息的效率。

Description

一种信息处理方法和装置、一种用于信息处理的装置
本申请要求在2015年12月25日提交中国专利局、申请号为201510997719.1、发明名称为“一种信息处理方法和装置、一种用于信息处理的装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及互联网信息处理技术领域,特别是涉及一种信息处理方法、一种信息处理装置和一种用于信息处理的装置。
背景技术
随着互联网技术的发展,越来越多的用户通过互联网获得信息。互联网的发展所带来的信息量增大,使得用户在获取信息的时候越来越依靠于搜索引擎,伴随着互联网的发展成长起来的年轻消费者,在获取信息和进行消费时更加依赖网络搜索。
例如,用户A正在减肥中,为控制饮食,其需要记录自己每天摄入的食物中包含的卡路里,则现有方案中,用户A需要在每次吃饭的过程中,在搜索引擎中输入菜品的名称,以通过搜索引擎提供的结果获得该菜品所包含的卡路里。
然而,用户在使用现有方案的过程中,有时会遇到这样的问题:菜品并不是用户亲自烹饪或亲自点的,故在餐桌上看到菜品,但并不知道该菜品的名称是什么;或者,用户忙于用餐或聊天而不方便输入文字;因此,上述通过搜索引擎获取信息的方式,增加了用户获取信息的难度,从而影响了用户获取信息的效率。
发明内容
鉴于上述问题,提出了本申请实施例以便提供一种克服上述问题或者至少部分地解决上述问题的信息处理方法、相应的信息处理装置和用于信息处理的装置,能够降低获取信息的难度,且能够提高获取信息的效率。
为了解决上述问题,本申请公开了一种信息处理方法,包括:
获取用户的食物图片、及所述食物图片对应的地理位置信息;
确定所述地理位置信息对应的餐厅;
在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
输出所述食物图片对应的菜品名称。
另一方面,本申请公开了一种信息处理装置,包括:
获取模块,用于获取用户的食物图片、及所述食物图片对应的地理位置信息;
第一确定模块,用于确定所述地理位置信息对应的餐厅;
搜索模块,用于在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
第二确定模块,用于依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;及
第一输出模块,用于输出所述食物图片对应的菜品名称。
再一方面,本申请公开了一种用于信息处理的装置,包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于进行以下操作的指令:
获取用户的食物图片、及所述食物图片对应的地理位置信息;
确定所述地理位置信息对应的餐厅;
在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
输出所述食物图片对应的菜品名称。
本申请实施例包括以下优点:
首先,本申请实施例自动识别并输出用户的食物图片对应的菜品名称,这样,本申请实施例能够在用户不知道菜品名称、或者不方便输入文字的情况下,自动输出食物图片对应的菜品名称,以使用户快速获得该菜品名称、或者依据该菜品名称获取进一步的信息(如将该菜品名称应用于搜索引擎获取进一步的卡路里等信息),由于可以节省用户输入文字的操作,因此能够降低获取信息的难度,且能够提高获取信息的效率;
例如,现有方案中,用户A需要在搜索引擎中输入菜品的名称,以通过搜索引擎提供的结果获得该菜品所包含的卡路里;而本申请实施例可以自动输出该美食图片对应的菜品名称,由于可以节省用户输入文字的操作,因此能够降低获取信息的难度,且能够提高获取信息的效率;
其次,本申请实施例在识别食物图片对应的菜品名称的过程中,依据食物图片对应的地理位置信息确定用户附近的餐厅,在上述餐厅对应的菜品图片的范围内得到与所述食物图片相同或相似的结果菜品图片,进而依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;一方面,由于上述餐厅对应的菜品图片的范围远小于传统的互联网图片范围,因此,本申请实施例能够尽可能地缩小图片匹配的对比范围,从而能够保证食物图片识别的速度,另一方面,餐厅对应的菜品图片与同一餐厅实际提供的食物图片的相关度较高,因此,本申请实施例能够保证食物图片识别的精度;
再者,本申请实施例还可以输出所述食物图片对应的菜品名称的相关信息,这相对于现有方案通过搜索引擎获得菜品的相关信息,由于可以自动向用户提供菜品对应的卡路里等相关信息,因此可以进一步提高用户获取信息的效率;
另外,本申请实施例在应用于食物图片的上传、备份等处理流程时,还可以提高食物图片的处理效率;
例如,现有方案中,当用户B在微信的好友圈上传美食图片后,需要在好友圈的输入框中输入美食图片的菜品名称;而本申请实施例可以自动 输出该美食图片对应的菜品名称,以使用户通过选择操作将该菜品名称输入至好友圈的输入框中;由于上述选择操作的时间成本远小于在好友圈的输入框中输入美食图片的菜品名称的操作,因此,本申请实施例还可以提高食物图片的上传效率。
附图说明
图1是本申请的一种信息处理方法实施例一的步骤流程图;
图2是本申请实施例的一种输出所述食物图片对应的菜品名称的示例;
图3是本申请实施例的一种输出上述食物图片对应的菜品名称的相关信息的示例;
图4是本申请的一种信息处理方法实施例二的步骤流程图;
图5是本申请的一种信息处理方法实施例三的步骤流程图;
图6是本申请的一种信息处理装置实施例的结构框图;
图7是本申请的一种用于输入的装置800的框图;
图8是本申请的一些实施例中一种服务器的结构示意图;
图9是用于执行根据本申请的信息处理方法的计算设备的框图;
图10是用于保持或者携带实现根据本申请的信息处理方法的程序代码的存储单元。
具体实施方式
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。
方法实施例一
参照图1,示出了本申请的一种信息处理方法实施例一的步骤流程图,具体可以包括如下步骤:
步骤101、获取用户的食物图片、及所述食物图片对应的地理位置信息;
本申请实施例可以应用于PC(个人计算机、Personal Computer)、手机、平板电脑等终端的应用程序(如信息处理程序)中,当该应用程序获取 到用户的食物图片时,可以自动识别并输出该食物图片对应的菜品名称,这样,本申请实施例能够在用户不知道菜品名称、或者不方便输入文字的情况下,自动输出食物图片对应的菜品名称,以使用户快速获得该菜品名称、或者依据该菜品名称获取进一步的信息(如将该菜品名称应用于搜索引擎获取进一步的卡路里等信息),由于可以节省用户输入文字的操作,因此能够降低获取信息的难度,且能够提高获取信息的效率。
本申请实施例中,食物图片可以是包含有食物的图片,本申请实施例对于具体的食物图片不加以限制。
本申请实施例可以提供如下获取用户的食物图片的技术方案:
技术方案A1
技术方案A1中,客户端可以获取用户上传的食物图片,具体地,在本申请实施例的信息处理程序客户端(以下简称客户端)检测到用户上传食物图片的操作时,可以获取对应的食物图片。
例如,在本申请实施例的一种应用示例1中,用户B在微信的好友圈上传美食图片,则本申请实施例的客户端可以检测并获取上述美食图片。
可以理解,上述获取用户通过微信上传的美食图片只是作为示例,实际上,本申请实施例的客户端也可以提供上传接口,以使用户通过上述上传接口进行食物图片的上传,本申请实施例对于具体的上传接口不加以限制。
技术方案A2
技术方案A2中,客户端可以获取用户拍摄的食物图片。例如,在本申请实施例的一种应用示例2中,用户A正在减肥中,为控制饮食,需要记录自己每天摄入的食物中包含的卡路里,也即在每次吃饭的过程中,都需要知道菜品的卡路里;则用户A在吃饭前,可以通过照相机等具有拍摄功能的拍摄模块拍摄菜品对应的食物图片,而本申请实施例的客户端可以检测到上述拍摄操作,并获取上述拍摄操作对应的食物图片。
技术方案A3
相对于技术方案A1和技术方案A2应用于客户端,技术方案A3可以应 用于服务器,具体地,服务器可以接收客户端发送的食物图片。其中,客户端在获取到用户上传或拍摄的食物图片后,可以向服务器发送所获取的食物图片,由服务器对上述食物图片对应的菜品名称进行识别。由于大量的运算工作在服务器中执行,故能够大大降低客户端的运算量,也即能够大大降低客户端的资源消耗,从而能够提高客户端的运行时间和运行效率,且能够提高客户端的实用性;并且,还能够发挥服务器侧计算资源(云服务器中云资源)丰富的优势,从而能够提高食物图片对应的菜品名称的识别精度和识别效率。
以上对获取用户的食物图片的几种技术方案进行了详细介绍,可以理解,本领域技术人员可以根据实际应用需求,采用上述技术方案中的任一或者组合,或者,还可以采用获取用户的食物图片的其他技术方案,如客户端通过用户提交的食物图片的网络地址获取用户的食物图片等,本申请实施例对于获取用户的食物图片的具体技术方案不加以限制。
上述食物图片对应的地理位置信息可用于反映食物图片对应的菜品所处的地理位置信息。在本申请的一种可选实施例中,所述食物图片对应的地理位置信息具体可以包括:所述食物图片携带的地理位置信息和/或所述食物图片所属终端的地理位置信息。其中,上述地理位置信息可以采用经纬度等信息来表示,本申请实施例对于地理位置信息的具体表示方式不加以限制。
目前,手机、相机等大多数终端均具有GPS(全球定位系统,Global Positioning System)的定位功能;并且,其上运行的拍摄模块可以将拍摄地点的GPS信息写入图片。这样,在图片的后期处理时,可以通过从图片的EXIF(可交换图像文件,Exchangeable Image File)信息中读取上述GPS信息。例如,对于上述应用示例2,用户A在“簋街仔仔”餐厅(餐厅地址为东城区东直门内大街193号)吃饭,其想知道饭桌上某道菜品的卡路里,于是用手机拍摄该道菜品得到对应的食物图片,则该食物图片中就可以携带当前拍摄手机所处的地理位置信息,即为该道菜品所处的地理位置信息。
可以理解,在食物图片未携带地理位置信息的情况(例如,食物图片是 用不带GPS功能的相机拍摄的)下,依据用户对于菜品的消费属性、及用户与手机之间的不分离特性,可以将所述食物图片所属终端的地理位置信息作为食物图片对应的菜品所处的地理位置信息。
步骤102、确定所述地理位置信息对应的餐厅;
在实际应用中,所述地理位置信息对应的餐厅可用于表示地理位置信息附近的餐厅,其具体可以包括:距离上述地理位置信息最近的N个餐厅,或者,与上述地理位置信息之间的距离小于第一阈值的餐厅等;其中,由于某些位置餐厅密集分布的特性容易导致餐厅的区分度较低,故为了避免错失上述食物图片对应的菜品所处的餐厅,可以将上述N和上述第一阈值的数值设置得大一些;而由于某些位置餐厅稀疏分布的特性容易使得餐厅的区分度较高,故可以将上述N和上述第一阈值的数值设置得小一些,可以理解,本申请实施例对于N和第一阈值的具体数值不加以限制。
在本申请的一种可选实施例中,所述确定所述地理位置信息对应的餐厅的步骤,包括:依据所述地理位置信息在地理位置信息与餐厅的映射关系中进行查找,以得到所述地理位置信息相对应的餐厅。其中,在所述地理位置信息相对应的餐厅的数目为多个时,可以得到所述地理位置信息相对应的餐厅列表,例如,在上述地理位置信息为簋街附近的经纬度时,可以得到簋街附近的餐厅列表。可以理解,本申请实施例对于确定所述地理位置信息对应的餐厅的具体过程不加以限制。
在本申请的另一种可选实施例中,确定地理位置信息与餐厅的映射关系的过程可以包括:预先抓取互联网上所有餐厅的信息,上述餐厅的信息具体可以包括餐厅名称、餐厅地址、菜单、菜单中菜名对应的菜品图片等,并将上述餐厅地址转化为经纬度形式的地理位置信息,从而得到餐厅名称与地理位置信息的第一映射关系,或者,还可以得到餐厅名称、菜名、菜品图片与地理位置信息的第二映射关系,其中,上述第一映射关系和第二映射关系均可被存储在餐厅数据库中。
步骤103、在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
餐厅对应的菜品图片可用于表示餐厅的菜单中菜品对应的菜品图片。在本申请的一种可选实施例中,可以从餐厅的菜品图片库中获取餐厅对应的菜品图片。具体地,餐厅的菜品图片库中可以记录有餐厅名称与菜品图片的映射关系,则可以查找上述餐厅名称与菜品图片的映射关系,以得到上述餐厅对应的菜品图片。
在本申请的另一种可选实施例中,也可以从网页中抓取菜品图片,并建立菜品图片与该菜品所属餐厅名称的映射关系。现有常用的很多美食网站、点评网站、团购网站或论坛类网站等,都会有餐厅信息以及该餐厅的菜品信息,其中就包括餐厅名称、所在位置、餐厅菜品图片以及菜品名称等。本申请中,可以通过网页抓取,获取餐厅信息以及餐厅的菜品信息,并建立菜品图片与该菜品所属餐厅名称的映射关系。
在本申请的再一种可选实施例中,还可以从网络用户的网络日志发布的照片、朋友圈发布的照片等途径,来获取菜品图片与该菜品所属餐厅的信息,并建立菜品图片与该菜品所属餐厅名称的映射关系。具体的,随着互联网技术的发展,用户利用移动终端上传并发布信息已经非常发达,当用户在某餐厅用餐时,对于比较喜欢或满意的菜品,会随手拍摄照片并上传至网络日志或朋友圈等发布平台进行发布,而且会在发布主题上注明餐厅的名称,以示向朋友推荐等,基于这种情况,可以获取网络用户发布的与菜品相关的信息,并挖掘得到菜品图片与该菜品所属餐厅的信息,并建立菜品图片与该菜品所属餐厅名称的映射关系。
另一方面,即使用户没有注明餐厅的名称,但是基于当前移动终端都有GPS定位功能,用户在拍摄照片时会标记该照片拍摄地的GPS信息,依据该GPS信息可以定位并查找得到该位置对应的餐厅信息,由此可以建立菜品图片与该菜品所属餐厅名称的映射关系。
当然,在本申请其他实施例中,可以但不限于采用上述方法获得菜品图片与该菜品所属餐厅名称的映射关系。
在实际应用中,在所述餐厅对应的菜品图片中进行搜索的过程具体可以包括:提取食物图片的第一图片特征,然后进行图片搜索,将上述第一 图片特征与餐厅对应的菜品图片的第二图片特征进行匹配,如果匹配率在一定阈值范围(如>95%)内,可认为二者相同或相似。对于食物图片和匹配率在一定阈值范围内的结果菜品图片,如果二者仅有细微的差别,如是否带水印、小图片和大图片的差别等,则刨除这些细微的差别,二者就是相同的图片;如果二者还有除细微的差别之外的差别,则二者就是相似的图片。
在本申请的一种可选实施例中,可以通过如下步骤提取图片的图片特征:针对图片生成对应的标志字符串,其中,针对图片生成对应的标志字符串的具体过程可以包括:先将图片缩小尺寸,以去除图片细节,保留结构和明暗;再将图片转为灰度图,计算灰度图中灰度的平均值,并将图片每个像素的灰度与平均值进行比较;比较的结果组合成为的标志位字符串,就是图片对应的标志字符串,上述标志字符串可由标志位组成。这样,在匹配过程中,可以比较两个图片的标志字符串,标志位相同的位数越多,则两个图片的匹配率越高,或者,标志位不相同的位数越少,则两个图片的匹配率越高。
可以理解,将灰度特征转化为标志位只是作为示例,实际上,还可以提取图片的纹理、形状、颜色等视觉特征,并将这些视觉特征转化为标志位,可以理解,本申请实施例对于提取图片的图片特征、以及匹配两个图片的图片特征的具体过程不加以限制。
步骤104、依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
本申请实施例中,对于与上述食物图片相同或相似的结果菜品图片,由于其源自上述餐厅对应的菜品图片,而上述餐厅又与上述食物图片对应的地理位置信息相匹配,因此,可以认为,上述结果菜品图片对应的菜品和上述食物图片对应的菜品属于同一餐厅的概率较大,从而,所述结果菜品图片对应的菜品名称能够作为获取所述食物图片对应的菜品名称的依据。
本申请实施例可以提供依据所述结果菜品图片对应的菜品名称,确定 所述食物图片对应的菜品名称的如下技术方案:
技术方案B1
技术方案B1中,可以直接将所述结果菜品图片对应的菜品名称作为所述食物图片对应的菜品名称。
对于上述应用示例2,用户A在“簋街仔仔”餐厅的总店吃饭,其拍摄了某道菜品的食物图片,则步骤101可以获取该食物图片的地理位置信息,步骤102可以确定上述地理位置信息对应的餐厅,具体可以包括:簋街仔仔(NO.3店)、巫山烤鱼、呱呱呷鲜瓜火锅、处留香等,步骤103可以在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的3副结果菜品图片,这3副结果菜品图片对应的菜品名称分别为:“麻辣烤鱼”、“香辣烤鱼”和“麻辣龙虾”,则可以将该3种菜品名称提供给用户,供用户选择。
需要说明的是,在与所述食物图片相似的结果菜品图片的数目较多时,可以依据匹配率对这些结果菜品图片进行筛选,例如,可以选取匹配率最高的M幅结果菜品图片,本申请实施例对于M的具体数值不加以限制。
技术方案B2
技术方案B2中,上述依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称的步骤,具体可以包括:
步骤S1、在互联网菜品图片中进行搜索,以得到与所述食物图片相同或相似的参考菜品图片;
步骤S2、依据所述参考菜品图片对所述结果菜品图片进行筛选,并将筛选后结果菜品图片对应的菜品名称,作为所述食物图片对应的菜品名称。
互联网菜品图片可用于表示在互联网范围内收集的菜品图片,其可以来源于美食网站、社交网站、商务网站等网站,具体地,可以从上述网站中抓取菜品图片及对应的文字描述,并依据抓取结果得到互联网菜品图片与菜品名称的映射关系。
对于在互联网菜品图片中进行搜索的过程而言,由于其与在述餐厅对应的菜品图片中进行搜索的过程类似,故在此不作赘述,相互参照即可。
由于互联网菜品图片的数量级远远大于餐厅的菜品图片的数量级,故参考菜品图片的数量也远远大于结果菜品图片的数量,从而,参考菜品图片可以作为评价结果菜品图片和筛选结果菜品图片的有效依据。
在本申请的一种可选实施例中,所述依据所述参考菜品图片对所述结果菜品图片进行筛选的步骤S2,具体可以包括:
步骤S21、依据与所述结果菜品图片相同或相似的第一参考菜品图片的数量,对所述结果菜品图片进行筛选;或者
例如,可以按照与所述结果菜品图片相同或相似的第一参考菜品图片的数量从大到小的顺序,对结果菜品图片进行排序,并选取排在前面的前P幅结果菜品图片,或者,选取排在前面的、数量大于第二阈值的结果菜品图片。
步骤S22、依据与所述结果菜品图片相同或相似的、且菜品名称与所述结果菜品图片对应的菜品名称相匹配的第二参考菜品图片的数量,对所述结果菜品图片进行筛选。
第二参考菜品图片对应的菜品名称与结果菜品图片对应的菜品名称相匹配可用于表示两个菜品名称对应的文字相匹配,其具体可以包括:两个菜品名称相同或者相似两种情况,例如,“麻辣龙虾”与“麻辣小虾”为相似的菜品名称等,本申请实施例对于两个菜品名称相匹配的具体条件及对应的匹配过程不加以限制。
步骤105、输出所述食物图片对应的菜品名称。
在本申请的一种可选实施例中,客户端可以将上述食物图片对应的菜品名称展现在上述食物图片的附近区域。参照图2,示出了本申请实施例的一种输出所述食物图片对应的菜品名称的示例,其中,可以在用户的食物图片的下方区域展现所述食物图片对应的菜品名称:“麻辣烤鱼”、“香辣烤鱼”和“麻辣龙虾”,其中,可以通过控件展现上述菜品名称以供用户选择。
在本申请的另一种可选实施例中,本申请实施例的方法还可以包括:输出所述食物图片对应的菜品名称的相关信息。由于可以自动向用户提供更丰富的信息,因此可以进一步提高用户获取信息的效率。其中,上述相关信息具体可以包括:卡路里、配料、菜系、准备时间、口味、食谱、制作方法、餐厅等信息中的至少一种,可以理解,本申请实施例对于具体的相关信息不加以限制。例如,参照图3,示出了本申请实施例的一种输出上述食物图片对应的菜品名称的相关信息的示例,其中,在用户选择图2所示“麻辣龙虾”的情况下,可以进一步输出“麻辣龙虾”的的卡路里、主料、辅料、调料、菜系、准备时间、口味等信息。
在本申请的再一种可选实施例中,所述相关信息具体可以包括如下信息中的至少一种:
所述菜品名称的食谱和/或制作方法;
所述菜品名称的卡路里;及
所述菜品名称对应的、符合预置位置条件和/或预置推荐度条件的餐厅。
在实际应用中,可以依据上述菜品名称,在搜索引擎、或者美食相关网站、或者美食相关APP(应用程序,Application)、或者百科APP中搜索得到该菜品名称的食谱、制作方法或卡路里,并展示给用户。
可以依据上述菜品名称,在搜索引擎、或者美食相关网站、或者美食相关APP等搜索得到符合预置位置条件和/或预置推荐度条件的餐厅,并展示给用户。其中,上述预置位置条件可用于约束餐厅的地理位置信息与上述食物图片对应的地理位置信息之间的距离,该距离可以小于距离阈值,该距离阈值可以为500m等,本申请实施例对于具体的距离阈值不加以限制;上述预置推荐度条件可用于约束餐厅的推荐度,该推荐度可基于用户对于餐厅的评价行为、点赞行为、推荐行为等行为得到,通常,上述预置推荐度条件可以为推荐度大于推荐度阈值,或者,上述预置推荐度条件可以为推荐度的排序结果排在前N位等,N为大于等于1的自然数,本申请实施例对于具体的预置推荐度条件不加以限制。
需要说明的是,本申请实施例的步骤101-步骤105可由客户端执行,也可由服务器执行,或者,还可由客户端和服务器配合执行,本申请实施例对于步骤101-步骤105对应的执行主体不加以限制。
综上,本申请实施例具有如下优点:
第一,自动识别并输出用户的食物图片对应的菜品名称,这样,本申请实施例能够在用户不知道菜品名称、或者不方便输入文字的情况下,自动输出食物图片对应的菜品名称,以使用户快速获得该菜品名称、或者依据该菜品名称获取进一步的信息(如将该菜品名称应用于搜索引擎获取进一步的卡路里等信息),由于可以节省用户输入文字的操作,因此能够降低获取信息的难度,且能够提高获取信息的效率;
例如,现有方案中,用户A需要在搜索引擎中输入菜品的名称,以通过搜索引擎提供的结果获得该菜品所包含的卡路里;而本申请实施例可以自动输出该美食图片对应的菜品名称,由于可以节省用户输入文字的操作,因此能够降低获取信息的难度,且能够提高获取信息的效率;
第二,本申请实施例在识别食物图片对应的菜品名称的过程中,依据食物图片对应的地理位置信息确定用户附近的餐厅,在上述餐厅对应的菜品图片的范围内得到与所述食物图片相同或相似的结果菜品图片,进而依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;一方面,由于上述餐厅对应的菜品图片的范围远小于传统的互联网图片范围,因此,本申请实施例能够尽可能地缩小图片匹配的对比范围,从而能够保证食物图片识别的速度,另一方面,餐厅对应的菜品图片与同一餐厅实际提供的食物图片的相关度较高,因此,本申请实施例能够保证食物图片识别的精度;
第三,本申请实施例还可以输出所述食物图片对应的菜品名称的相关信息,这相对于现有方案通过搜索引擎获得菜品的相关信息,由于可以自动向用户提供菜品对应的卡路里等相关信息,因此可以进一步提高用户获取信息的效率;
第四,本申请实施例在应用于食物图片的上传、备份、美化等处理流 程时,还可以提高食物图片的处理效率;
例如,现有方案中,当用户B在微信的好友圈上传美食图片后,需要在好友圈的输入框中输入美食图片的菜品名称;而本申请实施例可以自动输出该美食图片对应的菜品名称,以使用户通过选择操作将该菜品名称输入至好友圈的输入框中;由于上述选择操作的时间成本远小于在好友圈的输入框中输入美食图片的菜品名称的操作,因此,本申请实施例还可以提高食物图片的上传效率。
又如,在用户美化美食图片的过程中,本申请实施例可以自动输出该美食图片对应的菜品名称,以使用户通过选择操作将该菜品名称放入该美食图片中。
方法实施例二
参照图4,示出了本申请的一种信息处理方法实施例二的步骤流程图,具体可以包括如下步骤:
步骤401、客户端获取用户的食物图片、及所述食物图片对应的地理位置信息;
步骤402、客户端向服务器发送所述食物图片、及所述食物图片对应的地理位置信息;
步骤403、服务器在接收到所述食物图片、及所述食物图片对应的地理位置信息后,确定所述地理位置信息对应的餐厅;
步骤404、服务器在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
步骤405、服务器依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
步骤406、服务器向客户端输出所述食物图片对应的菜品名称;
步骤407、客户端在接收到所述食物图片对应的菜品名称后,对所述食物图片对应的菜品名称进行展现。
相对于方法实施例一,本实施例通过客户端获取用户的食物图片、及所述食物图片对应的地理位置信息、及对所述食物图片对应的菜品名称进 行展现,且,通过服务器对上述食物图片对应的菜品名称进行识别;由于大量的运算工作在服务器中执行,故能够大大降低客户端的运算量,也即能够大大降低客户端的资源消耗,从而能够提高客户端的运行时间和运行效率,且能够提高客户端的实用性;并且,还能够发挥服务器侧计算资源(云服务器中云资源)丰富的优势,从而能够提高食物图片对应的菜品名称的识别精度和识别效率。
方法实施例三
参照图5,示出了本申请的一种信息处理方法实施例三的步骤流程图,具体可以包括如下步骤:
步骤501、客户端获取用户拍摄的食物照片、以及上述食物照片包含的地理位置信息;
步骤502、客户端向服务器发送所述食物图片、及所述食物图片对应的地理位置信息;
步骤503、服务器接收所述食物图片、及所述食物图片对应的地理位置信息;
相对于方法实施例二,本实施例在服务器侧对上述食物图片对应的菜品名称进行识别的过程进行了详细介绍。
步骤504、服务器确定所述地理位置信息对应的餐厅,并且,在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
步骤505、服务器在互联网菜品图片中进行搜索,以得到与所述食物图片相同或相似的参考菜品图片。
步骤506、服务器依据所述参考菜品图片对所述结果菜品图片进行筛选,并将筛选后结果菜品图片对应的菜品名称,作为所述食物图片对应的菜品名称。
以用户拍摄了一盘某餐厅的“宫保鸡丁”为例,步骤505将食物图片的图片特征提取后,从互联网菜品图片库中得到了上万幅匹配率在一定阈值范围的参考菜品图片,这些参考菜品图片中具体可以包括大量的“宫保鸡 丁”相关图片,同时也包括了较多的“辣子鸡丁”、“糖醋里脊”等图片特征较类似的图片。
而步骤504可以依据用户拍摄所在餐厅位置得到附近几家餐厅的列表,进一步获得这些餐厅的所有菜品图片和菜品名称,在对食物图片和菜品图片的图片特征进行匹配后,得到了结果菜品图片和对应的菜品名称“宫保鸡丁”。
步骤506可以对步骤504和步骤505输出的信息进行综合处理,在本申请的一种应用示例中,假设综合处理结果表明:“宫保鸡丁”在参考菜品图片中出现的概率最大,则可以输出菜品名称的这一结果。
步骤507、服务器向客户端输出所述食物图片对应的菜品名称。
步骤508、客户端在接收到所述食物图片对应的菜品名称后,对所述食物图片对应的菜品名称进行展现。
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。
装置实施例
参照图6,示出了本申请的一种信息处理装置实施例的结构框图,具体可以包括如下模块:
获取模块601,用于获取用户的食物图片、及所述食物图片对应的地理位置信息;
第一确定模块602,用于确定所述地理位置信息对应的餐厅;
搜索模块603,用于在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
第二确定模块604,用于依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;及
第一输出模块605,用于输出所述食物图片对应的菜品名称。
在本申请的一种可选实施例中,所述第一确定模块602,具体可以包括:
查找子模块,用于依据所述地理位置信息在地理位置信息与餐厅的映射关系中进行查找,以得到所述地理位置信息相对应的餐厅。
在本申请的另一种可选实施例中,所述第二确定模块604,具体可以包括:
第一确定子模块,用于将所述结果菜品图片对应的菜品名称作为所述食物图片对应的菜品名称;或者
第二确定子模块,用于在互联网菜品图片中进行搜索,以得到与所述食物图片相同或相似的参考菜品图片;依据所述参考菜品图片对所述结果菜品图片进行筛选,并将筛选后结果菜品图片对应的菜品名称,作为所述食物图片对应的菜品名称。
在本申请的再一种可选实施例中,所述第二确定子模块,具体可以包括:
第一筛选单元,用于依据与所述结果菜品图片相同或相似的第一参考菜品图片的数量,对所述结果菜品图片进行筛选;或者
第二筛选单元,用于依据与所述结果菜品图片相同或相似的、且菜品名称与所述结果菜品图片对应的菜品名称相匹配的第二参考菜品图片的数量,对所述结果菜品图片进行筛选。
在本申请的又一种可选实施例中,所述食物图片对应的地理位置信息具体可以包括:所述食物图片携带的地理位置信息和/或所述食物图片所属终端的地理位置信息。
在本申请的一种可选实施例中,所述获取模块601,具体可以包括:
第一获取子模块,位于客户端,用于获取用户上传的食物图片;或者
第二获取子模块,位于客户端,用于获取获取用户拍摄的食物图片;或者
第三获取子模块,位于服务器,用于接收客户端发送的食物图片。
在本申请的另一种可选实施例中,所述装置还可以包括:
第二输出模块,用于输出所述食物图片对应的菜品名称的相关信息。
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。
关于上述实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。
图7是根据一示例性实施例示出的一种用于信息处理的装置800的框图。例如,装置800可以是移动电话,计算机,数字广播终端,消息收发设备,游戏控制台,平板设备,医疗设备,健身设备,个人数字助理等。
参照图7,装置800可以包括以下一个或多个组件:处理组件802,存储器804,电源组件806,多媒体组件808,音频组件810,输入/输出(I/O)的接口812,传感器组件814,以及通信组件816。
处理组件802通常控制装置800的整体操作,诸如与显示,电话呼叫,数据通信,相机操作和记录操作相关联的操作。处理元件802可以包括一个或多个处理器820来执行指令,以完成上述的方法的全部或部分步骤。此外,处理组件802可以包括一个或多个模块,便于处理组件802和其他组件之间的交互。例如,处理部件802可以包括多媒体模块,以方便多媒体组件808和处理组件802之间的交互。
存储器804被配置为存储各种类型的数据以支持在设备800的操作。这些数据的示例包括用于在装置800上操作的任何应用程序或方法的指令,联系人数据,电话簿数据,消息,图片,视频等。存储器804可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
电源组件806为装置800的各种组件提供电力。电源组件806可以包括 电源管理系统,一个或多个电源,及其他与为装置800生成、管理和分配电力相关联的组件。
多媒体组件808包括在所述装置800和用户之间的提供一个输出接口的屏幕。在一些实施例中,屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界,而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中,多媒体组件808包括一个前置摄像头和/或后置摄像头。当设备800处于操作模式,如拍摄模式或视频模式时,前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件810被配置为输出和/或输入音频信号。例如,音频组件810包括一个麦克风(MIC),当装置800处于操作模式,如呼叫模式、记录模式和语音识别模式时,麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器804或经由通信组件816发送。在一些实施例中,音频组件810还包括一个扬声器,用于输出音频信号。
I/O接口812为处理组件802和外围接口模块之间提供接口,上述外围接口模块可以是键盘,点击轮,按钮等。这些按钮可包括但不限于:主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件814包括一个或多个传感器,用于为装置800提供各个方面的状态评估。例如,传感器组件814可以检测到设备800的打开/关闭状态,组件的相对定位,例如所述组件为装置800的显示器和小键盘,传感器组件814还可以检测装置800或装置800一个组件的位置改变,用户与装置800接触的存在或不存在,装置800方位或加速/减速和装置800的温度变化。传感器组件814可以包括接近传感器,被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件814还可以包括光传感器,如CMOS或CCD图像传感器,用于在成像应用中使用。在一些实施例中,该传感器组件814还可以包括加速度传感器,陀螺仪传感器,磁传感器,压力传感器或温度传 感器。
通信组件816被配置为便于装置800和其他设备之间有线或无线方式的通信。装置800可以接入基于通信标准的无线网络,如WiFi,2G或3G,或它们的组合。在一个示例性实施例中,通信部件816经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中,所述通信部件816还包括近场通信(NFC)模块,以促进短程通信。例如,在NFC模块可基于射频识别(RFID)技术,红外数据协会(IrDA)技术,超宽带(UWB)技术,蓝牙(BT)技术和其他技术来实现。
在示例性实施例中,装置800可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,用于执行上述方法。
在示例性实施例中,还提供了一种包括指令的非临时性计算机可读存储介质,例如包括指令的存储器804,上述指令可由装置800的处理器820执行以完成上述方法。例如,所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
一种非临时性计算机可读存储介质,当所述存储介质中的指令由移动终端的处理器执行时,使得移动终端能够执行一种信息处理方法,所述方法包括:获取用户的食物图片、及所述食物图片对应的地理位置信息;确定所述地理位置信息对应的餐厅;在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;输出所述食物图片对应的菜品名称。
图8是本申请的一些实施例中服务器的结构示意图。该服务器1900可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上中央处理器(central processing units,CPU)1922(例如,一个或一个以上处理器)和存储器1932,一个或一个以上存储应用程序1942或数据1944的存储介质1930(例如一个或一个以上海量存储设备)。其中,存储器1932和存储介质1930可以是短暂存储或持久存储。存储在存储介质1930的程序可以包括一 个或一个以上模块(图示没标出),每个模块可以包括对服务器中的一系列指令操作。更进一步地,中央处理器1922可以设置为与存储介质1930通信,在服务器1900上执行存储介质1930中的一系列指令操作。
服务器1900还可以包括一个或一个以上电源1926,一个或一个以上有线或无线网络接口1950,一个或一个以上输入输出接口1958,一个或一个以上键盘1956,和/或,一个或一个以上操作系统1941,例如Windows ServerTM,Mac OS XTM,UnixTM,LinuxTM,FreeBSDTM等等。
例如,图9示出了用于执行根据本发明的信息处理方法的计算设备。该计算设备传统上包括处理器1410和以存储器1420形式的程序产品或者可读介质。存储器1420可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM或者ROM之类的电子存储器。存储器1420具有用于执行上述方法中的任何方法步骤的程序代码1431的存储空间1430。例如,用于程序代码的存储空间1430可以包括分别用于实现上面的方法中的各种步骤的各个程序代码1431。这些程序代码可以从一个或者多个程序产品中读出或者写入到这一个或者多个程序产品中。这些程序产品包括诸如存储卡之类的程序代码载体。这样的程序产品通常为如参考图10所述的便携式或者固定存储单元。该存储单元可以具有与图9的计算设备中的存储器1420类似布置的存储段、存储空间等。程序代码可以例如以适当形式进行压缩。通常,存储单元包括可读代码1431’,即可以由例如诸如1410之类的处理器读取的代码,这些代码当由计算设备运行时,导致该计算设备执行上面所描述的方法中的各个步骤。
本领域技术人员在考虑说明书及实践这里公开的发明后,将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本申请的真正范围和精神由下面的权利要求指出。
应当理解的是,本申请并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制
以上所述仅为本申请的较佳实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。
以上对本申请所提供的一种信息处理方法、一种信息处理装置和一种用于信息处理的装置,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (12)

  1. 一种信息处理方法,其特征在于,包括:
    获取用户的食物图片、及所述食物图片对应的地理位置信息;
    确定所述地理位置信息对应的餐厅;
    在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
    依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
    输出所述食物图片对应的菜品名称。
  2. 根据权利要求1所述的方法,其特征在于,所述确定所述地理位置信息对应的餐厅的步骤,包括:
    依据所述地理位置信息在地理位置信息与餐厅的映射关系中进行查找,以得到所述地理位置信息相对应的餐厅。
  3. 根据权利要求1所述的方法,其特征在于,所述依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称的步骤,包括:
    将所述结果菜品图片对应的菜品名称作为所述食物图片对应的菜品名称;或者
    在互联网菜品图片中进行搜索,以得到与所述食物图片相同或相似的参考菜品图片;依据所述参考菜品图片对所述结果菜品图片进行筛选,并将筛选后结果菜品图片对应的菜品名称,作为所述食物图片对应的菜品名称。
  4. 根据权利要求3所述的方法,其特征在于,所述依据所述参考菜品图片对所述结果菜品图片进行筛选的步骤,包括:
    依据与所述结果菜品图片相同或相似的第一参考菜品图片的数量,对所述结果菜品图片进行筛选;或者
    依据与所述结果菜品图片相同或相似的、且菜品名称与所述结果菜品图片对应的菜品名称相匹配的第二参考菜品图片的数量,对所述结果菜品图片进行筛选。
  5. 根据权利要求1所述的方法,所述食物图片对应的地理位置信息包 括:所述食物图片携带的地理位置信息和/或所述食物图片所属终端的地理位置信息。
  6. 根据权利要求1至5中任一所述的方法,其特征在于,所述获取用户的食物图片的步骤,包括:
    客户端获取用户上传的食物图片;或者
    客户端获取用户拍摄的食物图片;或者
    服务器接收客户端发送的食物图片。
  7. 根据权利要求1至5中任一所述的方法,其特征在于,所述方法还包括:
    输出所述食物图片对应的菜品名称的相关信息。
  8. 根据权利要求7所述的方法,所述相关信息包括如下信息中的至少一种:
    所述菜品名称的食谱和/或制作方法;
    所述菜品名称的卡路里;及
    所述菜品名称对应的、符合预置位置条件和/或预置推荐度条件的餐厅。
  9. 一种信息处理装置,其特征在于,包括:
    获取模块,用于获取用户的食物图片、及所述食物图片对应的地理位置信息;
    第一确定模块,用于确定所述地理位置信息对应的餐厅;
    搜索模块,用于在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
    第二确定模块,用于依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;及
    第一输出模块,用于输出所述食物图片对应的菜品名称。
  10. 一种用于信息处理的装置,其特征在于,包括有存储器,以及一个或者一个以上的程序,其中一个或者一个以上程序存储于存储器中,且经配置以由一个或者一个以上处理器执行所述一个或者一个以上程序包含用于 进行以下操作的指令:
    获取用户的食物图片、及所述食物图片对应的地理位置信息;
    确定所述地理位置信息对应的餐厅;
    在所述餐厅对应的菜品图片中进行搜索,以得到与所述食物图片相同或相似的结果菜品图片;
    依据所述结果菜品图片对应的菜品名称,确定所述食物图片对应的菜品名称;
    输出所述食物图片对应的菜品名称。
  11. 一种程序,包括可读代码,当所述可读代码在计算设备上运行时,导致所述计算设备执行根据权利要求1至8中的任一项所述的信息处理方法。
  12. 一种可读介质,其中存储了如权利要求11所述的程序。
PCT/CN2016/104233 2015-12-25 2016-11-01 一种信息处理方法和装置、一种用于信息处理的装置 WO2017107672A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510997719.1A CN105653636B (zh) 2015-12-25 2015-12-25 一种信息处理方法和装置、一种用于信息处理的装置
CN201510997719.1 2015-12-25

Publications (1)

Publication Number Publication Date
WO2017107672A1 true WO2017107672A1 (zh) 2017-06-29

Family

ID=56476990

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/104233 WO2017107672A1 (zh) 2015-12-25 2016-11-01 一种信息处理方法和装置、一种用于信息处理的装置

Country Status (2)

Country Link
CN (1) CN105653636B (zh)
WO (1) WO2017107672A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017076A (zh) * 2019-05-31 2020-12-01 阿里巴巴集团控股有限公司 餐饮服务信息处理方法及装置
CN112507942A (zh) * 2020-12-17 2021-03-16 神思电子技术股份有限公司 一种多尺度融合的菜品识别方法
CN114363485A (zh) * 2021-12-10 2022-04-15 中电科思仪科技(安徽)有限公司 一种基于fpga的双目摄像头图像拼接处理装置及方法

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105653636B (zh) * 2015-12-25 2020-07-28 北京搜狗科技发展有限公司 一种信息处理方法和装置、一种用于信息处理的装置
CN106815745A (zh) * 2016-12-30 2017-06-09 北京三快在线科技有限公司 菜品推荐方法及系统
CN106910093A (zh) * 2017-03-02 2017-06-30 百度在线网络技术(北京)有限公司 餐厅推荐的方法及装置
CN107682401A (zh) * 2017-09-01 2018-02-09 深圳市盛路物联通讯技术有限公司 信息查看方法及相关设备
CN107993106B (zh) * 2017-12-14 2020-04-10 阿里巴巴集团控股有限公司 电子发票生成方法及装置
CN108009288B (zh) * 2017-12-25 2020-01-14 维沃移动通信有限公司 食谱推送方法及装置
CN109299721A (zh) * 2018-07-24 2019-02-01 上海常仁信息科技有限公司 一种基于图像识别技术的菜品识别系统和方法
CN109299648A (zh) * 2018-07-24 2019-02-01 上海常仁信息科技有限公司 一种能够菜品识别的识别装置
CN109344696A (zh) * 2018-08-14 2019-02-15 上海常仁信息科技有限公司 一种基于菜品识别的评分系统和方法
CN109446915B (zh) * 2018-09-29 2020-12-29 口碑(上海)信息技术有限公司 一种菜品信息生成方法、装置以及电子设备
CN113296680A (zh) * 2018-11-27 2021-08-24 浙江口碑网络技术有限公司 菜品图片上传方法、装置、计算机设备及可读存储介质
CN109919803A (zh) * 2019-01-31 2019-06-21 秒针信息技术有限公司 一种菜品检测方法及装置
CN110379490A (zh) * 2019-07-19 2019-10-25 秒针信息技术有限公司 目标餐厅的获取方法及装置、存储介质、电子装置
CN110569440A (zh) * 2019-09-10 2019-12-13 北京星选科技有限公司 数据查询方法、装置、电子设备及存储介质
CN111985417A (zh) * 2020-08-24 2020-11-24 中国第一汽车股份有限公司 功能部件识别方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102565056A (zh) * 2010-11-26 2012-07-11 泰尔茂株式会社 便携终端、卡路里推定方法及卡路里推定程序
CN104021207A (zh) * 2014-06-18 2014-09-03 厦门美图之家科技有限公司 一种基于图像的食物信息提供方法
CN104699929A (zh) * 2013-12-06 2015-06-10 无锡韩光电器有限公司 一种互动式图片识别方法与系统
US20150228062A1 (en) * 2014-02-12 2015-08-13 Microsoft Corporation Restaurant-specific food logging from images
CN105653636A (zh) * 2015-12-25 2016-06-08 北京搜狗科技发展有限公司 一种信息处理方法和装置、一种用于信息处理的装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9323785B2 (en) * 2013-03-06 2016-04-26 Streamoid Technologies Private Limited Method and system for mobile visual search using metadata and segmentation
TWI546685B (zh) * 2014-04-09 2016-08-21 Univ Chang Gung Diet management system and food image search sorting method
CN104182780B (zh) * 2014-08-21 2018-07-03 五八同城信息技术有限公司 一种自动生成就餐点评的方法及终端设备
CN104269003A (zh) * 2014-09-12 2015-01-07 李龙龙 一种食物识别方法、装置及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102565056A (zh) * 2010-11-26 2012-07-11 泰尔茂株式会社 便携终端、卡路里推定方法及卡路里推定程序
CN104699929A (zh) * 2013-12-06 2015-06-10 无锡韩光电器有限公司 一种互动式图片识别方法与系统
US20150228062A1 (en) * 2014-02-12 2015-08-13 Microsoft Corporation Restaurant-specific food logging from images
CN104021207A (zh) * 2014-06-18 2014-09-03 厦门美图之家科技有限公司 一种基于图像的食物信息提供方法
CN105653636A (zh) * 2015-12-25 2016-06-08 北京搜狗科技发展有限公司 一种信息处理方法和装置、一种用于信息处理的装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017076A (zh) * 2019-05-31 2020-12-01 阿里巴巴集团控股有限公司 餐饮服务信息处理方法及装置
CN112507942A (zh) * 2020-12-17 2021-03-16 神思电子技术股份有限公司 一种多尺度融合的菜品识别方法
CN114363485A (zh) * 2021-12-10 2022-04-15 中电科思仪科技(安徽)有限公司 一种基于fpga的双目摄像头图像拼接处理装置及方法
CN114363485B (zh) * 2021-12-10 2024-04-16 中电科思仪科技(安徽)有限公司 一种基于fpga的双目摄像头图像拼接处理装置及方法

Also Published As

Publication number Publication date
CN105653636B (zh) 2020-07-28
CN105653636A (zh) 2016-06-08

Similar Documents

Publication Publication Date Title
WO2017107672A1 (zh) 一种信息处理方法和装置、一种用于信息处理的装置
US10423656B2 (en) Tag suggestions for images on online social networks
US11146619B2 (en) Systems and methods for selecting media items
US9727565B2 (en) Photo and video search
US11249620B2 (en) Electronic device for playing-playing contents and method thereof
WO2017129018A1 (zh) 一种图片处理方法、装置和智能终端
US20160042249A1 (en) Event-based image classification and scoring
CA2913461C (en) Tag suggestions for images on online social networks
CN103412951A (zh) 基于人物照片的人脉关联分析管理系统与方法
CN112088370A (zh) 数字资产搜索用户界面
WO2020044099A1 (zh) 一种基于对象识别的业务处理方法和装置
WO2017067485A1 (zh) 一种图片管理方法、装置及一种终端
WO2017219484A1 (zh) 设置身份图像的方法及装置
JP2016502707A (ja) 視覚コンテンツと測位データとの相関付け
US20150242405A1 (en) Methods, devices and systems for context-sensitive organization of media files
JP2019159537A (ja) 画像検索装置、画像検索方法、電子機器及びその制御方法
US9875512B2 (en) Photo and video sharing
US20160012078A1 (en) Intelligent media management system
WO2019100925A1 (zh) 图像数据输出
TW201915721A (zh) 資訊展示方法及裝置
KR102165339B1 (ko) 전자장치에서 콘텐츠 재생 방법 및 장치
KR102050594B1 (ko) 전자장치에서 콘텐츠 재생 방법 및 장치
JP2018073022A (ja) 施設情報伝達方法、施設情報伝達システム、施設情報伝達プログラム、施設情報伝達装置、及び合成画像作成プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16877483

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16877483

Country of ref document: EP

Kind code of ref document: A1