CN109309757B - Memorandum reminding method and terminal - Google Patents
Memorandum reminding method and terminal Download PDFInfo
- Publication number
- CN109309757B CN109309757B CN201810973408.5A CN201810973408A CN109309757B CN 109309757 B CN109309757 B CN 109309757B CN 201810973408 A CN201810973408 A CN 201810973408A CN 109309757 B CN109309757 B CN 109309757B
- Authority
- CN
- China
- Prior art keywords
- information
- image
- memo
- memorandum
- prompting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72427—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/109—Time management, e.g. calendars, reminders, meetings or time accounting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72457—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to geographic location
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Environmental & Geological Engineering (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a memorandum reminding method and a terminal. By the method, the memo reminding function of the terminal is triggered, the memo information is directly displayed to the user, the user does not need to click a memo application program icon to search for the memo information to be processed, and great convenience is brought to the user.
Description
Technical Field
The embodiment of the invention relates to the technical field of information identification and augmented reality, in particular to a memorandum reminding method and a terminal.
Background
The memo is information which can help a user to record backlog to play a memo reminding role, and the information can be composed of one or more of text information, picture information and voice information. With the rapid development of the intelligent device, a user can record some information needing to be processed through the intelligent device anytime and anywhere so as to remind the user when the information needs to be processed.
At present, a memo application program is provided in intelligent equipment such as a mobile phone or a computer, a user can add events needing to be processed in the future in the memo application program and select reminding time, and when the preset time is reached, the intelligent equipment sends out a reminding message to inform the user. For example, the smart phone may send out the reminding message by means of ring or vibration, and the computer may send out the reminding message by means of message pop-up.
However, even if the user sets the memo reminding time in the smart device, there is a possibility that a memo event is missed because a large amount of things need to be processed. When the user inquires the detailed information of the memo according to the reminding message, the user needs to click the memo application icon on the intelligent device and select the memo information to be inquired from the memo list.
Disclosure of Invention
The memorandum reminding method and the terminal simplify the step of inquiring detailed contents of the memorandum by the user and greatly facilitate the user.
The invention provides a memorandum reminding method in a first aspect, which comprises the following steps:
shooting an object through a camera to obtain a first image;
acquiring memo information bound with the object according to the first image;
and prompting the memo information.
In a possible implementation manner, the obtaining, according to the first image, memo information bound to the object includes:
extracting object characteristic information of the first image;
inputting the object characteristic information into an object recognition model to obtain an object label of the first image;
and acquiring the memo information bound with the object tag.
In a possible implementation manner, the obtaining, according to the first image, memo information bound to the object includes:
inquiring a memorandum picture library, and determining a second image with the image similarity of the object in the first image meeting the preset image similarity;
and acquiring the memorandum information corresponding to the second image.
In one possible implementation manner, the prompting the memo information includes:
acquiring the current position of a user;
and judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance, and if so, prompting the memorandum information.
In one possible implementation manner, the prompting the memo information includes:
acquiring current time;
and judging whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference, and if so, prompting the memorandum information.
In one possible implementation manner, the prompting the memo information includes:
acquiring the current position and the current time of a user;
judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance or not and whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference or not;
and if the distance is smaller than or equal to a preset distance and the time difference is smaller than or equal to a preset time difference, prompting the memorandum information.
In one possible implementation manner, the prompting the memo information includes:
and displaying the memo information to a user in a three-dimensional space by adopting an AR technology.
In one possible implementation manner, the displaying the memo information to the user in a three-dimensional space by using AR technology includes:
acquiring video information of the current position of a user through a camera;
and displaying the video information on a display interface, and overlapping the memo information on the video information by adopting an AR technology for displaying.
In one possible implementation, the memo information includes at least one of text information, voice information, picture information, and video information.
A second aspect of the present invention provides a terminal, including:
the acquisition module is used for shooting an object to obtain a first image;
the acquisition module is used for acquiring memo information bound with the object according to the first image;
and the prompting module is used for prompting the memo information.
In a possible implementation manner, the terminal further includes:
the extraction module is used for extracting object characteristic information of the first image;
the identification module is used for inputting the object characteristic information into an object identification model to obtain an object label of the first image;
the acquisition module is specifically used for acquiring memo information bound with the object tag.
In a possible implementation manner, the terminal further includes:
the query module is used for querying the memo gallery;
the determining module is used for determining a second image with the image similarity of the object in the first image meeting the preset image similarity;
the obtaining module is specifically configured to obtain memo information corresponding to the second image.
In a possible implementation manner, the obtaining module is further configured to obtain a current location of the user;
the terminal further comprises: and the judging module is used for judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance, and if so, the prompting module is used for prompting the memorandum information.
In a possible implementation manner, the obtaining module is further configured to obtain a current time;
the terminal further comprises: and the judging module is used for judging whether the time difference between the current time and the time recorded in the memorandum is less than or equal to a preset time difference, and if so, the prompting module is used for prompting the memorandum information.
In a possible implementation manner, the obtaining module is further configured to obtain a current location and a current time of the user;
the terminal further comprises: the judging module is used for judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance or not and whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference or not;
and if the distance is smaller than or equal to a preset distance and the time difference is smaller than or equal to a preset time difference, the prompting module is used for prompting the memorandum information.
In a possible implementation manner, the prompt module is specifically configured to:
and displaying the memo information to a user in a three-dimensional space by adopting an AR technology.
In a possible implementation manner, the acquisition module is further configured to acquire video information of a current location of a user;
the prompting module is specifically used for displaying the video information on a display interface and displaying the memo information by overlapping the memo information on the video information by adopting an AR technology.
In one possible implementation, the memo information includes at least one of text information, voice information, picture information, and video information.
A third aspect of the present invention provides a terminal, including:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement the method according to any one of the first aspect of the invention.
A fourth aspect of the invention provides a computer readable storage medium having stored thereon a computer program for execution by a processor to perform the method according to any one of the first aspect of the invention.
The embodiment of the invention provides a memorandum reminding method and a terminal. By the method, the memo reminding function of the terminal is triggered, the memo information is directly displayed to the user, the user does not need to click a memo application program icon to search for the memo information to be processed, and great convenience is brought to the user.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic flow chart of a memo reminding method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a memo reminding method according to another embodiment of the present invention;
fig. 3 is a schematic flowchart of a memo reminding method according to another embodiment of the present invention;
fig. 4 is a schematic flowchart illustrating a memo reminding method according to yet another embodiment of the present invention;
fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a terminal according to another embodiment of the present invention;
fig. 7 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present invention.
With the above figures, certain embodiments of the invention have been illustrated and described in more detail below. The drawings and the description are not intended to limit the scope of the inventive concept in any way, but rather to illustrate it by those skilled in the art with reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
The terms "comprising" and "having," and any variations thereof, in the description and claims of this invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
"and/or" in the present invention describes an association relationship of associated objects, and indicates that three relationships may exist, for example, a and/or B, and may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
Reference throughout this specification to "one embodiment" or "another embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
First, technical terms in the present embodiment will be explained as follows.
LBS Location Service, also called Location Based Service (LBS), is a value-added Service that obtains the Location Information (geographical coordinates, or geodetic coordinates) of the mobile terminal user through the telecommunication network (such as GSM network, CDMA network) of the telecommunication mobile operator or the external Location mode (such as GPS), and provides corresponding Service for the user under the support of the geographical Information System (foreign language abbreviation: GIS, foreign language full name: Geographic Information System) platform. The embodiment of the invention adopts the LBS technology to position the terminal equipment used by the user, and has higher positioning precision.
Object identification is a classic problem in computer vision tasks, and the technology is widely applied to scenes such as intelligent video monitoring, automobile auxiliary driving, unmanned automobile driving, intelligent transportation, internet image retrieval, virtual reality, human-computer interaction and the like. The main principle of object recognition is to divide an image to be recognized into a plurality of image areas, the area division result of each image to be recognized forms an image area set, the characteristics of each image area are extracted, object recognition is respectively carried out on each image area according to an object recognition model which is constructed in advance through a machine learning algorithm, and finally object information in the image to be recognized is determined. In the embodiment of the invention, a user binds an object with the memo information, and triggers the memo to remind when the terminal identifies the object. The embodiment adopts an object recognition technology to recognize the object in the image acquired by the terminal, determines whether the object is the object recorded in the memorandum by the user, and further displays the detailed information of the memorandum if the object is the object recorded in the memorandum by the user.
Augmented Reality (AR) is a technology for increasing the perception of a user to the real world through information provided by a computer system, applies virtual information to the real world, and superimposes virtual objects, scenes or system prompt information generated by the computer to the real scene, thereby realizing the enhancement of Reality. The augmented reality technology comprises new technologies and new means such as multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and the like. Augmented reality provides information that is generally different from what human beings can perceive. The embodiment of the invention adopts the AR technology to superpose the memorandum information recorded by the user in the three-dimensional real scene to remind the user of the current to-be-processed items, thereby solving the problem that the memorandum information recorded on the text or the application program is forgotten in the prior art.
The memo reminding method provided by the embodiment determines whether to trigger the memo reminding message through the LBS technology and the object recognition technology, and when the trigger condition is met, the acquisition AR technology displays detailed information of the memo in a three-dimensional space in an overlapping manner. The AR memo reminding function improves user experience, and meanwhile, the probability that the user forgets a memo event is greatly reduced.
The technical solution of the present invention will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 1 is a schematic flow chart of a memo reminding method according to an embodiment of the present invention, where the method can be executed by any terminal that executes the memo reminding method, and the terminal can be implemented by software and/or hardware.
As shown in fig. 1, the memo reminding method provided in this embodiment includes the following steps:
s101, shooting an object through a camera to obtain a first image;
in this embodiment, a user captures an object through a camera on a terminal to obtain a first image, where the object may be any inanimate object, such as a building, a vehicle, a living good, a home appliance, or the like, and may also be an animal, a person, or the like, which is not limited in this embodiment.
The terminal of this embodiment is a mobile terminal, for example, smart phone, AR glasses, mobile device, wearable device, etc., is provided with the camera on this terminal for gather the image of user's current position.
For example, a book is bound in one piece of memo information prestored by the user, the recorded detailed information is that the book is returned to a library of the school before friday, and if the user forgets the detailed information of the memo, the book can be shot through the terminal, and the memo information bound with the book can be quickly obtained.
For another example, a refrigerator is bound in a piece of memo information prestored by the user, the information recorded in the memo is video data for making a certain dish, if the user forgets a detailed step for making a certain dish, the refrigerator can be shot through the terminal, and the video data made by the dish bound with the refrigerator can be quickly called.
S102, acquiring memo information bound with an object according to the first image;
in this embodiment, when recording memo information, a user may bind the memo information and the object by adding an object tag or adding an object picture, and specifically, what kind of method is used for binding, which is not limited in this embodiment.
In one possible implementation, the user binds the memo information to the object tag by adding the object tag. The object labels include, but are not limited to, books, stationery, buildings, people, and animals.
Specifically, the terminal extracts object characteristic information of the first image;
inputting object characteristic information into an object recognition model to obtain an object label of a first image;
and determining whether the object tag is an object tag added in the memo by the user, and if so, acquiring memo information bound with the object tag.
In this embodiment, the object recognition model is obtained by training feature vectors corresponding to a large number of object training samples and object labels marked in each object training sample by using a deep learning method. The trained object recognition model has the function of recognizing the type of the object in the image data, and takes the object characteristic information of the image data as input and takes the object label as output.
For example, when creating memo information, the user adds video data of a certain dish to the memo information, and at the same time, adds and saves an object tag that triggers the memo information, for example, the object tag of the memo information is "refrigerator". When the memorandum information is obtained, a user shoots an object through the terminal equipment to obtain a first image, an object tag for shooting the object is determined to be a refrigerator through an object recognition model on the terminal, and after the object tag for the first image is determined to be the object tag recorded in the memorandum by the user, the memorandum information bound with the object tag is obtained.
In another possible implementation, the user binds the memo information with the object picture by adding the object picture.
Specifically, the terminal queries a memo gallery; the memorandum picture library stores a second image which is shot by a user in advance and contains a target object.
The terminal determines whether a second image with the image similarity meeting the preset image similarity with the object in the first image shot by the user exists in the memo picture library (namely, determines whether a second image which is the same as or similar to the shot object exists in the memo picture library), and if the second image exists, acquires memo information corresponding to the second image.
For example, when creating memo information, the user takes and saves an image of a book to be returned when recording memo information "return book to school library before friday". When the user forgets the specific time for returning the book, the book can be shot through the terminal to obtain a first image, and when the image similarity between the book in the first image and the book in a certain second image in the memo picture base meets the preset image similarity, the memo information corresponding to the second image is quickly obtained.
And S103, prompting memorandum information.
In this embodiment, the terminal adopts AR technology to present memo information to the user in a three-dimensional space.
Specifically, the terminal collects video information of the current position of a user through a camera;
and displaying the video information on a display interface, and displaying the memorandum information by overlapping the memorandum information on the video information by adopting an AR (augmented reality) technology.
Optionally, the memo information includes at least one of text information, voice information, picture information, and video information.
For example, a user photographs a refrigerator through a camera, and after determining that the refrigerator is a refrigerator recorded in a memo by the user, video information bound to the refrigerator is directly presented to the user in a three-dimensional space by using an AR technology.
In the embodiment, the terminal displays the memo information bound with the shot object by adopting the AR technology, optionally, the terminal directly jumps to a memo application program interface, so that a user can conveniently and directly look up the corresponding memo information on the application program interface, the user does not need to click a memo application program icon to look up the memo information to be processed according to the prompt information, and great convenience is brought to the user.
The memorandum reminding method provided by the embodiment of the invention comprises the steps of shooting an object through the camera to obtain a first image, determining whether the object in the first image is a target object recorded in the memorandum by a user according to the first image, if so, acquiring memorandum information bound with the object, and reminding the memorandum information to the user. By the method, the memo reminding function of the terminal is triggered, the memo information is directly displayed to the user, the user does not need to click a memo application program icon to search for the memo information to be processed, and great convenience is brought to the user.
The above embodiments show how the terminal determines whether the object image includes the target object bound in the user memo according to the object image acquired by the camera, and triggers the memo reminding function when determining that the object image includes the target object. On the basis of the above embodiments, the following embodiments respectively show several memo reminding methods combining different trigger conditions, so as to further improve the accuracy of the memo reminding.
The following describes in detail the memo reminding method provided in each embodiment with reference to the accompanying drawings.
Fig. 2 is a schematic flow chart of a memo reminding method according to another embodiment of the present invention, and based on the embodiment shown in fig. 1, as shown in fig. 2, the memo reminding method according to the embodiment includes the following steps:
s201, shooting an object through a camera to obtain a first image;
s202, acquiring memo information bound with an object according to the first image;
the implementation principle and the technical effect of S201 and S202 in this embodiment are the same as those of S101 and S102 in the above embodiment, and reference may be specifically made to the above embodiment, which is not described herein again.
S203, acquiring the current position of the user;
in this embodiment, the terminal acquires the current location of the user by using the LBS technology.
S204, judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance or not;
and S205, prompting the memo information if the distance between the current position and the position recorded in the memo is less than or equal to a preset distance.
In this embodiment, after determining that the object in the first image is the object bound by the user in the memo, the terminal further determines the current position of the user, that is, the position where the user shoots the object. Considering that the LBS positioning technology has a positioning error, the terminal determines whether the distance between the current position and the position recorded in the memorandum information to be prompted is less than or equal to a preset distance according to the positioned current position, and if so, prompts the memorandum information; and if not, the memorandum information is not prompted.
The memorandum reminding method provided by the embodiment of the invention comprises the steps of shooting an object through the camera to obtain a first image, determining whether the object in the first image is a target object recorded in the memorandum by a user according to the first image, if so, further determining the current position of the user, and prompting the memorandum information when the distance between the current position and the position recorded in the memorandum information is smaller than or equal to a preset distance. The memorandum reminding function of the terminal is triggered by the method, so that the accuracy of memorandum reminding is improved; meanwhile, the terminal directly displays the memorandum information to the user, and the user does not need to click a memorandum application program icon to search the memorandum information to be processed, so that great convenience is brought to the user.
Fig. 3 is a schematic flow chart of a memo reminding method according to another embodiment of the present invention, and based on the embodiment shown in fig. 1, as shown in fig. 3, the memo reminding method according to this embodiment includes the following steps:
s301, shooting an object through a camera to obtain a first image;
s302, acquiring memo information bound with the object according to the first image;
the implementation principle and the technical effect of S301 and S302 in this embodiment are the same as those of S101 and S102 in the above embodiment, and reference may be specifically made to the above embodiment, and details are not described here.
S303, acquiring the current time;
s304, judging whether the time difference between the current time and the time recorded in the memorandum is less than or equal to a preset time difference;
s305, prompting the memo information if the time difference between the current time and the time recorded in the memo is less than or equal to the preset time difference.
In this embodiment, after determining that the object in the first image is the object bound in the memo of the user, the terminal further determines the current time, and determines whether the time difference between the current time and the time recorded in the memo information is less than or equal to a preset time difference according to the current time, if so, the memo information is prompted, and if not, the memo information is not prompted.
The memorandum reminding method provided by the embodiment of the invention comprises the steps of shooting an object through the camera to obtain a first image, determining whether the object in the first image is a target object recorded in the memorandum by a user according to the first image, if so, further determining the current time, and reminding the memorandum information when the time difference between the current time and the time recorded in the memorandum information is less than or equal to the preset time difference. The memorandum reminding function of the terminal is triggered by the method, so that the accuracy of memorandum reminding is improved; meanwhile, the terminal directly displays the memorandum information to the user, and the user does not need to click a memorandum application program icon to search the memorandum information to be processed, so that great convenience is brought to the user.
Fig. 4 is a schematic flow chart of a memo reminding method according to still another embodiment of the present invention, and based on the embodiment shown in fig. 1, as shown in fig. 4, the memo reminding method according to this embodiment includes the following steps:
s401, shooting an object through a camera to obtain a first image;
s402, acquiring memo information bound with an object according to the first image;
the implementation principle and technical effect of S401 and S402 in this embodiment are the same as those of S101 and S102 in the above embodiment, and reference may be specifically made to the above embodiment, which is not described herein again.
S403, acquiring the current position of the user;
s404, judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance;
s405, acquiring current time;
s406, judging whether the time difference between the current time and the time recorded in the memorandum is less than or equal to a preset time difference;
s403 to S404 and S405 to S406 of this embodiment may be executed simultaneously or sequentially, and the execution sequence is not limited to the above-mentioned execution sequence, and this embodiment is not particularly limited.
And S407, if the distance is smaller than or equal to a preset distance and the time difference is smaller than or equal to a preset time difference, prompting detailed information of a memorandum corresponding to the object information.
In this embodiment, after determining that the object in the first image is the object bound by the user in the memo, the terminal further determines a current position and a current time, determines whether a distance between the current position and the position recorded in the memo information is smaller than or equal to a preset distance according to the current position, determines whether a time difference between the current time and the time recorded in the memo information is smaller than or equal to a preset time difference according to the current time, prompts the memo information if the distance is smaller than or equal to the preset distance and the time difference is smaller than or equal to the preset time difference, and does not prompt the memo information if the distance is smaller than or equal to the preset distance and the time difference is greater than the preset time difference, or if the distance is greater than or equal to the preset distance and the time difference is smaller than or equal to the preset time difference, or if the distance is greater than the preset distance and the time difference is greater than the preset.
The memorandum reminding method provided by the embodiment of the invention comprises the steps of shooting an object through a camera to obtain a first image, determining whether the object in the first image is a target object recorded in a memorandum by a user according to the first image, if so, further determining the current position and the current time, and reminding the memorandum information when the distance between the current position and the position recorded in the memorandum information is smaller than or equal to the preset distance and the time difference between the current time and the time recorded in the memorandum information is smaller than or equal to the preset time difference. By the method, the memorandum reminding function of the terminal is triggered, so that the accuracy of memorandum reminding is further improved; meanwhile, the terminal directly displays the memorandum information to the user, and the user does not need to click a memorandum application program icon to search the memorandum information to be processed, so that great convenience is brought to the user.
An embodiment of the present invention further provides a terminal, which is shown in fig. 5, and the embodiment of the present invention is only described by taking fig. 5 as an example, which does not mean that the present invention is limited thereto.
Fig. 5 is a schematic structural diagram of a terminal according to an embodiment of the present invention, and as shown in fig. 5, the terminal 50 according to this embodiment includes:
the acquisition module 51 is used for shooting an object to obtain a first image;
an obtaining module 52, configured to obtain memo information bound to the object according to the first image;
and the prompting module 53 is configured to prompt the memo information.
According to the terminal provided by the embodiment of the invention, an object is shot through the acquisition module to obtain a first image; the acquisition module acquires memo information bound with the object according to the first image, and the prompting module prompts the memo information. The terminal triggers the memorandum reminding function through the modules and directly displays the memorandum information to the user, the user does not need to click a memorandum application program icon to search the memorandum information to be processed, and great convenience is brought to the user.
Fig. 6 is a schematic structural diagram of a terminal according to another embodiment of the present invention, and based on the terminal shown in fig. 5, as shown in fig. 6, the terminal 50 according to this embodiment further includes:
an extracting module 54, configured to extract object feature information of the first image;
the identification module 55 is configured to input the object feature information into an object identification model, so as to obtain an object tag of the first image;
the obtaining module 52 is specifically configured to obtain memo information bound to the object tag.
In a possible implementation manner, the terminal 50 further includes:
a query module 56 for querying the memo gallery;
a determining module 57, configured to determine a second image with an image similarity to the object in the first image that satisfies a preset image similarity;
the obtaining module 52 is specifically configured to obtain memo information corresponding to the second image.
In a possible implementation manner, the obtaining module 52 is further configured to obtain a current location of the user;
the terminal 50 further includes: a judging module 58, configured to judge whether a distance between the current position and the position recorded in the memo is smaller than or equal to a preset distance, if so, the prompting module 53 is configured to prompt the memo information.
In a possible implementation manner, the obtaining module 52 is further configured to obtain a current time;
the terminal 50 further includes: a judging module 58, configured to judge whether a time difference between the current time and the time recorded in the memo is smaller than or equal to a preset time difference, if so, the prompting module 53 is configured to prompt the memo information.
In a possible implementation manner, the obtaining module 52 is further configured to obtain a current location and a current time of the user;
a judging module 58, configured to judge whether a distance between the current position and a position recorded in the memo is smaller than or equal to a preset distance, and whether a time difference between the current time and the time recorded in the memo is smaller than or equal to a preset time difference;
if the distance is less than or equal to a preset distance and the time difference is less than or equal to a preset time difference, the prompting module 53 is configured to prompt the memo information.
In a possible implementation manner, the prompting module 53 is specifically configured to:
and displaying the memo information to a user in a three-dimensional space by adopting an AR technology.
In a possible implementation manner, the acquiring module 51 is further configured to acquire video information of a current location of a user;
the prompting module 53 is specifically configured to display the video information on a display interface, and display the memo information by superimposing the memo information on the video information by using an AR technology.
In one possible implementation, the memo information includes at least one of text information, voice information, picture information, and video information.
The terminal provided in this embodiment may execute the technical solution of the above method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.
Fig. 7 shows that the embodiment of the present invention is only illustrated in fig. 7, and does not show that the present invention is limited thereto.
Fig. 7 is a schematic diagram of a hardware structure of a terminal according to an embodiment of the present invention, and as shown in fig. 7, a terminal 70 according to this embodiment includes:
a memory 71;
a processor 72; and
a computer program;
wherein the computer program is stored in the memory 71 and configured to be executed by the processor 72 to implement the technical solution of any one of the foregoing method embodiments, and the implementation principle and technical effect are similar, which are not described herein again.
Alternatively, the memory 71 may be separate or integrated with the processor 72.
When the memory 71 is a device separate from the processor 72, the terminal 70 further includes:
a bus 73 for connecting the memory 71 and the processor 72.
Embodiments of the present invention also provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by the processor 72 to implement the steps performed by the terminal 70 in the above method embodiments.
It should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The memory may comprise a high-speed RAM memory, and may further comprise a non-volatile storage NVM, such as at least one disk memory, and may also be a usb disk, a removable hard disk, a read-only memory, a magnetic or optical disk, etc.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The storage medium may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the storage medium may reside as discrete components in an electronic device or host device.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (18)
1. A memo reminding method is characterized by comprising the following steps:
shooting an object through a camera to obtain a first image;
acquiring memo information bound with the object according to the first image;
prompting the memo information;
the obtaining of the memo information bound with the object according to the first image includes:
extracting object characteristic information of the first image;
inputting the object characteristic information into an object recognition model to obtain an object label of the first image; the object recognition model is obtained by training the feature vectors of the objects in the image samples and the object labels marked in the image samples by adopting a deep learning method;
acquiring memo information bound with the object tag;
the prompting the memo information comprises: and jumping to a memorandum application program interface, and prompting the memorandum information.
2. The method of claim 1, wherein obtaining memo information bound to the object according to the first image comprises:
inquiring a memorandum picture library, and determining a second image with the image similarity of the object in the first image meeting the preset image similarity;
and acquiring the memorandum information corresponding to the second image.
3. The method of claim 1, wherein prompting the memo information comprises:
acquiring the current position of a user;
and judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance, and if so, prompting the memorandum information.
4. The method of claim 1, wherein prompting for memo information comprises:
acquiring current time;
and judging whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference, and if so, prompting the memorandum information.
5. The method of claim 1, wherein prompting the memo information comprises:
acquiring the current position and the current time of a user;
judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance or not and whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference or not;
and if the distance is smaller than or equal to a preset distance and the time difference is smaller than or equal to a preset time difference, prompting the memorandum information.
6. The method of claim 1, wherein prompting the memo information comprises:
and displaying the memo information to a user in a three-dimensional space by adopting an AR technology.
7. The method of claim 6, wherein the displaying the memo information to the user in three-dimensional space using AR technology comprises:
acquiring video information of the current position of a user through a camera;
and displaying the video information on a display interface, and overlapping the memo information on the video information by adopting an AR technology for displaying.
8. The method of any of claims 1-7, wherein the memo information includes at least one of text information, voice information, picture information, and video information.
9. A terminal, comprising:
the acquisition module is used for shooting an object to obtain a first image;
the acquisition module is used for acquiring memo information bound with the object according to the first image;
the prompting module is used for prompting the memo information;
the terminal further comprises:
the extraction module is used for extracting object characteristic information of the first image;
the identification module is used for inputting the object characteristic information into an object identification model to obtain an object label of the first image; the object recognition model is obtained by training the feature vectors of the objects in the image samples and the object labels marked in the image samples by adopting a deep learning method;
the acquisition module is specifically used for acquiring memo information bound with the object tag;
the prompting module is specifically used for jumping to a memo application program interface and prompting the memo information.
10. The terminal of claim 9, wherein the terminal further comprises:
the query module is used for querying the memo gallery;
the determining module is used for determining a second image with the image similarity of the object in the first image meeting the preset image similarity;
the obtaining module is specifically configured to obtain memo information corresponding to the second image.
11. The terminal of claim 9,
the acquisition module is also used for acquiring the current position of the user;
the terminal further comprises: and the judging module is used for judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance, and if so, the prompting module is used for prompting the memorandum information.
12. The terminal of claim 9,
the acquisition module is also used for acquiring the current time;
the terminal further comprises: and the judging module is used for judging whether the time difference between the current time and the time recorded in the memorandum is less than or equal to a preset time difference, and if so, the prompting module is used for prompting the memorandum information.
13. The terminal of claim 9,
the acquisition module is also used for acquiring the current position and the current time of the user;
the terminal further comprises: the judging module is used for judging whether the distance between the current position and the position recorded in the memorandum is smaller than or equal to a preset distance or not and whether the time difference between the current time and the time recorded in the memorandum is smaller than or equal to a preset time difference or not;
and if the distance is smaller than or equal to a preset distance and the time difference is smaller than or equal to a preset time difference, the prompting module is used for prompting the memorandum information.
14. The terminal according to claim 9, wherein the prompt module is specifically configured to:
and displaying the memo information to a user in a three-dimensional space by adopting an AR technology.
15. The terminal of claim 14,
the acquisition module is also used for acquiring the video information of the current position of the user;
the prompting module is specifically used for displaying the video information on a display interface and displaying the memo information by overlapping the memo information on the video information by adopting an AR technology.
16. The terminal according to any of claims 9-15, wherein said memo information comprises at least one of text information, voice information, picture information, video information.
17. A terminal, comprising:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement the method of any one of claims 1-8.
18. A computer-readable storage medium, having stored thereon a computer program for execution by a processor to perform the method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810973408.5A CN109309757B (en) | 2018-08-24 | 2018-08-24 | Memorandum reminding method and terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810973408.5A CN109309757B (en) | 2018-08-24 | 2018-08-24 | Memorandum reminding method and terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109309757A CN109309757A (en) | 2019-02-05 |
| CN109309757B true CN109309757B (en) | 2020-11-10 |
Family
ID=65224359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810973408.5A Active CN109309757B (en) | 2018-08-24 | 2018-08-24 | Memorandum reminding method and terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109309757B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111832360A (en) * | 2019-04-19 | 2020-10-27 | 北京三星通信技术研究有限公司 | Prompt message processing method and device, electronic equipment and readable storage medium |
| CN110197142A (en) * | 2019-05-16 | 2019-09-03 | 谷东科技有限公司 | Object identification method, device, medium and terminal device under faint light condition |
| CN112115132B (en) * | 2019-06-20 | 2024-02-13 | 北京百度网讯科技有限公司 | Data association method, device, equipment and storage medium |
| CN112528603A (en) * | 2019-08-27 | 2021-03-19 | 中兴通讯股份有限公司 | Memo creation method, apparatus, terminal device and computer-readable storage medium |
| CN111260899A (en) * | 2020-02-27 | 2020-06-09 | 上海萃钛智能科技有限公司 | Intelligent visual capture reminding AR device, reminding system and reminding method |
| CN111917918B (en) * | 2020-07-24 | 2021-09-21 | 腾讯科技（深圳）有限公司 | Augmented reality-based event reminder management method and device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102467343A (en) * | 2010-11-03 | 2012-05-23 | Lg电子株式会社 | Mobile terminal and method for controlling the same |
| CN104767871A (en) * | 2014-01-08 | 2015-07-08 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
| CN106296107A (en) * | 2015-05-26 | 2017-01-04 | 富泰华工业（深圳）有限公司 | Location-based memorandum based reminding method, system and electronic installation |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100692005B1 (en) * | 2004-10-09 | 2007-03-09 | 엘지전자 주식회사 | Mobile station having photograph memo recording function and control method thereof |
| CN103813012A (en) * | 2014-02-13 | 2014-05-21 | 深圳全智达通信股份有限公司 | Reminding method and device for memorandum of handheld device |
| CN103927350A (en) * | 2014-04-04 | 2014-07-16 | 百度在线网络技术（北京）有限公司 | Smart glasses based prompting method and device |
| CN106933807A (en) * | 2017-03-20 | 2017-07-07 | 北京光年无限科技有限公司 | Memorandum event-prompting method and system |
-
2018
- 2018-08-24 CN CN201810973408.5A patent/CN109309757B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102467343A (en) * | 2010-11-03 | 2012-05-23 | Lg电子株式会社 | Mobile terminal and method for controlling the same |
| CN104767871A (en) * | 2014-01-08 | 2015-07-08 | Lg电子株式会社 | Mobile terminal and controlling method thereof |
| CN106296107A (en) * | 2015-05-26 | 2017-01-04 | 富泰华工业（深圳）有限公司 | Location-based memorandum based reminding method, system and electronic installation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109309757A (en) | 2019-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309757B (en) | Memorandum reminding method and terminal | |
| CN111638796A (en) | Virtual object display method and device, computer equipment and storage medium | |
| CN109993045B (en) | Article searching method, article searching device, article searching system and machine-readable storage medium | |
| CN107885430B (en) | Audio playing method and device, storage medium and electronic equipment | |
| EP2410493A2 (en) | Apparatus and method for providing augmented reality using additional data | |
| CN104976999B (en) | A kind of method and apparatus that article is searched based on mobile device | |
| CN112486451B (en) | Voice broadcasting method, computing device and computer storage medium | |
| CN107084740B (en) | Navigation method and device | |
| CN108986842A (en) | Music style identifying processing method and terminal | |
| CN108108461B (en) | Method and device for determining cover image | |
| CN108697934A (en) | Guidance information related with target image | |
| JP2013167973A (en) | Retrieval device, retrieval method, retrieval program, and recording medium for storing the program | |
| CN114416905A (en) | Article searching method, label generating method and device | |
| CN111665945B (en) | Tour information display method and device | |
| CN110049180A (en) | Shoot posture method for pushing and device, intelligent terminal | |
| CN111026901A (en) | Learning content searching method and learning equipment | |
| US9462062B2 (en) | Portable terminal for displaying local service based on context awareness technology, and operation method of the portable terminal | |
| CN117496738A (en) | Underground garage car searching system based on optical symbol recognition technology matched engineering drawing | |
| CN111703278B (en) | Fragrance release method, device, vehicle end, cloud end, system and storage medium | |
| CN113220928B (en) | Image searching method and device, electronic equipment and storage medium | |
| CN111078982B (en) | Electronic page retrieval method, electronic device and storage medium | |
| CN110019863B (en) | Object searching method and device, terminal equipment and storage medium | |
| Ghazal et al. | Mobile-based archival and retrieval of missing objects using image matching | |
| CN108235764A (en) | Information processing method, device, cloud processing equipment and computer program product | |
| CN109084750B (en) | Navigation method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |