WO2019233078A1

WO2019233078A1 - Method and device for displaying virtual sticky-note, storage medium, and mobile terminal

Info

Publication number: WO2019233078A1
Application number: PCT/CN2018/121547
Authority: WO
Inventors: 陈海亮
Original assignee: 珠海格力电器股份有限公司
Priority date: 2018-06-06
Filing date: 2018-12-17
Publication date: 2019-12-12
Also published as: CN108984242A

Abstract

A method and device for displaying a virtual sticky-note, a storage medium, and a mobile terminal. The method comprises: performing recognition on a currently scanned object to obtain a first placement space corresponding to the object (S110); acquiring a virtual sticky-note associated with the first placement space corresponding to the object (S120); and superimposing the associated virtual sticky-note on the object currently presented on a display screen (S130), the virtual sticky-note being an image comprising a target content item and generated according to a preset style. The method changes a manner in which a sticky-note is viewed, and enhances the fun and interactivity of viewing sticky-notes.

Description

Method, device, storage medium and mobile terminal for displaying virtual notes

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 6, 2018, with an application number of 201810575381.4 and an invention name of "a method, a device, a storage medium, and a mobile terminal for displaying a virtual sticky note." Incorporated by reference in this application.

Technical field

The present invention relates to the technical field of terminals, and in particular, to a method, device, storage medium, and mobile terminal for displaying virtual notes.

Background technique

In the application of the traditional mobile terminal, the sticky note application has functions such as reminding and recording. With the advancement of science and technology and the rapid development of mobile terminal technology, sticky notes in mobile terminals can only enter text from the early days, and now can insert photos, graffiti and other functions. More and more functions can be realized and more powerful. However, whether it is an early note or a current note, the carrier can only be displayed on the display interface of the mobile terminal on the carrier, and there is no more novel display form.

Summary of the Invention

The main purpose of the present invention is to overcome the shortcomings of the prior art described above, and provide a method, device, storage medium and mobile terminal for displaying virtual notes, so as to solve the problem that the notes in mobile terminals can only be displayed on the display interface of the mobile terminal There is no problem with more novel display forms.

An aspect of the present invention provides a method for displaying a virtual sticky note, including: identifying a currently scanned object to obtain a first placement space corresponding to the object; and acquiring a first placement space corresponding to the object. A virtual sticky note; superimposing and displaying the associated virtual sticky note on the object currently appearing on the display screen; the virtual sticky note is an image containing a target content generated in a preset style.

Optionally, identifying the currently scanned object to obtain a first placement space corresponding to the object includes: performing a feature ratio of the image of the object to a recognition map corresponding to each of the preset at least one alternative placement space. Yes; wherein each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map; When any one of the identification maps corresponding to each of the at least one candidate placement space is matched, it is determined that the candidate placement space corresponding to the identified matching map is the first placement space corresponding to the object.

Optionally, the virtual note associated with the first placement space corresponding to the object is stored in the server, and acquiring the virtual note associated with the first placement space corresponding to the object includes sending to the server An identification mark of the first placement space; and receiving a virtual note associated with the first placement space returned by the server according to the identification mark.

Optionally, superimposing and displaying the associated virtual note on the object currently appearing in the display screen includes: obtaining a preset size ratio relationship between the object and the virtual note; The associated virtual sticky note is displayed superimposed on the object.

Optionally, the size ratio relationship includes a length, width, and height ratio relationship between the object and the virtual sticky note.

Optionally, superimposing and displaying the associated virtual notes on the object currently appearing in the display screen includes: when the number of the virtual notes associated with the first placement space is two or more, according to The serial number order of the two or more virtual notes is arranged on the object to display two or more of the virtual notes.

Optionally, the method further includes: when superimposing and displaying the associated virtual notes on the object currently appearing on the display screen, if a delete operation is received for any of the virtual notes, deleting the corresponding virtual note Virtual notes, and delete the target content that generated the corresponding virtual notes.

Optionally, the method further includes: generating the virtual note associated with the first placement space; generating the virtual note associated with the first placement space, including: obtaining target content to be generated by the virtual note Determining a first placement space associated with the target content; generating a corresponding virtual note according to the target content; saving the generated virtual note and the association relationship between the virtual note and the first placement space.

Optionally, obtaining the target content of the virtual note to be generated includes: when the user creates a new note, prompt information indicating whether the new note is to be generated into a virtual note; if a user confirms the feedback command for generating the new note to generate a virtual note, Determining the newly created note as the target content; and / or, when the user performs a content collection operation in the browser, displaying a prompt message as to whether the favorite content is generated as a virtual note; if the user confirms that the collection is received The virtual note feedback command generated by the content, determine the favorite content as the target content; wherein the favorite content includes at least one of an article and a picture; and / or, obtain at least one saved in advance by the user At least one target note selected in the note, and the at least one target note selected by the user is determined as the target content.

Optionally, determining the first placement space associated with the target content includes: receiving an alternative placement space selected by the user from at least one preset placement space preset, and determining the first placement associated with the target content. Space; and / or, identifying a target object within a current scanning range to determine an alternative placement space corresponding to the target object in a preset at least one alternative placement space; The candidate placement space is determined as a first placement space associated with the target content.

Optionally, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map; An alternative placement space selected in an alternative placement space and determined as the first placement space associated with the target content includes receiving the target selected by the user from the identification map corresponding to each of the alternative placement spaces. Identification map; determining an alternative placement space corresponding to the target recognition map as a first placement space associated with the target content.

Optionally, the method further includes: presetting an identification map of the at least one candidate placement space corresponding to at least one object; wherein, setting an alternative placement space corresponding to an object includes receiving the object photographed by a camera At least one image of the image; the object and the at least one image are stored in association as an identification diagram of an alternative placement space corresponding to the object.

Optionally, generating a corresponding virtual note according to the target content includes: sending the target content to a server, and the server generating a corresponding virtual note according to the target content;

Receiving a corresponding virtual note generated according to the target content returned by the server; and / or storing the corresponding virtual note generated by the server.

Optionally, generating a corresponding virtual note according to the target content includes generating the virtual note including the target content according to a preset style.

Optionally, saving the generated virtual note and the correspondence between the virtual note and the first placement space includes: saving the correspondence between the virtual note and the identification identifier of the first placement space; and / Or, upload the virtual sticky note and / or the identification mark of the first placement space to a server for storage, and the server saves the correspondence between the virtual sticky note and the identification mark of the first placement space.

Optionally, the method further includes: when the user modifies the target content for generating the virtual note, the corresponding virtual note saved is modified synchronously.

Optionally, the method further includes: sending virtual sticky note sharing information to the target user; the virtual sticky note sharing information includes storage address information of the virtual sticky note to be shared and a verification password for viewing the virtual sticky note, so that the target The user views the virtual note to be shared according to the storage address information and the verification password; wherein the target user opens the storage address and enters the verification password in a preset input area, and then scans according to corresponding prompts Specify an object, and view the virtual note to be shared superimposedly displayed on the object.

Another aspect of the present invention provides a virtual sticky note display device, including: a recognition unit for recognizing a currently scanned object to obtain a first placement space corresponding to the object; and an obtaining unit for obtaining the A virtual note associated with the first placement space corresponding to the object; a display unit, configured to superimpose and display the associated virtual note on the object currently appearing in the display screen; wherein the virtual note is in accordance with a preset A style-generated image containing the target content.

Optionally, the recognition unit recognizes a currently scanned object to obtain a first placement space corresponding to the object, and includes: respectively corresponding to an image of the object and at least one preset placement space that is preset. The identification map performs feature comparison; wherein each of the candidate placement spaces in the at least one alternative placement space corresponds to an object, and each object corresponding to the alternative placement space has at least one identification map; if it is determined If the object matches any of the recognition maps in the recognition maps corresponding to the at least one candidate placement space respectively, it is determined that the candidate placement space corresponding to the matched recognition map is the first corresponding to the object. Place space.

Optionally, the virtual note associated with the first placement space corresponding to the object is stored in a server, and the obtaining unit obtains a virtual note associated with the first placement space corresponding to the object, The method includes: sending an identification identifier of the first placement space to a server; and receiving a virtual note associated with the first placement space returned by the server according to the identification identifier.

Optionally, the display unit superimposing and displaying the associated virtual note on the object currently appearing in the display screen includes: obtaining a preset size ratio relationship between the object and the virtual note; and according to the The size ratio relationship superimposes and displays the associated virtual notes on the object.

Optionally, the display unit superimposing and displaying the associated virtual notes on the object currently appearing on the display screen includes: when the number of the virtual notes associated with the first placement space is two When there are more than two, according to the sequence number of two or more virtual notes, two or more of the virtual notes are arranged and displayed on the object.

Optionally, the device further includes: a deleting unit, configured to superimpose and display the associated virtual notes on the object currently appearing on the display screen, if a deletion operation of any of the virtual notes is received , Then delete the corresponding virtual note, and delete the corresponding target content that generated the corresponding virtual note.

Optionally, the apparatus further includes: a generating unit for generating the virtual note associated with the first placement space; the generating unit includes: an obtaining subunit for obtaining target content of the virtual note to be generated Determining subunits for determining a first placement space associated with the target content; generating subunits for generating corresponding virtual notes according to the target content; saving subunits for saving the generated virtual notes and An association relationship between the virtual sticky note and the first placement space.

Optionally, the acquiring subunit, which acquires the target content of the virtual note to be generated, includes: when the user creates a new note, prompt information indicating whether the new note is to be generated into a virtual note; if the user confirms that the new note is generated, A virtual sticky note feedback command, determining the newly created sticky note as the target content; and / or, when a user performs a content collection operation in a browser, displaying a prompt message as to whether the favorited content is generated as a virtual sticky note; if received The user confirms that the favorite content is generated into a virtual note feedback command, and then determines the favorite content as the target content; wherein the favorite content includes at least one of an article and a picture; and / or, acquires the user At least one target note selected from at least one previously saved note, and the at least one target note selected by the user is determined as the target content.

Optionally, the determining subunit, determining the first placement space associated with the target content, includes: receiving a candidate placement space selected by the user from at least one preset placement space that is preset, and determining as the target A content-associated first placement space; and / or identifying a target object within a current scanning range to determine an alternative placement space corresponding to the target object in a preset at least one alternative placement space; The candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.

Optionally, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map; the determining subunit, receives The user selects an alternative placement space from the preset at least one alternative placement space, and determines the first placement space associated with the target content, including: receiving, by the user, a corresponding one from each of the alternative placement spaces. The target recognition map selected in the recognition map; the candidate placement space corresponding to the target recognition map is determined to be the first placement space associated with the target content.

Optionally, the device further includes: a setting unit configured to preset an identification map of at least one candidate placement space corresponding to at least one object; wherein, setting the candidate placement space corresponding to one object includes receiving a photographed by a camera At least one image of the object; the object and the at least one image are stored in association as an identification map of an alternative placement space corresponding to the object.

Optionally, the generating subunit generates a corresponding virtual note according to the target content, including: sending the target content to a server, and the server generating a corresponding virtual note according to the target content; receiving the server return A corresponding virtual sticky note generated according to the target content; and / or, the server generates the corresponding virtual sticky note generated.

Optionally, the generating subunit generates a corresponding virtual note according to the target content, including: generating the virtual note including the target content according to a preset style. Optionally, the saving subunit, which stores the generated virtual note and the correspondence between the virtual note and the first placement space, includes: saving the identification identifier of the virtual note and the first placement space Corresponding relationship; and / or, uploading the virtual note and / or the identification mark of the first placement space to a server for storage, and the server storing the identification note of the virtual note and the first placement space Corresponding relationship.

Optionally, the apparatus further includes: a synchronization unit, configured to synchronize and modify the saved corresponding virtual note when the user modifies the target content for generating the virtual note.

Optionally, the device further includes a sharing unit configured to send virtual note sharing information to the target user; the virtual note sharing information includes storage address information of the virtual note to be shared and a verification password for viewing the virtual note So that the target user can view the virtual note to be shared according to the storage address information and the verification password; wherein after the target user opens the storage address and enters the verification password in a preset input area, Scan the designated object according to the corresponding prompt to view the virtual note to be shared superimposed and displayed on the object.

Another aspect of the present invention provides a storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the foregoing methods are implemented.

Another aspect of the present invention provides a mobile terminal including a processor, a memory, and a computer program stored on the memory and executable on the processor. When the processor executes the program, the steps of any one of the foregoing methods are implemented. .

A further aspect of the present invention provides a mobile terminal, including the foregoing virtual note display device.

According to the technical solution of the present invention, when a specific object is scanned using a mobile terminal, the first scanned space corresponding to the object is acquired by identifying the currently scanned object, and a virtual note associated with the first placed space is acquired, so that the Associated virtual notes are superimposed on the object to achieve the effect of viewing notes in augmented and augmented reality, changing the way to view notes, increasing the fun and interactivity of viewing notes, and improving the user experience. In addition, the present invention can generate corresponding virtual notes from any target content selected by the user, so that the notes, favorite articles, and photos saved or newly created in the user's mobile terminal can be viewed and edited in an augmented reality environment, which enhances the user Interest in using sticky notes app.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The schematic embodiments of the present invention and the descriptions thereof are used to explain the present invention, and do not constitute an improper limitation on the present invention. In the drawings:

FIG. 1 is a method schematic diagram of an embodiment of a method for displaying a virtual note provided by the present invention; FIG.

FIG. 2 is an example diagram of arranging and displaying virtual notes on objects using a refrigerator as an example according to an embodiment of the present invention; FIG.

3 is a schematic method diagram of another embodiment of a method for displaying a virtual note provided by the present invention;

4 is a schematic flowchart of a specific implementation step of generating the virtual note associated with the first placement space according to an embodiment of the present invention;

5 is a schematic method diagram of another embodiment of a method for displaying a virtual note provided by the present invention;

6 is a schematic method diagram of still another embodiment of a method for displaying a virtual note provided by the present invention;

7 is a schematic method diagram of still another embodiment of a method for displaying a virtual note provided by the present invention;

8 is a schematic structural diagram of an embodiment of a virtual note display device provided by the present invention;

9 is a schematic structural diagram of another embodiment of a virtual note display device provided by the present invention;

10 is a schematic structural diagram of a specific implementation manner of a generating unit according to an embodiment of the present invention;

11 is a schematic structural diagram of another embodiment of a virtual note display device provided by the present invention;

12 is a schematic structural diagram of still another embodiment of a virtual note display device provided by the present invention;

FIG. 13 is a schematic structural diagram of still another embodiment of a virtual note display device provided by the present invention.

Detailed ways

In order to make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described in combination with specific embodiments of the present invention and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It should be noted that the terms “first” and “second” in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way are interchangeable where appropriate, so that the embodiments of the invention described herein can be implemented in an order other than those illustrated or described herein. Furthermore, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that contains a series of steps or units need not be limited to those explicitly listed Those steps or units may instead include other steps or units not explicitly listed or inherent to these processes, methods, products or equipment.

With the rapid development of Internet technology, AR (augmented reality) technology is becoming more and more mature, and AR scene applications are also increasing. By scanning the specified patterns, such as butterflies, red envelopes, plants, flowers, etc., you can obtain the corresponding identification content, such as the description information of the scanned object, extended information of the scanned object, such as random red envelopes, etc .; by identifying the indoor space, you can view at any angle By placing furniture, you can obtain virtual scenes and objects by identifying patterns. Existing AR technology is widely used in every corner of mobile phone applications. For example, mobile games. The main idea of the present invention is to generate a normal note (with a certain form of images, graphics, etc.) from ordinary notes and / or favorite pictures, articles, etc., and scan and identify the object through a mobile terminal such as a mobile phone. The surface of the object displays associated virtual notes, which enhances the fun of viewing the notes.

FIG. 1 is a schematic diagram of a method for displaying a virtual note according to an embodiment of the present invention. As shown in FIG. 1, according to an embodiment of the present invention, the method for displaying a virtual note includes at least steps S110, S120, and S130.

In step S110, the currently scanned object is identified to obtain a first placement space corresponding to the object.

The first placement space refers to the object as a placement position for placing a virtual note, and the first placement space is used to identify the object and an association relationship between the object and a virtual note associated with the object. In a specific implementation manner, a feature comparison is performed between an image of the object and an identification map corresponding to each of the preset at least one alternative placement space; if it is determined that the object corresponds to each of the at least one alternative placement space If any of the recognition maps in the recognition map matches, it is determined that the candidate placement space corresponding to the matched recognition map is the first placement space corresponding to the object.

Wherein, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map. The alternative placement space refers to a corresponding object as a placement position for placing a virtual note, and the alternative placement space is used to identify a corresponding object and an association relationship between the corresponding object and a virtual note associated with the object. The identification map may specifically be a photo of an object corresponding to the candidate placement space. For example, multiple different identification pictures of a refrigerator taken from different angles.

Step S120: Obtain a virtual note associated with the first placement space corresponding to the object.

The virtual sticky note may specifically be an image containing target content generated according to a preset style. For example, it has the style of a solid note and contains an image of the target content. The process of generating a virtual sticky note will be described in detail in the following embodiments.

In a specific implementation manner, when the virtual note associated with the first placement space is stored locally, the virtual identifier associated with the first placement space corresponding to the object is obtained according to the identification identifier of the first placement space. Notes. The identification mark may specifically be an identification map of an object corresponding to the first placement space. After the virtual note is generated, the association relationship of the identification map of the object corresponding to the first placement space associated with the virtual note is saved, and the virtual note associated with the first placement space is found according to the association relationship.

In another specific implementation manner, the virtual note associated with the first placement space is stored in a server, and when the virtual note associated with the first placement space corresponding to the object is obtained, the first An identification mark of the placement space; and receiving a virtual note associated with the first placement space returned by the server according to the identification mark. The identification mark may specifically be an identification map of an object corresponding to the first placement space.

Specifically, the virtual note may be generated by the server, or sent to the server for storage when the virtual note is generated locally, and the generated virtual note is stored by the server and associated with the identification map of the object corresponding to the first placement space associated with the virtual note. The relationship sends the identification identifier of the first placement space to the server, and the server searches for the virtual note associated with the first placement space according to the association relationship, and receives the associated virtual note returned by the server.

Step S130: superimpose and display the associated virtual note on the object currently appearing in the display screen.

In a specific implementation manner, a preset size ratio relationship between the object and the virtual note is obtained; and the associated virtual note is superimposed and displayed on the object according to the size ratio relationship. That is, the associated virtual notes are superimposed and displayed on the object (not photographed) in the range of the currently visible scene in the display screen of the used mobile terminal, that is, the display on the used mobile terminal What is displayed on the screen is a virtual note superimposed on a real object. The size ratio relationship may specifically include a length, width, and height ratio relationship between the object and the virtual sticky note. For example, according to the physical size of the object and the physical size of the note, a size proportional relationship between different objects and the virtual note may be set in advance, such as a length, width, and height proportional relationship.

Optionally, when the number of the virtual notes associated with the first placement space is two or more, two or more of the virtual notes may be randomly arranged and displayed on the object. Preferably, two or more of the virtual notes are arranged and displayed on the object according to the serial number sequence of the two or more of the virtual notes.

For example, the ordinary notes in the mobile phone are generally arranged according to the order of the establishment time. The closer the establishment time is to the current, the larger the serial number is. Arranged on objects. FIG. 2 is an example diagram of arranging and displaying virtual notes on objects using a refrigerator as an example according to an embodiment of the present invention. Among them, 1 is a refrigerator, 2 is a screen of a mobile phone, and 3 is a virtual sticky note. Since the size ratio relationship between the object and the virtual note is fixed, the user can adjust the size of the virtual note displayed on the object image by adjusting the distance between the mobile terminal used and the object, that is, the mobile terminal and The closer the distance of the object, the larger the displayed virtual sticky note, and the clearer the target content contained therein.

In a practical example, the user opens the mobile phone's note app and turns on the camera in the note app to identify the current object, for example, the current object is a refrigerator. The mobile phone screen will present virtual notes in an orderly arrangement on the surface of the refrigerator. ; The user can view the contents of the memo by changing the distance between the mobile phone and the refrigerator by clicking, and clicking any virtual memo, the content of the virtual memo can be adaptively expanded on the screen of the mobile phone.

FIG. 3 is a schematic method diagram of another embodiment of a method for displaying a virtual note provided by the present invention. As shown in FIG. 3, based on the above embodiment, according to another embodiment of the present invention, the method for displaying a virtual note further includes step S100.

Step S100: Generate the virtual note associated with the first placement space.

FIG. 4 is a schematic flowchart of a specific implementation step of generating the virtual note associated with the first placement space according to an embodiment of the present invention. As shown in FIG. 4, step S100 specifically includes steps S1011, S1012, S1013, and S1014.

Step S1011: Obtain the target content of the virtual note to be generated.

The target content may specifically include a general note created by a user and / or content collected by a user through a browser.

In a specific implementation manner, the target content includes a general note created by a user on a mobile terminal. Specifically, when the user creates a new note, prompt information is displayed as to whether the new note is to be generated as a virtual note; if a user confirms that the newly created note is generated as a virtual note feedback command, the newly created note is determined as the target content. For example, when the user creates a new note in the mobile phone, an option of whether to generate a virtual note is displayed. If the user selects Yes, it is determined that the note newly created by the user is the target content.

In another specific implementation manner, the target content includes content collected by a user through a browser. Specifically, when the user performs a content bookmarking operation in the browser, prompt information is displayed as to whether the bookmarked content is generated as a virtual note; if the user receives a feedback command for confirming that the bookmarked content is generated as a virtual note, the bookmark is displayed. The content is determined as the target content; wherein the favorite content includes at least one of an article and a picture. For example, when a user collects content such as articles and pictures through a collection function of a browser application in a mobile phone, a pop-up option of generating virtual notes is popped up. If the user selects Yes, the content, such as articles, pictures, etc. that the user has favorited is determined as the target content.

In yet another specific implementation manner, at least one target note selected by the user among at least one pre-saved note that is pre-saved is acquired, and the at least one target note selected by the user is determined as the target content. For example, the user may select a general note for generating a virtual note from among a plurality of notes saved by the user, and the general note selected by the user for generating a virtual note is determined as the target content.

Step S1012: Determine a first placement space associated with the target content.

In a specific implementation manner, an alternative placement space selected by the user from at least one preset alternative placement space is received, and determined as the first placement space associated with the target content. Wherein, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map. The identification map may specifically be a photo of an object corresponding to the candidate placement space. For example, multiple different identification pictures of a refrigerator taken from different angles.

Specifically, an identification map of at least one alternative placement space corresponding to at least one object may be set in advance; wherein setting an alternative placement space corresponding to one object specifically includes: receiving at least one image of the object captured by a camera; and associating and saving The object and the at least one image are used as a recognition map of an alternative placement space corresponding to the object. For example, a user takes a picture of an object that is to be placed as a virtual sticky note through the camera of the mobile terminal. The user can take pictures of the object from multiple angles and use the received pictures of the object from multiple angles of the user as the object. The recognition map of the corresponding alternative placement space can accelerate the speed of object recognition. Receiving the target identification map selected by the user from the identification map corresponding to each of the candidate placement spaces; determining that the candidate placement space corresponding to the target identification map is the first placement space associated with the target content.

In another specific implementation manner, the target object within the current scanning range is identified to determine an alternative placement space corresponding to the target object in a preset at least one alternative placement space; the target object is correspondingly The candidate placement space of is determined to be a first placement space associated with the target content.

Specifically, the image of the target object in the current scanning range is matched with the identification map corresponding to each of the preset at least one alternative placement space, and the candidate placement corresponding to the identification map with the highest degree of image matching of the target object is matched The space is determined as the candidate placement space corresponding to the target object, and the candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.

Step S1013: Generate a corresponding virtual note according to the target content.

In a specific implementation manner, the (mobile terminal implementing the present invention) locally generates a corresponding virtual note according to the target content, and specifically generates a virtual note containing the target content according to a preset style.

In another specific implementation manner, the target content is sent to a server, and the server generates a corresponding virtual note according to the target content. The server generates a virtual note containing the target content according to a preset style.

Step S1014: Save the generated virtual sticky note and the correspondence between the virtual sticky note and the first placement space.

In a specific implementation manner, the correspondence between the generated virtual note and the identification identifier of the first placement space is saved. That is, the correspondence between the virtual sticky note and the identification mark of the first placement space is stored locally (the mobile terminal implementing the method), so as to find a corresponding virtual sticky note according to the identification mark of the first placement space.

In another specific implementation manner, the generated virtual sticky note and / or the identification identifier of the first placement space is uploaded to a server for storage, and the generated virtual sticky note and the first are saved by the server. Correspondence between the identification mark of the placement space, so that when displaying the virtual note corresponding to the first placement space, the identification mark of the first placement space is sent to the server, and the server searches for the first placement space according to the identification mark. Place virtual notes associated with the space.

In a practical example, a user opens a note application in a mobile phone, selects a note recognition map entry, opens a camera to point at an object to be recognized, such as a refrigerator, and generates a recognition map of the refrigerator after scanning. The recognition map can be a recognition map corresponding to multiple different objects, and different recognition maps represent different virtual note placement spaces. For example, if the recognition map is a refrigerator, the refrigerator is used to generate a virtual note placement space; the recognition map is a television, The television is used as a space for generating the generated virtual notes. The user opens the mobile note application, selects a normal note to generate a virtual note, and selects a space after generating the virtual note. The mobile phone generates a corresponding virtual note in the background or uploads it to the server to generate a corresponding virtual note.

In another practical example, when the user saves the article or photo in the browser to the favorite folder, a dialog box pops up to ask the user whether to generate a virtual sticky note. If the user selects Yes, the user's favorite article or picture will be automatically stored in the mobile phone Add to the note, after the user opens the note application, a dialog box pops up asking the user to store the virtual note space for articles and pictures. For example, A, B, C, and D are saved in the browser, and the note is opened. The application will prompt the user to put the content in the refrigerator's corresponding space and the TV's space; if the user chooses No, it will only be added to the browser's favorite folder. When the user selects content placed in different placement spaces, the corresponding virtual note is generated in the background, or the content is uploaded to the cloud server, and the cloud server generates the corresponding virtual note, and saves the associated relationship between the generated virtual note and the corresponding placement space.

FIG. 5 is a method schematic diagram of another embodiment of a method for displaying a virtual note provided by the present invention. As shown in FIG. 5, based on any of the foregoing embodiments, according to another embodiment of the present invention, the method for displaying a virtual note further includes step S140.

Step S140: When the associated virtual note is superimposed and displayed on the object currently appearing on the display screen, if a deletion operation of any of the virtual notes is received, the corresponding virtual note is deleted, and the generation office is deleted. Describe the corresponding target content of the corresponding virtual sticky note.

For example, when viewing a virtual note, the user may delete the virtual note when the virtual note is displayed superimposed on the object currently appearing in the display screen. If the user receives any of the displayed virtual notes, The delete operation of the sticky note deletes the virtual sticky note and deletes the target content that generates the virtual sticky note. For example, if the virtual sticky note is generated by a normal sticky note in a mobile phone, the normal sticky note saved in the mobile phone is deleted.

FIG. 6 is a method schematic diagram of still another embodiment of a method for displaying a virtual note provided by the present invention. As shown in FIG. 6, based on any of the foregoing embodiments, according to yet another embodiment of the present invention, the method for displaying a virtual note further includes step S150.

In step S150, when the user modifies the target content for generating the virtual note, the corresponding virtual note saved is modified synchronously.

For example, when the user modifies the content of any ordinary note that has generated corresponding virtual notes stored in the mobile phone, the modified note content is synchronized to the corresponding virtual note saved locally, and / or the modified note content is Synchronize to the corresponding virtual note saved on the server.

FIG. 7 is a method schematic diagram of still another embodiment of a method for displaying a virtual note provided by the present invention. As shown in FIG. 7, based on any of the foregoing embodiments, according to still another embodiment of the present invention, the method for displaying a virtual note further includes step S160.

Step S160: Send virtual note sharing information to the target user, so that the target user can view the virtual note to be shared according to the storage address information and the verification password included in the virtual note sharing information.

Specifically, the virtual note to be shared may be stored on the server. The virtual note sharing information includes the link address information of the virtual note to be shared and a verification password for viewing the virtual note, so that the target user can The link address information and the verification password to view the virtual sticky note to be shared; after the target user opens the storage address and enters the verification password in a preset input area, scan the designated object according to the corresponding prompt to view the The virtual note to be shared is displayed superimposed on the object.

For example, the user opens a preset password input page by clicking the link address information. After the user enters the verification password on the password input page, the page is displayed prompting the user to scan the placement space associated with the virtual note to be shared. For the corresponding object, after the user scans the object, the server transmits the corresponding virtual note to the mobile phone of the user, and the virtual note to be shared is superimposed on the object currently displayed on the mobile phone.

FIG. 8 is a schematic structural diagram of an embodiment of a virtual note display device provided by the present invention. As shown in FIG. 8, the virtual sticky note display device 100 includes a recognition unit 110, an acquisition unit 120, and a display unit 130.

The identification unit 110 is configured to identify the currently scanned object to obtain a first placement space corresponding to the object; the acquisition unit 120 is used to obtain a virtual note associated with the first placement space corresponding to the object; a display unit For superimposing and displaying the associated virtual note on the object currently appearing in the display screen; wherein the virtual note is an image containing a target content generated according to a preset style.

The first placement space refers to the object as a placement position for placing a virtual note, and the first placement space is used to identify the object and an association relationship between the object and a virtual note associated with the object. In a specific implementation manner, the recognition unit 110 performs a feature comparison between an image of the object and an identification map corresponding to each of the preset at least one alternative placement space; if it is determined that the object is at least one backup space If any one of the identification maps corresponding to the respective placement spaces is selected to match, it is determined that the candidate placement space corresponding to the matching identification map is the first placement space corresponding to the object. Wherein, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map. The alternative placement space refers to a corresponding object as a placement position for placing a virtual note, and the alternative placement space is used to identify a corresponding object and an association relationship between the corresponding object and a virtual note associated with the object. The identification map may specifically be a photo of an object corresponding to the candidate placement space. For example, multiple different identification pictures of a refrigerator taken from different angles.

The obtaining unit 120 obtains a virtual note associated with the first placement space corresponding to the object. The virtual sticky note may specifically be an image containing target content generated according to a preset style. For example, it has the style of a solid note and contains an image of the target content.

In another specific implementation manner, the virtual note associated with the first placement space corresponding to the object is stored in a server, and the obtaining unit 120 sends an identification identifier of the first placement space to the server; Receiving a virtual note associated with the first placement space returned by the server according to the identification identifier. The identification mark may specifically be an identification map of an object corresponding to the first placement space.

Specifically, the virtual note may be generated by the server, or sent to the server for storage when the virtual note is generated locally, and the generated virtual note is associated with the identification map of the object corresponding to the first placement space stored by the server. The relationship obtaining unit 120 sends the identification of the first placement space to the server, and the server searches for the virtual note associated with the first placement space according to the association relationship, and receives the associated virtual note returned by the server.

The display unit 130 superimposes and displays the associated virtual notes on the object currently appearing in the display screen.

In a specific implementation manner, the display unit 130 obtains a preset size ratio relationship between the object and the virtual note; and superimposes and displays the associated virtual note on the object according to the size ratio relationship. That is, the associated virtual notes are superimposed and displayed on the object (not photographed) in the range of the currently visible scene in the display screen of the used mobile terminal, that is, the display on the used mobile terminal What is displayed on the screen is a virtual note superimposed on a real object. The size ratio relationship may specifically include a length, width, and height ratio relationship between the object and the virtual sticky note. For example, according to the physical size of the object and the physical size of the note, a size proportional relationship between different objects and the virtual note may be set in advance, such as a length, width, and height proportional relationship.

Optionally, when the number of the virtual notes associated with the first placement space is two or more, the display unit 130 may randomly display two or more of the virtual notes on the object. Preferably, two or more of the virtual notes are arranged and displayed on the object according to the serial number sequence of the two or more of the virtual notes.

FIG. 9 is a schematic structural diagram of another embodiment of a virtual note display device provided by the present invention. As shown in FIG. 9, the virtual note display device 100 further includes a generating unit 101.

The generating unit 101 is configured to generate the virtual note associated with the first placement space.

FIG. 10 is a schematic structural diagram of a specific implementation manner of a generating unit according to an embodiment of the present invention. As shown in FIG. 10, the generating unit 101 includes an obtaining subunit 1011, a determining subunit 1012, a generating subunit 1013, and a saving subunit 1014.

The obtaining subunit 1011 is used to obtain the target content of the virtual note to be generated; the determining subunit 1012 is used to determine the first placement space associated with the target content; the generating subunit 1013 is used to generate the corresponding virtual note according to the target content; The saving subunit 1014 is configured to save the generated virtual note and the association relationship between the virtual note and the first placement space. The target content may specifically include a general note created by a user and / or content collected by a user through a browser.

In a specific implementation manner, the target content includes a general note created by a user on a mobile terminal. The acquisition subunit 1011 acquires the target content of the virtual note to be generated specifically includes: when the user creates a new note, a prompt message is displayed whether to generate a new note to generate a virtual note; if a user confirms that the newly created note is generated as a virtual note feedback command, Determining the newly created sticky note as the target content. For example, when the user creates a new note in the mobile phone, an option of whether to generate a virtual note is displayed. If the user selects Yes, it is determined that the note newly created by the user is the target content.

In another specific implementation manner, the target content includes content collected by a user through a browser. The obtaining subunit 1011 obtains the target content of the virtual note to be generated specifically includes: when the user performs a content collection operation in the browser, displaying a prompt message as to whether the favorite content is to be generated as a virtual note; if the user confirms that the favorite The content generation virtual sticky note feedback command determines the favorite content as the target content; wherein the favorite content includes at least one of an article and a picture. For example, when a user collects content such as articles and pictures through a collection function of a browser application in a mobile phone, a pop-up option of generating virtual notes is popped up. If the user selects Yes, the content, such as articles, pictures, etc. that the user has favorited is determined as the target content.

In yet another specific implementation manner, the acquisition subunit 1011 acquires at least one target note selected by the user from at least one pre-saved note, and determines the at least one target note selected by the user as the target content. For example, the user may select an ordinary note for generating a virtual note among a plurality of notes saved by the user, and the ordinary note for generating a virtual note selected by the user is determined as the target content.

The determining subunit 1012 determines a first placement space associated with the target content.

In a specific implementation manner, the determination subunit 1012 receives a candidate placement space selected by the user from a preset at least one alternative placement space, and determines the first placement space associated with the target content. Wherein, each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each object corresponding to the candidate placement space has at least one identification map. The identification map may specifically be a photo of an object corresponding to the candidate placement space. For example, multiple different identification pictures of a refrigerator taken from different angles.

Specifically, the virtual sticky note display device 100 includes a setting unit for presetting an identification map of at least one candidate placement space corresponding to at least one object. Wherein, setting an alternative placement space corresponding to an object specifically includes: receiving at least one image of the object captured by a camera; associating and storing the object and the at least one image as an alternative placement corresponding to the object Space identification map. For example, a user takes a picture of an object that is to be placed as a virtual sticky note through the camera of the mobile terminal. The user can take pictures of the object from multiple angles and use the received pictures of the object from multiple angles of the user as the object. The recognition map of the corresponding alternative placement space can accelerate the speed of object recognition. The determining subunit 1012 receives the target identification map selected by the user from the identification map corresponding to each of the candidate placement spaces; determining the alternative placement space corresponding to the target recognition map as a first placement associated with the target content space.

In another specific implementation manner, the determining subunit 1012 identifies a target object within the current scanning range to determine a candidate placement space corresponding to the target object in a preset at least one candidate placement space; The candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.

Specifically, the image of the target object in the current scanning range is matched with the identification map corresponding to each of the preset at least one alternative placement space, and the candidate placement corresponding to the identification map with the highest degree of matching of the target image The space is determined as the candidate placement space corresponding to the target object, and the candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.

The generating subunit 1013 generates a corresponding virtual note according to the target content.

The saving subunit 1014 saves the virtual note and a correspondence between the virtual note and the first placement space.

In a specific implementation manner, the saving subunit 1014 saves the corresponding relationship between the generated virtual note and the identification identifier of the first placement space. That is, the correspondence between the virtual sticky note and the identification mark of the first placement space is stored locally (the mobile terminal implementing the method), so as to find a corresponding virtual sticky note according to the identification mark of the first placement space.

In another specific implementation manner, the saving subunit 1014 uploads the generated virtual sticky note and / or the identification identifier of the first placement space to a server for storage, and the generated virtual sticky note is saved with the server. The correspondence between the identification marks of the first placement space, so that when displaying the virtual notes corresponding to the first placement space, the identification marks of the first placement space are sent to the server, and the server searches for A virtual note associated with the first placement space.

FIG. 11 is a schematic structural diagram of another embodiment of a virtual note display device provided by the present invention. As shown in FIG. 11, the virtual note display device 100 further includes a deletion unit 140.

The deleting unit 140 is configured to superimpose and display the associated virtual notes on the object currently appearing on the display screen, and if a deletion operation of any of the virtual notes is received, delete the corresponding virtual notes and delete Generate corresponding target content of the corresponding virtual note.

FIG. 12 is a schematic structural diagram of still another embodiment of a virtual note display device provided by the present invention. As shown in FIG. 12, based on any of the foregoing embodiments, the virtual note display device 100 further includes a synchronization unit 150.

The synchronization unit 150 is configured to synchronize and modify the saved corresponding virtual note when the user modifies the target content that generates the virtual note.

FIG. 13 is a schematic structural diagram of still another embodiment of a virtual note display device provided by the present invention. As shown in FIG. 13, based on any of the foregoing embodiments, the virtual note display device 100 further includes a sharing unit 160.

The sharing unit 160 is configured to send virtual sticky note sharing information to the target user, so that the target user can view the virtual sticky note to be shared according to the storage address information and the verification password contained in the virtual sticky note sharing information.

The present invention also provides a storage medium corresponding to the method for displaying a virtual sticky note, on which a computer program is stored, and when the program is executed by a processor, the steps of any of the foregoing methods are implemented.

The present invention also provides a mobile terminal corresponding to the method for displaying a virtual note, including a processor, a memory, and a computer program stored on the memory and executable on the processor. The processor implements any of the foregoing tasks when the processor executes the program. Steps of the method.

The present invention also provides a mobile terminal corresponding to the virtual memo display device, including the virtual memo display device of any one of the foregoing.

According to the solution provided by the present invention, when a specific object is scanned using a mobile terminal, the first scanned space corresponding to the object is obtained by identifying the currently scanned object, and a virtual note associated with the first placed space is obtained, thereby The associated virtual notes are superimposed on the object to realize the effect of viewing notes in augmented and augmented reality, changing the way to view notes, increasing the fun and interactivity of viewing notes, and improving the user experience. In addition, the present invention can generate corresponding virtual notes from any target content selected by the user, so that the notes, favorite articles, and photos saved or newly created in the user's mobile terminal can be viewed and edited in an augmented reality environment, which enhances the user Interest in using sticky notes app.

The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Other examples and implementations are within the scope and spirit of the invention and the appended claims. For example, due to the nature of software, the functions described above may be implemented using software performed by a processor, hardware, firmware, hard-wired, or a combination of any of these. In addition, each functional unit may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit.

In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the unit may be a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or may be combined. Integration into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or other forms.

The units described as separate components may or may not be physically separated, and the components as the control device may or may not be physical units, that is, may be located in one place, or may be distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium , Including a number of instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in various embodiments of the present invention. The foregoing storage media include: U disks, Read-Only Memory (ROM), Random Access Memory (RAM), mobile hard disks, magnetic disks, or optical disks, and other media that can store program codes .

The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall be included in the scope of the claims of the present invention.

Claims

A method for displaying a virtual sticky note, comprising:

Identifying the currently scanned object to obtain a first placement space corresponding to the object;

Acquiring a virtual sticky note associated with the first placement space corresponding to the object;

Superimposing and displaying the associated virtual notes on the object currently appearing on the display screen;

The virtual sticky note is an image containing target content generated in a preset style.
The method according to claim 1, wherein identifying the currently scanned object to obtain a first placement space corresponding to the object comprises:

Feature comparison is performed between the image of the object and an identification map corresponding to each of the preset at least one candidate placement space; wherein each of the candidate placement spaces in the at least one candidate placement space corresponds to one object, each An object corresponding to each of the candidate placement spaces has at least one identification map;

If it is determined that the object matches any of the recognition maps in the recognition maps corresponding to the at least one candidate placement space respectively, it is determined that the candidate placement space corresponding to the matched recognition map is the corresponding to the object. First placement space.
The method according to claim 1 or 2, wherein the virtual notes associated with the first placement space corresponding to the object are stored in a server, and the first placement corresponding to the object is obtained Space-linked virtual notes, including:

Sending an identification identifier of the first placement space to a server;

Receiving a virtual note associated with the first placement space returned by the server according to the identification identifier.
The method according to any one of claims 1-3, wherein superimposing and displaying the associated virtual notes on the object currently appearing in the display screen comprises:

Obtaining a preset size ratio relationship between the object and the virtual note;

Superimposing and displaying the associated virtual note on the object according to the size ratio relationship.
The method according to claim 4, wherein the size proportional relationship includes a length, width, and height proportional relationship between the object and the virtual sticky note.
The method according to any one of claims 1 to 5, characterized in that superimposing and displaying the associated virtual notes on the object currently appearing in the display screen comprises:

When the number of the virtual notes associated with the first placement space is two or more, two or more of the virtual notes are arranged and displayed on the object according to the sequence number of the two or more virtual notes.
The method according to any one of claims 1-6, further comprising:

When the associated virtual note is displayed superimposed on the object currently appearing in the display screen, if a delete operation is received for any of the virtual notes, the corresponding virtual note is deleted, and the corresponding generated The target content of the virtual sticky note.
The method according to any one of claims 1 to 7, further comprising: generating the virtual note associated with the first placement space;

Generating the virtual note associated with the first placement space includes:

Acquiring target content to generate the virtual sticky note;

Determining a first placement space associated with the target content;

Generating a corresponding virtual note according to the target content;

The generated virtual sticky note and the association relationship between the virtual sticky note and the first placement space are saved.
The method according to claim 8, wherein obtaining target content of a virtual note to be generated comprises:

When the user creates a new note, a prompt message is displayed as to whether the new note will be generated into a virtual note;

If a user confirms that the newly created note is generated as a virtual note feedback command, determining the newly created note as the target content;

and / or,

When the user performs a content collection operation in a browser, a prompt message is displayed whether to generate the favorite content into a virtual sticky note;

If a user confirms that the favorite content is generated as a virtual note feedback command, determining the favorite content as the target content;

Wherein, the content of the collection includes at least one of an article and a picture;

and / or,

At least one target note selected by the user among at least one pre-saved note is obtained, and the at least one target note selected by the user is determined as the target content.
The method according to claim 8 or 9, wherein determining the first placement space associated with the target content comprises:

Receiving an alternative placement space selected by the user from at least one preset alternative placement space, and determining the first placement space associated with the target content;

and / or,

Identifying a target object within a current scanning range to determine a candidate alternative placement space corresponding to the target object in at least one preset alternative placement space;

The candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.
The method according to claim 10, wherein each of the at least one candidate placement space corresponds to an object, and each of the objects corresponding to the candidate placement space has at least one identification Figure;

Receiving an alternative placement space selected by the user from at least one preset alternative placement space and determining the first placement space associated with the target content includes:

Receiving a target recognition map selected by the user from a recognition map corresponding to each of the candidate placement spaces;

It is determined that the candidate placement space corresponding to the target recognition map is a first placement space associated with the target content.
The method according to claim 11, further comprising: presetting an identification map of the at least one candidate placement space corresponding to at least one object;

Wherein, setting an alternative placement space corresponding to an object includes:

Receiving at least one image of the object captured by a camera;

Associate and save the object and the at least one image as an identification map of an alternative placement space corresponding to the object.
The method according to any one of claims 8-12, wherein generating a corresponding virtual note according to the target content comprises:

Sending the target content to a server, and the server generates a corresponding virtual note according to the target content;

Receiving a corresponding virtual note generated according to the target content returned by the server; and / or storing the corresponding virtual note generated by the server.
The method according to any one of claims 8-13, wherein generating a corresponding virtual note according to the target content comprises:

And generating the virtual note including the target content in a preset style.
The method according to any one of claims 8 to 14, wherein saving the generated virtual note and a corresponding relationship between the virtual note and the first placement space comprises:

Saving the correspondence between the virtual sticky note and the identification identifier of the first placement space;

and / or,

Upload the virtual sticky note and / or the identification mark of the first placement space to a server for storage, and the server saves the correspondence between the virtual sticky note and the identification mark of the first placement space.
The method according to any one of claims 8-15, further comprising:

When the user modifies the target content for generating the virtual note, the corresponding virtual note saved is modified synchronously.
The method according to any one of claims 8 to 16, further comprising:

Sending virtual sticky note sharing information to the target user; the virtual sticky note sharing information includes storage address information of the virtual sticky note to be shared and a verification password for viewing the virtual sticky note, so that the target user may Verify the password to view the virtual sticky note to be shared;

Wherein, after the target user opens the storage address and enters the verification password in a preset input area, the designated object is scanned by the corresponding prompt to view the virtual note to be shared superimposed and displayed on the object.
A virtual sticky note display device includes:

A recognition unit, configured to recognize a currently scanned object to obtain a first placement space corresponding to the object;

An obtaining unit, configured to obtain a virtual sticky note associated with the first placement space corresponding to the object;

A display unit, configured to superimpose and display the associated virtual notes on the object currently appearing in the display screen;

Wherein, the virtual sticky note is an image containing target content generated according to a preset style.
The device according to claim 18, wherein the recognition unit recognizes the currently scanned object to obtain a first placement space corresponding to the object, comprising:

Feature comparison is performed between the image of the object and an identification map corresponding to each of the preset at least one candidate placement space; wherein each of the candidate placement spaces in the at least one candidate placement space corresponds to one object, each An object corresponding to each of the candidate placement spaces has at least one identification map;

If it is determined that the object matches any of the recognition maps in the recognition maps corresponding to the at least one candidate placement space respectively, it is determined that the candidate placement space corresponding to the matched recognition map is the corresponding to the object. First placement space.
The device according to claim 18 or 19, wherein the virtual notes associated with the first placement space corresponding to the object are stored in a server,

The acquiring unit acquiring a virtual note associated with the first placement space corresponding to the object includes:

Sending an identification identifier of the first placement space to a server;

Receiving a virtual note associated with the first placement space returned by the server according to the identification identifier.
The device according to any one of claims 18-20, wherein the display unit, which superimposes and displays the associated virtual notes on the object currently appearing in the display screen, comprises:

Obtaining a preset size ratio relationship between the object and the virtual note;

Superimposing and displaying the associated virtual notes on the object according to the size ratio relationship.
The device according to claim 21, wherein the size proportional relationship comprises a length, width and height proportional relationship between the object and the virtual sticky note.
The device according to any one of claims 18 to 22, wherein the display unit superimposes and displays the associated virtual notes on the object currently appearing in the display screen, comprising:

When the number of the virtual notes associated with the first placement space is two or more, two or more of the virtual notes are arranged and displayed on the object according to the sequence number of the two or more virtual notes.
The device according to any one of claims 18-23, further comprising:

A deleting unit, configured to superimpose and display the associated virtual note on the object currently appearing on the display screen, and if a delete operation is received on any of the virtual notes, delete the corresponding virtual note, and delete Generate corresponding target content of the corresponding virtual note.
The device according to any one of claims 18 to 24, further comprising: a generating unit, configured to generate the virtual sticky note associated with the first placement space;

The generating unit includes:

An acquisition subunit for acquiring target content of a virtual note to be generated;

A determining subunit, configured to determine a first placement space associated with the target content;

A generating subunit, configured to generate a corresponding virtual note according to the target content;

A saving subunit, configured to save the generated virtual note and the association relationship between the virtual note and the first placement space.
The apparatus according to claim 25, wherein the acquiring subunit, acquiring target content of a virtual note to be generated, comprises:

When the user creates a new note, a prompt message is displayed as to whether the new note will be generated into a virtual note;

If a user confirms that the newly created note is generated as a virtual note feedback command, determining the newly created note as the target content;

and / or,

When the user performs a content collection operation in a browser, a prompt message is displayed whether to generate the favorite content into a virtual sticky note;

If a user confirms that the favorite content is generated as a virtual note feedback command, determining the favorite content as the target content;

Wherein, the content of the collection includes at least one of an article and a picture;

and / or,

At least one target note selected by the user among at least one pre-saved note is obtained, and the at least one target note selected by the user is determined as the target content.
The device according to claim 25 or 26, wherein the determining subunit, which determines a first placement space associated with the target content, comprises:

Receiving an alternative placement space selected by the user from at least one preset alternative placement space, and determining the first placement space associated with the target content;

and / or,

Identifying a target object within a current scanning range to determine a candidate alternative placement space corresponding to the target object in at least one preset alternative placement space;

The candidate placement space corresponding to the target object is determined as a first placement space associated with the target content.
The device according to claim 27, wherein each of the candidate placement spaces in the at least one candidate placement space corresponds to an object, and each of the objects corresponding to the candidate placement space has at least one identification Figure;

The determining subunit, which receives an alternative placement space selected by the user from at least one preset alternative placement space, and determines the first placement space associated with the target content, includes:

Receiving a target recognition map selected by the user from a recognition map corresponding to each of the candidate placement spaces;

It is determined that the candidate placement space corresponding to the target recognition map is a first placement space associated with the target content.
The device according to claim 28, further comprising: a setting unit, configured to set in advance an identification map of at least one candidate placement space corresponding to at least one object;

Wherein, setting an alternative placement space corresponding to an object includes:

Receiving at least one image of the object captured by a camera;

Associate and save the object and the at least one image as an identification map of an alternative placement space corresponding to the object.
The device according to any one of claims 25-29, wherein the generating subunit generates a corresponding virtual note according to the target content, including:

Sending the target content to a server, and the server generates a corresponding virtual note according to the target content;

Receiving a corresponding virtual note generated according to the target content returned by the server; and / or storing the corresponding virtual note generated by the server.
The device according to any one of claims 25 to 30, wherein the generating subunit generates a corresponding virtual note according to the target content, including:

And generating the virtual note including the target content in a preset style.
The device according to any one of claims 25 to 31, wherein the saving subunit, storing the generated virtual note and a correspondence between the virtual note and the first placement space, comprises:

Saving the correspondence between the virtual sticky note and the identification identifier of the first placement space;

and / or,

Upload the virtual sticky note and / or the identification mark of the first placement space to a server for storage, and the server saves the correspondence between the virtual sticky note and the identification mark of the first placement space.
The device according to any one of claims 25-32, further comprising:

The synchronization unit is configured to synchronize and modify the saved corresponding virtual note when the user modifies the target content for generating the virtual note.
The device according to any one of claims 25-33, further comprising:

A sharing unit, configured to send virtual sticky note sharing information to a target user; the virtual sticky note