CN111625092A - Archive consulting system, method, computer device and storage medium - Google Patents

Archive consulting system, method, computer device and storage medium Download PDF

Info

Publication number
CN111625092A
CN111625092A CN202010419408.8A CN202010419408A CN111625092A CN 111625092 A CN111625092 A CN 111625092A CN 202010419408 A CN202010419408 A CN 202010419408A CN 111625092 A CN111625092 A CN 111625092A
Authority
CN
China
Prior art keywords
archive
radio frequency
file
frequency identification
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010419408.8A
Other languages
Chinese (zh)
Inventor
梁哲恒
张金波
邱宇
温柏坚
李端姣
陈剑光
王伯敏
谢清锐
张锦周
曹彦朝
谈树峰
杨灿魁
王宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Power Grid Co Ltd
Original Assignee
Guangdong Power Grid Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Power Grid Co Ltd filed Critical Guangdong Power Grid Co Ltd
Priority to CN202010419408.8A priority Critical patent/CN111625092A/en
Publication of CN111625092A publication Critical patent/CN111625092A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/284—Lexical analysis, e.g. tokenisation or collocates
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • G06K17/0029—Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device the arrangement being specially adapted for wireless interrogation of grouped or bundled articles tagged with wireless record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Electromagnetism (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present application relates to an archive consulting system, method, computer device and storage medium. The system comprises: the system comprises a radio frequency identification tag, radio frequency identification equipment and augmented reality equipment; the radio frequency identification tag is used for storing the file identification of the file; the radio frequency identification device is used for reading the radio frequency identification tag to obtain a file identifier and sending the file identifier to the augmented reality device; and the augmented reality equipment is used for receiving the file identification and generating an augmented reality image matched with the file according to the file identification. By adopting the method, the user can conveniently read the file, and the speed and efficiency of looking up the file are improved.

Description

Archive consulting system, method, computer device and storage medium
Technical Field
The present application relates to the field of archive management technologies, and in particular, to an archive lookup system, method, computer device, and storage medium.
Background
The archives are used as recordable files and data formed in the process of social activities of people, generally have large information quantity, and are stored and managed in order, so that useful information can be conveniently and quickly found in complicated archive information, and the archives can be conveniently sorted and checked by people.
In the traditional archive management technology, a label can be added to an archive, and the archive content is searched, managed and checked according to the label. The labels may be paper labels or electronic labels, and are usually arranged in a certain order. When the label is an electronic label, the electronic text of the file can be obtained by reading the electronic label, and useful information can be conveniently and quickly found according to the electronic text.
However, although the conventional file management technology is convenient for people to search for the file contents, when the file contents need to be read, the reading speed and the reading efficiency are easily affected by reading the tags manually or by moving the terminal, especially in the case of more file contents.
Therefore, the conventional file management technology has the problems of low file searching speed and low efficiency.
Disclosure of Invention
In view of the above, it is desirable to provide an archive consulting system, method, computer device and storage medium capable of improving the archive consulting speed and efficiency.
An archive lookup system, the system comprising: the system comprises a radio frequency identification tag, radio frequency identification equipment and augmented reality equipment;
the radio frequency identification tag is used for storing the archive identification of the archive;
the radio frequency identification device is used for reading the radio frequency identification tag to obtain the file identification and sending the file identification to the augmented reality device;
and the augmented reality equipment is used for receiving the archive identification and generating an augmented reality image matched with the archive according to the archive identification.
In one embodiment, the profile identification includes a profile keyword; the radio frequency identification device is also used for acquiring the archive content of the archive; obtaining a word segmentation result of the file content by performing word segmentation processing on the file content; extracting key words in the file contents according to the word segmentation result to obtain the file key words;
the radio frequency identification device is further configured to write the archive keyword into the radio frequency identification tag, so that the radio frequency identification tag stores the archive keyword.
In one embodiment, the augmented reality device is further configured to obtain a keyword image corresponding to the archive keyword, and store a correspondence between the archive keyword and the keyword image;
the radio frequency identification device is also used for reading the radio frequency identification tag to obtain a target keyword and sending the target keyword to the augmented reality device;
the augmented reality equipment is further used for receiving the target keywords and searching the keyword images in the corresponding relation according to the target keywords to obtain target images.
In one embodiment, the rfid device is further configured to transmit a ranging signal to the rfid tag at a first time; when the ranging signal reflected by the radio frequency identification tag is received, recording a corresponding second moment; and obtaining the radio frequency identification distance from the radio frequency identification device to the radio frequency identification tag according to the time difference between the second moment and the first moment.
In one embodiment, the augmented reality device is further configured to obtain the radio frequency identification distance; and adjusting the image size of the target image according to the radio frequency identification distance to obtain the augmented reality image so as to enable the augmented reality image to be matched with the tag position of the radio frequency identification tag.
In one embodiment, the radio frequency identification device is further configured to read the radio frequency identification tag to obtain the archive identifier and archive identifier content corresponding to the archive identifier; sending the archive identification and the archive identification content to the augmented reality equipment;
the augmented reality device is further configured to receive the archive identifier and the archive identifier content, and store a corresponding relationship between the archive identifier and the archive identifier content; and when the target image is obtained, acquiring a target identifier corresponding to the target image, determining target identifier content matched with the target identifier in the archive identifier content, and displaying the target identifier content.
A method of archive lookup, the method comprising:
reading a radio frequency identification tag to obtain a file identification of the file; the archive identification is stored in the radio frequency identification tag;
and sending the archive identification to augmented reality equipment so that the augmented reality equipment generates an augmented reality image matched with the archive according to the archive identification after receiving the archive identification.
A method of archive lookup, the method comprising:
receiving a file identification of the file; the file identification is stored in a radio frequency identification tag, a radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to an augmented reality device;
and generating an augmented reality image matched with the archive according to the archive identification.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
reading a radio frequency identification tag to obtain a file identification of the file; the archive identification is stored in the radio frequency identification tag;
and sending the archive identification to augmented reality equipment so that the augmented reality equipment generates an augmented reality image matched with the archive according to the archive identification after receiving the archive identification.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
receiving a file identification of the file; the file identification is stored in a radio frequency identification tag, a radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to an augmented reality device;
and generating an augmented reality image matched with the archive according to the archive identification.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
reading a radio frequency identification tag to obtain a file identification of the file; the archive identification is stored in the radio frequency identification tag;
and sending the archive identification to augmented reality equipment so that the augmented reality equipment generates an augmented reality image matched with the archive according to the archive identification after receiving the archive identification.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
receiving a file identification of the file; the file identification is stored in a radio frequency identification tag, a radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to an augmented reality device;
and generating an augmented reality image matched with the archive according to the archive identification.
The archives reference system, the method, computer equipment and storage medium, archives identification through the archives identification of radio frequency identification label storage archives, can obtain the archives identification corresponding with archives content, read the radio frequency identification label through radio frequency identification equipment, obtain the archives identification, and send archives identification to augmented reality equipment, can make augmented reality equipment acquire the archives identification, receive the archives identification through augmented reality equipment, and according to the archives identification, generate with archives assorted augmented reality image, can obtain the augmented reality image corresponding with archives content, convenient to use user reads the archives according to the augmented reality image, improve the speed and the efficiency that the archives were looked up.
Drawings
FIG. 1 is a diagram of an environment in which an archive lookup system may be implemented, according to one embodiment;
FIG. 2 is a block diagram of an archive lookup system in one embodiment;
FIG. 3 is a block diagram of an archive lookup system in another embodiment;
FIG. 4 is a flowchart illustrating a file lookup method according to an embodiment;
FIG. 5 is a flowchart illustrating a file lookup method according to another embodiment;
FIG. 6 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
As shown in FIG. 1, a diagram of an archive review system application environment is provided, including an RFID tag 102, an RFID device 104, and an augmented reality device 106, with the RFID device 104 communicating with the augmented reality device 106. The RFID tag 102 may be, but is not limited to, various active, passive, and semi-passive RFID (Radio frequency identification) tags; the RFID device 104 includes an RFID reader, which may be, but not limited to, various portable and fixed RFID readers, and an RFID server, which may be implemented by an independent server or a server cluster composed of a plurality of servers; the Augmented Reality device 106 includes an AR (Augmented Reality) terminal and an AR server, the AR terminal may be, but is not limited to, various head-mounted, hand-held and space display AR terminals, including AR glasses, a tablet computer and a smart phone equipped with an AR application program, an AR wearable device, and an AR projector, and the AR server may be implemented by an independent server or a server cluster composed of a plurality of servers.
In one embodiment, as shown in FIG. 2, a block diagram of an archive review system 200 is provided, the system comprising: a radio frequency identification tag 102, a radio frequency identification device 104, and an augmented reality device 106.
And the radio frequency identification tag 102 is used for storing the archive identification of the archive.
The archive identifier is an identifier for marking the archive content, and can be a keyword of the archive content.
In the concrete implementation, the existing archive management gradually adopts a 'dual-track system' system, and the same archive content usually coexists with paper documents and electronic documents. The electronic archive has the advantages of being convenient to search and data processing, the RFID server can extract a plurality of keywords according to the electronic archive in advance, and the set of the keywords is stored in the radio frequency identification tag 102 through the RFID reader-writer, or the RFID server can encode the keywords after extracting the keywords and write the encoded keywords into the radio frequency identification tag 102 through the RFID reader-writer. In order to make the electronic files correspond to the paper files one to one, the RFID tags 102 may be attached to the corresponding paper files, for example, after the keywords are written into the passive RFID tags, the tags may be attached to the file bags of the paper files or embedded in the file bags. The RFID tag 102 may further store archive content, for example, the RFID server may encode the archive content of the electronic archive, and the encoded archive content is written into the RFID tag 102 by the RFID reader, so that the archive content can be directly read by scanning.
In practical applications, in the process of extracting the keywords from the electronic file content, the file content may be segmented first, and the keywords are extracted based on the segmentation result to form a keyword set written in the rfid tag 102. The method for segmenting the archive content includes, but is not limited to, using a Natural Language Processing (NLP) method, where the NLP method includes a dictionary-based rule matching method and a statistical-based machine learning method; the method for extracting keywords includes, but is not limited to, methods using TF-IDF (term Frequency-Inverse Document Frequency), Text-Rank (Text ordering), and SMT (Statistical Machine Translation).
The rfid device 104 is configured to read the rfid tag 102, obtain a file identifier, and send the file identifier to the augmented reality device 106.
In a specific implementation, when the archive content needs to be looked up, the user can use the RFID device 104 to read the RFID tag 102 on the paper archive to obtain the archive identifier, for example, the user can use a portable RFID reader to scan RFID tags on archive bags one by one to read the archive keyword sets stored in the tags, and can also use a fixed RFID reader to scan a plurality of RFID tags on a plurality of archive bags simultaneously to read the archive keyword sets stored in the plurality of tags. In the process of reading the tag, the RFID reader may also read the encoded information of the archive content, and then the RFID reader may send the archive identifier and the encoded information of the archive content to the RFID server, and transmit the archive identifier to the AR server in the augmented reality device 106 through the RFID server.
Augmented reality device 106 for receiving the archive identifier and generating an augmented reality image matching the archive according to the archive identifier.
The augmented reality image is a virtual image that is displayed and output according to a position and an angle in a real scene.
In concrete implementation, one or more real images corresponding to the archive identifier can be collected in advance and stored in the AR server, and the AR server can also store the corresponding relation between the archive identifier and the real image set. When archives need to be looked up, a user can carry or wear the AR display device to enter an archive room, the RFID tag 102 is scanned through the RFID device 104 to obtain an archive identifier, the archive identifier is transmitted to the augmented reality device 106, the AR server can find a corresponding real image set through the archive identifier according to the corresponding relation between the archive identifier and the real images, and the plurality of real images are synthesized into the AR images. Augmented reality device 106 can also acquire the distance between AR display device and the paper archives, and according to the display scale that sets up in advance, AR display device can show AR image on paper archives with suitable size.
For example, to a batch of archives that have recorded block terminal equipment information, the archives keyword that corresponds is "block terminal", and the AR server gathers the block terminal image in advance, specifically, can follow a plurality of two-dimensional image of leading-in block terminal in a plurality of angles in the image database, also can use the AR camera to carry out multi-angle shooting to the block terminal object in kind, obtain a plurality of two-dimensional image of block terminal, with a plurality of block terminal image storage in AR server to mark with archives keyword "block terminal". When a user uses the RFID reader-writer to scan the RFID tag 102 and reads the keyword 'distribution box', the RFID server can transmit the keyword to the AR server, the AR server calls out all two-dimensional images marked under the 'distribution box', the two-dimensional images are synthesized into an AR image of the distribution box, the AR image is adjusted to be suitable for displaying, and the AR image is displayed on the edge of characters of a paper archive through AR display equipment.
In one embodiment, the distance between the RFID tag and the reader-writer may be calculated by a phase difference ranging method, so as to obtain the distance between the paper archive and the AR display device. In the process of applying the phase difference distance measuring method, the RFID reader-writer can be used for transmitting electromagnetic wave signals to the label and receiving the electromagnetic wave signals reflected by the label, the time of the signals going back and forth is measured through the RFID server, and the distance between the reader-writer and the label is calculated according to the time of the signals going back and forth. For example, the distance between the reader/writer and the tag may be calculated as L ═ c Δ t/2, where L is the distance between the RFID reader/writer and the tag, c is the speed of light, and Δ t is the round-trip time of the electromagnetic wave. After the L is obtained, the distance between the paper archive (or the RFID tag) and the AR display device can be calculated according to the relative position between the RFID reader and the AR display device. For example, when the RFID tag is affixed to a paper archive, the user uses a handheld RFID reader and wears AR glasses, the distance between the RFID reader and the tag may be approximately equal to the distance between the paper archive and the AR display device, i.e., the distance between the paper archive and the AR display device is approximately L.
In another embodiment, the size of the AR image may be adjusted by a similar triangulation method based on the distance between the paper archive and the AR display device. The rfid device 104 may transmit the distance L between the paper archive and the AR display device in addition to the archive keywords to the augmented reality device 106. The AR server may store in advance a correspondence between a distance and a size of an image suitable for display on the paper archive, for example, may store in advance information "100 cm to 20 cm" indicating that a suitable height for displaying the AR image on the paper archive should be 20cm when the distance between the AR display device and the paper archive is 100cm, and the AR server may adjust the size of the AR image based on the information in synthesizing the AR image, for example, when the distance L between the paper archive and the AR display device is measured to be 50cm, the height of the AR image suitable for display on the paper archive should be 20/100 × 50 to 10cm based on the triangle-like method. Further, the AR server may also adjust the size of the AR image according to the distance between the user and the paper archive, for example, when the user is farther away from the paper archive, the AR image may be reduced to show more images, and when the user is closer to the paper archive, the AR image may be enlarged to show more detailed content. The AR server may also adjust the display position of the AR image, for example, after obtaining the relative distance between the RFID tag and the AR display device, the AR server may control the AR image to be displayed near the tag on the paper archive.
Above-mentioned archives system of looking up, archives sign through radio frequency identification label storage archives, can obtain the archives sign corresponding with archives content, read the radio frequency identification label through radio frequency identification equipment, obtain the archives sign, and send archives sign to augmented reality equipment, can make augmented reality equipment acquire the archives sign, receive the archives sign through augmented reality equipment, and according to the archives sign, generate and archives assorted augmented reality image, can obtain the augmented reality image corresponding with archives content, the user of being convenient for reads the archives according to the augmented reality image, improve the speed and the efficiency that the archives were looked up.
In one embodiment, the profile identification includes a profile keyword; the radio frequency identification device is also used for acquiring the file content of the file; obtaining a word segmentation result of the file content by performing word segmentation processing on the file content; extracting key words in the file content according to the word segmentation result to obtain file key words; the radio frequency identification device is also used for writing the archive key words into the radio frequency identification tag so that the radio frequency identification tag can store the archive key words.
The archive content is all archive content obtained from the electronic archive, and may include information such as characters and diagrams.
In the specific implementation, after the RFID server acquires all the file contents of the electronic file, the file keywords can be extracted from the electronic file contents, and the file keywords are written into the RFID label through the RFID reader-writer. In the process of extracting the keywords, the document contents can be segmented first, and then the keywords are extracted based on the segmentation results. The method for segmenting the archive content comprises but is not limited to using an NLP method, wherein the NLP method comprises a rule matching method based on a dictionary and a machine learning method based on statistics; methods for extracting keywords include, but are not limited to, using TF-IDF, Text-Rank, and SMT based methods.
In the embodiment, the archive content of the archive is acquired through the radio frequency identification device, and the archive content can be processed; the word segmentation processing is carried out on the file contents to obtain word segmentation results of the file contents, and words contained in the file contents can be extracted; and extracting the keywords in the file content according to the word segmentation result to obtain file keywords, writing the file keywords into the radio frequency identification tag, acquiring the keywords of the file content when the radio frequency identification tag is scanned, and processing the file according to the keywords.
In an embodiment, the augmented reality device is further configured to obtain a keyword image corresponding to the archive keyword, and store a corresponding relationship between the archive keyword and the keyword image; the radio frequency identification device is also used for reading the radio frequency identification tag to obtain a target keyword and sending the target keyword to the augmented reality device; the augmented reality device is further configured to receive the target keyword, and search the keyword image in the corresponding relationship according to the target keyword to obtain the target image.
The keyword image is a real image corresponding to the archive keyword, and may be a two-dimensional image of a real object.
The target keywords are keywords read from the RFID tags, and the target images are real images stored in the AR equipment and corresponding to the target keywords.
In a specific implementation, the AR server may pre-store the real image corresponding to the archive keyword and the corresponding relationship between the archive keyword and the real image. When the file content needs to be looked up, a user can use the RFID reader-writer to scan the RFID label on the paper file, reads the file keyword, uses the file keyword as a target keyword, sends the target keyword to the RFID server through the RFID reader-writer, and transmits the target keyword to the AR server through the RFID server. According to the corresponding relation between the prestored archive keywords and the actual image, the AR server can find the corresponding target image through the target keywords.
In this embodiment, the keyword images corresponding to the archive keywords are obtained by the augmented reality device, and the correspondence between the archive keywords and the keyword images is stored, so that the archive keywords and the keyword images can be in one-to-one correspondence on the augmented reality device; reading the radio frequency identification tag through the radio frequency identification device to obtain a target keyword, and sending the target keyword to the augmented reality device, so that the augmented reality device can obtain a file keyword corresponding to a paper file; receive the target keyword through augmented reality equipment to according to the target keyword, look for the keyword image in the corresponding relation, obtain the target image, can obtain the augmented reality image that paper archives correspond, through showing it, can be convenient for the user to know and read archives, improve the speed and the efficiency that the archives were looked up.
In one embodiment, the rfid device is further configured to transmit a ranging signal to the rfid tag at a first time; when a ranging signal reflected by the radio frequency identification tag is received, recording a corresponding second moment; and obtaining the radio frequency identification distance from the radio frequency identification device to the radio frequency identification tag according to the time difference between the second moment and the first moment.
The distance measuring signal RFID reader-writer sends a signal of the RFID label to measure the distance between the reader-writer and the label.
In the specific implementation, the distance between the RFID tag and the reader-writer can be calculated through a phase difference ranging method, and then the distance between the paper archive and the AR display device is obtained. In the process of applying the phase difference distance measuring method, an RFID reader-writer can transmit an electromagnetic wave signal to a tag at a first moment, the moment when the electromagnetic wave signal is reflected by the tag is received is recorded as a second moment, and an RFID server calculates the time difference between the second moment and the first moment so as to calculate the distance between the reader-writer and the tag. For example, the distance between the reader/writer and the tag may be calculated as L ═ c Δ t/2, where c is the speed of light and Δ t is the time difference between the second time and the first time.
In this embodiment, send range finding signal to the radio frequency identification label at the first moment through the radio frequency identification equipment, when receiving the range finding signal of radio frequency identification label reflection, the corresponding second moment of record, according to the time difference between the second moment and the first moment, obtain the radio frequency identification distance of radio frequency identification equipment to the radio frequency identification label, can obtain the distance between radio frequency identification label and the read write line, and then calculate the distance between augmented reality equipment and the paper archives, be convenient for augmented reality image with the suitable position of suitable size display at paper archives.
In an embodiment, the augmented reality device is further configured to obtain a radio frequency identification distance; and adjusting the image size of the target image according to the radio frequency identification distance to obtain an augmented reality image so as to enable the augmented reality image to be matched with the tag position of the radio frequency identification tag.
The RFID distance is the distance between the RFID reader and the RFID label.
The target image is a real image, and the augmented reality image is an image obtained by synthesizing the real image.
Wherein the tag location includes a location of the radio frequency identification tag relative to the AR display device and a location of the radio frequency identification tag on the paper archive.
In specific implementation, after the distance L between the reader-writer and the tag is obtained, the RFID device can transmit the L to the AR device, and the AR device can calculate the distance between the paper archive (or the RFID tag) and the AR display device according to the relative position between the RFID reader-writer and the AR display device. For example, when the RFID tag is affixed to a paper archive, the user uses a handheld RFID reader and wears AR glasses, the distance between the RFID reader and the tag may be approximately equal to the distance between the paper archive and the AR display device, i.e., the distance between the paper archive and the AR display device is approximately L. The AR image may then be resized by a similar triangle method according to L. The AR server may store in advance a correspondence between a distance and a size of an image suitable for display on the paper archive, for example, may store in advance information "100 cm to 20 cm" indicating that a suitable height for displaying the AR image on the paper archive should be 20cm when the distance between the AR display device and the paper archive is 100cm, and the AR server may adjust the size of the AR image based on the information in synthesizing the AR image, for example, when the distance L between the paper archive and the AR display device is measured to be 50cm, the height of the AR image suitable for display on the paper archive should be 20/100 × 50 to 10cm based on the triangle-like method. Further, the AR server may also adjust the size of the AR image according to the distance between the user and the paper archive, for example, when the user is farther away from the paper archive, the AR image may be reduced to show more images, and when the user is closer to the paper archive, the AR image may be enlarged to show more detailed content. The AR server may also adjust the display position of the AR image, for example, after obtaining the relative distance between the RFID tag and the AR display device, the AR server may control the AR image to be displayed near the tag on the paper archive.
In the embodiment, the distance between the augmented reality display device and the paper file can be determined by acquiring the radio frequency identification distance through the augmented reality device; and adjusting the image size of the target image according to the radio frequency identification distance to obtain an augmented reality image, so that the augmented reality image can be displayed in a proper position and in a proper size, and a user can conveniently view the augmented reality image.
In an embodiment, the radio frequency identification device is further configured to read the radio frequency identification tag to obtain a file identifier and file identifier content corresponding to the file identifier; sending the file identification and the file identification content to augmented reality equipment; the augmented reality device is further configured to receive the archive identifier and the archive identifier content, and store a corresponding relationship between the archive identifier and the archive identifier content; and when the target image is obtained, acquiring a target identifier corresponding to the target image, determining target identifier content matched with the target identifier in the archive identifier content, and displaying the target identifier content.
The file identification content is file content corresponding to the file identification in the electronic file, and may include information such as characters and diagrams.
The target identification is a file keyword corresponding to the target image, and may be the target keyword, and the target identification content is file identification content corresponding to the target keyword.
In specific implementation, the RFID tag can store the file keyword and the file content, the RFID reader reads the tag, and the RFID server can simultaneously obtain the file keyword and the file content corresponding to the file keyword, for example, a certain tag is read by the RFID reader, and the RFID server can obtain the encoded information of the file keyword and the file content, and decode the encoded information to obtain the file keyword and the file content corresponding to the tag. The RFID server sends the archive keywords and the corresponding archive contents to the AR server, the AR server stores the information, when the target image is obtained, the target identification, namely the target keywords, can be determined according to the corresponding relation between the target image and the archive keywords, the target identification contents are determined according to the corresponding relation between the archive keywords and the archive contents, and the target identification contents can be displayed through the AR display equipment.
For example, through the code, can save keyword "block terminal" and block terminal archival information in the RFID label, through reading and scanning, the RFID server acquires above-mentioned information and with above-mentioned information transmission to AR server, AR server is after confirming the AR image that needs to show the block terminal, can confirm the target identification in proper order according to the corresponding relation and be "block terminal", target identification content is the archival information of block terminal, AR server transmits block terminal archival information to AR display device, AR display device shows block terminal archival information, for example, can be with on the projected wall of block terminal archival information.
In this embodiment, the radio frequency identification tag is read by the radio frequency identification device to obtain the file identifier and the file identifier content corresponding to the file identifier, and the file identifier content are sent to the augmented reality device, so that the augmented reality device can obtain the file identifier and the file identifier content; receiving archives sign and archives sign content through augmented reality equipment to the corresponding relation between archives sign and the archives sign content of storage, when obtaining the target image, obtain the target sign that the target image corresponds, confirm in archives sign content with target sign assorted target sign content, and show target sign content, can be after the user watches the augmented reality image, conveniently look over the archives content that the augmented reality image corresponds, can improve the convenience that the archives looked up.
To facilitate a thorough understanding of the embodiments of the present application by those skilled in the art, the following description will be made with reference to the specific example of fig. 3.
As shown in FIG. 3, a block diagram of another archive review system is provided. The physical layer of the system comprises an archive file 301 attached with an RFID, the acquisition layer comprises an AR smart terminal 302 (e.g., an AR camera) and an RFID reader-writer 304, the processing layer comprises an AR system 303 (e.g., an AR server) and an RFID system (e.g., an RFID server) 305, and the display layer comprises an AR device 306 (e.g., AR glasses or a tablet computer equipped with an AR application). The RFID reader 304 may collect information in the RFID tag 301 attached to the archive, transmit an electromagnetic wave signal to the tag and receive a reflected signal of the tag according to a phase difference ranging algorithm, and calculate a distance between the reader and the passive tag by measuring a round trip time of the electromagnetic wave signal. After that, data such as tag information and distance is transmitted to the RFID system 305 through the wireless gateway, and the RFID system 305 transmits the data to the AR system 303 to perform virtual imaging processing. AR intelligent terminal 302 can gather the reality image in advance, transmits image data to AR system 303, and the virtual image that will produce again is according to RFID phase difference range finding and AR modeling range finding, finds the corresponding relation between virtual image and the archives, adjusts to laminating reality and accords with AR equipment 306's display demand. The adjusted virtual image is transmitted to the AR device 306, and the image is superimposed on the real scene by the AR device 306.
Further, although the AR smart terminal 302, the RFID reader 304, and the AR device 306 are different levels in architecture, a product integrating three devices may be implemented, for example, an AR glasses integrated with the functions of AR camera shooting and RFID reading and writing may be designed, or a tablet computer integrated with the functions of AR camera shooting and RFID reading and writing may be designed.
Further, RFID system 305 and AR system 303 may be integrated into a single integrated processing system, acting as a processing layer.
Further, the virtual image displayed by the AR device 306 is not limited to an image, and may be image data.
Among the above-mentioned archives look up system, augmented reality superposes two-dimentional or three-dimensional virtual scene in the reality scene, can avoid using RFID alone to read operation complexity and the work unicity that archives characters relevant information brought, shows the literal information for augmented reality image, can provide sense organ and operation experience beyond reality for the user. Extend RFID read write line 304, AR intelligent terminal 302 and AR equipment 306 etc. to wearable equipment, can increase archives reference system's maneuverability, convenience and intuition nature.
In one embodiment, as shown in FIG. 4, a document review method is provided, which is illustrated by way of example as applied to the RFID device 104 of FIG. 1, and includes the steps of:
step S410, reading the radio frequency identification tag to obtain a file identification of the file; the file identification is stored in the radio frequency identification tag;
step S420, sending the archive identifier to the augmented reality device, so that the augmented reality device generates an augmented reality image matched with the archive according to the archive identifier after receiving the archive identifier.
In specific implementation, the RFID server can extract the file keywords in the electronic file in advance, and the keywords are written into the RFID label through the RFID reader-writer. In order to make the electronic file correspond to the paper file one to one, the RFID tag may be attached to the paper file recording the content of the corresponding file. The RFID tag can also store archive contents, so that the archive contents can be directly identified and read through scanning. The AR server may pre-store the real image corresponding to the archive keyword and the correspondence between the archive keyword and the real image. When looking up archive content, the user can scan the RFID label on the paper archive by using the RFID reader-writer to obtain archive keywords and archive content, the RFID reader-writer sends the archive keywords and the archive content to the RFID server, and the archive keywords are transmitted to the AR server through the RFID server. According to the corresponding relation between the prestored archive keywords and the real images, the AR server can find the corresponding real images through the archive keywords, synthesize the real images into the AR images, and display the AR images near the RFID labels on the paper archives through AR display equipment. The AR server can also acquire the distance between the AR display equipment and the paper archive, and displays the AR image in a proper size according to a preset display proportion.
The specific limitations of the above-mentioned file lookup method can be referred to the limitations of the file lookup system in the above, and since the processing procedure of the rfid device has been described in detail in the foregoing embodiments, no further description is given here.
Above-mentioned archives look up method, archives identification through radio frequency identification tag storage archives, can obtain the archives identification corresponding with archives content, read the radio frequency identification tag through radio frequency identification equipment, obtain the archives identification, and send archives identification to augmented reality equipment, can make augmented reality equipment acquire the archives identification, receive the archives identification through augmented reality equipment, and according to the archives identification, generate with archives assorted augmented reality image, can obtain the augmented reality image corresponding with archives content, the user of being convenient for reads the archives according to the augmented reality image, improve the speed and the efficiency that the archives were looked up.
In one embodiment, as shown in fig. 5, an archive consulting method is provided, which is described by taking the example of the method applied to the augmented reality device 106 in fig. 1, and includes the following steps:
step S510, receiving a file identification of a file; the file identification is stored in the radio frequency identification tag, the radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to the augmented reality device;
step S520, generating an augmented reality image matched with the archive according to the archive identifier.
In specific implementation, the RFID server can extract the file keywords in the electronic file in advance, and the keywords are written into the RFID label through the RFID reader-writer. In order to make the electronic file correspond to the paper file one to one, the RFID tag may be attached to the paper file recording the content of the corresponding file. The RFID tag can also store archive contents, so that the archive contents can be directly identified and read through scanning. The AR server may pre-store the real image corresponding to the archive keyword and the correspondence between the archive keyword and the real image. When looking up archive content, the user can scan the RFID label on the paper archive by using the RFID reader-writer to obtain archive keywords and archive content, the RFID reader-writer sends the archive keywords and the archive content to the RFID server, and the archive keywords are transmitted to the AR server through the RFID server. According to the corresponding relation between the prestored archive keywords and the real images, the AR server can find the corresponding real images through the archive keywords, synthesize the real images into the AR images, and display the AR images near the RFID labels on the paper archives through AR display equipment. The AR server can also acquire the distance between the AR display equipment and the paper archive, and displays the AR image in a proper size according to a preset display proportion.
The specific limitations of the above-mentioned file lookup method can be referred to the limitations of the file lookup system in the above, and since the processing procedure of the rfid device has been described in detail in the foregoing embodiments, no further description is given here.
Above-mentioned archives look up method, archives identification through radio frequency identification tag storage archives, can obtain the archives identification corresponding with archives content, read the radio frequency identification tag through radio frequency identification equipment, obtain the archives identification, and send archives identification to augmented reality equipment, can make augmented reality equipment acquire the archives identification, receive the archives identification through augmented reality equipment, and according to the archives identification, generate with archives assorted augmented reality image, can obtain the augmented reality image corresponding with archives content, the user of being convenient for reads the archives according to the augmented reality image, improve the speed and the efficiency that the archives were looked up.
It should be understood that although the various steps in the flow charts of fig. 4-5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 4-5 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least some of the other steps.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 6. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing archive reference data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a file lookup method.
Those skilled in the art will appreciate that the architecture shown in fig. 6 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program: reading the radio frequency identification tag to obtain a file identification of the file; the file identification is stored in the radio frequency identification tag; and sending the file identification to the augmented reality equipment, so that the augmented reality equipment generates an augmented reality image matched with the file according to the file identification after receiving the file identification.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program: receiving a file identifier of a file; the file identification is stored in the radio frequency identification tag, the radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to the augmented reality device; and generating an augmented reality image matched with the archive according to the archive identification.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: reading the radio frequency identification tag to obtain a file identification of the file; the file identification is stored in the radio frequency identification tag; and sending the file identification to the augmented reality equipment, so that the augmented reality equipment generates an augmented reality image matched with the file according to the file identification after receiving the file identification.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: receiving a file identifier of a file; the file identification is stored in the radio frequency identification tag, the radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to the augmented reality device; and generating an augmented reality image matched with the archive according to the archive identification.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical storage, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. An archive lookup system, comprising: the system comprises a radio frequency identification tag, radio frequency identification equipment and augmented reality equipment;
the radio frequency identification tag is used for storing the archive identification of the archive;
the radio frequency identification device is used for reading the radio frequency identification tag to obtain the file identification and sending the file identification to the augmented reality device;
and the augmented reality equipment is used for receiving the archive identification and generating an augmented reality image matched with the archive according to the archive identification.
2. The system of claim 1, wherein the profile identification comprises a profile keyword; the radio frequency identification device is also used for acquiring the archive content of the archive; obtaining a word segmentation result of the file content by performing word segmentation processing on the file content; extracting key words in the file contents according to the word segmentation result to obtain the file key words;
the radio frequency identification device is further configured to write the archive keyword into the radio frequency identification tag, so that the radio frequency identification tag stores the archive keyword.
3. The system according to claim 2, wherein the augmented reality device is further configured to obtain a keyword image corresponding to the archive keyword, and store a correspondence between the archive keyword and the keyword image;
the radio frequency identification device is also used for reading the radio frequency identification tag to obtain a target keyword and sending the target keyword to the augmented reality device;
the augmented reality equipment is further used for receiving the target keywords and searching the keyword images in the corresponding relation according to the target keywords to obtain target images.
4. The system of claim 3, wherein the radio frequency identification device is further configured to transmit a ranging signal to the radio frequency identification tag at a first time; when the ranging signal reflected by the radio frequency identification tag is received, recording a corresponding second moment; and obtaining the radio frequency identification distance from the radio frequency identification device to the radio frequency identification tag according to the time difference between the second moment and the first moment.
5. The system of claim 4, wherein the augmented reality device is further configured to obtain the radio frequency identification distance; and adjusting the image size of the target image according to the radio frequency identification distance to obtain the augmented reality image so as to enable the augmented reality image to be matched with the tag position of the radio frequency identification tag.
6. The system of claim 3, wherein the radio frequency identification device is further configured to read the radio frequency identification tag to obtain the profile identifier and profile identifier content corresponding to the profile identifier; sending the archive identification and the archive identification content to the augmented reality equipment;
the augmented reality device is further configured to receive the archive identifier and the archive identifier content, and store a corresponding relationship between the archive identifier and the archive identifier content; and when the target image is obtained, acquiring a target identifier corresponding to the target image, determining target identifier content matched with the target identifier in the archive identifier content, and displaying the target identifier content.
7. A method for referring to a file, the method comprising:
reading a radio frequency identification tag to obtain a file identification of the file; the archive identification is stored in the radio frequency identification tag;
and sending the archive identification to augmented reality equipment so that the augmented reality equipment generates an augmented reality image matched with the archive according to the archive identification after receiving the archive identification.
8. A method for referring to a file, the method comprising:
receiving a file identification of the file; the file identification is stored in a radio frequency identification tag, a radio frequency identification device reads the radio frequency identification tag to obtain the file identification, and the file identification is sent to an augmented reality device;
and generating an augmented reality image matched with the archive according to the archive identification.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor realizes the steps of the method of any one of claims 7 to 8 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 7 to 8.
CN202010419408.8A 2020-05-18 2020-05-18 Archive consulting system, method, computer device and storage medium Pending CN111625092A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010419408.8A CN111625092A (en) 2020-05-18 2020-05-18 Archive consulting system, method, computer device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010419408.8A CN111625092A (en) 2020-05-18 2020-05-18 Archive consulting system, method, computer device and storage medium

Publications (1)

Publication Number Publication Date
CN111625092A true CN111625092A (en) 2020-09-04

Family

ID=72258934

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010419408.8A Pending CN111625092A (en) 2020-05-18 2020-05-18 Archive consulting system, method, computer device and storage medium

Country Status (1)

Country Link
CN (1) CN111625092A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200937278A (en) * 2008-02-29 2009-09-01 Tsung-Yu Liu Assisted reading system and method utilizing identification label and augmented reality
CN102004934A (en) * 2010-12-28 2011-04-06 广东万维博通信息技术有限公司 RFID-based archive information resource management method
US20180121551A1 (en) * 2016-11-02 2018-05-03 Microsoft Technology Licensing, Llc Identifying content in a content management system relevant to content of a published electronic document

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200937278A (en) * 2008-02-29 2009-09-01 Tsung-Yu Liu Assisted reading system and method utilizing identification label and augmented reality
CN102004934A (en) * 2010-12-28 2011-04-06 广东万维博通信息技术有限公司 RFID-based archive information resource management method
US20180121551A1 (en) * 2016-11-02 2018-05-03 Microsoft Technology Licensing, Llc Identifying content in a content management system relevant to content of a published electronic document

Similar Documents

Publication Publication Date Title
US10297083B2 (en) Method and system for determining a model of at least part of a real object
Choi et al. Depth analogy: Data-driven approach for single image depth estimation using gradient samples
US11704357B2 (en) Shape-based graphics search
CN105517679B (en) Determination of the geographic location of a user
JP5563494B2 (en) Corresponding reference image search device and method, content superimposing device, system and method, and computer program
CN102411582B (en) Image searching method, device and client
US20100250588A1 (en) Image searching system and image searching method
CN103106252A (en) Method for using handheld device to position plane area
US11915478B2 (en) Bayesian methodology for geospatial object/characteristic detection
CN108597034B (en) Method and apparatus for generating information
WO2024088291A1 (en) Form filling method and apparatus, electronic device, and medium
Peng et al. Unsupervised change detection method based on saliency analysis and convolutional neural network
US20120113109A1 (en) Method and apparatus for searching for image data
Hong et al. Rapid three-dimensional detection approach for building damage due to earthquakes by the use of parallel processing of unmanned aerial vehicle imagery
Merino‐Gracia et al. Real‐time text tracking in natural scenes
KR101768914B1 (en) Geo-tagging method, geo-tagging apparatus and storage medium storing a program performing the method
Chen et al. Low-cost asset tracking using location-aware camera phones
CN111625092A (en) Archive consulting system, method, computer device and storage medium
CN112819953B (en) Three-dimensional reconstruction method, network model training method, device and electronic equipment
EP3115927A1 (en) Method and apparatus for processing a scene
KR101910825B1 (en) Method, apparatus, system and computer program for providing aimage retrieval model
CN114723923B (en) Transmission solution simulation display system and method
CN115578539B (en) Indoor space high-precision visual position positioning method, terminal and storage medium
Pagani Modeling reality for camera registration in augmented reality applications
KR101920465B1 (en) System and method for object identification in outdoor environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200904

RJ01 Rejection of invention patent application after publication