CN111476829A - Augmented reality virtual and real image dynamic registration method and device based on optical flow - Google Patents
Augmented reality virtual and real image dynamic registration method and device based on optical flow Download PDFInfo
- Publication number
- CN111476829A CN111476829A CN202010171433.9A CN202010171433A CN111476829A CN 111476829 A CN111476829 A CN 111476829A CN 202010171433 A CN202010171433 A CN 202010171433A CN 111476829 A CN111476829 A CN 111476829A
- Authority
- CN
- China
- Prior art keywords
- image
- module
- circuit board
- electrically connected
- fixedly connected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 16
- 230000003287 optical effect Effects 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 title claims abstract description 13
- 230000009466 transformation Effects 0.000 claims abstract description 12
- 238000004891 communication Methods 0.000 claims abstract description 10
- 238000009434 installation Methods 0.000 claims abstract description 6
- 239000000428 dust Substances 0.000 claims description 9
- 238000005259 measurement Methods 0.000 claims description 5
- 239000000284 extract Substances 0.000 claims description 4
- 230000008569 process Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/33—Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
- G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
Abstract
The invention discloses a method and a device for dynamically registering augmented reality virtual and real images based on optical flow, wherein the device comprises a shell and a circuit board, wherein an installation plate is arranged in the shell, a storage battery is fixedly connected onto the installation plate, and the storage battery is electrically connected with a transformer; the circuit board is electrically connected with the transformer, and the circuit board is also fixedly connected with a wiring terminal, an image recognition module, an image registration module, an image storage module and a single chip microcomputer, wherein the image recognition module, the image registration module and the image storage module are electrically connected with the single chip microcomputer through the wiring terminal. The image registration module obtains image space coordinate transformation parameters through the matched characteristic point pairs and carries out image registration through the coordinate transformation parameters, and the communication module is connected with the Internet and transmits data, so that the layout is reasonable and the design is ingenious.
Description
Technical Field
The invention relates to an image matching device, in particular to a method and a device for dynamically registering augmented reality virtual and real images based on optical flow.
Background
The optical flow method is an important method for analyzing the current moving image, and refers to the mode moving speed in the time-varying image. The augmented reality is a technology for calculating the position and angle of a camera image in real time and adding a corresponding image, and comprises new technologies and new means such as multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and the like. Image registration is a process of matching and superimposing two or more images acquired at different times and under different sensors or under different conditions, and has been widely applied to the fields of remote sensing data analysis, computer vision, image processing and the like.
The traditional image registration equipment used in the field of augmented reality relies on a built-in memory card to store a comparison image in advance, but the mode is influenced by the storage capacity of the memory card; in addition, as a high-precision electronic device, if power failure occurs during work, great time and economic loss are brought, so that the method and the device for dynamically registering the augmented reality virtual-real images based on the optical flow are provided.
Disclosure of Invention
In order to solve the technical problems, the invention provides the following technical scheme:
the invention provides an augmented reality virtual-real image dynamic registration method based on optical flow, which comprises the following steps of:
s1, the image recognition module extracts the features of the two images to obtain feature points, and finds out matched feature point pairs by carrying out similarity measurement;
s2, the image registration module obtains image space coordinate transformation parameters through the matched feature point pairs, and the coordinate transformation parameters are used for image registration;
s3, the image storage module stores the data source and the image processed by identification.
The invention also provides an augmented reality virtual-real image dynamic registration device based on optical flow, which comprises a shell and a circuit board, wherein the shell is internally provided with a mounting plate, and the circuit board is fixedly connected with the mounting plate through a bolt; the mounting plate is fixedly connected with a storage battery, the storage battery is electrically connected with a transformer, and the transformer is fixedly connected with the mounting plate through bolts; the circuit board is electrically connected with the transformer, and the circuit board is also fixedly connected with a wiring terminal, an image recognition module, an image registration module, an image storage module and a single chip microcomputer, wherein the image recognition module, the image registration module and the image storage module are electrically connected with the single chip microcomputer through the wiring terminal.
As a preferable technical solution of the present invention, a circuit switch is disposed on a connection circuit between the storage battery and the transformer, and a control key of the circuit switch is disposed on a side surface of the housing.
As a preferred technical scheme of the invention, the circuit board is fixedly connected with a communication module, and the communication module is electrically connected with the singlechip through a wiring terminal.
As a preferred technical scheme of the present invention, a solar panel is embedded on the outer side of the housing, and the solar panel is electrically connected to the storage battery.
As a preferred technical scheme of the invention, the side surface of the shell is rotatably connected with a connecting plate, and a connecting hole is drilled on the connecting plate.
As a preferred technical scheme of the invention, the shell is provided with a USB interface and a VGA interface which are electrically connected with the circuit board.
As a preferred technical solution of the present invention, dust covers are disposed outside the USB interface and the VGA interface, and the dust covers are inserted into the housing.
The invention has the beneficial effects that: the augmented reality virtual-real image dynamic registration device based on the optical flow obtains feature points by performing feature extraction on two images through the image recognition module 8 and finds matched feature point pairs by performing similarity measurement, the image registration module 9 obtains image space coordinate transformation parameters through the matched feature point pairs and performs image registration through the coordinate transformation parameters, and the image storage module stores the images and is connected with the internet through the communication module and transmits data; in addition, the mounting plate is beneficial to the connection of the solar photovoltaic power supply device with other devices, and the solar photovoltaic panel solves the power supply problem of the solar photovoltaic power supply device.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic structural diagram of an apparatus for dynamically registering augmented reality virtual and real images based on optical flow according to the present invention;
FIG. 2 is a control schematic diagram of an augmented reality virtual-real image dynamic registration device based on optical flow according to the present invention;
in the figure: 1. a base; 2. a storage battery; 3. a circuit switch; 4. a transformer; 5. a circuit board; 6. a USB interface; 7. a VGA interface; 8. an image recognition module; 9. an image registration module; 10. an image storage module; 11. a communication module; 12. a single chip microcomputer; 13. a wiring terminal; 14. a connecting plate; 15. a solar panel; 16. a dust cover; 17. and (7) mounting the plate.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
The invention provides an augmented reality virtual-real image dynamic registration method based on optical flow, which comprises the following steps of:
s1, the image recognition module extracts the features of the two images to obtain feature points, and finds out matched feature point pairs by carrying out similarity measurement;
s2, the image registration module obtains image space coordinate transformation parameters through the matched feature point pairs, and the coordinate transformation parameters are used for image registration;
s3, the image storage module stores the data source and the image processed by identification.
As shown in fig. 1, the invention further provides an augmented reality virtual-real image dynamic registration device based on optical flow, which includes a housing 1 and a circuit board 5, wherein an installation plate 17 is arranged inside the housing 1, and the circuit board 5 is fixedly connected with the installation plate 17 through a bolt; the mounting panel 17 fixedly connected with battery 2, 2 electric connection of battery have transformer 4, be provided with circuit switch 3 on the connecting circuit between battery 2 and the transformer 4, circuit switch 3's control key sets up the side at shell 1. When the invention is not used, the power supply can be cut off through a switch control key (not marked obviously in the figure) outside the shell 1, and the function of protecting circuits and equipment can be realized. The transformer 4 is fixedly connected with the mounting plate 17 through bolts; the circuit board 5 is electrically connected with the transformer 4, the circuit board 5 is also fixedly connected with a wiring terminal 13, an image recognition module 8, an image registration module 9, an image storage module 10 and a single chip microcomputer 12, wherein the image recognition module 8, the image registration module 9 and the image storage module 10 are electrically connected with the single chip microcomputer 12 through the wiring terminal 13.
The side surface of the shell 1 is rotatably connected with a connecting plate 14, a connecting hole is drilled on the connecting plate 14, and the connecting plate can be used for connecting the invention with other equipment. The shell 1 is provided with a USB interface 6 and a VGA interface 7, and the USB interface 6 and the VGA interface 7 are electrically connected with the circuit board 5. And dust covers 16 are arranged outside the USB interface 6 and the VGA interface 7, and the dust covers 16 are spliced with the shell 1. When the USB interface 6 and the VGA interface 7 are not externally connected with other equipment for a long time, the situation that dust enters the interface to cause connection failure can occur, the dust cover is plugged with the shell, the connection is convenient, and the problems can be effectively solved.
As illustrated in fig. 2, the image dynamic registration process: firstly, the image recognition module 8 extracts the features of two images to obtain feature points, and finds out matched feature point pairs by carrying out similarity measurement; then, the image registration module 9 obtains an image space coordinate transformation parameter through the matched feature point pair, and performs image registration by using the coordinate transformation parameter. In the process, the image storage module 9 is used for storing the data source in advance and storing the identification processed image. Fixedly connected with communication module 11 on the circuit board 5, communication module 11 is connected with singlechip 12 electricity through binding post 13. The image storage module 9 may have the memory condition, and the invention can be connected with the internet through the communication module 11, which not only can be used for data transmission capability, but also greatly improves the storage capability of the utility model.
In the description of the present invention, it should be noted that the terms "vertical", "upper", "lower", "horizontal", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.
In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. An augmented reality virtual-real image dynamic registration method based on optical flow is characterized by comprising the following steps:
s1, the image recognition module extracts the features of the two images to obtain feature points, and finds out matched feature point pairs by carrying out similarity measurement;
s2, the image registration module obtains image space coordinate transformation parameters through the matched feature point pairs, and the coordinate transformation parameters are used for image registration;
s3, the image storage module stores the data source and the image processed by identification.
2. The device for dynamically registering the augmented reality virtual and real images based on the optical flow comprises a shell and a circuit board, and is characterized in that an installation plate is arranged in the shell, and the circuit board is fixedly connected with the installation plate through bolts; the mounting plate is fixedly connected with a storage battery, the storage battery is electrically connected with a transformer, and the transformer is fixedly connected with the mounting plate through bolts; the circuit board is electrically connected with the transformer, and the circuit board is also fixedly connected with a wiring terminal, an image recognition module, an image registration module, an image storage module and a single chip microcomputer, wherein the image recognition module, the image registration module and the image storage module are electrically connected with the single chip microcomputer through the wiring terminal.
3. The device of claim 2, wherein a circuit switch is disposed on the connection circuit between the battery and the transformer, and a control key of the circuit switch is disposed on a side surface of the housing.
4. The device of claim 2, wherein a communication module is fixedly connected to the circuit board, and the communication module is electrically connected to the single chip via a connection terminal.
5. The device of claim 2, wherein a solar panel is embedded on the outer side of the housing, and the solar panel is electrically connected to the battery.
6. The device of claim 2, wherein a connection plate is rotatably connected to a side of the housing, and a connection hole is drilled in the connection plate.
7. The apparatus according to claim 2, wherein the housing has a USB interface and a VGA interface, and the USB interface and the VGA interface are electrically connected to the circuit board.
8. The device of claim 7, wherein a dust cover is disposed outside the USB interface and the VGA interface, and the dust cover is plugged into the housing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010171433.9A CN111476829A (en) | 2020-03-12 | 2020-03-12 | Augmented reality virtual and real image dynamic registration method and device based on optical flow |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010171433.9A CN111476829A (en) | 2020-03-12 | 2020-03-12 | Augmented reality virtual and real image dynamic registration method and device based on optical flow |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111476829A true CN111476829A (en) | 2020-07-31 |
Family
ID=71748317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010171433.9A Pending CN111476829A (en) | 2020-03-12 | 2020-03-12 | Augmented reality virtual and real image dynamic registration method and device based on optical flow |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111476829A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112507925A (en) * | 2020-12-16 | 2021-03-16 | 安徽建筑大学 | Fire detection method based on slow characteristic analysis |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170116783A1 (en) * | 2015-10-26 | 2017-04-27 | Institute Of Nuclear Energy Research Atomic Energy Council, Executive Yuan | Navigation System Applying Augmented Reality |
| CN109858479A (en) * | 2018-07-10 | 2019-06-07 | 上海其高电子科技有限公司 | The illegal whistle capturing system of motor vehicle based on image registration |
| CN209074577U (en) * | 2018-11-06 | 2019-07-09 | 齐齐哈尔大学 | A kind of multimodal medical image registration experimental provision |
| CN110562653A (en) * | 2019-07-30 | 2019-12-13 | 国网浙江省电力有限公司嘉兴供电公司 | power transformation operation detection intelligent decision system and maintenance system based on ubiquitous power Internet of things |
-
2020
- 2020-03-12 CN CN202010171433.9A patent/CN111476829A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170116783A1 (en) * | 2015-10-26 | 2017-04-27 | Institute Of Nuclear Energy Research Atomic Energy Council, Executive Yuan | Navigation System Applying Augmented Reality |
| CN109858479A (en) * | 2018-07-10 | 2019-06-07 | 上海其高电子科技有限公司 | The illegal whistle capturing system of motor vehicle based on image registration |
| CN209074577U (en) * | 2018-11-06 | 2019-07-09 | 齐齐哈尔大学 | A kind of multimodal medical image registration experimental provision |
| CN110562653A (en) * | 2019-07-30 | 2019-12-13 | 国网浙江省电力有限公司嘉兴供电公司 | power transformation operation detection intelligent decision system and maintenance system based on ubiquitous power Internet of things |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112507925A (en) * | 2020-12-16 | 2021-03-16 | 安徽建筑大学 | Fire detection method based on slow characteristic analysis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107341489A (en) | A kind of image identification system for center monitoring | |
| CN103079055B (en) | A kind of intelligent meter data recording terminal | |
| CN111476829A (en) | Augmented reality virtual and real image dynamic registration method and device based on optical flow | |
| CN112564291A (en) | Power equipment pressing plate state monitoring system and monitoring method | |
| CN108493740A (en) | A kind of electric cabinet automatic routing system based on machine vision | |
| CN107994493A (en) | A kind of inspection auxiliary device and method for inspecting for electricity grid substation | |
| CN215599695U (en) | 3D structured light face recognition module | |
| CN207965779U (en) | A kind of Riser cards based on OpenPower platforms | |
| CN115167458A (en) | Machine room cooperation operation and maintenance robot and system | |
| CN109753780B (en) | Method and system for identifying user identity by relay protection device | |
| CN201701198U (en) | Intelligent detector | |
| CN211554718U (en) | Intelligent comprehensive monitoring system for optical cable cross connecting cabinet | |
| CN108445887B (en) | Distributed power environment monitoring system | |
| CN206575520U (en) | A kind of vehicle-mounted emergency command case of detachable display screen | |
| CN212966215U (en) | Face recognition device for education management dispatching desk | |
| CN211403452U (en) | Face recognition equipment | |
| CN214098059U (en) | General binocular camera module suitable for embedded ARM platform | |
| CN205958410U (en) | A control circuit for composite insulator hydrophobicity automated inspection | |
| CN109378872A (en) | A kind of charging method and system of electronic product | |
| CN214475021U (en) | Intelligent control equipment information card reading device with adaptive structure | |
| CN204007707U (en) | A kind of electrical control cubicles humiture detecting device | |
| CN215068294U (en) | Face data docking system | |
| CN205582080U (en) | One -card cloud platform sensing layer liquid crystal panel terminal equipment | |
| CN213659471U (en) | Motion attitude video measuring device based on GPU | |
| CN219738222U (en) | RFID medical consumable smart cabinet |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |