CN110347259A - A kind of method and system being presented IOT device data in AR application apparatus - Google Patents
A kind of method and system being presented IOT device data in AR application apparatus Download PDFInfo
- Publication number
- CN110347259A CN110347259A CN201910612555.4A CN201910612555A CN110347259A CN 110347259 A CN110347259 A CN 110347259A CN 201910612555 A CN201910612555 A CN 201910612555A CN 110347259 A CN110347259 A CN 110347259A
- Authority
- CN
- China
- Prior art keywords
- data
- application apparatus
- iot
- equipment
- cloud server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3055—Monitoring arrangements for monitoring the status of the computing system or of the computing system component, e.g. monitoring if the computing system is on, off, available, not available
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/328—Computer systems status display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/12—Network monitoring probes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Medical Informatics (AREA)
- Computer Hardware Design (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Provide a kind of method and system for being presented IOT device data in AR application apparatus, IOT equipment is communicated to connect via cloud server and AR application apparatus, IOT device data is sent to AR application apparatus in real time via cloud server by IOT equipment, and it is carried out realizing that real time enhancing is shown after synthesizing processing by AR application apparatus, more intuitive efficient transmitting physical device, environmental data, make the display of AR application apparatus using real data as support, and via the mutually matched design of display pattern and display effect so that the efficiency of enhancing display greatly improves, and the effect that enhancing is shown is more life-like, enhance user experience.
Description
Technical field
The present invention relates to computer technology, in particular to the technology that is combined with AR technology of IOT technology, more particularly to it is a kind of
The method and system that IOT device data is presented in AR application apparatus.
Background technique
IOT equipment, i.e. all things on earth internet device.IOT equipment has the spies such as low-power consumption, wide covering, multi-connection, at low cost
Point can be widely applied to a variety of vertical industries, such as remote meter reading, asset tracking, intelligent parking, wisdom agricultural, provide base
In the information back ability of network.In the prior art, IOT equipment is mainly used to acquire data, is used to monitoring device state.
AR, that is, augmented reality, AR technology are also referred to as Augmented Reality, and AR technology is to promote real world information and virtual generation
The newer technology contents to combine between boundary's information content, script is more difficult in the spatial dimension of real world
Entity information to be experienced implements analog simulation processing, superposition will virtually be believed on the basis of the science and technology such as computer
Breath content is effectively applied in real world, and can be perceived in this course by human sensory, to realize
The sensory experience of exceeding reality.It, can be in the same picture and space after being overlapped between true environment and dummy object
It exists simultaneously.
Detection device operating status generally uses internal sensor link instrument to show equipment running status in the prior art,
Or networked devices are used, equipment running status is transmitted to Back end data platform and is shown, there are operating status sights in use
It examines not directly, can only be observed by fixed position or fixed equipment, malfunction limits more.
It in existing AR industrial detection application, is mainly shown using corresponding instrument, it is shown that simple is preset
Model, such as preset animation is played merely.In overhaul of the equipments application, many equipment can not carry out shutdown detection, even if using existing
There is sensing equipment detect and show by instrument board, but detection content is not intuitive, is not easy to operate, is not easy to save.
For the above problem in the presence of the relevant technologies, currently no effective solution has been proposed.Therefore, of the invention
A kind of method and system for being presented IOT device data in AR application apparatus is proposed, it is undoubtedly, of the invention by IOT
The method that device data is presented in AR application apparatus is effectively combined IOT technology with AR application technology, is able to solve existing skill
Many defects existing for art, and bring many beneficial effects.
Summary of the invention
To solve the problems of above-mentioned prior art, IOT device data is applied in AR the invention proposes a kind of
The method and system presented in equipment, this technology can be by being transmitted to AR application apparatus for data in server, and user is logical
Hand-held AR terminal is crossed, or wears AR glasses, more portable intuitive observation device operating status.
Preferably, the present invention proposes a kind of method for being presented IOT device data in AR application apparatus, IOT equipment warp
It is communicated to connect by cloud server and AR application apparatus, IOT equipment in real time transmits IOT device data via cloud server
To AR application apparatus, and carried out realizing that real time enhancing is shown after synthesizing processing by AR application apparatus.
Preferably, IOT equipment real-time data collection and IOT data are uploaded to cloud server, the cloud server
Format analysis processing and contents processing carried out respectively to the IOT data, the IOT equipment be the IOT equipment of multiple and different types and
Data acquisition and upload are carried out parallel to each other；By the video of image acquisition device true environment after the unlatching of AR application apparatus
Data；Monitoring is using video data described in real-time monitoring and carries out target identification, takes when capturing the cloud specific objective Shi Zexiang
Business device sends the first AR request；It is requested in response to the first AR, cloud server in real time will be related to the specific objective
Latest edition data be sent to AR application apparatus；AR application apparatus is based on the latest edition data in real time and generates the first AR
It shows content, and carries out real time enhancing after the first AR display content and the video data are synthesized and show, wherein
First AR shows that the latest edition data stored on content and cloud server synchronously change so that the enhancing is shown
Content change therewith.
Preferably, the format analysis processing and contents processing include: the difference by format analysis processing module based on the IOT data
Type carries out the conversion and uniformly of data format to the IOT data respectively；If it is not present in the IOT data after format analysis processing
His associated data, then directly store it in storage device；If there are other incidence numbers for the IOT data after format analysis processing
According to the data that will then be mutually related merge processing, then store it in storage device again.
Preferably, in response to the triggering of any one preset condition among multiple preset conditions, according to it is described any one
Preset condition sends the 2nd AR request to cloud server；It is requested in response to the 2nd AR, cloud server is based on described appoint
Preset condition of anticipating transfers all data relevant to the specific objective stored in storage device, and based on described all
Data generate the 2nd AR and show content, and the 2nd AR is shown that content is sent to AR application apparatus；AR application apparatus will be described
2nd AR, which is shown, carries out stable state enhancing display after content and the video data are synthesized.
Preferably, the present invention proposes a kind of system that can be presented IOT device data in AR application apparatus, the system
System includes multiple IOT equipment and multiple AR application apparatus, the multiple IOT equipment and the multiple AR application apparatus via
Cloud server communication connection.
Preferably, any one IOT equipment in the multiple IOT equipment includes data acquisition device and data transmit-receive dress
It sets, data acquisition device is for acquiring data and being uploaded to cloud server via data transmitter-receiver set；
Preferably, multiple IOT equipment are divided into multiple types, and each type of IOT equipment acquires different types of data,
The content of same type of IOT equipment acquisition is not identical.
Preferably, the cloud server includes: data transmitter-receiver set, for carrying out with IOT equipment and AR application apparatus
Data communication；Data storage device, for storing the data of data and AR application apparatus feedback from the acquisition of IOT equipment；
Standard data format device, the unification of the data format for guaranteeing different IOT equipment acquisitions；AR shows contents production dress
It sets, the data for being acquired according to IOT equipment, which are generated, realizes that the AR of enhancing display shows content for AR application apparatus.
Preferably, the AR application apparatus include the image collecting device of video data for acquiring true environment, U/I interface,
Data transmitter-receiver set and following application: the binding application of AR model, for downloading AR model from dummy model database server；
The identification application of AR condition code, is extracted for the video data using image acquisition device true environment and from video data
Characteristic point；AR identification figure binding application, for carrying out space orientation to AR model based on the characteristic point；AR image superposition is answered
With, by AR show content be added in the video data realize enhancing display.
Preferably, the system comprises real time enhancing display patterns and stable state to enhance display pattern, in the real time enhancing
Under display pattern, AR is generated by AR application apparatus and shows content, in the case where the stable state enhances display pattern, is given birth to by cloud server
Content is shown at AR.
Preferably, the AR application apparatus further includes display effect application, not for different virtual display content applications
Same display effect, including Overlapping display, floating are shown, further include fixed display, variation display.
Preferably, the AR application apparatus further includes AR display pattern application, and the AR display pattern, which is applied, is used for basis
The type of triggering mode and the acquired data of IOT equipment carries out the selection of different display modes, including real time enhancing shows mould
Formula and stable state enhance display pattern, under the real time enhancing display pattern, IOT equipment is acquired via server data into
Row pretreatment finally generates AR by AR application apparatus and shows content, the data under real time enhancing display pattern be temperature, pressure,
The current value of numerical quantities and the present image of real time kinematics state, flow regime such as revolving speed, real-time, it is aobvious in stable state enhancing
Show under mode, being generated by cloud server directly to show that content, stable state enhance display pattern by the AR that AR application apparatus uses
Under data be history value and history curve.
Preferably, in the case where dynamic enhances display pattern, display current value is related to the first AR request, according to the spy captured
Set the goal triggering, generates AR by AR application apparatus for current value, that is, latest edition data and shows that content realizes that real time enhancing is shown
Show；For history value and history curve, instruction triggers are inputted via U/I interface according to user, for history value and history curve by
Cloud server generates AR and shows that content realizes stable state enhancing display.
Preferably, the AR display pattern is applied to apply with AR display effect and is used cooperatively, for temperature, pressure, revolving speed
Etc. numerical quantities current value shown with floating, fixed display；For real time kinematics state, flow regime present image to be superimposed
Display, variation display；History value and history curve are shown with floating, fixed display.
Detailed description of the invention
Fig. 1 is flow chart according to the system in the embodiment of the present invention.
Fig. 2 is the system pie graph of embodiment according to the present invention.
Fig. 3 is the system composition frame diagram of embodiment according to the present invention.
Specific embodiment
Retouching in detail to one or more embodiment of the invention is hereafter provided together with the attached drawing of the diagram principle of the invention
It states.The present invention is described in conjunction with such embodiment, but the present invention is not limited to any embodiments.The scope of the present invention is only by right
Claim limits, and the present invention covers many substitutions, modification and equivalent.Illustrate in the following description many details with
Just it provides a thorough understanding of the present invention.These details are provided for exemplary purposes, and without in these details
Some or all details can also realize the present invention according to claims.
Below in conjunction with Figure of description the present invention is described in detail, especially specific method and step and technical effect will with
It is described in detail in lower content.Fig. 1 is shown according to an embodiment of the present invention to be presented IOT device data in AR application apparatus
Method flow diagram.As shown in Figure 1, the method proposed by the present invention for being presented IOT device data in AR application apparatus, IOT
Equipment is communicated to connect via cloud server and AR application apparatus, and IOT equipment is via cloud server in real time by IOT number of devices
According to being sent to AR application apparatus, and carried out realizing that real time enhancing is shown after synthesizing processing by AR application apparatus.The present invention needs logical
Cloud server is crossed, as support, IOT equipment and cloud server have data connection, and AR shows that application has with cloud server
Data connection.IOT equipment keeps the real-time Data Transmission with server, guarantees that server has the latest data of the IOT equipment.
When AR shows that associated trigger point is opened in application, (including but not limited to data monitoring point enters the visual field, scanning recognition figure/two dimensional code
The associated triggers mechanism such as equal identification points, click/direction), server sends IOT acquisition data and/or process to AR application apparatus
Data are displayed in the user interface by the data of processing, AR application apparatus, and display mode includes but is not limited to text, data, figure
Mark, color lump, animation etc..IOT equipment in the present invention refers in particular to the IOT equipment with data back ability, and in the present invention, IOT is set
The data of standby acquisition, handle by cloud server, as the real-time display data in AR scene, or are used as basic number
According to operation is used as the display foundation of AR scene later.
According to an embodiment of the invention, IOT equipment real-time data collection and IOT data be uploaded to cloud server going forward side by side
Row storage, the cloud server carry out data normalization processing, i.e., carry out format analysis processing and content respectively to the IOT data
Processing, the IOT equipment are the IOT equipment of multiple and different types and carry out data acquisition and upload parallel to each other；AR application
By the video data of image acquisition device true environment after opening of device；Monitoring applies video data described in real-time monitoring simultaneously
Target identification is carried out, sends the first AR request when capturing specific objective Shi Zexiang cloud server；In response to the first AR
Latest edition data relevant to the specific objective are sent to AR application apparatus in real time by request, cloud server；AR is answered
It is based on the latest edition data in real time with equipment and generates the first AR display content, and the first AR is shown into content and institute
It states video data and is synthesized (load) and carry out real time enhancing afterwards and show, wherein the first AR shows content and cloud service
The latest edition data stored on device synchronously change so that the content of the enhancing display changes therewith.More specifically, this hair
It is bright to be applied to twin, AR reproduction of AR industrial detection, AR etc., in mainly AR application.The present invention can be by acquiring IOT equipment
Data be presented in AR application apparatus in real time, can achieve it is more true in AR application, more added with the application for substituting into row.In AR
In industrial detection application, this technology can be used in real time saving equipment operation condition to cloud server in industrial detection,
And be shown in AR application apparatus, the relevant parameter of acquisition equipment running status that can be intuitive and convenient by application will originally
The case where being unfavorable for observation intuitively gets, such as the conducts such as large scale equipment internal engine operating revolution, temperature, pressure
The real-time data collection of IOT equipment.Corresponding supplemental characteristic can be uploaded to cloud server by this technology, in AR application apparatus
In in use, the information such as current value, history value, history curve can be checked, wherein current value is related to the first AR request, according to
The specific objective triggering captured generates AR by AR application apparatus for current value, that is, latest edition data and shows that content is realized in fact
Shi Zengqiang is shown；For history value and history curve, instruction triggers are inputted via U/I interface according to user, for history value and are gone through
History curve generates AR by cloud server and shows that content realizes stable state enhancing display, and different data is classified via the technology
The software and hardware resources for making full use of cloud server and AR application apparatus, the whole efficiency for improving data processing enhance user
Experience.Obviously, can be by data back that IOT equipment detects to server in AR is twin, AR application apparatus is obtained from server
Evidence of fetching realizes fully synchronized reduction apparatus operating status and operation ginseng in AR scene in conjunction with the mathematical model of relevant device
Several virtual displays can reach the fully synchronized digitized simulation emulation to equipment, for the record to equipment running status
And monitoring, Digital Theory basis is provided for the health maintenance and guarantee maintenance of equipment；And in AR reproduction, record IOT equipment
The data detected, record data when being run by equipment, subsequent bonding apparatus mathematical model, reduction and reproducing apparatus
Operating status, can be used for after equipment runs and completes, equipment running status analyzed and is investigated, can be used for point
Analyse the analysis of caused equipment operation difference under different conditions.Typical case scene is that staff has on AR glasses into one
Equipment workshop determines specific objective by the vision positioning of video camera, and then temperature humidity flow velocity of this equipment etc. is supervised in real time
First AR of measured data, that is, above shows that content will be shown in some designated position in the AR glasses visual field, and this display can be with
It is various and the combination of the projects such as scene relevant form color data in kind.Real time data is continuous refreshing and real-time transmission AR
Application apparatus, and history number can be further displayed with a specific real time data in chalaza by eyes and gesture
Accordingly and history curve data, i.e., the 2nd AR content hereafter.
The data proposed by the present invention for acquiring IOT equipment apply conventional AR using the method in AR application apparatus
The data source of equipment is supplemented, and improve AR application scenarios and real scene interacts impression, can be more intuitive
Pass through AR application observation to actual scene, the state of equipment and/or situation of change.Provide a kind of novel IOT device data
Methods of exhibiting replaces the equipment state display mode of existing instrumented, the digital display mode of data platform mode, improves
The convenience and intuitive that data are shown no longer are fixed by data display equipment when making user using this product or data are shown
Mode fixation is fettered, and achievees the purpose that " data are walked with people ".The present invention also provides a kind of completely new number for AR application apparatus
According to source, the data of IOT equipment can be shown with real-time Transmission into AR application apparatus, can will existing AR application in it is each
Kind of model, animation, in interactive operation, increase in real time, from the data of IOT equipment, make model state, the animation in interaction
Process, interactive operation have more authenticity, wherein AR application bandwagon effect include but is not limited to use text, data, icon,
The modes such as color lump, animation are shown.Such as: IOT equipment includes temperature IOT sensor, intensity of illumination IOT sensor, tasselled
IOT sensor etc..It sends temperature IOT sensing data to AR application apparatus, can intuitively show room in AR application apparatus
Between temperature range situation, in the visual field be superimposed green display Current Temperatures be suitable for, superposition red display temperature it is excessively high, superposition blue
Displays temperature is too low；It sends intensity of illumination IOT sensing data to AR application apparatus, can intuitively be opened up in AR application apparatus
Show intensity of illumination, so as to adjust model effect of shadow, such as when illumination enhances, plant leaf blade transparency is increased, green plant is made
Object shows more true effect of shadow, increases shadow intensity, the more obvious hatching effect etc. in display ground；By flow velocity
IOT sensor sends AR application apparatus to, can in AR application apparatus liquid mobility status in intuitive display pipes, in pipeline
Increase fluidized particle effect in model, particle effect is adjusted according to IOT device data in real time, presenting in real time cannot be straight in reality
Liquid mobility status information in the pipeline observed.Send revolution, temperature, pressure IOT sensor to AR application apparatus, it can
Car body model can be carried out translucent display by the way that big machinery to be put into the visual field in AR application apparatus, highlight aobvious
Show engine mockup, and use label for labelling present engine revolution and engine oil pressure, temperature sensor numerical value, convenient for large size
Mechanical engine carries out the observation of operating condition score and inspection.
As Figure 2-3, the present invention also provides one kind to be by what IOT device data was presented in AR application apparatus
System, the system comprises multiple IOT equipment and multiple AR application apparatus (abbreviation AR application), the multiple IOT equipment and institutes
Multiple AR application apparatus are stated to communicate to connect via cloud server.The present invention is the multiple as support by cloud server
Any one IOT equipment in IOT equipment includes data acquisition device and data transmitter-receiver set, and data acquisition device is for acquiring
Data are simultaneously uploaded to cloud server via data transmitter-receiver set；IOT equipment and cloud server have data connection, and AR application is set
It is standby to have data connection with cloud server.Multiple IOT equipment are divided into multiple types, and each type of IOT equipment acquisition is different
The content of the data of type, same type of IOT equipment acquisition is not identical.IOT equipment keeps the real time data with server
Transmission, guarantees that server has the latest data of the IOT equipment.When AR shows that associated trigger point is opened in application (including but not
It is limited to data monitoring point (specific objective, calibration object) and enters the identification points, point such as the visual field, scanning recognition figure (calibration maps)/two dimensional code
The associated triggers mechanism such as hit/be directed toward), server sends IOT acquisition data and/or treated data to AR application apparatus,
Data are displayed in the user interface by AR application apparatus, and display mode includes but is not limited to text, data, icon, color lump, animation
Deng.Specifically, the mode of IOT equipment acquisition information is different according to various equipment, specific acquisition device sensor can be variant,
But basic principle is, and perceives acquisition signal (temperature, humidity, pressure, flow velocity, revolution etc.) using sensor, passes through sensor
Corresponding signal is changed into electric signal, coded treatment is carried out by the microprocessor of equipment itself, it, will finally by sending device
By the electric signal transmission of coding to other equipment, with this, the acquisition and transmission work to signal to be collected are completed.IOT equipment
The data interaction that data equipment is received with other, can pass through GSM network, UMTS network, LTE network, 5G network, Wifi net
The modes such as network, wired connection network are transmitted, that is, include cellular network, conventional wired networks, conventional wireless network mode
It is communicated, when using cellular network, is communicated using protenchyma networking mode, realize under same frequency range, compare
In nearly 100 times of network coverage ability of traditional equipment, and bigger data connection amount, while possessing low latency, low equipment at
Originally, the advantages that equipment low-power consumption, the more optimal network architecture, it is sufficient to traditional sensor is substituted, to detect to target.
Server receives data, can use a variety of prior arts and completes, for example carries out data collection record using http request mode,
Or active access mode is used, carry out the collection of data.
As shown in Fig. 2, according to an embodiment of the invention, the cloud server includes: data transmitter-receiver set, for
IOT equipment and AR application apparatus carry out data communication；Data storage device, for store from IOT equipment acquisition data with
And the data of AR application apparatus feedback；Standard data format device, for guaranteeing the data format of different IOT equipment acquisitions
It is unified；AR shows contents production device, and the data for being acquired according to IOT equipment, which are generated, realizes that enhancing is aobvious for AR application apparatus
The AR shown shows content.It needs to handle collected data in server end, most basic process content has data lattice
The conversion of formula and uniformly, the data that processing is completed store etc..Required according to concrete application or application scenarios not
Together, the specific processing of data has different modes, carries out simple example below and illustrates specific service device process content: for room
Between temperature processing, the collected data of sensor can be compared with preset data, according to comparison result difference value
Situation generates different labeled colour code, the colour code of generation is passed to AR application apparatus, is carried out by AR application apparatus
It shows；For pipe flow speed processing, sensor can be acquired into data and carry out scale operation, and according to existing pipeline model number
According to, generate with the particle flow special efficacy (or corresponding particle flow special effect parameters) that pipeline model matches, by special efficacy (or special efficacy
Parameter) AR application apparatus is passed to, the displaying of fluid is carried out by AR application apparatus；The processing of large scale equipment engine signal, can
Processing, such as revolution, pressure, temperature are merged with the data for passing multiple sensors back, information is merged into picture, table
Lattice or text information send AR application apparatus end to, are shown by AR application apparatus；Or after information is collected, generation pair
The engine animation (or animation parameters) answered, for showing present engine actual rotation speed (rotational frequency), temperature (cylinder
Interior color), the information such as pressure (piston, valve color), transfer to AR application apparatus to be handled and generate AR and show that content is gone forward side by side
Row is shown；Increase a kind of special applications.Smart machine is more and more at present, is usually controlled by mobile phone, but introduces AR
Afterwards, smart machine and AR application apparatus can be combined, such as when people come into office or the such interior space of family
When, on AR glasses other than showing room temperature, also prompt have operable intelligent control device (as intelligence is opened within doors
Pass, intelligent electric appliance etc.), it can then prompt whether people open air-conditioning, user can control this intelligence with voice or gesture
The unlatching of energy equipment.In the present invention, it is preferable that the system comprises real time enhancing display patterns and stable state to enhance display pattern,
Under the real time enhancing display pattern, pre-processes via the data that server acquires IOT equipment, finally applied by AR
Equipment generates AR and shows content, and in the case where the stable state enhances display pattern, being generated by cloud server directly to be set by AR application
The standby AR used shows content.
As shown in Fig. 2, in embodiments of the present invention, the AR application apparatus includes the video data for acquiring true environment
Image collecting device, U/I interface, data transmitter-receiver set and following application: the binding application of AR model is used for from dummy model number
AR model is downloaded according to library server；AR condition code identification application, for using the video of image acquisition device true environment
Data simultaneously extract characteristic point from video data；AR identification figure binding application, for being carried out based on the characteristic point to AR model
Space orientation；AR is shown that content is added in the video data and realizes enhancing display by AR image superposition application.AR application is set
It is standby that data are shown into mode in space, according to application content, it can choose and final display content is superimposed upon entire picture
In, floating the modes such as be shown in some spatial position, be bundled on some mathematical model, follow the user visual field to change and become
Change.It is superimposed upon in entire picture, can be used for such as room temperature is shown in examples detailed above scene；It is suspended in some spatial position
In, such as current location air quality, temperature and humidity information, it is shown in user visual field forward anchoring position, does not follow user to regard
Open country changes and changes.It preferably, further include that display effect applies (attached drawing is not shown) in AR application apparatus of the invention；Bind certain
On a mathematical model, as above-mentioned pipe flow speed shows under scene that particle flow effect will be shown on pipeline model surface, for not
Same virtual display content (i.e. previously described temperature, revolving speed, pressure, particle flow etc.) applies different display effects, packet
Include Overlapping display, floating is shown, further include that fixed display (the user visual field is not followed to change and change), variation show and (follow use
The family visual field changes and changes) so that the effect of enhancing display is more life-like, enhance user experience, the display effect is answered
With being also used in conjunction with each other with display pattern application.
According to an embodiment of the invention, in response to the triggering of any one preset condition among multiple preset conditions, according to
Any one described preset condition sends the 2nd AR request to cloud server；It is requested in response to the 2nd AR, cloud service
Device transfers all data relevant to the specific objective stored in storage device based on any one described preset condition, and
The 2nd AR is generated based on all data and shows content, and the 2nd AR is shown that content is sent to AR application apparatus；AR is answered
The 2nd AR is shown with equipment and carries out stable state enhancing display after content and the video data are synthesized.Of the invention real
It applies in example, AR application apparatus further includes that AR display pattern applies (attached drawing is not shown), and the AR display pattern, which is applied, is used for basis
The type of triggering mode and the acquired data of IOT equipment carries out the selection of different display modes, including real time enhancing shows mould
Formula and stable state enhance display pattern, under the real time enhancing display pattern, IOT equipment is acquired via server data into
Row pretreatment finally generates AR by AR application apparatus and shows content, it is preferable that the data under real time enhancing display pattern are temperature
The current value of numerical quantities and the present image of real time kinematics state, flow regime such as degree, pressure, revolving speed, real-time, described steady
State enhances under display pattern, and being generated by cloud server directly to show content by the AR that AR application apparatus uses, it is preferable that steady
It is history value and history curve that state, which enhances the data under display pattern,.The present invention can check current value, history value, history curve
Etc. information, dynamic enhance display pattern under, display current value it is related to the first AR request, according to capture specific objective touching
Hair generates AR by AR application apparatus for current value, that is, latest edition data and shows that content realizes that real time enhancing is shown；For going through
History value and history curve input instruction triggers via U/I interface according to user, for history value and history curve by cloud service
Device generates AR and shows that content realizes stable state enhancing display, and different data is carried out classification via the technology and makes full use of cloud service
The software and hardware resources of device and AR application apparatus, the whole efficiency for improving data processing enhance user experience.It is shown with AR
When effect is using being used cooperatively, the current value of the numerical quantities such as temperature, pressure, revolving speed is shown with floating, fixed display；For
Real time kinematics state, flow regime present image with Overlapping display, variation display；For history value and history curve with floating
Display, fixed display.
In embodiments of the present invention, the mode of AR application identification scene areas, can be carried out, such as: allusion quotation using various ways
The selected mode for needing to show data equipment of type is the cursor point on AR glasses, substantially the namely place seen of eyes, or
Person can select the equipment for wanting to see data plus gesture or the auxiliary of voice, two parameters.Using scanning the two-dimensional code
Mode, need to content to be shown with two dimensional code be that basic position is shown；It is carried out using model binding mode, uses such as 3D
SLAM mode is bound, and content to be shown will be needed to bind with actual object, display data cover actual object it
On；It is carried out by the way of image recognition, is opened up needing content to be shown to be placed on the position based on identification figure
Show；Floating shows, similar to the mode that UI is shown, need to it is to be shown in be placed in the visual field and fix position, do not become with the visual field
Change and changes；Different data can also be shown simultaneously in several regions simultaneously, or real-time display is all in whole visuals field
It is provided with the device parameter of IOT sensor.In this technology, data source is not limited to IOT equipment, in actual use, can be used
Other any authentic data information sources are replaced, such as data information, the traditional sensors data information prerecorded,
It is preferred that deriving from IOT equipment, this is also one of inventive point of the invention.
According to an embodiment of the invention, the format analysis processing and contents processing include: by format analysis processing module based on described
The different type of IOT data carries out the conversion and uniformly of data format to the IOT data respectively；If after format analysis processing
Other associated datas are not present in IOT data, then directly store it in storage device；If the IOT data after format analysis processing
There are other associated datas, then the data that will be mutually related merge processing, then store it in storage device again.Number
According to the conversion of format and uniformly including operations such as quantization, normalization, by converting and unifying so that the data of difference IOT equipment are full
The whole standard of pedal system, improves system whole efficiency.
Via the above embodiment of the present invention, more intuitive efficient transmitting physical device, environmental data set AR application
Standby display is using real data as support；Compared to preset data, the real time data returned using IOT equipment, Ke Yibao
The high reliability and high real-time for demonstrate,proving the display content of AR application increase user and are felt by the interaction that AR is applied, can pass through AR
Truthful data state of the application apparatus to user's presentation device, environment；In existing AR application, interactive experience is mainly using highlighted aobvious
Show, equipment real-time running state can be shown by the interaction for modes the carry out user such as animation is shown after IOT equipment,
Rather than preset animation is played merely, it can allow user's state that equipment is run in seeing real scene, and be seen in AR scene
To equipment operation generate effect combine, promoted interaction impression；Further, it is possible to use the control function of IOT equipment, by AR
Click, crawl in etc. operation, feed back in IOT equipment, control the operating status of IOT equipment, and then control
The operating status of relevant device processed is used as the application scenarios such as overhaul of the equipments and transports as equipment to promote interactive impression
Turn status data displaying, convenient for not shutting down detection device operation.In overhaul of the equipments application, since many equipment can not be shut down
Detection, simultaneously because prior art reason, detection content is not intuitive or is not easy to operate, be not easy to the defects of saving, AR maintenance
Application in, IOT facility information can show in the visual field, it is not necessary to equipment carry out directly measurement can learn equipment fortune
Row state, while the application of AR maintenance can be set and be saved by user's control to the shooting of maintenance picture, or to the visual field AR
Content carries out screenshot, records preservation, provides concrete foundation for later period examination.And the mutual cooperation of display pattern and display effect
Design so that enhancing display efficiency greatly improve, and make enhancing show effect it is more life-like, enhance user's body
It tests.
It should be understood that above-mentioned specific embodiment of the invention is used only for exemplary illustration or explains of the invention
Principle, but not to limit the present invention.Therefore, that is done without departing from the spirit and scope of the present invention is any
Modification, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.In addition, appended claims purport of the present invention
Covering the whole variations fallen into attached claim scope and boundary or this range and the equivalent form on boundary and is repairing
Change example.
Claims (10)
1. a kind of method for being presented IOT device data in AR application apparatus, IOT equipment is applied via cloud server and AR
IOT device data is sent to AR application apparatus in real time via cloud server by equipment communication connection, IOT equipment, and by AR
Application apparatus realizes that real time enhancing is shown after carrying out synthesis processing.
2. the method for being presented IOT device data in AR application apparatus according to claim, which is characterized in that
IOT data are simultaneously uploaded to cloud server by IOT equipment real-time data collection, and the cloud server is to the IOT number
According to carrying out format analysis processing and contents processing respectively, the IOT equipment be the IOT equipment of multiple and different types and parallel to each other into
The acquisition of row data and upload；
By the video data of image acquisition device true environment after the unlatching of AR application apparatus；
Monitoring is using video data described in real-time monitoring and carries out target identification, when capturing specific objective Shi Zexiang cloud service
Device sends the first AR request；
It is requested in response to the first AR, cloud server in real time will latest edition data hair relevant to the specific objective
It send to AR application apparatus；
AR application apparatus is based on the latest edition data in real time and generates the first AR display content, and the first AR is shown
Content and the video data carry out real time enhancing after being synthesized and show, wherein the first AR shows that content and cloud take
The latest edition data stored on business device synchronously change so that the content of the enhancing display changes therewith.
3. the method according to claim 2 for being presented IOT device data in AR application apparatus, which is characterized in that institute
It states format analysis processing and contents processing includes:
Different type by format analysis processing module based on the IOT data carries out data format to the IOT data respectively and turns
It changes and uniformly；
If other associated datas are not present in the IOT data after format analysis processing, directly store it in storage device；
If the IOT data after format analysis processing are there are other associated datas, the data that will be mutually related merge processing, so
It stores it in storage device again afterwards.
4. the method according to claim 2 for being presented IOT device data in AR application apparatus, which is characterized in that also
Include:
In response to the triggering of any one preset condition among multiple preset conditions, according to any one described preset condition to cloud
Server is held to send the 2nd AR request；
It is requested in response to the 2nd AR, cloud server is transferred in storage device based on any one described preset condition and stored
All data relevant to the specific objective, and generate the 2nd AR based on all data and show content, by described the
Two AR show that content is sent to AR application apparatus；
AR application apparatus, which shows the 2nd AR, carries out stable state enhancing display after content and the video data are synthesized.
5. the system that one kind can be presented IOT device data in AR application apparatus, the system comprises multiple IOT equipment,
And multiple AR application apparatus, the multiple IOT equipment and the multiple AR application apparatus are communicated to connect via cloud server.
6. the system according to claim 5 that can be presented IOT device data in AR application apparatus, feature exist
In:
Any one IOT equipment in the multiple IOT equipment includes data acquisition device and data transmitter-receiver set, data acquisition
Device is for acquiring data and being uploaded to cloud server via data transmitter-receiver set.
7. the system according to claim 6 that can be presented IOT device data in AR application apparatus, feature exist
In multiple IOT equipment are divided into multiple types, and each type of IOT equipment acquires different types of data, same type of
The content of IOT equipment acquisition is not identical.
8. the system according to claim 5 that can be presented IOT device data in AR application apparatus, feature exist
In the cloud server includes:
Data transmitter-receiver set, for carrying out data communication with IOT equipment and AR application apparatus；
Data storage device, for storing the data of data and AR application apparatus feedback from the acquisition of IOT equipment；
Standard data format device, the unification of the data format for guaranteeing different IOT equipment acquisitions；
AR shows contents production device, and the data for being acquired according to IOT equipment, which are generated, realizes that enhancing is aobvious for AR application apparatus
The AR shown shows content.
9. the system according to claim 5 that can be presented IOT device data in AR application apparatus, feature exist
In the AR application apparatus includes image collecting device, U/I interface, the data transmitter-receiver set for acquiring the video data of true environment
And following application:
AR model binding application, for downloading AR model from dummy model database server；
AR condition code identification application, for using the video data of image acquisition device true environment and from video data
Extract characteristic point；
AR identification figure binding application, for carrying out space orientation to AR model based on the characteristic point；
AR is shown that content is added in the video data and realizes enhancing display by AR image superposition application.
10. the system according to claim 1 that can be presented IOT device data in AR application apparatus, feature exist
In,
The system comprises real time enhancing display patterns and stable state to enhance display pattern, under the real time enhancing display pattern,
AR is generated by AR application apparatus and shows content, in the case where the stable state enhances display pattern, is generated in AR shows by cloud server
Hold.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910612555.4A CN110347259A (en) | 2019-07-09 | 2019-07-09 | A kind of method and system being presented IOT device data in AR application apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910612555.4A CN110347259A (en) | 2019-07-09 | 2019-07-09 | A kind of method and system being presented IOT device data in AR application apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110347259A true CN110347259A (en) | 2019-10-18 |
Family
ID=68178516
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910612555.4A Pending CN110347259A (en) | 2019-07-09 | 2019-07-09 | A kind of method and system being presented IOT device data in AR application apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110347259A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114839782A (en) * | 2022-06-07 | 2022-08-02 | 上汽大众汽车有限公司 | Vehicle-mounted enhanced display system for vehicle control and information display |
| US11662722B2 (en) * | 2016-01-15 | 2023-05-30 | Irobot Corporation | Autonomous monitoring robot systems |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106953900A (en) * | 2017-03-09 | 2017-07-14 | 华东师范大学 | A kind of industrial environment outdoor scene enhanced interactive terminal and system |
| CN107578487A (en) * | 2017-09-19 | 2018-01-12 | 北京枭龙科技有限公司 | A kind of cruising inspection system based on augmented reality smart machine |
| CN108020262A (en) * | 2017-11-21 | 2018-05-11 | 北京恒华伟业科技股份有限公司 | A kind of tunnel environment data display method and system |
| JP6417467B1 (en) * | 2017-11-30 | 2018-11-07 | ソフトバンク株式会社 | Virtual, augmented reality space service providing system, program and method |
-
2019
- 2019-07-09 CN CN201910612555.4A patent/CN110347259A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106953900A (en) * | 2017-03-09 | 2017-07-14 | 华东师范大学 | A kind of industrial environment outdoor scene enhanced interactive terminal and system |
| CN107578487A (en) * | 2017-09-19 | 2018-01-12 | 北京枭龙科技有限公司 | A kind of cruising inspection system based on augmented reality smart machine |
| CN108020262A (en) * | 2017-11-21 | 2018-05-11 | 北京恒华伟业科技股份有限公司 | A kind of tunnel environment data display method and system |
| JP6417467B1 (en) * | 2017-11-30 | 2018-11-07 | ソフトバンク株式会社 | Virtual, augmented reality space service providing system, program and method |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11662722B2 (en) * | 2016-01-15 | 2023-05-30 | Irobot Corporation | Autonomous monitoring robot systems |
| CN114839782A (en) * | 2022-06-07 | 2022-08-02 | 上汽大众汽车有限公司 | Vehicle-mounted enhanced display system for vehicle control and information display |
| CN114839782B (en) * | 2022-06-07 | 2023-08-18 | 上汽大众汽车有限公司 | Vehicle-mounted enhanced display system for vehicle control and information display |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107730017B (en) | Intelligent metallurgical equipment operation diagnosis system | |
| WO2020160261A1 (en) | Augmented reality system | |
| CN106355153A (en) | Virtual object display method, device and system based on augmented reality | |
| CN107850936A (en) | For the method and system for the virtual display for providing physical environment | |
| US20160049007A1 (en) | Spatial data visualization | |
| CN110728670A (en) | Low-voltage equipment operation and maintenance method based on AR technology | |
| CN110457414A (en) | Offline map processing, virtual objects display methods, device, medium and equipment | |
| CN107274368B (en) | Compatible vision processing system and method | |
| CN110347259A (en) | A kind of method and system being presented IOT device data in AR application apparatus | |
| CN108229376A (en) | For detecting the method and device of blink | |
| EP3090425A1 (en) | Visualization of physical characteristics in augmented reality | |
| US9830395B2 (en) | Spatial data processing | |
| US11816926B2 (en) | Interactive augmented reality content including facial synthesis | |
| CN106683193B (en) | Design method and design device of three-dimensional model | |
| US20190332181A1 (en) | Method and system for generating a synthetic database of postures and gestures | |
| CN106797458A (en) | The virtual change of real object | |
| WO2022212503A1 (en) | Facial synthesis in augmented reality content for third party applications | |
| CN109615655A (en) | A kind of method and device, electronic equipment and the computer media of determining gestures of object | |
| CN110070622A (en) | A kind of library application system and application method based on AR technology | |
| CN111727905A (en) | Automatic analysis system and method for big and small mouse open field experiment based on deep learning | |
| CN107544387A (en) | A kind of recognition of face Household security system and method | |
| JP2022551139A (en) | Biometric face detection method, biometric face detection device, electronic device, and computer program | |
| EP4315255A1 (en) | Facial synthesis in augmented reality content for advertisements | |
| WO2022212309A1 (en) | Facial synthesis in content for online communities using a selection of a facial expression | |
| CN115482322A (en) | Computer-implemented method and system for generating a synthetic training data set |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |