CN109067822A - The real-time mixed reality urban service realization method and system of on-line off-line fusion - Google Patents
The real-time mixed reality urban service realization method and system of on-line off-line fusion Download PDFInfo
- Publication number
- CN109067822A CN109067822A CN201810586132.5A CN201810586132A CN109067822A CN 109067822 A CN109067822 A CN 109067822A CN 201810586132 A CN201810586132 A CN 201810586132A CN 109067822 A CN109067822 A CN 109067822A
- Authority
- CN
- China
- Prior art keywords
- scene
- city
- virtual
- data
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000004927 fusion Effects 0.000 title claims abstract description 60
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000007726 management method Methods 0.000 claims description 66
- 238000004891 communication Methods 0.000 claims description 36
- 230000000694 effects Effects 0.000 claims description 28
- 230000007613 environmental effect Effects 0.000 claims description 20
- 238000004422 calculation algorithm Methods 0.000 claims description 18
- 238000013461 design Methods 0.000 claims description 16
- 230000002452 interceptive effect Effects 0.000 claims description 16
- 238000005516 engineering process Methods 0.000 claims description 15
- 238000004458 analytical method Methods 0.000 claims description 14
- 238000007405 data analysis Methods 0.000 claims description 13
- 230000003993 interaction Effects 0.000 claims description 12
- 230000001360 synchronised effect Effects 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 11
- 230000008447 perception Effects 0.000 claims description 10
- 230000006399 behavior Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 9
- 206010000117 Abnormal behaviour Diseases 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 5
- 230000003542 behavioural effect Effects 0.000 claims description 5
- 238000004140 cleaning Methods 0.000 claims description 5
- 238000010219 correlation analysis Methods 0.000 claims description 5
- 238000013135 deep learning Methods 0.000 claims description 5
- 238000010191 image analysis Methods 0.000 claims description 5
- 230000009466 transformation Effects 0.000 claims description 5
- 230000002457 bidirectional effect Effects 0.000 claims description 4
- 238000007654 immersion Methods 0.000 claims description 4
- 238000010801 machine learning Methods 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 4
- 230000001413 cellular effect Effects 0.000 claims description 3
- 235000013399 edible fruits Nutrition 0.000 claims description 3
- 230000006855 networking Effects 0.000 claims description 3
- 238000004321 preservation Methods 0.000 claims description 3
- 238000004088 simulation Methods 0.000 claims description 3
- 238000009826 distribution Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000010354 integration Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000003860 storage Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 239000011551 heat transfer agent Substances 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 239000011800 void material Substances 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 241001310793 Podium Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000155 melt Substances 0.000 description 1
- 238000012821 model calculation Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000001338 self-assembly Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/067—Enterprise or organisation modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/26—Government or public services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Economics (AREA)
- General Physics & Mathematics (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Game Theory and Decision Science (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Primary Health Care (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The present invention provides a kind of real-time mixed reality urban service realization method and systems of on-line off-line fusion, this method comprises: obtaining and analyzing the urban information acquired in real time by the city sensing network that all things on earth interconnects, form city high amount of traffic；Scene of Virtual City completely corresponding with real City scenarios is established, the urban information high amount of traffic that will acquire is matched and shown in the Scene of Virtual City, to construct and the accurate corresponding dynamic virtual City scenarios of reality scene；Mode and urban service application build are interacted based on the dynamic virtual City scenarios.The present invention can be realized the urban service system of virtual reality fusion, on-line off-line fusion, the case where each block in city is more accurately understood in virtual city model, rather than face various many and diverse data, information display format in virtual scene is unrestricted, more convenient observation and decision, thus the user experience of General Promotion urban service, service quality and interactivity.
Description
Technical field
The present invention relates to a kind of real-time mixed reality city of internet of things field more particularly to on-line off-line fusion clothes
Business realization method and system.
Background technique
With the technological progress and application popularization of the industries such as smart phone, mobile payment, Internet of Things and artificial intelligence, interconnection
The fast-developing of 5G technology will at hand in OMO (Online-Merge-Offline, line on the offline fusion) epoch of net industry
The application process of boosting OMO.The communication technologys such as low time delay, high-speed, low-power consumption, high density in the case where realizing all things on earth internet
After upgrading, the critical services that the novel OMO application of a batch will become convenient city management, improve quality of residents'life, to take into account height
The intelligent future city service scenarios with friendly interactivity of degree provide floor-type support.
The depth integration of online and offline need to guarantee have efficient on-line off-line interaction mechanism, be supported with content under line
On line, while realized on line to the intuitive control under line.As the basis of on-line off-line fusion, the biography of internet-of-things terminal composition
Sense network size just constantly expands, and develops towards the direction of all things on earth interconnection (Internet of everything), passes through design
Distributed edge computing architecture and lightweight artificial intelligence data analysis algorithm, a large amount of effective information of acquisition can pass through
A kind of mode of mixed reality innovates presentation, makes virtual with real depth integration, and urban service is made to break through on-line off-line barrier.
It is limited to the development of the communication technology and the deficiency of intelligent city operation experience, current worldwide wisdom city
City's construction be there is a problem that more with operation, is mainly shown as: in terms of public administration, existing service system or management framework
Find the problem, state event location, instruction issuing and in terms of, functionally can not effectively meet the requirements, and have in efficiency
There is certain hysteresis；Personal lifestyle service aspect, existing public service system intelligence degree is insufficient, cannot mention for user
For customizing, intuitive, easy-to-use service.Face the future the operating service in city.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind
The real-time mixed reality urban service realization method and system for stating a kind of on-line off-line fusion of problem, can be in virtual city
The case where each block in city is more accurately understood in model, rather than various many and diverse data are faced, the letter in virtual scene
It is unrestricted to cease display format, is more convenient observation and decision, General Promotion user experience, service quality and interactivity.
The present invention provides a kind of real-time mixed reality urban service implementation method of on-line off-line fusion, this method packets
It includes:
The urban information acquired in real time by the city sensing network that all things on earth interconnects is obtained and analyzed, city high amount of traffic is formed；
Scene of Virtual City completely corresponding with real City scenarios is established, the urban information high amount of traffic that will acquire is in institute
It states and is matched and shown in Scene of Virtual City, while realizing that the mixing of virtual scene data and real data two-way fusion is existing
Actual effect fruit, with building and the accurate corresponding dynamic virtual City scenarios of reality scene；
Mode and urban service application build are interacted based on the dynamic virtual City scenarios.
Wherein, the urban information high amount of traffic includes continually changing environmental information, power system information, target object
The information of location information, infrastructure and smart machine status information, management unit or user's active upload, image information and by
Target information, abnormal behaviour information, parking stall and the violation information that image analysis obtains.
Wherein, it the acquisition and analyzes the urban information that acquires in real time of city sensing network interconnected by all things on earth and includes:
The data of the city sensing network interconnected by all things on earth acquisition are subjected to the number based on distributed edge computing architecture at end
Data preprocess；
Pretreated data are carried out to summarize upload server end, carry out centralized processing in server end.
Wherein, the data by the city sensing network interconnected by all things on earth acquisition are carried out in terminal side based on distribution
The data prediction of edge calculations framework, comprising:
Cleaning and basic correlation analysis are carried out to the data of digital information, lightweight calculating support is based on to the data of image information
The marginal end target detection of structure, behavioural analysis；
It is described to carry out centralized processing in server end, comprising:
Multisource data fusion is carried out to digital information and overall relevancy is analyzed, image information answered based on testing result
With design, and obtained overall data is optimized by machine learning algorithm model, forms structuring city big data.
Wherein, foundation Scene of Virtual City completely corresponding with real City scenarios, the city letter that will acquire
Breath high amount of traffic is matched and is shown in the Scene of Virtual City, while realizing that virtual scene data and real data are double
To the mixed reality effect of fusion, comprising:
Using the position Scene of Virtual City corresponding with state of scene reconstruction technology foundation and reality scene, and described virtual
Scene simulation dynamic effect is configured in City scenarios；
According to the corresponding relationship of the position of reality scene and state in Scene of Virtual City, the urban information that will be will acquire
Big data and Scene of Virtual City real time fusion, so that the real movable state of perception data is reflected in virtual scene；
Synchronous feedback can be obtained in reality scene to the operation of object in virtual scene or element, realize that fusion is existing in virtual
Virtual mixed reality effect is merged in real, reality.
Wherein, the interactive mode and urban service are applied including urban infrastructure, Environmental Communication management and garden, society
Area, scenic spot management service.
The real-time mixed reality urban service that another aspect of the present invention additionally provides a kind of on-line off-line fusion realizes system
System, including front end sensing layer, Web communication layer, cloud computing platform layer, data analysis layer, service offer layer and management backstage,
In:
Front end sensing layer sets up all things on earth and interconnects sensing network, for each using the city intelligent terminal of integrated multiple sensors
Kind urban information is perceived and is acquired, and realizes Street lamps control and positioning；
Web communication layer is built by a kind of at least following access networking technology, the novel multi-hop communication of link layer, all things on earth is interconnected
Sensing network, cellular network, local area network, Bluetooth form urban network communication；
Cloud computing platform layer, using distributed edge computing architecture, according to the self-assembly ability of intelligent terminal with from master data
Operational capability is interacted and is pre-processed at end to the data of front end sensing layer acquisition;
Data analysis layer, for machine vision algorithm and data anastomosing algorithm based on deep learning, to the image and biography of acquisition
Sense data are analyzed；
Service provides layer, by establishing Scene of Virtual City corresponding with reality scene, transmits by data analysis with information,
To the transformation of reality scene in Scene of Virtual City synchronized update, and be that community and resident mention by cloud platform and APP software
For various application services；
Management backstage realizes the virtually interaction with real Bidirectional flow of information for being monitored, managing and maintaining to whole system
With control.
Wherein, the application service that the application service layer provides include urban infrastructure, Environmental Communication management and garden,
At least one of community, scenic spot management service.
Wherein, described towards urban infrastructure, Environmental Communication management service, it is implemented as follows:
By infrastructure data stream real-time synchronization that front end sensing layer obtains the service of being reflected in provides the virtual city of layer building
In scene, is assigned for it and click, check and tactical management service；By The Surroundings in Cities, transport data stream with effect of shadow or height
Bright effect is shown in the Scene of Virtual City, and provides interactive operation entrance for user, is produced according to the interactive operation of user
Raw state, which changes, generates synchronously control instruction to reality scene, so that reality scene generates corresponding state and changes.
Wherein, the management service towards garden, is implemented as follows:
The garden parking space information that front end sensing layer is obtained is highlighted in the Scene of Virtual City that service provides layer building and is shown,
User carries out the predetermined or offline AR in parking stall by interactive operation and navigates, so that manager carries out parking stall behaviour in service statistics and configures
Management strategy.
Wherein, the management service of the Community-oriented, is implemented as follows:
The crowd behaviour that front end sensing layer is obtained and exception information highlight in the Scene of Virtual City that service provides layer building
It has been shown that, and carry out suspect's locking and interlink warning；By the corresponding location information real-time exhibition of crowd behaviour, society is left to abnormal
The user in area carries out track preservation and notifies related guardian.
Wherein, the management service towards scenic spot, is implemented as follows:
The scenic spot stream of people that front end sensing layer is acquired, environment, location information are in the Scene of Virtual City that service provides layer building
Implement to show, and assign dynamic AR/VR effect for it, so that onsite user passes through scanning scenic spot physical object, at dynamic AR
Observed information under scape carries out service consultation and navigation, remote user access dynamic VR scene, realizes that scene is strolled and right in real time
The high-immersion visit answered.
The real-time mixed reality urban service realization method and system of on-line off-line fusion provided in an embodiment of the present invention, energy
It enough realizes the urban service system of virtual reality fusion, on-line off-line fusion, more accurate in virtual city model can understand
The case where each block in city, rather than various many and diverse data are faced, the information display format in virtual scene is unrestricted,
More convenient observation and decision, General Promotion user experience, service quality and interactivity.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention,
And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 is a kind of method stream of the real-time mixed reality urban service implementation method of on-line off-line fusion of the embodiment of the present invention
Cheng Tu；
Fig. 2 is that a kind of real-time mixed reality urban service of on-line off-line fusion of the embodiment of the present invention realizes the system frame of system
Figure；
Fig. 3 is that a kind of real-time mixed reality urban service of on-line off-line fusion of the embodiment of the present invention realizes the system function of system
It can schematic diagram；
Fig. 4 is that a kind of real-time mixed reality urban service of on-line off-line fusion of the embodiment of the present invention realizes the scene exhibition of system
Diagram.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Should also
Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art
The consistent meaning of meaning, and unless otherwise will not be explained in an idealized or overly formal meaning by specific definitions.
The embodiment of the invention provides a kind of real-time mixed reality urban service implementation method of on-line off-line fusion and it is
System, main target are to provide innovation service solution to relevant issues such as city management, environment and traffic, will be directed to wisdom
Garden, community, crucial pain spot problem exploitation in the operating service of scenic spot service effectively apply, pass through the city interconnected according to all things on earth
The analysis of city's sensing network real-time data acquisition, make with the accurate corresponding dynamic virtual scene of reality scene, make it is virtual with it is real
Data realize two-way fusion, and design a variety of applications and the convenient urban service of interactive mode, General Promotion user experience, Service Quality
Amount and interactivity.
The real-time mixed reality urban service that Fig. 1 diagrammatically illustrates the on-line off-line fusion of one embodiment of the invention is real
The method flow diagram of existing method.Referring to Fig.1, the real-time mixed reality urban service of the on-line off-line fusion of the embodiment of the present invention is real
Existing method, specifically includes the following steps:
S11, acquisition simultaneously analyze the urban information that the city sensing network interconnected by all things on earth acquires in real time, form city big data
Stream；
S12, foundation Scene of Virtual City completely corresponding with real City scenarios, the urban information high amount of traffic that will acquire
It is matched and is shown in the Scene of Virtual City, while realizing the mixed of virtual scene data and real data two-way fusion
Real effect is closed, with building and the accurate corresponding dynamic virtual City scenarios of reality scene；
S13, mode and urban service application build are interacted based on the dynamic virtual City scenarios.
The present invention provides a kind of real-time mixed reality urban service implementation methods of on-line off-line fusion, by city
The real-time perception and control of information carry out multi-source urban information on the virtual application service platform with real depth integration straight
Three-dimensional presentation is seen, and designs a variety of depth interaction mechanisms and service system towards different application scene, is realized virtual
The case where each block in city is more accurately understood in city model, rather than various many and diverse data are faced, in virtual scene
Information display format it is unrestricted, be more convenient observation and decision, thus the user experience of General Promotion urban service, Service Quality
Amount and interactivity.
In the present embodiment, the city high amount of traffic includes continually changing environmental information, power system information, object
The information of body position information, infrastructure and smart machine status information, management unit or user's active upload, image information and
Target information, abnormal behaviour information, parking stall and the violation information obtained by image analysis.
In practical application, by all things on earth interconnect city sensing network mainly acquire with analyze information include: temperature, it is wet
The environmental informations such as degree, illumination, PM2.5, noise；The power system informations such as Street lamps control；The target position informations such as people, vehicle；Basis
Facility and smart machine status information；The information of management unit or user's active upload；It image information and is obtained by image analysis
People, vehicle, object target information, abnormal behaviour information, parking stall and violation information etc..
In a specific embodiment, the acquisition and analyzing is acquired in real time by the city sensing network that all things on earth interconnects
Urban information mainly includes unshowned step in the following drawings:
S111, the data of the city sensing network interconnected by all things on earth acquisition are carried out at end based on distributed edge computing architecture
Data prediction.It is implemented as follows: cleaning and basic correlation analysis being carried out to the data of digital information, to image information
Data based on the marginal end target detection of lightweight computing architecture, behavioural analysis.
S112, pretreated data are carried out to summarize upload server end, carries out centralized processing in server end.Tool
Body, which is accomplished by, carries out multisource data fusion and overall relevancy analysis to digital information, carries out image information based on detection
As a result application design, and obtained overall data is optimized by machine learning algorithm model, form structuring city
City's big data.
In practical applications, a large amount of perception datas are handled in real time by the way of Distribution and Centralization combination,
First by large-scale terminal heat transfer agent end carry out the data prediction based on distributed edge computing architecture, after will locate in advance
Information after reason is summarized, and carries out centralized processing in server end.Wherein, distributed treatment mainly includes to digital information
Data cleaning and basic correlation analysis, to image information based on the marginal end target detection of lightweight computing architecture, row
For analysis；Centralized processing mainly includes analyzing the multisource data fusion and overall relevancy of digital information, to image information
The application design based on testing result, and the optimization to overall data learning algorithm model；It is big to ultimately form structuring city
Data source of the data as follow-up business process.
In a specific embodiment, foundation Scene of Virtual City completely corresponding with real City scenarios, will obtain
The urban information high amount of traffic taken is matched and is shown in the Scene of Virtual City, while realizing virtual scene number
Mainly include unshowned step in the following drawings according to the mixed reality effect with real data two-way fusion:
S121, it is established using scene reconstruction technology and the position Scene of Virtual City corresponding with state of reality scene, and in institute
State configuration scene simulation dynamic effect in Scene of Virtual City.
S122, the corresponding relationship according to the position and state of reality scene in Scene of Virtual City, the institute that will be will acquire
Urban information big data and Scene of Virtual City real time fusion are stated, so that the real movable state of perception data is reflected in virtual scene
In；
S123, synchronous feedback can be obtained in reality scene to the operation of object in virtual scene or element, realizes and melts in virtual
It closes in real, reality and merges virtual mixed reality effect.
In practical applications, the scene reconstructions technologies such as three-dimensional modeling, 3D scanning be can use, the position with reality scene is made
Set with the accurate corresponding virtual scene of state, and design a variety of emulation dynamic effects for it, such as personnel, vehicle is mobile, street lamp is opened
It closes, Changes in weather etc..All things on earth is interconnected sensing network from reality scene by dynamic virtual scene location and the accurate corresponding part of state
The perception data and virtual scene real time fusion of acquisition are presented so that the real movable state of perception data is reflected in virtual scene
Synchronize corresponding visual effect.Wherein, it is described virtually with real data two-way fusion part, it is desirable that the variation in reality scene can
It is reflected in virtual scene in real time, while the operation in virtual scene can obtain synchronous feedback in reality scene, realized in virtual
Virtual mixed reality effect is merged in fusion reality, reality.
In the present embodiment, the interactive mode and urban service apply including urban infrastructure, Environmental Communication management and
Garden, community, scenic spot management service, and in particular to road lamp management, waste management, power system management, fixation means health pipe
Reason, polluted information displaying, traffic information display supervision, intelligent parking navigation Service, visitor's guide service, real time monitoring and crowd
Scout service, intelligent security guard and real-time AR/VR application etc..
The real-time mixed reality urban service that Fig. 2 diagrammatically illustrates the on-line off-line fusion of one embodiment of the invention is real
The system block diagram of existing system.The system structure builds the demand for being based primarily upon object-oriented and system requirements sets up.It is logical
The fusion for crossing technology of Internet of things and Internet technology, on the basis of the UE novel link layer multihop network communication technology, proposition
A comprehensive urban service system.Referring to Fig. 2, the real-time mixed reality city of the on-line off-line fusion of the embodiment of the present invention
Service realization system, including front end sensing layer 10, Web communication layer 20, cloud computing platform layer 30, data analysis layer 40, service mention
For layer 50 and management backstage 60, in which:
Front end sensing layer 10 is set up all things on earth and is interconnected sensing network using the city intelligent terminal of integrated multiple sensors, for pair
Various urban informations are perceived and are acquired, and realize Street lamps control and positioning.In the present embodiment, sensing layer is a variety of using integrating
The smart terminal product of sensor, set up all things on earth interconnect sensing network, acquire a variety of urban informations, and can carry out Street lamps control with
Positioning service.Perception information specifically includes that the environmental informations such as image, temperature, humidity, illumination, PM2.5, noise, Street lamps control letter
Breath, target position information etc..
Web communication layer 20 is built by a kind of at least following access networking technology, by the novel multi-hop communication of link layer, ten thousand
Object interconnects sensing network, cellular network, local area network, Bluetooth and forms urban network communication.In the present embodiment, network communication
Layer carries out network communication using the novel multi-hop link layer ad hoc network of UE.
Cloud computing platform layer 30, using distributed edge computing architecture, according to the UE to UE communication ability of intelligent terminal
With autonomous data operation ability, the data of front end sensing layer acquisition are interacted and pre-processed at end.In the present embodiment, cloud meter
It calculates podium level and uses distributed edge computing architecture, UE to UE communication ability and autonomous data processing energy by intelligent terminal
Acquisition data can be pre-processed at end, be summarized in gateway, and carry out model calculation and interpretation of result by power, while according to
It is updated by a large amount of data flow, algorithm model tuning is independently carried out under distributed model framework.
Data analysis layer 40, for machine vision algorithm and data anastomosing algorithm based on deep learning, to the figure of acquisition
As being analyzed with sensing data.In the present embodiment, using the image understanding based on deep learning, algorithm of target detection, to adopting
The image of collection is accurately analyzed.Using the data fusion parser based on machine learning, Air Quality Analysis, lamp control are carried out
Analysis of strategies, positioning correction analysis etc..Algorithm above is packaged as servicing, is called for cloud computing platform layer.
Service provides layer 50, by establishing Scene of Virtual City corresponding with reality scene, analyzes and believes by data
Breath transmitting, to the transformation of reality scene in Scene of Virtual City synchronized update, and by cloud platform and APP software be community and
Resident provides various application services.In the present embodiment, service provides layer and establishes target scene dummy model corresponding with reality,
Transmitted by data analysis with information, to the transformation of reality scene in virtual scene synchronized update, meanwhile, in virtual scene
The operation and state that object or element generate change synchronous impact reality scene.Design and provide a variety of cities of facing the future,
The information service of garden, community, scenic spot provides the interactive application based on real-time type mixed reality for it.
Management backstage 60, for being monitored, manage and maintain to whole system, realize virtually with real Bidirectional flow of information
Interaction and control.The chief components such as management backstage, including data gateway, console, data gateway realize data docking,
Instruction publication and service call are carried out by console.
The embodiment of the invention provides a kind of real-time mixed reality urban services of on-line off-line fusion to realize system, system
Framework is provided the levels such as layer and management backstage and is formed by front end sensing layer, Web communication layer, data analysis layer, service.By right
The real-time perception and control of urban information, on the virtual application service platform with real depth integration to multi-source urban information into
The intuitive three-dimensional presentation of row, and a variety of depth interaction mechanisms and service system towards different application scene are designed, face promotes user
Experience, service quality and interactivity.
The real-time mixed reality urban service of on-line off-line fusion provided in this embodiment realize system by front end sensing layer,
Web communication layer, data analysis layer, service provide layer and management backstage composition.Wherein, sensing layer is using integrated multiple sensors
City intelligent terminal, set up all things on earth interconnect sensing network, a variety of urban informations are perceived and are acquired, and have street lamp control
The functions such as system and positioning.Web communication layer is using the novel link layer multi-hop ad hoc network technology of UE that unit of the present invention is had by oneself as logical
Letter basis.Cloud computing platform layer uses distributed edge computing architecture, in corresponding in UE to UE(Fig. 2 of intelligent terminal
Appearance also makes same modification) communication capacity and autonomous data operation ability, perception data is interacted and pre-processed at end.Data
Analysis layer is developed machine vision algorithm and data anastomosing algorithm based on deep learning, is mentioned for the image and sensing data of acquisition
For accurate Analysis Service.Service provides layer, by establishing Virtual City Model corresponding with reality scene, analyzes by data
Transmitted with information, to the transformation of reality scene in virtual scene synchronized update, and mainly realize a variety of Innovative Cities services
Design and application.Management backstage can be monitored whole system, manage and maintain, realize virtually with real bidirectional information
The interaction and control function of stream.
The real-time mixed reality urban service of on-line off-line fusion provided by the invention realizes system, towards city management,
Environment and traffic etc., by it is virtual with it is real, on line under line depth integration in the way of, urban infrastructure, environment will be directed to
With the crucial pain spot problem design innovation application in traffic administration, wisdom garden, community, scenic spot operating service, and then mention comprehensively
Rise user experience, service quality and interactivity.
In the operating service field of smart city, the city basis sensing network paving of all things on earth interconnection is carried out the system early period
If with distributed edge computing architecture and can realize that urban environment, people's vehicle, basis are set from the intelligent sensing equipment of host computer
Apply the extensive acquisition and analysis of information.
The city sensing network of system application all things on earth interconnection, main acquisition with the information analyzed includes: temperature, wet
The environmental informations such as degree, illumination, PM2.5, noise；The power system informations such as Street lamps control；The target position informations such as people, vehicle；Basis
Facility and smart machine status information；The information of management unit or user's active upload；It image information and is obtained by image analysis
People, vehicle, object target information, abnormal behaviour information, parking stall and violation information etc..
To the data of above-mentioned city sensing network acquisition, located in real time by the way of Distribution and Centralization combination
Large-scale terminal heat transfer agent is carried out the data prediction based on distributed edge computing architecture at end first by reason, thus
Amount of communication data and system redundancy is effectively reduced.Pretreated information is summarized afterwards, carries out centralization in server end
Processing.The Distribution and Centralization handles related communications means and is all made of the novel link layer multi-hop ad hoc network skill of UE
Art guarantees data transmission efficiency and real-time.
For the data processing method that above-mentioned Distribution and Centralization combines, distribution pretreatment aspect, for numeric type
Information is substantially carried out data cleaning and basic correlation analysis, reduces data redundancy；For image-type information, it is substantially carried out base
It works in the marginal end target detection of lightweight computing architecture, behavioural analysis, while obtaining target information, data is analyzed and are calculated
Method carries out tuning.
For the data processing method that above-mentioned Distribution and Centralization combines, in terms of centralized processing, after to pretreatment
Information summarize after, for numeric type information, be substantially carried out multisource data fusion and overall relevancy analyzed, refine and generate city
Big data；For image-type information, it is substantially carried out the application design based on testing result, and according to result Continuous optimization data
Algorithm model is practised, to support effective iteration of lightweight detection model.
For the structural data that the processing mode that above-mentioned Distribution and Centralization combines obtains, city big data will be used as
Applied to follow-up business process.
A large amount of City scenarios and infrastructure are carried out visual scanning and three-dimensionalreconstruction by the system, and reduction production is accurate
Object module, formed be used for urban infrastructure management virtual scene.
The a large amount of real-time sensing information and the progress of above-mentioned virtual scene that the city basis sensing network of all things on earth interconnection is obtained
Depth integration, including the work such as object matching, state registration and bi-directional chaining.Realize the variation for city reality scene,
Can accomplish in above-mentioned virtual scene synchronized update in real time it is corresponding.
In environment and traffic management applications, the system constructs virtual scene element using data visualization mode, such as
Air quality icon, parking offense mark, parking stall residue mark etc., and these elements are merged in whole city model.
Real scene variation is reflected in virtual scene, adds simultaneously by the real-time passback of the system combination biosensor analysis data
Real-time syncretization information, is checked and the design of decision and novel interactive application for user.The system is in city management service
Under scene, it is mainly directed towards above-mentioned infrastructure management and Environmental Communication management service.The system is established by same method
Virtual garden model, and then garden management service system is made, it is mainly directed towards intelligent parking, navigation and guide service.The system
System establishes the dummy model of community by same method, and then makes community management service system, is mainly directed towards intelligent monitoring
With key population Scout service.The tourist attractions virtual scene that real-time update is made by same method, is mainly directed towards
State updates, destination path is planned and mixed reality application.
Fig. 3 is that a kind of real-time mixed reality urban service of on-line off-line fusion of the embodiment of the present invention realizes that system is
System functional schematic.
As shown in figure 3, the data acquisition and procession based on city sensing network, the present invention is towards urban infrastructure, ring
Border traffic, garden, community, scenic spot, it will thus provide different application services.
Specifically, the application service that the application service layer provides includes urban infrastructure, Environmental Communication management and garden
At least one of area, community, scenic spot management service.
Wherein, described towards urban infrastructure, Environmental Communication management service, it is implemented as follows: by front end sensing layer
The service of being reflected in the infrastructure data stream real-time synchronization of acquisition is provided in the Scene of Virtual City of layer building, assigns point for it
It hits, check and tactical management service；The Surroundings in Cities, transport data stream are shown in the void with effect of shadow or highlight effect
In quasi- City scenarios, and interactive operation entrance is provided for user, the state generated according to the interactive operation of user changes to reality
Scene generates synchronously control instruction, so that reality scene generates corresponding state and changes.
In practical applications, in the management for urban infrastructure, manager, can be virtual by service platform
City model in the case where more accurately understanding each block in city, rather than face various many and diverse data, virtual scene
In information display format it is unrestricted, be more convenient observation and decision.
For example, the street lamp in the reality obtained by city sensing network is opened and closed, electric system loading condition, refuse collection
The information such as situation, the health condition of fixation means are formed by Urban Data stream, can be reflected in virtual scene to real-time synchronization
In, entire virtual scene has more than the intuitive bandwagon effect of reality scene experience to information flow in dynamic change.Virtual scene
In urban infrastructure, it can be achieved that street lamp dynamic switch after the information that reception state changes, electric system carry digital is aobvious
Show, each fixation means status information is shown, is clicked, checked and operated for manager in the form of number or icon.Manager can
Street lamp, setting switch and maintenance strategy are clicked, electric system mark is clicked and carries out managing power consumption, click dustbin, configuration and hair
Cloth clears instruction etc..
Towards urban environment, the system is analyzed certainly by the data to video or the acquisition of environmental information sensor
Plan judges the environmental aspect of each tiny area in city, converts visualization effect of shadow and additional admission for regional environment data
Jing Zhong, user can check the environmental problem of each tiny area in city at any time, can click pollution position and carry out suggestion feedback, management
Person can click pollution position check Sources as a result, control information while formulate countermeasure in time.
Towards urban traffic control, the system can the traffic monitoring image information to city analyze, city is each
The trip traffic conditions such as the pedestrian in section and vehicle count, and are identified in virtual scene.It can be shown in virtual scene
Show each section flow of the people, vehicle flowrate, situation violating the regulations can be highlighted in the scene and marked.Supervision department can click each section in real time,
It checks section congestion reason, historical traffic statistics and real scene video, and the active operations such as monitoring device visual angle can be adjusted,
It can obtain synchronous execution in virtual scene in reality to the operation of monitoring device.
Wherein, the management service towards garden, is implemented as follows: the garden parking stall that front end sensing layer is obtained
Information service provide layer building Scene of Virtual City in highlight show, user by interactive operation carry out parking stall make a reservation for or from
Line AR navigation, so that manager carries out parking stall behaviour in service statistics and configuration management strategy.
In practical applications, virtual garden scene can be established by the same manner, and design management service and interaction are answered
With.For example, being labeled first in virtual scene to all real parking stalls, for parking and navigation aspect by sensing terminal
Vacant parking stall is highlighted in virtual scene and is shown by the parking stall occupied information acquired in real time.User can be accessed with mobile device
Virtual scene, it is intuitive to observe garden parking stall service condition, reservation operation is carried out by clicking vacant parking stall, service system, which combines, to be passed
Feel network, offline AR navigation in real time can be provided for user, it is helped to reach parking stall；Manager can observe parking stall in virtual scene
Overall service condition and statistical information, to arrange parking management strategy.
Wherein, the management service of the Community-oriented, is implemented as follows: crowd behaviour that front end sensing layer is obtained with
Exception information is highlighted in the Scene of Virtual City that service provides layer building, and carries out suspect's locking and interlink warning；
The corresponding location information real-time exhibition of crowd behaviour is carried out track preservation and notify correlation to the abnormal user for leaving community
Guardian.
In practical applications, virtual community scene can be established by the same manner, and design management service and interaction are answered
With.For example, under intelligent monitoring service scenarios, real monitoring camera is obtained by computer vision algorithms make crowd's image into
Row behavioural analysis and abnormality detection, by abnormal conditions information Real-time Feedback to service system, after service system receives information, in void
Suspicion personnel are locked in quasi- scene, are highlighted linkage alarm；Under key population Scout service scene, to community
Key population (such as old man, child) is equipped with positioning terminal, acquires its location information, and the real-time display in virtual system in real time,
To the abnormal user for leaving community area, system retains activity trajectory and photo automatically, and notifies related guardian.
Wherein, the management service towards scenic spot, is implemented as follows: the scenic spot stream of people that front end sensing layer is acquired,
Environment, location information are implemented to show in the Scene of Virtual City that service provides layer building, and assign dynamic AR/VR effect for it
Fruit so that onsite user is by scanning scenic spot physical object, under dynamic AR scene observed information, service consultation and lead
Boat, remote user access dynamic VR scene realize that scene is strolled and corresponding high-immersion is gone sight-seeing in real time.
In practical applications, virtual scenic spot scene can be established by the same manner, and design management service and interaction are answered
With.For example, by the stream of people at scenic spot, environmental quality, personnel positioning, dashing forward by the magnanimity Internet of Things sensor network for being laid in scenic spot
The information such as hair event are sent to service platform in real time, show in virtual scene for service platform, show in dynamic AR(reality
Fusion is virtual) and dynamic VR(it is virtual in fusion reality) modes of two kinds of application combinations realizes；Dynamic AR refers to mobile device
Scan the entity at scenic spot, such as scan tourist map, can the flows of the people of each important scenes of reality, environmental quality can be real after clicking place
Now according to the active path planning of scenic spot flow of the people and offline navigation, auxiliary tourist is efficiently visited；Scenic spot building is scanned, can be shown
Building is introduced, and the interaction of the forms such as voice, text or click can be carried out with wherein attendant；Dynamic VR refers to towards long-range
The user for accessing scenic spot, by the real-time update of scenic spot high amount of traffic, by the flow of personnel in VR scene, weather, flowers, plants and trees
Upgrowth situation etc. is corresponding in real time with reality scene, and user can freely stroll in the scene, has height feeling of immersion for its presentation
Dynamic go sight-seeing experience.
Fig. 4 is that the real-time mixed reality urban service of on-line off-line fusion realizes that one of system more specifically mixes now
Real application service example, towards visitor's guiding in real time application under garden management service scene.Garden visitor's described herein has
Effect route guiding service has important practical significance, and Most current garden building is more, and guideboard, building number etc. guide facility to set
Meter is extremely not perfect, and the strange visitor of garden is caused to be difficult to find destination, causes work efficiency low and experiences poor.
Under system of the present invention, visitor, which reaches garden, can experience a variety of convenient friendships after installation garden services APP
Mutually service.
As shown in figure 4, have in garden largely can the various marks such as scan element, including guideboard, company logo, street lamp,
Scene (the dynamic AR effect of new dimension can be all unfolded in the entities such as parking lot, convenience store on mobile phone screen after scanning by APP
Fruit), while the interactive button that relevant information is presented and can click.It such as scans logo and shows that company's details, scanning building are aobvious
Show building title, the function services that can be clicked etc..
For visitor's guide service, user scans garden map by APP, the virtual garden scene of dynamic AR can be presented,
On the basis of observing garden Global Information and itself present position, button can be clicked directly on and interviewee establishes access relation；
Then, since visitor enters garden, system can determine visitor by the interconnection of garden sensing network and user terminal immediately
Position, while visitor and interviewee can be highlighted in virtual scene, intuitively understand for two parties and be presently in position, visits
Visitor can click directly on the navigation button, carry out route guiding using the offline AR navigation in garden, the seamless rank of indoor and outdoor is supported in navigation
It connects.Both sides also support the interactions such as real-time voice call, text or button in AR scene, to realize that quickly guidance visitor reaches
Destination.
The real-time mixed reality urban service realization method and system of on-line off-line fusion provided in an embodiment of the present invention, energy
It enough realizes the urban service system of virtual reality fusion, on-line off-line fusion, more accurate in virtual city model can understand
The case where each block in city, rather than various many and diverse data are faced, the information display format in virtual scene is unrestricted,
More convenient observation and decision, General Promotion user experience, service quality and interactivity.
In addition, it is stored thereon with computer program the embodiment of the invention also provides a kind of computer readable storage medium,
The real-time mixed reality urban service implementation method of on-line off-line fusion as described above is realized when the program is executed by processor
Function.
In the present embodiment, the real-time mixed reality urban service of the on-line off-line fusion realize the module of the system integration/
If unit is realized in the form of SFU software functional unit and when sold or used as an independent product, it can store and counted at one
In calculation machine read/write memory medium.Based on this understanding, the present invention realizes all or part of stream in above-described embodiment method
Journey can also instruct relevant hardware to complete by computer program, and the computer program can be stored in a calculating
In machine readable storage medium storing program for executing, the computer program is when being executed by processor, it can be achieved that the step of above-mentioned each embodiment of the method.
Wherein, the computer program includes computer program code, and the computer program code can be source code form, object
Code form, executable file or certain intermediate forms etc..The computer-readable medium may include: that can carry the meter
Any entity or device of calculation machine program code, recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, only
Read memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electricity load
Wave signal, telecommunication signal and software distribution medium etc..It should be noted that the content that the computer-readable medium includes can
To carry out increase and decrease appropriate according to the requirement made laws in jurisdiction with patent practice, such as in certain jurisdictions, root
It does not include electric carrier signal and telecommunication signal according to legislation and patent practice, computer-readable medium.
It will be appreciated by those of skill in the art that although some embodiments in this include included in other embodiments
Certain features rather than other feature, but the combination of the feature of different embodiments means to be within the scope of the present invention simultaneously
And form different embodiments.For example, in the following claims, the one of any of embodiment claimed all may be used
Come in a manner of in any combination using.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (12)
1. a kind of real-time mixed reality urban service implementation method of on-line off-line fusion characterized by comprising
The urban information acquired in real time by the city sensing network that all things on earth interconnects is obtained and analyzed, city high amount of traffic is formed；
Scene of Virtual City completely corresponding with real City scenarios is established, the urban information high amount of traffic that will acquire is in institute
It states and is matched and shown in Scene of Virtual City, while realizing that the mixing of virtual scene data and real data two-way fusion is existing
Actual effect fruit, with building and the accurate corresponding dynamic virtual City scenarios of reality scene；
Mode and urban service application build are interacted based on the dynamic virtual City scenarios.
2. the method according to claim 1, wherein the city high amount of traffic includes continually changing environment letter
Breath, power system information, target object location information, infrastructure and smart machine status information or use householder at management unit
The dynamic information uploaded, image information and the target information obtained by image analysis, abnormal behaviour information, parking stall and letter violating the regulations
Breath.
3. the method according to claim 1, wherein described obtain and analyze the city sensing interconnected by all things on earth
The urban information that network acquires in real time includes:
The data of the city sensing network interconnected by all things on earth acquisition are subjected to the number based on distributed edge computing architecture at end
Data preprocess；
Pretreated data are carried out to summarize upload server end, carry out centralized processing in server end.
4. according to the method described in claim 3, it is characterized in that, described acquire the city sensing network interconnected by all things on earth
Data carry out the data prediction based on distributed edge computing architecture in terminal side, comprising:
Cleaning and basic correlation analysis are carried out to the data of digital information, lightweight calculating support is based on to the data of image information
The marginal end target detection of structure, behavioural analysis；
It is described to carry out centralized processing in server end, comprising:
Multisource data fusion is carried out to digital information and overall relevancy is analyzed, image information answered based on testing result
With design, and obtained overall data is optimized by machine learning algorithm model, forms structuring city big data.
5. the method according to claim 1, wherein the foundation is completely corresponding virtual with real City scenarios
City scenarios, the urban information high amount of traffic that will acquire are matched and are shown in the Scene of Virtual City, simultaneously
Realize the mixed reality effect of virtual scene data and real data two-way fusion, comprising:
Using the position Scene of Virtual City corresponding with state of scene reconstruction technology foundation and reality scene, and described virtual
Scene simulation dynamic effect is configured in City scenarios；
According to the corresponding relationship of the position of reality scene and state in Scene of Virtual City, the urban information that will be will acquire
Big data and Scene of Virtual City real time fusion, so that the real movable state of perception data is reflected in virtual scene；
Synchronous feedback can be obtained in reality scene to the operation of object in virtual scene or element, realize that fusion is existing in virtual
Virtual mixed reality effect is merged in real, reality.
6. the method according to claim 1, wherein it includes city base that the interactive mode and urban service, which are applied,
Infrastructure, Environmental Communication management and garden, community, scenic spot management service.
7. a kind of real-time mixed reality urban service of on-line off-line fusion realizes system, which is characterized in that perceived including front end
Layer, Web communication layer, cloud computing platform layer, data analysis layer, service provide layer and management backstage；
Front end sensing layer sets up all things on earth and interconnects sensing network, for each using the city intelligent terminal of integrated multiple sensors
Kind urban information is perceived and is acquired, and realizes Street lamps control and positioning；
Web communication layer is built by a kind of at least following access networking technology, the novel multi-hop communication of link layer, all things on earth is interconnected
Sensing network, cellular network, local area network, Bluetooth form urban network communication；
Cloud computing platform layer, using distributed edge computing architecture, according to the UE to UE communication ability of intelligent terminal and independently
Data operation ability is interacted and is pre-processed at end to the data of front end sensing layer acquisition；
Data analysis layer, for machine vision algorithm and data anastomosing algorithm based on deep learning, to the image and biography of acquisition
Sense data are analyzed；
Service provides layer, by establishing Scene of Virtual City corresponding with reality scene, transmits by data analysis with information,
To the transformation of reality scene in Scene of Virtual City synchronized update, and be that community and resident mention by cloud platform and APP software
For various application services；
Management backstage realizes the virtually interaction with real Bidirectional flow of information for being monitored, managing and maintaining to whole system
With control.
8. system according to claim 7, which is characterized in that the application service that the application service layer provides includes city
At least one of infrastructure, Environmental Communication management and garden, community, scenic spot management service.
9. system according to claim 8, which is characterized in that described to be taken towards urban infrastructure, Environmental Communication management
Business, is implemented as follows:
By infrastructure data stream real-time synchronization that front end sensing layer obtains the service of being reflected in provides the virtual city of layer building
In scene, is assigned for it and click, check and tactical management service；By The Surroundings in Cities, transport data stream with effect of shadow or height
Bright effect is shown in the Scene of Virtual City, and provides interactive operation entrance for user, is produced according to the interactive operation of user
Raw state, which changes, generates synchronously control instruction to reality scene, so that reality scene generates corresponding state and changes.
10. system according to claim 8, which is characterized in that the management service towards garden, specific implementation is such as
Under:
The garden parking space information that front end sensing layer is obtained is highlighted in the Scene of Virtual City that service provides layer building and is shown,
User carries out the predetermined or offline AR in parking stall by interactive operation and navigates, so that manager carries out parking stall behaviour in service statistics and configures
Management strategy.
11. system according to claim 8, which is characterized in that the management service of the Community-oriented, specific implementation is such as
Under:
The crowd behaviour that front end sensing layer is obtained and exception information highlight in the Scene of Virtual City that service provides layer building
It has been shown that, and carry out suspect's locking and interlink warning；By the corresponding location information real-time exhibition of crowd behaviour, society is left to abnormal
The user in area carries out track preservation and notifies related guardian.
12. system according to claim 8, which is characterized in that the management service towards scenic spot, specific implementation is such as
Under:
The scenic spot stream of people that front end sensing layer is acquired, environment, location information are in the Scene of Virtual City that service provides layer building
Implement to show, and assign dynamic AR/VR effect for it, so that onsite user passes through scanning scenic spot physical object, at dynamic AR
Observed information under scape carries out service consultation and navigation, remote user access dynamic VR scene, realizes that scene is strolled and right in real time
The high-immersion visit answered.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810586132.5A CN109067822A (en) | 2018-06-08 | 2018-06-08 | The real-time mixed reality urban service realization method and system of on-line off-line fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810586132.5A CN109067822A (en) | 2018-06-08 | 2018-06-08 | The real-time mixed reality urban service realization method and system of on-line off-line fusion |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109067822A true CN109067822A (en) | 2018-12-21 |
Family
ID=64819981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810586132.5A Pending CN109067822A (en) | 2018-06-08 | 2018-06-08 | The real-time mixed reality urban service realization method and system of on-line off-line fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109067822A (en) |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109800503A (en) * | 2019-01-18 | 2019-05-24 | 上海湃睿信息科技有限公司 | A kind of scenario simulation method, apparatus, equipment and medium |
| CN110415420A (en) * | 2019-08-22 | 2019-11-05 | 广东鉴面智能科技有限公司 | A kind of visitor's intelligent management system and its management method based on recognition of face |
| CN110515577A (en) * | 2019-08-23 | 2019-11-29 | 上海理工大学 | A kind of interactive intelligence collaboration display system based on Urban Data |
| CN110766322A (en) * | 2019-10-23 | 2020-02-07 | 四川创客知佳科技有限公司 | Big data-based VR (virtual reality) tourism product evaluation method |
| CN110853397A (en) * | 2019-09-06 | 2020-02-28 | 广东智信信息科技股份有限公司 | Wisdom parking ability supports and commander cloud platform |
| CN111599157A (en) * | 2020-06-04 | 2020-08-28 | 云南电网有限责任公司电力科学研究院 | Smart city intelligent terminal application system |
| CN111599222A (en) * | 2020-06-11 | 2020-08-28 | 浙江商汤科技开发有限公司 | Sand table display method and device |
| CN111815785A (en) * | 2020-06-30 | 2020-10-23 | 北京市商汤科技开发有限公司 | Method and device for presenting reality model, electronic equipment and storage medium |
| CN111882675A (en) * | 2020-07-31 | 2020-11-03 | 北京市商汤科技开发有限公司 | Model presentation method and device, electronic equipment and computer storage medium |
| CN111939560A (en) * | 2020-08-05 | 2020-11-17 | 广东技术师范大学 | Method and device for improving health of old people based on 5G signal transmission technology |
| CN112037503A (en) * | 2020-08-31 | 2020-12-04 | 安徽海螺集团有限责任公司 | Mine intelligent scheduling system |
| CN112097757A (en) * | 2019-06-17 | 2020-12-18 | 上海宝谊图片有限公司 | Enterprise visitor navigation system |
| CN112379770A (en) * | 2020-09-16 | 2021-02-19 | 江苏第二师范学院（江苏省教育科学研究院） | Can provide natural experience's wisdom tourism system |
| CN112417069A (en) * | 2020-10-29 | 2021-02-26 | 武汉哈船导航技术有限公司 | Simulation high-precision map system |
| CN112434789A (en) * | 2020-11-06 | 2021-03-02 | 中山大学 | Distributed neural network model partitioning method for edge video analysis |
| CN112770087A (en) * | 2020-12-25 | 2021-05-07 | 山东爱城市网信息技术有限公司 | AR technology community 3D large-screen interaction method |
| CN113036915A (en) * | 2021-03-04 | 2021-06-25 | 国网福建省电力有限公司厦门供电公司 | Intelligent gateway-based remote monitoring and control method for park power supply and utilization equipment |
| CN113191841A (en) * | 2021-04-28 | 2021-07-30 | 张鹏 | Scientific and technological innovation and culture sharing intelligent platform mode method based on augmented reality technology |
| CN113395300A (en) * | 2020-03-11 | 2021-09-14 | 成都秦川物联网科技股份有限公司 | Intelligent city off-network operation method and system |
| CN113435833A (en) * | 2021-06-11 | 2021-09-24 | 泰瑞数创科技(北京)有限公司 | City three-dimensional model collaborative management method and system for smart community |
| CN113537790A (en) * | 2021-07-21 | 2021-10-22 | 四川通普科技有限公司 | Super-fusion management platform |
| CN113971047A (en) * | 2021-10-22 | 2022-01-25 | 中国联合网络通信集团有限公司 | Construction method, application method, computer equipment and medium of hierarchical parallel system |
| CN114020978A (en) * | 2021-09-28 | 2022-02-08 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN117409374A (en) * | 2023-12-14 | 2024-01-16 | 深圳富联富桂精密工业有限公司 | Gate sentry management method, device, electronic equipment and computer readable storage medium |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1624704A (en) * | 2004-12-02 | 2005-06-08 | 高永安 | Construction method of virtual world imitating analogue real world in network game software |
| US20050128212A1 (en) * | 2003-03-06 | 2005-06-16 | Edecker Ada M. | System and method for minimizing the amount of data necessary to create a virtual three-dimensional environment |
| CN1987857A (en) * | 2006-12-18 | 2007-06-27 | 于慧 | Method for realizing digital city system using virtual artificial comprehensive image and text information interaction |
| CN101110829A (en) * | 2007-08-24 | 2008-01-23 | 张建中 | Method, device and system for multidimensional address data analysis |
| CN101114385A (en) * | 2007-08-07 | 2008-01-30 | 深圳先进技术研究院 | Digital city full-automatic generating method |
| CN101174332A (en) * | 2007-10-29 | 2008-05-07 | 张建中 | Method, device and system for interactively combining real-time scene in real world with virtual reality scene |
| CN101763605A (en) * | 2010-01-28 | 2010-06-30 | 成都东哈科技有限公司 | Three-dimensional digital urban fire protection pre-control and management system |
| US20140201126A1 (en) * | 2012-09-15 | 2014-07-17 | Lotfi A. Zadeh | Methods and Systems for Applications for Z-numbers |
| CN104123664A (en) * | 2014-08-04 | 2014-10-29 | 中网一号电子商务有限公司 | Correlation method of 3D (three-dimensional) virtual world and real city |
| CN105872075A (en) * | 2016-05-06 | 2016-08-17 | 东莞中科智城软件有限公司 | Method of mapping Internet of Things equipment to smart city resource model |
| CN105938613A (en) * | 2016-06-27 | 2016-09-14 | 锐创（唐山）生态建筑科技有限公司 | BIM (building information modeling) and VR (virtual reality)-based smart city pipeline network integrated platform, management method thereof and construction method |
| US20160335981A1 (en) * | 2015-05-12 | 2016-11-17 | Samsung Electronics Co., Ltd. | Remote control method and device using wearable device |
| CN206021354U (en) * | 2016-06-27 | 2017-03-15 | 锐创（唐山）生态建筑科技有限公司 | One kind is based on BIM and VR smart cities pipeline coordination platform |
| CN108090574A (en) * | 2018-01-05 | 2018-05-29 | 中邮建技术有限公司 | A kind of smart city Information Management System based on augmented reality |
| US20180150387A1 (en) * | 2015-05-31 | 2018-05-31 | Entit Software Llc | Testing applications using virtual reality |
| US20180374080A1 (en) * | 2017-06-22 | 2018-12-27 | Beijing Xiaomi Mobile Software Co., Ltd. | Public transit payment device |
-
2018
- 2018-06-08 CN CN201810586132.5A patent/CN109067822A/en active Pending
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050128212A1 (en) * | 2003-03-06 | 2005-06-16 | Edecker Ada M. | System and method for minimizing the amount of data necessary to create a virtual three-dimensional environment |
| CN1624704A (en) * | 2004-12-02 | 2005-06-08 | 高永安 | Construction method of virtual world imitating analogue real world in network game software |
| CN1987857A (en) * | 2006-12-18 | 2007-06-27 | 于慧 | Method for realizing digital city system using virtual artificial comprehensive image and text information interaction |
| CN101114385A (en) * | 2007-08-07 | 2008-01-30 | 深圳先进技术研究院 | Digital city full-automatic generating method |
| CN101110829A (en) * | 2007-08-24 | 2008-01-23 | 张建中 | Method, device and system for multidimensional address data analysis |
| CN101174332A (en) * | 2007-10-29 | 2008-05-07 | 张建中 | Method, device and system for interactively combining real-time scene in real world with virtual reality scene |
| CN101763605A (en) * | 2010-01-28 | 2010-06-30 | 成都东哈科技有限公司 | Three-dimensional digital urban fire protection pre-control and management system |
| US20140201126A1 (en) * | 2012-09-15 | 2014-07-17 | Lotfi A. Zadeh | Methods and Systems for Applications for Z-numbers |
| CN104123664A (en) * | 2014-08-04 | 2014-10-29 | 中网一号电子商务有限公司 | Correlation method of 3D (three-dimensional) virtual world and real city |
| US20160335981A1 (en) * | 2015-05-12 | 2016-11-17 | Samsung Electronics Co., Ltd. | Remote control method and device using wearable device |
| US20180150387A1 (en) * | 2015-05-31 | 2018-05-31 | Entit Software Llc | Testing applications using virtual reality |
| CN105872075A (en) * | 2016-05-06 | 2016-08-17 | 东莞中科智城软件有限公司 | Method of mapping Internet of Things equipment to smart city resource model |
| CN105938613A (en) * | 2016-06-27 | 2016-09-14 | 锐创（唐山）生态建筑科技有限公司 | BIM (building information modeling) and VR (virtual reality)-based smart city pipeline network integrated platform, management method thereof and construction method |
| CN206021354U (en) * | 2016-06-27 | 2017-03-15 | 锐创（唐山）生态建筑科技有限公司 | One kind is based on BIM and VR smart cities pipeline coordination platform |
| US20180374080A1 (en) * | 2017-06-22 | 2018-12-27 | Beijing Xiaomi Mobile Software Co., Ltd. | Public transit payment device |
| CN108090574A (en) * | 2018-01-05 | 2018-05-29 | 中邮建技术有限公司 | A kind of smart city Information Management System based on augmented reality |
Non-Patent Citations (2)
| Title |
|---|
| SIMO HOSIO等: ""situated engagement and virtual services in a smart city"", 《2014 IEEE 7TH INTERNATIONAL CONFERENCE ON SERVICE-ORIENTED COMPUTING AND APPLICATIONS》 * |
| 郭启幼: ""三维虚拟城市景观服务平台建设策略"", 《地理空间信息》 * |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109800503A (en) * | 2019-01-18 | 2019-05-24 | 上海湃睿信息科技有限公司 | A kind of scenario simulation method, apparatus, equipment and medium |
| CN112097757A (en) * | 2019-06-17 | 2020-12-18 | 上海宝谊图片有限公司 | Enterprise visitor navigation system |
| CN110415420A (en) * | 2019-08-22 | 2019-11-05 | 广东鉴面智能科技有限公司 | A kind of visitor's intelligent management system and its management method based on recognition of face |
| CN110515577B (en) * | 2019-08-23 | 2023-07-25 | 上海理工大学 | Interactive intelligent collaborative display system based on city data |
| CN110515577A (en) * | 2019-08-23 | 2019-11-29 | 上海理工大学 | A kind of interactive intelligence collaboration display system based on Urban Data |
| CN110853397A (en) * | 2019-09-06 | 2020-02-28 | 广东智信信息科技股份有限公司 | Wisdom parking ability supports and commander cloud platform |
| CN110766322A (en) * | 2019-10-23 | 2020-02-07 | 四川创客知佳科技有限公司 | Big data-based VR (virtual reality) tourism product evaluation method |
| CN113395300B (en) * | 2020-03-11 | 2023-02-10 | 成都秦川物联网科技股份有限公司 | Outside-network operation method and system for smart city |
| CN113395300A (en) * | 2020-03-11 | 2021-09-14 | 成都秦川物联网科技股份有限公司 | Intelligent city off-network operation method and system |
| CN111599157A (en) * | 2020-06-04 | 2020-08-28 | 云南电网有限责任公司电力科学研究院 | Smart city intelligent terminal application system |
| CN111599222A (en) * | 2020-06-11 | 2020-08-28 | 浙江商汤科技开发有限公司 | Sand table display method and device |
| CN111599222B (en) * | 2020-06-11 | 2022-07-22 | 浙江商汤科技开发有限公司 | Sand table display method and device |
| CN111815785A (en) * | 2020-06-30 | 2020-10-23 | 北京市商汤科技开发有限公司 | Method and device for presenting reality model, electronic equipment and storage medium |
| CN111882675A (en) * | 2020-07-31 | 2020-11-03 | 北京市商汤科技开发有限公司 | Model presentation method and device, electronic equipment and computer storage medium |
| CN111939560B (en) * | 2020-08-05 | 2021-05-07 | 广东技术师范大学 | Method and device for improving health of old people based on 5G signal transmission technology |
| CN111939560A (en) * | 2020-08-05 | 2020-11-17 | 广东技术师范大学 | Method and device for improving health of old people based on 5G signal transmission technology |
| CN112037503B (en) * | 2020-08-31 | 2021-08-17 | 安徽海螺集团有限责任公司 | Mine intelligent scheduling system |
| CN112037503A (en) * | 2020-08-31 | 2020-12-04 | 安徽海螺集团有限责任公司 | Mine intelligent scheduling system |
| CN112379770A (en) * | 2020-09-16 | 2021-02-19 | 江苏第二师范学院（江苏省教育科学研究院） | Can provide natural experience's wisdom tourism system |
| CN112417069A (en) * | 2020-10-29 | 2021-02-26 | 武汉哈船导航技术有限公司 | Simulation high-precision map system |
| CN112434789A (en) * | 2020-11-06 | 2021-03-02 | 中山大学 | Distributed neural network model partitioning method for edge video analysis |
| CN112434789B (en) * | 2020-11-06 | 2023-07-07 | 中山大学 | Distributed neural network model partitioning method for edge video analysis |
| CN112770087A (en) * | 2020-12-25 | 2021-05-07 | 山东爱城市网信息技术有限公司 | AR technology community 3D large-screen interaction method |
| CN113036915B (en) * | 2021-03-04 | 2024-02-27 | 国网福建省电力有限公司厦门供电公司 | Intelligent gateway-based park power supply equipment remote monitoring and control method |
| CN113036915A (en) * | 2021-03-04 | 2021-06-25 | 国网福建省电力有限公司厦门供电公司 | Intelligent gateway-based remote monitoring and control method for park power supply and utilization equipment |
| CN113191841B (en) * | 2021-04-28 | 2024-06-14 | 张鹏 | Scientific and technological innovation and culture sharing intelligent platform based on augmented reality technology |
| CN113191841A (en) * | 2021-04-28 | 2021-07-30 | 张鹏 | Scientific and technological innovation and culture sharing intelligent platform mode method based on augmented reality technology |
| CN113435833A (en) * | 2021-06-11 | 2021-09-24 | 泰瑞数创科技(北京)有限公司 | City three-dimensional model collaborative management method and system for smart community |
| CN113537790A (en) * | 2021-07-21 | 2021-10-22 | 四川通普科技有限公司 | Super-fusion management platform |
| CN114020978A (en) * | 2021-09-28 | 2022-02-08 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN114020978B (en) * | 2021-09-28 | 2024-06-11 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN113971047A (en) * | 2021-10-22 | 2022-01-25 | 中国联合网络通信集团有限公司 | Construction method, application method, computer equipment and medium of hierarchical parallel system |
| CN113971047B (en) * | 2021-10-22 | 2023-06-23 | 中国联合网络通信集团有限公司 | Hierarchical parallel system construction method, application method, computer equipment and medium |
| CN117409374A (en) * | 2023-12-14 | 2024-01-16 | 深圳富联富桂精密工业有限公司 | Gate sentry management method, device, electronic equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109067822A (en) | The real-time mixed reality urban service realization method and system of on-line off-line fusion | |
| Kumar et al. | Moving towards smart cities: Solutions that lead to the Smart City Transformation Framework | |
| Wu et al. | Digital twins and artificial intelligence in transportation infrastructure: Classification, application, and future research directions | |
| CN106056517A (en) | Smart city management system | |
| McNeill | IBM and the visual formation of smart cities | |
| Doran et al. | Geomatics and Smart City: A transversal contribution to the Smart City development | |
| Meta et al. | The camp nou stadium as a testbed for city physiology: a modular framework for urban digital twins | |
| Marsal-Llacuna | How to succeed in implementing (smart) sustainable urban Agendas:“keep cities smart, make communities intelligent” | |
| Sharma | Evolution in smart city infrastructure with IOT potential applications | |
| Sabri et al. | A multi-dimensional analytics platform to support planning and design for liveable and sustainable urban environment | |
| KR102377652B1 (en) | Pedestrian traffic information providing system and method using controlled traffic signal informationttg | |
| CN116805444A (en) | Distributed named navigation pedestrian driving early warning method, system and device | |
| Yang et al. | [Retracted] Measures and Suggestions for Smart Community Development Based on Urban Renewal | |
| Jiang et al. | Status quo and challenges and future development of fire emergency evacuation research and application in built environment | |
| De Falco et al. | Optimizing personalized touristic itineraries by a multiobjective evolutionary algorithm | |
| Cugurullo et al. | Smart cities | |
| Liu | Landscape Architecture Design and Implementation Based on Intelligent Monitoring Sensing Network | |
| Lynn et al. | Smart streets: Definition, principles, and infrastructural elements | |
| Avezbaev et al. | Implementation of GIS-based Smart Community Information System and concepts of Digital Twin in the field of urban planning in Uzbekistan | |
| Bakaraniya et al. | 5G Enabled Smart City Using Cloud Environment | |
| Spirito et al. | Internet of Things application scenarios, pilots and innovation | |
| Papageorgiou et al. | A big data approach to developing a smart pedestrian network (SPN) system | |
| Lee et al. | An Edge-Enabled IoT Framework for Metaverse in Smart City | |
| Shahraki et al. | A review on the effects of IoT and smart cities technologies on urbanism | |
| Wang et al. | System design and data governance for environmental disaster management in smart scenic-a case study of Huangshan mountain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200210 Address after: Room 264, Building 3, No. 135 Guowei Road, Yangpu District, Shanghai, 2008 Applicant after: SHANGHAI JUYUAN COMMUNICATION TECHNOLOGY CO.,LTD. Address before: 519000 Creative Valley, 1889 Huandao East Road, Hengqin New District, Zhuhai City, Guangdong Province, 18, 110-163 (Centralized Office District) Applicant before: ZHUHAI OMESH COMMUNICATION TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181221 |
|
| RJ01 | Rejection of invention patent application after publication |