CN102915669A - Method and device for manufacturing live-action map - Google Patents

Method and device for manufacturing live-action map Download PDF

Info

Publication number
CN102915669A
CN102915669A CN2012103950011A CN201210395001A CN102915669A CN 102915669 A CN102915669 A CN 102915669A CN 2012103950011 A CN2012103950011 A CN 2012103950011A CN 201210395001 A CN201210395001 A CN 201210395001A CN 102915669 A CN102915669 A CN 102915669A
Authority
CN
China
Prior art keywords
outdoor scene
scene map
destination object
video image
full
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012103950011A
Other languages
Chinese (zh)
Inventor
张丽晓
尚浩强
唐磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN2012103950011A priority Critical patent/CN102915669A/en
Publication of CN102915669A publication Critical patent/CN102915669A/en
Priority to PCT/CN2013/077112 priority patent/WO2013170797A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • G06F16/444Spatial browsing, e.g. 2D maps, 3D or virtual spaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/32Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B29/00Maps; Plans; Charts; Diagrams, e.g. route diagram
    • G09B29/003Maps
    • G09B29/005Map projections or methods associated specifically therewith
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/32Indexing scheme for image data processing or generation, in general involving image mosaicing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Databases & Information Systems (AREA)
  • Remote Sensing (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Instructional Devices (AREA)

Abstract

The invention relates to a method and a device for manufacturing a live-action map. The method comprises the following steps: acquiring a plurality of video images acquired by a plurality of cameras; synthetizing and processing the plurality of video images to form a full-view video image; identifying a target object in the full-view video image and geographic information of the target object; marking the target object to acquire the marked target object; renewedly mapping the marked target object to the full-view video image; and performing map drawing processing on the full-view video image according to the geographic information of the target object and generating the live-action map. The method and the device have the beneficial effects that real-time manufacturing of the live-action map can be realized by a user, and a traditional mode that the live-action map needs to be manufactured by a special team and the user can use the map by only payment or internet is broken through; and by adopting the live-action map manufactured by the method and the device, the live-action map can be used free, and the dependence of internet loading on signals and geographical conditions can also be avoided.

Description

A kind of method for making of outdoor scene map and device
Technical field
The present invention relates to image processing, virtual reality field, relate to more specifically a kind of method for making and device of outdoor scene map.
Background technology
Map is requisite life instrument in people's life and work, along with the prosperity of traffic and the development of tourist industry, experiences in order to obtain better map, and increasing people selects to use the outdoor scene map.The outdoor scene map is a kind of very interesting map roam mode, people can roam on the virtual avenue with 360 degree visual angles, view and admire the street corner scene. the virtual reality that the superior position enquiring ability that electronic chart is had and panorama provide is experienced and is combined, and very large facility is provided will for the usual life of people, trip etc.
Present outdoor scene map mainly is to rely on satellite map, as: google streetscape map, perhaps some professional website team make, as: city etc., general this map all needs to pay or internet services, and map all is to make early stage, geography information that can only display standard, the operations such as the user can not make amendment to it, mark, these problems have all caused inconvenience to user's use.
Summary of the invention
In order to solve the problems of the technologies described above, the invention provides a kind of method for making and device of outdoor scene map, break through in the past the outdoor scene map and need to rely on professional team to make, the user can only pay or the pattern of its map of networking.
In order to achieve the above object, the technical solution used in the present invention is: a kind of method for making of outdoor scene map may further comprise the steps:
Obtain a plurality of video images of a plurality of camera collections;
Described a plurality of video images are synthesized processing form full-view video image;
Identify destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
Destination object behind the described mark is remapped in the described full-view video image;
According to the geography information of described destination object, described full-view video image is carried out mapping process, generate the outdoor scene map.
Further, described a plurality of video images being synthesized the step of processing the formation full-view video image comprises:
Described a plurality of video images are carried out audio video synchronization;
Described a plurality of video images that will carry out after the audio video synchronization splice the generating panoramic video image in real time.
Further,
Described a plurality of video image is through the video image after the anti-shake processing.
Further, further comprising the steps of:
Preservation also shows described outdoor scene map.
Further, described destination object is marked processing, the step of the destination object after obtaining marking comprises:
Attribute according to described geography information uses different marks that described destination object is carried out classification annotation.
Further, the step that the destination object behind the described mark is remapped in the described full-view video image comprises:
Take described full-view video image as the basis, in conjunction with described geography information, described geography information is mapped on the described full-view video image in real time.
Further, according to the geography information of described destination object, described full-view video image is carried out mapping process, the step that generates the outdoor scene map comprises:
Described destination object and GPS latitude and longitude information are mated;
Mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
Further, mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, and the step that generates the outdoor scene map comprises:
Input the user under the condition of the user annotation information that comprises traffic information, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
The present invention also provides a kind of producing device of outdoor scene map, comprising:
Video acquisition module is obtained a plurality of video images of a plurality of camera collections;
The video synthesis module is used for that described a plurality of video images are synthesized processing and forms full-view video image;
The target identification module identifies destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
The mapping module is remapped to the destination object behind the described mark in the described full-view video image, and according to the geography information of described destination object, described full-view video image is carried out mapping process, and generates the outdoor scene map.
Further, described video synthesis module specifically is used for described a plurality of video images are carried out audio video synchronization, and described a plurality of video images that will carry out after the audio video synchronization splice generating panoramic video in real time.
Further, also comprise for described a plurality of video images being carried out anti-shake processing, avoiding the image blurring anti-shake module of video.
Further, also comprise be used to the map memory module of preserving described outdoor scene map, and the display module that shows described outdoor scene map.
Further, described target identification module specifically is used for using different marks that described destination object is carried out classification annotation according to the attribute of described geography information.
Further, described mapping module specifically is used for described destination object and GPS latitude and longitude information are mated, and be used for will be corresponding with described destination object mark and the corresponding GPS latitude and longitude information correspondence position that appends to described full-view video image, generate the outdoor scene map.
Further, also comprise human-computer interaction module, be used for the user annotation information that user's input comprises traffic information.
Further, described mapping module also is used for inputting under the condition of the user annotation information that comprises traffic information the user, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
Further, comprise that also described map sharing module comprises for the map sharing module that realizes that the outdoor scene map is shared between the vehicle:
Judging unit is used for judging whether other vehicles have the outdoor scene map;
Transmitting element has at other vehicles under the condition of outdoor scene map, sends the request that the outdoor scene map is shared;
Receiving element is agreed to receive the outdoor scene map that other vehicles send under the shared condition of outdoor scene map at other vehicles.
The invention has the beneficial effects as follows: the present invention can make the user realize the real-time manufacturing of outdoor scene map, has broken through traditional outdoor scene map and need to rely on professional team to make, and the user can only pay or the pattern of its map of networking;
The present invention makes the outdoor scene map except can freely using, the dependence of download to signal and geographical environment of can also avoiding networking;
The outdoor scene map of current surrounding environment is recorded at the setup and use family of display module and map sharing module in real time DIY, is shown to the user, can realize that different vehicle carry out map and share by communication modes such as wlan simultaneously;
The outdoor scene map of making is preserved the map data base that can be used as the user by the map memory module, for later on, also can by the modes such as wlan or bluetooth realize and a plurality of vehicle between shared, with renewal and the expansion of realization map;
In addition, the present invention also is furnished with human-computer interaction module, can be used for the modification of outdoor scene map is replenished and renewal, can make the user obtain the up-to-date information of current route, has greatly promoted user's experience.
Description of drawings
Fig. 1 represents the process flow diagram of the method for making of outdoor scene map of the present invention;
Fig. 2 represents the process flow diagram of the method for making of outdoor scene map of the present invention;
Fig. 3 represents the structured flowchart of the producing device of outdoor scene map of the present invention;
Fig. 4 represents the structured flowchart of the producing device of outdoor scene map of the present invention.
Embodiment
Below in conjunction with accompanying drawing structure of the present invention and principle are elaborated, illustrated embodiment only is used for explaining the present invention, is not to limit protection scope of the present invention with this.
Need to rely on professional team to make in order to break through traditional outdoor scene map, the user can only pay or the pattern of its map of networking, the invention provides a kind of method for making of outdoor scene map, as shown in Figure 1, the method for making of the outdoor scene topic figure in the present embodiment may further comprise the steps:
Obtain a plurality of video images of a plurality of camera collections;
Described a plurality of video images are synthesized processing form full-view video image;
Identify destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
Destination object behind the described mark is remapped in the described full-view video image;
According to the geography information of described destination object, described full-view video image is carried out mapping process, generate the outdoor scene map.
In the present embodiment, vehicle front, left, the right-hand camera that varying number respectively is installed, quantity and position that camera is installed are to guarantee to collect the video image of vehicle periphery 360 degree.
Installation site and the quantity of concrete camera, to arrange according to the visual angle of concrete camera, such as: if adopt 120 ° of special-purpose wide-angle cameras, minimum will be forwardly, left front and right front respectively install one, guarantees that the scenery of 360 ° of vehicle peripheries can be collected.If the camera visual angle of installing is smaller, then need a plurality of cameras are installed, thus the panoramic view around guaranteeing to obtain.
When needing to make the outdoor scene map, start the camera of vehicle periphery, comprising vehicle body the place ahead, left and right-hand camera, adjust each camera and be in normal duty, namely camera can normally gather current view data.
Because camera is to be installed on the vehicle, the vibrations that engine produces can cause the high-frequency vibration of camera, and vehicle is in motion process, owing to the road reason can produce violent low-frequency vibration, these vibrations all can impact the video of camera collection, produce the fuzzy and float of video etc.So will carry out anti-shake processing to the video image of each camera output, (special processing refers to: the Image post-processing algorithm such as anti-shake processing and image sharpening namely video image to be carried out estimation and special processing, make the image more clear), eliminate because vehicle body vibrations or the mobile video that causes are fuzzy and float, thereby guarantee to obtain the steady and audible video image of each camera collection.
In order to allow the user see the video effect of continuous three-dimensional panorama, can not exist obvious crease and the discontinuous effect of splicing described a plurality of video images need to be synthesized to process and form full-view video image, specifically may further comprise the steps:
(1) described a plurality of video images is carried out audio video synchronization;
Video after the anti-shake processing of each camera is not strict synchronous in time, must carry out audio video synchronization, during audio video synchronization, can set a time threshold according to the frame per second of video, such as: frame per second is 30fps, and then each the road video image in the 33ms is all as synchronous frame.It is fixed that concrete threshold value can be come according to the frame per second that the user selects.
Described a plurality of video images that (2) will carry out after the audio video synchronization splice the generating panoramic video image in real time.
Each road video image synchronously, just can carry out video synthetic, the synthetic ultimate principle of video is mated and correlation analysis each road video image exactly, splice in real time afterwards, generating panoramic video image, this full-view video image video are exactly the basis of carrying out target identification the later stage and making the outdoor scene map.
In the present embodiment, the synthetic ultimate principle of video is specially carries out content analysis in each road video, extracts the similar part of content, synthesizes splicing, thereby forms a secondary continuous outdoor scene map.This principle is identical with the realization principle that the panoramas of panorama camera function realization 360 degree of general camera are taken pictures.
In the present embodiment, identify in the geography information step of destination object in the described full-view video image and described destination object, be specially by professional Target Recognition Algorithms the destination object in the full-view video image is identified, and extract the geography information of described destination object.
Described Target Recognition Algorithms can be pattern-recognition or textual scan, can certainly be other Target Recognition Algorithms, as long as can identify the destination object in the full-view video image.
Described destination object is mainly street in the full-view video image, crossing, traffic lights, buildings etc.
In the present embodiment, described destination object is marked processing, the step of the destination object after obtaining marking specifically comprises: the attribute according to described geography information uses different marks that described destination object is carried out classification annotation.
Described mark can be sign flag, also can be word marking, for also using phonetic symbol to mark destination object such as necessary informations such as red lights.Can certainly for other mark patterns, give unnecessary details no longer one by one at this.
In the present embodiment, the step that the destination object behind the described mark is remapped in the described full-view video image comprises:
Take described full-view video image as the basis, in conjunction with described geography information, described geography information is mapped on the described full-view video image in real time.
In the present embodiment, according to the geography information of described destination object, described full-view video image is carried out mapping process, the step that generates the outdoor scene map comprises:
Described destination object and GPS latitude and longitude information are mated;
Mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
As shown in Figure 2, for the user can experience more fresh accurately outdoor scene map, the method for making of outdoor scene map of the present invention is further comprising the steps of:
Need to be under the condition that the outdoor scene map is made amendment the user, the user inputs user annotation information.
Described user annotation information can comprise the information such as traffic lights damage, traffic congestion is serious.
Accordingly, mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, and the step that generates the outdoor scene map comprises:
Input the user under the condition of the user annotation information that comprises traffic information, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
Understand in order to allow the user that geography information is on every side had more fully, traffic route is had more accurately judge, the method for making of outdoor scene map of the present invention is further comprising the steps of:
Preservation also shows described outdoor scene map.
Drawn outdoor scene map can directly be sent to display device, and the outdoor scene map of vehicle periphery is provided in real time for the user, allows the user that geography information is on every side had more fully and understands, and traffic route is had more accurately judge.
Drawn outdoor scene map is stored, with the map data base of this outdoor scene map as user oneself, for later on.
For renewal and the expansion that realizes user's map data base, the user can detect other vehicles by communication modes such as WLAN or bluetooths and whether have the outdoor scene map function, have at other vehicles under the condition of outdoor scene map function, send the request that the outdoor scene map is shared by communication modes such as WLAN or bluetooths to other vehicles, and under the condition that other vehicles permission outdoor scene maps are shared, receive the outdoor scene map that other vehicles send, realize that the outdoor scene map is shared, the renewal of the map data base of completing user and expansion.
As shown in Figure 3, the present invention also provides a kind of producing device of outdoor scene map, comprising:
Video acquisition module is obtained a plurality of video images of a plurality of camera collections;
The video synthesis module is used for that described a plurality of video images are synthesized processing and forms full-view video image;
The target identification module identifies destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
The mapping module is remapped to the destination object behind the described mark in the described full-view video image, and according to the geography information of described destination object, described full-view video image is carried out mapping process, and generates the outdoor scene map.
Described video acquisition module is mainly used in obtaining a plurality of video images of a plurality of camera collections of vehicle front, left, right-hand installation, and quantity and position that camera is installed will guarantee that described video acquisition module can obtain the video image of vehicle periphery 360 degree.
Installation site and the quantity of concrete camera, to arrange according to the visual angle of concrete camera, such as: if adopt 120 ° of special-purpose wide-angle cameras, minimum will be forwardly, left front and right front respectively install one, guarantees that the scenery of 360 ° of vehicle peripheries can be collected.If the camera visual angle of installing is smaller, then need a plurality of cameras are installed, thus the panoramic view around guaranteeing to obtain.
When needing to make the outdoor scene map, start the camera of vehicle periphery, comprising vehicle body the place ahead, left and right-hand camera, adjust each camera and be in normal duty, namely camera can normally gather current view data.
Because camera is to be installed on the vehicle, the vibrations that engine produces can cause the high-frequency vibration of camera, and vehicle is in motion process, owing to the road reason can produce violent low-frequency vibration, these vibrations all can impact the video of camera collection, produce the fuzzy and float of video etc.In order to solve the problems of the technologies described above, the producing device of outdoor scene map of the present invention also comprises for described a plurality of video images being carried out anti-shake processing, avoiding the image blurring anti-shake module of video.
The anti-shake module of described video is used for the video image of each camera output is carried out anti-shake processing, (special processing refers to: the Image post-processing algorithm such as anti-shake processing and image sharpening namely video image to be carried out estimation and special processing, make the image more clear), eliminate because vehicle body vibrations or the mobile video that causes are fuzzy and float, thereby guarantee to obtain the steady and audible video image of each camera collection.
In order to allow the user see the video effect of continuous three-dimensional panorama, can not exist obvious crease and the discontinuous effect of splicing described a plurality of video images need to be synthesized to process and form full-view video image, described video synthesis module specifically is used for described a plurality of video images are carried out audio video synchronization, and described a plurality of video images that will carry out after the audio video synchronization splice generating panoramic video in real time.
Video after the anti-shake processing of each camera is not strict synchronous in time, must carry out audio video synchronization, during audio video synchronization, can set a time threshold according to the frame per second of video, such as: frame per second is 30fps, and then each the road video image in the 33ms is all as synchronous frame.It is fixed that concrete threshold value can be come according to the frame per second that the user selects.
Each road video image synchronously, just can carry out video synthetic, the synthetic ultimate principle of video is mated and correlation analysis each road video image exactly, splice in real time afterwards, generating panoramic video image, this full-view video image video are exactly the basis of carrying out target identification the later stage and making the outdoor scene map.
In the present embodiment, the synthetic ultimate principle of video is specially carries out content analysis in each road video, extracts the similar part of content, synthesizes splicing, thereby forms a secondary continuous outdoor scene map.This principle is identical with the realization principle that the panoramas of panorama camera function realization 360 degree of general camera are taken pictures.
Described target identification module specifically is used for by professional Target Recognition Algorithms the destination object of full-view video image being identified, and extracts the geography information of described destination object.
Described Target Recognition Algorithms can be pattern-recognition or textual scan, can certainly be other Target Recognition Algorithms, as long as can identify the destination object in the full-view video image.
Described destination object is mainly street in the full-view video image, crossing, traffic lights, buildings etc.
Described target identification module specifically is used for using different marks that described destination object is carried out classification annotation according to the attribute of described geography information.
Described mark can be sign flag, also can be word marking, for also using phonetic symbol to mark destination object such as necessary informations such as red lights.Can certainly for other mark patterns, give unnecessary details no longer one by one at this.
Described mapping module specifically is used for described destination object and GPS latitude and longitude information are mated, and be used for will be corresponding with described destination object mark and the corresponding GPS latitude and longitude information correspondence position that appends to described full-view video image, generate the outdoor scene map.
As shown in Figure 4, for the user can experience more fresh accurately outdoor scene map, the producing device of outdoor scene map of the present invention also comprises human-computer interaction module, is used for the user annotation information that user's input comprises traffic information.
Described user annotation information can comprise the information such as traffic lights damage, traffic congestion is serious.
Accordingly, described mapping module also is used for inputting under the condition of the user annotation information that comprises traffic information the user, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
Understand in order to allow the user that geography information is on every side had more fully, traffic route there is more accurately judgement, the producing device of outdoor scene map of the present invention also comprises be used to the map memory module of preserving described outdoor scene map, and the display module that shows described outdoor scene map.
Drawn outdoor scene map can directly be sent to display module, and the outdoor scene map of vehicle periphery is provided in real time for the user, allows the user that geography information is on every side had more fully and understands, and traffic route is had more accurately judge.
Drawn outdoor scene map is sent to the map memory module stores, with the map data base of this outdoor scene map as user oneself, for later on.
For renewal and the expansion that realizes user's map data base, the producing device of outdoor scene map of the present invention comprises that also described map sharing module comprises for the map sharing module that realizes that the outdoor scene map is shared between the vehicle:
Judging unit is used for judging whether other vehicles have the outdoor scene map;
Transmitting element has at other vehicles under the condition of outdoor scene map, sends the request that the outdoor scene map is shared;
Receiving element is agreed to receive the outdoor scene map that other vehicles send under the shared condition of outdoor scene map at other vehicles.
Described judging unit can detect other vehicles by communication modes such as WLAN or bluetooths and whether have the outdoor scene map function.
Described transmitting element has at other vehicles under the condition of outdoor scene map function, sends the request that the outdoor scene map is shared by communication modes such as WLAN or bluetooths to other vehicles.
Described receiving element allows to receive the outdoor scene map that other vehicles send under the shared condition of outdoor scene map at other vehicles, realizes that the outdoor scene map is shared, the renewal of the map data base of completing user and expansion.
In the present embodiment, described display module and the described human-computer interaction module structure that becomes one, during specific implementation, the user can browse the outdoor scene map by the display screen on the vehicle, and the operation of inputting user annotation information.
In the present embodiment, described video just progressive die piece, the anti-shake module of described video, described video synthesis module, described target identification module, described mapping module, described map memory module, described map sharing module is integrated in the CPU (central processing unit).
The above is preferred embodiment of the present invention, should be pointed out that to those skilled in the art, under the prerequisite that does not break away from principle of the present invention, can also make some improvements and modifications, and these improvements and modifications also should be considered as protection domain of the present invention.

Claims (17)

1. the method for making of an outdoor scene map is characterized in that, may further comprise the steps:
Obtain a plurality of video images of a plurality of camera collections;
Described a plurality of video images are synthesized processing form full-view video image;
Identify destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
Destination object behind the described mark is remapped in the described full-view video image;
According to the geography information of described destination object, described full-view video image is carried out mapping process, generate the outdoor scene map.
2. the method for making of outdoor scene map according to claim 1 is characterized in that, described a plurality of video images is synthesized the step of processing the formation full-view video image comprise:
Described a plurality of video images are carried out audio video synchronization;
Described a plurality of video images that will carry out after the audio video synchronization splice the generating panoramic video image in real time.
3. the method for making of outdoor scene map according to claim 1 is characterized in that,
Described a plurality of video image is through the video image after the anti-shake processing.
4. the method for making of outdoor scene map according to claim 1 is characterized in that, and is further comprising the steps of:
Preservation also shows described outdoor scene map.
5. the method for making of outdoor scene map according to claim 1 is characterized in that, described destination object is marked processing, and the step of the destination object after obtaining marking comprises:
Attribute according to described geography information uses different marks that described destination object is carried out classification annotation.
6. the method for making of outdoor scene map according to claim 1 is characterized in that, the step that the destination object behind the described mark is remapped in the described full-view video image comprises:
Take described full-view video image as the basis, in conjunction with described geography information, described geography information is mapped on the described full-view video image in real time.
7. the method for making of outdoor scene map according to claim 1 is characterized in that, according to the geography information of described destination object, described full-view video image is carried out mapping process, and the step that generates the outdoor scene map comprises:
Described destination object and GPS latitude and longitude information are mated;
Mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
8. the method for making of outdoor scene map according to claim 7 is characterized in that, mark that will be corresponding with described destination object and corresponding GPS latitude and longitude information append to the correspondence position in the described full-view video image, and the step that generates the outdoor scene map comprises:
Input the user under the condition of the user annotation information that comprises traffic information, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
9. the producing device of an outdoor scene map is characterized in that, comprising:
Video acquisition module is obtained a plurality of video images of a plurality of camera collections;
The video synthesis module is used for that described a plurality of video images are synthesized processing and forms full-view video image;
The target identification module identifies destination object in the described full-view video image and the geography information of described destination object, and described destination object is marked processing, the destination object after obtaining marking;
The mapping module is remapped to the destination object behind the described mark in the described full-view video image, and according to the geography information of described destination object, described full-view video image is carried out mapping process, and generates the outdoor scene map.
10. the producing device of outdoor scene map according to claim 9, it is characterized in that, described video synthesis module specifically is used for described a plurality of video images are carried out audio video synchronization, and described a plurality of video images that will carry out after the audio video synchronization splice generating panoramic video in real time.
11. the producing device of outdoor scene map according to claim 9 is characterized in that, also comprises for described a plurality of video images being carried out anti-shake processing, avoiding the image blurring anti-shake module of video.
12. the producing device of outdoor scene map according to claim 9 is characterized in that, also comprises be used to the map memory module of preserving described outdoor scene map, and the display module that shows described outdoor scene map.
13. the producing device of outdoor scene map according to claim 9 is characterized in that, described target identification module specifically is used for using different marks that described destination object is carried out classification annotation according to the attribute of described geography information.
14. the producing device of outdoor scene map according to claim 9, it is characterized in that, described mapping module specifically is used for described destination object and GPS latitude and longitude information are mated, and be used for will be corresponding with described destination object mark and the corresponding GPS latitude and longitude information correspondence position that appends to described full-view video image, generate the outdoor scene map.
15. the producing device of outdoor scene map according to claim 14 is characterized in that, also comprises human-computer interaction module, is used for the user annotation information that user's input comprises traffic information.
16. the producing device of outdoor scene map according to claim 15, it is characterized in that, described mapping module also is used for inputting under the condition of the user annotation information that comprises traffic information the user, mark that will be corresponding with described destination object, corresponding GPS latitude and longitude information and described user annotation information append to the correspondence position in the described full-view video image, generate the outdoor scene map.
17. the producing device of outdoor scene map according to claim 9 is characterized in that, comprises that also described map sharing module comprises for the map sharing module that realizes that the outdoor scene map is shared between the vehicle:
Judging unit is used for judging whether other vehicles have the outdoor scene map;
Transmitting element has at other vehicles under the condition of outdoor scene map, sends the request that the outdoor scene map is shared;
Receiving element is agreed to receive the outdoor scene map that other vehicles send under the shared condition of outdoor scene map at other vehicles.
CN2012103950011A 2012-10-17 2012-10-17 Method and device for manufacturing live-action map Pending CN102915669A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN2012103950011A CN102915669A (en) 2012-10-17 2012-10-17 Method and device for manufacturing live-action map
PCT/CN2013/077112 WO2013170797A1 (en) 2012-10-17 2013-06-09 Method and device for producing real-view map

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012103950011A CN102915669A (en) 2012-10-17 2012-10-17 Method and device for manufacturing live-action map

Publications (1)

Publication Number Publication Date
CN102915669A true CN102915669A (en) 2013-02-06

Family

ID=47614012

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012103950011A Pending CN102915669A (en) 2012-10-17 2012-10-17 Method and device for manufacturing live-action map

Country Status (2)

Country Link
CN (1) CN102915669A (en)
WO (1) WO2013170797A1 (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103177475A (en) * 2013-03-04 2013-06-26 腾讯科技(深圳)有限公司 Method and system for showing streetscape maps
CN103260013A (en) * 2013-05-30 2013-08-21 水木路拓科技(北京)有限公司 Road network traffic satellite map video display system based on video image processing technology
WO2013170797A1 (en) * 2012-10-17 2013-11-21 中兴通讯股份有限公司 Method and device for producing real-view map
CN104535070A (en) * 2014-12-26 2015-04-22 上海交通大学 High-precision map data structure, high-precision map data acquiringand processing system and high-precision map data acquiringand processingmethod
CN105389584A (en) * 2015-10-13 2016-03-09 西北工业大学 Streetscape semantic annotation method based on convolutional neural network and semantic transfer conjunctive model
CN105472332A (en) * 2015-12-01 2016-04-06 杨春光 Analysis method and system based on technology of positioning and video technology
CN105509754A (en) * 2015-11-27 2016-04-20 芜湖宏景电子股份有限公司 Improved IOS system vehicle navigation
CN105845020A (en) * 2016-05-20 2016-08-10 深圳市喜悦智慧数据有限公司 Real-scene map making method and device
CN106126593A (en) * 2016-06-20 2016-11-16 国家基础地理信息中心 Earth's surface based on network opening photo resources outdoor scene information generating method and device
CN106210647A (en) * 2016-08-02 2016-12-07 中睿通信规划设计有限公司 Based on the method and system building base station coverage area full-view image of taking photo by plane
CN106441298A (en) * 2016-08-26 2017-02-22 陈明 Method for map data man-machine interaction with robot view image
CN106576191A (en) * 2013-09-13 2017-04-19 沃科公司 Video production sharing apparatus and method
CN106799993A (en) * 2017-01-09 2017-06-06 智车优行科技(北京)有限公司 Streetscape acquisition method and system, vehicle
CN107038949A (en) * 2016-02-03 2017-08-11 幸福在线(北京)网络技术有限公司 A kind of generation method of live-action map, method for pushing and its device
CN107167149A (en) * 2017-06-26 2017-09-15 上海与德科技有限公司 A kind of streetscape view preparation method and system
WO2017206097A1 (en) * 2016-06-01 2017-12-07 深圳看到科技有限公司 Panoramic video making method
CN107798720A (en) * 2016-08-30 2018-03-13 中兴通讯股份有限公司 A kind of method for drawing map and its device, mobile terminal
CN109117693A (en) * 2017-06-22 2019-01-01 深圳华智融科技股份有限公司 A kind of method and terminal of the scanning recognition found a view based on wide-angle
CN109949439A (en) * 2019-04-01 2019-06-28 星觅(上海)科技有限公司 Driving outdoor scene information labeling method, apparatus, electronic equipment and medium
CN110264576A (en) * 2013-11-14 2019-09-20 微软技术许可有限责任公司 Label is presented in the scene using transparency
CN110637457A (en) * 2017-05-23 2019-12-31 林克物流有限公司 Method for determining photographing position information and apparatus for performing the same
CN110704557A (en) * 2019-09-10 2020-01-17 广东华远国土工程有限公司 Live-action browsing method of electronic map
CN110996013A (en) * 2013-03-13 2020-04-10 三星电子株式会社 Electronic device and method for processing image
CN111375206A (en) * 2018-12-27 2020-07-07 珠海金山网络游戏科技有限公司 Scene map editing system, method and device
CN111918024A (en) * 2020-06-29 2020-11-10 北京大学 Urban road network digital monitoring system and method
WO2021142890A1 (en) * 2020-01-19 2021-07-22 广州启量信息科技有限公司 System and method for generating three-dimensional panoramic roaming model
CN113253324A (en) * 2021-02-25 2021-08-13 安徽乐道信息科技有限公司 Expressway target scene positioning method, navigation method and system
US11509807B2 (en) 2013-03-13 2022-11-22 Samsung Electronics Co., Ltd. Electronic device and method for generating thumbnails based on captured images

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104700710A (en) * 2015-04-07 2015-06-10 苏州市测绘院有限责任公司 Simulation map for house property mapping
CN108933899B (en) * 2018-08-22 2020-10-16 Oppo广东移动通信有限公司 Panorama shooting method, device, terminal and computer readable storage medium
CN114531580B (en) * 2020-11-23 2023-11-21 北京四维图新科技股份有限公司 Image processing method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1487676A (en) * 2002-08-19 2004-04-07 ������������ʽ���� Communicating method for inter-movingbodies and vehicle communicating apparatus
JP2006054662A (en) * 2004-08-11 2006-02-23 Mitsubishi Electric Corp Drive support device
CN101588482A (en) * 2009-06-02 2009-11-25 石黎 Vehicular virtual panoramic electronic system
CN101998236A (en) * 2009-08-20 2011-03-30 美国博通公司 Method and system for generating a personalized map
US20110285810A1 (en) * 2010-05-21 2011-11-24 Qualcomm Incorporated Visual Tracking Using Panoramas on Mobile Devices

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102915669A (en) * 2012-10-17 2013-02-06 中兴通讯股份有限公司 Method and device for manufacturing live-action map

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1487676A (en) * 2002-08-19 2004-04-07 ������������ʽ���� Communicating method for inter-movingbodies and vehicle communicating apparatus
JP2006054662A (en) * 2004-08-11 2006-02-23 Mitsubishi Electric Corp Drive support device
CN101588482A (en) * 2009-06-02 2009-11-25 石黎 Vehicular virtual panoramic electronic system
CN101998236A (en) * 2009-08-20 2011-03-30 美国博通公司 Method and system for generating a personalized map
US20110285810A1 (en) * 2010-05-21 2011-11-24 Qualcomm Incorporated Visual Tracking Using Panoramas on Mobile Devices

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013170797A1 (en) * 2012-10-17 2013-11-21 中兴通讯股份有限公司 Method and device for producing real-view map
CN103177475A (en) * 2013-03-04 2013-06-26 腾讯科技(深圳)有限公司 Method and system for showing streetscape maps
WO2014135022A1 (en) * 2013-03-04 2014-09-12 腾讯科技(深圳)有限公司 Street view map display method and system
CN110996013A (en) * 2013-03-13 2020-04-10 三星电子株式会社 Electronic device and method for processing image
US11509807B2 (en) 2013-03-13 2022-11-22 Samsung Electronics Co., Ltd. Electronic device and method for generating thumbnails based on captured images
CN103260013A (en) * 2013-05-30 2013-08-21 水木路拓科技(北京)有限公司 Road network traffic satellite map video display system based on video image processing technology
CN106576191B (en) * 2013-09-13 2020-07-14 英特尔公司 Video production sharing device and method
CN106576191A (en) * 2013-09-13 2017-04-19 沃科公司 Video production sharing apparatus and method
US10812781B2 (en) 2013-09-13 2020-10-20 Intel Corporation Video production sharing apparatus and method
CN110264576A (en) * 2013-11-14 2019-09-20 微软技术许可有限责任公司 Label is presented in the scene using transparency
CN104535070A (en) * 2014-12-26 2015-04-22 上海交通大学 High-precision map data structure, high-precision map data acquiringand processing system and high-precision map data acquiringand processingmethod
CN105389584B (en) * 2015-10-13 2018-07-10 西北工业大学 Streetscape semanteme marking method based on convolutional neural networks with semantic transfer conjunctive model
CN105389584A (en) * 2015-10-13 2016-03-09 西北工业大学 Streetscape semantic annotation method based on convolutional neural network and semantic transfer conjunctive model
CN105509754A (en) * 2015-11-27 2016-04-20 芜湖宏景电子股份有限公司 Improved IOS system vehicle navigation
CN105472332A (en) * 2015-12-01 2016-04-06 杨春光 Analysis method and system based on technology of positioning and video technology
CN105472332B (en) * 2015-12-01 2018-07-20 广东弘栎电子设备有限公司 Analysis method based on location technology and video technique and its analysis system
CN107038949A (en) * 2016-02-03 2017-08-11 幸福在线(北京)网络技术有限公司 A kind of generation method of live-action map, method for pushing and its device
CN105845020A (en) * 2016-05-20 2016-08-10 深圳市喜悦智慧数据有限公司 Real-scene map making method and device
WO2017206097A1 (en) * 2016-06-01 2017-12-07 深圳看到科技有限公司 Panoramic video making method
CN106126593B (en) * 2016-06-20 2019-05-21 国家基础地理信息中心 Earth's surface outdoor scene information generating method and device based on network opening photo resources
CN106126593A (en) * 2016-06-20 2016-11-16 国家基础地理信息中心 Earth's surface based on network opening photo resources outdoor scene information generating method and device
CN106210647A (en) * 2016-08-02 2016-12-07 中睿通信规划设计有限公司 Based on the method and system building base station coverage area full-view image of taking photo by plane
CN106441298A (en) * 2016-08-26 2017-02-22 陈明 Method for map data man-machine interaction with robot view image
CN107798720A (en) * 2016-08-30 2018-03-13 中兴通讯股份有限公司 A kind of method for drawing map and its device, mobile terminal
CN106799993A (en) * 2017-01-09 2017-06-06 智车优行科技(北京)有限公司 Streetscape acquisition method and system, vehicle
CN106799993B (en) * 2017-01-09 2021-06-11 智车优行科技(北京)有限公司 Streetscape acquisition method and system and vehicle
CN110637457A (en) * 2017-05-23 2019-12-31 林克物流有限公司 Method for determining photographing position information and apparatus for performing the same
CN109117693A (en) * 2017-06-22 2019-01-01 深圳华智融科技股份有限公司 A kind of method and terminal of the scanning recognition found a view based on wide-angle
CN107167149B (en) * 2017-06-26 2020-06-30 上海智讯信息科技有限公司 Street view making method and system
CN107167149A (en) * 2017-06-26 2017-09-15 上海与德科技有限公司 A kind of streetscape view preparation method and system
CN111375206A (en) * 2018-12-27 2020-07-07 珠海金山网络游戏科技有限公司 Scene map editing system, method and device
CN111375206B (en) * 2018-12-27 2024-05-03 珠海金山数字网络科技有限公司 Scene map editing system, method and device
CN109949439A (en) * 2019-04-01 2019-06-28 星觅(上海)科技有限公司 Driving outdoor scene information labeling method, apparatus, electronic equipment and medium
CN110704557A (en) * 2019-09-10 2020-01-17 广东华远国土工程有限公司 Live-action browsing method of electronic map
CN110704557B (en) * 2019-09-10 2023-03-10 广东华远国土工程有限公司 Live-action browsing method of electronic map
WO2021142890A1 (en) * 2020-01-19 2021-07-22 广州启量信息科技有限公司 System and method for generating three-dimensional panoramic roaming model
CN111918024A (en) * 2020-06-29 2020-11-10 北京大学 Urban road network digital monitoring system and method
CN111918024B (en) * 2020-06-29 2021-10-19 北京大学 Urban road network digital monitoring system and method
CN113253324B (en) * 2021-02-25 2024-03-29 安徽乐道智能科技有限公司 Highway target scene positioning method, navigation method and system
CN113253324A (en) * 2021-02-25 2021-08-13 安徽乐道信息科技有限公司 Expressway target scene positioning method, navigation method and system

Also Published As

Publication number Publication date
WO2013170797A1 (en) 2013-11-21

Similar Documents

Publication Publication Date Title
CN102915669A (en) Method and device for manufacturing live-action map
US20230400317A1 (en) Methods and Systems for Generating Route Data
KR101147748B1 (en) A mobile telecommunication device having a geographic information providing function and the method thereof
JP7127165B2 (en) Systems and methods for using visual landmarks in initial navigation
US20130318078A1 (en) System and Method for Producing Multi-Angle Views of an Object-of-Interest from Images in an Image Dataset
JP6418266B2 (en) Three-dimensional head-up display device that displays visual context corresponding to voice commands
EP3338058B1 (en) Location based service tools for video illustration, selection, and synchronization
US10291898B2 (en) Method and apparatus for updating navigation map
KR100533033B1 (en) Position tracing system and method using digital video process technic
CN103913174A (en) Navigation information generation method and system, mobile client and server
JP2011170599A (en) Outdoor structure measuring instrument and outdoor structure measuring method
CN108399785A (en) Find the method, apparatus and storage medium of vehicle
CN106649777B (en) Method for constructing intersection topological relation in panoramic vector data
CN111323041B (en) Information processing system, storage medium, and information processing method
KR100620668B1 (en) Method for implementing Video GIS system of car navigation system having GPS receiver
CN102243078B (en) Namely a kind of institute depending on releasing type guider and implementation method
KR20090099938A (en) The camera system for producing the panorama of a map information
JP2007323085A (en) Three-dimensional information display device
JP4685286B2 (en) Information update processing device
CN111275823B (en) Target associated data display method, device and system
KR20060033296A (en) System for managing signboards using geographic information system and method therefor
US20220005267A1 (en) System and method for three-dimensional reproduction of an off-road vehicle
CN116958915A (en) Target detection method, target detection device, electronic equipment and storage medium
KR101910460B1 (en) System and method for providing contents
CN114866682A (en) Method for generating road book based on video and method for generating personalized road book

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20130206