CN108282635B - Panoramic image generation method and system and Internet of vehicles big data service platform - Google Patents
Panoramic image generation method and system and Internet of vehicles big data service platform Download PDFInfo
- Publication number
- CN108282635B CN108282635B CN201810142602.9A CN201810142602A CN108282635B CN 108282635 B CN108282635 B CN 108282635B CN 201810142602 A CN201810142602 A CN 201810142602A CN 108282635 B CN108282635 B CN 108282635B
- Authority
- CN
- China
- Prior art keywords
- position information
- effective position
- real
- information
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003068 static effect Effects 0.000 claims abstract description 95
- 238000005070 sampling Methods 0.000 claims abstract description 66
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 40
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 40
- 230000006855 networking Effects 0.000 claims abstract description 9
- 238000013507 mapping Methods 0.000 claims description 14
- 230000002194 synthesizing effect Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 5
- 238000012800 visualization Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000008187 granular material Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Processing Or Creating Images (AREA)
- Instructional Devices (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a panoramic image generation method and system and a vehicle networking big data service platform. The panoramic image generation method comprises the following steps: the video sampling unit acquires real-time information of the vehicle-mounted terminal in a current set period, wherein the real-time information comprises effective position information and real-time video information corresponding to the effective position information; the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information; and the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period. The method and the device realize the generation of the full-map real-time panoramic image in the cell with the base station as the center, realize the visualization of the real-time traffic scene under an intelligent traffic system, provide the actual scene of the real-time update of the target position for the user, improve the user experience and meet the multi-directional requirements of the user.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a panoramic image generation method and system and a vehicle networking big data service platform.
Background
With the development of the internet of vehicles industry and wireless communication technology, people's attention to internet of vehicles service is not limited to basic anti-collision alarm, but is expanded to more abundant and diversified video and image applications. Visual native perception data such as live-action images and video streams can be used for vehicle behavior control decision through analysis and processing, and meanwhile, the visual native perception data can be provided for a third party to provide diversified application services for other types of terminals.
In recent years, internet technologies such as big data and cloud computing are becoming mature, and mass internet of vehicles data can be processed more efficiently. In addition, with the advent of a new Computing architecture, Mobile Edge Computing (MEC), it is proposed to deploy a low-cost mini-server at the base station side, creating a carrier-class service environment with high efficiency and low time delay, and also providing a new solution for improving service quality in a typical time delay sensitive application scenario, such as internet of vehicles.
The existing live-action image processing technology mainly captures a space scene of the real world through a professional camera, splices and synthesizes a plurality of plane photos by using software, and simulates 360-degree panoramic views of a three-dimensional space, and has the characteristics of high definition and high fidelity. However, such static images cannot be generated in real time, and any user can acquire the same live-action image when viewing the same place for a long period of time, which causes the phenomena of information failure and the like, reduces the user experience, and cannot meet the multi-directional requirements of the user.
The existing live-action image generation method has at least the following disadvantages:
1. the existing actual scene 3D image is generated by image synthesis after being shot by a special camera and then uploaded to a server for updating, the updating interval is long, and the real-time performance is not realized;
2. the traffic accident and road condition monitoring mainly adopts monitoring facilities such as a road camera and the like, has more dead angles, cannot be covered in all directions, and has low definition and fixed angle;
3. the cost of the special hardware equipment used by the traditional method is high.
Disclosure of Invention
The invention aims to at least solve one of the problems in the prior art, and provides a panoramic image generation method and system and an Internet of vehicles big data service platform, which are used for realizing the generation of a real-time panoramic image, realizing the visualization of a real-time traffic scene under an intelligent traffic system, providing a real-time updated actual scene of a target position for a user, improving the user experience and meeting the multi-directional requirements of the user.
In order to achieve the above object, the present invention provides a panoramic image generation method, including:
the method comprises the steps that a video sampling unit obtains real-time information of a vehicle-mounted terminal in a current set period, wherein the real-time information comprises effective position information and real-time video information corresponding to the effective position information;
the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information;
and the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period.
Optionally, the generating, by the video sampling unit, a static image set corresponding to the effective position information in a current setting period according to the effective position information and the real-time video information includes:
the video sampling unit inquires all frames corresponding to the effective position information from the mapping relation between each frame in the real-time video information and the effective position information which is established in advance;
and the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to all the frames corresponding to the effective position information.
Optionally, after the video sampling unit generates a static image set corresponding to the effective position information in the current setting period according to all frames corresponding to the effective position information, the method further includes:
the video sampling unit stores the static image set corresponding to the effective position information in the current set period to a corresponding storage root directory in a database;
the video sampling unit judges whether a static image set stored under a storage root directory corresponding to effective position information in a database is a static image set corresponding to the effective position information in a current set period or not, if so, an updating index corresponding to the storage root directory corresponding to the effective position information is set as a first set value, and if not, an updating index corresponding to the storage root directory corresponding to the effective position information is set as a second set value;
the 3D image synthesis unit acquires an update index corresponding to the effective position information in the current set period;
and the 3D image synthesis unit judges whether the updating index is a first set value or a second set value, and if the updating index is judged to be the first set value, the step of generating the panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period is executed.
Optionally, if the 3D image synthesis unit determines that the update indicator is the second set value, the panoramic image corresponding to the effective position information in the previous set period is acquired.
In order to achieve the above object, the present invention provides a big data service platform of internet of vehicles, including:
the video sampling unit is used for acquiring real-time information of the vehicle-mounted terminal in a current set period, wherein the real-time information comprises effective position information and real-time video information corresponding to the effective position information; generating a static image set corresponding to the effective position information in a current set period according to the effective position information and the real-time video information;
and the 3D image synthesis unit is used for generating a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period.
Optionally, the video sampling unit is specifically configured to query all frames corresponding to the effective position information from a mapping relationship between each frame in the pre-established real-time video information and the effective position information; and generating a static image set corresponding to the effective position information in the current set period according to all the frames corresponding to the effective position information.
Optionally, a database is also included;
the video sampling unit is also used for storing the static image set corresponding to the effective position information in the current set period to the corresponding storage root directory in the database; judging whether a static image set stored under a storage root directory corresponding to effective position information in a database is a static image set corresponding to the effective position information in a current set period or not, if so, setting an update index corresponding to the storage root directory corresponding to the effective position information as a first set value, and if not, setting the update index corresponding to the storage root directory corresponding to the effective position information as a second set value;
the 3D image synthesis unit is specifically used for acquiring an update index corresponding to a storage root directory corresponding to effective position information in a current set period; and judging whether the updating index is a first set value or a second set value, and if the updating index is the first set value, generating a panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period.
Optionally, the 3D image synthesizing unit is further specifically configured to, if it is determined that the update indicator is the second set value, obtain a panoramic image corresponding to the effective position information in the previous set period.
In order to achieve the purpose, the invention provides a panoramic image generation system which comprises a vehicle-mounted terminal and the Internet of vehicles big data service platform, wherein the vehicle-mounted terminal is connected with the Internet of vehicles big data service platform.
Optionally, the system further comprises a client, wherein the client is connected with the Internet of vehicles big data service platform;
the client is used for acquiring the panoramic image corresponding to the effective position information output by the Internet of vehicles big data service platform.
The invention has the beneficial effects that:
in the panoramic image generation method and system and the technical scheme of the internet of vehicles big data service platform, the video sampling unit acquires real-time information of the vehicle-mounted terminal in the current set period, wherein the real-time information comprises effective position information and real-time video information corresponding to the effective position information; the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information; and the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period. Therefore, the generation of the full-map real-time panoramic image in the cell with the base station as the center is realized, the visualization of a real-time traffic scene under an intelligent traffic system is realized, the real-time updated actual scene of the target position can be provided for a user, the user experience is improved, and the multi-directional requirements of the user are met.
Drawings
Fig. 1 is a flowchart of a panoramic image generation method according to an embodiment of the present invention;
fig. 2 is a flowchart of a panoramic image generation method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a big data service platform of the internet of vehicles according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a panoramic image generation system according to a fourth embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the panoramic image generation method and system and the internet of vehicles big data service platform provided by the present invention are described in detail below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a panoramic image generation method according to an embodiment of the present invention, and as shown in fig. 1, the panoramic image generation method includes:
And 102, the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information.
And 103, generating a panoramic image corresponding to the effective position information in the current set period by the 3D image synthesis unit according to the static image set corresponding to the effective position information in the current set period.
In the technical scheme of the panoramic image generation method provided by this embodiment, a video sampling unit acquires real-time information of a vehicle-mounted terminal in a current set period, where the real-time information includes effective position information and real-time video information corresponding to the effective position information; the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information; and the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period. Therefore, the generation of the full-map real-time panoramic image in the cell with the base station as the center is realized, the visualization of a real-time traffic scene under an intelligent traffic system is realized, the real-time updated actual scene of the target position can be provided for a user, the user experience is improved, and the multi-directional requirements of the user are met. According to the panoramic image generation method provided by the embodiment, the panoramic image can have a shorter update period, has better real-time performance, and is generated without using hardware equipment with higher cost.
Fig. 2 is a flowchart of a panoramic image generation method according to a second embodiment of the present invention, where the panoramic image generation method is implemented based on a car networking big data service platform, and the car networking big data service platform includes a video acquisition unit, a video sampling unit, a 3D image synthesis unit, a database, and an image cache unit, where the video acquisition unit is connected to an external vehicle-mounted terminal, the video acquisition unit is connected to the video sampling unit, the 3D image synthesis unit, and the image cache unit are all connected to an external client, the video sampling unit and the 3D image synthesis unit are all connected to the database, and the 3D image synthesis unit is further connected to the video sampling unit and the image cache unit. As shown in fig. 2, the panoramic image generation method includes:
Specifically, the vehicle comprises a vehicle-mounted terminal, and during the driving process of the vehicle, the vehicle-mounted terminal continuously records and shoots a video of a road scene where the vehicle drives when running, so that real-time video information is generated. Specifically, the in-vehicle terminal may generate real-time video information through a shooting device such as a camera. Since the vehicle continuously moves during the driving process, the videos of the road scene shot by the vehicle-mounted terminal at different times are different. Under the scheduling control of the wireless access network, the vehicle-mounted terminal transmits the real-time video information to the video acquisition unit, and in the embodiment, the video acquisition unit is a base station. Preferably, the video capture unit is an intelligent base station carrying a Mobile Edge Computing (MEC) server.
Since the vehicle is moving continuously during the driving process, the effective position information of the vehicle-mounted terminal is changing continuously, wherein the effective position information of the vehicle-mounted terminal can be generated by the vehicle-mounted terminal through a positioning system such as a GPS. The MEC server of the base station granulates the map of the cell covered by the MEC server in advance, establishes a coordinate system by taking the position of the MEC server as an origin, and defines effective position information as a minimum granularity point which can be selected by a user in map software, so that the position range of the cell covered by the base station can include a plurality of effective position information.
In this embodiment, the effective position information is preferably effective position coordinates.
Since the vehicle-mounted terminal shoots the real-time video while driving, the effective position information of the vehicle-mounted terminal corresponds to the real-time video information. Specifically, after the video acquisition unit receives real-time video information and effective position information of the vehicle-mounted terminal, a mapping relation is established between the effective position information and each frame in the real-time video information. Then, the MEC server of the base station stores the real-time video information in a distributed storage system supporting stream storage, and can access through a Uniform Resource Locator (URL). The distributed storage system can support frequent updating of stored data, and for video files exceeding a set period, the video files are regularly covered by new video files according to a certain rule, so that the real-time performance of the stored video files is ensured.
When different vehicle-mounted terminals pass through the same position, the shot real-time video information may be the same or different, and therefore, each effective position information may correspond to the real-time video information shot by the plurality of vehicle-mounted terminals. Therefore, after the mapping relationship between each frame in the real-time video information and the valid location information is established, all frames corresponding to the valid location information can be further determined.
The video sampling unit presets a sampling period, the sampling period is a set period, and real-time information of the vehicle-mounted terminal is acquired every other set period. Specifically, in the current setting period, the video sampling unit acquires real-time information of all vehicle-mounted terminals in the current setting period from a distributed storage system of the MEC server, and converts the real-time video information into frames.
In step 202, the base station MEC server establishes a mapping relationship between each frame in the real-time video information and the effective position information, and since there may be a plurality of vehicles passing through the same position and capturing real-time video information from the same viewing angle or different viewing angles in the current setting period, each effective position information may correspond to a plurality of frames of the real-time video information in the current setting period. Therefore, in this step, the video sampling unit may query all frames corresponding to the valid location information according to the mapping relationship.
Specifically, the video sampling unit performs data shuffling on each frame of the effective position information and the real-time video information acquired in step 203, and then screens out all frames corresponding to the effective position information according to the mapping relationship. Therefore, all frames corresponding to each effective position information in part or all effective position information of the position range of the cell covered by the base station in the current setting period can be obtained.
Specifically, step 205 includes:
step 2051, the video sampling unit converts each frame of all frames corresponding to the effective position information into a corresponding image.
And step 2052, the video sampling unit combines the images corresponding to each frame into a static image set corresponding to the effective position information in the current setting period.
And step 206, the video sampling unit stores the static image set corresponding to the effective position information in the current setting period to a corresponding storage root directory in the database.
In the database, each valid location information of the location range of the cell covered by the base station corresponds to a storage path URL in the database, each storage path URL corresponds to a storage root directory, and each storage root directory corresponds to an UPDATE (UPDATE) indicator. In other words, each valid location information corresponds to an update indicator.
Specifically, in this step, after the video sampling unit generates the still image set corresponding to the effective position information in the current setting period, the video sampling unit may store the still image set corresponding to the effective position information in the current setting period to the corresponding storage root directory in the database. Under the storage root directory, the effective position information in the current setting period and the corresponding static image set are stored.
Specifically, if the storage root directory corresponding to the valid location information in the database stores the static image set corresponding to the valid location information in the previous set period, the static image set corresponding to the valid location information in the previous set period stored in the storage root directory is deleted, and the static image set corresponding to the valid location information in the current set period is stored in the storage root directory. In other words, the set period is an update period of the static image set corresponding to the valid location information stored in the database, and in the current set period, if a new static image set comes from the storage root directory corresponding to the valid location information, the static image set corresponding to the valid location information in the previous set period stored under the storage root directory is deleted, and the static image set corresponding to the valid location information in the current set period is stored in the storage root directory.
In this embodiment, the effective location information in the acquired real-time information of the vehicle-mounted terminal in the current setting period does not necessarily cover all effective location information of the location range of the cell covered by the base station. In other words, in the current setting period, there may be a situation that no vehicle passes through the position corresponding to the partial effective position information, and then for the partial effective position information, in the current setting period, the static image set corresponding to the partial effective position information in the previous setting period is still stored under the storage root directory corresponding to the partial effective position information in the database. In this embodiment, in the current setting period, the storage root directory corresponding to the part of valid location information is reserved to store the static image set in the previous setting period. In this case, it should be understood that the partial valid location information is the remaining valid location information, except the valid location information in the real-time information of the vehicle-mounted terminal acquired in the current set period, of all the valid location information of the location range of the cell covered by the base station.
At this time, if there is a situation that the vehicle does not pass through the position corresponding to part of the valid position information in the current setting period, a static image set corresponding to the valid position information of the vehicle-mounted terminal acquired in the current setting period and a static image set in the last setting period corresponding to the rest of the valid position information of the position range of the cell covered by the base station are stored in the database.
In this step, if the video sampling unit determines that the still image set stored under the storage root directory corresponding to the valid location information in the database is the still image set corresponding to the valid location information in the current setting period, it indicates that the still image set stored under the storage root directory corresponding to the valid location information is updated to the latest still image set, and therefore, the update index corresponding to the storage root directory corresponding to the valid location information needs to be updated, and the update index corresponding to the storage root directory corresponding to the valid location information is set to a first setting value, for example, the first setting value is 1.
If the video sampling unit determines that the static image set stored under the storage root directory corresponding to the valid location information in the database is not the static image set corresponding to the valid location information in the current setting period, it indicates that the static image set stored under the storage root directory corresponding to the valid location information is not updated, and the static image set in the previous setting period is still stored under the storage root directory, so that the update index corresponding to the storage root directory corresponding to the valid location information also needs to be updated, and the update index corresponding to the storage root directory corresponding to the valid location information is set to a second setting value, for example, the second setting value is 0.
After storing the static image sets corresponding to the valid location information in all current set periods into the database and updating the corresponding UPDATE indexes, the SAMPLE image set TABLE (SAMPLE _ TABLE) corresponding to the database needs to be updated, and the fields recorded in the SAMPLE image set TABLE include the valid location information and the corresponding UPDATE time, the storage root directory URL of the static image set, the UPDATE indexes and the like.
And step 208, the video sampling unit outputs the update index corresponding to the storage root directory corresponding to the effective position information in the current set period to the 3D image synthesis unit.
In step 209, the 3D image synthesis unit determines whether the update index is the first set value or the second set value, and if the update index is the first set value, step 210 is executed, and if the update index is the second set value, step 214 is executed.
Wherein the first set value is 1, and the second set value is 0. When the first set value is 1, it indicates that the static image set corresponding to the valid position information in the current setting period is stored under the storage root directory corresponding to the valid position information in the current setting period, that is, it indicates that the static image set corresponding to the storage root directory corresponding to the valid position information in the current setting period is updated; when the second setting value is 0, it indicates that, in the current setting period, the static image set corresponding to the valid location information in the last setting period is stored under the storage root directory corresponding to the valid location information, that is, in the current setting period, the static image set stored under the storage root directory corresponding to the valid location information is not updated.
When it is determined that the value of the update indicator corresponding to the storage root directory corresponding to the valid location information in the current setting period is the first set value, it indicates that, in the current setting period, the static image set corresponding to the valid location information in the current setting period is stored under the storage root directory corresponding to the valid location information, that is, it indicates that the static image set under the storage root directory corresponding to the valid location information in the current setting period has been updated, so step 210 is executed to obtain the static image set corresponding to the valid location information in the current setting period.
Specifically, the 3D image synthesis unit obtains a set of still images corresponding to valid position information in a current setting period from the database. Specifically, the 3D image synthesis unit queries a storage path URL corresponding to the update index from the sample image set table, and acquires a static image set corresponding to the valid position information in the current setting period from the database according to the storage path URL.
And step 211, the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period.
Specifically, after acquiring the static image set corresponding to the effective position information in the current setting period, the 3D image synthesis unit rejects the invalid images, for example, the images with the same shooting angle, in the static image set corresponding to the effective position information in the current setting period, and synthesizes the panoramic image corresponding to the effective position information in the current setting period according to the remaining images in the static image set corresponding to the effective position information in the current setting period.
And step 212, the 3D image synthesis unit stores the panoramic image corresponding to the effective position information in the current setting period to a corresponding storage root directory in the database.
Specifically, in this step, after generating the panoramic image corresponding to the effective position information in the current setting period, the 3D image synthesis unit may store the panoramic image corresponding to the effective position information in the current setting period into the corresponding storage root directory in the database. And storing the effective position information in the current set period and the corresponding panoramic image under the storage root directory.
Specifically, if a panoramic image corresponding to the valid location information in the last set period is stored under the storage root directory corresponding to the valid location information in the database, the panoramic image corresponding to the valid location information in the last set period stored under the storage root directory and the synthesis time thereof are stored in the image cache unit, the panoramic image corresponding to the valid location information in the last set period stored under the storage root directory is deleted, and the panoramic image corresponding to the valid location information in the current set period is stored in the storage root directory. Therefore, the panoramic image corresponding to the effective position information is updated every set period.
In this embodiment, the image cache unit is connected to a Client (Client), the Client has an access right of the image cache unit, and the image cache unit has a cache time, and starts to count time from when an image is stored, and automatically deletes the image when the cache time is exceeded. Therefore, the image cache unit in the implementation can be matched with the requirements of monitoring application.
When the position corresponding to the effective position information that the vehicle does not pass through is not available, the panoramic image corresponding to the effective position information in the previous set period is still stored under the storage root directory corresponding to the effective position information. In this embodiment, in the current setting period, the storage root directory corresponding to the effective position information is reserved to store the panoramic image in the previous setting period.
After storing all panoramic images corresponding to the valid position information in the current setting period into the database, the RESULT image set TABLE (RESULT _ TABLE) corresponding to the database needs to be updated, and the fields recorded in the RESULT image set TABLE include the valid position information, the corresponding update time, the storage root directory URL of the panoramic image, and the like.
And step 213, outputting the panoramic image corresponding to the effective position information in the current set period to the client by the 3D image synthesis unit, and ending the process.
In step 214, the 3D image synthesis unit obtains a panoramic image corresponding to the effective position information in the last set period.
When it is determined that the update indicator corresponding to the storage root directory corresponding to the valid location information in the current setting period is the second set value, it indicates that the static image set corresponding to the valid location information in the last setting period is stored under the storage root directory corresponding to the valid location information in the current setting period, that is, in the current setting period, the static image set stored under the storage root directory corresponding to the valid location information is not updated, and it is known that the panoramic image stored under the storage root directory corresponding to the valid location information is not updated, so step 214 is executed to obtain the panoramic image in the last setting period corresponding to the valid location information in the current setting period.
Specifically, the 3D image synthesis unit queries a storage path URL corresponding to the valid location information from the result image set table, and acquires a panoramic image corresponding to the valid location information in a previous setting period from the database according to the storage path URL.
The embodiment is based on a scene of the internet of vehicles, the MEC server based on the base station utilizes a big data service platform of the internet of vehicles to complete the processes of collecting, sampling, shuffling, synthesizing panoramic images and the like of videos of a real-time scene, a sampling period is set and is used as an updating period, in the current sampling period, frames corresponding to the same effective position information are combined by discretizing real-time video information shot by different vehicles, the frames are abstracted into a K-V mode in which the effective position information and the frames correspond one to one, the frames corresponding to each effective position information are converted into a static image set, a 3D image synthesizing unit can screen out proper images from the static image set according to certain screening conditions to synthesize the proper images into the panoramic images, and therefore the generation of the real-time panoramic images of the full maps in a cell with the base station as the center is.
The particularity that this kind of novel terminal of vehicle had is considered to this embodiment, make full use of vehicle self's functional device and motion characteristics, shoot the carrier with the removal of networking vehicle as real-time video information, and MEC server based on the basic station, the real-time video information that the district inner vehicle that covers through collecting the basic station was shot, through processing, the frame of the video stream that the different vehicle carriers in intercepting same place were shot, generate real-time 3D panoramic image according to certain rule, can realize the visualization of real-time traffic scene under the intelligent transportation system, still can provide the regional road conditions of target area and road all ring edge border information of current moment for the user, make the user obtain real-time information convenient and fast more, user's experience has effectively been promoted. In this embodiment, the client may be an upper layer APP, for example, a map APP, and then according to the panoramic image generation method provided in this embodiment, a user may view a real-time panoramic image of a target area in advance through the map APP. The embodiment can also be applied to traffic supervision, a traffic supervision department can acquire real-time traffic conditions of a city and the like, the embodiment can also be applied to live-action map navigation, vehicle tracking and the like, and the panoramic image generation method provided by the embodiment is widely applied and is not listed one by one.
In the technical scheme of the panoramic image generation method provided by the embodiment, a video sampling unit acquires real-time information of a vehicle-mounted terminal in a current set period, wherein the real-time information comprises effective position information and real-time video information; the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information; and generating a panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period, so that the generation of the full-map real-time panoramic image in the cell with the base station as the center is realized, the visualization of a real-time traffic scene under an intelligent traffic system is realized, the real-time updated actual scene of the target position can be provided for the user, the user experience is improved, and the multi-directional requirements of the user are met. According to the panoramic image generation method provided by the embodiment, the panoramic image can have a shorter update period, has better real-time performance, and is generated without using hardware equipment with higher cost.
Fig. 3 is a schematic structural diagram of a big data service platform in the internet of vehicles according to a third embodiment of the present invention, and as shown in fig. 3, the big data service platform in the internet of vehicles includes a video sampling unit 301 and a 3D image synthesizing unit 302.
The video sampling unit 301 is configured to acquire real-time information of the vehicle-mounted terminal in a current set period, where the real-time information includes effective position information and real-time video information corresponding to the effective position information; and generating a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information.
The 3D image synthesizing unit 302 is configured to generate a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period.
Specifically, the video sampling unit 301 is specifically configured to query all frames corresponding to the effective position information from a mapping relationship between each frame in the real-time video information and the effective position information, which is established in advance; and generating a static image set corresponding to the effective position information in the current set period according to all the frames corresponding to the effective position information.
In this embodiment, the internet of vehicles big data service platform further includes a database 303.
The video sampling unit 301 is further configured to store a static image set corresponding to effective position information in a current setting period to a corresponding storage root directory in the database 303; whether the static image set stored under the storage root directory corresponding to the valid location information in the database 303 is the static image set corresponding to the valid location information in the current setting period is judged, if yes, the update index corresponding to the storage root directory corresponding to the valid location information is set as a first setting value, and if not, the update index corresponding to the storage root directory corresponding to the valid location information is set as a second setting value.
The 3D image synthesizing unit 302 is specifically configured to obtain an update index corresponding to a storage root directory corresponding to effective location information in a current setting period; and judging whether the updating index is a first set value or a second set value, if so, generating a panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period, and if so, acquiring the panoramic image corresponding to the effective position information in the last set period.
In this embodiment, as shown in fig. 3, the internet of vehicles big data service platform further includes a video capture unit 304 and an image cache unit 305. The video acquisition unit 304 is connected with an external vehicle-mounted terminal, the video acquisition unit 304 is connected with the video sampling unit 301, the 3D image synthesis unit 302 and the image cache unit 305 are all connected with an external client, the video sampling unit 301 and the 3D image synthesis unit 302 are all connected with the database 303, and the 3D image synthesis unit 302 is further connected with the video sampling unit 301 and the image cache unit 305. Specifically, the internet of vehicles big data service platform provided in this embodiment is used to implement the panoramic image generation method provided in the second embodiment, and specific description may refer to the second embodiment, which is not described herein again in detail.
In the technical scheme of the internet of vehicles big data service platform provided by this embodiment, the video sampling unit is configured to acquire real-time information of the vehicle-mounted terminal in a current set period, where the real-time information includes effective position information and real-time video information, and generate a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information; and the 3D image synthesis unit is used for generating a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period. Therefore, the generation of the full-map real-time panoramic image in the cell with the base station as the center is realized, the visualization of a real-time traffic scene under an intelligent traffic system is realized, the real-time updated actual scene of the target position can be provided for a user, the user experience is improved, and the multi-directional requirements of the user are met. The car networking big data service platform that this embodiment provided, panoramic image can possess shorter update cycle, has better real-time, and need not to use the hardware equipment generation of higher cost.
Fig. 4 is a schematic structural diagram of a panoramic image generation system according to a fourth embodiment of the present invention, and as shown in fig. 4, the real-time panoramic image generation system includes a car networking big data service platform 401 and a car terminal 402, and the car terminal 402 is connected to the car networking big data service platform 401.
In this embodiment, the real-time panoramic image generation system further includes a client 403, and the client 403 is connected to the internet of vehicles big data service platform 401. The client 403 is configured to obtain a panoramic image corresponding to the effective location information output by the internet of vehicles big data service platform 401.
In the panoramic image generation system provided in this embodiment, the internet of vehicles big data service platform 401 adopts the internet of vehicles big data service platform provided in the second embodiment, and specific description may refer to the second embodiment, which is not described herein again in detail.
In the technical scheme of the panoramic image generation system provided by this embodiment, the video sampling unit is configured to acquire real-time information of the vehicle-mounted terminal in a current setting period, where the real-time information includes effective position information and real-time video information, and generate a static image set corresponding to the effective position information in the current setting period according to the effective position information and the real-time video information; and the 3D image synthesis unit is used for generating a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period. Therefore, the generation of the real-time panoramic image of the full map in the cell with the base station as the center is realized, the visualization of the real-time traffic scene under an intelligent traffic system is realized, the real-time updated actual scene of the target position can be provided for the user, the user experience is improved, and the multi-directional requirements of the user are met. According to the panoramic image generation system provided by the embodiment, the panoramic image can have a shorter update period, has better real-time performance, and is generated without using hardware equipment with higher cost.
It will be understood that the above embodiments are merely exemplary embodiments taken to illustrate the principles of the present invention, which is not limited thereto. It will be apparent to those skilled in the art that various modifications and improvements can be made without departing from the spirit and substance of the invention, and these modifications and improvements are also considered to be within the scope of the invention.
Claims (8)
1. A panoramic image generation method, characterized by comprising:
the method comprises the steps that a video acquisition unit acquires real-time information of a vehicle-mounted terminal, wherein the real-time information comprises effective position information and real-time video information corresponding to the effective position information; the video acquisition unit is a base station carrying a mobile edge computing server;
the video acquisition unit establishes a mapping relation between each frame in the real-time video information and the effective position information according to the effective position information and the real-time video information;
the video sampling unit acquires real-time information of the vehicle-mounted terminal in a current set period;
the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information;
the 3D image synthesis unit generates a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period;
the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to the effective position information and the real-time video information, and the static image set comprises:
the video sampling unit inquires all frames corresponding to the effective position information from the mapping relation between each frame in the real-time video information and the effective position information which is established in advance;
and the video sampling unit generates a static image set corresponding to the effective position information in the current set period according to all the frames corresponding to the effective position information.
2. The method of claim 1, wherein the video sampling unit further generates a static image set corresponding to the effective position information in a current setting period according to the effective position information and the real-time video information, and then:
the video sampling unit stores the static image set corresponding to the effective position information in the current set period to a corresponding storage root directory in a database;
the video sampling unit judges whether a static image set stored under a storage root directory corresponding to effective position information in a database is a static image set corresponding to the effective position information in a current set period or not, if so, an updating index corresponding to the storage root directory corresponding to the effective position information is set as a first set value, and if not, an updating index corresponding to the storage root directory corresponding to the effective position information is set as a second set value;
the 3D image synthesis unit acquires an update index corresponding to the effective position information in the current set period;
and the 3D image synthesis unit judges whether the updating index is a first set value or a second set value, and if the updating index is judged to be the first set value, the step of generating the panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period is executed.
3. The panoramic image generation method according to claim 2,
and if the 3D image synthesis unit judges that the updating index is the second set value, acquiring the panoramic image corresponding to the effective position information in the last set period.
4. The utility model provides a big data service platform of car networking which characterized in that includes:
the system comprises a video acquisition unit, a video processing unit and a video processing unit, wherein the video acquisition unit is used for acquiring real-time information of a vehicle-mounted terminal, and the real-time information comprises effective position information and real-time video information corresponding to the effective position information; the video acquisition unit is a base station carrying a mobile edge computing server; establishing a mapping relation between each frame in the real-time video information and the effective position information according to the effective position information and the real-time video information;
the video sampling unit is used for acquiring the real-time information of the vehicle-mounted terminal in the current set period; generating a static image set corresponding to the effective position information in a current set period according to the effective position information and the real-time video information;
the 3D image synthesis unit is used for generating a panoramic image corresponding to the effective position information in the current setting period according to the static image set corresponding to the effective position information in the current setting period;
the video sampling unit is specifically configured to query all frames corresponding to the effective position information from a mapping relationship between each frame in the real-time video information and the effective position information, which is established in advance; and generating a static image set corresponding to the effective position information in the current set period according to all the frames corresponding to the effective position information.
5. The Internet of vehicles big data service platform of claim 4, further comprising a database;
the video sampling unit is also used for storing the static image set corresponding to the effective position information in the current set period to the corresponding storage root directory in the database; judging whether a static image set stored under a storage root directory corresponding to effective position information in a database is a static image set corresponding to the effective position information in a current set period or not, if so, setting an update index corresponding to the storage root directory corresponding to the effective position information as a first set value, and if not, setting the update index corresponding to the storage root directory corresponding to the effective position information as a second set value;
the 3D image synthesis unit is specifically used for acquiring an update index corresponding to a storage root directory corresponding to effective position information in a current set period; and judging whether the updating index is a first set value or a second set value, and if the updating index is the first set value, generating a panoramic image corresponding to the effective position information in the current set period according to the static image set corresponding to the effective position information in the current set period.
6. The Internet of vehicles big data service platform of claim 5,
the 3D image synthesizing unit is further specifically configured to obtain a panoramic image corresponding to the effective position information in the previous setting period if it is determined that the update indicator is the second setting value.
7. A panoramic image generation system is characterized by comprising a vehicle-mounted terminal and the Internet of vehicles big data service platform of any one of claims 4 to 6, wherein the vehicle-mounted terminal is connected with the Internet of vehicles big data service platform.
8. The panoramic image generation system of claim 7, further comprising a client connected with the internet of vehicles big data service platform;
the client is used for acquiring the panoramic image corresponding to the effective position information output by the Internet of vehicles big data service platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810142602.9A CN108282635B (en) | 2018-02-11 | 2018-02-11 | Panoramic image generation method and system and Internet of vehicles big data service platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810142602.9A CN108282635B (en) | 2018-02-11 | 2018-02-11 | Panoramic image generation method and system and Internet of vehicles big data service platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108282635A CN108282635A (en) | 2018-07-13 |
| CN108282635B true CN108282635B (en) | 2020-11-10 |
Family
ID=62808337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810142602.9A Active CN108282635B (en) | 2018-02-11 | 2018-02-11 | Panoramic image generation method and system and Internet of vehicles big data service platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108282635B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109302709B (en) * | 2018-09-14 | 2022-04-05 | 重庆邮电大学 | Mobile edge computing-oriented vehicle networking task unloading and resource allocation strategy |
| CN109687340A (en) * | 2018-11-28 | 2019-04-26 | 国网辽宁省电力有限公司丹东供电公司 | The transmission line of electricity inspection system that full-view image is merged with virtual reality |
| CN110186471A (en) * | 2019-05-06 | 2019-08-30 | 平安科技（深圳）有限公司 | Air navigation aid, device, computer equipment and storage medium based on history video |
| CN110266664B (en) * | 2019-06-05 | 2021-07-09 | 中国联合网络通信有限公司广州市分公司 | Cloud VR video live broadcast system based on 5G and MEC |
| CN110379162B (en) * | 2019-07-23 | 2021-01-26 | 广东工业大学 | Vehicle violation monitoring method, device, equipment and computer readable storage medium |
| KR20220133207A (en) * | 2020-04-15 | 2022-10-04 | 지티이 코포레이션 | Volumetric visual media processing method and apparatus |
| CN112013867B (en) * | 2020-09-09 | 2022-03-29 | 深圳市掌锐电子有限公司 | AR navigation pre-display cruise system based on live-action feedback |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002213984A (en) * | 2001-01-12 | 2002-07-31 | Oojisu Soken:Kk | Guide system by panoramic image, central device and terminal device, and computer program and recording medium |
| CN102737509A (en) * | 2012-06-29 | 2012-10-17 | 惠州天缘电子有限公司 | Method and system for realizing image information sharing based on internet of vehicles |
| CN104573733A (en) * | 2014-12-26 | 2015-04-29 | 上海交通大学 | High-precision map generation system and method based on high-definition ortho-photo map |
| CN105291984A (en) * | 2015-11-13 | 2016-02-03 | 中国石油大学(华东) | Pedestrian and vehicle detecting method and system based on multi-vehicle cooperation |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9042454B2 (en) * | 2007-01-12 | 2015-05-26 | Activevideo Networks, Inc. | Interactive encoded content system including object models for viewing on a remote device |
| KR102021050B1 (en) * | 2012-06-06 | 2019-09-11 | 삼성전자주식회사 | Method for providing navigation information, machine-readable storage medium, mobile terminal and server |
| US20160237487A1 (en) * | 2015-02-10 | 2016-08-18 | The Texas A&M University System | Modeling and Predicting Differential Alternative Splicing Events and Applications Thereof |
-
2018
- 2018-02-11 CN CN201810142602.9A patent/CN108282635B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002213984A (en) * | 2001-01-12 | 2002-07-31 | Oojisu Soken:Kk | Guide system by panoramic image, central device and terminal device, and computer program and recording medium |
| CN102737509A (en) * | 2012-06-29 | 2012-10-17 | 惠州天缘电子有限公司 | Method and system for realizing image information sharing based on internet of vehicles |
| CN104573733A (en) * | 2014-12-26 | 2015-04-29 | 上海交通大学 | High-precision map generation system and method based on high-definition ortho-photo map |
| CN105291984A (en) * | 2015-11-13 | 2016-02-03 | 中国石油大学(华东) | Pedestrian and vehicle detecting method and system based on multi-vehicle cooperation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108282635A (en) | 2018-07-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108282635B (en) | Panoramic image generation method and system and Internet of vehicles big data service platform | |
| JP6486744B2 (en) | Regional monitoring server, providing terminal and system thereof | |
| CN106027960B (en) | A kind of positioning system and method | |
| JP6916888B2 (en) | Virtual prop allocation method, server, client and storage medium | |
| EP4116938A1 (en) | Image generating device, image generating method, recording medium generating method, learning model generating device, learning model generating method, learning model, data processing device, data processing method, inferring method, electronic instrument, generating method, program, and non-transitory computer-readable medium | |
| CN112288906B (en) | Method and device for acquiring simulation data set, storage medium and electronic equipment | |
| CN105847756B (en) | Video identification tracking location system based on the dotted fitting in position | |
| CN108955715A (en) | navigation video generation method, video navigation method and system | |
| CN101211337A (en) | Classification method for digital photo with geographic position information | |
| CN109960969B (en) | Method, device and system for generating moving route | |
| CN108769576B (en) | Intelligent video processing method and system | |
| CN113115216B (en) | Indoor positioning method, service management server and computer storage medium | |
| CN102831816B (en) | Device for providing real-time scene graph | |
| CN109523499A (en) | A kind of multi-source fusion full-view modeling method based on crowdsourcing | |
| CN110710199B (en) | Smart camera, image processing apparatus, and data communication method | |
| CN112632124B (en) | Multimedia information acquisition method, device, system, storage medium and electronic device | |
| KR20140022680A (en) | System and method for managing integrated image of vehicle blackbox | |
| CN103686239A (en) | Network sharing crime evidence obtaining system and method based on location videos | |
| CN114051100B (en) | Method, system and terminal equipment for sharing photographing information in real time | |
| CN106612414A (en) | Tracking control method for suspicious target of key region video | |
| CN107249016B (en) | Information pushing method and device | |
| CN111695589B (en) | Intelligent state Internet of things cloud monitoring method and artificial intelligent robot system | |
| CN101841765A (en) | Method based on mobile communication network for generating multimedia containing position information by using mobile phone | |
| CN114189631A (en) | Shooting method and electronic equipment | |
| US11222427B2 (en) | Image compression |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210913 Address after: 101500 room 106-266, building 2, courtyard 8, Xingsheng South Road, Miyun District, Beijing Patentee after: Unicom Zhiwang Technology Co.,Ltd. Address before: 100033 21 Finance Street, Xicheng District, Beijing. Patentee before: CHINA UNITED NETWORK COMMUNICATIONS GROUP Co.,Ltd. |
|
| TR01 | Transfer of patent right |