Summary of the invention
In view of this, this application provides a kind of method and system thereof of the virtual reality video playback based on geographical position, the geographical position in conjunction with mobile terminal is play about the video stream data in described geographical position, thus provides more recreation experience for user.
In order to solve the problems of the technologies described above, this application discloses a kind of method of the virtual reality video playback based on geographical position, being applied to the browser of mobile terminal, it is characterized in that, comprising:
Monitor the geographical location information from described mobile terminal, described geographical location information represents the described geographical position residing for described mobile terminal;
From database, the video stream data corresponding to described geographical position is obtained according to described geographical location information;
Receive the view data from the camera of described mobile terminal;
Judge whether described first frame of described video stream data mates with described view data; And
When described first frame of described video stream data and described view data match, the window of browsing of described browser is indicated to play described video stream data.
Preferably, wherein, also comprise:
When described first frame of described video stream data does not mate with described view data, send information, described information is for pointing out the arrival of described mobile terminal corresponding to the geographical position of described first frame of described video stream data.
Preferably, wherein, also comprise:
After obtaining described video stream data corresponding to described geographical position, indicate described first frame browsed window described in described browser and show described video stream data.
Preferably, wherein, indicate the step that window plays described video stream data of browsing of described browser to comprise further when described first frame of described video stream data and described view data match:
When described first frame of described video stream data and described view data match, generate play instruction;
Described video stream data is play according to browsing window described in described play instruction instruction.
Preferably, wherein, the wireless signal received by the global positioning system of described mobile terminal, user's input, described mobile terminal and/or the Quick Response Code of described camera shooting generate described geographical location information.
In order to solve the problems of the technologies described above, disclosed herein as well is a kind of system of the virtual reality video playback based on geographical position, this system comprises:
Monitoring unit, for monitoring the geographical location information from described mobile terminal, described geographical location information represents the described geographical position residing for described mobile terminal;
Acquiring unit, for obtaining the video stream data corresponding to described geographical position from database according to described geographical location information;
Receiving element, for receiving the view data of the camera from described mobile terminal;
Judging unit, for judging whether described first frame of described video stream data mates with described view data; And
Indicating member, for when described first frame of described video stream data and described view data match, indicates the window of browsing of described browser to play described video stream data.
Preferably, wherein, also comprise:
Tip element, for sending information when described first frame of described video stream data does not mate with described view data, described information is for pointing out the arrival of described mobile terminal corresponding to the geographical position of described first frame of described video stream data.
Preferably, wherein, after obtaining described video stream data corresponding to described geographical position, described indicating member is used to indicate described first frame browsed window described in described browser and show described video stream data.
Preferably, wherein, when described judging unit judges that described first frame of described video stream data and described view data match, described indicating member generates play instruction, browses window and play described video stream data described in being used to indicate.
Preferably, wherein, described geographical location information is that the Quick Response Code of wireless signal and/or the described camera shooting received by the global positioning system of described mobile terminal, user's input, described mobile terminal is generated.
Compared with prior art, a kind of virtual reality video broadcasting method based on geographical position described in the application and system thereof, reach following effect:
1) geographical position in conjunction with mobile terminal is play about the video stream data in described geographical position, thus provide more about the recreation experience in this geographical position for user, such as better understand about this geographical position humanistic philosohpy, better understand this geographical position full spectrum information, carry out interaction etc. by video stream data and real scene.
2) can according to video stream data, indicating user arrives the definite geographical position about this video stream data, user can be obtained and view and admire angle about this geographical position the best.
3) the virtual reality video broadcasting method based on geographical position in the application and system thereof can be applied to different browsers and carry in the different mobile terminal of this browser, practical.
Certainly, the arbitrary product implementing the application might not need to reach above-described all technique effects simultaneously.
Embodiment
As employed some vocabulary to censure specific components in the middle of specification and claim.Those skilled in the art should understand, and hardware manufacturer may call same assembly with different noun.This specification and claims are not used as with the difference of title the mode distinguishing assembly, but are used as the criterion of differentiation with assembly difference functionally." comprising " as mentioned in the middle of specification and claim is in the whole text an open language, therefore should be construed to " comprise but be not limited to "." roughly " refer to that in receivable error range, those skilled in the art can solve the technical problem within the scope of certain error, reach described technique effect substantially.In addition, " couple " word and comprise directly any and indirectly electric property coupling means at this.Therefore, if describe a first device in literary composition to be coupled to one second device, then represent described first device and directly can be electrically coupled to described second device, or be indirectly electrically coupled to described second device by other devices or the means that couple.Specification subsequent descriptions is implement the better embodiment of the application, and right described description is for the purpose of the rule that the application is described, and is not used to the scope limiting the application.The protection range of the application is when being as the criterion depending on the claims person of defining.
Fig. 1 is the flow chart of the method for a kind of virtual reality video playback based on geographical position of foundation the application one embodiment.As shown in Figure 1, the method comprises the following steps.
Step 101, monitors the geographical location information from mobile terminal, and described geographical location information represents the geographical position residing for described mobile terminal.
The mobile terminal of the application includes but not limited to: the mobile devices such as notebook computer, panel computer, smart mobile phone, personal digital assistant.Geographical location information is generated by the Quick Response Code of the camera shooting of the global positioning system of mobile terminal, user's input, wireless signal that mobile terminal receives and/or mobile terminal.Such as, in an embodiment of the application, mobile terminal is smart mobile phone, therefore obtains the geographical position residing for smart mobile phone by the global positioning system (GPS) of smart mobile phone, this geographical position is converted to geographical location information.In another embodiment of the application, mobile terminal is panel computer, therefore the camera by panel computer takes the Quick Response Code that geographical position residing for it is placed, wherein this Quick Response Code is relevant to geographical position, by decoding to this Quick Response Code, the geographical position residing for panel computer can be obtained.In the another embodiment of the application, mobile terminal is smart mobile phone, and the radio signal therefore received by mobile terminal is to obtain geographical position.Such as, when this radio signal is Wifi signal, the MAC Address by scanning Wifi access point (AccessPoint is called for short AP) inquires corresponding geographical position; When this radio signal is such as 2G, 3G or 4G signal, the base station location (CLLEID and LAC) by sending this 2G, 3G or 4G signal obtains the geographical position of mobile terminal.In an embodiment again of the application, user is by input unit (such as touch-screen, keyboard, voice-input unit etc.) the input geographical location information of mobile terminal.
Step 102, obtains the video stream data corresponding to described geographical position according to described geographical location information from database.
Database in the application is used for stored video data stream, and it can be the database in far-end server, also can be the database in home server, and the present invention is not as limit.In one embodiment, database comprises a table of comparisons further, as shown in table 1 below, and this table of comparisons represents the corresponding relation of geographical position and video stream data.After listening to geographical location information, from database, obtain the video stream data corresponding to geographical position according to this table of comparisons.
Table 1
In an embodiment of the application, can automatically choose the video stream data the highest with this geographical position matching degree according to geographical location information from multiple video stream datas of database purchase.Such as when geographical positional representation mobile terminal is positioned at " the Forbidden City ", automatically choose documentary film " the Forbidden City " as video stream data corresponding to this geographical position.In another embodiment of the application, the video stream data mated the most with this geographical position that the selection by user chooses from database that user thinks.Such as when geographical positional representation mobile terminal is positioned at " Pigeons' Nest ", user selects this video stream data of (such as being chosen by touch-screen or physical keyboard) " Pigeons' Nest park ".
Step 103, receives the view data of the camera from mobile terminal.
In an embodiment of the application, camera can be front-facing camera and also can be post-positioned pick-up head, the scene image observed by camera, can know the scene that current user watches definitely.
Step 104, judges whether described first frame (also can be the image of key point, not do concrete restriction here) of described video stream data mates with described view data.
As understood by those skilled in the art, it is no matter the geographical location information that the wireless signal received by the global positioning system of mobile terminal, user's input, mobile terminal is generated, or by the geographical location information that the Quick Response Code that the camera of mobile terminal is taken generates, all there is certain error in it.In other words, there is the error of certain limit in the geographical position represented by these geographical location information and the geographical position residing for mobile terminal, such as the error of about 10 meters of GPS location.And due to the information of video stream data very abundant, it can comprise the different angles in same place, the visual information of different scene, even if therefore in same place, because viewing angle is different, the picture enjoyed also can be different.In order to be better combined with actual scene by video, thus bring user better Consumer's Experience, the application judges whether the first frame of video stream data obtained in a step 102 mates with the image (i.e. camera picture) of camera.The process of this coupling realizes by matching algorithms such as such as Least squares matching, correlation coefficient matching method, characteristic matching, and the present invention is not as limit.
In step 105, when the view data of the first frame and camera that judge video stream data matches, described video stream data play by the window of browsing of the browser of indicating mobile terminal.
In one embodiment of this invention, browsing window can be carrier for display network page content in mobile terminal, it can be the display window of the browser run in the terminal, also can be the application program (Application operating in mobile terminal, APP) (indication range of APP window is now exactly the indication range of mobile terminal screen to window, namely in the case, the screen that window is exactly mobile terminal is browsed).In one embodiment of this invention, generate play instruction, send the browser of this play instruction to mobile terminal when the first frame of video stream data and the view data of camera match, described video stream data play by the window of browsing of instruction browser.
In step 106, when judging that the first frame of video stream data does not mate with the view data of camera, send information, described information is used for the geographical position of prompting mobile terminal arrival corresponding to the first frame of video stream data.
In one embodiment of this invention, after obtaining video stream data corresponding to geographical position, the browser of indicating mobile terminal browse the first frame that window shows described video stream data.When judging that the first frame of video stream data does not mate with the view data of camera, send information.In one embodiment, this information can be information of voice prompt, the moving direction of voice message mobile terminal and displacement.In another embodiment, this information can be the mark (such as arrow logo, words identification etc.) be shown on the picture of camera, for moving direction and the displacement of prompting mobile terminal in real time.In another embodiment, this information can be the mark (such as arrow logo, words identification etc.) being shown in and browsing window, for moving direction and the displacement of prompting mobile terminal in real time.By the prompting of information, make mobile terminal finally arrive the definite geographical position of the first frame corresponding to video stream data, such as, the picture of camera overlaps with the first frame height of video stream data.
Fig. 2 is the system block diagram of a kind of virtual reality video playback based on geographical position according to the application one embodiment.As shown in Figure 2, this system comprises monitoring unit 201, acquiring unit 202, receiving element 203, judging unit 204, indicating member 205 and Tip element 206.
Monitoring unit 201, for monitoring the geographical location information from mobile terminal, described geographical location information represents the geographical position residing for described mobile terminal.
Wherein mobile terminal includes but not limited to: the mobile devices such as notebook computer, panel computer, smart mobile phone, personal digital assistant.Geographical location information is generated by the Quick Response Code of the camera shooting of the global positioning system of mobile terminal, user's input, wireless signal that mobile terminal receives and/or mobile terminal.Such as, in an embodiment of the application, mobile terminal is smart mobile phone, therefore obtains the geographical position residing for smart mobile phone by the global positioning system (GPS) of smart mobile phone, this geographical position is converted to geographical location information.In another embodiment of the application, mobile terminal is panel computer, therefore the camera by panel computer takes the Quick Response Code that geographical position residing for it is placed, wherein this Quick Response Code is relevant to geographical position, by decoding to this Quick Response Code, the geographical position residing for panel computer can be obtained.In the another embodiment of the application, mobile terminal is smart mobile phone, and the radio signal therefore received by mobile terminal is to obtain geographical position.Such as, when this radio signal is Wifi signal, the MAC Address by scanning Wifi access point (AccessPoint is called for short AP) inquires corresponding geographical position; When this radio signal is such as 2G, 3G or 4G signal, the base station location (CLLEID and LAC) by sending this 2G, 3G or 4G signal obtains the geographical position of mobile terminal.In an embodiment again of the application, user is by input unit (such as touch-screen, keyboard, voice-input unit etc.) the input geographical location information of mobile terminal.
Acquiring unit 202, couples monitoring unit 201, receives geographical location information from monitoring unit 201, and from database, obtains the video stream data corresponding to described geographical position according to described geographical location information.
Database in the application is used for stored video data stream, and it can be the database in far-end server, also can be the database in home server, and the present invention is not as limit.In one embodiment, database comprises a table of comparisons further, and this table of comparisons represents the corresponding relation of geographical position and video stream data.After monitoring unit 201 listens to geographical location information, acquiring unit 202 obtains the video stream data corresponding to geographical position according to this table of comparisons from database.
In an embodiment of the application, acquiring unit 202 can automatically choose the video stream data the highest with this geographical position matching degree according to geographical location information from multiple video stream datas of database purchase.Such as when geographical positional representation mobile terminal is positioned at " the Forbidden City ", acquiring unit 202 chooses documentary film " the Forbidden City " automatically as video stream data corresponding to this geographical position.In another embodiment of the application, by the selection of user, the video stream data mated the most with this geographical position that acquiring unit 202 chooses from database that user thinks.Such as when geographical positional representation mobile terminal is positioned at " Pigeons' Nest ", user selects this video stream data of (such as being chosen by touch-screen or physical keyboard) " Pigeons' Nest park " by acquiring unit 202.
Receiving element 203, couples the camera of mobile terminal, for receiving the view data of the camera from mobile terminal.In an embodiment of the application, camera can be front-facing camera and also can be post-positioned pick-up head, the scene image observed by camera, can know the scene that current user watches definitely.
Judging unit 204, couples acquiring unit 202 and receiving element 203, receives view data, and judge whether described first frame of described video stream data mates with described view data from acquiring unit 202 receiver, video flow data from receiving element 203.Judge whether coupling by matching algorithms such as such as Least squares matching, correlation coefficient matching method, characteristic matching, the present invention is not as limit.
Indicating member 205, couples judging unit 204, and when judging unit 204 judges the first frame of video stream data and the view data of camera matches, described video stream data play by the window of browsing of the browser of indicating member 205 indicating mobile terminal.
In one embodiment of this invention, browsing window can be carrier for display network page content in mobile terminal, it can be the display window of the browser run in the terminal, also can be the application program (Application operating in mobile terminal, APP) (indication range of APP window is now exactly the indication range of mobile terminal screen to window, namely in the case, the screen that window is exactly mobile terminal is browsed).In one embodiment of this invention, when the first frame of video stream data and the view data of camera match, indicating member 205 generates play instruction, sends the browser of this play instruction to mobile terminal, and described video stream data play by the window of browsing of instruction browser.
Tip element 206, couple judging unit 204, when judging unit 204 judges that the first frame of video stream data does not mate with the view data of camera, Tip element 206 sends information, and described information is used for the geographical position of prompting mobile terminal arrival corresponding to the first frame of video stream data.
In one embodiment, this information can be information of voice prompt, the moving direction of voice message mobile terminal and displacement.In another embodiment, this information can be the mark (such as arrow logo, words identification etc.) be shown on the picture of camera, for moving direction and the displacement of prompting mobile terminal in real time.In another embodiment, this information can be the mark (such as arrow logo, words identification etc.) being shown in and browsing window, for moving direction and the displacement of prompting mobile terminal in real time.By the prompting of information, make mobile terminal finally arrive the definite geographical position of the first frame corresponding to video stream data, such as, the picture of camera overlaps with the first frame height of video stream data.
In one embodiment of this invention, indicating member 206 couples acquiring unit 202(figure further and does not show), after acquiring unit 202 obtains the video stream data corresponding to geographical position, indicating member 206 further indicating mobile terminal browser browse the first frame that window shows described video stream data.
Because method part has been described in detail the embodiment of the present application, the expansion of the System and method for corresponding part related in embodiment is described omit here, repeat no more.Description for particular content in system can the content of reference method embodiment, no longer specifically limits here.
Below in conjunction with Fig. 3 and 4, the method for the described virtual reality video playback based on geographical position and the embody rule scene of system thereof are described in detail.
As shown in Figure 3, visitor A plays in Xiangshan, thinks that Fragrance Hill is picturesque, so have taken the video on mountain top, one section of Fragrance Hill with mobile phone and upload in the remote data storehouse of video website, is named as " Xiangshan ".Spent a period of time, visitor B also arrives Fragrance Hill and plays, and the mobile phone due to visitor B opens such as GPS positioning function, the geographical location information " Fragrance Hill " therefore residing for visitor B listen to by the system of the virtual reality video playback based on geographical position.According to this geographical location information " Fragrance Hill ", the video corresponding to " Fragrance Hill " " Xiangshan " be stored in database is acquired.Meanwhile, visitor B opens the camera of mobile phone, so camera shows the view data about current geographic position, as shown in Figure 3, the camera of visitor B also shows the landscape on mountain top, Fragrance Hill.Based on this view data of system acceptance of the virtual reality video playback in geographical position, and compare with the first frame of obtained video " Xiangshan ", to judge whether both mate.When judging not mate, the picture of the mobile phone camera of visitor B generating an arrow left, and points out visitor B shift position with word " 10 steps of turning left away ".If after mobile, when the camera picture judging now is mated with the first frame of video " Xiangshan ", then generation play instruction browses window displaying video " Xiangshan " in order to what indicate the browser of visitor B mobile phone.In an embody rule scene, after the video corresponding to " Fragrance Hill " " Xiangshan " be stored in database is acquired, its first frame can be shown in browsing in window of visitor B mobile phone.
As shown in Figure 4, when visitor B mobile phone starts displaying video " Xiangshan ", because the picture play is consistent with the landscape that camera is watched, therefore, from the visual angle of visitor B, real landscape (landscape outside mobile phone screen) can realize seamlessly being connected with virtual landscape (video that mobile phone screen is play).Visitor B can obtain abundant sensory information by this virtual reality video of viewing, thus brings unrivaled recreation experience.
Compared with prior art, a kind of virtual reality video broadcasting method based on geographical position described in the application and system thereof, reach following effect:
1) geographical position in conjunction with mobile terminal is play about the video stream data in described geographical position, thus provide more about the recreation experience in this geographical position for user, such as better understand about this geographical position humanistic philosohpy, better understand this geographical position full spectrum information, carry out interaction etc. by video stream data and real scene.
2) can according to video stream data, indicating user arrives the definite geographical position about this video stream data, user can be obtained and view and admire angle about this geographical position the best.
3) the virtual reality video broadcasting method based on geographical position in the application and system thereof can be applied to different browsers and carry in the different mobile terminal of this browser, practical.
Also it should be noted that, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, commodity or system and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, commodity or system.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, commodity or the system comprising described key element and also there is other identical element.
It will be understood by those skilled in the art that the embodiment of the application can be provided as method, system or computer program.Therefore, the application can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the application can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) of computer usable program code.
The foregoing is only the embodiment of the application, be not limited to the application.To those skilled in the art, the application can have various modifications and variations.Any amendment done within all spirit in the application and principle, equivalent replacement, improvement etc., within the right that all should be included in the application.