CN109104632A - A kind of realization method and system of television terminal AR scene - Google Patents
A kind of realization method and system of television terminal AR scene Download PDFInfo
- Publication number
- CN109104632A CN109104632A CN201811131776.1A CN201811131776A CN109104632A CN 109104632 A CN109104632 A CN 109104632A CN 201811131776 A CN201811131776 A CN 201811131776A CN 109104632 A CN109104632 A CN 109104632A
- Authority
- CN
- China
- Prior art keywords
- image
- scene
- reality
- mobile terminal
- virtual scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The embodiment of the present application provides a kind of realization method and system of television terminal AR scene, is related to augmented reality field.This method comprises: mobile terminal obtains reality scene image in real time；The reality scene image is sent to cloud server by mobile terminal；Cloud server determines virtual scene information according to reality scene image；Mobile terminal receives the virtual scene information；The virtual scene information in real time in conjunction with the reality scene image, is obtained AR scene by mobile terminal；The AR scene is sent to television terminal.Can not only AR scene quickly and accurately be presented in television terminal in the realization method and system of AR scene provided by the embodiments of the present application, and use cost is lower, has stronger market adaptability.
Description
Technical field
This application involves the implementation method of augmented reality field more particularly to a kind of television terminal AR scene and it is
System.
Background technique
AR (AugmentedReality, augmented reality) technology can add virtual scene in real scene, so that very
Real field scape combines together with virtual scene, and can be realized the real-time synchronization of virtual scene and real scene, forms AR scene,
It allows users to truly experience the things simulated in virtual scene in real world, enhances understanding of the user to true environment
With experience.Therefore, application of the AR technology in fields such as education, medical treatment, amusement, medium, industry is very extensive.
Currently, the AR scene of television terminal usually requires to realize by dedicated external accessory.Specifically, such as Fig. 1
It is shown, in order to which AR scene is presented on television terminal, it usually needs dedicated camera and AR are arranged except the television terminal
Set-top box, the camera are connect with the AR set-top box, which connect with the television terminal, and pre- in the AR set-top box
First it is stored with image recognition library and virtual scene information corresponding with the image recognition library.The camera is existing for obtaining in real time
Real scene image, and the reality scene image is sent to the AR set-top box.The AR set-top box is needed to the reality scene image
It is constantly identified, determines corresponding virtual scene information in real time according to recognition result, and by the virtual scene information and reality
Scene image combines, and obtains AR scene.Then, which is sent to television terminal, is shown by television terminal, for
User's viewing.
In above process, in order to guarantee the consistency of virtual scene information and live image, which needs frequent
Ground identification reality scene image simultaneously handles virtual scene model.However, the data-handling capacity phase of AR set-top box under normal conditions
To weaker, when the identification frequency to reality scene image is higher, which will be unable to carry out reality scene content fast
Speed and accurately identification and registration cause reality scene and virtual scene to mismatch, and AR scene occur abnormal.
Summary of the invention
This application provides a kind of realization method and systems of television terminal AR scene, can not be right for solving the prior art
Reality scene content is quickly and accurately identified and registration, causes reality scene and virtual scene to mismatch, makes AR
There is abnormal problem in scene.
In a first aspect, the embodiment of the present application provides a kind of implementation method of television terminal AR scene, it is applied to mobile terminal,
The described method includes: obtaining reality scene image in real time；The reality scene image is sent to cloud server, the reality
Scene image is for determining virtual scene information；Receive the virtual scene information；In real time and institute by the virtual scene information
The combination of reality scene image is stated, AR scene is obtained；The AR scene is sent to television terminal.
Second aspect, the embodiment of the present application provide a kind of implementation method of television terminal AR scene, are applied to cloud service
Device, which comprises receive the reality scene image that mobile terminal is sent；Virtual field is determined according to the reality scene image
Scape information；The virtual scene information is sent to mobile terminal, the virtual scene information is used for the mobile terminal for institute
Virtual scene information is stated in real time in conjunction with the reality scene image, obtains AR scene, and the AR scene is sent to TV
Terminal.
The third aspect, the embodiment of the present application provide a kind of existing method of television terminal AR scene, are applied to mobile terminal, packet
It includes: obtaining reality scene image in real time, the reality scene image includes the characteristic image that television terminal is shown, the characteristic pattern
As being determined according to the configuration of O&M server；The reality scene image is sent to cloud server, the reality scene figure
As for determining virtual scene information；Receive the virtual scene information；By the virtual scene information in real time with the reality
Scene image combines, and obtains and shows AR scene.
Fourth aspect, the embodiment of the present application provide a kind of implementation method of television terminal AR scene, are applied to cloud service
Device, comprising: receive the reality scene image that mobile terminal is sent, the reality scene image includes the feature that television terminal is shown
Image, the characteristic image are determined according to the configuration of O&M server；Determine that virtual scene is believed according to the reality scene image
Breath；The virtual scene information is sent to mobile terminal, the virtual scene information is used for the mobile terminal for the void
Quasi- scene information in conjunction with the reality scene image, obtains in real time and shows AR scene.
5th aspect, the embodiment of the present application provide a kind of realization system of television terminal AR scene, comprising: mobile terminal,
For obtaining reality scene image in real time；The reality scene image is sent to cloud server；Cloud server is used for root
Virtual scene information is determined according to the reality scene image, and the virtual scene information is sent to the mobile terminal；Institute
Mobile terminal is stated, is also used to receive the virtual scene information；By the virtual scene information in real time with the reality scene figure
As combining, AR scene is obtained；And the AR scene is sent to television terminal；Television terminal, it is described for receiving and showing
AR scene.
6th aspect, the embodiment of the present application provide a kind of realization system of television terminal AR scene, comprising: O&M service
Device, the characteristic image shown for configuring television terminal；Television terminal, for showing the spy according to the configuration of O&M server
Levy image；Mobile terminal, for obtaining reality scene image in real time, the reality scene image includes the spy that television terminal is shown
Image is levied, the characteristic image is determined according to the configuration of O&M server；The reality scene image is sent to cloud service
Device；Cloud server for determining virtual scene information according to the reality scene image, and the virtual scene information is sent out
Give the mobile terminal；The mobile terminal is also used to receive the virtual scene information；And by the virtual scene information
In real time in conjunction with the reality scene image, obtains and show AR scene.
In the realization method and system of the television terminal AR scene shown in the embodiment of the present application, mobile terminal can will be obtained
The reality scene image got is sent to cloud server, carries out image recognition and virtual scene information tune by cloud server
It takes, reduces the occupancy to mobile terminal resource, mobile terminal is enable quickly and accurately to generate AR scene, avoid AR scene
Occur abnormal.In addition, can be shown on television terminal by the collective effect of mobile terminal, cloud server and television terminal
Show AR scene, or realize and show interacting for content with television terminal, without additionally configuring dedicated camera and set-top box, drops
The cost that low television terminal AR scene generates has stronger market adaptability.
Detailed description of the invention
In order to illustrate more clearly of the technical solution of the application, letter will be made to attached drawing needed in the embodiment below
Singly introduce, it should be apparent that, for those of ordinary skills, without any creative labor,
It is also possible to obtain other drawings based on these drawings.
Fig. 1 is the structural schematic diagram of television terminal AR Scene realization system in the prior art.
Fig. 2 is the flow chart one of the implementation method of television terminal AR scene provided by the embodiments of the present application.
Fig. 3 is the flowchart 2 of the implementation method of television terminal AR scene provided by the embodiments of the present application.
Fig. 4 is the schematic diagram one of the realization system of television terminal AR scene provided by the embodiments of the present application.
Fig. 5 is the schematic diagram two of the realization system of television terminal AR scene provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Whole description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
Referring to Fig. 2, a kind of flow chart one of the implementation method of television terminal AR scene provided by the embodiments of the present application, it should
Method includes step S201-S206, specific as follows shown.
Step S201, mobile terminal obtain reality scene image in real time.
In the embodiment of the present application, which includes but is not limited to mobile phone, tablet computer, AR glasses, MR (Mixed
Reality, mixed reality) glasses, smartwatch etc. have the equipment of display screen, camera and the information processing function.With hand
For machine, reality scene image can be obtained by the camera that mobile phone itself is equipped in real time, such as scene of game image, interaction field
Scape image etc., without purchasing dedicated image acquisition equipment.
The reality scene image is sent to cloud server by step S202, mobile terminal, which is used for
Determine virtual scene information.
In one possible implementation, in order to enable cloud server to identify the change of reality scene image in time
Change, a frame reality scene image at current time is directly sent to cloud server at interval of the preset time by mobile terminal.
Wherein, which determines that the application is not limited this with specific reference to the preparatory configuration of mobile terminal.
In alternatively possible implementation, reality scene image can be sent S202A-S202C as follows
To cloud server.
Step S202A, mobile terminal identify the reality scene image according to local image library.
In a reality scene, it will usually including environment division and characteristic.For example, being based on playing cards at one
Scene of game in, it will usually the desktop including placing the playing cards, i.e. environment division and the playing cards itself, i.e.,
Characteristic.Therefore, the reality scene image that mobile terminal obtains in real time generally also includes the corresponding environment map of the environment division
The corresponding characteristic image of picture and this feature part.
It is provided with local image library and local model library in the mobile terminal, is preset with the first standard in the local image library
Image, and each first standard picture has corresponding virtual scene information in local model library.Wherein, it needs to illustrate
, the local image library and local model library are that reality scene image passes through for the first time after cloud server successfully identifies, under
Load is cached to mobile terminal.
In this step, mobile terminal, at interval of the preset time, extracts after getting reality scene image in real time
The feature of the reality scene image at current time, and the first standard picture in this feature and local image library is subjected to feature
Match.If characteristic matching success, identifies success between this feature and first standard picture.If this feature and first mark
Characteristic matching fails between quasi- image, then recognition failures.
Wherein, think if the feature of reality scene image and the feature similarity with higher of the first standard picture
Successful match, it is on the contrary then think that it fails to match.In addition, the preset time interval is true with specific reference to the preparatory configuration of mobile terminal
Fixed, the application is not limited this.
According to the difference of user's usage scenario, it may include multiple characteristic images in a reality scene image.For example, same
Sample may include multiple playing cards in the reality scene of above-mentioned playing cards, each playing cards is a feature
Image.Therefore, multiple characteristic images in the reality scene image may be will recognise that by local image library.
The reality scene image is sent to the cloud server if recognition failures by step S202B.
If recognition failures, illustrate that there is no the first standard drawings with the reality scene images match in local image library
Picture, thus also without corresponding virtual scene information in local model library.Therefore, which is sent to cloud
Server, to transfer corresponding virtual scene information from cloud server.
Step S202C transfers corresponding virtual scene information if identified successfully in local model library.
If identified successfully, illustrate to be stored with the first standard drawing with the reality scene images match in local image library
Picture, and corresponding virtual scene information is also stored in local model library.Therefore, mobile terminal can directly according to this
One standard picture transfers corresponding virtual scene information in local model library.
It, can be directly corresponding according to this feature image if only knowing successfully a characteristic image in the reality scene image
The first standard picture transfer corresponding virtual scene information.It, can be according to this if identifying successfully at least two characteristic image
Corresponding first standard picture of several characteristic images transfers a corresponding virtual scene information respectively.It is of course also possible to transfer
The corresponding virtual scene information of the characteristic image that mobile terminal recognizes at first.It is true with specific reference to the preparatory configuration of mobile terminal
Fixed, the application is not limited this.
In order to avoid mobile terminal repeats to transfer identical virtual scene information, in one possible implementation, move
Dynamic terminal is after identifying successfully, it is thus necessary to determine that first standard picture and currently used virtual scene information corresponding second
Whether standard picture is identical.If first standard picture is different with second standard picture, illustrate in reality scene image
Characteristic image changed, at this point, transferring the corresponding virtual scene of the first standard picture again in local model library
Information.If first standard picture is identical with second standard picture, illustrate characteristic image in reality scene image simultaneously
There is no variations, currently used virtual scene information are continued to use, without transferring virtual scene information again.
Step S203, cloud server determine virtual scene information according to the reality scene image.
Specifically, cloud server determines virtual scene information according to following steps S203A-S203B.
Step S203A, cloud server identify the reality scene image according to cloud image library.
Firstly, it is necessary to explanation, the cloud server are preset with cloud image library and cloud model library, the cloud image
Also it is preset with the first standard picture in library, and each first standard picture has corresponding virtual field in model library beyond the clouds
Scape information.
Cloud server extracts the feature of the reality scene image at current time after receiving reality scene image,
And the first standard picture in this feature and cloud image library is subjected to characteristic matching.If this feature and first standard picture
Between characteristic matching success, then identify success；If characteristic matching fails between this feature and first standard picture, identify
Failure.
Step S203B, if identified successfully, from cloud, model library transfers corresponding virtual scene information.
If identified successfully, illustrate that cloud image library is previously stored with the first standard with the reality scene images match
Image, and corresponding virtual scene information is also stored in model library beyond the clouds.Therefore, cloud server can direct basis
First standard picture transfers corresponding virtual scene information in model library beyond the clouds.
It, can be according to direct this feature image pair if only identifying successfully a characteristic image in the reality scene image
The first standard picture answered transfers corresponding virtual scene information.It, can basis if identifying successfully at least two characteristic image
Corresponding first standard picture of these characteristic images transfers a corresponding virtual scene information respectively.It is of course also possible to adjust
The corresponding virtual scene information of the characteristic image for taking cloud server to recognize at first.Match with specific reference to cloud server is preparatory
Determination is set, the application is not limited this.
In order to avoid cloud server repeats to transfer identical virtual scene information, in one possible implementation,
Cloud server judges first standard picture and currently used virtual scene information corresponding second after identifying successfully
Whether standard picture is identical.If first standard picture is different with second standard picture, illustrate in reality scene image
Characteristic image changed, at this point, transferring the corresponding virtual scene of the first standard picture in model library again beyond the clouds
Information.If first standard picture is identical with second standard picture, illustrate characteristic image in reality scene image simultaneously
There is no variations, currently used virtual scene information are continued to use, without transferring virtual scene information again.
Optionally, if identified successfully, can also will first standard picture corresponding with the reality scene image and
Virtual scene information corresponding with first standard picture is sent to the mobile terminal, so that mobile terminal can be directly to reality
Scene image carries out local identification, and transfers corresponding virtual scene information from local.
In the above-mentioned methods, mobile terminal has first carried out local identification to reality scene image, identifies and successfully then directly adjusts
The virtual scene information being locally stored is taken, recognition failures send it to cloud server again and transfer virtual scene information.Therefore,
It can not only guarantee the recognition success rate of image, virtual scene information also with higher in the method shown in the embodiment of the present application
Acquisition speed.
With the frequent use of mobile terminal, more the first standard picture and correspondence may be stored in mobile terminal
Virtual scene information, occupy the memory of mobile terminal, influence its speed of service.It therefore, can be to first in mobile terminal
Standard picture and virtual scene information are cleared up.
Illustratively, when the amount of storage of the local image library of mobile terminal and local model library reaches amount of storage threshold value,
Alternatively, can be deleted in all first standard pictures and local model library in local image library at interval of the preset time
All virtual scene information.It is of course also possible to delete lower first standard picture of frequency of use and virtual scene information.Or
Person can also delete the first standard picture and virtual scene information that storage time is greater than storage time threshold value.With specific reference to shifting
The preparatory configuration of dynamic terminal determines that the application is not limited this.
Step S203C thens follow the steps S203A if recognition failures.
If recognition failures, illustrate that there is no the first standard drawings with the reality scene images match in the image library of cloud
Picture, thus beyond the clouds in model library also without corresponding virtual scene information.
In the embodiment of the present application, operation management personnel can directly server side carries out pipe to virtual scene information beyond the clouds
Reason, such as update, maintenance, extension virtual scene information.Also, mobile terminal directly can obtain newest void from cloud server
Quasi- scene information.
Step S204, mobile terminal receive virtual scene information.
In the embodiment of the present application, which not only includes the 3D model of virtual scene, can also include UI
(user interface, user interface) material, image, video, special efficacy particle file etc..
Virtual scene information in real time in conjunction with reality scene image, is obtained AR scene by step S205, mobile terminal.
Since the reality scene image that mobile terminal obtains in real time is a video image, the feature in the video image
Image may constantly be in the state of motion change, the variation etc. of variation, image angle including size.Therefore, mobile terminal
After receiving virtual scene information, need first to carry out dynamic registration tracking to the characteristic image in the video image.If
Current dynamic registration tracking failure, then persistently carry out dynamic registration tracking, until calculating the transformation of this feature image after success
Matrix, and according to the location matches of transformation matrix progress virtual scene 3D model, and configure UI material, image, video, special efficacy
The relevant informations such as particle file.Finally, by the 3D model and the relevant information in conjunction with the characteristic image in current video image,
Obtain AR scene.
AR scene is sent to television terminal by step S206, mobile terminal.
In this step, the AR scene can be shown in mobile terminal, it can also be by way of throwing screen by the AR scene
It is shown on television terminal simultaneously.
In the implementation method of the television terminal AR scene shown in the embodiment of the present application, what mobile terminal can will acquire
Reality scene image is sent to cloud server, carries out image recognition by cloud server and virtual scene information is transferred, and reduces
To the occupancy of mobile terminal resource, mobile terminal is enable quickly and accurately to generate AR scene, avoids AR scene from occurring different
Often.
In addition, can be shown on television terminal by the collective effect of mobile terminal, cloud server and television terminal
AR scene reduces the cost of television terminal AR scene generation, has more without additionally configuring dedicated camera and set-top box
Strong market adaptability.By taking the mobile terminal is mobile phone as an example, user obtains reality scene image, Ji Ke by mobile phone in real time
It is presented corresponding AR scene on television terminal, it is easy to use and cost is relatively low.
Referring to Fig. 3, a kind of flow chart of the implementation method of television terminal AR scene shown in the embodiment of the present application, the party
Method includes the following steps S301-S306.
Step S301, television terminal is according to the configuration real-time display characteristic image of O&M server.
The O&M server is used to provide characteristic image to television terminal, and this feature image can be teaching scene, game
Scene etc., and this feature image can be obtained from the downloading of O&M server in advance, can also be obtained by sending request in real time,
The application is not limited this.
Step S302, mobile terminal obtain reality scene image in real time.
In this step, which includes the characteristic image that television terminal is shown.
The reality scene image is sent to cloud server by step S303, mobile terminal, which is used for
Determine virtual scene information.
In one possible implementation, in order to enable cloud server to identify the change of reality scene image in time
Change, a frame reality scene image at current time is directly sent to cloud server at interval of the preset time by mobile terminal.
In alternatively possible implementation, it can be realized by step S303A-S303C and send reality scene image
To cloud server.The implementation procedure of step S303A-S303C exists referring specifically to step S202A-S202C, the embodiment of the present application
This will not be described in great detail.
Step S304, cloud server determine virtual scene information according to the reality scene image.
Step S304 includes step S304A-304C, and implementation procedure is referring specifically to step S203A-S203C, the application
Embodiment will not be described in great detail herein.
Step S305, mobile terminal receive the virtual scene information.
Virtual scene information in real time in conjunction with reality scene image, is obtained and shows AR by step S306, mobile terminal
Scape.
In step S306, the characteristic image substantially on the television terminal of the AR scene and corresponding virtual scene
The combination of information.Mobile terminal is after obtaining AR scene, it is also necessary to which it will be shown on the screen of the mobile terminal.
Specifically, the specific implementation process of step S302~S306 please refers to the content shown in step S301~S305,
The embodiment of the present application will not be described in great detail herein.
In the implementation method of the television terminal AR scene shown in the embodiment of the present application, what mobile terminal can will acquire
Reality scene image is sent to cloud server, carries out image recognition by cloud server and virtual scene information is transferred, and reduces
To the occupancy of mobile terminal resource, mobile terminal is enable quickly and accurately to generate AR scene, avoids AR scene from occurring different
Often.
In addition, can be passed through by the collective effect of O&M server, mobile terminal, cloud server and television terminal
The content that mobile terminal and television terminal are shown carries out real-time interactive, and not only use cost is low, but also can be improved user experience.
Referring to Fig. 4, a kind of television terminal AR Scene realization system shown in the embodiment of the present application, for executing above-mentioned step
Method shown in rapid S201-S206, including mobile terminal, cloud server and television terminal.
The mobile terminal includes: image acquisition unit, for obtaining reality scene image in real time.Local transmission unit is used
In reality scene image is sent to cloud server, the reality scene image is for determining virtual scene information；And by AR
Scene is sent to television terminal.Local reception unit, for receiving virtual scene information.Calculation processing unit, being used for will be virtual
Scene information in conjunction with reality scene image, obtains AR scene in real time.
Optionally, the mobile terminal further include: local recognition unit, for identifying reality scene figure according to local image library
Picture.Unit locally is transferred, if transferring corresponding virtual scene information in local model library for identifying successfully.Also,
Reality scene image is sent to cloud server if being also used to recognition failures by the local transmission unit.
The cloud server includes: cloud receiving unit, for receiving the reality scene image of mobile terminal transmission.Cloud
Recognition unit, for identification reality scene image.Unit is transferred in cloud, if for identifying successfully, according to reality scene figure
As image library transfers corresponding virtual scene information beyond the clouds.Cloud transmission unit, for virtual scene information to be sent to shifting
Dynamic terminal.
The television terminal, for receiving and showing AR scene.
In the realization system of the television terminal AR scene shown in the embodiment of the present application, what mobile terminal can will acquire
Reality scene image is sent to cloud server, carries out image recognition by cloud server and virtual scene information is transferred, and reduces
To the occupancy of mobile terminal resource, mobile terminal is enable quickly and accurately to generate AR scene, avoids AR scene from occurring different
Often.
In addition, can be shown on television terminal by the collective effect of mobile terminal, cloud server and television terminal
AR scene reduces the cost of television terminal AR scene generation, has more without additionally configuring dedicated camera and set-top box
Strong market adaptability.
Referring to Fig. 5, a kind of television terminal AR Scene realization system shown in the embodiment of the present application, for executing above-mentioned step
Method shown in rapid S301-S306, including O&M server, television terminal, mobile terminal and cloud server and television terminal.
The O&M server, the characteristic image shown for configuring television terminal.
The television terminal, for showing this feature image according to the configuration of O&M server.
The mobile terminal includes: image acquisition unit, for obtaining reality scene image, the reality scene image packet in real time
Include the characteristic image that television terminal is shown.Local transmission unit, for reality scene image to be sent to cloud server, this is existing
Real scene image is for determining virtual scene information；And AR scene is sent to television terminal.Local reception unit, is used for
Receive virtual scene information.Calculation processing unit, for by virtual scene information in real time with reality scene image ining conjunction with, acquisition AR
Scene.Display unit, for showing AR scene.
Optionally, the mobile terminal further include: local recognition unit, for identifying reality scene figure according to local image library
Picture.Unit locally is transferred, if transferring corresponding virtual scene information in local model library for identifying successfully.Also,
Reality scene image is sent to cloud server if being also used to recognition failures by the local transmission unit.
The cloud server includes: cloud receiving unit, for receiving the reality scene image of mobile terminal transmission.Cloud
Recognition unit, for identification reality scene image.Unit is transferred in cloud, if for identifying successfully, according to the reality scene
Image library transfers corresponding virtual scene information to image beyond the clouds.Virtual scene information is sent to movement by cloud transmission unit
Terminal.
In the realization system of the television terminal AR scene shown in the embodiment of the present application, what mobile terminal can will acquire
Reality scene image is sent to cloud server, carries out image recognition by cloud server and virtual scene information is transferred, and reduces
To the occupancy of mobile terminal resource, mobile terminal is enable quickly and accurately to generate AR scene, avoids AR scene from occurring different
Often.
In addition, can be passed through by the collective effect of O&M server, mobile terminal, cloud server and television terminal
The content that mobile terminal and television terminal are shown carries out real-time interactive, and not only use cost is low, but also can be improved user experience.
The above is only the specific embodiment of the application, is made skilled artisans appreciate that or realizing this Shen
Please.Various modifications to these embodiments will be apparent to one skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the application.Therefore, the application
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
It should be understood that the application is not limited to the content being described above, and its model can not departed from
It encloses and carry out various modifications and change.Scope of the present application is only limited by the accompanying claims.
Claims (11)
1. a kind of implementation method of television terminal AR scene, which is characterized in that be applied to mobile terminal, which comprises
Reality scene image is obtained in real time；
The reality scene image is sent to cloud server, the reality scene image is for determining virtual scene information；
Receive the virtual scene information；
By the virtual scene information in real time in conjunction with the reality scene image, AR scene is obtained；
The AR scene is sent to television terminal.
2. the method according to claim 1, wherein the reality scene image is sent to cloud server,
Include:
The reality scene image is identified according to local image library；
If recognition failures, the reality scene image is sent to the cloud server.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
If identified successfully, and the reality scene image corresponding first standard picture in the local image library, with
Corresponding second standard picture of currently used virtual scene information is different, then first standard is transferred in local model library
The corresponding virtual scene information of image.
4. according to the method described in claim 3, it is characterized in that, the method also includes:
If the amount of storage of the local image library and the local model library reaches amount of storage threshold value, it is low to delete frequency of use
The first standard picture and corresponding virtual scene information in frequency threshold；Alternatively, deleting storage time is greater than time threshold
First standard picture and corresponding virtual scene information.
5. a kind of implementation method of television terminal AR scene, which is characterized in that be applied to cloud server, which comprises
Receive the reality scene image that mobile terminal is sent；
Virtual scene information is determined according to the reality scene image；
The virtual scene information is sent to mobile terminal, the virtual scene information is used for the mobile terminal for the void
Quasi- scene information in conjunction with the reality scene image, obtains AR scene, and the AR scene is sent to television terminal in real time.
6. according to the method described in claim 5, it is characterized in that, determining that virtual scene is believed according to the reality scene image
Breath, comprising:
The reality scene image is identified according to cloud image library；
If identified successfully, and the reality scene image corresponding first standard picture in the cloud image library, with
Corresponding second standard picture of currently used virtual scene information is different, then transfers first standard in model library beyond the clouds
The corresponding virtual scene information of image.
7. according to the method described in claim 6, it is characterized in that, the method also includes: by first standard picture with
And virtual scene information corresponding with first standard picture is sent to the mobile terminal.
8. a kind of implementation method of television terminal AR scene, which is characterized in that be applied to mobile terminal, comprising:
Reality scene image is obtained in real time, and the reality scene image includes the characteristic image that television terminal is shown, the feature
Image is determined according to the configuration of O&M server；
The reality scene image is sent to cloud server, the reality scene image is for determining virtual scene information；
Receive the virtual scene information；
The virtual scene information is obtained in conjunction with the reality scene image in real time and shows AR scene.
9. a kind of implementation method of television terminal AR scene, which is characterized in that be applied to cloud server, comprising:
The reality scene image that mobile terminal is sent is received, the reality scene image includes the characteristic pattern that television terminal is shown
Picture, the characteristic image are determined according to the configuration of O&M server；
Virtual scene information is determined according to the reality scene image；
The virtual scene information is sent to mobile terminal, the virtual scene information is used for the mobile terminal for the void
Quasi- scene information in conjunction with the reality scene image, obtains in real time and shows AR scene.
10. a kind of realization system of television terminal AR scene characterized by comprising
Mobile terminal, for obtaining reality scene image in real time；And the reality scene image is sent to cloud service
Device；
Cloud server, for determining virtual scene information according to the reality scene image, and by the virtual scene information
It is sent to the mobile terminal；
The mobile terminal is also used to receive the virtual scene information；By the virtual scene information in real time with the reality
Scene image combines, and obtains AR scene；And the AR scene is sent to television terminal；
Television terminal, for receiving and showing the AR scene.
11. a kind of realization system of television terminal AR scene characterized by comprising
O&M server, the characteristic image shown for configuring television terminal；
Television terminal, for showing the characteristic image according to the configuration of O&M server；
Mobile terminal, for obtaining reality scene image in real time, the reality scene image includes the feature that television terminal is shown
Image, the characteristic image are determined according to the configuration of O&M server；The reality scene image is sent to cloud server；
Cloud server, for determining virtual scene information according to the reality scene image, and by the virtual scene information
It is sent to the mobile terminal；
The mobile terminal is also used to receive the virtual scene information；And by the virtual scene information in real time with it is described existing
Real scene image combines, and obtains and shows AR scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131776.1A CN109104632A (en) | 2018-09-27 | 2018-09-27 | A kind of realization method and system of television terminal AR scene |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131776.1A CN109104632A (en) | 2018-09-27 | 2018-09-27 | A kind of realization method and system of television terminal AR scene |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109104632A true CN109104632A (en) | 2018-12-28 |
Family
ID=64867255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811131776.1A Pending CN109104632A (en) | 2018-09-27 | 2018-09-27 | A kind of realization method and system of television terminal AR scene |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109104632A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083235A (en) * | 2019-04-08 | 2019-08-02 | 聚好看科技股份有限公司 | Interactive system and data processing method |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN111966216A (en) * | 2020-07-17 | 2020-11-20 | 杭州易现先进科技有限公司 | Method, device and system for synchronizing spatial positions, electronic device and storage medium |
| CN112988093A (en) * | 2019-12-16 | 2021-06-18 | 天翼智慧家庭科技有限公司 | Method and system for rapid same-screen of VR equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| US20160267719A1 (en) * | 2010-06-17 | 2016-09-15 | Microsoft Technology Licensing, Llc | Techniques to present location information for social networks using augmented reality |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| CN106390457A (en) * | 2016-10-10 | 2017-02-15 | 南京炫佳网络科技有限公司 | Television AR game system and display method |
| CN106851386A (en) * | 2017-03-27 | 2017-06-13 | 青岛海信电器股份有限公司 | The implementation method and device of augmented reality in television terminal based on android system |
| CN107204031A (en) * | 2017-04-27 | 2017-09-26 | 腾讯科技（深圳）有限公司 | Information displaying method and device |
| US20170287007A1 (en) * | 2016-04-03 | 2017-10-05 | Integem Inc. | Real-time and context based advertisement with augmented reality enhancement |
| CN107633441A (en) * | 2016-08-22 | 2018-01-26 | 大辅科技（北京）有限公司 | Commodity in track identification video image and the method and apparatus for showing merchandise news |
| CN107817897A (en) * | 2017-10-30 | 2018-03-20 | 努比亚技术有限公司 | A kind of information intelligent display methods and mobile terminal |
-
2018
- 2018-09-27 CN CN201811131776.1A patent/CN109104632A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160267719A1 (en) * | 2010-06-17 | 2016-09-15 | Microsoft Technology Licensing, Llc | Techniques to present location information for social networks using augmented reality |
| CN104134229A (en) * | 2014-08-08 | 2014-11-05 | 李成 | Real-time interaction reality augmenting system and method |
| US20170287007A1 (en) * | 2016-04-03 | 2017-10-05 | Integem Inc. | Real-time and context based advertisement with augmented reality enhancement |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| CN107633441A (en) * | 2016-08-22 | 2018-01-26 | 大辅科技（北京）有限公司 | Commodity in track identification video image and the method and apparatus for showing merchandise news |
| CN106390457A (en) * | 2016-10-10 | 2017-02-15 | 南京炫佳网络科技有限公司 | Television AR game system and display method |
| CN106851386A (en) * | 2017-03-27 | 2017-06-13 | 青岛海信电器股份有限公司 | The implementation method and device of augmented reality in television terminal based on android system |
| CN107204031A (en) * | 2017-04-27 | 2017-09-26 | 腾讯科技（深圳）有限公司 | Information displaying method and device |
| CN107817897A (en) * | 2017-10-30 | 2018-03-20 | 努比亚技术有限公司 | A kind of information intelligent display methods and mobile terminal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083235A (en) * | 2019-04-08 | 2019-08-02 | 聚好看科技股份有限公司 | Interactive system and data processing method |
| CN110412765A (en) * | 2019-07-11 | 2019-11-05 | Oppo广东移动通信有限公司 | Augmented reality image capturing method, device, storage medium and augmented reality equipment |
| CN112988093A (en) * | 2019-12-16 | 2021-06-18 | 天翼智慧家庭科技有限公司 | Method and system for rapid same-screen of VR equipment |
| CN111966216A (en) * | 2020-07-17 | 2020-11-20 | 杭州易现先进科技有限公司 | Method, device and system for synchronizing spatial positions, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109104632A (en) | A kind of realization method and system of television terminal AR scene | |
| CN111556278B (en) | Video processing method, video display device and storage medium | |
| CN109091861B (en) | Interactive control method in game, electronic device and storage medium | |
| WO2022088918A1 (en) | Virtual image display method and apparatus, electronic device and storage medium | |
| CN107205122A (en) | The live camera system of multiresolution panoramic video and method | |
| CN104378586B (en) | The method and system that vision facilities based on desktop virtualization is redirected | |
| CN113038264B (en) | Live video processing method, device, equipment and storage medium | |
| KR102402580B1 (en) | Image processing system and method in metaverse environment | |
| EP4270315A1 (en) | Method and device for processing three-dimensional video, and storage medium | |
| US20120194548A1 (en) | System and method for remotely sharing augmented reality service | |
| CN111582240A (en) | Object quantity identification method, device, equipment and medium | |
| US20190057551A1 (en) | Systems and methods for combined augmented and virtual reality | |
| US11223662B2 (en) | Method, system, and non-transitory computer readable record medium for enhancing video quality of video call | |
| CN112653898A (en) | User image generation method, related device and computer program product | |
| CN112163993A (en) | Image processing method, device, equipment and storage medium | |
| KR102505666B1 (en) | A device that performs rendering optimized for the viewer's point of view in a specific location to provide ultra-realistic content | |
| CN108769755A (en) | High-resolution full view frequency live streaming camera system and method | |
| US20240062479A1 (en) | Video playing method and apparatus, electronic device, and storage medium | |
| CN112423142B (en) | Image processing method, device, electronic equipment and computer readable medium | |
| CN113014960B (en) | Method, device and storage medium for online video production | |
| CN113590878A (en) | Method and device for planning path on video picture and terminal equipment | |
| KR20220159968A (en) | Conference handling method and system using avatars | |
| CN104618733A (en) | Image remote projection method and related device | |
| KR102190388B1 (en) | Method, system and non-transitory computer-readable recording medium for providing contents including augmented reality object using multi-devices | |
| CN112489219A (en) | Mixed reality recording and broadcasting method based on computer vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181228 |
|
| RJ01 | Rejection of invention patent application after publication |