CN106792228A - A kind of living broadcast interactive method and system - Google Patents
A kind of living broadcast interactive method and system Download PDFInfo
- Publication number
- CN106792228A CN106792228A CN201611142174.7A CN201611142174A CN106792228A CN 106792228 A CN106792228 A CN 106792228A CN 201611142174 A CN201611142174 A CN 201611142174A CN 106792228 A CN106792228 A CN 106792228A
- Authority
- CN
- China
- Prior art keywords
- video
- live
- digital audio
- payment
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/254—Management at additional data server, e.g. shopping server, rights management server
- H04N21/2543—Billing, e.g. for subscription services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/47815—Electronic shopping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention proposes a kind of living broadcast interactive method and system.Method includes：The end of live content from the digital audio-video unit in digital audio-video place is received, receive for sequence information in kind in kind, information to be paid in kind is generated based on the sequence information in kind, and after the terminal is based on the information completion payment to be paid in kind, the material object is distributed to the digital audio-video unit in the digital audio-video place.Embodiment of the present invention can be realized giving authentic item, and thus improve interactive.AR can be pressed on towards and be broadcast introducing KTV places by embodiment of the present invention combination camera with live AR contents.Embodiment of the present invention can also improve the security and reduces cost of mobile payment, but also can realize that high in the clouds configures, and upgrade maintenance is facilitated very much.
Description
Technical field
The invention belongs to mobile direct seeding technique field, particularly a kind of living broadcast interactive method and system.
Background technology
The advantage of internet is drawn and continued to network direct broadcasting, is broadcast live on the net using video signal mode, can be with talent
The contents such as art show is shown, product introduction, related meeting, background introduction, scheme test and appraisal, investigation on the net, dialogue interview, online training show
Field is published on internet, and using the directly perceived, quick of internet, the form of expression is good, abundant in content, interactivity strong, region is not received
The features such as limitation, audient can divide, strengthens the promotion effect of site of activity.Can also be at any time reader after the completion of on-the-spot broadcasting
Continue to provide replay, program request, effectively extend live time and space, play the maximum value of live content.
At present, independent signal collecting device (audio+video) is generally set up at the scene, then service is uploaded to by network
Device, is distributed to network address and is watched for people.Existing live broadcast system is constituted mainly to be included：Mobile phone acquisition camera video data and audio
Module gathers voice data, by U.S. face software processing, audio frequency and video synthesis is then pushed to (content distributing network (Content
Delivery Network, CDN) platform, the user on line watches live content source on platform, while and the live user of initiation
Interaction is carried out using barrage, message column, virtual item, virtual present
However, existing live software can only give virtual stage property and present in user interaction environment, it is impossible to give
Actual supermarket's article or the article of reality.
In addition, the function such as substantially only U.S. face of existing net cast, it is impossible to reference to enhancing display (AR) function, will be cruel
The video content dazzled is live to go out.And, existing live main utilization mobile phone is limited to the focal length of mobile phone camera, picture
It is limited, it is impossible to meet that many people are live, but also it is often subject to the limitation of cell phone battery capacity.Further, mobile phone camera is shooting
During easily shake, the video of shooting is easily unintelligible；And mobile phone camera, during follow shot, network signal is bad,
Easily cause live interim card.
The content of the invention
Embodiment of the present invention proposes a kind of living broadcast interactive method and system, so that realize giving authentic item, and thus
Improve interactive.
The technical scheme of embodiment of the present invention is as follows：
A kind of living broadcast interactive method, the method includes：
The end of live content, receives for material object in kind from the digital audio-video unit in digital audio-video place is received
Sequence information, information to be paid in kind is generated based on the sequence information in kind, and when the terminal is waited to prop up based on the material object
After the information of paying completes to pay, the material object is distributed to the digital audio-video unit in the digital audio-video place.
In one embodiment, the method also includes：
Live content is determined based on mobile terminal, the live content is sent to high in the clouds, generated in live with by high in the clouds
The broadcast address of appearance；Or
Live content is determined based on box requesting song terminal, the live content is sent to high in the clouds, with straight by high in the clouds generation
Broadcast the broadcast address of content.
In one embodiment, it is described to determine that live content includes based on mobile terminal：
When live user is selected using the mobile terminal as live recording source on mobile terminals, the movement is enabled
Terminal records the video of the live user as the live content；Or, when live user selects on the mobile terminal
Determine during being arranged in the camera in the digital audio-video unit in the digital audio-video place as live recording source, to be taken the photograph described in enable
The video of the live user is recorded as head, and the video of the live user is made into enhancing with predetermined virtual scene model
Reality treatment is as the live content；Or, select on the mobile terminal with the mobile terminal as live user and
When being arranged in the camera in the digital audio-video unit in digital audio-video place collectively as live recording source, enable described mobile whole
The video of the live user is recorded at end, enables the video that the camera records the live user, and by the movement eventually
Hold the video recorded, the video of the live user to make augmented reality with predetermined virtual scene model to process as described
Live content；Or, selecting to be arranged in the digital audio-video in the digital audio-video place on the mobile terminal as live user
When camera in unit is as live recording source, the video that the camera records the live user is enabled, and will be described
The video of live user is used as the live content；
Or
It is described to determine that live content includes based on box requesting song terminal：When live user selects in box requesting song terminal
Determine during being arranged in the camera in the digital audio-video unit in the digital audio-video place as live recording source, to be taken the photograph described in enable
Record the video of the live user as head, and using the video of the live user as the live content；Or, working as live use
Selected in box requesting song terminal and made with the camera being arranged in the digital audio-video unit in the digital audio-video place in family
During for live recording source, enable the video that the camera records the live user, and by the video of the live user with
Predetermined virtual scene model makes augmented reality treatment as the live content.
In one embodiment, live content includes in the digital audio-video unit for receiving digital audio-video place：
Terminal is connected to live page and receives the live content by wechat；And/or
Terminal receives the live content by predetermined application program.
In one embodiment, it is described in kind including at least one of following：
Drinks；Beverage；Snacks；Fresh flower；Fruit；Prepared food；Toy；Clothes；Ornaments.
In one embodiment, the method also includes：
It is flat via payment management of the Set Top Box in the digital audio-video unit with digital audio-video place in same LAN
Platform, the mobile terminal mutually bound from the digital audio-video unit with the digital audio-video place receives sequence information；
The sequence information is sent to by gateway server by LAN via the payment management platform, with by described
The sequence information is sent to cloud server by gateway server via internet, and will via internet by cloud server
The sequence information is sent to payment platform；
Information to be paid, the letter to be paid are received from gateway server by LAN via the payment management platform
Breath is based on sequence information and generates and be sent to cloud server via internet by payment platform, then by cloud server via
Internet is sent to gateway server；
Show the information to be paid, payment is performed based on the information to be paid with by mobile terminal；
Or, the method also includes：Payment platform returns to payment result via internet to cloud server；Cloud server
Payment result is sent to gateway server via internet；Gateway server sends branch via LAN to payment management platform
Pay result；
Or, the method also includes：When new payment platform is increased, cloud server further sets up flat with new payment
The internet connection of platform；Cloud server is based on predetermined policy selection target payment platform, and the sequence information is sent to
The target payment platform；Or, when the payment platform is replaced by other payment platform, cloud server is further built
It is vertical to be connected with the internet of the other payment platform；The sequence information is sent to institute by cloud server via internet
State other payment platform；Or, when payment platform is deleted, cloud server is deleted and connected with the internet of the payment platform
Connect.
In one embodiment, the payment management platform via in LAN receives sequence information and includes：
Via the LAN sequence information is received from the Set Top Box；Wherein：The sequence information is being moved by user
Dynamic terminal triggering, and it is sent to Set Top Box via the LAN by mobile terminal；Or, being taken from payment via the LAN
Business device receives sequence information；Wherein：The sequence information is triggered on paying server by administrative staff；
Or
The number of the paying server is one or more；And/or, the information to be paid includes thering is Quick Response Code form
Or the payment code of bar code form, or bank's class payment link.
In one embodiment, the method also includes：
Record the video or picture in kind；
Shown in the digital audio-video unit in the digital audio-video place live content and the video in kind or
Picture.
In one embodiment, the method also includes：First object is updated in the virtual scene model, and
When receiving interaction instruction, interaction content is updated in the virtual scene model according to interaction instruction, it is described straight to obtain
Broadcast content；
Wherein described first object includes at least one of following：True man's object；Pet；Plant.
In one embodiment, the first object is updated includes to the virtual scene model：One is obtained in real time
The signal of above camera head, collects more than one first view data；According to default condition, from each the first figure
As more than one first object of extracting data, by more than one first object real-time update to virtual scene model；
The interaction content also content-data including the first material, first material includes：Textual materials, image element
The combination of material, sound material or picture material and sound material；Or, the virtual scene model is 3D virtual stages.
A kind of living broadcast interactive system, including：
Cloud server, for live content generation broadcast address in the digital audio-video unit based on digital audio-video place；
Payment platform, for from the end that live content is watched based on the broadcast address, receiving for reality in kind
Thing sequence information, information to be paid in kind is generated based on the sequence information in kind, and when the terminal is treated based on the material object
After payment information completes to pay, the material object is distributed to the digital audio-video unit in the digital audio-video place.
In one embodiment, also include：
Mobile terminal, for being selected on the mobile terminal using the mobile terminal as live recording as live user
During source, the video of the live user is recorded as live content or by the video of the live user and predetermined virtual field
Scape model makes augmented reality treatment as the live content, and the live content is sent into cloud server；
The camera in the digital audio-video unit in the digital audio-video place is arranged in, for when live user is in the shifting
The video that the live user is recorded during using the camera as live recording source is selected in dynamic terminal as live interior
Hold, or the video of the live user and predetermined virtual scene model made into augmented reality treatment as live content,
The live content is sent to cloud server；
Box is requested a song terminal, for being selected using the camera as straight in box requesting song terminal as live user
When broadcasting recording source, enable the camera and record the video of the live user and using the video of the live user as described
Live content, or the video of the live user and predetermined virtual scene model are made into augmented reality treatment as described
Live content.
In one embodiment, also including the Set Top Box in the digital audio-video unit in the digital audio-video place；
The camera or the mobile terminal, are additionally operable to record the video or picture of the material object, by the material object
Video or picture are sent to the Set Top Box；
The Set Top Box is connected with display unit, for the video in kind or picture to be sent into display unit；
Display unit, for showing the live content and the video or picture in kind.
In one embodiment, the box is disposed in digital audio-video place, and the digital audio-video place includes
It is at least one of following：Karaoke place；Nightclub；Bar；Hotel；Multimedia conferencing room；Internet bar；Shadow；Pool room；
And/or
The digital audio-video unit includes box.
From above-mentioned technical proposal as can be seen that in embodiments of the present invention, being regarded from the numeral for receiving digital audio-video place
Listen the terminal of live content in unit to receive for sequence information in kind in kind, wait to prop up based on sequence information in kind generation material object
The information of paying, and after terminal is based on information completion payment to be paid in kind, distribute to the digital audio-video unit in digital audio-video place
The material object.Embodiment of the present invention can be realized giving authentic item during live, and thus improve live interaction
Property.
Embodiment of the present invention combination camera can be with live virtual scene model content, can be by the live introducing numerals of AR
Audiovisual place.
In addition, embodiment of the present invention can also improve the security and reduces cost of mobile payment, but also can be real
Existing high in the clouds configuration, upgrade maintenance is facilitated very much.Especially, when the number of the paying server in payment management platform is multiple
When, the cost benefit of embodiment of the present invention is more obvious.In embodiments of the present invention, when payment platform occurs change, expansion
When exhibition or the upgrading means of payment, corresponding configuration work can be beyond the clouds completed, without lower unit/terminal, paying server etc.
Other service ends make any change, and upgrading and maintenance are greatly simplified.
Further, in embodiments of the present invention, can transaction sensitive data of the server to each transaction place beyond the clouds
Managed concentratedly, both ensure that Information Security, or big data is excavated and provides crucial foundation.
Further, the present invention can be using the camera being arranged in the digital audio-video unit in digital audio-video place as live
Recording source, overcomes the shortcoming that mobile phone camera is easily shaken in shooting process, and overcome mobile phone camera network letter
It is number bad, easily cause the shortcoming of live interim card.
Brief description of the drawings
Fig. 1 is the living broadcast interactive method flow diagram according to embodiment of the present invention.
Fig. 2 is to be given a present flow chart according to the material object of embodiment of the present invention.
Fig. 3 is the structure chart of the living broadcast interactive system according to embodiment of the present invention.
Fig. 4 is the living broadcast interactive element schematic diagram according to embodiment of the present invention.
Fig. 5 is the demonstrative structure figure of the mobile-payment system according to embodiment of the present invention.
Fig. 6 is the demonstrative structure figure in the mobile-payment system in digital audio-video place according to embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, further is made to the present invention below in conjunction with the accompanying drawings
Detailed description.
In order to succinct and directly perceived on describing, hereafter by describing some representational implementation methods come to side of the invention
Case is illustrated.Substantial amounts of details is only used for help and understands the solution of the present invention in implementation method.However, it will be apparent that of the invention
Technical scheme can be not limited to these details when realizing.In order to avoid unnecessarily having obscured the solution of the present invention, some realities
Apply mode not described meticulously, but only give framework.Hereinafter, " including " refer to " including but not limited to ", " root
According to ... " refer to " according at least to ..., but be not limited to according only to ... ".Due to the speech habits of Chinese, hereinafter without spy
When not pointing out the quantity of composition, it is meant that it can also be multiple that the composition can be one, or can be regarded as at least one.
In embodiments of the present invention, from the digital audio-video unit in digital audio-video place is received live content terminal
Place, is received for sequence information in kind in kind, and information to be paid in kind is generated based on the sequence information in kind, and when described
After terminal is based on the information completion payment to be paid in kind, the digital audio-video unit distribution to the digital audio-video place is described
It is in kind.
In one embodiment, can be by mobile terminal (such as, mobile phone) and the digital audio-video list in digital audio-video place
Unit binds, and user opens direct broadcast function by the client in mobile terminal, be may be selected in the direct broadcast function live mobile whole
End carries the video file captured by camera, it is also an option that the video file captured by the camera set in live box
(video file can be the video of virtual stage).
In one embodiment, user be also based on box requesting song terminal determine live content.When live user exists
Selected to be arranged in the camera in the digital audio-video unit in digital audio-video place as live recording source in box requesting song terminal
When, enable the video that camera records live user, and using the video of live user as the live content；Or, when live
User the box requesting song terminal on select using the camera in the digital audio-video unit for being arranged in digital audio-video place as
During live recording source, the video that camera records live user is enabled, and by the video of live user and predetermined virtual scene
Model makes augmented reality treatment as the live content.
Live content it is determined that after live content, to be dealt into the CDM living broadcast channels of cloud server, and it is live to generate viewing
Path.Then, user is directly shared with other people by live path is watched, other people be can watch by live path it is live,
Or be placed on client platform in live path by user, other people actively search the live path and carry out watching live.
Can have barrage button, virtual present, virtual item or entrance on the line of place in live page.Other people can
Barrage, virtual present, virtual item etc. are sent in live page purchase.After purchase, barrage button, virtual present, virtual item according to
It is secondary that box Set Top Box is sent to by cloud server and gateway server, then Set Top Box control barrage, virtual present, virtual
Stage property etc. is shown on the display screen of box.When needing to send physical item, enter on the line of place from entrance on the line of place
Supermarket, carries out purchase physical item, and the sequence information (shopping information) in kind includes box information, the account made a gift to someone etc.,
After payment, be sent to physical item in correspondence box by place.
Fig. 1 is the flow chart of the living broadcast interactive method according to embodiment of the present invention.In flow shown in Fig. 1, with movement
The method for determining live content is illustrated as a example by terminal.Embodiment of the present invention can also be by box requesting song terminal or other whole
End determines live content.And, in Fig. 1, carried out box as the embodiment of the digital audio-video unit in digital audio-video place
Explanation.
As shown in figure 1, the method includes：
Step 101：Mobile terminal is mutually bound with the digital audio-video unit in digital audio-video place.
Herein, mobile terminal can by way of scanning Quick Response Code with the digital audio-video unit phase in digital audio-video place
Binding.Such as, Quick Response Code, the camera scanning two dimension of mobile terminal have been puted up in the digital audio-video unit in digital audio-video place
Code, and keep binding with the digital audio-video unit in digital audio-video place.
Herein, digital audio-video place includes Karaoke place；Nightclub；Bar；Hotel；Multimedia conferencing room；Internet bar；
Shadow；Pool room, etc..Digital audio-video unit includes the box in digital audio-video place.
Step 102：Live content is determined based on mobile terminal, live content is sent to high in the clouds, with straight by high in the clouds generation
Broadcast the broadcast address of content.
Herein, when live user is selected using mobile terminal as live recording source on mobile terminals, movement is enabled
Terminal records the video of live user as live content.
When live user on mobile terminals select be arranged in digital audio-video place digital audio-video unit in shooting
When head is as live recording source, the video that camera records live user is enabled, and by the video of live user and predetermined void
Intend model of place and make augmented reality (AR) treatment as live content.
When live user selectes with mobile terminal and be arranged in the digital audio-video list in digital audio-video place on mobile terminals
When camera in unit is collectively as live recording source, the video that mobile terminal records live user is enabled, enable camera record
The video of live user is made, and video, the video of live user and the predetermined virtual scene model work that mobile terminal is recorded
Go out augmented reality treatment as live content.
Select to be arranged in the digital audio-video unit in the digital audio-video place on the mobile terminal as live user
In camera as live recording source when, enable the video that the camera records the live user, and will be described live
The video of user is used as the live content；
In other embodiments, also live content can be determined based on box requesting song terminal by described, specially：When live
User selectes the camera to be arranged in the digital audio-video unit in the digital audio-video place in box requesting song terminal
During as live recording source, the video that the camera records the live user is enabled, and by the video of the live user
As the live content.Or, regarded with being arranged in the numeral when live user selectes in box requesting song terminal
When listening the camera in the digital audio-video unit in place as live recording source, enable the camera and record the live user
Video, and the video of the live user and predetermined virtual scene model are made into augmented reality treatment as described straight
Broadcast content.
And, after the broadcast address of high in the clouds generation live content, the broadcast address of live content can be sent to shifting
Dynamic terminal, then the broadcast address of live content is directly shared with by other people by mobile terminal.Or, high in the clouds generation live content
After broadcast address, the broadcast address of live content can be sent to mobile terminal, mobile terminal is by the broadcasting of live content
Address is placed on client platform, and the broadcast address that other people actively search live content on client platform carries out watching straight
Broadcast.Again or, high in the clouds generation live content broadcast address after, the broadcast address of live content is directly placed on client and is held level with both hands
On platform, the broadcast address that other people actively search live content on client platform carries out watching live.
Step 103：Received for material object in kind from the terminal of the broadcast address viewing live content based on live content
Sequence information, generates information to be paid in kind, and complete branch when terminal is based on information to be paid in kind based on sequence information in kind
Fu Hou, distributes in kind to the digital audio-video unit in digital audio-video place.
In one embodiment, terminal is connected to live page (the 5th generation such as, by wechat is super literary by wechat
This markup language page watches live content) receive the live content；And/or, terminal is received by predetermined application program
The live content.
In one embodiment, it is in kind including at least one of following：Drinks；Beverage；Snacks；Fresh flower；Fruit；It is ripe
Food；Toy；Clothes；Ornaments, etc..In this practical operation, material object simultaneously not only limits mentioned kind, as long as can supermarket's purchase on line
The material object for arriving can be used as gifts.
Citing, live user Zhang San mutually binds mobile terminal with the digital audio-video unit in digital audio-video place.And, directly
Broadcasting user Zhang San selectes to be arranged in the camera in the digital audio-video unit in digital audio-video place as straight on mobile terminals
Broadcast recording source, camera records the performance of talent and art video of live user Zhang San, and by the performance of talent and art video of live user with it is pre-
Fixed virtual scene model (such as, stage background) makes augmented reality (AR) treatment as live content.Camera will be straight
Broadcast content and be sent to high in the clouds, to generate the broadcast address of live content by high in the clouds.The broadcasting ground that terminal Li Si passes through live content
Live content is watched in location, and enjoys a lot the show content of live user Zhang San.Li Si intend send Zhang San's entity present as
Reward.Li Si is sent for sequence information in kind in kind, and payment platform is based on sequence information in kind and generates letter to be paid in kind
Breath, and after Li Si is based on information completion payment to be paid in kind, to live in the digital audio-video unit in digital audio-video place
User Zhang San distribution is in kind.
The specific embodiment of species in kind described in detail above and viewing live content, those skilled in the art can
With, it is realized that this description is only protection domain that is exemplary, being not intended to limit the present invention.
In one embodiment, the method also includes：Record video or picture in kind；In the number in digital audio-video place
The video or picture of live content and material object are shown in word audio-visual unit.
In specific implementation, live user can be scanned special on station of ordering songs by K meters of App on mobile terminal or wechat
Fixed Quick Response Code, to bind box.Live user can select to be carried and taken the photograph using the professional camera or mobile terminal in box
As head carry out it is live.It is live using professional camera, AR functions can be selected, virtual stage, scene is live goes out.Work as user
After initiation is live, the user actively can share the live H5 pages to spectators outside the venue by wechat.User outside the venue also uses K
Rice App finds corresponding live in popular live hall list.Outside audience can send barrage, virtual present, virtual item or
The article of the actual supermarket of person, and live person is interactive.Live broadcast system and KTV song-on-demand system seamless combination.The transmission of user outside the venue
Barrage, virtual present, material object give a present, have on the big TV of box of KTV it is synchronous it is cruel dazzle displaying, if what is sent outside the venue is
Supermarket system under the present of actual supermarket, line can be produced corresponding actual present automatically, and live person is given by waiter.
Embodiment of the present invention preferably also proposed a kind of fusion type virtual scene interactive approach.In an implementation method
In, the method also includes：First object is updated in the virtual scene model, and when interaction instruction is received, according to
Interaction instruction updates in the virtual scene model interaction content, to obtain the live content；Wherein the first object bag
Include：In kind or virtual present.
In one embodiment, the first object is updated includes to the virtual scene model：One is obtained in real time
The signal of above camera head, collects more than one first view data；According to default condition, from each the first figure
As more than one first object of extracting data, by more than one first object real-time update to virtual scene；It is described
The interaction content also content-data including the first material, first material includes：Textual materials, picture material, sound material
Or the combination of picture material and sound material；Or, the virtual scene model is 3D virtual stages.
It can be seen that, embodiment of the present invention additionally provides a kind of interactive method of fusion type virtual scene, can apply to net
In various demands such as network is live or MTV makes.The interactive method of the fusion type virtual scene, the first object is updated to virtual field
Jing Zhong, and when interaction instruction is received, updated in virtual scene interaction content according to interaction instruction, obtain picture number
According to.
Specifically, fusion type virtual scene interaction is comprised the following steps：
The first step：The signal of more than one camera head is obtained in real time, collects more than one first view data.
Second step：According to default condition, more than one first object is extracted from each first view data.Not
In same embodiment as needed, the first object can be different specific objects, and such as the first object can be true man main broadcaster,
Can be pet animals etc., can also be plant etc.；The quantity of the first object can be single, or more than 2.According to
The difference of these actual demands, it is possible to use different algorithms and setting, effectively to extract first in the first data image
Object.It is illustrated below by way of a specific algorithm embodiment for extracting the first object.
In a certain embodiment, in the first view data, the first object behaviour owner broadcasts, and the background residing for main broadcaster is pure color
Background.Extract concretely comprising the following steps for the first object in the first view data：GPU is by the face of each pixel in the first view data
Colour is compared with default threshold value；If the color value of pixel is in default threshold value, the Alpha passages of the pixel are set
Be zero, will background be shown as Transparent color, extract object.
Because background is pure color, so the present embodiment carries out scratching figure using chroma key method.Wherein default threshold value is background
The color value of color, for example, background color for green, then the threshold value of default pixel RGB color value for (0 ± 10,255-
10、0±10).Background colour can select green or blue, two kinds of backgrounds of color can simultaneously be set in the place for shooting, for master
Broadcast selection.When main broadcaster wears the clothes larger with green contrast to sing, the background of green is can select.Extracted in object (portrait)
Cheng Zhong, because the clothes that main broadcaster wears is larger with background hue difference, so the color value and default threshold of each pixel in image
After value is compared, the color value of background parts pixel in default threshold value, by the Alpha passages of background parts pixel
Be set to zero, will background be shown as Transparent color；And the pixel of portrait part retains portrait part not in default threshold value,
So as to realize that portrait is extracted from image.
In the particular embodiment, FIG pull handle operation can also be carried out using the GPU in equipment, is not take up the CPU time,
Improve system speed；And because GPU is the special hardware processed image, to the different size of Pixel calcualting time one
Sample, for example, 8,16, Pixel calcualting time of 32, the operation time to pixel can be greatlyd save；And it is common
CPU can with pixel size increase extend process time, so the portrait extraction rate of the present embodiment is greatly improved.Above-mentioned
Distinctive points cause to be realized using the embedded device with GPU in the present embodiment, even if the CPU in embedded scheme
Can be weaker, but using the scheme of the present embodiment, embedded device scheme still can realize smooth display, if because using CPU
The first object is extracted from the first view data, CPU need to be read out the video of camera head acquisition, and carry out scratching figure etc.
Reason, CPU burdens are too heavy, it is impossible to carry out the display of smoothness.And the present embodiment is applied in embedded scheme, by above-mentioned FIG pull handle
Being put into GPU is carried out, and the burden of CPU has both been alleviated, while will not be impacted to the operation of GPU.
3rd step：Receive the interaction instruction sent from first terminal.In various embodiments, the first terminal leads to
Cross computer network send interaction instruction, computer network can be that Internet network can also be LAN, can be by
Cable network, WiFi network, 3G/4G mobile communication networks, blueteeth network or ZigBee-network etc. are attached.First terminal can
To be the mobile communication equipment such as PC, or mobile phone, panel computer, intelligent watch, Intelligent bracelet, intelligent glasses are can also be
Etc. Wearable.In certain embodiments, first terminal be able to can be produced with the closely control device such as remote control, first terminal
The signals such as infrared signal, radio wave are given birth to send corresponding interaction instruction.
4th step：By in more than one first object real-time update to virtual scene, and according to interaction instruction, update or
Switching virtual scene, obtains the second view data.In embodiment, the virtual scene includes the virtual reality of computer simulation
Scene or the true video scene for shooting etc..Further, embodiment can be combined with the 3D rendering technology of newly-developed
Virtual scene, such as 3D virtual reality scenarios or 3D video scenes are provided.
3D virtual reality scenario technologies are a kind of computer simulation systems that can be created with the experiencing virtual world, and it is utilized
Computer generates a kind of 3D simulated scenarios of reality scene, be a kind of Multi-source Information Fusion interactive Three-Dimensional Dynamic what comes into a driver's and
The system emulation of entity behavior.Virtual scene includes actual scene present in any actual life, appoints comprising vision, sense of hearing etc.
The scene what can be experienced by body-sensing, by computer technology come simulated implementation.One kind of 3D virtual reality scenarios is applied and is
3D virtual stages, 3D virtual stages are, by computer technology simulating reality stage, to realize the dance of a kind of third dimension, strong sense of reality
Platform effect.Can be realized by 3D virtual stages, the main broadcaster's object in reality not before the lights carries out table on various stages
The scene effect drilled.When 3D videos are filmed images, left and right binocular parallax is simulated with two cameras, two shadows are shot respectively
Piece, then shows onto screen this two films simultaneously, allows spectators' left eye to can only see left-eye image during projection, and right eye can only
See eye image.By after brain overlapping, can just see the picture with three-dimensional depth feelings, as 3D is regarded last two images
Frequently.
In the different virtual scenes in interactive embodiment, interaction instruction can include different contents, in some implementations
In example, the interaction instruction includes updating the first material to the order in virtual scene.Specially：The first object is real-time
While updating virtual scene, according to the interaction instruction, during the first material also updated into virtual scene, so as to obtain
State the second view data.First material can be the combination of picture material, sound material or picture material and sound material.With
As a example by network direct broadcasting, first material includes virtual present, thumb up, background sound, cheer etc., the spectators Ke Tong of network direct broadcasting
Cross cell phone, the interaction instruction of the virtual presents such as fresh flower sent to main broadcaster, the present for being sent by the form of fresh flower picture in void
Intend being embodied in scene.The spectators of network direct broadcasting can also send the interaction instruction applauded, drum to main broadcaster by cell phone
The interaction instruction of the palm will be played out in the form of applause.First material can be system intialization, and supply user's selection is used,
And in certain embodiments, the interaction instruction is except including the first material is updated to the order in virtual scene, can also wrap
The content-data of the first material is included.Such as spectators uploading an interaction instruction for giving virtual present by mobile terminal,
And a picture for giving virtual present is further comprises in interaction instruction, after the interaction instruction is received, by institute
The picture for stating present is updated in virtual scene.Therefore spectators are when interaction instruction is sent, the mode except interaction can be selected,
Can also be according to the content-data of self-defined first material of hobby of oneself, the picture materials such as liked, sound material or picture
The material combined with sound.
In certain embodiments, interaction instruction also includes the order of conversion virtual scene camera lens, the conversion virtual scene
The order of camera lens includes the visual angle of switching virtual scene shot, changes virtual scene lens focus and virtual scene is carried out
On Local Fuzzy treatment etc..By the visual angle of switching virtual scene shot, the picture for watching virtual scene with different view can be simulated
Face；By changing virtual scene lens focus, can be to furthering and pushing away the picture of remote virtual scene；And to carrying out office to virtual scene
Portion's Fuzzy Processing, non-Fuzzy Processing part picture is highlighted in can making virtual scene.By the conversion virtual scene mirror
The order of head, is greatly improved the interactive degree and interest of spectators.
Existing living broadcast interactive is different from, it by interactive content is the superficial layer that is directly superimposed to image or video to be,
Therefore in visual effect, the interaction content being superimposed seems the surface for swimming in virtual scene, so as to cause interaction content
Visual effect is very lofty, it is difficult to be fused into one with virtual scene.In the above-described embodiments, the interaction content is at first pair
As being updated to while virtual scene, it is updated in virtual scene, wherein, first object, interaction content and virtual field
Scape is together to be rendered to picture, thus interaction content and the first object can naturally, merging in virtual scene of coordinating so that
With good visual effect.In embodiment, the interaction content can also be by 3D interactive models obtained from 3D modeling,
3D interactive models and the first object and virtual scene real-time rendering, so as to obtain the natural exhibition in virtual scene of 3D interactive models
Existing, such as interaction content is for when presenting a bouquet of flowers, the fresh flower offered can represent in virtual scene neutral body；During such as interaction content for thumb up, point
Shown on the virtual screen that the information praised can be in virtual scene.For example, in virtual scene is a stage, interaction content
To present a bouquet of flowers, using the above method of the present invention, the fresh flower offered can be illustrated in the middle of stage, the part as stage, display effect
It is really good, it is to swim in interface surface rather than prior art.
In one embodiment, in the signal of acquisition camera head in real time, while collecting the first view data, in real time
The signal of microphone is obtained, the first voice data is collected；
While by the first object real-time update to virtual scene, also just the first sound real-time update is to virtual scene
In, obtain the second view data.By taking network direct broadcasting as an example, first voice data is the explanation of network main broadcaster or the sound of performance
Sound, or drill the sound of main broadcaster's performance and the mixing sound of accompanying song.By in real time by the first sound real-time update to virtual field
Jing Zhong, meanwhile, the second view data after updating is shown in real time in display terminal.So, the sound of network main broadcaster can not only be heard
Sound, can also see picture (combination of portrait and virtual scene) with synchronous sound in display terminal, realize virtual stage
Effect.
In the above-described embodiments, obtain after the second view data, the second view data is shown by display device, lead to
Cross and show on the display apparatus second view data, user can be seen the video after the first object synthesizes with virtual scene.
When the second view data is shown, picture that can be first to the second view data is encoded, and picture number can be made by coded treatment
According in display device smooth display in real time.In the prior art, raw frames are not processed typically, original image data amount
Greatly, so prior art does not occur also to the picture after portrait and virtual scene synthesis, the technology for being shown in client in real time.And
The picture of the second view data that the present embodiment will be obtained after renewal is first encoded, and encoded operation can greatly reduce picture
Size.
For example：In the case where resolution ratio is 720P, the size of 1 frame video is 1.31MByte, and 1 second video is drawn for 30 frames
Face, so, in existing video, the size of video is within 1 second：30*1.31=39.3MByte；The present embodiment is encoded to picture
Afterwards, or in the case where resolution ratio is 720P, if code check is 4Mbit, the size of the video of 1 second is 4Mbit, due to 1Byte=8bit,
So the video of 1 second is 0.5MByte；Compared with existing video, the video data after coding is greatly reduced, so that after encoding
Video data can be transmitted on network glibly, realize in the smooth display audio, video data of client.
In certain embodiments, after obtaining the second view data, the view data of stored record second.Second for being stored
View data can be uploaded to gateway server, and the view data of reception is uploaded to cloud server, high in the clouds clothes by gateway server
Business device receives view data and address is shared in generation.By above-mentioned steps, sharing for the second view data is realized.By end
End equipment (such as electronic equipment with display screen such as mobile phone, computer, flat board) is logged in shares address, you can direct playing audio-video
Data download second view data.
The second resulting view data, can also be in network-side except that can be played out in local display device
Played in real time.Specially：
Networking client obtains second view data by real time streaming transport protocol, and in the second view data
Video data decoding display picture, the image content can be the picture of 3D scene renderings；Pass through audio after voice data decoding
Playback equipment (such as loudspeaker) is played.The real time streaming transport protocol can be RTSP agreements.Wherein, in the second view data
View data encoded operation in advance, operated by coded image data, be capable of achieving client smooth playing video data.
Fusion type virtual scene described in detail above it is interactive realize details.It will be appreciated by those of skill in the art that
Above-mentioned interaction mode can not also be used or using other interaction modes, the present invention is simultaneously not limited to this.
The material object for describing embodiment of the present invention in detail again below is given a present flow.
Fig. 2 is to be given a present flow chart according to the material object of embodiment of the present invention.
As shown in Fig. 2 the method includes：
Step 201：Watching live user A outside the venue uses App or the wechat H5 pages to watch live.
Step 202：Live user A selections article in kind and object of giving a present are watched outside the venue.
Step 203：Live user A is watched outside the venue to realize paying by means of payment such as wechat or Alipays.
Step 204：After paying successfully, the Supermarket Management System product article in place.
Step 205：Mobile phone A pp or H5 interface notification order programme television presentation material object pay successfully after, place surpass
City's management system product article.
Step 206：The person of receiving receives the gift in kind of supermarket's product that waiter sends.
Therefore, in embodiments of the present invention, interaction conveniently can be increased using material object is sent in live process, no
Virtual stage property and present is limited only to, while the present invention combines professional camera, AR content lives is gone out, can directly
Introducing KTV places are broadcast, the KTV live epoch are started.
Embodiment of the present invention also proposed a kind of living broadcast interactive system.Including：Cloud server, for being regarded based on numeral
Listen live content generation broadcast address in the digital audio-video unit in place；Payment platform, for being seen from based on the broadcast address
The terminal for seeing live content is received for sequence information in kind in kind, in kind to be paid based on the sequence information generation in kind
Information, and after the terminal is based on the information completion payment to be paid in kind, to the digital audio-video list in digital audio-video place
Unit's distribution is in kind.
In one embodiment, living broadcast interactive system also includes：
Mobile terminal, for being selected on the mobile terminal using the mobile terminal as live recording as live user
During source, the video of the live user is recorded as live content or by the video of the live user and predetermined virtual field
Scape model makes augmented reality treatment as the live content, and the live content is sent into cloud server；
The camera in the digital audio-video unit in the digital audio-video place is arranged in, for when live user is in the shifting
The video that the live user is recorded during using the camera as live recording source is selected in dynamic terminal as live interior
Hold, or the video of the live user and predetermined virtual scene model made into augmented reality treatment as live content,
The live content is sent to cloud server；
Box is requested a song terminal, for being selected using the camera as straight in box requesting song terminal as live user
When broadcasting recording source, enable the camera and record the video of the live user and using the video of the live user as described
Live content, or the video of the live user and predetermined virtual scene model are made into augmented reality treatment as described
Live content.
Fig. 3 is the structure chart of the living broadcast interactive system according to embodiment of the present invention.
As shown in figure 3, living broadcast interactive system includes：
Mobile terminal, mutually binds for the digital audio-video unit with digital audio-video place, when live user is in mobile terminal
The video that live user is recorded during using mobile terminal as live recording source is above selected as live content, by live content
It is sent to cloud server；
Be arranged in the camera in the digital audio-video unit in digital audio-video place, for when live user on mobile terminals
It is selected using camera as live recording source when, record the video of live user, and by the video of live user and predetermined void
Intend model of place and make augmented reality treatment as live content, live content is sent to cloud server；
Cloud server, the broadcasting ground of the live content generation live content for being provided based on mobile terminal or camera
Location；
Payment platform, for being received for material object from the terminal of the broadcast address viewing live content based on live content
Sequence information in kind, information to be paid in kind is generated based on sequence information in kind, and when terminal is complete based on information to be paid in kind
Into after payment, distribute to the digital audio-video unit in digital audio-video place in kind.
In one embodiment, living broadcast interactive system also includes in the digital audio-video unit in digital audio-video place
Set Top Box；
Camera or mobile terminal, are additionally operable to record video or picture in kind, and video or picture in kind are sent to
Set Top Box；Set Top Box is connected with display unit, for video or picture in kind to be sent into display unit；Display unit, uses
In display live content and the video or picture of material object.
In one embodiment, box is disposed in digital audio-video place, and the digital audio-video place includes following
At least one of：Karaoke place；Nightclub；Bar；Hotel；Multimedia conferencing room；Internet bar；Shadow；Pool room, etc..
Fig. 4 is the living broadcast interactive element schematic diagram according to embodiment of the present invention.During live, use can be both shown
Family enters and exits the state of direct broadcast band, can also show that virtual present is given a present and the process given a present in kind.
In addition to above-mentioned living broadcast interactive, embodiment of the present invention is herein in connection with disclosing a kind of method of mobile payment.
Mobile payment (Mobile Payment), also referred to as mobile-phone payment refer to both parties for certain goods or
Person services, and the use of mobile terminal device is carrier, the business transaction realized by mobile communications network.What mobile payment was used
Mobile terminal can be mobile phone, personal digital assistant (PDA), mobile personal computer (PC) etc..Mobile payment widely should at present
In all trades and professions.When being paid after checking, user can be square by cash, swipe the card payment or third-party platform payment etc.
Formula carries out checkout operation.In payment process, it usually needs payment terminal (such as, the card swiping terminal of such as card reader etc) with
Internet have be stably connected with.If paying server can not normally connect network, cannot just complete to pay.However, when payment
When server is more, each paying server connects internet can cause Cost Problems.And, a large amount of payment is settled accounts simultaneously
When, multiple paying servers bring no small pressure to the load of network and bandwidth, it could even be possible to because network blockage is led
Cause to pay time-out.In addition, directly by paying server in internet, it is also possible to cause security risk problem.
At present, the mobile payment in digital audio-video place mainly has two ways：Mode (1), mobile terminal pass through internet
The direct product in the purchase network platform, mobile terminal is directly to being paid on third-party payment platform.In mode (1)
In, digital audio-video place cannot obtain the means of subsistence of user, it is impossible to carry out the operation such as big data analysis.Mode (2), movement are eventually
End direct payment to the payment management platform in digital audio-video place, payment management platform again with third-party payment platform pair
Connect.However, after there is the new means of payment, payment management platform must be updated.Because payment management platform is arranged on
In place, so after the means of payment increases or changes every time, the payment management platform in place must all carry out respective operations, pole
It is inconvenient.
In view of paying server needs to be directly connected to internet that the defect of mobile payment, this hair could be realized in the prior art
Bright implementation method proposes a kind of novel mobile payment mode.Payment management platform with internet without being directly connected to be capable of achieving
Mobile payment, so as to improve the security and reduces cost of mobile payment.The mobile-payment system that embodiment of the present invention is proposed,
Including：Payment management platform, gateway server, cloud server and payment platform, wherein payment management platform are arranged in local
In net；Payment management platform, for receiving sequence information via LAN, is sent to gateway and takes via LAN by sequence information
Business device；Gateway server, for sequence information to be sent into cloud server via internet；Cloud server, for via
Sequence information is sent to payment platform by internet；Payment platform, information to be paid is generated for generating based on sequence information, and
Information to be paid to cloud server is sent via internet；Cloud server, is additionally operable to information to be paid via internet
It is sent to gateway server；Gateway server, is additionally operable to send information to be paid to payment management platform via LAN；Pay
Management platform, is additionally operable to show information to be paid, and payment is performed based on information to be paid with by user.Preferably, payment management
Platform includes lower unit/terminal, Set Top Box and/or paying server.
Correspondingly, the living broadcast interactive method shown in Fig. 1 also includes：
It is flat via payment management of the Set Top Box in the digital audio-video unit with digital audio-video place in same LAN
Platform, the mobile terminal mutually bound from the digital audio-video unit with the digital audio-video place receives sequence information；
The sequence information is sent to by gateway server by LAN via the payment management platform, with by described
The sequence information is sent to cloud server by gateway server via internet, and will via internet by cloud server
The sequence information is sent to payment platform；
Information to be paid, the letter to be paid are received from gateway server by LAN via the payment management platform
Breath is based on sequence information and generates and be sent to cloud server via internet by payment platform, then by cloud server via
Internet is sent to gateway server；
Show the information to be paid, payment is performed based on the information to be paid with by mobile terminal.
In one embodiment, the living broadcast interactive method shown in Fig. 1 also includes：
Payment platform returns to payment result via internet to cloud server；
Payment result is sent to gateway server by cloud server via internet；
Gateway server sends payment result via LAN to payment management platform.
In one embodiment, the living broadcast interactive method shown in Fig. 1 also includes：
When new payment platform is increased, cloud server is further set up and is connected with the internet of new payment platform；
Cloud server is based on predetermined policy selection target payment platform, and it is flat that the sequence information is sent into the target payment
Platform；Or
When the payment platform is replaced by other payment platform, cloud server further set up with it is described in addition
Payment platform internet connection；The sequence information is sent to the other payment by cloud server via internet
Platform；Or
When payment platform is deleted, cloud server is deleted and is connected with the internet of the payment platform.
In one embodiment, receiving sequence information via the payment management platform in LAN includes：
Via the LAN sequence information is received from the Set Top Box；Wherein：The sequence information is being moved by user
Dynamic terminal triggering, and it is sent to Set Top Box via the LAN by mobile terminal；Or, being taken from payment via the LAN
Business device receives sequence information；Wherein：The sequence information is triggered on paying server by administrative staff.
In one embodiment, the also number including paying server of the living broadcast interactive method shown in Fig. 1 is one or more
It is individual；And/or, the information to be paid includes the payment code with Quick Response Code form or bar code form, or bank's class payment
Link.
Fig. 5 is the demonstrative structure figure of the mobile-payment system according to embodiment of the present invention.
As shown in figure 5, the system includes：Lower unit/terminal 501, paying server 502, gateway server 503, cloud service
Device 504 and payment platform 505；Unit/terminal 501, paying server 502 and gateway server 503 is wherein descended to be arranged in same office
In the net of domain, the LAN is arranged in mobile payment place.Lower unit/terminal 501 and paying server 502 are linked up to constitute and pay pipe
Platform.
The number of lower unit/terminal 501 can be multiple, and multiple users can respectively generate on respective lower unit/terminal 501
Respective sequence information.
In one embodiment, one or more lower unit/terminals 501 correspond to a paying server 502.Similarly, prop up
The number of pay server 502 can also be multiple, and one or more paying servers 102 correspond to a gateway server
503。
Specifically：
Lower unit/terminal 501, for sending sequence information to corresponding paying server 502 via LAN；
Paying server 502, for receiving sequence information from lower unit/terminal 501 via LAN, will order via LAN
Single information is sent to gateway server 503；
Gateway server 503, for sequence information to be sent into cloud server 504 via internet；
Cloud server 504, for sequence information 504 to be sent into payment platform 505 via internet；
Payment platform 505, for generating information to be paid based on sequence information, and sends information to be paid via internet
To cloud server 504；
Cloud server 504, is additionally operable to that information to be paid is sent into gateway server 503 via internet；
Gateway server 503, is additionally operable to be sent to the paying server 502 that forwarding before carrys out sequence information via LAN
Information to be paid；
Paying server 502, is additionally operable to show information to be paid, and payment is performed based on information to be paid with by user.
Specifically, the sequence information of the lower generation of unit/terminal 501 can be comprising exchange hour, order goods title, order business
Product number, etc..Place title, place coding, box title, box ID, gateway clothes can also be further carried in sequence information
The Business Information such as business device.In one embodiment, information to be paid may be embodied as the payment link of payment code or bank's class.
User, to confirm an order, and performs payment by hand-held mobile scanning terminal payment code, or clicking trigger bank class payment
Link to confirm an order and perform payment.And, payment platform 505 can be the independently developed payment platform of businessman, Huo Zhewei
Arbitrary Third-party payment platform, such as Alipay payment platform, wechat payment platform, Unionpay's payment platform, etc..
It can be seen that, in the system architecture described in Fig. 5, paying server is based on LAN and obtains sequence information, and by net
Close server and obtain information to be paid from high in the clouds.Paying server is no longer needed with internet networked capabilities, so as to reduce
Hardware cost.Especially, when the number of paying server is for multiple, the cost benefit of embodiment of the present invention is more obvious.
In addition, in embodiments of the present invention, paying server is no longer exposed in internet, therefore can evade various
Security risk problem.
And, in embodiments of the present invention, can transaction sensitive data of the server to each transaction place beyond the clouds
Managed concentratedly, both ensure that Information Security, or big data is excavated and provides crucial foundation.
It is exemplary to elaborate embodiment party of the present invention below by embodiment of the present invention specific implementation to digital audio-video place
Formula.Based on embodiment of the present invention, the paying server (such as, check-out services device) in digital audio-video place is what can not be networked
In the case of can also complete pay.
Fig. 6 is the demonstrative structure figure in the mobile-payment system in digital audio-video place according to embodiment of the present invention.
As seen from Figure 6, in the LAN in digital audio-video place, digital audio-video terminal 601, Set Top Box 602, net are disposed with
Close server 603 and paying server 604.Gateway server 603 is connected with cloud server 604 with internet, high in the clouds clothes
Business device 604 is connected with payment platform 605.
Such as, digital audio-video terminal 601 can be to be embodied as in the digital audio-video unit in digital audio-video digital audio-video place
Requesting song screen, etc..After digital audio-video terminal 601 places an order, Set Top Box 602 is connected user based on LAN, from digital audio-video
Terminal 601 receives order request, and place title, place coding, box title, box ID, gateway server are numbered etc.
Business Information carries out corresponding association and encapsulates with sequence information, then the sequence information after encapsulation is sent into payment based on LAN
Server 604.Paying server 604 receives sequence information, and sequence information is sent into gateway server based on LAN
603.Sequence information is sent to cloud server 604 by gateway server 603 by internet, and cloud server 604 is received
After sequence information, the sequence information after encapsulation is decapsulated, and sent out the sequence information after decapsulation by internet
Give corresponding payment platform 605.Payment platform 605 is returned to cloud server 604 by internet and corresponds to sequence information
Payment code, cloud server 604 is packaged to payment code, and payment code is sent into gateway server based on internet
603.Payment code is pushed to paying server 604 by the device of gateway service 603 based on LAN.User passes through mobile terminal 606 pairs
The payment code shown on paying server 604 is paid.After the completion of payment, payment result will be by corresponding payment platform 605
Cloud server 304 is returned to, cloud server 604 transmits payment result to gateway server 603 and the mobile end of user again
Payment result is sent to paying server 604 by end 606, gateway server 603 again, completes whole payment process.
When payment platform 605 is changed, change is capable of achieving by the payment platform interface for changing cloud server,
And without making change to paying server 604 or gateway server 603, therefore configuration work is relatively simple.
And, when user A selects to start live by mobile terminal 606, mobile terminal 606 records the intelligence and art of user A
Performance video, and live content is sent to cloud server 604.Cloud server 604 generates the broadcast address of live content.
Terminal B in payment terminal 607 watches live content by the broadcast address of live content, and enjoys a lot live user A's
Show content.User B intends to send Zhang San's entity present as reward.User B is sent for sequence information in kind in kind, branch
Pay platform 605 and be based on sequence information generation in kind information to be paid in kind, and branch is completed when user B is based on information to be paid in kind
Fu Hou, distributes in kind to the user A of the mobile terminal 606 in the digital audio-video unit in digital audio-video place.
Invention embodiment is described by taking digital audio-video place as an example above, those skilled in the art will be appreciated that
Arrive, this description is only exemplary, is not intended to limit the present invention the protection domain of implementation method.
In sum, in embodiments of the present invention, by the digital audio-video unit phase in mobile terminal and digital audio-video place
Binding；Live content is determined based on mobile terminal, live content is sent to high in the clouds, to generate the broadcasting of live content by high in the clouds
Address；Received for sequence information in kind in kind, base from the terminal of the broadcast address viewing live content based on live content
Information to be paid in kind is generated in sequence information in kind, and after terminal is based on information completion payment to be paid in kind, to numeral
The digital audio-video unit in audiovisual place distributes the material object.Embodiment of the present invention can be realized giving authentic item, and thus
Improve interactive.
AR can be pressed on towards and be broadcast introducing KTV places by embodiment of the present invention combination camera with live AR contents.
In addition, embodiment of the present invention can also improve the security and reduces cost of mobile payment, but also can be real
Existing high in the clouds configuration, upgrade maintenance is facilitated very much.Especially, when the number of the paying server in payment management platform is multiple
When, the cost benefit of embodiment of the present invention is more obvious.In embodiments of the present invention, when payment platform occurs change, expansion
When exhibition or the upgrading means of payment, corresponding configuration work can be beyond the clouds completed, without lower unit/terminal, paying server etc.
Other service ends make any change, and upgrading and maintenance are greatly simplified.
Further, in embodiments of the present invention, can transaction sensitive data of the server to each transaction place beyond the clouds
Managed concentratedly, both ensure that Information Security, or big data is excavated and provides crucial foundation.
Further, the present invention can be using the camera being arranged in the digital audio-video unit in digital audio-video place as live
Recording source, overcomes the shortcoming that mobile phone camera is easily shaken in shooting process, and overcome mobile phone camera network letter
It is number bad, easily cause the shortcoming of live interim card.
The above, only presently preferred embodiments of the present invention is not intended to limit the scope of the present invention.It is all
Within the spirit and principles in the present invention, any modification, equivalent substitution and improvements made etc. should be included in protection of the invention
Within the scope of.
Claims (14)
1. a kind of living broadcast interactive method, it is characterised in that the method includes：
The end of live content, receives for order in kind in kind from the digital audio-video unit in digital audio-video place is received
Information, information to be paid in kind is generated based on the sequence information in kind, and when the terminal is based on the letter to be paid in kind
After breath completes to pay, the material object is distributed to the digital audio-video unit in the digital audio-video place.
2. living broadcast interactive method according to claim 1, it is characterised in that the method also includes：
Live content is determined based on mobile terminal, the live content is sent to high in the clouds, with by high in the clouds generation live content
Broadcast address；Or
Live content is determined based on box requesting song terminal, the live content is sent to high in the clouds, generated in live with by high in the clouds
The broadcast address of appearance.
3. living broadcast interactive method according to claim 2, it is characterised in that
It is described to determine that live content includes based on mobile terminal：
When live user is selected using the mobile terminal as live recording source on mobile terminals, the mobile terminal is enabled
The video of the live user is recorded as the live content；Or, when live user on the mobile terminal select with
When being arranged in the camera in the digital audio-video unit in the digital audio-video place as live recording source, the camera is enabled
The video of the live user is recorded, and the video of the live user is made into augmented reality with predetermined virtual scene model
Treatment is as the live content；Or, when live user is selected with the mobile terminal and arrangement on the mobile terminal
When camera in the digital audio-video unit in digital audio-video place is collectively as live recording source, the mobile terminal record is enabled
The video of the live user is made, the video that the camera records the live user is enabled, and the mobile terminal is recorded
The video of system, the video of the live user make augmented reality treatment as described live with predetermined virtual scene model
Content；Or, selecting to be arranged in the digital audio-video unit in the digital audio-video place on the mobile terminal as live user
In camera as live recording source when, enable the video that the camera records the live user, and will be described live
The video of user is used as the live content；
Or
It is described to determine that live content includes based on box requesting song terminal：When live user the box requesting song terminal on select with
When being arranged in the camera in the digital audio-video unit in the digital audio-video place as live recording source, the camera is enabled
Record the video of the live user, and using the video of the live user as the live content；Or, when live user exists
Selected in box requesting song terminal to be arranged in the camera in the digital audio-video unit in the digital audio-video place as straight
When broadcasting recording source, enable the video that the camera records the live user, and by the video of the live user with it is predetermined
Virtual scene model make augmented reality process as the live content.
4. living broadcast interactive method according to claim 1, it is characterised in that the numeral in the reception digital audio-video place is regarded
Live content includes in listening unit：
Terminal is connected to live page and receives the live content by wechat；And/or
Terminal receives the live content by predetermined application program.
5. living broadcast interactive method according to claim 1, it is characterised in that described in kind including in following at least
It is individual：
Drinks；Beverage；Snacks；Fresh flower；Fruit；Prepared food；Toy；Clothes；Ornaments.
6. living broadcast interactive method according to claim 1, it is characterised in that the method also includes：
Via payment management platform of the Set Top Box in the digital audio-video unit with digital audio-video place in same LAN, from
Sequence information is received with the mobile terminal that the digital audio-video unit in the digital audio-video place is mutually bound；
The sequence information is sent to by gateway server by LAN via the payment management platform, with by the gateway
The sequence information is sent to cloud server by server via internet, and will be described via internet by cloud server
Sequence information is sent to payment platform；
Information to be paid is received from gateway server by LAN via the payment management platform, the information to be paid by
Payment platform is based on sequence information and generates and be sent to cloud server via internet, then by cloud server via interconnection
Net is sent to gateway server；
Show the information to be paid, payment is performed based on the information to be paid with by mobile terminal；Or
The method also includes：Payment platform returns to payment result via internet to cloud server；Cloud server is via mutual
Payment result is sent to gateway server by networking；Gateway server sends to payment management platform via LAN and pays knot
Really；
Or the method also includes：
When new payment platform is increased, cloud server is further set up and is connected with the internet of new payment platform；High in the clouds
Server is based on predetermined policy selection target payment platform, and the sequence information is sent into the target payment platform；Or,
When the payment platform is replaced by other payment platform, cloud server further sets up flat with the other payment
The internet connection of platform；The sequence information is sent to the other payment platform by cloud server via internet；Or,
When payment platform is deleted, cloud server is deleted and is connected with the internet of the payment platform.
7. living broadcast interactive method according to claim 6, it is characterised in that the payment management via in LAN is put down
Platform receives sequence information to be included：
Via the LAN sequence information is received from the Set Top Box；Wherein：The sequence information is mobile whole by user
End triggering, and it is sent to Set Top Box via the LAN by mobile terminal；Or, via the LAN from paying server
Receive sequence information；Wherein：The sequence information is triggered on paying server by administrative staff；
Or
The number of the paying server is one or more；And/or, the information to be paid includes thering is Quick Response Code form or bar
The payment code of shape code form, or bank's class payment link.
8. living broadcast interactive method according to claim 1, it is characterised in that the method also includes：
Record the video or picture in kind；
The live content and the video or picture in kind are shown in the digital audio-video unit in the digital audio-video place.
9. living broadcast interactive method according to claim 3, it is characterised in that
The method also includes：First object is updated in the virtual scene model, and when interaction instruction is received, according to
Interaction instruction updates in the virtual scene model interaction content, to obtain the live content；
Wherein described first object includes at least one of following：True man's object；Pet；Plant.
10. living broadcast interactive method according to claim 9, it is characterised in that
First object is updated to be included to the virtual scene model：The signal of more than one camera head is obtained in real time, is adopted
Collection obtains more than one first view data；According to default condition, more than one is extracted from each first view data
The first object, by more than one first object real-time update to virtual scene model；
The interaction content also content-data including the first material, first material includes：Textual materials, picture material,
The combination of sound material or picture material and sound material；Or, the virtual scene model is 3D virtual stages.
A kind of 11. living broadcast interactive systems, it is characterised in that including：
Cloud server, for live content generation broadcast address in the digital audio-video unit based on digital audio-video place；
Payment platform, for from the end that live content is watched based on the broadcast address, receiving and being ordered for material object in kind
Single information, information to be paid in kind is generated based on the sequence information in kind, and when the terminal is to be paid based on the material object
After information completes to pay, the material object is distributed to the digital audio-video unit in the digital audio-video place.
12. living broadcast interactive systems according to claim 11, it is characterised in that also include：
Mobile terminal, for being selected on the mobile terminal using the mobile terminal as live recording source as live user
When, the video of the live user is recorded as live content or by the video of the live user and predetermined virtual scene
Model makes augmented reality treatment as the live content, and the live content is sent into cloud server；
The camera in the digital audio-video unit in the digital audio-video place is arranged in, for when live user is described mobile whole
The video that the live user is recorded during using the camera as live recording source is selected on end as live content, or
The video of the live user and predetermined virtual scene model are made into augmented reality treatment as live content, will be described
Live content is sent to cloud server；
Box is requested a song terminal, for being selected using the camera as live record in box requesting song terminal as live user
During source processed, enable the camera and record the video of the live user and using the video of the live user as described live
Content, or the video of the live user and predetermined virtual scene model are made into augmented reality treatment as described live
Content.
13. living broadcast interactive systems according to claim 12, it is characterised in that also including positioned at the digital audio-video place
Digital audio-video unit in Set Top Box；
The camera or the mobile terminal, are additionally operable to record the video or picture of the material object, by the video in kind
Or picture is sent to the Set Top Box；
The Set Top Box is connected with display unit, for the video in kind or picture to be sent into display unit；
Display unit, for showing the live content and the video or picture in kind.
The 14. living broadcast interactive system according to claim 12 or 13, it is characterised in that under the digital audio-video place includes
At least one of row：Karaoke place；Nightclub；Bar；Hotel；Multimedia conferencing room；Internet bar；Shadow；Pool room；With/
Or
The digital audio-video unit includes box.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611142174.7A CN106792228B (en) | 2016-12-12 | 2016-12-12 | Live broadcast interaction method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611142174.7A CN106792228B (en) | 2016-12-12 | 2016-12-12 | Live broadcast interaction method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106792228A true CN106792228A (en) | 2017-05-31 |
| CN106792228B CN106792228B (en) | 2020-10-13 |
Family
ID=58876029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611142174.7A Active CN106792228B (en) | 2016-12-12 | 2016-12-12 | Live broadcast interaction method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106792228B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108108014A (en) * | 2017-11-16 | 2018-06-01 | 北京密境和风科技有限公司 | A kind of methods of exhibiting, device that picture is broadcast live |
| CN108282666A (en) * | 2018-01-26 | 2018-07-13 | 北京潘达互娱科技有限公司 | Control method and device based on network direct broadcasting |
| CN108769775A (en) * | 2018-05-30 | 2018-11-06 | 广州华多网络科技有限公司 | Data processing method and device, network direct broadcasting system in network direct broadcasting |
| CN109005416A (en) * | 2018-08-01 | 2018-12-14 | 武汉斗鱼网络科技有限公司 | AR scans interactive approach, storage medium, equipment and system in live streaming |
| CN109064180A (en) * | 2018-07-13 | 2018-12-21 | 广州神马移动信息科技有限公司 | Comment on method, apparatus and terminal device |
| CN109286851A (en) * | 2018-11-09 | 2019-01-29 | 广州酷狗计算机科技有限公司 | In the method and storage medium of direct broadcasting room requesting song |
| CN109285532A (en) * | 2018-10-31 | 2019-01-29 | 深圳市酷达通讯有限公司 | A kind of order programme |
| WO2019019306A1 (en) * | 2017-07-27 | 2019-01-31 | 深圳依偎控股有限公司 | Dual-camera collection-based 3d live broadcasting display method and system |
| WO2019119815A1 (en) * | 2017-12-18 | 2019-06-27 | 广州市动景计算机科技有限公司 | Ar service processing method, apparatus, device and computer readable storage medium |
| CN110069342A (en) * | 2019-04-11 | 2019-07-30 | 西安交通大学 | Net cast channel dispositions method is merged under a kind of mobile cloud computing environment |
| CN110312142A (en) * | 2019-07-23 | 2019-10-08 | 东华大学 | A kind of AR live broadcast system based on 5G technology |
| CN111641850A (en) * | 2020-04-23 | 2020-09-08 | 福建凯米网络科技有限公司 | Audio-visual place interaction method and equipment |
| CN111683265A (en) * | 2020-06-23 | 2020-09-18 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method and device |
| CN114786026A (en) * | 2022-04-06 | 2022-07-22 | 南京小灿灿网络科技有限公司 | Live broadcast interaction method and system based on digital audio-visual place |
| CN115099910A (en) * | 2022-08-25 | 2022-09-23 | 北京蔚领时代科技有限公司 | Order processing method for cloud application |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001045057A1 (en) * | 1999-12-14 | 2001-06-21 | Hypercom Corporation | Method and apparatus for point of sale device to access web site for processing orders and fulfillment information |
| CN101034448A (en) * | 2006-03-08 | 2007-09-12 | 株式会社NRNeT | Payment system using prepaid-type terminals and method thereof |
| CN101894335A (en) * | 2010-06-17 | 2010-11-24 | 中兴通讯股份有限公司 | Payment method and system for on-line transaction and home gateway |
| CN104219199A (en) * | 2013-05-29 | 2014-12-17 | 大连万达集团股份有限公司 | KTV recording system and using method thereof |
| CN104468845A (en) * | 2014-12-31 | 2015-03-25 | 广州华多网络科技有限公司 | Data processing method and system |
| CN105321107A (en) * | 2015-06-25 | 2016-02-10 | 苏州蜗牛数字科技股份有限公司 | Method and system for participating in network transaction by mobile terminal |
| CN105897770A (en) * | 2016-06-20 | 2016-08-24 | 武汉斗鱼网络科技有限公司 | Virtual gift display method and device based on live broadcasting |
| CN106067136A (en) * | 2016-06-13 | 2016-11-02 | 南京物联传感技术有限公司 | A kind of intelligent rotating button purchase system and method |
| CN106157006A (en) * | 2016-06-30 | 2016-11-23 | 广州华多网络科技有限公司 | Based on the most live virtual present presentation method and device |
-
2016
- 2016-12-12 CN CN201611142174.7A patent/CN106792228B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001045057A1 (en) * | 1999-12-14 | 2001-06-21 | Hypercom Corporation | Method and apparatus for point of sale device to access web site for processing orders and fulfillment information |
| CN101034448A (en) * | 2006-03-08 | 2007-09-12 | 株式会社NRNeT | Payment system using prepaid-type terminals and method thereof |
| CN101894335A (en) * | 2010-06-17 | 2010-11-24 | 中兴通讯股份有限公司 | Payment method and system for on-line transaction and home gateway |
| CN104219199A (en) * | 2013-05-29 | 2014-12-17 | 大连万达集团股份有限公司 | KTV recording system and using method thereof |
| CN104468845A (en) * | 2014-12-31 | 2015-03-25 | 广州华多网络科技有限公司 | Data processing method and system |
| CN105321107A (en) * | 2015-06-25 | 2016-02-10 | 苏州蜗牛数字科技股份有限公司 | Method and system for participating in network transaction by mobile terminal |
| CN106067136A (en) * | 2016-06-13 | 2016-11-02 | 南京物联传感技术有限公司 | A kind of intelligent rotating button purchase system and method |
| CN105897770A (en) * | 2016-06-20 | 2016-08-24 | 武汉斗鱼网络科技有限公司 | Virtual gift display method and device based on live broadcasting |
| CN106157006A (en) * | 2016-06-30 | 2016-11-23 | 广州华多网络科技有限公司 | Based on the most live virtual present presentation method and device |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019019306A1 (en) * | 2017-07-27 | 2019-01-31 | 深圳依偎控股有限公司 | Dual-camera collection-based 3d live broadcasting display method and system |
| CN108108014A (en) * | 2017-11-16 | 2018-06-01 | 北京密境和风科技有限公司 | A kind of methods of exhibiting, device that picture is broadcast live |
| WO2019119815A1 (en) * | 2017-12-18 | 2019-06-27 | 广州市动景计算机科技有限公司 | Ar service processing method, apparatus, device and computer readable storage medium |
| CN108282666A (en) * | 2018-01-26 | 2018-07-13 | 北京潘达互娱科技有限公司 | Control method and device based on network direct broadcasting |
| CN108769775A (en) * | 2018-05-30 | 2018-11-06 | 广州华多网络科技有限公司 | Data processing method and device, network direct broadcasting system in network direct broadcasting |
| CN108769775B (en) * | 2018-05-30 | 2021-06-29 | 广州方硅信息技术有限公司 | Data processing method and device in live webcast and live webcast system |
| CN109064180A (en) * | 2018-07-13 | 2018-12-21 | 广州神马移动信息科技有限公司 | Comment on method, apparatus and terminal device |
| CN109005416B (en) * | 2018-08-01 | 2020-12-15 | 武汉斗鱼网络科技有限公司 | AR scanning interaction method, storage medium, equipment and system in live broadcast |
| CN109005416A (en) * | 2018-08-01 | 2018-12-14 | 武汉斗鱼网络科技有限公司 | AR scans interactive approach, storage medium, equipment and system in live streaming |
| CN109285532A (en) * | 2018-10-31 | 2019-01-29 | 深圳市酷达通讯有限公司 | A kind of order programme |
| CN109286851A (en) * | 2018-11-09 | 2019-01-29 | 广州酷狗计算机科技有限公司 | In the method and storage medium of direct broadcasting room requesting song |
| CN110069342B (en) * | 2019-04-11 | 2021-01-15 | 西安交通大学 | Method for deploying fusion video live broadcast channel in mobile cloud computing environment |
| CN110069342A (en) * | 2019-04-11 | 2019-07-30 | 西安交通大学 | Net cast channel dispositions method is merged under a kind of mobile cloud computing environment |
| CN110312142A (en) * | 2019-07-23 | 2019-10-08 | 东华大学 | A kind of AR live broadcast system based on 5G technology |
| CN111641850A (en) * | 2020-04-23 | 2020-09-08 | 福建凯米网络科技有限公司 | Audio-visual place interaction method and equipment |
| CN111641850B (en) * | 2020-04-23 | 2022-08-26 | 福建凯米网络科技有限公司 | Audio-visual place interaction method and equipment |
| CN111683265A (en) * | 2020-06-23 | 2020-09-18 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method and device |
| CN111683265B (en) * | 2020-06-23 | 2021-10-29 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method and device |
| CN114786026A (en) * | 2022-04-06 | 2022-07-22 | 南京小灿灿网络科技有限公司 | Live broadcast interaction method and system based on digital audio-visual place |
| CN115099910A (en) * | 2022-08-25 | 2022-09-23 | 北京蔚领时代科技有限公司 | Order processing method for cloud application |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106792228B (en) | 2020-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106792228A (en) | A kind of living broadcast interactive method and system | |
| CN106792214A (en) | A kind of living broadcast interactive method and system based on digital audio-video place | |
| CN106792246B (en) | Method and system for interaction of fusion type virtual scene | |
| CN106789991B (en) | Multi-person interactive network live broadcast method and system based on virtual scene | |
| WO2018045927A1 (en) | Three-dimensional virtual technology based internet real-time interactive live broadcasting method and device | |
| JP6397911B2 (en) | Video broadcast system and method for distributing video content | |
| CN109889855A (en) | Intelligent panoramic net cast networked shopping system and method based on mobile APP | |
| CN106134227B (en) | Method, apparatus and system for the Instantaneous sharing video content in social media | |
| CN107360160A (en) | live video and animation fusion method, device and terminal device | |
| JP2022177053A (en) | Information processing system, information processing method, and information processing program | |
| CN106713988A (en) | Beautifying method and system for virtual scene live | |
| US10205969B2 (en) | 360 degree space image reproduction method and system therefor | |
| CN108282598A (en) | A kind of software director system and method | |
| CN113115110B (en) | Video synthesis method and device, storage medium and electronic equipment | |
| KR20150105058A (en) | Mixed reality type virtual performance system using online | |
| CN104335243A (en) | Processing panoramic pictures | |
| CN113473207B (en) | Live broadcast method and device, storage medium and electronic equipment | |
| KR20160096019A (en) | Method of Service for Providing Advertisement Contents to Game Play Video | |
| CN107592549A (en) | Panoramic video based on two-way communication plays camera system | |
| KR100901111B1 (en) | Live-Image Providing System Using Contents of 3D Virtual Space | |
| KR101680551B1 (en) | Method for creating and automatic vending private music video | |
| CN116761009A (en) | Video playing method and device in meta-universe panoramic live broadcast scene and live broadcast system | |
| JP2015198443A (en) | augmented reality system, augmented reality processing method, program and recording medium | |
| KR20090035254A (en) | System for composing of moving pictures and creating a character by extracting the object in real time | |
| KR101221540B1 (en) | Interactive media mapping system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |