CN110708610B - Offline live broadcast interaction system and method - Google Patents

Offline live broadcast interaction system and method Download PDF

Info

Publication number
CN110708610B
CN110708610B CN201910967149.XA CN201910967149A CN110708610B CN 110708610 B CN110708610 B CN 110708610B CN 201910967149 A CN201910967149 A CN 201910967149A CN 110708610 B CN110708610 B CN 110708610B
Authority
CN
China
Prior art keywords
client
audience
live broadcast
interactive data
data transmission
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910967149.XA
Other languages
Chinese (zh)
Other versions
CN110708610A (en
Inventor
孟奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201910967149.XA priority Critical patent/CN110708610B/en
Publication of CN110708610A publication Critical patent/CN110708610A/en
Application granted granted Critical
Publication of CN110708610B publication Critical patent/CN110708610B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40Support for services or applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention provides an offline live broadcast interactive system and method, wherein the offline live broadcast interactive system comprises: the audience client is used for acquiring a live broadcast interaction request of an audience; the anchor client comprises a live broadcast chair, a live broadcast table, a background wall positioned behind the live broadcast table and the live broadcast chair, and an entity prop unit in communication connection with the live broadcast chair, the live broadcast table and the background wall, wherein the anchor client is used for responding to a live broadcast interaction request of audiences and enabling the entity prop unit to perform entity interaction with the anchor through the live broadcast chair, the live broadcast table or the background wall; and the server is used for transmitting the live broadcast interaction request of the audience to the anchor client, and transmitting the entity prop unit and the entity interaction of the anchor to the audience client. According to the system, by means of the entity prop unit, the audience can perform entity interaction with the anchor through the live broadcast chair, the live broadcast table or the background wall, and the interaction effect between the audience and the anchor can be enhanced.

Description

Offline live broadcast interaction system and method
Technical Field
The invention relates to the technical field of Internet live broadcast, in particular to an offline live broadcast interaction system and method.
Background
The network live broadcast absorbs and continues the advantages of the internet, and aiming at users with live broadcast requirements, by utilizing the internet (or a private network) and advanced multimedia communication technology and constructing a multifunctional network live broadcast platform integrating audio, video, desktop sharing, document sharing and interaction links on the network, enterprises or individuals can directly carry out comprehensive communication and interaction of voice, video and data on line. In the existing live broadcast interactive system, audiences can only give virtual gifts or input characters, a main broadcast can only respond through images, sounds or videos, a stereoscopic multi-style interactive mode is lacked between the audiences and the main broadcast, and the interactive effect is poor.
Disclosure of Invention
The invention provides an offline live broadcast interactive system and method, which are used for enhancing the interactive effect between audiences and a main broadcast.
The invention provides an offline live broadcast interactive system, which comprises:
the audience client is used for acquiring a live broadcast interaction request of an audience;
the anchor client side comprises a live broadcast chair, a live broadcast table, a background wall positioned behind the live broadcast table and the live broadcast chair, and an entity prop unit in communication connection with the live broadcast chair, the live broadcast table and the background wall, and the anchor client side is used for responding to the live broadcast interaction request of audiences and enabling the entity prop unit to perform entity interaction with an anchor through the live broadcast chair, the live broadcast table or the background wall; and
and the server is connected with the audience client and the anchor client and is used for transmitting the live broadcast interaction request of the audience to the anchor client and transmitting the entity prop unit and the entity interaction of the anchor to the audience client.
Further, the physical prop unit includes a number of physical props having physical entities and capable of physical entity changes of at least one of sound, light, electricity, magnetism, heat, gas, liquid, and machinery.
Further, the entity prop unit comprises one or more of a color bubble generating device, a light color changing device, an inflating hammer, a spraying device, a lightning simulating device, a massaging device, an electrostatic generator, a cold tobacco forming device, a sound special effect device, a smell special effect device and a beverage device.
Further, the server is also configured to detect a virtual gift-giving instruction triggered by a viewer at the viewer client,
the anchor client further comprises a virtual gift display module, and the virtual gift display module is used for determining a sound special effect, a visual special effect, a smell special effect or a touch special effect corresponding to the virtual gift to be presented when the server detects a virtual gift presenting instruction triggered by the audience at the audience client, and outputting the sound special effect, the visual special effect, the smell special effect or the touch special effect corresponding to the virtual gift to be presented through the entity prop unit so as to display the virtual gift.
Further, the viewer client obtains a live interaction request of a viewer and executes the following steps:
receiving the live broadcast interactive data sent by the server, loading a corresponding live broadcast interactive area in a live broadcast page of a specified live broadcast room according to the live broadcast interactive data, and executing input and/or selection operation in the live broadcast interactive area by the audience;
performing semantic recognition on each input and/or selection operation in a plurality of live broadcast interactive data of the audience client, and acquiring target live broadcast interactive data with semantics conforming to preset semantics from the plurality of live broadcast interactive data according to a semantic recognition result;
acquiring virtual gift information belonging to the virtual gift giving instruction set from the target live broadcast interactive data, and determining the occurrence frequency of the acquired virtual gift information in the live broadcast interactive data;
and when the occurrence frequency is greater than or equal to a frequency threshold value corresponding to the acquired virtual gift information, determining the virtual gift information corresponding to the live broadcast interaction data as the live broadcast interaction request.
Further, the entity prop unit performs entity interaction with a main broadcast through the live broadcast chair, the live broadcast table or the background wall to execute the following steps:
the service receives the live broadcast interaction request of the audience and transmits the live broadcast interaction request to the anchor client to obtain audience behavior information of the audience, wherein the audience behavior information comprises audience voice information and audience action information, the audience voice information comprises keywords and volume values, and the audience action information comprises action force;
after receiving the live broadcast interaction request of the audience, the anchor client determines the emotion state of the audience according to the audience behavior information, and the method comprises the following steps: determining an emotional state identifier according to the keyword, wherein the emotional state identifier corresponds to an emotional state; determining emotional state intensity according to at least one of the volume value and the action strength, converting the volume value into a first weight value, determining the first weight value as emotional state intensity, or converting the action strength into a second weight value, determining the second weight value as emotional state intensity, or converting the volume value into the first weight value, converting the action strength into the second weight value, and determining the sum of the first weight value and the second weight value as emotional state intensity; when the emotional state strength meets a preset condition, determining the emotional state corresponding to the emotional state identifier as the emotional state of the audience;
and selecting at least one of the live broadcast chair, the live broadcast table or the background wall as an action carrier of the entity prop unit according to the emotion state of the audience, converting a parameter setting instruction of the entity prop unit into an instruction in a preset format conforming to the emotion state of the audience, and sending the instruction in the preset format conforming to the emotion state of the audience to the corresponding action object, so that the entity prop unit and the anchor carry out an interaction strategy corresponding to the emotion state of the user through the action carrier.
Furthermore, the anchor client further comprises a background wall control unit and a multimedia device, wherein the background wall control unit is connected with the background wall, and the background wall control unit is used for responding to the live broadcast interaction request of the audience, controlling the multimedia device to play videos requested by the audience through the background wall, or displaying wind, thunder, ghost, expression bags and cartoon characters, or displaying background real objects or special light effects.
Further, the server transmits the live interaction request of the audience to the anchor client, and transmits the entity prop unit and the entity interaction of the anchor to the audience client by adopting the following steps:
firstly, a complete interactive data transmission flow is that the live interactive request is transmitted to the anchor client, and the entity prop unit and the entity of the anchor are interactively transmitted to the audience client, so as to obtain a set SA of the anchor client and the audience client through which the complete interactive data transmission flow passes,
Figure BDA0002230264790000041
wherein i is the number variable of the complete interactive data transmission process, the initial value is 1, the number is increased by taking 1 as a unit, and the maximum value is the preset value N1, SAiFor the set of clients of the ith complete flow,
Figure BDA0002230264790000042
for the ith complete flowiAn interactive data transmission client in s state, where the client is the audience client or the anchor client, s is a boolean value of the state of sending data or receiving interactive data by the client, and s is a true tableShowing the client as an interactive data sending party, showing the client as an interactive data receiving party by s ═ false, and showing the client as an interactive data receiving party by kiThe total number of the clients passed by the complete interactive data transmission process;
then, the total egress bandwidth in the complete interactive data transmission flow is calculated by using the following calculation formula:
Figure BDA0002230264790000043
wherein j is the number variable of the clients through which the complete interactive data transmission process passes, and j belongs to {1,2,3i},Gi(SAi) Total egress bandwidth for the set of clients, ci,jThe value range of the bandwidth used by the jth client in the complete interactive data transmission process is ci,j∈[ci,jmin,ci,jmax],ci,jminIs the bandwidth minimum value of the jth client side of the complete interactive data transmission process, ci,jmaxThe bandwidth of the jth client side of the complete interactive data transmission process is the maximum value;
secondly, calculating the total transmission time of the complete interactive data transmission flow by adopting the following calculation formula:
Figure BDA0002230264790000044
wherein, biThe total size of the interactive data transmitted for the ith complete interactive data transmission process, b is the size of the transmission data within 1 second, and ti,jThe value range of the time from the ith complete interactive data transmission process to the jth client is ti,j∈[ti,jmin,ti,jmax],ti,jminThe lower limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process, ti,jmaxThe upper limit of the time for transmitting the data for the buffer memory of the jth client in the complete interactive data transmission process,Ti(SAi) The total transmission time of the complete interactive data transmission process;
secondly, the maximum value max (T) of the total transmission time is respectively obtainedi(SAi),hi,j) Min (T) minimum valuei(SAi),hi,j) And a maximum value max (G) of said total egress bandwidthi(SAi),hi,j) Minimum value min (G)i(SAi),hi,j) Wherein h isi,jA saturation constant of the jth client data transmission for the ith complete process is a preset value, and the adopted calculation formula is hi,j=ci,j/ci,jmaxThe value range is hi,j∈[0,1],hi,j1 denotes that the client data transmission is saturated, 0 ≦ hi,j< 1 indicates that the client data transfer is not saturated;
finally, under the condition that the client data transmission is not saturated, solving a comprehensive evaluation calculation minimum function of the total transmission time and the total exit bandwidth, wherein the comprehensive evaluation calculation minimum function adopts the following formula:
Figure BDA0002230264790000051
phi is the function of the minimum value of the comprehensive evaluation calculation function, alpha and beta are preset weights, the value ranges are respectively in the range of alpha belonging to (0,1) and beta belonging to (0,1), beta + alpha is equal to 1, argmin is the minimum value, and the state of the minimum value of the comprehensive evaluation calculation function is the optimal interactive data transmission state of the system.
Further, after receiving the live broadcast interaction request of the audience, the anchor client determines the emotion state of the audience by adopting the following steps according to the audience behavior information:
first, information of all the keywords is extracted, the information constitutes an information set, and the information set is SG ═ { SG ═1,sg2,...,sgk,...,sgnAnd k is the information sequence number variable, and the value range is k belonging to {1, 2.. multidot.n }, sgiInformation of the kth keyword;
then, all the emotional state identifications are created, and the set of emotional state identifications is SQ ═ { SQ ═ SQ1,sq2,...,sql,...,sqmAnd l is the sequence number variable of the emotional state identifier, and the value range is l belonging to {1,2lIdentifying for the ith said emotional state;
then, determining the emotional state identifier by adopting the following formula according to the keyword:
Figure BDA0002230264790000052
wherein, p (sg)k|sql) As the keyword information sgkBelongs to the emotional state mark sqlProbability of (1), argmax is the maximum value, uklTo add sgkAfter information, the emotional state identification sqlThe average value of (a) of (b),
Figure BDA0002230264790000061
to add sgkAfter information, the emotional state identification sqlThe variance of (a);
then, the emotional state intensity is calculated using the following formula:
Figure BDA0002230264790000062
wherein the content of the first and second substances,
Figure BDA0002230264790000063
for said audience aoThe intensity of the emotional state at time r +1,
Figure BDA0002230264790000064
for said audience aoThe intensity of the emotional state at time r,
Figure BDA0002230264790000065
for the said audienceao+sThe intensity of the emotional state at time r,
Figure BDA0002230264790000066
for said audience ao+sThe ability of the mood affecting device(s),
Figure BDA0002230264790000067
for said audience aoThe ability of the mood affecting device(s),
Figure BDA0002230264790000068
for said audience aoThe degree of infection of the mood of the patient,
Figure BDA0002230264790000069
for said audience ao+sAnd the audience aoH is the set of all said viewers,
Figure BDA00022302647900000610
for the said audienceao+sWeight of v1As a mood regulator, v2(ii) an emotional infection modifier for all of said viewers;
finally, determining the emotional state intensity
Figure BDA00022302647900000611
Corresponding preset condition SZ corresponding to the emotional state identifierlI.e. by
Figure BDA00022302647900000612
Thereby determining the viewer emotional state.
The offline live broadcast interaction system provided by the embodiment of the invention has the following beneficial effects: by means of the entity prop unit, audiences can perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall, the anchor can quickly and accurately respond to the live broadcast interaction requests of the audiences, and the audiences can also see the response of the anchor truly, so that the interaction effect between the audiences and the anchor can be enhanced.
The invention also provides an offline live broadcast interaction method, which comprises the following steps:
step 1: at a spectator client, acquiring a live broadcast interaction request of spectators;
step 2: transmitting the live interaction request of the audience to an anchor client;
and step 3: responding to the live broadcast interaction request of audiences at the anchor client, and enabling an entity prop unit to perform entity interaction with an anchor through a live broadcast chair, a live broadcast table or a background wall;
and 4, step 4: transmitting the entity prop element to the audience client in interaction with the entity of the anchor.
The offline live broadcast interaction method provided by the embodiment of the invention has the following beneficial effects: by means of the entity prop unit, audiences can perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall, the anchor can quickly and accurately respond to the live broadcast interaction requests of the audiences, and the audiences can also see the response of the anchor truly, so that the interaction effect between the audiences and the anchor can be enhanced.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a block diagram of an offline live broadcast interactive system according to an embodiment of the present invention;
fig. 2 is a flowchart of an offline live broadcast interaction method according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
An embodiment of the present invention provides an offline live broadcast interactive system, as shown in fig. 1, including:
a viewer client 101, configured to obtain a live interaction request of a viewer;
the anchor client 103 comprises a live broadcast chair, a live broadcast table, a background wall positioned behind the live broadcast table and the live broadcast chair, and an entity prop unit in communication connection with the live broadcast chair, the live broadcast table and the background wall, wherein the anchor client 103 is used for responding to the live broadcast interaction request of audiences and enabling the entity prop unit to perform entity interaction with an anchor through the live broadcast chair, the live broadcast table or the background wall; and
and a server 102, connected to the viewer client 101 and the anchor client 103, configured to transmit the live interaction request of the viewer to the anchor client 103, and transmit the entity item unit and the entity interaction of the anchor to the viewer client 101.
The working principle of the technical scheme is as follows: a spectator client 101 obtains a live broadcast interaction request of spectators; the server 102 transmits the live interaction request of the audience to the anchor client 103; the anchor client 103 responds to the live broadcast interaction request of the audience, and enables the entity prop unit to perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall; server 102 the physical prop element is transmitted to audience client 101 in association with the entity of the anchor.
Hardware devices that the viewer client 101 and the anchor client 103 may run may be a computer, a smartphone, and a tablet, and software operating systems that may run may be an android system and an apple system.
The viewer client 101 has a camera and microphone that recognize viewer actions, expressions and voices according to the actions, expressions and voices defined in the preset pattern.
The live broadcast chair, the live broadcast table, the background wall and the entity prop unit are connected in a wired communication mode or a wireless communication mode, wherein the wired communication mode comprises but is not limited to RS232, RS485, RS422, CAN, TCP/IP, ADSL or FSK, and the wireless communication mode comprises but is not limited to Bluetooth, wireless fidelity, zigbee, ultra-wideband, short-distance communication, infrared communication, wireless gigabit, wireless USB, wireless high definition, wireless home digital interface or radio frequency identification.
Furthermore, the live broadcast table can comprise a plurality of brackets embedded in the surface of the live broadcast table or folded at the bottom of the table top and on the table legs, and the brackets are used for placing the entity prop units.
The beneficial effects of the above technical scheme are: by means of the entity prop unit, audiences can perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall, the anchor can quickly and accurately respond to the live broadcast interaction requests of the audiences, and the audiences can also see the response of the anchor truly, so that the interaction effect between the audiences and the anchor can be enhanced.
In one embodiment, the physical prop unit includes a number of physical props having physical entities and capable of physical entity changes in at least one of sound, light, electricity, magnetism, heat, gas, liquid, and machinery.
The working principle of the technical scheme is as follows: the entity prop unit comprises one or more of a color bubble generating device, a light color conversion device, an inflation hammer, a spraying device, a lightning simulation device, a massage device, an electrostatic generator, a cold tobacco peanut forming device, a sound special effect device, a smell special effect device and a beverage device.
The colored bubble generating device can adopt a bubble machine to transport bubbles to the entry of immersible pump, is intraductal by the immersible pump with even the impact of bubble into organic glass, and the immersible pump is drawn water ceaselessly, is brought the bubble into circulating water pipeline evenly, and the color of putting the water in circulating water pipeline can be red, blue or colored, can produce the bubble of ceaseless color like this.
The light color conversion device can convert the live indoor light control parameters according to different scenes, such as a horror scene, a thriller scene, a happy scene, a romantic scene, a sad scene and the like. The light control parameters include display color data, brightness data, and/or flicker frequency.
The pneumatic hammer strikes the anchor in response to a request by the viewer client to strike the anchor.
The spraying device can enable the spraying container to pass through the nozzle to achieve the effects of spraying, spraying decoration, spraying water, spraying snowflakes, spraying colored ribbons, spraying colored chips, spraying dry ice, blowing air, spraying dust and the like, wherein the spraying container is driven by a mechanical device to spray or stop spraying, and meanwhile, the controller can control the mechanical device to achieve automatic mechanical control by means of a driving circuit, so that the spraying efficiency and the spraying effect are improved. The sprayed mist can be colored mist, and the spraying device can be a blower or an electric fan to realize the blowing effect.
The lightning simulation device can be rendering equipment such as a desktop computer, a notebook, a palm computer, a mobile phone and the like. After receiving a lightning special effect request of a spectator client, acquiring a video frame to be processed from a target video frame; acquiring at least three position points in a coordinate range of a video frame, wherein the position points are not on the same straight line; drawing a lightning special effect image based on the position points; and generating a video frame with the lightning special effect based on the lightning special effect image and the video frame to be processed.
The massage device can be a vibration mechanism arranged on the direct seeding chair, and the adjustment of the massage force can be realized by adjusting the electric quantity or the gear of a motor for driving the force.
The electrostatic generator can generate high voltage by mechanical transmission (Van der Graaff generator), so that the big ball is provided with high voltage, the anchor firstly stands on the insulating table, the hand is attached to the high-voltage ball, then the high voltage is applied, the hair of the anchor can be erected, and at the moment, if the high-voltage ball is discharged for a plurality of times by the discharge rod, the audience can see obvious spark.
The cold firework generating device can enable the photoluminescence materials to absorb partial light energy, and release the stored light energy to emit various bright colors such as blue-green light, sky blue, light blue, purple light, yellow light, white light, orange light, red light, yellow-green light and the like after the titanium powder is extinguished. The cold fireworks are also called cold fireworks, cold light fireworks and indoor fireworks.
The sound effect apparatus may play sounds adapted to a specific scene, such as lightning, thunderbolt, wind, thunder, rain, ghost sounds, etc., by means of the multimedia device, and the sounds may be fixed sounds or sounds on demand or uploaded by viewers, etc.
The special smell effect device can make the owner ask for the smell of garlic, durian, toona sinensis, caraway, green Chinese onion and the like.
The drink device can enable a user to taste the taste of drinks such as water, beverages, coffee, wine and the like.
The physical prop unit may be a special effect device, and a device that can add a visual special effect or a special effect that can be sensed by a sense other than vision to increase an immersion feeling and a realistic feeling that viewers can feel when viewing an image. Additional effects that can be provided by the effect means can include a sound effect, a wind effect, a smell effect, a fog effect, a temperature change effect, a laser effect, a light effect, a bubble effect, a water spray effect, and the like, as well as various effects associated with the five senses of a human. Thus, the special effects device may include various devices capable of stimulating five senses of a person, such as speakers, blowers, fragrance diffusers, aerosolizers, lighting devices, heaters, refrigerators, laser devices, foam generators, LEDs, water jets, and the like.
The anchor client also comprises an energy charging device for supplementing energy to each entity prop of the entity prop unit.
The beneficial effects of the above technical scheme are: by means of the entity prop unit, the anchor can make a more real response to the gift or punishment in the live broadcast interaction request of the audience, and the audience can also see the response of the anchor truly, so that the interaction effect between the audience and the anchor is further improved, and the user experience is improved.
In one embodiment, the server is further configured to detect a virtual gift-giving instruction triggered by a viewer at the viewer client,
the anchor client further comprises a virtual gift display module, and the virtual gift display module is used for determining a sound special effect, a visual special effect, a smell special effect or a touch special effect corresponding to the virtual gift to be presented when the server detects a virtual gift presenting instruction triggered by the audience at the audience client, and outputting the sound special effect, the visual special effect, the smell special effect or the touch special effect corresponding to the virtual gift to be presented through the entity prop unit so as to display the virtual gift.
The working principle of the technical scheme is as follows: and after the audience triggers the virtual gift giving instruction, determining a sound special effect, a visual special effect, a smell special effect or a touch special effect corresponding to the virtual gift to be given, and displaying the corresponding sound special effect, visual special effect, smell special effect or touch special effect by the corresponding entity prop unit.
The beneficial effects of the above technical scheme are: by means of the virtual gift display module, virtual gifts given by audiences can be displayed through the physical prop units.
In one embodiment, the viewer client obtains a live interaction request of a viewer and performs the following steps:
receiving the live broadcast interactive data sent by the server, loading a corresponding live broadcast interactive area in a live broadcast page of a specified live broadcast room according to the live broadcast interactive data, and executing input and/or selection operation in the live broadcast interactive area by the audience;
performing semantic recognition on each input and/or selection operation in a plurality of live broadcast interactive data of the audience client, and acquiring target live broadcast interactive data with semantics conforming to preset semantics from the plurality of live broadcast interactive data according to a semantic recognition result;
acquiring virtual gift information belonging to the virtual gift giving instruction set from the target live broadcast interactive data, and determining the occurrence frequency of the acquired virtual gift information in the live broadcast interactive data;
and when the occurrence frequency is greater than or equal to a frequency threshold value corresponding to the acquired virtual gift information, determining the virtual gift information corresponding to the live broadcast interaction data as the live broadcast interaction request.
The working principle of the technical scheme is as follows: according to the semantic recognition result, target live broadcast interactive data with the semantics meeting preset semantics can be obtained from a plurality of live broadcast interactive data, and the virtual gift information with the occurrence frequency larger than or equal to the frequency threshold value corresponding to the obtained virtual gift information is determined as a live broadcast interactive request.
The beneficial effects of the above technical scheme are: the method for acquiring the live broadcast interaction request of the audience can quickly extract the live broadcast interaction request of the audience according to the semantic recognition result, and can improve the acquisition speed and the acquisition accuracy.
In one embodiment, the entity prop unit performs the following steps through the live chair, the live table or the background wall in entity interaction with a main broadcast:
the service receives the live broadcast interaction request of the audience and transmits the live broadcast interaction request to the anchor client to obtain audience behavior information of the audience, wherein the audience behavior information comprises audience voice information and audience action information, the audience voice information comprises keywords and volume values, and the audience action information comprises action force;
after receiving the live broadcast interaction request of the audience, the anchor client determines the emotion state of the audience according to the audience behavior information, and the method comprises the following steps: determining an emotional state identifier according to the keyword, wherein the emotional state identifier corresponds to an emotional state; determining emotional state intensity according to at least one of the volume value and the action strength, converting the volume value into a first weight value, determining the first weight value as emotional state intensity, or converting the action strength into a second weight value, determining the second weight value as emotional state intensity, or converting the volume value into the first weight value, converting the action strength into the second weight value, and determining the sum of the first weight value and the second weight value as emotional state intensity; when the emotional state strength meets a preset condition, determining the emotional state corresponding to the emotional state identifier as the emotional state of the audience;
and selecting at least one of the live broadcast chair, the live broadcast table or the background wall as an action carrier of the entity prop unit according to the emotion state of the audience, converting a parameter setting instruction of the entity prop unit into an instruction in a preset format conforming to the emotion state of the audience, and sending the instruction in the preset format conforming to the emotion state of the audience to the corresponding action object, so that the entity prop unit and the anchor carry out an interaction strategy corresponding to the emotion state of the user through the action carrier.
The working principle of the technical scheme is as follows: the audience has different behavior habits in different emotional states, so that different behaviors are made, and the emotional states of the audience can be reflected to a certain extent according to the behavior information of the audience. For example, the viewer shouting "dead me! "to reflect the user's angry state to a certain extent; the audience shouting "too good cheer! ", which can reflect the distraction of the audience to a certain extent; when the audience strongly slaps the object, the current emotional state of the audience can be reflected to a certain extent to be very strong.
The keywords may include "happy", "good", "bad", "angry", "restlessness", "uncomfortable", etc. The volume value can be a decibel value of the voice of the audience, and can also be other measurement units.
The action strength refers to the strength value of an action object of the audience, and any existing measurement unit can be adopted.
The beneficial effects of the above technical scheme are: the corresponding interaction strategies are set for different emotion states of the audiences, after the emotion states of the audiences are determined, the interaction strategies corresponding to the emotion states of the audiences are executed, the execution of the interaction strategies can be adapted to the emotion states of the audiences, pertinence is achieved, and therefore the emotion requirements of the audiences are met.
In one embodiment, the light of the background wall is controlled by the following steps:
the service receives the live broadcast interaction request of the audience and transmits the live broadcast interaction request to the anchor client;
after receiving the live broadcast interaction request of the audience, the anchor client analyzes the live broadcast interaction request into a corresponding parameter setting instruction through a live broadcast interaction request analysis component, the parameter setting instruction is used for setting the lighting parameters of all lighting devices of a live broadcast room of the anchor client, wherein the lighting parameters of the background wall are used for adjusting the lighting of a background wall, and the illumination parameters of the background wall comprise the position and the height of each lighting device, whether each lighting device emits light, the light-emitting time and the light-emitting direction, and at least one of the emitted light intensity, the light color temperature, the display color data, the brightness data and the flicker frequency;
and converting the parameter setting instruction into an instruction which accords with a preset format of the lighting device, and sending the instruction which accords with the preset format of the lighting device to the corresponding lighting device, wherein the lighting device adjusts the lighting parameters of the lighting device according to the instruction of the preset format and the main color of the current environment.
The working principle of the technical scheme is as follows: the lighting device includes, but is not limited to, a fill light, a flash light, etc. When the vehicle is in a romantic scene, the light control parameter is determined to be orange and continuously lightened. And if the main color in the current space is green, the determined light control parameter is green and is continuously lightened. And when the vehicle is in a thriller scene at present, determining the corresponding light control parameters to be dark green and twinkling every 2s-5 s.
The beneficial effects of the above technical scheme are: the method for controlling the light of the background wall is provided, and the light parameters of all the light devices of the light of the background wall can be adjusted according to different scenes.
In one embodiment, the anchor client further includes a background wall control unit and a multimedia device connected to the background wall, where the background wall control unit is configured to control the multimedia device to play a video requested by the viewer through the background wall, or display a windy, a thunder, a ghost, an emoticon, an animation character, or show a real background object or a special lighting effect in response to the live broadcast interaction request of the viewer.
The working principle of the technical scheme is as follows: the background wall control unit controls the multimedia equipment to play videos requested by audiences through a background wall, or display wind, thunder, ghost, expression bags and cartoon characters, or display background real objects or special effects of light.
The background real object can comprise a ghost hand, a ghost head bag and the like, and the light special effect can comprise single-color light, colorful light and the like of various colors. The video on demand by the viewer may include various small glaring screens, classical bridges of movies and television shows, etc.
The beneficial effects of the above technical scheme are: by means of the background wall control unit, the multimedia equipment and the background wall control unit, the audience can visually see the video screen on demand or the purchased virtual gift and the like through the background wall.
In one embodiment, the entity prop unit includes an offensive prop and a defensive prop, the offensive prop is used for responding to the live broadcast interaction request of the audience and attacking the anchor of the anchor client, and the defensive attack is used for responding to the live broadcast interaction request of the audience and partially or completely counteracting the attack on the anchor of the anchor client.
The working principle of the technical scheme is as follows: the anchor is attacked by means of the offensive prop, and the protective attack is used for responding to a live broadcast interaction request of a viewer, partially or completely offsetting the attack on the anchor of an anchor client, and can bring positive stimulation and negative stimulation to the client. And both the offensive and defensive props may be made available to the audience at the audience client by purchasing a virtual gift.
The beneficial effects of the above technical scheme are: by means of the aggressive prop and the protective prop, the client can feel the stimulation on the front side and the stimulation on the back side, different psychological needs of audiences are met, the real situation is closer, and therefore the satisfaction degree of the client is improved.
In one embodiment, the server transmits the live interaction request of the audience to the anchor client and transmits the entity prop unit to the audience client in interaction with the entity of the anchor by the following steps:
firstly, a complete interactive data transmission flow is that the live interactive request is transmitted to the anchor client, and the entity prop unit and the entity of the anchor are interactively transmitted to the audience client, so as to obtain a set SA of the anchor client and the audience client through which the complete interactive data transmission flow passes,
Figure BDA0002230264790000151
wherein i is a number variable of the complete interactive data transmission process, an initial value is 1, the number is increased by 1, the maximum value is N1, illustratively, N1 is 100000000, SAiFor the set of clients of the ith complete flow,
Figure BDA0002230264790000152
for the ith complete flowiAn interactive data transmission client in s state, where the client is the audience client or the anchor client, s is a boolean value of a state of sending data or receiving interactive data by the client, s-true indicates that the client is a party sending interactive data, s-false indicates that the client is a party receiving interactive data, k isiThe total number of the clients passed by the complete interactive data transmission process;
then, the total egress bandwidth in the complete interactive data transmission flow is calculated by using the following calculation formula:
Figure BDA0002230264790000153
wherein j is the number variable of the clients through which the complete interactive data transmission process passes, and j belongs to {1,2,3i},Gi(SAi) Is the client terminal setTotal egress bandwidth of ci,jThe value range of the bandwidth used by the jth client in the complete interactive data transmission process is ci,j∈[ci,jmin,ci,jmax],ci,jminIs the bandwidth minimum value of the jth client side of the complete interactive data transmission process, ci,jmaxThe bandwidth of the jth client side of the complete interactive data transmission process is the maximum value;
secondly, calculating the total transmission time of the complete interactive data transmission flow by adopting the following calculation formula:
Figure BDA0002230264790000161
wherein, biThe total size of the interactive data transmitted for the ith complete interactive data transmission process, b is the size of the transmission data within 1 second, and ti,jThe value range of the time from the ith complete interactive data transmission process to the jth client is ti,j∈[ti,jmin,ti,jmax],ti,jminThe lower limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process, ti,jmaxThe upper limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process is Ti(SAi) The total transmission time of the complete interactive data transmission process;
secondly, the maximum value max (T) of the total transmission time is respectively obtainedi(SAi),hi,j) Min (T) minimum valuei(SAi),hi,j) And a maximum value max (G) of said total egress bandwidthi(SAi),hi,j) Minimum value min (G)i(SAi),hi,j) Wherein h isi,jA saturation constant of the jth client data transmission for the ith complete process is a preset value, and the adopted calculation formula is hi,j=ci,j/ci,jmaxThe value range is hi,j∈[0,1],hi,jIndicating that the client data transmission is saturated by 1And, 0 is not less than hi,j< 1 indicates that the client data transfer is not saturated;
finally, under the condition that the client data transmission is not saturated, solving a comprehensive evaluation calculation minimum function of the total transmission time and the total exit bandwidth, wherein the comprehensive evaluation calculation minimum function adopts the following formula:
Figure BDA0002230264790000162
phi is the function of the minimum value of the comprehensive evaluation calculation function, alpha and beta are preset weights, the value ranges are respectively in the range of alpha and beta from (0,1) to (0,1), beta + alpha is equal to 1, argmin is the minimum value, and the state of the minimum value of the comprehensive evaluation calculation function is the optimal interactive data transmission state of the system.
The beneficial effects of the above technical scheme are: according to the bandwidth bearing capacity of client data transmission in each transmission flow, the conditions of different clients can be clearly mastered so as to adopt different processing strategies; the total time of data transmission in each transmission flow is calculated according to the size of the transmission data, and the obtained total time is more accurate; the parallel optimization processing technology of the total bandwidth and the total transmission time in the interactive data transmission process is comprehensively utilized, the control of data transmission and transmission time of all the clients in the transmission process can be realized, the interactive data transmission between audiences and the anchor is ensured to be rapid and accurate, and the interactive effect between the audiences and the anchor is enhanced.
In one embodiment, after receiving the live interaction request of the viewer, the anchor client 103 determines the emotional state of the viewer according to the viewer behavior information by:
first, information of all the keywords is extracted, the information constitutes an information set, and the information set is SG ═ { SG ═1,sg2,...,sgk,...,sgnAnd k is the information sequence number variable, and the value range is k belonging to {1, 2.. multidot.n }, sgiInformation of the kth keyword;
then, the user can use the device to perform the operation,creating all the emotional state identifiers, wherein the set of emotional state identifiers is SQ ═ SQ1,sq2,...,sql,...,sqmAnd l is the sequence number variable of the emotional state identifier, and the value range is l belonging to {1,2lIdentifying for the ith said emotional state;
then, determining the emotional state identifier by adopting the following formula according to the keyword:
Figure BDA0002230264790000171
wherein, p (sg)k|sql) As the keyword information sgkBelongs to the emotional state mark sqlProbability of (1), argmax is the maximum value, uklTo add sgkAfter information, the emotional state identification sqlThe average value of (a) of (b),
Figure BDA0002230264790000172
to add sgkAfter information, the emotional state identification sqlThe variance of (a);
then, the emotional state intensity is calculated using the following formula:
Figure BDA0002230264790000173
wherein the content of the first and second substances,
Figure BDA0002230264790000174
for said audience aoThe intensity of the emotional state at time r +1,
Figure BDA0002230264790000175
for said audience aoThe intensity of the emotional state at time r,
Figure BDA0002230264790000176
for the said audienceao+sThe intensity of the emotional state at time r,
Figure BDA0002230264790000177
for said audience ao+sThe ability of the mood affecting device(s),
Figure BDA0002230264790000181
for said audience aoThe ability of the mood affecting device(s),
Figure BDA0002230264790000182
for said audience aoThe degree of infection of the mood of the patient,
Figure BDA0002230264790000183
for said audience ao+sAnd the audience aoH is the set of all said viewers,
Figure BDA0002230264790000184
for the said audienceao+sWeight of v1As a mood regulator, v2(ii) an emotional infection modifier for all of said viewers;
finally, determining the emotional state intensity
Figure BDA0002230264790000185
Corresponding preset condition SZ corresponding to the emotional state identifierlI.e. by
Figure BDA0002230264790000186
Thereby determining the viewer emotional state.
The beneficial effects of the above technical scheme are: the nearest emotional state identification is determined according to the keyword information of the audience, so that the information processing amount of the system can be greatly reduced, and the burden of the system can be reduced; the emotion intensity of the audience is calculated by integrating the influence capacity of other audiences and the infection degree of the audience in the live broadcast process, the obtained emotion state intensity of the audience is more scientific, and a reliable basis is provided for judging the preset condition of the emotion state identification corresponding to the follow-up emotion state intensity.
The invention also provides an offline live broadcast interaction method, as shown in fig. 2, the method comprises the following steps:
step 1: at a spectator client, acquiring a live broadcast interaction request of spectators;
step 2: transmitting the live interaction request of the audience to an anchor client;
and step 3: responding to the live broadcast interaction request of audiences at the anchor client, and enabling an entity prop unit to perform entity interaction with an anchor through a live broadcast chair, a live broadcast table or a background wall;
and 4, step 4: transmitting the entity prop element to the audience client in interaction with the entity of the anchor.
The working principle of the technical scheme is as follows: at a spectator client, acquiring a live broadcast interaction request of spectators; transmitting a live broadcast interaction request of a viewer to a main broadcast client; at the anchor client, responding to a live broadcast interaction request of audiences, and enabling an entity prop unit to perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall; the physical prop element is transmitted to the audience client in association with the anchor's physical interaction.
Hardware devices that the viewer client 101 and the anchor client 103 may run may be a computer, a smartphone, and a tablet, and software operating systems that may run may be an android system and an apple system.
The live broadcast chair, the live broadcast table, the background wall and the entity prop unit are connected in a wired communication mode or a wireless communication mode, wherein the wired communication mode comprises but is not limited to RS232, RS485, RS422, CAN, TCP/IP, ADSL or FSK, and the wireless communication mode comprises but is not limited to Bluetooth, wireless fidelity, zigbee, ultra-wideband, short-distance communication, infrared communication, wireless gigabit, wireless USB, wireless high definition, wireless home digital interface or radio frequency identification.
Furthermore, the live broadcast table can comprise a plurality of brackets embedded in the surface of the live broadcast table or folded at the bottom of the table top and on the table legs, and the brackets are used for placing the entity prop units.
The beneficial effects of the above technical scheme are: by means of the entity prop unit, audiences can perform entity interaction with the anchor through a live broadcast chair, a live broadcast table or a background wall, the anchor can quickly and accurately respond to the live broadcast interaction requests of the audiences, and the audiences can also see the response of the anchor truly, so that the interaction effect between the audiences and the anchor can be enhanced.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (9)

1. An offline live interactive system, comprising:
the audience client is used for acquiring a live broadcast interaction request of an audience;
the anchor client side comprises a live broadcast chair, a live broadcast table, a background wall positioned behind the live broadcast table and the live broadcast chair, and an entity prop unit in communication connection with the live broadcast chair, the live broadcast table and the background wall, and the anchor client side is used for responding to the live broadcast interaction request of audiences and enabling the entity prop unit to perform entity interaction with an anchor through the live broadcast chair, the live broadcast table or the background wall; the server is connected with the audience client and the anchor client and is used for transmitting the live broadcast interaction request of the audience to the anchor client and transmitting the entity prop unit and the entity interaction of the anchor to the audience client;
the server transmits the live broadcast interaction request of the audience to the anchor client by adopting the following steps, and transmits the entity prop unit and the entity interaction of the anchor to the audience client:
firstly, a complete interactive data transmission process is that the live broadcast interactive request is transmitted to the anchor client, and the entity prop unit and the entity of the anchor are interactively transmitted to the audience clientInputting; the set of the anchor client and the audience client through which the interactive data transmission process passes is SA, and the SA is set
Figure FDA0003213423260000011
Wherein i is the number variable of the complete interactive data transmission process, the initial value is 1, the number is increased by taking 1 as a unit, and the maximum value is a preset value N1,SAiFor the i-th complete interactive data transmission flow client set,
Figure FDA0003213423260000012
for the ith complete flowiAn interactive data transmission client in s state, where the client is the audience client or the anchor client, s is a boolean value of a state of sending data or receiving interactive data by the client, s-true indicates that the client is a party sending interactive data, s-false indicates that the client is a party receiving interactive data, k isiThe total number of the clients passed by the complete interactive data transmission process;
then, the total exit bandwidth of the ith complete interactive data transmission flow is calculated by adopting the following calculation formula:
Figure FDA0003213423260000013
wherein j is the number variable of the clients through which the complete interactive data transmission process passes, and j belongs to {1,2,3i},Gi(SAi) Total egress bandwidth for the set of clients, ci,jThe value range of the bandwidth used by the jth client in the complete interactive data transmission process is ci,j∈[ci,jmin,ci,jmax],ci,jminIs the bandwidth minimum value of the jth client side of the complete interactive data transmission process, ci,jmaxThe bandwidth of the jth client side of the complete interactive data transmission process is the maximum value;
secondly, calculating the total transmission time of the ith complete interactive data transmission process by adopting the following calculation formula:
Figure FDA0003213423260000021
wherein, biThe total size of the interactive data transmitted for the ith complete interactive data transmission process, b is the size of the transmission data within 1 second, and ti,jThe value range of the time from the ith complete interactive data transmission process to the jth client is ti,j∈[ti,jmin,ti,jmax],ti,jminThe lower limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process, ti,jmaxThe upper limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process is Ti(SAi) The total transmission time of the complete interactive data transmission process;
secondly, in hi,jRespectively solving the maximum value and the minimum value of the total transmission time under the state: maximum value max (T) of total transmission timei(SAi))=max{T1(SA1),T2(SA2),…,Ti(SAi) The minimum value min (T) of the total transmission timei(SAi))=min{T1(SA1),T2(SA2),…,Ti(SAi) }; at hi,jRespectively solving the maximum value and the minimum value of the total exit bandwidth under the state: maximum value max (G) of total egress bandwidthi(SAi))=max{G1(SA1),G2(SA2),...,Gi(SAi) The minimum value min (G) of the total exit bandwidthi(SAi))=min{G1(SA1),G2(SA2),..,Gi(SAi)};
Wherein h isi,jA saturation constant of the jth client data transmission for the ith complete process is a preset value, and the adopted calculation formula is hi,j=ci,j/ci,jmaxThe value range is hi,j∈[0,1],hi,j1 denotes that the client data transmission is saturated, 0 ≦ hi,j< 1 indicates that the client data transfer is not saturated;
finally, under the condition that the client data transmission is not saturated, solving a comprehensive evaluation calculation minimum function of the total transmission time and the total exit bandwidth, wherein the comprehensive evaluation calculation minimum function adopts the following formula:
Figure FDA0003213423260000031
phi is the minimum function of the comprehensive evaluation calculation, alpha and beta are preset weights, the value ranges are respectively in the range of alpha and beta from (0,1) to (0,1), beta + alpha is equal to 1, argmin is the minimum value, and the state of the minimum function of the comprehensive evaluation calculation is the optimal interactive data transmission state of the system.
2. The offline live interaction system of claim 1, wherein said physical prop unit comprises a number of physical props having physical entities and capable of physical entity changes of at least one of sound, light, electricity, magnetism, heat, gas, liquid and machinery.
3. The offline live interaction system of claim 1, wherein said physical property units comprise one or more of a color bubble generating device, a light color changing device, an inflatable hammer, a spraying device, a lightning simulation device, a massaging device, an electrostatic generator, a cold smoke generating device, a sound effect device, a scent effect device, and a drink device.
4. The offline live interactive system of claim 1, wherein said server is further configured to detect a virtual gift-rendering instruction triggered by a viewer at said viewer client,
the anchor client further comprises a virtual gift display module, and the virtual gift display module is used for determining a sound special effect, a visual special effect, a smell special effect or a touch special effect corresponding to the virtual gift to be presented when the server detects a virtual gift presenting instruction triggered by the audience at the audience client, and outputting the sound special effect, the visual special effect, the smell special effect or the touch special effect corresponding to the virtual gift to be presented through the entity prop unit so as to display the virtual gift.
5. The offline live interactive system of claim 4, wherein said viewer client obtaining a viewer's live interactive request performs the steps of:
receiving live broadcast interactive data sent by the server, loading a corresponding live broadcast interactive area in a live broadcast page of a specified live broadcast room according to the live broadcast interactive data, and executing input and/or selection operation in the live broadcast interactive area by the audience;
performing semantic recognition on each input and/or selection operation in a plurality of live broadcast interactive data of the audience client, and acquiring target live broadcast interactive data with semantics conforming to preset semantics from the plurality of live broadcast interactive data according to a semantic recognition result;
acquiring virtual gift information belonging to the virtual gift giving instruction set from the target live broadcast interactive data, and determining the occurrence frequency of the acquired virtual gift information in the live broadcast interactive data;
and when the occurrence frequency is greater than or equal to a frequency threshold value corresponding to the acquired virtual gift information, determining the virtual gift information corresponding to the live broadcast interaction data as the live broadcast interaction request.
6. The offline live interactive system according to claim 1, wherein the physical prop unit performs the following steps through physical interaction with a host through the live chair, the live table or the background wall:
the server receives the live broadcast interaction request of the audience and transmits the live broadcast interaction request to the anchor client to obtain audience behavior information of the audience, wherein the audience behavior information comprises audience voice information and audience action information, the audience voice information comprises keywords and volume values, and the audience action information comprises action force;
after receiving the live broadcast interaction request of the audience, the anchor client determines the emotion state of the audience according to the audience behavior information, and the method comprises the following steps: determining an emotional state identifier according to the keyword, wherein the emotional state identifier corresponds to an emotional state; determining emotional state intensity according to at least one of the volume value and the action strength, converting the volume value into a first weight value, determining the first weight value as emotional state intensity, or converting the action strength into a second weight value, determining the second weight value as emotional state intensity, or converting the volume value into the first weight value, converting the action strength into the second weight value, and determining the sum of the first weight value and the second weight value as emotional state intensity; when the emotional state strength meets a preset condition, determining the emotional state corresponding to the emotional state identifier as the emotional state of the audience;
and selecting at least one of the live broadcast chair, the live broadcast table or the background wall as an action carrier of the entity prop unit according to the emotion state of the audience, converting a parameter setting instruction of the entity prop unit into an instruction in a preset format conforming to the emotion state of the audience, and sending the instruction in the preset format conforming to the emotion state of the audience to a corresponding action object, so that the entity prop unit and a main broadcast perform an interaction strategy corresponding to the emotion state of the audience through the action carrier.
7. The system of claim 1, wherein the anchor client further comprises a background wall control unit and a multimedia device connected to the background wall, the background wall control unit is configured to control the multimedia device to play a video requested by the viewer through the background wall, or to display a wind, a thunder, a ghost, an emoticon, an animation character, or to display a background object or a light special effect in response to the live broadcast interaction request of the viewer.
8. The offline live interactive system of claim 6, wherein said anchor client, upon receiving said live interactive request from said viewer, determines a viewer emotional state based on said viewer behavior information by:
first, information of all the keywords is extracted, the information constitutes an information set, and the information set is SG ═ { SG ═1,sg2,...,sgk,...,sgnK is an information sequence number variable, and the value range is k belonging to {1,2kInformation of the kth keyword;
then, all the emotional state identifications are created, and the set of emotional state identifications is SQ ═ { SQ ═ SQ1,sq2,...,sql,...,sqmAnd l is the sequence number variable of the emotional state identifier, and the value range is l belonging to {1,2lIdentifying for the ith said emotional state;
then, determining the emotional state identifier by adopting the following formula according to the keyword:
Figure FDA0003213423260000051
wherein, p (sg)k|sql) Information sg for the keywordkBelongs to the emotional state mark sqlProbability of (d), argmax is the maximum value, uklTo add sgkAfter information, the emotional state identification sqlThe average value of (a) of (b),
Figure FDA0003213423260000057
to add sgkAfter information, the emotional state identification sqlThe variance of (a);
then, the emotional state intensity is calculated using the following formula:
Figure FDA0003213423260000052
wherein the content of the first and second substances,
Figure FDA0003213423260000053
for a spectator aoThe intensity of the emotional state at time r +1,
Figure FDA0003213423260000054
for said audience aoThe intensity of the emotional state at time r,
Figure FDA0003213423260000055
for a spectator ao+sThe intensity of the emotional state at time r,
Figure FDA0003213423260000056
for said audience ao+sThe ability of the mood affecting device(s),
Figure FDA0003213423260000061
for said audience aoThe ability of the mood affecting device(s),
Figure FDA0003213423260000062
for said audience aoThe degree of infection of the mood of the patient,
Figure FDA0003213423260000063
for said audience ao+sAnd the audience aoH is the set of all said viewers,
Figure FDA0003213423260000064
for said audience ao+sWeight of v1As a mood regulator, v2(ii) an emotional infection modifier for all of said viewers;
finally, determining the emotional state intensity
Figure FDA0003213423260000065
Corresponding preset condition SZ corresponding to the emotional state identifierlI.e. by
Figure FDA0003213423260000066
Thereby determining the viewer emotional state.
9. An offline live broadcast interaction method is characterized by comprising the following steps:
step 1: at a spectator client, acquiring a live broadcast interaction request of spectators;
step 2: the server transmits the live broadcast interaction request of the audience to an anchor client;
and step 3: responding to the live broadcast interaction request of audiences at the anchor client, and enabling an entity prop unit to perform entity interaction with an anchor through a live broadcast chair, a live broadcast table or a background wall;
and 4, step 4: the server transmits the entity prop unit and the entity interaction of the anchor to the audience client;
the server transmits the live broadcast interaction request of the audience to the anchor client by adopting the following steps, and transmits the entity prop unit and the entity interaction of the anchor to the audience client:
firstly, a complete interactive data transmission flow is that the live broadcast interactive request is transmitted to the anchor client, and the entity prop unit and the entity interaction of the anchor are transmitted to the audience client; the set of the anchor client and the audience client through which the interactive data transmission process passes is SA, and the SA is set
Figure FDA0003213423260000067
Wherein i is the number variable of the complete interactive data transmission process, the initial value is 1, the number is increased by taking 1 as a unit, and the maximum value is a preset value N1,SAiFor the i-th complete interactive data transmission flow client set,
Figure FDA0003213423260000068
for the ith complete flowiAn interactive data transmission client in s state, where the client is the audience client or the anchor client, s is a boolean value of a state of sending data or receiving interactive data by the client, s-true indicates that the client is a party sending interactive data, s-false indicates that the client is a party receiving interactive data, k isiThe total number of the clients passed by the complete interactive data transmission process;
then, the total exit bandwidth of the ith complete interactive data transmission flow is calculated by adopting the following calculation formula:
Figure FDA0003213423260000071
wherein j is the number variable of the clients through which the complete interactive data transmission process passes, and j belongs to {1,2,3i},Gi(SAi) Total egress bandwidth for the set of clients, ci,jThe value range of the bandwidth used by the jth client in the complete interactive data transmission process is ci,j∈[ci,jmin,ci,jmax],ci,jminIs the bandwidth minimum value of the jth client side of the complete interactive data transmission process, ci,jmaxThe bandwidth of the jth client side of the complete interactive data transmission process is the maximum value;
secondly, calculating the total transmission time of the ith complete interactive data transmission process by adopting the following calculation formula:
Figure FDA0003213423260000072
wherein, biThe total size of the interactive data transmitted for the ith complete interactive data transmission process, b is the size of the transmission data within 1 second, and ti,jThe value range of the time from the ith complete interactive data transmission process to the jth client is ti,j∈[ti,jmin,ti,jmax],ti,jminThe lower limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process, ti,jmaxThe upper limit of the time for transmitting the data for the cache of the jth client in the complete interactive data transmission process is Ti(SAi) The total transmission time of the complete interactive data transmission process;
secondly, in hi,jRespectively solving the maximum value and the minimum value of the total transmission time under the state: maximum value max (T) of total transmission timei(SAi))=max{T1(SA1),T2(SA2),…,Ti(SAi) The minimum value min (T) of the total transmission timei(SAi))=min{T1(SA1),T2(SA2),…,Ti(SAi) }; at hi,jRespectively solving the maximum value and the minimum value of the total exit bandwidth under the state: maximum value max (G) of total egress bandwidthi(SAi))=max{G1(SA1),G2(SA2),...,Gi(SAi) The minimum value min (G) of the total exit bandwidthi(SAi))=min{G1(SA1),G2(SA2),..,Gi(SAi)};
Wherein h isi,jA saturation constant of the jth client data transmission for the ith complete process is a preset value, and the adopted calculation formula is hi,j=ci,j/ci,jmaxThe value range is hi,j∈[0,1],hi,j1 denotes that the client data transmission is saturated, 0 ≦ hi,j< 1 indicates that the client data transfer is not saturated;
finally, under the condition that the client data transmission is not saturated, solving a comprehensive evaluation calculation minimum function of the total transmission time and the total exit bandwidth, wherein the comprehensive evaluation calculation minimum function adopts the following formula:
Figure FDA0003213423260000081
phi is the minimum function of the comprehensive evaluation calculation, alpha and beta are preset weights, the value ranges are respectively in the range of alpha and beta from (0,1) to (0,1), beta + alpha is equal to 1, argmin is the minimum value, and the state of the minimum function of the comprehensive evaluation calculation is the optimal interactive data transmission state of the system.
CN201910967149.XA 2019-10-11 2019-10-11 Offline live broadcast interaction system and method Active CN110708610B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910967149.XA CN110708610B (en) 2019-10-11 2019-10-11 Offline live broadcast interaction system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910967149.XA CN110708610B (en) 2019-10-11 2019-10-11 Offline live broadcast interaction system and method

Publications (2)

Publication Number Publication Date
CN110708610A CN110708610A (en) 2020-01-17
CN110708610B true CN110708610B (en) 2021-09-28

Family

ID=69199556

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910967149.XA Active CN110708610B (en) 2019-10-11 2019-10-11 Offline live broadcast interaction system and method

Country Status (1)

Country Link
CN (1) CN110708610B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111741574A (en) * 2020-06-11 2020-10-02 湖北美和易思教育科技有限公司 Thing networking classroom smart lamp system
CN111710200A (en) * 2020-07-31 2020-09-25 青海卓旺智慧信息科技有限公司 Efficient live broadcast education control management device and system
CN114189743B (en) * 2021-12-15 2023-12-12 广州博冠信息科技有限公司 Data transmission method, device, electronic equipment and storage medium

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020103772A1 (en) * 2001-01-31 2002-08-01 Bijoy Chattopadhyay System and method for gathering of real-time current flow information
CN104581219B (en) * 2014-12-22 2018-01-23 浙江工业大学 A kind of control method of Streaming Media forwarding server
US9497498B2 (en) * 2015-01-23 2016-11-15 Robert Hain System and method for live streaming of content
CN107133368B (en) * 2017-06-09 2020-11-03 上海思依暄机器人科技股份有限公司 Human-computer interaction method and system and robot
CN107509117A (en) * 2017-06-21 2017-12-22 白冰 A kind of living broadcast interactive method and living broadcast interactive system
CN107682320A (en) * 2017-06-21 2018-02-09 白冰 A kind of physical interaction cast communication device
CN107454435A (en) * 2017-06-21 2017-12-08 白冰 A kind of live broadcasting method and live broadcast system based on physical interaction
CN107734360B (en) * 2017-09-15 2020-04-21 深圳英飞拓科技股份有限公司 Control method and device of streaming media server
CN109495763B (en) * 2018-11-16 2020-12-01 北京达佳互联信息技术有限公司 Virtual article record determining method, device, server and storage medium

Also Published As

Publication number Publication date
CN110708610A (en) 2020-01-17

Similar Documents

Publication Publication Date Title
CN110708610B (en) Offline live broadcast interaction system and method
US10466790B2 (en) System and method for processing an audio and video input in a point of view program for haptic delivery
US11475646B1 (en) Computer implemented display system responsive to a detected mood of a person
US11294468B2 (en) System and method for modulating a sex peripheral device based on an unscripted feed using computer vision
US9137878B2 (en) Dynamic lighting based on activity type
CN105872748A (en) Lamplight adjusting method and device based on video parameter
US11748950B2 (en) Display method and virtual reality device
WO2015163030A1 (en) Information processing device, information processing method and program
CN103970892B (en) Various dimensions viewing system control method based on intelligent home device
WO2017002435A1 (en) Information processing device, information processing method, and program
CN108648061A (en) image generating method and device
CN208013970U (en) A kind of living creature characteristic recognition system
US10706820B2 (en) Methods and apparatus for producing a multimedia display that includes olfactory stimuli
CN109714647B (en) Information processing method and device
CN107657893B (en) Scene experience window and system
US20200059631A1 (en) Control apparatus, control method, program, and projection system
CN111881857B (en) Electronic candle control method based on face detection
US20220413614A1 (en) System and Method for a Surface-Optimized Tactile Transducer
CN203874469U (en) Control system for cinema special effects
CN111225233A (en) Multi-dimensional environment rendering system and rendering method
US11452187B2 (en) System and method for an end-user scripted (EUS) customized effect from a rendered web-page
WO2021131326A1 (en) Information processing device, information processing method, and computer program
CN210924530U (en) Interactive multimedia display system
US20230386159A1 (en) System and Method for Video-Captured Initialization of Peripheral Devices
CN106094941B (en) A kind of method and system changing indoor scene

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant