WO2023000662A1 - 媒体内容的投放方法及设备 - Google Patents
媒体内容的投放方法及设备 Download PDFInfo
- Publication number
- WO2023000662A1 WO2023000662A1 PCT/CN2022/076629 CN2022076629W WO2023000662A1 WO 2023000662 A1 WO2023000662 A1 WO 2023000662A1 CN 2022076629 W CN2022076629 W CN 2022076629W WO 2023000662 A1 WO2023000662 A1 WO 2023000662A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- media
- call service
- user equipment
- computer interaction
- indication information
- Prior art date
Links
- 238000002716 delivery method Methods 0.000 title abstract description 6
- 230000003993 interaction Effects 0.000 claims abstract description 565
- 238000000034 method Methods 0.000 claims abstract description 223
- 238000004891 communication Methods 0.000 claims abstract description 54
- 230000006870 function Effects 0.000 claims description 155
- 238000012545 processing Methods 0.000 claims description 103
- 230000004044 response Effects 0.000 claims description 86
- 230000000977 initiatory effect Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 description 39
- 238000012790 confirmation Methods 0.000 description 33
- 230000000694 effects Effects 0.000 description 32
- 238000007726 management method Methods 0.000 description 27
- 238000010586 diagram Methods 0.000 description 22
- 238000004590 computer program Methods 0.000 description 14
- 238000005516 engineering process Methods 0.000 description 7
- 238000003780 insertion Methods 0.000 description 7
- 230000037431 insertion Effects 0.000 description 7
- 238000011330 nucleic acid test Methods 0.000 description 7
- 230000002452 interceptive effect Effects 0.000 description 6
- 230000008878 coupling Effects 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 5
- 238000005859 coupling reaction Methods 0.000 description 5
- 230000007115 recruitment Effects 0.000 description 5
- 230000011664 signaling Effects 0.000 description 4
- 208000034953 Twin anemia-polycythemia sequence Diseases 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 230000007774 longterm Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/1016—IP multimedia subsystem [IMS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
- H04L65/1089—In-session procedures by adding media; by removing media
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1104—Session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/756—Media network packet handling adapting media to device capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/09—Mapping addresses
- H04L61/25—Mapping addresses of the same type
- H04L61/2503—Translation of Internet protocol [IP] addresses
- H04L61/256—NAT traversal
- H04L61/2575—NAT traversal using address mapping retrieval, e.g. simple traversal of user datagram protocol through session traversal utilities for NAT [STUN]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Definitions
- the present application relates to the communication field, in particular to a method and device for delivering media content.
- VOLTE voice over long term evolution
- 4G fourth generation
- 5th generation 5th generation
- IMS Internet protocol multimedia subsystem
- media content can be delivered to UE when the user uses VOLTE technology to make a call.
- VOLTE technology to make a call.
- it is blind to determine the media content to be delivered only according to the tag information of the user, which will affect the user experience and the delivery effect of the media content.
- This application provides a method and device for delivering media content, which can determine whether to deliver media content to the UE during the course of the call service according to the human-computer interaction environment of the user corresponding to the UE during the course of the call service, or determine what to deliver to the UE during the course of the call service Media content improves the user experience and the delivery effect of media content.
- the embodiment of the present application provides a method for delivering media content.
- the method can be applied to a media delivering server.
- the method includes: receiving call service human-computer interaction environment indication information sent by UE, the call service human-computer interaction environment
- the indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service; the media content to be delivered is determined according to the call service human-computer interaction environment indication information, and the media content to be delivered is delivered to the UE during the call service.
- the media delivery server may receive the call service human-computer interaction environment indication information sent by the UE, and determine the media content to be delivered according to the indication information.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information may reflect the current state of the user, for example, whether the user is looking at the UE screen, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media content to be delivered determined according to the call service human-computer interaction environment indication information is more in line with the user's needs, and the media delivery server can deliver the media content that meets the user's needs to the user, which can improve user experience and media content delivery effect.
- the embodiment of the present application provides a method for delivering media content, which can be applied to a media delivering server, and the method includes: receiving call service human-computer interaction environment indication information sent by the UE, and the call service human-computer interaction
- the interactive environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service; according to the call service human-computer interaction environment indication information, it is determined not to deliver media content to the UE during the call service.
- the media delivery server may determine not to deliver media content to the UE during the call service according to the indication information of the call service human-computer interaction environment.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information may reflect the current state of the user, for example, whether the user is looking at the UE screen, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media delivery server may not deliver media content to the UE when it is not suitable to deliver media content to the UE, which improves user experience, reduces or avoids data traffic consumption of the UE, and saves air interface resources.
- the human-computer interaction environment includes any one or any combination of the following: whether the UE's screen is on, whether the interface of the UE's calling program is visible, whether the UE's hands-free function is turned on, and whether the UE's wired headset is plugged in , whether the wireless headset of the UE is connected, or whether the user is within the visible range of the UE.
- the UE’s screen is on, whether the interface of the UE’s call program is visible, whether the UE’s hands-free function is turned on, whether the UE’s wired headset is plugged in, whether the UE’s wireless headset is connected, or whether the user is in the UE’s
- Determine the current state of the user within the visible range for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, etc., and then determine the media content to be delivered, or determine not to deliver it to the UE during the call service media content.
- determining the media content to be delivered according to the call service human-computer interaction environment indication information includes: determining a media form according to the call service human-computer interaction environment indication information, the media form includes audio form, silent video form, In the video format with sound or the low-pitched video format, the default volume of the media content in the low-pitched video format is greater than 0 and less than a preset threshold; determine that the media content conforming to the media format is the media content to be delivered. Based on the above method, the media content to be delivered can be determined according to the media form, so as to improve the delivery effect of the media content.
- determining the media format according to the call service human-computer interaction environment indication information includes: determining that the media format is an audio format if any of the following is true: the call service human-computer interaction environment indication information indicates that the UE's The screen is off, or the call service human-computer interaction environment indication information indicates that the UE’s screen is on and the interface of the UE’s call program is invisible, or the call service human-computer interaction environment indication information indicates that the UE’s screen is on and the UE’s wired The headset is plugged in and the user is not within the visible range of the UE, or the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless headset of the UE is connected, and the user is not within the visible range of the UE.
- the media format is an audio format when the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE.
- the media delivery server will not deliver media content in the form of video to the UE, which can reduce or avoid consumption of data traffic of the UE and save air interface resources while improving user experience.
- determining the media format according to the indication information of the human-computer interaction environment of the call service includes: if any of the following is true, determining that the media form is in the form of audio and video: the indication information of the human-computer interaction environment of the call service indicates that the UE's The screen lights up, the UE's calling program interface is visible, and the UE's wired headset is plugged in; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's calling program interface is visible, and the UE's wireless headset is connected ; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, the UE's wireless headset is connected, and the user is within the visible range of the UE; or, the call service human-computer interaction The environment indication information indicates that the screen of the UE is on, the calling program interface of the UE is visible, the wired earphone of the UE is plugged
- determining the media format according to the call service human-computer interaction environment indication information includes: if the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's free If the mention function is enabled, it is determined that the media format is a silent video format. Based on the above method, if the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, but the human-computer interaction environment of the call service is not suitable for the UE to play external voice, the media distribution server can determine that the media format is a silent video format.
- determining the media format according to the indication information of the call service human-computer interaction environment includes: if any of the following is true, determining that the media format is a bass video format: the call service human-computer interaction environment indication information indicates that the UE's wired Headphone insertion; or, the call service human-computer interaction environment indication information indicates the wireless headset connection of the UE; or, the call service human-computer interaction environment indication information indicates that the UE's screen is lit, the UE's call program interface is visible, and the UE's hands-free function Off, the UE's wired headset is not plugged in, the UE's wireless headset is not connected, and the user is within the visible range of the UE.
- the media distribution server can determine the media format as the low-frequency video format.
- determining the media content to be delivered according to the indication information of the call service human-computer interaction environment includes: if any of the following is true, then determining that the media content to be delivered is the media content that transmits media information through voice: the call service person The computer interaction environment indication information indicates that the UE's screen is off; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the UE's call program interface is invisible; or, the call service human-computer interaction environment indication information indicates that the UE The screen of the UE is on, the wired earphone of the UE is plugged in, and the user is not within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not in the UE’s within sight. Based on the above method, if the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE,
- determining the media content to be delivered according to the indication information of the human-computer interaction environment of the call service includes: if any of the following is true, determining that the media content to be delivered is the media content that transmits information through images: the call service human-machine
- the interactive environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's hands-free function is turned off; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the UE's call program interface Visible, and the hands-free function of the UE is turned on.
- the media delivery server can determine that the media content to be delivered is the media content that transmits media information through images.
- determining the media content to be delivered according to the indication information of the call service human-computer interaction environment includes: determining the group type of the user according to the indication information of the call service human-computer interaction environment; and determining the media content to be delivered according to the group type. Based on the above method, the media content suitable for the group to which the user belongs is delivered to the UE, so as to improve user experience and delivery effect of the media content.
- determining not to deliver media content to the UE during the call service according to the indication information of the call service human-computer interaction environment includes: if any of the following is true, determining not to deliver the media content to the UE during the call service Media content: the call service human-computer interaction environment indication information indicates that the UE's screen is off; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the interface of the UE's call program is invisible; or, the call service man-machine The interactive environment indication information indicates that the UE's screen is on, the UE's wired headset is plugged in, and the user is not within the UE's visual range; or, the call service man-machine interaction environment indication information indicates that the UE's screen is on, the UE's wireless headset is connected, And the user is not within the visible range of the UE. Based on the above method, the media content may not be delivered to the UE when the human-computer interaction environment of the call service is not suitable for
- receiving the call service human-computer interaction environment indication information sent by the UE includes: receiving a SIP-info message sent by the UE, where the SIP-info message includes the call service human-computer interaction environment indication information. Based on the above method, the UE can send the call service human-computer interaction environment indication information to the media delivery server through the SIP-info message.
- receiving the call service human-computer interaction environment indication information sent by the UE includes: receiving a SIP-Notification message sent by the UE, the SIP-Notification message including the call service human-computer interaction environment indication information; Before the call service human-computer interaction environment indication information, the method further includes: sending a subscription message to the UE, where the subscription message is used to subscribe to the call service human-computer interaction environment indication information.
- the media delivery server can subscribe to the call service human-computer interaction environment indication information through a subscription message, and the UE can send the call service human-computer interaction environment indication information to the media delivery server through a SIP-Notification message.
- receiving the call service human-computer interaction environment indication information sent by the UE includes: receiving a media content request request message sent by the UE, where the media content request message includes the call service human-computer interaction environment indication information. Based on the above method, the UE may send the call service human-computer interaction environment indication information to the media delivery server through a request message requesting media content.
- delivering the media content to be delivered to the UE during the ongoing call service includes: sending a response message of the request message to the UE during the ongoing call service, where the response message includes the media content to be delivered.
- the media delivery server can deliver the media content to be delivered to the UE through the response message of the request message.
- the method further includes: sending a response message of the request message to the UE, and the response message includes the first The indication information, the first indication information is used to indicate that the media content is not delivered to the UE during the call service.
- the first indication information may indicate that the media content is not to be delivered to the UE, so that the UE determines that it does not need to receive the media content to be delivered.
- the method further includes: establishing a media channel according to the media content to be delivered, and the type of the media channel includes an audio media channel or a video media channel,
- the audio media channel is used to transmit media content in the form of audio
- the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service
- the video media channel is used to transmit media content in the form of video
- Delivering the media content to be delivered to the UE during the ongoing call service includes: delivering the media content to be delivered to the UE through a media channel during the ongoing call service.
- the media delivery server can deliver the media content to be delivered to the UE through the media channel.
- the method before determining the media content to be delivered according to the call service human-computer interaction environment indication information, the method further includes: establishing a media channel according to the call service, and the type of the media channel includes an audio media channel or a video media channel, an audio media channel
- the media channel is used to transmit media content in the form of audio
- the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service
- the video media channel is used to transmit media content in the form of video.
- the media delivery server can establish a media channel for calling services between UEs before determining the content to be delivered.
- the method further includes: switching the media channel if the media channel cannot transmit the media content to be delivered; Delivering the media content to be delivered by the UE includes: delivering the media content to be delivered to the UE through the switched media channel during the calling service. Based on the above method, if the established media channel is not suitable, it can be switched to a suitable media channel, and then the media content to be delivered can be delivered through the switched media channel.
- delivering the media content to be delivered to the UE during the call service includes: delivering the media content to the UE through the media channel during the call service . Based on the above method, if the established media channel is suitable, the media content to be delivered can be delivered through the established media channel.
- the method further includes: establishing a media channel according to the call service, and the type of the media channel includes audio media channel or video media channel, the audio media channel is used to transmit media content in the form of audio, and/or, the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel is used to transmit Media content in the form of video.
- the media delivery server can establish a media channel for calling services between UEs.
- the embodiment of the present application provides a method for delivering media content, which can be applied to the UE, and the method includes: acquiring call service human-computer interaction environment indication information, and the call service human-computer interaction environment indication information indicates that in the call service The human-computer interaction environment of the user corresponding to the UE during the process; sending the call service human-computer interaction environment indication information to the media delivery server; receiving the media content to be delivered sent by the media delivery server, and presenting the to-be-delivered media through the program unit related to the calling program content.
- the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine the media content to be delivered according to the indication information.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information may reflect the current state of the user, for example, whether the user is looking at the UE screen, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media content to be delivered determined according to the call service human-computer interaction environment indication information is more in line with user needs, and the UE can improve user experience and media content delivery effect by presenting media content that meets user needs.
- the embodiment of the present application provides a method for delivering media content, which can be applied to UEs, and the method includes: acquiring call service human-computer interaction environment indication information, and the call service human-computer interaction environment indication information indicates that the call service human-computer interaction environment indication information is The human-computer interaction environment of the user corresponding to the UE during the call service; sending the indication information of the call service human-computer interaction environment to the media delivery server; determining not to present the media content.
- the UE can send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine not to deliver media content to the UE during the call service according to the indication information.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information can reflect the current state of the user, for example, whether the user is watching the UE's screen, whether the user is suitable for watching media content or listening to media content, etc. Therefore, the media delivery server may not deliver media content to the UE when it is not suitable to deliver media content to the UE, which improves user experience, reduces or avoids data traffic consumption of the UE, and saves air interface resources.
- the acquisition of call service human-computer interaction environment indication information includes at least one of the following: detecting whether the screen of the UE is on; or detecting whether the interface of the calling program of the UE is visible; or detecting whether the UE's free Or, detect whether the wired earphone of the UE is plugged in; or, detect whether the wireless earphone of the UE is connected; or, detect whether the user is within the visible range of the UE.
- the UE can detect any of the following: whether the screen of the UE is on, whether the interface of the calling program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired headset of the UE is plugged in, or whether the wireless headset of the UE is connected , or whether the user is within the visible range of the UE, and then obtain the call service human-computer interaction environment indication information.
- sending the call service human-computer interaction environment indication information to the media delivery server includes: sending a SIP-info message to the media delivery server, where the SIP-info message includes the call service human-computer interaction environment indication information.
- the UE can send the call service human-computer interaction environment indication information to the media delivery server through the SIP-info message.
- sending the call service human-computer interaction environment indication information to the media delivery server includes: sending a SIP-Notification message to the media delivery server, the SIP-Notification message includes the call service human-computer interaction environment indication information; Before the server sends the call service human-computer interaction environment indication information, the method further includes: receiving a subscription message from the media delivery server, where the subscription message is used to subscribe to the call service human-computer interaction environment indication information. Based on the above method, the UE may send the calling service human-computer interaction environment indication information to the media delivery server through the SIP-Notification message based on the subscription message of the media delivery server.
- sending the call service human-computer interaction environment indication information to the media delivery server includes: sending a request message requesting media content to the media delivery server, the request message including the call service human-computer interaction environment Instructions.
- the UE may send the call service human-computer interaction environment indication information to the media delivery server through a request message requesting media content.
- receiving the media content to be delivered sent by the media delivery server includes: receiving a response message to the request message sent by the media delivery server, where the response message includes the media content to be delivered. Based on the above method, the UE may receive the media content to be delivered through the response message of the request message.
- determining not to present the media content includes: receiving first indication information sent by the media delivery server, the first indication information is used to indicate that the media content is not to be delivered to the UE during the call service; according to the first indication information Determine not to present the media content; or, determine not to present the media content if no indication information about presenting the media content is received from the media delivery server within the preset time range. Based on the above method, the UE may determine not to present media content in various ways.
- receiving the first indication information sent by the media delivery server includes: receiving a response to the request message sent by the media delivery server message, and the response message includes the first indication information. Based on the above method, the UE may receive the first indication information through the response message of the request message.
- the embodiment of the present application provides a method for delivering media content, which can be applied to the UE.
- the method includes: determining the human-computer interaction environment of the call service.
- the human-computer interaction environment of the call service is the UE corresponding The human-computer interaction environment of the user; determine the media form according to the human-computer interaction environment of the call service; send the indication information of the media form to the media delivery server; receive the media content that conforms to the media form sent by the media delivery server, and pass the call program related program
- the unit presents the media content.
- the UE can determine the media format according to the human-computer interaction environment of the call service, and indicate the media format to the media delivery server, so that the media delivery server can deliver media content conforming to the media format to the UE.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media format determined according to the human-computer interaction environment of the call service is more in line with the needs of the user, and can improve user experience and delivery effect of media content.
- the UE may not send the call service human-computer interaction environment indication information to the media delivery server, so as to protect user privacy and improve information security.
- the embodiment of the present application provides a method for delivering media content, the method can be applied to the UE, the method includes: determining the human-computer interaction environment of the call service, and the human-computer interaction environment of the call service is during the call service The human-computer interaction environment of the user corresponding to the UE; according to the human-computer interaction environment of the call service, it is determined that no media content is presented during the call service.
- the UE may determine not to present media content during the call service according to the call service man-machine interaction environment.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, when the UE is not suitable for presenting media content, for example, the user does not look at the screen, or the user is not suitable for watching and listening to the media content, the media content is not presented, which improves user experience.
- the UE may not send the call service human-computer interaction environment indication information to the media delivery server, so as to protect user privacy and improve information security.
- a possible implementation manner is to determine the human-computer interaction environment of the call service, including at least one of the following: detecting whether the screen of the UE is on; or detecting whether the interface of the calling program of the UE is visible; or detecting the hands-free function of the UE Whether it is turned on; or, detecting whether the wired headset of the UE is plugged in; or detecting whether the wireless headset of the UE is connected; or detecting whether the user is within the visible range of the UE.
- the UE can detect any of the following: whether the screen of the UE is on, whether the interface of the calling program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired headset of the UE is plugged in, or whether the wireless headset of the UE is connected , or whether the user is within the visible range of the UE, so as to determine the human-computer interaction environment of the call service.
- determining the media format according to the human-computer interaction environment of the call service includes: determining that the media format is an audio format if any of the following environments is detected: it is detected that the screen of the UE is turned off; or, it is detected that the UE's The screen is on, and the interface of the calling program of the UE is not visible; or, it is detected that the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE; or, the screen of the UE is detected to be on , the wireless headset of the UE is connected, and the user is not within the visible range of the UE.
- the UE may determine that the media format is an audio format when the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, and indicate the media format to the media delivery server.
- the media delivery server will not deliver media content in the form of video to the UE, which can reduce or avoid consumption of data traffic of the UE and save air interface resources while improving user experience.
- the media format is determined according to the human-computer interaction environment of the call service, including: if any of the following environments is detected, the media format is determined to be in the form of audio and video: it is detected that the screen of the UE is lit, and the call procedure of the UE is detected.
- the interface is visible, and the UE's wired headset is plugged in; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset is connected; or, it is detected that the UE's screen is lit, and the UE's call program
- the interface is visible, the wireless headset of the UE is connected, and the user is within the visible range of the UE; or, it is detected that the screen of the UE is turned on, the interface of the calling program of the UE is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE. within range.
- the UE may determine that the media format is video with audio.
- determining the media format according to the human-computer interaction environment of the call service includes: if it is detected that the screen of the UE is on, the interface of the UE's call program is visible, and the hands-free function of the UE is turned on, then determining the media format is Silent video format. Based on the above method, if the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play external voice, then the UE can determine that the media format is a silent video format.
- determining the media format according to the human-computer interaction environment of the call service includes: determining that the media format is a bass video format if any of the following environments is detected: the insertion of a wired headset of the UE is detected; or, the UE is detected or, it is detected that the screen of the UE is on, the caller interface of the UE is visible, the hands-free function of the UE is off, the wired headset of the UE is not plugged in, the wireless headset of the UE is not connected, and the user is on the UE’s within sight.
- the UE can determine that the media format is a low-pitched video format.
- determining not to present media content during the call service according to the human-computer interaction environment of the call service includes: if any of the following environments is detected, determining not to present the media content during the call service: UE is detected The screen of the UE is off; or, it is detected that the screen of the UE is on, and the interface of the calling program of the UE is not visible; or, the screen of the UE is detected to be on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE ; or, it is detected that the screen of the UE is on, the wireless headset of the UE is connected, and the user is not within the visible range of the UE.
- the UE may not present the media content when the man-machine interaction environment of the call service is not suitable for delivering the media content.
- the embodiment of the present application provides a method for delivering media content, which can be applied to UE, and the method includes: obtaining information about media content; determining the call service human-computer interaction environment, and the call service human-computer interaction environment The human-computer interaction environment of the user corresponding to the UE during the call service; the media form is determined according to the call service human-computer interaction environment, and the media content that conforms to the media form is presented in the information of the media content through the program unit related to the call program.
- the UE can first obtain the information of the media content, determine the human-computer interaction environment of the call service, and then determine the media form according to the human-computer interaction environment of the call service. In this way, after determining the media form, the UE can present the media content in the media content information that conforms to the media form.
- the human-computer interaction environment of the call service can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media format determined according to the human-computer interaction environment of the call service is more in line with the needs of the user, and can improve user experience and delivery effect of media content.
- the UE determines the media format, it does not need to request the media content from the media delivery server, but directly determines the media content that meets the media format locally and presents the media content, which can present the media content in time, reducing the UE The time from the media form to the UE presenting the media content is determined. Moreover, compared with the method provided in the second aspect, the UE may not send the call service human-computer interaction environment indication information to the media delivery server, which protects the user's privacy and improves information security.
- the embodiment of the present application provides a method for delivering media content, which can be applied to UE, and the method includes: acquiring information about media content; It is the human-computer interaction environment of the user corresponding to the UE during the call service; according to the call service human-computer interaction environment, it is determined that the media content is not presented during the call service.
- the UE may first obtain information about media content, determine a call service human-computer interaction environment, and determine not to present media content during a call service according to the call service human-computer interaction environment.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, when the UE is not suitable for presenting media content, for example, the user does not look at the screen, or the user is not suitable for watching and listening to the media content, the media content is not presented, which improves the user experience and reduces or avoids the UE consumption of data traffic and save air interface resources.
- the UE does not need to send the call service human-computer interaction environment indication information to the media delivery server, which protects the user's privacy and improves information security.
- a possible implementation manner is to determine the human-computer interaction environment of the call service, including at least one of the following: detecting whether the screen of the UE is on; or detecting whether the interface of the calling program of the UE is visible; or detecting the hands-free function of the UE Whether it is turned on; or, detecting whether the wired headset of the UE is plugged in; or detecting whether the wireless headset of the UE is connected; or detecting whether the user is within the visible range of the UE.
- the UE can detect any of the following: whether the screen of the UE is on, whether the interface of the calling program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired headset of the UE is plugged in, or whether the wireless headset of the UE is connected , or whether the user is within the visible range of the UE, so as to determine the human-computer interaction environment of the call service.
- determining the media format according to the human-computer interaction environment of the call service includes: determining that the media format is an audio format if any of the following environments is detected: it is detected that the screen of the UE is turned off; or, the screen of the UE is detected It is on, and the interface of the calling program of the UE is not visible; or, it is detected that the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE; or, it is detected that the screen of the UE is on, The wireless headset of the UE is connected and the user is not within the visible range of the UE.
- the UE may determine that the media format is an audio format when the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE.
- the media format is determined according to the human-computer interaction environment of the call service, including: if any of the following environments is detected, the media format is determined to be in the form of audio and video: it is detected that the screen of the UE is lit, and the call procedure of the UE is detected.
- the interface is visible, and the UE's wired headset is plugged in; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset is connected; or, it is detected that the UE's screen is lit, and the UE's call program
- the interface is visible, the wireless headset of the UE is connected, and the user is within the visible range of the UE; or, it is detected that the screen of the UE is on, the interface of the calling program of the UE is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE. within sight.
- the UE may determine that the media format is video with audio.
- determining the media format according to the human-computer interaction environment of the call service includes: if it is detected that the screen of the UE is on, the interface of the UE's call program is visible, and the hands-free function of the UE is turned on, then determining the media format is Silent video format. Based on the above method, if the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, but the human-computer interaction environment of the call service is not suitable for the UE to play external voice, then the UE can determine that the media format is a silent video format.
- determining the media format according to the human-computer interaction environment of the call service includes: determining that the media format is a bass video format if any of the following environments is detected: the insertion of a wired headset of the UE is detected; or, the UE is detected or, it is detected that the screen of the UE is on, the caller interface of the UE is visible, the hands-free function of the UE is off, the wired headset of the UE is not plugged in, the wireless headset of the UE is not connected, and the user is on the UE’s within sight.
- the UE can determine that the media format is a low-pitched video format.
- determining not to present media content during the call service according to the human-computer interaction environment of the call service includes: if any of the following environments is detected, determining not to present the media content during the call service: UE is detected The screen of the UE is off; or, it is detected that the screen of the UE is on, and the interface of the call program of the UE is not visible; or, the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE; Or, it is detected that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE.
- the UE may not present the media content when the man-machine interaction environment of the call service is not suitable for delivering the media content.
- the embodiment of the present application provides a media delivery server.
- the media delivery server includes: a transceiver module and a processing module;
- the interactive environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service; the processing module is used to determine the media content to be delivered according to the call service human-computer interaction environment indication information;
- the media content to be delivered is delivered to the UE during the call service.
- the embodiment of the present application provides a media delivery server
- the media delivery server includes: a transceiver module and a processing module
- the human-computer interaction environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service
- the processing module is configured to determine not to deliver media content to the UE during the call service according to the call service human-computer interaction environment indication information .
- the human-computer interaction environment includes any one or any combination of the following: whether the UE's screen is on, whether the interface of the UE's calling program is visible, whether the UE's hands-free function is turned on, and whether the UE's wired headset is plugged in , whether the wireless headset of the UE is connected, or whether the user is within the visible range of the UE.
- the processing module is specifically configured to determine the media format according to the call service human-computer interaction environment indication information, the media format includes audio format, silent video format, audio video format or bass video format, and the media content in the bass video format
- the default volume is greater than 0 and less than a preset threshold; the processing module is also specifically configured to determine that the media content conforming to the media form is the media content to be delivered.
- the processing module is specifically configured to determine that the media format is an audio format if any of the following is true: the call service human-computer interaction environment indication information indicates that the screen of the UE is off, or the call service human-computer interaction environment The indication information indicates that the UE's screen is on, and the interface of the UE's call program is invisible, or the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's wired headset is plugged in, and the user is not within the visible range of the UE Alternatively, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless headset of the UE is connected, and the user is not within the visible range of the UE.
- the processing module is specifically used to determine that the media format is the audio and video format if any of the following is established: the call service human-computer interaction environment indication information indicates that the screen of the UE is lit, and the interface of the call program of the UE Visible, and the UE's wired headset is plugged in; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's wireless headset is connected; or, the call service human-computer interaction environment indication The information indicates that the UE's screen is on, the UE's call program interface is visible, the UE's wireless headset is connected, and the user is within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the UE The interface of the calling program is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE.
- the processing module is specifically used to determine that the media format is Silent video format.
- the processing module is specifically configured to determine that the media format is a bass video format if any of the following is true: the call service human-computer interaction environment indication information indicates that the wired headset of the UE is inserted; or, the call service man-machine The interaction environment indication information indicates that the UE's wireless headset is connected; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, the UE's hands-free function is turned off, and the UE's wired headset is not plugged in. The wireless headset of the UE is not connected, and the user is within the visible range of the UE.
- the processing module is specifically configured to determine that the media content to be delivered is media content that transmits media information through voice if any of the following is true: the call service human-computer interaction environment indication information indicates that the screen of the UE is turned off; Or, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, and the interface of the UE call program is invisible; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's wired headset is plugged in, And the user is not within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE.
- the processing module is specifically configured to determine that the media content to be delivered is media content that transmits information through images if any of the following is true: the call service human-computer interaction environment indication information indicates that the screen of the UE is lit, The interface of the calling program of the UE is visible, and the hands-free function of the UE is turned off; or, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the interface of the calling program of the UE is visible, and the hands-free function of the UE is turned on.
- the processing module is specifically configured to determine the group type of the user according to the call service human-computer interaction environment indication information; and determine the media content to be delivered according to the group type.
- the processing module is specifically configured to determine that no media content is delivered to the UE during the call service if any of the following is true: the call service human-computer interaction environment indication information indicates that the screen of the UE is turned off; or, The call service human-computer interaction environment indication information indicates that the UE’s screen is on, and the interface of the UE’s call program is invisible; or, the call service human-computer interaction environment indication information indicates that the UE’s screen is on, the UE’s wired headset is plugged in, and the user Not within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is not within the visible range of the UE.
- the transceiver module is specifically configured to receive a SIP-info message sent by the UE, where the SIP-info message includes the call service human-computer interaction environment indication information.
- the transceiver module is specifically configured to receive a SIP-Notification message sent by the UE, and the SIP-Notification message includes the call service human-computer interaction environment indication information; the transceiver module is also used to send a subscription message to the UE , the subscription message is used to subscribe to the call service human-computer interaction environment indication information.
- the transceiver module is specifically configured to receive a request message for requesting media content sent by the UE, where the request message for requesting media content includes the call service human-computer interaction environment indication information.
- the transceiver module is specifically configured to send a response message to the request message to the UE during the call service, where the response message includes the media content to be delivered.
- the transceiver module is further configured to send a response message to the request message to the UE, where the response message includes first indication information, and the first indication information is used to indicate that no media is delivered to the UE during the call service content.
- the processing module is further configured to establish a media channel according to the media content to be delivered, the type of the media channel includes an audio media channel or a video media channel, and the audio media channel is used to transmit media content in the form of audio, and/or Or, the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel is used to transmit media content in the form of video; During this period, the media content to be delivered is delivered to the UE through the media channel.
- the processing module is further configured to establish a media channel according to the call service, the type of the media channel includes an audio media channel or a video media channel, and the audio media channel is used to transmit media content in the form of audio, and/or , the audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel is used to transmit media content in the form of video.
- the processing module is also used to switch the media channel if the media channel cannot transmit the media content to be delivered; Deliver the media content to be delivered.
- the transceiver module is specifically configured to deliver the media content to be delivered to the UE through the media channel during the call service.
- the processing module is further configured to establish a media channel according to the call service, the type of the media channel includes an audio media channel or a video media channel, and the audio media channel is used to transmit media content in the form of audio, and/or, The audio media channel is used to transmit voice information between UEs corresponding to the call service during the call service, and the video media channel is used to transmit media content in the form of video.
- the embodiment of the present application provides a UE, the UE includes: a processing module and a transceiver module, the processing module is used to obtain the indication information of the human-computer interaction environment of the call service, and the indication information of the human-computer interaction environment of the call service indicates that in the call The human-computer interaction environment of the user corresponding to the UE during the service; the transceiver module is used to send the call service human-computer interaction environment indication information to the media delivery server; the transceiver module is also used to receive the media content to be delivered sent by the media delivery server; processing The module is also used to present the media content to be delivered by calling program-related program units.
- the embodiment of the present application provides a UE, the UE includes: a processing module and a transceiver module, the processing module is used to obtain the call service human-computer interaction environment indication information, the call service human-computer interaction environment indication information indicates The human-computer interaction environment of the user corresponding to the UE during the call service; the transceiver module is used to send the call service human-computer interaction environment indication information to the media delivery server; the processing module is also used to determine not to present the media content.
- the processing module is specifically configured to detect at least one of the following: detect whether the screen of the UE is on; or detect whether the interface of the calling program of the UE is visible; or detect whether the hands-free function of the UE is turned on ; Or, detecting whether the wired earphone of the UE is plugged in; or, detecting whether the wireless earphone of the UE is connected; or, detecting whether the user is within the visible range of the UE.
- the transceiver module is specifically configured to send a SIP-info message to the media delivery server, where the SIP-info message includes the call service human-computer interaction environment indication information.
- the transceiver module is specifically configured to send a SIP-Notification message to the media delivery server, and the SIP-Notification message includes the call service human-computer interaction environment indication information; the transceiver module is also used to receive information from the media delivery server.
- the transceiver module is specifically configured to send a request message for requesting media content to the media delivery server, where the request message for requesting media content includes the call service human-computer interaction environment indication information.
- the transceiver module is specifically configured to receive a response message to the request message sent by the media delivery server, where the response message includes the media content to be delivered.
- the processing module is specifically configured to receive, through the transceiver module, first indication information sent by the media delivery server, where the first indication information is used to indicate that media content is not to be delivered to the UE during the call service; processing The module is further specifically configured to determine not to present the media content according to the first indication information; or,
- the processing module is specifically configured to determine not to present the media content if it does not receive the indication information about presenting the media content sent by the media delivery server within the preset time range.
- the transceiver module is specifically configured to receive a response message to the request message sent by the media delivery server, where the response message includes the first indication information.
- the embodiment of the present application provides a UE, the UE includes: a processing module and a transceiver module; The human-computer interaction environment of the user corresponding to the UE; the processing module is also used to determine the media format according to the call service human-computer interaction environment; the transceiver module is used to send the instruction information of the media format to the media delivery server; the transceiver module is also used to receive The media content conforming to the media format sent by the media delivery server; the processing module is also used to present the media content by calling program units related to the program.
- the embodiment of the present application provides a UE, the UE includes: a processing module; a processing module, configured to determine a call service human-computer interaction environment, the call service human-computer interaction environment is the UE during the call service The corresponding user's human-computer interaction environment; the processing module is further configured to determine not to present media content during the call service according to the call service human-computer interaction environment.
- the processing module is specifically configured to detect at least one of the following: detect whether the screen of the UE is on; or detect whether the interface of the calling program of the UE is visible; or detect whether the hands-free function of the UE is turned on ; or, detecting whether the wired earphone of the UE is plugged in; or, detecting whether the wireless earphone of the UE is connected; or, detecting whether the user is within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is an audio format if any of the following circumstances is detected: it is detected that the screen of the UE is off; or, it is detected that the screen of the UE is on and the call of the UE
- the interface of the program is not visible; or, it is detected that the UE’s screen is lit, the UE’s wired headset is plugged in, and the user is not within the visible range of the UE; or, it is detected that the UE’s screen is lit, the UE’s wireless headset is connected, and the user Not within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is in the form of audio and video if any of the following circumstances is detected: it is detected that the screen of the UE is lit, the interface of the calling program of the UE is visible, and the UE's wired The headset is plugged in; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset is connected; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset Connected and the user is within the visible range of the UE; or, it is detected that the screen of the UE is on, the call program interface of the UE is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is a silent video format if it is detected that the UE's screen is on, the UE's calling program interface is visible, and the UE's hands-free function is enabled.
- the processing module is specifically configured to determine that the media format is a bass video format if any of the following environments is detected: the insertion of a wired headset of the UE is detected; or, the wireless headset connection of the UE is detected; or, It is detected that the UE's screen is on, the UE's calling program interface is visible, the UE's hands-free function is off, the UE's wired headset is not plugged in, the UE's wireless headset is not connected, and the user is within the visible range of the UE.
- the processing module is specifically configured to determine that no media content is presented during the call service if any of the following circumstances is detected: it is detected that the screen of the UE is turned off; or, it is detected that the screen of the UE is turned on, And the call program interface of the UE is not visible; or, it is detected that the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE; or, the screen of the UE is on, and the wireless headset of the UE connected, and the user is not within the visible range of the UE.
- the embodiment of the present application provides a UE, the UE includes: a transceiver module and a processing module; the transceiver module is used to acquire media content information;
- the human-computer interaction environment is the human-computer interaction environment of the user corresponding to the UE during the call service; the processing module is also used to determine the media form according to the call service human-computer interaction environment, and present the media content through the program unit related to the call program In the message, the media content conforms to the media form.
- the embodiment of the present application provides a UE, the UE includes: a transceiver module and a processing module; the transceiver module is used to acquire media content information; the processing module is used to determine the call service human-computer interaction environment, the The call service human-computer interaction environment is the human-computer interaction environment of the user corresponding to the UE during the call service; the processing module is further configured to determine not to present media content during the call service according to the call service human-computer interaction environment.
- the processing module is specifically configured to detect at least one of the following: detect whether the screen of the UE is on; or detect whether the interface of the calling program of the UE is visible; or detect whether the hands-free function of the UE is turned on ; or, detecting whether the wired earphone of the UE is plugged in; or, detecting whether the wireless earphone of the UE is connected; or, detecting whether the user is within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is an audio format if any of the following circumstances is detected: it is detected that the screen of the UE is off; or, it is detected that the screen of the UE is on and the call of the UE
- the interface of the program is not visible; or, it is detected that the UE's screen is lit, the UE's wired headset is plugged in, and the user is not within the visible range of the UE; or, it is detected that the UE's screen is lit, the UE's wireless headset is connected, and The user is not within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is in the form of audio and video if any of the following circumstances is detected: it is detected that the screen of the UE is lit, the interface of the calling program of the UE is visible, and the UE's wired The headset is plugged in; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset is connected; or, it is detected that the UE's screen is lit, the interface of the UE's call program is visible, and the UE's wireless headset Connected, and the user is within the visible range of the UE; or, it is detected that the screen of the UE is on, the call program interface of the UE is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE.
- the processing module is specifically configured to determine that the media format is a silent video format if it is detected that the UE's screen is on, the UE's calling program interface is visible, and the UE's hands-free function is enabled.
- the processing module is specifically configured to determine that the media format is a bass video format if any of the following environments is detected: the insertion of a wired headset of the UE is detected; or, the wireless headset connection of the UE is detected; or, It is detected that the UE's screen is on, the UE's calling program interface is visible, the UE's hands-free function is off, the UE's wired headset is not plugged in, the UE's wireless headset is not connected, and the user is within the visible range of the UE.
- the processing module is specifically configured to determine that no media content is presented during the call service if any of the following circumstances is detected: it is detected that the screen of the UE is turned off; or, it is detected that the screen of the UE is turned on, And the call program interface of the UE is not visible; or, it is detected that the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE; or, the screen of the UE is on, and the wireless headset of the UE connected, and the user is not within the visible range of the UE.
- the embodiment of the present application provides a media delivery server, including: a processor; the processor is configured to be coupled with the memory, and after reading the instructions in the memory, execute the method according to the above first aspect according to the instructions .
- the media delivery server may be the media delivery server in the first aspect above, or a device including the above media delivery server.
- the media delivery server further includes a memory, where the memory is configured to store necessary program instructions and data.
- an embodiment of the present application provides a UE, including: a processor; the processor is configured to be coupled to a memory, and after reading an instruction in the memory, execute any of the above-mentioned second to fourth aspects according to the instruction.
- the UE may be the UE in any one of the above-mentioned second aspect to the fourth aspect, or an apparatus including the above-mentioned UE.
- the UE further includes a memory, where the memory is configured to store necessary program instructions and data.
- the embodiment of the present application provides a media delivery server, including: a processor and an interface circuit; the interface circuit is used to receive computer programs or instructions and transmit them to the processor; the processor is used to execute the computer programs or instructions , so that the media delivery server executes the method described in the first aspect above.
- the embodiment of the present application provides a UE, including: a processor and an interface circuit; the interface circuit is configured to receive a computer program or instruction and transmit it to the processor; the processor is configured to execute the computer program or instruction to The UE is made to execute the method described in any one of the second aspect to the fourth aspect above.
- an embodiment of the present application provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer can execute the method described in any one of the above-mentioned aspects.
- the embodiments of the present application provide a computer program product containing instructions, which when run on a computer, enable the computer to execute the method described in any one of the above aspects.
- an embodiment of the present application is a communication system
- the communication system includes a media delivery server configured to execute the method described in the first aspect above, and a UE configured to execute the method described in the second aspect above, or
- the communication system includes a UE configured to execute the method described in the third aspect above, or the communication system includes a UE configured to execute the method described in the fourth aspect above.
- FIG. 1 is a first schematic flow diagram of the delivery process of media content provided by the embodiment of the present application
- FIG. 2 is a second schematic flow diagram of the delivery process of media content provided by the embodiment of the present application.
- FIG. 3A is a first schematic diagram of a communication system architecture provided by an embodiment of the present application.
- FIG. 3B is a second schematic diagram of the communication system architecture provided by the embodiment of the present application.
- FIG. 4 is a schematic diagram of the hardware structure of the device provided by the embodiment of the present application.
- FIG. 5 is a first schematic flow diagram of a method for delivering media content provided by an embodiment of the present application
- FIG. 6A is a schematic diagram of a SIP-info message provided by an embodiment of the present application.
- FIG. 6B is a schematic diagram of a SIP-Subscribe message provided by an embodiment of the present application.
- FIG. 7 is a second schematic flow diagram of a method for delivering media content provided by an embodiment of the present application.
- FIG. 8A is a first schematic diagram of an image captured by a mobile phone provided in an embodiment of the present application.
- FIG. 8B is a second schematic diagram of an image captured by a mobile phone provided in the embodiment of the present application.
- FIG. 9 is a third schematic flow diagram of a method for delivering media content provided by an embodiment of the present application.
- FIG. 10 is a fourth schematic flow diagram of a method for delivering media content provided by an embodiment of the present application.
- FIG. 11 is a schematic structural diagram of a media delivery server provided by an embodiment of the present application.
- FIG. 12 is a schematic structural diagram of a UE provided in an embodiment of the present application.
- the call service may refer to a voice call service or a video call service in which the UE participates as a calling party or a called party and connects with other UEs via a communication network.
- the call service can be a voice call service or a video call service performed by the UE dialing a mobile phone number, a landline number or a customer service center number; or, the call service can be a real time communication (RTC ) is a voice call service or a video call service for calling other UEs.
- RTC real time communication
- the call service can be a voice call service or a video call service for the UE to receive a call from a mobile phone, landline or customer service center; or, the call service can be performed when the UE receives calls from other UEs through the RTC application voice call service or video call service.
- the duration of a call service may refer to the entire time range from the dialing of a party participating in the call service to the end of the call service (suspension or termination, etc.), and may sometimes be called "call process” or "call service process”.
- the call service period may include after the user of the calling UE calls the called UE and before the calling UE receives the ring-back tone; after the calling UE receives the ring-back tone and before the called UE is connected; During the call between the user of the called UE and the user of the called UE; after the call ends, the user of one UE hangs up and before the user of the other UE hangs up; after the user of the calling UE calls the called UE, the called UE is in arrears due to shutdown , or the network is not good and other reasons cannot be connected, but before the calling UE user hangs up.
- the media content may refer to the media content suitable for being presented on the UE during the call service. For example, when a call service is in progress, news, advertisements, recruitment information, landscape pictures, people's deeds and other information presented on the UE are expected to be pushed to the UE.
- a media form may also be referred to as a form of media content.
- the media format includes one or more of an audio format, a silent video format, a sound video format, or a subwoofer video format.
- the video format without sound, the video format with sound and the video format with bass may be collectively referred to as the video format.
- the volume of the media content in the form of silent video is less than or equal to the first preset threshold.
- the volume of the media content in the form of video with audio is greater than or equal to a second preset threshold.
- the default volume of the media content in the form of bass video is greater than 0 and less than the third preset threshold.
- the volume of the media content in the form of bass video is 10% lower than the volume of the media content in the form of video with sound.
- the first preset threshold, the second preset threshold, and the third preset threshold may be the same or different.
- the media format is an audio format
- presenting the media content on the UE may be understood as the UE playing the media content in the audio format.
- the media format is a silent video format, an audio video format or a subwoofer video format, presenting the media content on the UE may be interpreted as the UE playing the media content in the video format.
- the media content that transmits media information by voice may be media content in the form of video or media content in the form of audio. If the media content that transmits media information through voice is in the form of video, the media content mainly transmits information through voice in the video, and the images (or pictures) in the video can play an auxiliary role in transmitting information.
- a recruitment advertisement as an example, if the recruitment advertisement transmits media information through voice, the user can understand the main information to be conveyed by the recruitment advertisement by listening to the recruitment advertisement.
- the media content that transmits media information through voice may also be media content that mainly transmits information through voice, such as epidemic prevention publicity, traffic safety public service advertisements, and the like.
- the media content conveying information through images may be media content in the form of video.
- the media content mainly transmits information through images (or pictures) in the video, and the sound in the video can play an auxiliary role in transmitting information, or the sound in the video does not have the function of transmitting information.
- media content that conveys information through images may be car sales advertisements, landscape image displays, sports displays, and other media contents with good video display effects.
- the audio media channel can be used to transmit media content in the form of audio, and/or, used to transmit voice information between UEs corresponding to the call service during the call service (for example, the user of UE 1 corresponding to the call service and the user of UE 2 content of calls between users).
- Video media channels can be used to transmit media content in the form of video.
- An audio media channel may also be referred to as an audio media resource channel.
- a video media channel may also be referred to as a video media resource channel.
- the audio media channel or the video media channel may be established according to a protocol in a conventional technology, for example, a session initiation protocol (session initiation protocol, SIP).
- a session initiation protocol session initiation protocol, SIP
- the process of establishing an audio media channel or a video media channel may be different.
- SIP session initiation protocol
- the following takes the example of the media resource system (media resource system, MRS) delivering media content to the UE during the process of the UE calling other UEs by dialing a number, and the example of the UE calling other UEs through the RTC application During the process, the MRS delivers media content to the UE as an example to describe the process of delivering media content.
- MRS media resource system
- Figure 1 is a schematic diagram of the flow of MRS delivering video media content to UE A when UE A dials UE B's number to call UE B for a voice call service. Specifically, you can refer to the introduction in the following S101-S147. The method shown in FIG. 1 can be applied to the communication system shown in FIG. 3A described below.
- S101 UE A calls UE B.
- the user corresponding to UE A dials the number of UE B to call UE B.
- the call from UE A to UE B can trigger a call session control function (call session control function, CSCF) device of the IMS of the calling party (that is, UE A) (hereinafter referred to as the calling IMS_CSCF device).
- CSCF call session control function
- session description protocol, SDP session description protocol
- the calling IMS_CSCF device sends a media negotiation request response message (PRACK) to the Media AS.
- PRACK media negotiation request response message
- the Media AS After the Media AS receives the request media negotiation response message, it sends a request media negotiation response message to the called IMS_CSCF device to respond to the called IMS_CSCF device. After receiving the request media negotiation response message, the called IMS_CSCF device sends a confirmation response message (200ok) to the Media AS. After the Media AS receives the confirmation response message, it sends a confirmation response message (200ok) to the calling IMS_CSCF device to confirm that the calling IMS_CSCF device is connected.
- the calling IMS_CSCF device sends an update media status (update) message to the Media AS.
- the Media AS receives the update media status message, it sends an update media status message to the called IMS_CSCF device to establish an audio media channel between the MRS and UE A.
- the called IMS_CSCF device receives the update media status message, it sends a confirmation response message (200ok) to the Media AS.
- the Media AS sends a confirmation response message to the calling IMS_CSCF device.
- the audio media channel is established successfully.
- the called IMS_CSCF device sends a ringing (180Ring(SDP)) message to Media AS, and UE B starts ringing.
- the Media AS sends a request message to the media decision server to obtain media content delivery policy information. After receiving the request message, the media decision server sends media content delivery information to the Media AS to indicate the media content to be delivered. After the Media AS receives the media content delivery information, it sends an information report (info) message to the MRS to control the MRS to deliver video-based media content to UE A.
- info information report
- the Media AS can also send a ringing (180Ring) message to the calling IMS_CSCF device, so that the user of UE A can determine that UE B is ringing.
- the MRS sends a confirmation response message (200OK) to the Media AS, and delivers media content in the form of video to UE A.
- the called IMS_CSCF device After the called party picks up the phone (that is, the called party responds), the called IMS_CSCF device sends a confirmation response message (200ok) to the Media AS. After the Media AS receives the confirmation response message, it sends a response confirmation message (ACK) to the called IMS_CSCF device.
- the Media AS also sends an end session (BYE) message to the MRS. After receiving the session end message, the MRS sends a confirmation response message (200ok) to the Media AS. After the Media AS receives the confirmation response message, it sends a re-negotiation (Re-INVITE) message to the called IMS_CSCF device.
- Re-INVITE re-negotiation
- the Media AS can also send a confirmation response message (200ok) to the calling IMS_CSCF device.
- the calling IMS_CSCF device After receiving the acknowledgment response message, the calling IMS_CSCF device sends a response acknowledgment message (ACK) to the Media AS.
- ACK response acknowledgment message
- S143-S147 The user of UE A and the user of UE B start talking. After the call ends, the calling IMS_CSCF device sends a call end session (BYE) message to the Media AS. After Media AS receives the end session message, it sends an end session (BYE) message to the called IMS_CSCF device. After the called IMS_CSCF device receives the session ending message, it sends a confirmation response message (200ok) to the Media AS. After the Media AS receives the confirmation response message, it sends a confirmation response message (200ok) to the calling IMS_CSCF device.
- BYE call end session
- BYE end session
- the called IMS_CSCF device After the called IMS_CSCF device receives the session ending message, it sends a confirmation response message (200ok) to the Media AS.
- the Media AS receives the confirmation response message, it sends a confirmation response message (200ok) to the calling IMS_CSCF device.
- Figure 2 is a schematic diagram of the flow of MRS delivering media content to UE A when UE A calls UE B through the RTC application for voice call services. Specifically, reference may be made to the introduction in the following S201-S226. The method shown in FIG. 2 can be applied to the communication system shown in FIG. 3B described below.
- S201 The RTC application of UE A establishes a connection with the signaling server (Signal Server), and the RTC application of UE B establishes a connection with the Signal Server.
- the signaling server Signaling Server
- S202-S203 UE A creates a peer connection (Create PeerConnection) and adds a stream (Add Streams).
- the RTC application program of UE A opens the audio device and video device of UE A, and determines parameters such as audio stream or video stream.
- UE A generates call negotiation data (CreateOffer), and the RTC application program of UE A invokes Signal Server, initiates a call establishment request, and sends call negotiation data (Send Offer SDP) to Signal Server.
- the call negotiation data may indicate whether the current session includes parameters such as audio stream or video stream.
- Signal Server After Signal Server receives the call negotiation data, it forwards the call negotiation data (Relay Offer SDP) to UE B's RTC application.
- the RTC application of UE B turns on the audio and video equipment of UE B, prepares to answer the call negotiation data (CreateAnswer), and sends a response message (Send Answer SDP) to Signal Server.
- Signal Server forwards the response message (Relay Answer SDP) to UE A.
- S210-S214 UE A requests an IP address (Ask my Ipaddress) from a network address translation (network address translation, NAT) session traversal application server (session traversal utilities for NAT server, STUN Server).
- STUN Server returns the allocated channel information (OnIceCandidate) to UE A.
- UE A sends channel information (Send candidate) to Signal Server.
- Signal Server receives the channel information, it forwards the channel information (Relay candidate) to UE B.
- UE B receives the channel information, it can add channel information (AddIceCandidate).
- S215-S218 UE B requests an IP address from the STUN Server (Ask my Ipaddress). STUN Server returns the allocated channel information (OnIceCandidate) to UE B. After receiving the channel information, UE B sends the channel information (Send candidate) to UE A via Signal Server.
- the process of S215-S218 is similar to the process of S210-S213, so the introduction in S210-S213 can be referred to, and details are not repeated here.
- P2P Channel point-to-point channel
- P2P Channel point-to-point channel
- S220 UE B adds a stream (OnAddStream).
- S221 UE A and UE B communicate in real time. If UE A and UE B establish a P2P channel for audio and video transmission, UE A and UE B will communicate in real time with audio and video.
- S222-S224 UE A sends a request message to the media decision server. After receiving the request message, the media decision server decides the media content to be delivered to UE A, and sends the address of the decided media content to UE A.
- S225-S227 UE A requests the MRS for the media content corresponding to the address of the media content according to the address of the media content, and presents the media content after obtaining the media content.
- the communication system can be a long term evolution (long term evolution, LTE) system, a fifth generation (5th generation, 5G) communication system, a wireless fidelity (wireless-fidelity, WiFi) system, a third generation partnership project (3rd generation Partnership project, 3GPP) related communication systems, future evolution communication systems, or systems integrating multiple systems, etc., are not limited.
- 5G can also be called new radio (new radio, NR).
- new radio new radio
- FIG. 3A it is a schematic structural diagram of a communication system provided by an embodiment of the present application.
- the communication system shown in FIG. 3A may include a media delivery server 303, UE 301 and UE 302. Wherein, the media delivery server 303, UE 301 and UE 302 can be connected through a communication network.
- the communication network may be an IMS network.
- the IMS network may be responsible for the routing of call related signaling messages.
- the calling and called UEs are connected with the media delivery server 303 .
- the IMS network can send the media content sent by the media delivery server 303 to UE 301 or UE 302; the IMS network can also send the message of UE 301 or UE 302 to the media delivery server 303; the IMS network can also transmit UE 301 and UE 302 between messages.
- the UE in FIG. 3A may be a device capable of calling and delivering media content.
- the UE having a call function may be understood as the UE being able to perform a call service.
- the UE has the function of delivering media content, which means that the UE can receive media content and present the media content.
- the UE in FIG. 3A may be a handheld device or a wearable device with a wireless communication function.
- the UE in FIG. 3A may be a mobile phone, a tablet computer, or a smart watch.
- a UE may also be called a terminal or a terminal device.
- the device for realizing the function of the UE may be the UE; it may also be a device capable of supporting the UE to realize the function, such as a chip system, and the device may be installed in the UE or matched with the UE.
- the system-on-a-chip may be composed of chips, or may include chips and other discrete devices.
- the method provided in the embodiment of the present application is described by taking the UE as an example for realizing the function of the UE. A unified description is made here, and will not be described in detail later.
- the media delivery server 303 in FIG. 3A may receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, and determine whether to deliver media content to the UE during the call service according to the indication information.
- the media delivery server 303 in FIG. 3A may receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, determine the media content to be delivered according to the indication information, and Deliver the media content to be delivered to the UE.
- the functions of the media delivery server 303 can be centrally deployed on one physical device, so as to improve the cohesiveness of the media delivery server 303 and further improve the performance of the media delivery server 303 .
- the functions of the media delivery server 303 can also be deployed on multiple physical devices, so as to reduce the requirements on each physical device and make the functions of the media delivery server 303 easier to realize.
- the media delivery server 303 may include a media decision module 3031 , a media application module 3032 and a media resource management module 3033 .
- the media application module 3032 may be configured to receive indication information sent by the UE for indicating the human-computer interaction environment of the user corresponding to the UE during the call service.
- the media decision module 3031 may be used to determine whether to deliver media content to the UE during the call service according to the indication information, or to determine the media content to be delivered according to the indication information.
- the media resource management module 3033 may be used to deliver the media content to be delivered to the UE during the call service.
- the functions that the media application module 3032 has can be deployed on a Media AS (not shown in FIG. 3A ) for realizing the functions of the media application module 3032.
- the functions of the media decision module 3031 may be deployed on a media decision server (not shown in FIG. 3A ) to realize the functions of the media decision module 3031 .
- the functions of the media resource management module 3033 can be deployed on the MRS (not shown in FIG. 3A ) to realize the functions of the media resource management module 3033 .
- FIG. 3B it is a schematic structural diagram of another communication system provided by the embodiment of the present application.
- the communication system shown in FIG. 3B may include a media delivery server 306, a UE 304, and a UE 305.
- the media delivery server 306, the UE 304 and the UE 305 can be connected through a communication network.
- the communication network may be a 4G or 5G network.
- the UE in FIG. 3B may be a device installed with an RTC application and capable of delivering media content.
- the UE having the function of delivering media content may be understood as the UE being able to receive media content and present the media content.
- the UE in FIG. 3B may be a handheld device, a vehicle-mounted device, a wearable device or a computing device with a wireless communication function.
- the UE in FIG. 3B may be a mobile phone, a tablet computer, a computer with a wireless transceiver function, or a smart watch.
- the media delivery server 306 in FIG. 3B may receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, and determine whether to deliver media content to the UE during the call service according to the indication information.
- the media delivery server 306 in FIG. 3B may receive indication information indicating the human-computer interaction environment of the user corresponding to the UE during the call service, determine the media content to be delivered according to the indication information, and Deliver the media content to be delivered to the UE.
- the functions of the media delivery server 306 can be centrally deployed on one physical device, so as to improve the cohesion of the media delivery server 306 and further improve the performance of the media delivery server 306 .
- the functions of the media delivery server 306 can also be deployed on multiple physical devices, so as to reduce the requirements on each physical device and make the functions of the media delivery server 306 easier to realize.
- the media delivery server 306 may include a media decision module 3061 and a media resource management module 3062 .
- the media decision module 3061 can be used to receive the indication information sent by the UE to indicate the human-computer interaction environment of the user corresponding to the UE during the call service, and determine whether to deliver media to the UE during the call service according to the indication information.
- Content or, the media decision module 3061 may be configured to receive indication information sent by the UE for indicating the human-computer interaction environment of the user corresponding to the UE during the call service, and determine the media content to be delivered according to the indication information.
- the media resource management module 3062 may be configured to deliver the media content to be delivered to the UE during the call service.
- the function of the media decision module 3061 can be deployed on a media decision server (not shown in FIG. 3B ) to realize the function of the media decision module 3061.
- the functions of the media resource management module 3062 can be deployed on the MRS (not shown in FIG. 3B ) to realize the functions of the media resource management module 3062 .
- the communication system shown in FIG. 3B also includes an RTC server (RTC Server) 307.
- RTC Server307 can provide high-availability, high-quality, ultra-low-latency voice and video communication services.
- the UE can integrate an instant messaging capability based on a software development kit (software development kit, SDK) provided by the RTC Server 307.
- SDK software development kit
- the RTC Server 307 may also be responsible for the routing of call-related signaling messages. Connect the calling and called UEs with the media delivery server 306.
- RTC Server 307 may include STUN Server and Signal Server.
- STUN is a network protocol that allows a client behind a NAT (or multiple NATs) to find out its own public network address, find out which type of NAT it is behind and which local port the NAT is bound to. Internet (Internet) port. This information is used to create user datagram protocol (UDP) communication between two hosts that are also behind a NAT router.
- STUN Server is a server that handles STUN.
- Signal Server is a server that handles RTC signaling. It is understandable that STUN Server and Signal Server can be deployed on the same physical device or on different physical devices without limitation.
- the communication system shown in FIG. 3A or FIG. 3B is for example only, and is not intended to limit the technical solution of the present application.
- the communication system shown in FIG. 3A or FIG. 3B may also include other devices, and the number of UEs, media delivery servers, and RTC servers may also be determined according to specific needs. be restricted.
- each device in FIG. 3A or FIG. 3B in this embodiment of the present application may be a general-purpose device or a dedicated device, which is not specifically limited in this embodiment of the present application.
- each device in FIG. 3A or FIG. 3B in the embodiment of the present application can be realized by one device, or by multiple devices, or by one or more functional modules in one device , which is not specifically limited in this embodiment of the present application.
- the above functions can be elements in hardware devices, software functions running on dedicated hardware, or a combination of hardware and software, or virtualization functions instantiated on a platform (for example, a cloud platform) .
- each device in FIG. 3A or FIG. 3B may adopt the composition structure shown in FIG. 4 , or include components shown in FIG. 4 .
- FIG. 4 is a schematic diagram of a hardware structure of a device applicable to this embodiment of the present application.
- the device 40 includes at least one processor 401 and at least one communication interface 404, configured to implement the method provided in the embodiment of the present application.
- the device 40 may also include a communication link 402 and a memory 403 .
- the processor 401 can be a general-purpose central processing unit (central processing unit, CPU), a microprocessor, a specific application integrated circuit (application-specific integrated circuit, ASIC), or one or more for controlling the implementation of the application program program integrated circuit.
- CPU central processing unit
- ASIC application-specific integrated circuit
- Communication line 402 may include a path, such as a bus, for transferring information between the aforementioned components.
- the communication interface 404 is used for communicating with other devices or communication networks.
- the communication interface 404 can be any device such as a transceiver, such as an Ethernet interface, a wireless access network (radio access network, RAN) interface, a wireless local area network (wireless local area networks, WLAN) interface, a transceiver, a pin , bus, or transceiver circuits, etc.
- a transceiver such as an Ethernet interface, a wireless access network (radio access network, RAN) interface, a wireless local area network (wireless local area networks, WLAN) interface, a transceiver, a pin , bus, or transceiver circuits, etc.
- Memory 403 may be read-only memory (read-only memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (random access memory, RAM) or other types that can store information and instructions It can also be an electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be programmed by a computer Any other medium accessed, but not limited to.
- the memory may exist independently and be coupled with the processor 401 through the communication line 402 .
- the memory 403 can also be integrated with the processor 401 .
- the memory provided by the embodiment of the present application may generally be non-volatile.
- the memory 403 is used to store computer-executed instructions involved in executing the solutions provided by the embodiments of the present application, and the execution is controlled by the processor 401 .
- the processor 401 is configured to execute computer-executed instructions stored in the memory 403, so as to implement the method provided in the embodiment of the present application.
- the processor 401 may also perform processing-related functions in the methods provided in the following embodiments of the application, and the communication interface 404 is responsible for communicating with other devices or communication networks. The example does not specifically limit this.
- the computer-executed instructions in the embodiments of the present application may also be referred to as application program codes, which is not specifically limited in the embodiments of the present application.
- the coupling in the embodiments of the present application is an indirect coupling or a communication connection between devices, units or modules, which may be in electrical, mechanical or other forms, and is used for information exchange between devices, units or modules.
- the processor 401 may include one or more CPUs, such as CPU0 and CPU1 in FIG. 4 .
- device 40 may include multiple processors, for example, processor 401 and processor 407 in FIG. 4 .
- processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor.
- a processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (eg, computer program instructions).
- the device 40 may further include an output device 405 and/or an input device 406 .
- An output device 405 is coupled to the processor 401 and can display information in a variety of ways.
- the output device 405 may be a liquid crystal display (liquid crystal display, LCD), a light emitting diode (light emitting diode, LED) display device, a cathode ray tube (cathode ray tube, CRT) display device, or a projector (projector) Wait.
- the input device 406 is coupled to the processor 401 and can receive user input in various ways.
- the input device 406 may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.
- composition structure shown in FIG. 4 does not constitute a limitation to the device.
- the device may include more or less components than shown in the illustration, or combine some components , or different component arrangements.
- the method for delivering media content provided in the embodiment of the present application can be applied to various scenarios.
- the method for delivering media content provided by the embodiment of the present application can be applied after the calling UE calls the called UE and before the called UE rings (that is, when the calling UE initiates a call but the called UE does not ring), During the ringing process (that is, when the calling user hears the ringback tone), during the call (the calling party and the called party are in the process of talking), after the call ends (the caller and the called party end the call, after one user hangs up, and before the other party hangs up ), call failure (after the calling UE calls the called UE, the called UE cannot be connected due to shutdown, arrears, or poor network, and before the calling user hangs up) and other scenarios.
- a and/or B can mean: A exists alone, A and B exist simultaneously, and There are three cases of B, where A and B can be singular or plural.
- expressions like "at least one of A, B, and C" or "at least one of A, B, or C” are generally used to mean any of the following: A alone; B alone; C exists; A and B exist together; A and C exist simultaneously; B and C exist simultaneously; A, B, and C exist simultaneously.
- the above is an example of the three elements of A, B and C to illustrate the optional items of the item.
- words such as “first” and “second” may be used to distinguish technical features with the same or similar functions.
- the words “first” and “second” do not limit the number and execution order, and the words “first” and “second” do not necessarily mean that they must be different.
- words such as “exemplary” or “for example” are used to represent examples, illustrations or illustrations, and any embodiment or design described as “exemplary” or “for example” should not be interpreted It is more preferred or more advantageous than other embodiments or design solutions.
- the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific manner for easy understanding.
- the UE and/or the media delivery server may perform some or all of the steps in the embodiment of the present application, these steps are only examples, and the embodiment of the present application may also perform other steps or various steps out of shape.
- each step may be performed in a different order presented in the embodiment of the present application, and it may not be necessary to perform all the steps in the embodiment of the present application.
- the method for delivering media content includes S501-S505a, or, the method for delivering media content includes S501-S502 and S503b.
- S501 The UE obtains the indication information of the call service human-computer interaction environment.
- the UE may be any UE in FIG. 3A or FIG. 3B .
- the UE may be UE301 or UE302 in FIG. 3A; or, the UE may be UE304 or UE305 in FIG. 3B.
- the call service human-computer interaction environment indication information may indicate the human-computer interaction environment of the user corresponding to the UE during the call service.
- the human-computer interaction environment may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching media content or listening to media content, and so on. Therefore, the call service man-machine interaction environment can be used by the media delivery server to determine whether it is suitable to deliver media content to the UE during the call service.
- the media delivery server may not deliver the media content to the UE, and only when it is suitable to deliver the media content to the UE, the media delivery server will deliver the media content to the UE, which improves user experience and media content.
- the delivery effect of the content may be used by the media delivery server to determine the media content to be delivered. Because the media content to be delivered determined by the media delivery server is determined according to the current status of the user, it meets the needs of the user, and can improve user experience and the delivery effect of the media content.
- the human-computer interaction environment may include any one or any combination of the following: whether the screen of the UE is on, whether the interface of the call program of the UE is visible, whether the hands-free function of the UE is turned on, whether the wired headset of the UE is plugged in, Whether the wireless headset of the UE is connected, or whether the user is within the visible range of the UE.
- the calling program may be an application program corresponding to the calling service.
- the calling program can be a Telephony APP on the UE or an RTC software on the UE.
- the interface of the calling program may be a graphical user interface (graphical user interface, GUI) of the calling program.
- GUI graphical user interface
- the visible interface of the calling program of the UE may be understood as the calling program of the UE is running in the foreground.
- the fact that the interface of the calling program of the UE is not visible may be understood as that the calling program of the UE is running in the background.
- the insertion of the wired earphone of the UE may be understood as the UE is connected to the wired earphone, and the UE may play sound through the wired earphone connected to the UE.
- the fact that the wired earphone of the UE is not plugged in can be understood as that the UE is not connected to the wired earphone, and the UE can play sound through the UE's speaker.
- the wired earphone of the UE is plugged in, but the wired earphone is not used for the calling service, which may also be considered as the wired earphone of the UE is not inserted.
- the wireless earphone connection of the UE can be understood as the UE is connected to the wireless earphone, and the UE can play sound through the wireless earphone connected to the UE.
- the fact that the UE's wireless earphone is not connected can be understood as that the UE is not connected to the wireless earphone, and the UE can play sound through the UE's speaker.
- the wireless earphone can be a bluetooth earphone or other bluetooth device with call function (such as: smart bracelet, smart watch, etc.). It should be noted that the wireless headset of the UE is connected, but the wireless headset is not used for a call service, and it may also be considered that the wireless headset of the UE is not connected.
- the user is within the visible range of the UE may be understood as the user is within the "field of view" of the UE's screen, or in other words, the user can see the UE's screen.
- the fact that the user is not within the visible range of the UE may be interpreted as that the user is outside the "field of view” of the screen of the UE, or in other words, the user cannot see the screen. It is understandable that if the user cannot see the screen, the user can make a call through devices such as wired earphones and bluetooth earphones.
- the call service human-computer interaction environment indication information may include multiple indication information, and each indication information is used to indicate a state included in the human-computer interaction environment.
- the call service human-computer interaction environment indication information includes at least three indication information , the first indication information may indicate whether the screen of the UE is on, the second indication information may indicate whether the calling program interface of the UE is visible, and the third indication information may indicate whether the hands-free function of the UE is turned on.
- the UE obtains the indication information of the human-computer interaction environment of the call service.
- S501 may be executed before S125.
- S501 may be performed before S222.
- the UE may acquire the call service human-computer interaction environment indication information by calling an application programming interface (application programming interface, API) provided by the operating system of the UE.
- an application programming interface application programming interface, API
- the UE obtains the call service human-computer interaction environment indication information by calling an API provided by the operating system of the UE.
- the UE obtains the call service human-computer interaction environment indication information by calling the API provided by the UE's operating system.
- the embodiment of this application uses Android as an example for introduction. Specifically, reference may be made to what is described in the method shown in FIG. 7 below, and details are not described here.
- the UE sends the call service human-computer interaction environment indication information to the media delivery server.
- the media delivery server receives the call service human-computer interaction environment indication information sent by the UE.
- the media delivery server may be the media delivery server 303 in FIG. 3A. If the UE is UE 304 or UE 305 in FIG. 3B, the media delivery server may be the media delivery server 306 in FIG. 3B.
- the media delivery server is the media delivery server 303 in FIG. 3A.
- the call service human-computer interaction environment indication information sent by the UE to the media delivery server includes: the UE sends a SIP-info message to the media delivery server.
- the SIP-info message includes call service human-computer interaction environment indication information. That is to say, by extending the SIP-info message, the UE can send the call service human-computer interaction environment indication information to the media delivery server.
- the UEScrInfo parameter can be extended in the Messenger Header, and the UEScrInfo parameter includes SCRS, TAPS, HDFS, WEPS, WLES, RLOP and other parameters to fill in as extended parameters, so as to realize the function of indicating information of the call service human-computer interaction environment.
- SCRS can indicate whether the UE's screen is on or not.
- TAPS may indicate whether the UE's calling program interface is visible.
- HDFS may indicate whether the UE's hands-free function is enabled.
- WEPS may indicate whether the UE's wired headset is plugged in.
- the WLES may indicate whether the UE's wireless headset is connected.
- the RLOP may indicate whether the user is within the line of sight of the UE.
- the UEScrInfo parameter can indicate that the screen of the UE is on, the interface of the call program of the UE is visible, the hands-free function of the UE is off, the wired headset of the UE is plugged in, the wireless headset of the UE is not connected, and the user within the visible range of the UE.
- the UE sends the call service human-computer interaction environment indication information to the media delivery server, including: the UE sends a session initiation protocol notification (SIP-Notification) message to the media delivery server.
- SIP-Notification message includes call service human-computer interaction environment indication information.
- the UE may receive a subscription (SIP-Subscribe) message from the media delivery server.
- the subscription message may be used to subscribe to the call service human-computer interaction environment indication information. That is to say, the media delivery server may subscribe to the UE the indication information of the human-computer interaction environment of the call service, and after the subscription, the UE may send the indication information of the human-computer interaction environment of the call service to the media delivery server.
- the media delivery server may subscribe the call service human-computer interaction environment indication information to the UE.
- a parameter ReqScr:request is added to subscribe to the call service human-computer interaction environment indication information, so as to realize the function of subscribing the call service human-computer interaction environment indication information to the UE.
- the UE may send call service human-computer interaction environment indication information to the media delivery server.
- the UEScrInfo parameter is extended in the message header of the SIP-Notification message, and the UEScrInfo parameter includes SCRS, TAPS, HDFS, WEPS, WLES, RLOP and other parameters as extended parameters to fill in, so as to realize the function of indicating the information of the call service human-computer interaction environment.
- the UEScrInfo parameter refer to the above example.
- the functions of the media delivery server 303 may be deployed centrally on one physical device, or may be deployed on multiple physical devices. Taking the communication system shown in FIG. 3A as an example, if the functions of the media delivery server 303 are centrally deployed on one physical device, the UE sends call service human-computer interaction environment indication information to the media application module 3032 .
- the media application module 3032 receives the call service human-computer interaction environment indication information sent by the UE. Subsequently, the media application module 3032 may send the call service human-computer interaction environment indication information to the media decision module 3031.
- the UE sends the call service human-computer interaction environment indication information to the Media AS.
- the Media AS receives the call service human-computer interaction environment indication information sent by the UE.
- the indication information may be included in a SIP-info message or a SIP-Notification message.
- the Media AS may send the call service human-computer interaction environment indication information to the media decision server.
- the Media AS can send the call service human-computer interaction environment indication information to the media decision server through the request message in S125, that is, the call service human-computer interaction environment indication information can be included in S125 in the request message.
- Example 2 The media delivery server is the media delivery server 306 in FIG. 3B.
- the UE sends the call service human-computer interaction environment indication information to the media delivery server, including: the UE sends a request message requesting media content to the media delivery server.
- the request message for requesting media content includes call service human-computer interaction environment indication information.
- the request message for requesting media content is the above request message of S222.
- the UE communicates with the media delivery server through a hypertext transfer protocol (hypertext transfer protocol, Http) protocol or a hypertext transfer protocol over securesocket layer (Https).
- Http hypertext transfer protocol
- Https hypertext transfer protocol over securesocket layer
- the call service human-computer interaction environment indication information contained in the request message for requesting media content may adopt formats such as extensible markup language (extensible markup language, xml), JavaScript object notation (JSon), etc. If the call service human-computer interaction environment indication information adopts the xml format, the call service human-computer interaction environment indication information may be as follows:
- the call service human-computer interaction environment indication information can be as follows:
- the above call service human-computer interaction environment indication information in xml format or JSon format indicates that the screen of the UE is on, the interface of the calling program of the UE is visible, the hands-free function of the UE is off, the wired headset of the UE is plugged in, the UE The wireless headset is connected and the user is within the line of sight of the UE.
- the functions of the media delivery server 306 can be centrally deployed on one physical device, or deployed on multiple physical devices. Taking the communication system shown in FIG. 3B as an example, if the functions of the media delivery server 306 are centrally deployed on one physical device, the UE sends call service human-computer interaction environment indication information to the media decision module 3061 . Correspondingly, the media decision module 3061 receives the call service human-computer interaction environment indication information sent by the UE. If the functions of the media delivery server 306 are deployed on multiple physical devices, the UE sends the call service human-computer interaction environment indication information to the media decision server. Correspondingly, the media decision server receives the call service human-computer interaction environment indication information sent by the UE. Taking the process shown in FIG. 2 as an example, the UE may send the call service human-computer interaction environment indication information to the media decision server through the request message in S222, that is, the call service human-computer interaction environment indication information may be included in S222. in the request message.
- the SDP offer message in the conventional technology can also be extended, and the call service man-machine interaction information can be sent through the extended SDP offer message. Instructions for the interactive environment.
- the media delivery server determines the media content to be delivered according to the call service human-computer interaction environment indication information.
- the media delivery server may directly determine the media content to be delivered according to the call service human-computer interaction environment indication information.
- the media delivery server may determine the media form according to the indication information of the call service human-computer interaction environment, and determine that the media content conforming to the media form is the media content to be delivered.
- the media delivery server may determine the group type of the user according to the call service human-computer interaction environment indication information, and determine the media content to be delivered according to the group type.
- Case 1 The media delivery server directly determines the media content to be delivered according to the indication information of the human-computer interaction environment of the call service.
- the media content to be delivered may be a media content that transmits media information through voice or a media content that transmits information through images.
- the media content that transmits media information through voice or the media content that transmits information through images reference may be made to the above explanation of related technical terms involved in the embodiments of the present application, and details are not repeated here.
- the media delivery server can determine the media content to be delivered corresponding to the call service human-computer interaction environment.
- the media delivery server may determine that the media content to be delivered is the media content that transmits media information through voice.
- the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, the media delivery server may determine that the media content to be delivered is the media content that transmits media information through images. In this way, media content suitable for the user can be delivered to the UE, which can improve user experience and the delivery effect of the media content.
- the media delivery server determines the media content to be delivered according to the indication information of the human-computer interaction environment of the call service, including: if any of the following is true, then determining that the media content to be delivered is media content that transmits media information through voice:
- the call service human-computer interaction environment indication information indicates that the UE's screen is off; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the interface of the UE's call program is invisible; or, the call service human-computer interaction environment indication
- the information indicates that the UE's screen is on, the UE's wired headset is plugged in, and the user is not within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's wireless headset is connected, and the user is not in within the visible range of the UE.
- the media delivery server determines that the media content to be delivered is the media content that transmits media information through voice.
- "/" indicates that any state is acceptable, or the call service human-computer interaction environment indication information does not indicate this state, and a unified explanation is made here, and will not be repeated hereafter.
- the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine that the media content to be delivered is through voice Media content that conveys media information. If the UE's screen is on and the interface of the UE's calling program is invisible, it means that the user is operating other applications. Although the user may stare at the screen, it is inconvenient to disturb the user visually. Therefore, the human-computer interaction environment for calling services is suitable The user listens to the sound played by the UE, and the media delivery server can determine that the media content to be delivered is the media content that transmits media information through voice.
- the media delivery server can determine that the media content to be delivered is the media content that transmits media information through voice.
- the media delivery server determines the media content to be delivered according to the instruction information of the human-computer interaction environment of the call service, including: if any of the following is true, determine that the media content to be delivered is the media content that transmits information through images: call The service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's hands-free function is turned off; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, and the UE's call The interface of the program is visible, and the UE's hands-free function is turned on. Specifically, it may be as shown in Table 2.
- the media delivery server may determine the media form according to the indication information of the human-computer interaction environment of the call service, and determine that the media content conforming to the media form is the media content to be delivered.
- the media delivery server can determine the media format corresponding to the call service human-computer interaction environment according to different call service human-computer interaction environments. Exemplarily, if the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, the media distribution server may determine that the media format is an audio format. If the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, the media delivery server may determine that the media format is video with audio. If the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, but the human-computer interaction environment of the call service is not suitable for the UE to play external voice, the media distribution server may determine that the media format is a silent video format.
- the media distribution server can determine that the media format is a low-frequency video format. Subsequently, the media delivery server only needs to determine that the media content conforming to the media format is the media content to be delivered. In this way, on the one hand, media content suitable for the user can be delivered to the UE, thereby improving user experience and the delivery effect of the media content.
- the media delivery server determines the media format according to the indication information of the call service human-computer interaction environment, including: if any of the following is true, determine that the media format is an audio form: the call service human-computer interaction environment indication information indicates that the UE or the call service human-computer interaction environment indication information indicates that the UE’s screen is on and the UE’s call program interface is invisible, or the call service human-computer interaction environment indication information indicates that the UE’s screen is on and the UE’s A wired earphone is plugged in and the user is not within the visible range of the UE, or the call service human-computer interaction environment indication information indicates that the screen of the UE is on, the wireless earphone of the UE is connected, and the user is out of the visible range of the UE.
- the media delivery server determines that the media format is an audio format. It can be seen from Table 3 that if the screen of the UE is not lit, it means that the user may not want to look at the screen, so the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, and the media delivery server can determine that the media format is audio. If the UE's screen is on and the interface of the UE's calling program is invisible, it means that the user is operating other applications. Although the user may stare at the screen, it is inconvenient to disturb the user visually.
- the human-computer interaction environment for calling services is suitable
- the user listens to the sound played by the UE, and the media distribution server can determine that the media format is an audio format. If the UE's screen is on, the UE's wired headset is plugged in (or the UE's wireless headset is connected), and the user is not within the visible range of the UE, the user is less likely to stare at the screen, so the human-computer interaction environment for call services is suitable for users Listening to the sound played by the UE, the media delivery server can determine that the media format is an audio format.
- the media delivery server determines the media format according to the indication information of the call service human-computer interaction environment, including: if any of the following is true, determine that the media form is in the form of audio and video: the call service human-computer interaction environment indication information indicates The UE's screen lights up, the UE's call program interface is visible, and the UE's wired headset is plugged in; or, the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's wireless Headphone connection; or, the call service man-machine interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, the UE's wireless headset is connected, and the user is within the visible range of the UE; or, the call service man-machine The interactive environment indication information indicates that the screen of the UE is on, the interface of the calling program of the UE is visible, the wired earphone of the UE is plugged in
- the media delivery server determines the media format according to the call service human-computer interaction environment indication information, including: if the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and If the hands-free function of the UE is turned on, it is determined that the media format is a silent video format. Specifically, it may be as shown in Table 5.
- the media delivery server determines the media format according to the indication information of the call service human-computer interaction environment, including: if any of the following is true, determine that the media form is a bass video format: the call service human-computer interaction environment indication information indicates The UE's wired headset is plugged in; or, the call service human-computer interaction environment indication information indicates the UE's wireless headset connection; or the call service human-computer interaction environment indication information indicates that the UE's screen is on, the UE's call program interface is visible, and the UE's The hands-free function is turned off, the wired headset of the UE is not plugged in, the wireless headset of the UE is not connected, and the user is within the visible range of the UE. Specifically, it may be as shown in Table 6.
- the media delivery server can determine the group type of the user according to the indication information of the human-computer interaction environment of the call service, and determine the media content to be delivered according to the group type.
- the group types can be divided according to the age of the users.
- the group type includes the first group, and the first group may be a youth group.
- the age of the youth group is greater than or equal to the first numerical value and less than or equal to the second numerical value.
- the first value and the second value are positive integers, and the first value is smaller than the second value.
- the age of the youth group is greater than or equal to 18 years old and less than or equal to 40 years old.
- the media delivery server may determine the group type corresponding to the call service human-computer interaction environment according to different call service human-computer interaction environments. Exemplarily, if the human-computer interaction environment of the call service is an environment suitable for the youth group, the media delivery server may determine that the group type of the user is the youth group. Subsequently, the media delivery server only needs to determine that the media content conforming to the group type is the media content to be delivered. In this way, media content suitable for the group to which the user belongs can be delivered to the UE, thereby improving user experience and the delivery effect of the media content.
- the media delivery server may determine the group type of the user according to the indication information of the call service human-computer interaction environment, including: if any of the following is true, determine that the user group type is the first group: call service person
- the computer interaction environment indication information indicates that the UE's wired headset is inserted; or, the call service human-computer interaction environment indication information indicates the UE's wireless headset connection. Specifically, it may be as shown in Table 7.
- Tables 1 to 7 are only examples for the media delivery server to determine the media content to be delivered according to the call service human-computer interaction environment indication information.
- the media delivery server determines according to the call service human-computer interaction environment indication information
- the media content to be delivered may also have other situations, which are not specifically limited in this embodiment of the present application.
- the media delivery server may also send the call service human-computer interaction environment indication information and some other information (such as: current time, user tag attribute and other information) to determine the media content to be delivered, so that the media content to be delivered is more suitable for the user.
- some other information such as: current time, user tag attribute and other information
- the media decision-making module 3031 indicates according to the human-computer interaction environment of the call service The information identifies the media content to be delivered. If the media delivery server is the media delivery server 303 in FIG. 3A , and the functions of the media delivery server are deployed on multiple physical devices, the media decision server determines the media content to be delivered according to the indication information of the call service human-computer interaction environment.
- the media decision-making module 3061 indicates according to the human-computer interaction environment of the call service The information identifies the media content to be delivered. If the media delivery server is the media delivery server 306 in FIG. 3B, and the functions of the media delivery server are deployed on multiple physical devices, the media decision server determines the media content to be delivered according to the call service human-computer interaction environment indication information.
- the media delivery server delivers the media content to be delivered to the UE during the call service.
- the UE receives the media content to be delivered sent by the media delivery server.
- the media delivery server sends the media content to be delivered to the UE through a media channel during the call service.
- a media channel for the introduction of the media channel, reference may be made to the above-mentioned explanations of related technical terms involved in the embodiments of the present application, and details are not repeated here.
- the media delivery server may establish the media channel according to the call service. For example, if the call service is a voice call service, the media delivery server establishes an audio media channel, and if the call service is a video call service, the media delivery server establishes a video media channel. Subsequently, after the media delivery server determines the media content to be delivered (ie after S503a), if the media channel determined by the media delivery server can transmit the media content to be delivered, the media delivery server sends the media content to be delivered to the UE through the media channel. If the media channel determined by the media delivery server cannot transmit the media content to be delivered, the media delivery server switches the media channel, and sends the media content to be delivered to the UE through the switched media channel.
- the call service is a voice call service
- the media delivery server establishes an audio media channel
- the media delivery server if the call service is a video call service, the media delivery server establishes a video media channel.
- the media delivery server determines the media content to be delivered (
- the media delivery server sends the media content to be delivered to the UE through the media channel.
- the media delivery server will The audio media channel is switched to a video media channel, and the media to be delivered is sent to the UE through the video media channel.
- the media delivery server Switch the video media channel to the audio media channel, and send the media to be delivered to the UE through the video media channel.
- the media delivery server may establish the media channel according to the media content to be delivered. For example, if the media form of the media content to be delivered is audio, the media delivery server establishes an audio media channel; if the media form of the media content to be delivered is video, the media delivery server establishes a video media channel.
- the UE performs call services with other UEs through the media channel used to transmit the media content to be delivered. If the media channel used to transmit the media content to be delivered cannot be used for call services, the UE switches the media channel, and performs call services with other UEs through the switched media channel.
- the media channel used to transmit the media content to be delivered is an audio media channel (or video media channel)
- the call service is a voice call service (or video call service) (that is, the media channel used to transmit the media content to be delivered channel can be used for call services)
- the UE performs call services with other UEs through the media channel used to transmit the media content to be delivered.
- the media channel used to transmit the media content to be delivered is an audio media channel
- the call service is a video call service (that is, the media channel used to transmit the media content to be delivered cannot be used for the call service)
- the UE sends the audio
- the media channel is switched to a video media channel, and calls are made with other UEs through the video media channel.
- the media channel used to transmit the media content to be delivered is a video media channel
- the call service is an audio call service (that is, the media channel used to transmit the media content to be delivered cannot be used for the call service)
- the UE sends the video
- the media channel is switched to an audio media channel, and a call service is performed with other UEs through the audio media channel.
- the media decision module 3031 determines the media delivery server 303 to be delivered. After receiving the content, the media application module 3032 sends information about the media content to be delivered. After receiving the information about the media content to be delivered, the media application module 3032 sends an info message to the media resource management module 3033 to control the media resource management module 3033 to deliver the content to the UE. Media content to be delivered.
- the media decision server sends the Media The AS sends information about the media content to be delivered, and the Media AS sends an info message to the MRS after receiving the information about the media content to be delivered, so as to control the MRS to deliver the media content to be delivered to the UE.
- S504a may correspond to the above S126-S127.
- the information about the media content to be delivered may indicate the media content to be delivered.
- the media decision module 3061 determines the media delivery server 306 to be delivered. After receiving the content, the address of the media content to be delivered is sent to the UE. After receiving the address of the media content to be delivered, the UE requests the media resource management module 3062 for the media content to be delivered, so that the media resource management module 3062 delivers the media content to be delivered to the UE .
- the media resource management module 3062 is controlled to deliver the media content to be delivered to the UE, for example, the media decision-making module 3061 controls the media resource management module 3062 to send the above-mentioned request message requesting the media content to the UE.
- the response message of the , the response message includes the media content to be delivered.
- the media decision server determines the media content to be delivered Afterwards, the address of the media content to be delivered is sent to the UE, and after receiving the address of the media content to be delivered, the UE requests the MRS for the media content to be delivered, so that the MRS delivers the media content to be delivered to the UE.
- S504a may correspond to the above S224-S226.
- S505a The UE presents the media content to be delivered by calling a program unit related to the program.
- the program unit related to the calling program may be at least one process or at least one thread of the calling program.
- the program unit related to the calling program may or may not have an interface. If the program unit related to the calling program has an interface, the interface may occupy the entire screen of the UE (for example, the interface is a full-screen window), or the interface may not occupy the entire screen of the UE (for example, the interface is a floating window that can be suspended On the main page of the UE, it can also be suspended on the interface of the application program running in the foreground of the UE).
- the interface may be the interface of the calling program itself, or may not be the interface of the calling program itself (such as an interface triggered by a relevant application program after the UE receives the media content to be delivered). If the program unit related to the calling program has no interface, the program unit related to the calling program can be a background process or a background thread.
- the UE presenting the media content to be delivered by calling the program unit related to the program may also be described as: the UE plays the media content to be delivered by calling the program unit related to the program.
- the UE may send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server may determine the media content to be delivered according to the indication information.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information may reflect the current state of the user, for example, whether the user is watching the UE screen, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media content to be delivered determined according to the call service human-computer interaction environment indication information is more in line with the user's needs, and can improve user experience and media content delivery effect.
- S503a-S505a may also be replaced with S503b.
- the media delivery server determines not to deliver the media content to the UE during the call service according to the indication information of the call service human-computer interaction environment.
- the media delivery server may determine whether to deliver media content to the UE during the call service according to different call service human-computer interaction environments. Exemplarily, if the human-computer interaction environment of the call service is suitable for delivering media content, the media delivery server may determine to deliver the media content to the UE during the call service. If the human-computer interaction environment of the call service is not suitable for delivering the media content, the media delivery server may determine not to deliver the media content to the UE during the call service. In this way, when the human-computer interaction environment of the call service is not suitable for delivering media content, the media content is not delivered to the UE, which improves the user experience, reduces or avoids the consumption of data traffic of the UE, and saves air interface resources.
- the media delivery server determines not to deliver media content to the UE during the call service according to the indication information of the call service human-computer interaction environment, including: if any of the following is true, it is determined that the call service is not delivered during the call service.
- the call service human-computer interaction environment indication information indicates that the UE’s screen is off; or, the call service human-computer interaction environment indication information indicates that the UE’s screen is on, and the interface of the UE’s call program is invisible; or, the call service The service human-computer interaction environment indication information indicates that the UE’s screen is on, the UE’s wired headset is plugged in, and the user is not within the visible range of the UE; or, the call service human-computer interaction environment indication information indicates that the UE’s screen is on, and the UE’s wireless The headset is connected and the user is not within the UE's line of sight. Specifically, it may be as shown in Table 8.
- the above Table 8 is only an example in which the media delivery server determines not to deliver media content to the UE during the call service according to the call service human-computer interaction environment indication information. In a specific application, the media delivery server determines according to the call service human-computer interaction There may be other situations where the environment indication information determines that the media content is not delivered to the UE during the call service, which is not specifically limited in this embodiment of the present application.
- the media delivery server may send first indication information to the UE, where the first indication information is used to indicate not to deliver media content to the UE during the call service.
- the UE determines not to present the media content according to the first indication information.
- the media decision module 3031 may determine not to The UE delivers media content. Subsequently, the media decision module 3031 may send the first indication information to the UE through the media application module 3032. If the media delivery server is the media delivery server 303 in FIG. 3A , and the functions of the media delivery server are deployed on multiple physical devices, the media decision server may determine not to deliver media content to the UE during the call service. Subsequently, the media decision server may send the first indication information to the Media AS, and the Media AS sends the first indication information to the UE after receiving the first indication information.
- the media decision-making module 3061 may determine not to The UE delivers media content. Subsequently, the media decision module 3061 may send a response message to the above request message for requesting media content to the UE, where the response message includes the first indication information. If the media delivery server is the media delivery server 306 in FIG. 3B , and the functions of the media delivery server are deployed on multiple physical devices, the media decision server may determine not to deliver media content to the UE during the call service. Subsequently, the media decision server may send a response message to the request message for requesting media content to the UE, where the response message includes the first indication information.
- the media delivery server may not send the first indication information to the UE, that is, the media delivery server may not indicate to the UE not to deliver media content to the UE during the call service.
- the UE does not receive the indication information about presenting the media content sent by the media delivery server within the preset time range, and the UE determines not to present the media content.
- a timer can be configured for the UE. When the UE sends the call service human-computer interaction environment indication information to the media delivery server, or after the UE sends the call service human-computer interaction environment indication information to the media delivery server, or after the UE calls other UEs, Start the timer. When the timer expires and the UE has not received the indication information about presenting the media content sent by the media delivery server, the UE determines not to present the media content.
- the media delivery server before S503b, or after S503b, the media delivery server establishes a media channel according to the call service.
- the call service is a voice call service
- the media delivery server establishes an audio media channel
- the call service is a video call service
- the media delivery server establishes a video media channel.
- the UE may send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server may determine not to deliver media content to the UE during the call service according to the indication information.
- the human-computer interaction environment indicated by the call service human-computer interaction environment indication information may reflect the current state of the user, for example, whether the user is watching the UE screen, whether the user is suitable for watching or listening to media content, and so on.
- the media content is not delivered to the UE, which improves the user experience and can also reduce Or avoid the consumption of data traffic of the UE, and save air interface resources.
- the actions of the UE or the media delivery server in S501-S505a and S503b above can be executed by the processor 401 in the device 40 shown in FIG. Do not make any restrictions.
- S501 includes at least one step in S701-S706.
- S701 The UE detects whether a screen of the UE is turned on.
- the UE may detect whether the screen of the UE is on through the capability of the power management module (PowerManager).
- PowerManager the UE can detect whether the screen of the UE is on through the following program code:
- S702 The UE detects whether an interface of a calling program of the UE is visible.
- the calling program has various life cycle states, for example, an active state (active), a suspended state (paused), a stopped state (stopped) and so on.
- the active state of the calling program can mean that when the Activity corresponding to the calling program is running in the foreground of the screen (that is, at the top of the current task activity stack), it has acquired the focus and can respond to the user's operation. There will be an Activity active at the same time.
- the suspended state of the calling program can mean that the Activity corresponding to the calling program has lost focus, but it is still visible to the user, that is, there is another transparent Activity or a pop-up window such as Toast or AlertDialog on the Activity of the calling program.
- a suspended Activity is still alive, retaining all state and member information and maintaining a connection with the window manager, but it can be killed by the system when the system memory is extremely small.
- the stopped state of the calling program can mean that the Activity corresponding to the calling program is in the stopped state when it is blocked by another Activity.
- the Activity corresponding to the calling program still retains all the state and member information in memory, but it is invisible to the user.
- the Activity corresponding to the calling program is often killed by the system when it is in memory.
- the calling program in the UE can perceive its own life cycle state, and the UE determines whether the interface of the calling program of the UE is visible according to the life cycle state sensed by the calling program. For example, if the life cycle state of the calling program is active, the UE determines that the interface of the calling program is visible; if the life cycle state of the calling program is in the suspended state or stopped state, the UE determines that the interface of the calling program is not visible.
- S703 The UE detects whether the hands-free function of the UE is enabled.
- the UE may detect whether the hands-free function of the UE is enabled through an audio management module (AudioManager).
- AudioManager audio management module
- the UE can detect whether the hands-free function of the UE is turned on through the following program code:
- S704 The UE detects whether a wired headset of the UE is plugged in.
- the UE may detect whether a wired earphone of the UE is plugged in through the audio management module.
- the UE can detect whether the wired headset of the UE is plugged in through the following program code:
- S705 The UE detects whether the wireless headset of the UE is connected.
- the UE may detect whether the wireless earphone of the UE is connected through the audio management module.
- the UE can detect whether the wireless headset of the UE is connected through the following program code:
- S706 The UE detects whether the user is within the visible range of the UE.
- the UE detects whether the user is within the visible range of the UE through a camera of the UE. For example, the UE acquires image information through a front-facing camera of the UE, and the UE recognizes whether the user's eyes may watch the screen according to the image information.
- the image information may include at least one image or a continuous image sequence (such as video) and the like.
- the UE executes the following code through the camera management (CAMERA), turns on the camera, and acquires image information.
- CAMERA camera management
- the UE can turn on the front camera through the API, and take pictures regularly to obtain image information. After acquiring the image information, the UE can identify the face information in the image information based on the face detection technology (such as: whether it contains a complete face, a partial face, no face, and the size of the recognized face when there is a face) . If the UE cannot detect a human face, or the detected human face is too small, it means that the user may be far away from the UE screen, and the probability of the user looking at the screen is low. In this case, the UE determines that the user is not within the visible range of the UE.
- the face detection technology such as: whether it contains a complete face, a partial face, no face, and the size of the recognized face when there is a face
- the UE determines that the user is within the visible range of the UE.
- the user is outside the shooting range of the front camera of the mobile phone, so the UE cannot detect a human face, and the UE may determine that the user is not within the visible range of the UE.
- the user is within the shooting range of the front camera of the mobile phone and the mobile phone is relatively close to the user, so the UE can detect the face and the face is large enough, and the UE can determine that the user is within the visible range of the UE.
- the UE can detect any of the following items: whether the UE's screen is on, whether the interface of the UE's call program is visible, whether the UE's hands-free function is turned on, whether the UE's wired headset is plugged in, whether the UE's wireless Whether the earphone is connected, or whether the user is within the visible range of the UE, and then obtain the call service human-computer interaction environment indication information.
- the actions of the UE in S701-S706 above can be executed by the processor 401 in the device 40 shown in FIG. 4 calling the application program code stored in the memory 403, which is not limited in this embodiment of the present application.
- the UE may send the call service human-computer interaction environment indication information to the media delivery server, so that the media delivery server can determine the media content to be delivered according to the indication information, or make the media delivery server can according to
- the indication information determines that the media content is not delivered to the UE during the call service.
- the UE may also determine the media format by itself, or determine not to present the media content during the call service. In this way, the UE may not send the call service human-computer interaction environment indication information to the media delivery server, so as to protect the user's privacy and improve information security.
- FIG. 9 or FIG. 10 discusses the method for protecting the user's privacy and improve information security.
- the method for delivering media content includes S901-S906a, or, the method for delivering media content includes S901 and S902b.
- S901 The UE determines a call service human-computer interaction environment.
- the UE may be any UE in FIG. 3A or FIG. 3B .
- the UE may be UE 301 or UE 302 in FIG. 3A; or, the UE may be UE 304 or UE 305 in FIG. 3B.
- the call service human-computer interaction environment is the human-computer interaction environment of the user corresponding to the UE during the call service. Specifically, reference may be made to the corresponding description in S501 above, and details are not repeated here.
- the UE determines the human-computer interaction environment of the call service. Taking the call process shown in FIG. 1 as an example, S901 may be executed before S125. Taking the call process shown in FIG. 2 as an example, S901 may be performed before S222.
- the UE determines the call service human-computer interaction environment, including at least one of the following: the UE detects whether the UE's screen is on; or, the UE detects whether the interface of the UE's call program is visible; or, the UE detects that the UE Or, the UE detects whether the wired headset of the UE is plugged in; or, the UE detects whether the wireless headset of the UE is connected; or, the UE detects whether the user is within the visible range of the UE.
- S902a The UE determines the media format according to the human-computer interaction environment of the call service.
- the UE may determine the media format corresponding to the call service human-computer interaction environment according to different call service human-computer interaction environments. Exemplarily, if the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, the UE may determine that the media format is an audio format. If the human-computer interaction environment of the call service is suitable for the user to watch the video played by the UE, the UE may determine that the media format is video with audio. If the call service human-computer interaction environment is suitable for the user to watch the video played by the UE, but the call service human-computer interaction environment is not suitable for the UE to play external voice, then the UE may determine that the media format is a silent video format.
- the UE may determine that the media format is a low-frequency video format. Subsequently, the UE may request the media delivery server for media content conforming to the media format, and present the media content. In this way, on the one hand, the UE can present media content suitable for the user, thereby improving user experience and delivery effect of the media content.
- the UE when the human-computer interaction environment of the call service is suitable for the user to listen to the sound played by the UE, the UE will not request the media delivery server for media content in the form of video, which can reduce or avoid UE data while improving user experience. Traffic consumption, saving air interface resources.
- the UE determines the media format according to the human-computer interaction environment of the call service, including: determining that the media format is an audio format if any of the following environments is detected: it is detected that the screen of the UE is off, or it is detected that the UE’s
- the screen is on, and the call program interface of the UE is not visible, or it is detected that the screen of the UE is on, the wired headset of the UE is plugged in, and the user is not within the visible range of the UE, or it is detected that the screen of the UE is on,
- the wireless headset of the UE is connected and the user is not within the visible range of the UE.
- the UE determines the media format according to the human-computer interaction environment of the call service, including: if any of the following environments is detected, the media format is determined to be in the form of audio and video: it is detected that the UE's screen is lit, the UE's call procedure The interface of the UE is visible, and the wired headset of the UE is plugged in; or, it is detected that the screen of the UE is lit, the interface of the calling program of the UE is visible, and the wireless headset of the UE is connected; or, the screen of the UE is lit, and the calling program of the UE is detected The interface of the UE is visible, the wireless headset of the UE is connected, and the user is within the visible range of the UE; or, it is detected that the screen of the UE is on, the interface of the calling program of the UE is visible, the wired headset of the UE is plugged in, and the user is within the visible range of the UE within sight.
- the description may be made to the description
- the UE determines the media format according to the call service human-computer interaction environment, including: if it is detected that the UE's screen is on, the UE's call program interface is visible, and the UE's hands-free function is turned on, then determine the media format In silent video format.
- the media format In silent video format.
- the UE determines the media format according to the human-computer interaction environment of the call service, including: if any of the following environments is detected, determining that the media format is a bass video format: the insertion of a wired headset of the UE is detected; The UE's wireless headset is connected; or, it is detected that the UE's screen is on, the UE's call program interface is visible, the UE's hands-free function is turned off, the UE's wired headset is not plugged in, the UE's wireless headset is not connected, and the user is on the UE's within sight.
- the description in S503a above and details are not repeated here.
- S903a The UE sends the indication information of the media format to the media delivery server.
- the media delivery server receives the indication information of the media format sent by the UE.
- the media delivery server may be the media delivery server 303 in FIG. 3A. If the UE is UE 304 or UE 305 in FIG. 3B, the media delivery server may be the media delivery server 306 in FIG. 3B.
- the indication information of the media format may include at least 1 bit.
- the at least 1 bit may indicate a UE-determined media format.
- the indication information of the media format includes 1 bit. If the media format determined by the UE is an audio format, the value of the 1 bit is "0", and if the media format determined by the UE is a video format, the value of the 1 bit is "1", and vice versa.
- the indication information of the media format includes 2 bits. If the media format determined by the UE is an audio format, the value of the 2 bits is "00". If the media format determined by the UE is a silent video format, the value of the 2 bits is "01”. If the media format determined by the UE is If the audio and video format is present, the value of the 2 bits is "10", and if the media format determined by the UE is a bass video format, the value of the 2 bits is "11".
- the functions of the media delivery server may be deployed centrally on one physical device, or may be deployed on multiple physical devices.
- the UE sends media form indication information to the media application module 3032 .
- the media application module 3032 receives the indication information of the media format sent by the UE.
- the media application module 3032 may send media form indication information to the media decision module 3031 . If the functions of the media delivery server 303 are deployed on multiple physical devices, the UE sends media form indication information to the Media AS.
- the Media AS receives the indication information of the media format sent by the UE. Subsequently, the Media AS may send the indication information of the media form to the media decision server. Taking the process shown in Figure 1 as an example, the Media AS may send the indication information of the media form to the media decision server through the request message in S125, that is, the indication information of the media form may be included in the request message in S125.
- the UE sends media form indication information to the media decision module 3061 .
- the media decision module 3061 receives the indication information of the media format sent by the UE.
- the UE sends the indication information of the media format to the media decision server.
- the media decision server receives the indication information of the media format sent by the UE.
- the UE may send the media format indication information to the media decision server through the request message in S222, that is, the media format indication information may be included in the request message in S222.
- the media delivery server determines the media content conforming to the media format according to the indication information of the media format.
- the media delivery server determines that the media content in the audio format is the media content that conforms to the media format. If the indication information of the media format indicates that the media format determined by the UE is a silent video format, the media delivery server determines that the media content in the silent video format is the media content that conforms to the media format. If the indication information of the media format indicates that the media format determined by the UE is in the audio and video format, the media delivery server determines that the media content in the audio and video format conforms to the media format. If the indication information of the media format indicates that the media format determined by the UE is a bass video format, then the media delivery server determines that the media content in the bass video format is the media content that conforms to the media format.
- the media delivery server sends the media content conforming to the media format to the UE.
- the UE receives the media content conforming to the media format sent by the media delivery server.
- the media delivery server sends the media content conforming to the media format to the UE through the media channel.
- the media channel For the introduction of the media channel, reference may be made to the above-mentioned explanations of related technical terms involved in the embodiments of the present application, and details are not repeated here.
- the media delivery server may establish the media channel according to the call service. For example, if the call service is a voice call service, the media delivery server establishes an audio media channel, and if the call service is a video call service, the media delivery server establishes a video media channel. Subsequently, after the media delivery server determines the media content conforming to the media format (ie after S904a), if the media channel determined by the media delivery server can transmit the media content conforming to the media format, the media delivery server sends the media content conforming to the media format to the UE through the media channel. form of media content. If the media channel determined by the media delivery server cannot transmit the media content conforming to the media format, the media delivery server switches the media channel, and sends the media content conforming to the media format to the UE through the switched media channel.
- the call service is a voice call service
- the media delivery server establishes an audio media channel
- the media delivery server if the call service is a video call service, the media delivery server establishes
- the media delivery server may establish the media channel according to the media format determined by the UE. For example, if the media format determined by the UE is an audio format, the media distribution server establishes an audio media channel; if the media format determined by the UE is a video format, the media distribution server establishes a video media channel.
- the UE communicates with other The UE performs a calling service. If the media channel used to transmit media content conforming to the media format cannot be used for call services, the UE switches the media channel, and performs call services with other UEs through the switched media channel.
- the media delivery server is the media delivery server 303 in FIG. 3A, and the functions of the media delivery server are centrally deployed on one physical device, then the media decision module 3031 determines that the media delivery server conforms to the media form
- the media application module 3032 sends the info message to the media resource management module 3033 to control the media resource
- the management module 3033 delivers media content that conforms to the media format to the UE.
- the media delivery server is the media delivery server 303 in FIG. 3A, and the functions of the media delivery server are deployed on multiple physical devices
- the media decision server determines the media content conforming to the media form
- the Media AS After receiving the information of the media content conforming to the media form, the Media AS sends an info message to the MRS to control the MRS to deliver the media content conforming to the media form to the UE.
- S905a may correspond to the above S126-S127.
- the information of the media content conforming to the media format may indicate the media content to be delivered.
- the media decision module 3061 determines that the media delivery server conforms to the media form
- the UE sends the address of the media content in the media format to the UE.
- the UE requests the media content in the media format from the media resource management module 3062, so that the media resource management module 3062 Publish the media content conforming to the media format to the UE.
- the media decision-making module 3061 determines the media content that conforms to the media format, it controls the media resource management module 3062 to deliver media content that conforms to the media format to the UE.
- the media decision-making module 3061 controls the media resource management module 3062 to send the above request media A response message to a content request message, the response message including media content conforming to the media format.
- the media decision server determines the After receiving the media content, send the address of the media content conforming to the media format to the UE. After receiving the address of the media content conforming to the media format, the UE requests the MRS for the media content conforming to the media format, so that the MRS delivers the media conforming to the media format to the UE. content.
- S905a may correspond to the above S224-S226.
- S906a The UE presents the media content by calling a program unit related to the program.
- the UE can determine the human-computer interaction environment of the call service, determine the media format according to the human-computer interaction environment of the call service, and indicate the media format to the media delivery server, so that the media delivery server can determine that the media format matches the media format according to the media format. form of media content, and send the media content to the UE.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media format determined according to the human-computer interaction environment of the call service is more in line with the needs of the user, and can improve user experience and delivery effect of media content.
- S902a-S906a may also be replaced with S902b.
- S902b The UE determines not to present media content during the call service according to the call service man-machine interaction environment.
- the UE may determine whether to present media content during the call service according to different call service man-machine interaction environments. Exemplarily, if the call service man-machine interaction environment is suitable for delivering media content, the UE may determine to present the media content during the call service. If the human-computer interaction environment of the call service is not suitable for delivering media content, the UE may determine not to present the media content during the call service. In this way, the UE can not present the media content when the human-computer interaction environment of the call service is not suitable for delivering the media content, which improves the user experience, and can also reduce or avoid the consumption of the UE's data traffic.
- the UE determines not to present media content during the call service according to the human-computer interaction environment of the call service, including: if any of the following environments is detected, determine that the media content is not presented during the call service: The UE's screen is off; or, it is detected that the UE's screen is on, and the UE's call program interface is invisible; or, it is detected that the UE's screen is on, the UE's wired headset is plugged in, and the user is not within the visible range of the UE ; or, it is detected that the screen of the UE is on, the wireless headset of the UE is connected, and the user is not within the visible range of the UE.
- the description in S503b above and details are not repeated here.
- the UE before S902b or after S902b, the UE establishes a media channel according to the call service.
- the call service is a voice call service
- the UE establishes an audio media channel
- the call service is a video call service
- the UE establishes a video media channel.
- the UE may determine the call service human-computer interaction environment, and determine not to present media content during the call service according to the call service human-computer interaction environment.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, when the UE is not suitable for presenting media content, for example, the user does not look at the screen, or the user is not suitable for watching and listening to the media content, the media content is not presented, which improves user experience.
- the UE may not send the call service human-computer interaction environment indication information to the media delivery server, so as to protect user privacy and improve information security.
- the actions of the UE or the media delivery server in S901-S906a and S902b above can be executed by the processor 401 in the device 40 shown in FIG. Do not make any restrictions.
- the media content delivery method includes S1001-S1004a, or, the media content delivery method includes S1001-S1002 and S1003b.
- the UE acquires information about media content.
- the media content information may include multiple media contents.
- the media forms corresponding to the multiple media contents include multiple types.
- the media content information includes 6 media contents, wherein 2 media contents are in audio format, 2 media contents are in audio and video format, and 2 media contents are in silent video format.
- the UE receives the media content information sent by the media delivery server. That is to say, the media delivery server can send the information of the media content to the UE in advance. In this way, after determining the media format, the UE can present the media content in the media content information that conforms to the media format.
- the UE determines the call service human-computer interaction environment.
- S1003a The UE determines the media format according to the human-computer interaction environment of the call service.
- S1004a The UE presents the media content in the media content information that conforms to the media form by calling the program unit related to the program.
- the UE may determine the media content conforming to the media format in the media content information.
- the media format determined by the UE is an audio format
- the UE determines that the media content in the audio format in the media content information is the media content that conforms to the media format.
- the media format determined by the UE is a silent video format
- the UE determines that the media content in the silent video format in the media content information is the media content that conforms to the media format.
- the media format determined by the UE is in the form of audio and video
- the UE determines that the media content in the form of audio and video in the media content information is the media content in compliance with the media format.
- the UE determines that the media content in the low-voice video format in the media content information is the media content that conforms to the media format. Subsequently, the UE presents the media content conforming to the media format by calling the program unit related to the program. Specifically, reference may be made to the corresponding introduction in S505a above, and details are not repeated here.
- the UE may first obtain the information of the media content, determine the call service human-computer interaction environment, and then determine the media form according to the call service human-computer interaction environment. In this way, after determining the media form, the UE can present the media content in the media content information that conforms to the media form.
- the human-computer interaction environment of the call service can reflect the current state of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on. Therefore, the media format determined according to the human-computer interaction environment of the call service is more in line with the needs of the user, and can improve user experience and delivery effect of media content.
- the UE determines the media format, it does not need to request the media content from the media delivery server, but directly determines the media content that meets the media format locally and presents the media content, which can present the media content in time, reducing the UE The time from the media form to the UE presenting the media content is determined. Moreover, the UE does not need to send the call service human-computer interaction environment indication information to the media delivery server, which protects the user's privacy and improves information security.
- S1003a-S1004a may also be replaced with S1003b.
- S1003b The UE determines not to present media content during the call service according to the call service man-machine interaction environment.
- the UE can first obtain the information of the media content, determine the human-computer interaction environment of the call service, and determine not to present the media content during the call service according to the human-computer interaction environment of the call service.
- the human-computer interaction environment of the call service may reflect the current status of the user, for example, whether the user is looking at the screen of the UE, whether the user is suitable for watching or listening to media content, and so on.
- the UE when the UE is not suitable for presenting media content, for example, the user does not look at the screen, or the user is not suitable for watching and listening to the media content, the media content is not presented, which improves the user experience and reduces or avoids the UE consumption of data traffic and save air interface resources. Moreover, the UE does not need to send the call service human-computer interaction environment indication information to the media delivery server, which protects the user's privacy and improves information security.
- the actions of the UE or the media delivery server in S1001-S1004a and S1003b above can be executed by the processor 401 in the device 40 shown in FIG. Do not make any restrictions.
- the above-mentioned media delivery server or UE includes corresponding hardware structures and/or software modules for performing various functions.
- the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present application.
- the embodiment of the present application may divide the functional modules of the media delivery server or UE according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
- the above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.
- FIG. 11 shows a schematic structural diagram of a media delivery server 110 .
- the media delivery server 110 includes a transceiver module 1101 and a processing module 1102 .
- the transceiver module 1101 may also be referred to as a transceiver unit to implement a transceiver function, for example, it may be a transceiver circuit, a transceiver, a transceiver or a communication interface.
- the media delivery server 110 is used to implement the functions of the media delivery server in the above method embodiments.
- the media delivery server 110 is, for example, the media delivery server described in the embodiment shown in FIG. 5 or the embodiment shown in FIG. 7 .
- the transceiver module 1101 is configured to receive the call service human-computer interaction environment indication information sent by the UE, the call service human-computer interaction environment indication information indicating the user's human-computer interaction environment corresponding to the UE during the call service.
- the processing module 1102 is configured to determine the media content to be delivered according to the call service human-computer interaction environment indication information.
- the transceiver module 1101 is further configured to deliver the media content to be delivered to the UE during the call service.
- the transceiver module 1101 is configured to receive call service human-computer interaction environment indication information sent by the UE, where the call service human-computer interaction environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service.
- the processing module 1102 is configured to determine not to deliver media content to the UE during the call service according to the indication information of the call service human-computer interaction environment.
- the media delivery server 110 can take the form shown in FIG. 4 .
- the processor 401 in FIG. 4 may invoke the computer-executed instructions stored in the memory 403, so that the media delivery server 110 executes the methods described in the foregoing method embodiments.
- the function/implementation process of the transceiver module 1101 and the processing module 1102 in FIG. 11 can be implemented by the processor 401 in FIG. 4 invoking computer-executed instructions stored in the memory 403 .
- the function/implementation process of the processing module 1102 in FIG. 11 can be realized by calling the computer execution instructions stored in the memory 403 by the processor 401 in FIG. 4 , and the function/implementation process of the transceiver module 1101 in FIG. 4 in the communication interface 404 to achieve.
- FIG. 12 shows a schematic structural diagram of a UE 120.
- UE 120 includes a processing module 1201 and a transceiver module 1202.
- the transceiver module 1202 may also be referred to as a transceiver unit to implement a transceiver function, for example, it may be a transceiver circuit, a transceiver, a transceiver or a communication interface.
- the UE 120 is configured to implement the functions of the UE in the foregoing method embodiments.
- UE 120 is, for example, the UE described in the embodiment shown in FIG. 5 or the embodiment shown in FIG. 7 .
- the processing module 1201 is configured to obtain indication information of a call service human-computer interaction environment, and the call service human-computer interaction environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service.
- the transceiver module 1202 is configured to send the call service human-computer interaction environment indication information to the media delivery server.
- the transceiver module 1202 is also configured to receive the media content to be delivered sent by the media delivery server.
- the processing module 1201 is further configured to present the media content to be delivered by calling a program unit related to the program.
- the processing module 1201 is configured to acquire call service human-computer interaction environment indication information, where the call service human-computer interaction environment indication information indicates the human-computer interaction environment of the user corresponding to the UE during the call service.
- the transceiver module 1202 is configured to send the call service human-computer interaction environment indication information to the media delivery server.
- the processing module 1201 is further configured to determine not to present media content.
- exemplary, UE 120 is, for example, the UE described in the embodiment shown in FIG. 9 .
- the processing module 1201 is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is the human-computer interaction environment of the user corresponding to the UE during the call service.
- the processing module 1201 is further configured to determine the media form according to the human-computer interaction environment of the call service.
- the transceiver module 1202 is configured to send the indication information of the media form to the media delivery server.
- the transceiver module 1202 is also configured to receive the media content conforming to the media format sent by the media delivery server.
- the processing module 1201 is further configured to present the media content by calling a program unit related to the program.
- the processing module 1201 is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is a human-computer interaction environment of a user corresponding to the UE during a call service.
- the processing module 1201 is further configured to determine not to present media content during the call service according to the call service man-machine interaction environment.
- exemplary, UE 120 is, for example, the UE described in the embodiment shown in FIG. 10 .
- the transceiver module 1202 is used for obtaining information of media content.
- the processing module 1201 is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is the human-computer interaction environment of a user corresponding to the UE during a call service.
- the processing module 1201 is further configured to determine the media form according to the human-computer interaction environment of the call service, and present the media content in accordance with the media form among the information of the media content through the program unit related to the call program.
- the transceiver module 1202 is configured to acquire information about media content.
- the processing module 1201 is configured to determine a call service human-computer interaction environment, where the call service human-computer interaction environment is the human-computer interaction environment of a user corresponding to the UE during a call service.
- the processing module 1201 is further configured to determine not to present media content during the call service according to the call service man-machine interaction environment.
- the UE 120 can take the form shown in FIG. 4 .
- the processor 401 in FIG. 4 may invoke the computer-executed instructions stored in the memory 403, so that the UE 120 executes the methods described in the foregoing method embodiments.
- the functions/implementation process of the processing module 1201 and the transceiver module 1202 in FIG. 12 may be realized by calling the computer-executed instructions stored in the memory 403 by the processor 401 in FIG. 4 .
- the function/implementation process of the processing module 1201 in FIG. 12 can be realized by calling the computer execution instructions stored in the memory 403 by the processor 401 in FIG. 4, and the function/implementation process of the transceiver module 1202 in FIG. 4 in the communication interface 404 to achieve.
- one or more of the above modules or units may be implemented by software, hardware or a combination of both.
- the software exists in the form of computer program instructions and is stored in the memory, and the processor can be used to execute the program instructions and realize the above method flow.
- the processor can be built into a SoC (system on a chip) or ASIC, or it can be an independent semiconductor chip.
- the core of the processor is used to execute software instructions for calculation or processing, and can further include necessary hardware accelerators, such as field programmable gate array (field programmable gate array, FPGA), PLD (programmable logic device) , or a logic circuit that implements a dedicated logic operation.
- the hardware can be CPU, microprocessor, digital signal processing (digital signal processing, DSP) chip, microcontroller unit (microcontroller unit, MCU), artificial intelligence processor, ASIC, Any one or any combination of SoC, FPGA, PLD, dedicated digital circuit, hardware accelerator or non-integrated discrete device, which can run necessary software or not depend on software to execute the above method flow.
- DSP digital signal processing
- MCU microcontroller unit
- ASIC artificial intelligence processor
- an embodiment of the present application further provides a chip system, including: at least one processor and an interface, the at least one processor is coupled to the memory through the interface, and when the at least one processor executes the computer program or instruction in the memory When, the method in any one of the above method embodiments is executed.
- the chip system further includes a memory.
- the system-on-a-chip may consist of a chip, or may include a chip and other discrete devices, which is not specifically limited in this embodiment of the present application.
- the embodiment of the present application further provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be completed by computer programs to instruct related hardware, and the program can be stored in the above computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments .
- the computer-readable storage medium may be the internal storage unit of the media delivery server or the UE in any of the foregoing embodiments, for example, the hard disk or memory of the media delivery server or the UE.
- the above-mentioned computer-readable storage medium may also be an external storage device of the above-mentioned media delivery server or UE, such as a plug-in hard disk equipped on the above-mentioned media delivery server or UE, a smart memory card (smart media card, SMC), a secure digital (secure digital, SD) card, flash card (flash card), etc. Further, the above-mentioned computer-readable storage medium may also include both an internal storage unit of the above-mentioned media delivery server or UE and an external storage device.
- the above-mentioned computer-readable storage medium is used for storing the above-mentioned computer program and other programs and data required by the above-mentioned media delivery server or UE.
- the computer-readable storage medium described above can also be used to temporarily store data that has been output or will be output.
- the embodiment of the present application further provides a computer program product. All or part of the processes in the above method embodiments can be completed by computer programs instructing related hardware, and the programs can be stored in the above computer program products. When the programs are executed, they can include the processes of the above method embodiments.
- An optional embodiment of the present application further provides a computer instruction. All or part of the procedures in the above method embodiments may be completed by computer instructions to instruct related hardware (such as computers, processors, access network devices, mobility management network elements or session management network elements, etc.).
- the program may be stored in the above-mentioned computer-readable storage medium or in the above-mentioned computer program product.
- the disclosed devices and methods may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods.
- multiple units or components can be Incorporation or may be integrated into another device, or some features may be omitted, or not implemented.
- the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
- the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may be one physical unit or multiple physical units, that is, it may be located in one place, or may be distributed to multiple different places . Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Telephonic Communication Services (AREA)
Abstract
本申请公开了媒体内容的投放方法及设备,涉及通信领域。该方法中,媒体投放服务器可以接收用户设备(user equipment,UE)发送的用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息。媒体投放服务器接收到该指示信息后,可以根据该指示信息确定在呼叫业务进行期间是否向UE投放媒体内容。或者,媒体投放服务器接收到该指示信息后,可以根据该指示信息确定待投放媒体内容,并在呼叫业务进行期间向UE投放该待投放媒体内容。上述指示信息可以反映呼叫业务进行期间、用户的人机交互环境,所以根据该指示信息确定是否投放媒体内容,或者确定待投放媒体内容,更符合用户的需求,可以提高用户体验和媒体内容的投放效果。
Description
“本申请要求于2021年7月23日提交国家知识产权局、申请号为202110838469.2、发明名称为“媒体内容的投放方法及设备”的专利申请的优先权,其全部内容通过引用结合在本申请中”。
本申请涉及通信领域,尤其涉及媒体内容的投放方法及设备。
随着移动通信技术的发展,长期演进语音承载(voice over long term evolution,VOLTE)技术应运而生。VOLTE可以承载于第四代(4th generation,4G)或第五代(5th generation,5G)网络之上,基于英特网协议多媒体子系统(internet protocol multimedia subsystem,IMS)实现语音控制,向用户设备(user equipment,UE)提供高清语音的更短接续。
为了给UE对应的用户展示丰富的媒体内容,例如广告或促销等信息,可以在用户使用VOLTE技术通话时,向UE投放媒体内容。但是在向UE投放媒体内容时,仅根据用户的标签信息确定要投放的媒体内容,仍具有一定的盲目性,会影响用户体验和媒体内容的投放效果。
发明内容
本申请提供媒体内容的投放方法及设备,可以根据呼叫业务进行期间UE对应的用户的人机交互环境确定在呼叫业务进行期间是否向UE投放媒体内容,或者确定在呼叫业务进行期间向UE投放的媒体内容,提升了用户体验和媒体内容的投放效果。
为达到上述目的,本申请的实施例采用如下技术方案:
第一方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于媒体投放服务器,该方法包括:接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境;根据呼叫业务人机交互环境指示信息确定待投放媒体内容,且在呼叫业务进行期间向UE投放待投放媒体内容。
基于上述方法,媒体投放服务器可以接收UE发送的呼叫业务人机交互环境指示信息,根据该指示信息确定待投放媒体内容。其中,呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境指示信息确定的待投放媒体内容更符合用户的需求,媒体投放服务器将符合用户需求的媒体内容投放给用户可以提高用户体验和媒体内容的投放效果。
或者,第一方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于媒体投放服务器,该方法包括:接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交 互环境;根据该呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容。
基于上述方法,媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容。其中,呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,媒体投放服务器可以在不适合向UE投放媒体内容的情况下,不向UE投放媒体内容,提高了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。
一种可能的实现方式,人机交互环境包含以下任意一项或任意组合:UE的屏幕是否点亮、UE的呼叫程序的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内。基于上述方法,可以根据UE的屏幕是否点亮、UE的呼叫程序的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内确定用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等,进而可以确定待投放媒体内容,或者确定在呼叫业务进行期间不向UE投放媒体内容。
一种可能的实现方式,根据该呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:根据该呼叫业务人机交互环境指示信息确定媒体形式,该媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式,该低音视频形式的媒体内容的缺省音量大于0且小于预设阈值;确定符合该媒体形式的媒体内容为该待投放媒体内容。基于上述方法,可以根据媒体形式确定待投放媒体内容,以提高媒体内容的投放效果。
一种可能的实现方式,根据该呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定该媒体形式为音频形式:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。基于上述方法,可以在呼叫业务人机交互环境适合用户听UE播放的声音的情况下,确定媒体形式为音频形式。在这种情况下,媒体投放服务器不会向UE投放视频形式的媒体内容,在提升用户体验的同时还可以减少或避免UE的数据流量的消耗、节约空口资源。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定该媒体形式为有声视频形式:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在该UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、 UE的有线耳机插入、且用户在该UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,则媒体投放服务器可以确定媒体形式为有声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放外音,则媒体投放服务器可以确定媒体形式为无声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定媒体形式为低音视频形式:呼叫业务人机交互环境指示信息指示UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放的外音过高,则媒体投放服务器可以确定媒体形式为低音视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:若以下任意一项成立,则确定待投放媒体内容为通过语音传递媒体信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在该UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户听UE播放的声音,则媒体投放服务器可以确定待投放媒体内容为通过语音传递媒体信息的媒体内容。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:若以下任意一项成立,则确定待投放媒体内容为通过图像传递信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能关闭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,则媒体投放服务器可以确定待投放媒体内容为通过图像传递媒体信息的媒体内容。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:根据呼叫业务人机交互环境指示信息确定该用户的群体类型;根据群体类型确定待投放媒体内容。基于上述方法,向UE投放适合用户所属的群体的媒体内容,提升用户体验和媒体内容的投放效果。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向该UE投放媒体内容,包括:若以下任意一项成立,则确定在呼叫业务进行期间不向UE投放媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭; 或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。基于上述方法,可以在呼叫业务人机交互环境不适合投放媒体内容的情况下,不向UE投放媒体内容。
一种可能的实现方式,接收UE发送的呼叫业务人机交互环境指示信息,包括:接收UE发送的SIP-info消息,该SIP-info消息包括呼叫业务人机交互环境指示信息。基于上述方法,UE可以通过SIP-info消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,接收UE发送的呼叫业务人机交互环境指示信息,包括:接收UE发送的SIP-Notifiication消息,该SIP-Notifiication消息包括呼叫业务人机交互环境指示信息;在接收UE发送的呼叫业务人机交互环境指示信息之前,该方法还包括:向UE发送订阅消息,该订阅消息用于订阅该呼叫业务人机交互环境指示信息。基于上述方法,媒体投放服务器可以通过订阅消息订阅呼叫业务人机交互环境指示信息,UE可以通过SIP-Notifiication消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,接收UE发送的呼叫业务人机交互环境指示信息,包括:接收UE发送的请求媒体内容的请求消息,请求媒体内容的请求消息包括该呼叫业务人机交互环境指示信息。基于上述方法,UE可以通过请求媒体内容的请求消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,在呼叫业务进行期间向UE投放该待投放媒体内容,包括:在呼叫业务进行期间向UE发送请求消息的响应消息,响应消息包括待投放媒体内容。基于上述方法,媒体投放服务器可以通过请求消息的响应消息向UE投放待投放媒体内容。
一种可能的实现方式,若根据该呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容,该方法还包括:向UE发送请求消息的响应消息,响应消息包括第一指示信息,第一指示信息用于指示在呼叫业务进行期间不向UE投放媒体内容。基于上述方法,媒体投放服务器在确定在呼叫业务进行期间不向UE投放媒体内容的情况下,可以通过第一指示信息指示不向UE投放媒体内容,使得UE确定不需要接收待投放媒体内容。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定待投放媒体内容之后,该方法还包括:根据待投放媒体内容建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,音频媒体通道用于传输音频形式的媒体内容,和/或,音频媒体通道用于传输呼叫业务进行期间、呼叫业务对应的UE之间的语音信息,视频媒体通道用于传输视频形式的媒体内容;在呼叫业务进行期间向UE投放该待投放媒体内容,包括:在呼叫业务进行期间通过媒体通道,向UE投放该待投放媒体内容。基于上述方法,媒体投放服务器可以通过媒体通道向UE投放待投放媒体内容。
一种可能的实现方式,根据该呼叫业务人机交互环境指示信息确定待投放媒体内 容之前,该方法还包括:根据呼叫业务建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,音频媒体通道用于传输音频形式的媒体内容,和/或,音频媒体通道用于传输该呼叫业务进行期间、呼叫业务对应的UE之间的语音信息,视频媒体通道用于传输视频形式的媒体内容。基于上述方法,媒体投放服务器可以在确定待投放内容之前就建立媒体通道,用于UE之间的呼叫业务。
一种可能的实现方式,根据呼叫业务人机交互环境指示信息确定待投放媒体内容之后,该方法还包括:若媒体通道不能传输该待投放媒体内容,则切换媒体通道;在呼叫业务进行期间向UE投放该待投放媒体内容,包括:在呼叫业务进行期间通过切换后的媒体通道,向UE投放该待投放媒体内容。基于上述方法,在建立的媒体通道不合适的情况下,可以切换到合适的媒体通道,再通过切换后的媒体通道投放待投放媒体内容。
一种可能的实现方式,若媒体通道能够传输待投放媒体内容,在呼叫业务进行期间向UE投放该待投放媒体内容,包括:在呼叫业务进行期间通过媒体通道,向UE投放该待投放媒体内容。基于上述方法,在建立的媒体通道合适的情况下,可以通过建立好的媒体通道投放待投放媒体内容。
一种可能的实现方式,若根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容,该方法还包括:根据该呼叫业务建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,音频媒体通道用于传输音频形式的媒体内容,和/或,音频媒体通道用于传输呼叫业务进行期间、呼叫业务对应的UE之间的语音信息,视频媒体通道用于传输视频形式的媒体内容。基于上述方法,媒体投放服务器可以建立媒体通道,用于UE之间的呼叫业务。
第二方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:获取呼叫业务人机交互环境指示信息,呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境;向媒体投放服务器发送呼叫业务人机交互环境指示信息;接收媒体投放服务器发送的待投放媒体内容,且通过呼叫程序相关的程序单元呈现该待投放媒体内容。
基于上述方法,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器,使得媒体投放服务器可以根据该指示信息确定待投放媒体内容。其中,呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境指示信息确定的待投放媒体内容更符合用户的需求,UE呈现符合用户需求的媒体内容可以提高用户体验和媒体内容的投放效果。
或者,第二方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:获取呼叫业务人机交互环境指示信息,呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境;向媒体投放服务器发送呼叫业务人机交互环境指示信息;确定不呈现媒体内容。
基于上述方法,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器,使得媒体投放服务器可以根据该指示信息确定在呼叫业务进行期间不向UE投放媒体内容。其中,呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前 的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,媒体投放服务器可以在不适合向UE投放媒体内容的情况下,不向UE投放媒体内容,提高了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。
一种可能的实现方式,获取呼叫业务人机交互环境指示信息,包括以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在该UE的可视范围内。基于上述方法,UE可以检测以下任一项:UE的屏幕是否点亮、UE的呼叫程序的的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内,进而获取呼叫业务人机交互环境指示信息。
一种可能的实现方式,向媒体投放服务器发送呼叫业务人机交互环境指示信息,包括:向媒体投放服务器发送SIP-info消息,该SIP-info消息包括该呼叫业务人机交互环境指示信息。基于上述方法,UE可以通过SIP-info消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,向媒体投放服务器发送呼叫业务人机交互环境指示信息,包括:向媒体投放服务器发送SIP-Notifiication消息,SIP-Notifiication消息包括呼叫业务人机交互环境指示信息;向媒体投放服务器发送呼叫业务人机交互环境指示信息之前,该方法还包括:接收来自媒体投放服务器的订阅消息,订阅消息用于订阅呼叫业务人机交互环境指示信息。基于上述方法,UE可以基于媒体投放服务器的订阅消息,通过SIP-Notifiication消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,向媒体投放服务器发送呼叫业务人机交互环境指示信息,包括:向媒体投放服务器发送请求媒体内容的请求消息,该请求媒体内容的请求消息包括该呼叫业务人机交互环境指示信息。基于上述方法,UE可以通过请求媒体内容的请求消息向媒体投放服务器发送呼叫业务人机交互环境指示信息。
一种可能的实现方式,接收媒体投放服务器发送的待投放媒体内容,包括:接收媒体投放服务器发送的请求消息的响应消息,响应消息包括待投放媒体内容。基于上述方法,UE可以通过请求消息的响应消息接收待投放媒体内容。
一种可能的实现方式,确定不呈现媒体内容,包括:接收媒体投放服务器发送的第一指示信息,第一指示信息用于指示在呼叫业务进行期间不向UE投放媒体内容;根据第一指示信息确定不呈现媒体内容;或者,在预设时间范围内未接收到媒体投放服务器发送的关于呈现媒体内容的指示信息,确定不呈现媒体内容。基于上述方法,UE可以通过多种方式确定不呈现媒体内容。
一种可能的实现方式,若呼叫业务人机交互环境指示信息包括在请求媒体内容的请求消息中,则接收媒体投放服务器发送的第一指示信息,包括:接收媒体投放服务器发送的请求消息的响应消息,响应消息包括该第一指示信息。基于上述方法,UE可以通过请求消息的响应消息接收第一指示信息。
第三方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:确定呼叫业务人机交互环境,呼叫业务人机交互环境为在呼叫业务进行 期间UE对应的用户的人机交互环境;根据呼叫业务人机交互环境确定媒体形式;向媒体投放服务器发送媒体形式的指示信息;接收媒体投放服务器发送的符合媒体形式的媒体内容,且通过呼叫程序相关的程序单元呈现该媒体内容。
基于上述方法,UE可以根据呼叫业务人机交互环境确定媒体形式,并向媒体投放服务器指示该媒体形式,使得媒体投放服务器可以向UE投放符合媒体形式的媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境确定的媒体形式更符合用户的需求,可以提高用户体验和媒体内容的投放效果。另外,与第二方面提供的方法相比,UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,以保护用户的隐私,提高信息安全。
或者,第三方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:确定呼叫业务人机交互环境,呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境;根据呼叫业务人机交互环境确定在该呼叫业务进行期间不呈现媒体内容。
基于上述方法,UE可以根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,可以在UE不适合呈现媒体内容的情况下,例如,用户未注视屏幕、或者用户不适合观看和听媒体内容的情况下,不呈现媒体内容,提高了用户体验。另外,与第二方面提供的方法相比,UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,以保护用户的隐私,提高信息安全。
一种可能的实现方式,确定呼叫业务人机交互环境,包括以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在UE的可视范围内。基于上述方法,UE可以检测以下任一项:UE的屏幕是否点亮、UE的呼叫程序的的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内,进而确定呼叫业务人机交互环境。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定该媒体形式为音频形式:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在该UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。基于上述方法,UE可以在呼叫业务人机交互环境适合用户听UE播放的声音的情况下,确定媒体形式为音频形式,并向媒体投放服务器指示该媒体形式。在这种情况下,媒体投放服务器不会向UE投放视频形式的媒体内容,在提升用户体验的同时还可以减少或避免UE的数据流量的消耗、节约空口资源。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为有声视频形式:检测到UE的屏幕点亮、UE的呼 叫程序的界面可见、且UE的有线耳机插入;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,则UE可以确定媒体形式为有声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放外音,则UE可以确定媒体形式为无声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为低音视频形式:检测到UE的有线耳机插入;或者,检测到UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放的外音过高,则UE可以确定媒体形式为低音视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容,包括:若检测到以下任一环境,则确定在呼叫业务进行期间不呈现媒体内容:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在该UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。基于上述方法,UE可以在呼叫业务人机交互环境不适合投放媒体内容的情况下,不呈现媒体内容。
第四方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:获取媒体内容的信息;确定呼叫业务人机交互环境,呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境;根据呼叫业务人机交互环境确定媒体形式,并通过呼叫程序相关的程序单元呈现该媒体内容的信息中,符合该媒体形式的媒体内容。
基于上述方法,UE可以先获取媒体内容的信息,确定呼叫业务人机交互环境,再根据该呼叫业务人机交互环境确定媒体形式。如此,UE可以在确定了媒体形式后,即可将媒体内容的信息中、符合媒体形式的媒体内容呈现出来。一方面,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境确定的媒体形式更符合用户的需求,可以提高用户体验和媒体内容的投放效果。另一方面,UE在确定了媒体形式后,不需要向媒体投放服务器请求媒体内容,直接在本地确定符合媒体形式的媒体内容,并呈现该媒体内容即可,可以及时呈现媒体内容,缩减了UE确定了媒体形式到UE呈现媒体内容的时间。而且与第二方面提供的方法相比,UE可以不向媒 体投放服务器发送呼叫业务人机交互环境指示信息,保护了用户的隐私,提高了信息安全。
或者,第四方面,本申请实施例提供一种媒体内容的投放方法,该方法可以应用于UE,该方法包括:获取媒体内容的信息;确定呼叫业务人机交互环境,呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境;根据该呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
基于上述方法,UE可以先获取媒体内容的信息,确定呼叫业务人机交互环境,根据该呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,可以在UE不适合呈现媒体内容的情况下,例如,用户未注视屏幕、或者用户不适合观看和听媒体内容的情况下,不呈现媒体内容,提高了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。而且与第二方面提供的方法相比,UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,保护了用户的隐私,提高了信息安全。
一种可能的实现方式,确定呼叫业务人机交互环境,包括以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在该UE的可视范围内。基于上述方法,UE可以检测以下任一项:UE的屏幕是否点亮、UE的呼叫程序的的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内,进而确定呼叫业务人机交互环境。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为音频形式:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在该UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。基于上述方法,UE可以在呼叫业务人机交互环境适合用户听UE播放的声音的情况下,确定媒体形式为音频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为有声视频形式:检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在该UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,则UE可以确定媒体形式为有声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放外音,则UE可以确定媒体形式 为无声视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为低音视频形式:检测到UE的有线耳机插入;或者,检测到UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。基于上述方法,若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放的外音过高,则UE可以确定媒体形式为低音视频形式。
一种可能的实现方式,根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容,包括:若检测到以下任一环境,则确定在呼叫业务进行期间不呈现媒体内容:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。基于上述方法,UE可以在呼叫业务人机交互环境不适合投放媒体内容的情况下,不呈现媒体内容。
第五方面,本申请实施例提供一种媒体投放服务器,该媒体投放服务器包括:收发模块和处理模块;收发模块,用于接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在该呼叫业务进行期间该UE对应的用户的人机交互环境;处理模块,用于根据该呼叫业务人机交互环境指示信息确定待投放媒体内容;收发模块,还用于在该呼叫业务进行期间向该UE投放该待投放媒体内容。
或者,第五方面,本申请实施例提供一种媒体投放服务器,该媒体投放服务器包括:收发模块和处理模块;收发模块,用于接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在该呼叫业务进行期间该UE对应的用户的人机交互环境;处理模块,用于根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容。
一种可能的实现方式,人机交互环境包含以下任意一项或任意组合:UE的屏幕是否点亮、UE的呼叫程序的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于根据呼叫业务人机交互环境指示信息确定媒体形式,媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式,低音视频形式的媒体内容的缺省音量大于0且小于预设阈值;处理模块,还具体用于确定符合该媒体形式的媒体内容为待投放媒体内容。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定媒体形式为音频形式:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定媒体形 式为有声视频形式:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定媒体形式为低音视频形式:呼叫业务人机交互环境指示信息指示UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定待投放媒体内容为通过语音传递媒体信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定待投放媒体内容为通过图像传递信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能关闭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启。
一种可能的实现方式,处理模块,具体用于根据呼叫业务人机交互环境指示信息确定用户的群体类型;根据群体类型确定该待投放媒体内容。
一种可能的实现方式,处理模块,具体用于若以下任意一项成立,则确定在呼叫业务进行期间不向UE投放媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。
一种可能的实现方式,收发模块,具体用于接收UE发送的SIP-info消息,该SIP-info消息包括该呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于接收UE发送的SIP-Notifiication消息,该SIP-Notifiication消息包括该呼叫业务人机交互环境指示信息;收发模块,还用用于 向UE发送订阅消息,该订阅消息用于订阅该呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于接收UE发送的请求媒体内容的请求消息,该请求媒体内容的请求消息包括该呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于在呼叫业务进行期间向UE发送该请求消息的响应消息,该响应消息包括该待投放媒体内容。
一种可能的实现方式,收发模块,还用于向UE发送该请求消息的响应消息,该响应消息包括第一指示信息,该第一指示信息用于指示在呼叫业务进行期间不向UE投放媒体内容。
一种可能的实现方式,处理模块,还用于根据待投放媒体内容建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,该音频媒体通道用于传输音频形式的媒体内容,和/或,该音频媒体通道用于传输该呼叫业务进行期间、该呼叫业务对应的UE之间的语音信息,该视频媒体通道用于传输视频形式的媒体内容;收发模块,具体用于在呼叫业务进行期间通过该媒体通道,向UE投放该待投放媒体内容。
一种可能的实现方式,处理模块,还用于根据该呼叫业务建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,该音频媒体通道用于传输音频形式的媒体内容,和/或,该音频媒体通道用于传输该呼叫业务进行期间、该呼叫业务对应的UE之间的语音信息,该视频媒体通道用于传输视频形式的媒体内容。
一种可能的实现方式,处理模块,还用于若该媒体通道不能传输该待投放媒体内容,则切换媒体通道;收发模块,具体用于在呼叫业务进行期间通过切换后的媒体通道,向UE投放该待投放媒体内容。
一种可能的实现方式,收发模块,具体用于在呼叫业务进行期间通过该媒体通道,向UE投放该待投放媒体内容。
一种可能的实现方式,处理模块,还用于根据呼叫业务建立媒体通道,媒体通道的类型包括音频媒体通道或视频媒体通道,该音频媒体通道用于传输音频形式的媒体内容,和/或,该音频媒体通道用于传输该呼叫业务进行期间、该呼叫业务对应的UE之间的语音信息,该视频媒体通道用于传输视频形式的媒体内容。
第六方面,本申请实施例提供一种UE,该UE包括:处理模块和收发模块,处理模块,用于获取呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境;收发模块,用于向媒体投放服务器发送呼叫业务人机交互环境指示信息;收发模块,还用于接收媒体投放服务器发送的待投放媒体内容;处理模块,还用于通过呼叫程序相关的程序单元呈现待投放媒体内容。
或者,第六方面,本申请实施例提供一种UE,该UE包括:处理模块和收发模块,处理模块,用于获取呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境;收发模块,用于向媒体投放服务器发送呼叫业务人机交互环境指示信息;处理模块,还用于确定不呈现媒体内容。
一种可能的实现方式,处理模块,具体用于检测以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功 能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在该UE的可视范围内。
一种可能的实现方式,收发模块,具体用于向媒体投放服务器发送SIP-info消息,该SIP-info消息包括该呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于向该媒体投放服务器发送SIP-Notifiication消息,该SIP-Notifiication消息包括该呼叫业务人机交互环境指示信息;收发模块,还用于接收来自媒体投放服务器的订阅消息,该订阅消息用于订阅该呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于向媒体投放服务器发送请求媒体内容的请求消息,请求媒体内容的请求消息包括呼叫业务人机交互环境指示信息。
一种可能的实现方式,收发模块,具体用于接收媒体投放服务器发送的请求消息的响应消息,该响应消息包括该待投放媒体内容。
一种可能的实现方式,处理模块,具体用于通过收发模块接收媒体投放服务器发送的第一指示信息,该第一指示信息用于指示在该呼叫业务进行期间不向该UE投放媒体内容;处理模块,还具体用于根据该第一指示信息确定不呈现媒体内容;或者,
处理模块,具体用于在预设时间范围内未接收到该媒体投放服务器发送的关于呈现媒体内容的指示信息,确定不呈现媒体内容。
一种可能的实现方式,收发模块,具体用于接收媒体投放服务器发送的请求消息的响应消息,该响应消息包括该第一指示信息。
第七方面,本申请实施例提供一种UE,该UE包括:处理模块和收发模块;处理模块,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间该UE对应的用户的人机交互环境;处理模块,还用于根据呼叫业务人机交互环境确定媒体形式;收发模块,用于向媒体投放服务器发送媒体形式的指示信息;收发模块,还用于接收媒体投放服务器发送的符合媒体形式的媒体内容;处理模块,还用于通过呼叫程序相关的程序单元呈现该媒体内容。
或者,第七方面,本申请实施例提供一种UE,该UE包括:处理模块;处理模块,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间该UE对应的用户的人机交互环境;处理模块,还用于根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
一种可能的实现方式,处理模块,具体用于检测以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体形式为音频形式:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体 形式为有声视频形式:检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体形式为低音视频形式:检测到UE的有线耳机插入;或者,检测到UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定在呼叫业务进行期间不呈现媒体内容:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。
第八方面,本申请实施例提供一种UE,该UE包括:收发模块和处理模块;收发模块,用于获取媒体内容的信息;处理模块,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境;处理模块,还用于根据呼叫业务人机交互环境确定媒体形式,并通过呼叫程序相关的程序单元呈现该媒体内容的信息中,符合该媒体形式的媒体内容。
或者,第八方面,本申请实施例提供一种UE,该UE包括:收发模块和处理模块;收发模块,用于获取媒体内容的信息;处理模块,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境;处理模块,还用于根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
一种可能的实现方式,处理模块,具体用于检测以下至少一项:检测UE的屏幕是否点亮;或者,检测UE的呼叫程序的的界面是否可见;或者,检测UE的免提功能是否开启;或者,检测UE的有线耳机是否插入;或者,检测UE的无线耳机是否连接;或者,检测用户是否在UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体形式为音频形式:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在该UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体形式为有声视频形式:检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的呼叫 程序的界面可见、UE的有线耳机插入、且用户在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定媒体形式为低音视频形式:检测到UE的有线耳机插入;或者,检测到UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在该UE的可视范围内。
一种可能的实现方式,处理模块,具体用于若检测到以下任一环境,则确定在呼叫业务进行期间不呈现媒体内容:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。
第九方面,本申请实施例提供一种媒体投放服务器,包括:处理器;该处理器用于与存储器耦合,并读取存储器中的指令之后,根据该指令执行如上述第一方面所述的方法。该媒体投放服务器可以为上述第一方面中的媒体投放服务器,或者包含上述媒体投放服务器的装置。
结合上述第九方面,在一种可能的实现方式中,该媒体投放服务器还包括存储器,该存储器,用于保存必要的程序指令和数据。
第十方面,本申请实施例提供一种UE,包括:处理器;该处理器用于与存储器耦合,并读取存储器中的指令之后,根据该指令执行如上述第二方面至第四方面中任一方面所述的方法。该UE可以为上述第二方面至第四方面中任一方面中的UE,或者包含上述UE的装置。
结合上述第十方面,在一种可能的实现方式中,该UE还包括存储器,该存储器,用于保存必要的程序指令和数据。
第十一方面,本申请实施例提供一种媒体投放服务器,包括:处理器和接口电路;接口电路,用于接收计算机程序或指令并传输至处理器;处理器用于执行所述计算机程序或指令,以使该媒体投放服务器执行如上述第一方面所述的方法。
第十二方面,本申请实施例提供一种UE,包括:处理器和接口电路;接口电路,用于接收计算机程序或指令并传输至处理器;处理器用于执行所述计算机程序或指令,以使该UE执行如上述第二方面至第四方面中任一方面所述的方法。
第十三方面,本申请实施例提供一种计算机可读存储介质,该计算机可读存储介质中存储有指令,当其在计算机上运行时,使得计算机可以执行上述任一方面所述的方法。
第十四方面,本申请实施例提供一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机可以执行上述任一方面所述的方法。
其中,第五方面至第十四方面中任一种可能的实现方式所带来的技术效果可参见上述第一方面至第四方面中任一方面或任一方面中不同可能的实现方式所带来的技术效果,此处不再赘述。
第十五方面,本申请实施例一种通信系统,该通信系统包括用于执行上述第一方 面所述的方法的媒体投放服务器、以及用于执行上述第二方面所述的方法的UE,或者,该通信系统包括用于执行上述第三方面所述方法的UE,或者,该通信系统包括用于执行上述第四方面所述方法的UE。
图1为本申请实施例提供的媒体内容的投放过程的流程示意图一;
图2为本申请实施例提供的媒体内容的投放过程的流程示意图二;
图3A为本申请实施例提供的通信系统架构示意图一;
图3B为本申请实施例提供的通信系统架构示意图二;
图4为本申请实施例提供的设备的硬件结构示意图;
图5为本申请实施例提供的媒体内容的投放方法的流程示意图一;
图6A为本申请实施例提供的SIP-info消息的示意图;
图6B为本申请实施例提供的SIP-Subscribe消息的示意图;
图7为本申请实施例提供的媒体内容的投放方法的流程示意图二;
图8A为本申请实施例提供的手机拍摄图像的示意图一;
图8B为本申请实施例提供的手机拍摄图像的示意图二;
图9为本申请实施例提供的媒体内容的投放方法的流程示意图三;
图10为本申请实施例提供的媒体内容的投放方法的流程示意图四;
图11为本申请实施例提供的媒体投放服务器的结构示意图;
图12为本申请实施例提供的UE的结构示意图。
在介绍本申请实施例之前,对本申请实施例涉及的相关技术术语进行解释说明。需要说明的是,这些解释说明是为了让本申请实施例更容易被理解,而不应该视为对本申请实施例所要求的保护范围的限定。
1、呼叫业务
呼叫业务可以指UE以主叫身份或者被叫身份参与,经通信网络接续与其他UE之间进行的语音通话业务或视频通话业务。以UE为主叫为例,呼叫业务可以为UE拨打手机号码、座机号码或客服中心号码而进行的语音通话业务或者视频通话业务;或者,呼叫业务可以为UE通过即时通讯(real time communication,RTC)应用呼叫其他UE而进行的语音通话业务或者视频通话业务。以UE为被叫为例,呼叫业务可以为UE接收手机、座机或客服中心的呼叫而进行的语音通话业务或者视频通话业务;或者,呼叫业务可以为UE通过RTC应用接收其他UE的呼叫而进行的语音通话业务或者视频通话业务。
2、呼叫业务进行期间
呼叫业务进行期间可以指从参与呼叫业务的一方拨号到呼叫业务结束(中止或者终止等)的整个时间范围,有时候也可以称为“呼叫过程”或“呼叫业务过程”等。
例如,呼叫业务进行期间可以包括主叫UE的用户呼叫被叫UE之后,到主叫UE接收到回铃音之前;主叫UE接收到回铃音之后到被叫UE接通之前;主叫UE的用户与被叫UE的用户通话的过程中;通话结束,一方UE的用户挂机之后到另一方UE的 用户挂机之前;主叫UE的用户呼叫被叫UE之后,被叫UE由于关机,欠费、或网络不好等原因无法接通,但主叫UE的用户挂机之前。
3、媒体内容
媒体内容可以指适合在呼叫业务进行期间,在UE上呈现的媒体内容。例如,在呼叫业务进行期间,在UE上呈现的新闻、广告、招聘信息、风景图片、人物事迹等希望推送给UE的信息。
4、媒体形式
媒体形式也可以称为媒体内容的形式。媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式中的一种或多种。其中,无声视频形式、有声视频形式和低音视频形式可以统称为视频形式。无声视频形式的媒体内容的音量小于或等于第一预设阈值。有声视频形式的媒体内容的音量大于或等于第二预设阈值。低音视频形式的媒体内容的缺省音量大于0且小于第三预设阈值。例如,低音视频形式的媒体内容的音量比有声视频形式的媒体内容的音量低10%。本申请实施例中,第一预设阈值、第二预设阈值和第三预设阈值可以相同也可以不同。
可以理解的,本申请实施例中,若媒体形式为音频形式,则在UE上呈现媒体内容可以理解为UE播放音频形式的媒体内容。若媒体形式为无声视频形式、有声视频形式或低音视频形式,则在UE上呈现媒体内容可以理解为UE播放视频形式的媒体内容。
5、通过语音传递媒体信息的媒体内容
通过语音传递媒体信息的媒体内容可以是视频形式的媒体内容也可以是音频形式的媒体内容。若通过语音传递媒体信息的媒体内容是视频形式的媒体内容,则该媒体内容主要通过视频中的语音来传递信息,视频中的图像(或图片)可以起到辅助传递信息的作用。以招聘广告为例,若该招聘广告是通过语音传递媒体信息的,则用户通过听该招聘广告,就可以了解到该招聘广告所要传达的主要信息。通过语音传递媒体信息的媒体内容还可以是防疫宣传、交通安全公益广告等主要通过语音传递信息的媒体内容。
6、通过图像传递信息的媒体内容
通过图像传递信息的媒体内容可以是视频形式的媒体内容。该媒体内容主要通过视频中的图像(或图片)来传递信息,视频中的声音可以起到辅助传递信息的作用,或者视频中的声音不具备传递信息的作用。例如,通过图像传递信息的媒体内容可以是汽车的售卖广告、风景图片展示、运动展示等视频展示效果好的媒体内容。
7、音频媒体通道和视频媒体通道
音频媒体通道可以用于传输音频形式的媒体内容,和/或,用于传输呼叫业务进行期间、呼叫业务对应的UE之间的语音信息(例如,呼叫业务对应的UE 1的用户和UE 2的用户之间通话的内容)。视频媒体通道可以用于传输视频形式的媒体内容。音频媒体通道还可以称为音频媒体资源通道。视频媒体通道还可以称为视频媒体资源通道。
可以理解的,音频媒体通道或视频媒体通道可以根据常规技术中的协议,例如,会话发起协议(session initiation protocol,SIP)来建立。在不同的协议中,音频媒体 通道或视频媒体通道的建立过程可能不同,具体可以参考常规技术中的解释说明,在此不做赘述。
为了便于理解本申请的技术方案,下面分别以UE通过拨打号码呼叫其他UE的过程中,媒体资源系统(media resource system,MRS)向UE投放媒体内容为例,以及以UE通过RTC应用呼叫其他UE的过程中,MRS向UE投放媒体内容为例,对媒体内容的投放过程进行阐述。
请参考图1,图1为在UE A通过拨打UE B的号码呼叫UE B进行语音通话业务期间,MRS向UE A投放视频形式的媒体内容的流程示意图。具体的,可以参考下述S101-S147中的介绍。图1所示的方法可以应用于下述图3A所示的通信系统中。
S101:UE A呼叫UE B。
例如,UE A对应的用户拨打UE B的号码,以呼叫UE B。UE A对UE B的呼叫可以触发到主叫(即UE A)的IMS的呼叫会话控制功能(call session control function,CSCF)设备(以下简称主叫的IMS_CSCF设备)。
S102-S103:主叫的IMS_CSCF设备向媒体应用服务器(media application server,Media AS)发送创建会话邀请请求(Invite(SDPa=audio)。Media AS接收到创建会话邀请请求后,向主叫的IMS_CSCF设备发送会话邀请应答消息(100trying)。其中,创建会话邀请请求可以携带会话描述协议(session description protocol,SDP)参数SDPa=audio,以指示进行语音通话业务。
S104-S105:Media AS向被叫(即UE B)的IMS_CSCF设备发送创建会话邀请请求(Invite(SDPa=audio),被叫的IMS_CSCF设备接收到创建会话邀请请求后,向Media AS发送会话邀请应答消息(100trying)。其中,创建会话邀请请求可以携带SDP参数SDPa=audio。
S106-S111:被叫的IMS_CSCF设备向Media AS发送请求媒体协商消息(183(SPDb=audio))。Media AS接收到请求媒体协商消息后,向主叫的IMS_CSCF设备发送请求媒体协商消息(183(SPDb=audio))。其中,请求媒体协商消息可以携带SDP参数SDPb=audio,以请求建立MRS与UE A之间的音频媒体通道。主叫的IMS_CSCF设备接收到请求媒体协商消息后,向Media AS发送请求媒体协商响应消息(PRACK)。Media AS接收到请求媒体协商响应消息后,向被叫的IMS_CSCF设备发送请求媒体协商响应消息,以响应被叫的IMS_CSCF设备。被叫的IMS_CSCF设备接收到请求媒体协商响应消息后,向Media AS发送确认响应消息(200ok)。Media AS接收到确认响应消息后,向主叫的IMS_CSCF设备发送确认响应消息(200ok),以确认主叫的IMS_CSCF设备被连通。
S112-S116:主叫的IMS_CSCF设备向Media AS发送更新媒体状态(update)消息。Media AS接收到更新媒体状态消息后,向被叫的IMS_CSCF设备发送更新媒体状态消息,以建立MRS与UE A之间的音频媒体通道。被叫的IMS_CSCF设备接收到更新媒体状态消息后,向Media AS发送确认响应消息(200ok)。Media AS接收到确认响应消息后,向主叫的IMS_CSCF设备发送确认响应消息。此时,音频媒体通道建立成功。后续,被叫的IMS_CSCF设备向Media AS发送振铃(180Ring(SDP))消息,UE B开始振铃。
S117-S124:Media AS向MRS发送创建会话邀请请求(Invite(SDPb=audio)。该创建会话邀请请求可以携带SDP参数SDPb=audio。MRS接收到该创建会话邀请请求后,向Media AS发送会话邀请应答消息(100trying)。后续,MRS向Media AS发送确认响应消息(200ok(SDPm=audio))。该确认响应消息可以携带SDP参数SDPm=audio。Media AS接收到确认响应消息后,向MRS发送重新协商(Re-INVITE)消息。MRS接收到重新协商消息后,向Media AS发送确认响应消息(200ok(SDPm=video))。该确认响应消息可以携带SDP参数SDPm=video。Media AS接收到确认响应消息后,向主叫的IMS_CSCF设备发送更新媒体状态(update(SDPm=video))消息。该更新媒体状态消息可以携带SDP参数SDPm=video。主叫的IMS_CSCF设备接收到该更新媒体状态消息后,向Media AS发送确认响应消息(200ok(SDPb=video))。该确认响应消息可以携带SDP参数SDPb=video。Media AS接收到确认响应消息后,向MRS发送响应确认消息(acknowledgement,ACK)。该响应确认消息可以携带SDP参数SDPa=video。此时,上述音频媒体通道切换为视频媒体通道。音频媒体通道切换为视频媒体通道也可以描述为音频媒体通道变更为视频媒体通道。
S125-S130:Media AS向媒体决策服务器发送请求消息,以获取媒体内容投放策略信息。媒体决策服务器接收到该请求消息后,向Media AS发送媒体内容投放信息,以指示要投放的媒体内容。Media AS接收到媒体内容投放信息后,向MRS发送信息上报(info)消息,以控制MRS向UE A投放视频形式的媒体内容。Media AS还可以向主叫的IMS_CSCF设备发送振铃(180Ring)消息,使得UE A的用户确定UE B正在振铃。MRS接收到信息上报消息后,向Media AS发送确认响应消息(200OK),并向UE A投放视频形式的媒体内容。
S131-S142:被叫摘机(即被叫应答)后,被叫的IMS_CSCF设备向Media AS发送确认响应消息(200ok)。Media AS接收到确认响应消息后,向被叫的IMS_CSCF设备发送响应确认消息(ACK)。Media AS还向MRS发送结束会话(BYE)消息。MRS接收到结束会话消息后,向Media AS发送确认响应消息(200ok)。Media AS接收到确认响应消息后,向被叫的IMS_CSCF设备发送重新协商(Re-INVITE)消息。被叫的IMS_CSCF设备接收到重新协商消息后,向Media AS发送确认响应消息(200ok(SDPb=audio))。该确认响应消息可以携带SDP参数SDPb=audio。Media AS接收到该确认响应消息后,向主叫的IMS_CSCF设备发送更新媒体状态(update(SDPb=audio,video=inactive))消息。该更新媒体状态消息可以携带SDP参数SDPb=audio,video=inactive。主叫的IMS_CSCF设备接收到更新媒体状态消息后,向Media AS发送确认响应消息(200ok(SDPa=audio))。该确认响应消息可以携带SDP参数SDPa=audio。Media AS接收到确认响应消息后,向被叫的IMS_CSCF设备发送响应确认消息(ACK(SDPa=audio,video=inactive))。该响应确认消息可以携带SDP参数SDPa=audio,video=inactive。Media AS还可以向主叫的IMS_CSCF设备发送确认响应消息(200ok)。主叫的IMS_CSCF设备接收到该确认响应消息后,向Media AS发送响应确认消息(ACK)。此时,上述视频媒体通道切换为音频媒体通道。
S143-S147:UE A的用户和UE B的用户开始通话。在通话结束后,主叫的 IMS_CSCF设备向Media AS发送呼叫结束会话(BYE)消息。Media AS接收到结束会话消息后,向被叫的IMS_CSCF设备发送结束会话(BYE)消息。被叫的IMS_CSCF设备接收到结束会话消息后,向Media AS发送确认响应消息(200ok)。Media AS接收到确认响应消息后,向主叫的IMS_CSCF设备发送确认响应消息(200ok)。
请参考图2,图2为在UE A通过RTC应用呼叫UE B进行语音通话业务期间,MRS向UE A投放媒体内容的流程示意图。具体的,可以参考下述S201-S226中的介绍。图2所示的方法可以应用于下述图3B所示的通信系统中。
S201:UE A的RTC应用与信令服务器(Signal Server)建立连接,UE B的RTC应用与Signal Server建立连接。
S202-S203:UE A创建对等连接(Create PeerConnection),并添加流(Add Streams)。
示例性的,UE A的RTC应用程序打开UE A的音频设备和视频设备,确定音频流或者视频流等参数。
S204-S209:UE A生成通话协商数据(CreateOffer),并且UE A的RTC应用程序调用Signal Server,发起建立呼叫的请求,向Signal Server发送通话协商数据(Send Offer SDP)。该通话协商数据可以指示本次会话是否包含音频流或者视频流等参数。Signal Server接收到通话协商数据后,向UE B的RTC应用程序转发通话协商数据(Relay Offer SDP)。UE B的RTC应用程序接收到通话协商数据后,打开UE B的音频视频设备,准备应答通话协商数据(CreateAnswer),并向Signal Server发送响应消息(Send Answer SDP)。Signal Server接收到响应消息后,向UE A转发响应消息(Relay Answer SDP)。
S210-S214:UE A向网络地址转换(network address translation,NAT)会话穿越应用程序服务器(session traversal utilities for NAT server,STUN Server)请求IP地址(Ask my Ipaddress)。STUN Server向UE A返回分配的通道信息(OnIceCandidate)。UE A接收到通道信息后,向Signal Server发送通道信息(Send candidate)。Signal Server接收到通道信息后,向UE B转发通道信息(Relay candidate)。UE B接收到通道信息后,可以添加通道信息(AddIceCandidate)。
S215-S218:UE B向STUN Server请求IP地址(Ask my Ipaddress)。STUN Server向UE B返回分配的通道信息(OnIceCandidate)。UE B接收到通道信息后,经Signal Server向UE A发送通道信息(Send candidate)。S215-S218的过程与S210-S213的过程类似,因此可以参考S210-S213中的介绍,在此不做赘述。
S219:UE A和UE B建立端到端(point to point,P2P)通道(P2P Channel),例如,音视频传输的P2P通道。
S220:UE B添加流(OnAddStream)。
S221:UE A和UE B进行实时通讯。若UE A和UE B建立了音视频传输的P2P通道,则UE A和UE B进行音视频实时通讯。
S222-S224:UE A向媒体决策服务器发送请求消息。媒体决策服务器接收到请求消息后,决策向UE A投放的媒体内容,并向UE A发送决策好的媒体内容的地址。
S225-S227:UE A根据媒体内容的地址向MRS请求媒体内容的地址对应的媒体内容,并在获取到该媒体内容后,呈现该媒体内容。
下面结合附图对本申请实施例的实施方式进行详细描述。
本申请实施例提供的方法可用于各种通信系统。例如该通信系统可以为长期演进(long term evolution,LTE)系统、第五代(5th generation,5G)通信系统、无线保真(wireless-fidelity,WiFi)系统、第三代合作伙伴计划(3rd generation partnership project,3GPP)相关的通信系统、未来演进的通信系统、或多种系统融合的系统等,不予限制。其中,5G还可以称为新无线(new radio,NR)。下面以图3A和图3B所示通信系统为例,对本申请实施例提供的方法进行描述。
如图3A所示,为本申请实施例提供的一种通信系统的架构示意图。图3A所示的通信系统可以包括媒体投放服务器303、UE 301和UE 302。其中,媒体投放服务器303、UE 301和UE 302可以通过通信网络连接。该通信网络可以为IMS网络。IMS网络可以负责呼叫相关的信令消息的路由。对接主被叫UE以及媒体投放服务器303。例如,IMS网络可以将媒体投放服务器303发送的媒体内容发送给UE 301或UE 302;IMS网络也可以将UE 301或UE 302的消息发送到媒体投放服务器303;IMS网络还可以传输UE 301和UE 302之间的消息。
图3A中的UE,例如UE 301或UE 302,可以是一种具备呼叫功能和媒体内容投放功能的设备。其中,UE具备呼叫功能可以理解为UE能够进行呼叫业务。UE具备媒体内容投放功能可以理解为UE能够接收媒体内容,并将媒体内容呈现出来。示例性的,图3A中的UE可以是具有无线通信功能的手持式设备或可穿戴设备。例如,图3A中的UE可以是手机(mobile phone)、平板电脑或智能手表等。本申请实施例中,UE还可以称为终端或终端设备。本申请实施例中,用于实现UE的功能的装置可以是UE;也可以是能够支持UE实现该功能的装置,例如芯片系统,该装置可以被安装在UE中或者和UE匹配使用。本申请实施例中,芯片系统可以由芯片构成,也可以包括芯片和其他分立器件。本申请实施例提供的方法中,以用于实现UE的功能的装置是UE为例,描述本申请实施例提供的方法。在此做出统一说明,后面不再赘述。
图3A中的媒体投放服务器303可以接收用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定在呼叫业务进行期间是否向UE投放媒体内容。或者,图3A中的媒体投放服务器303可以接收用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定待投放媒体内容,并在呼叫业务进行期间向UE投放该待投放媒体内容。
可以理解的,媒体投放服务器303具备的功能可以被集中部署在一个物理设备上,以提高媒体投放服务器303的内聚性(cohesiveness),进而提高媒体投放服务器303的性能。媒体投放服务器303具备的功能也可以部署在多个物理设备上,以降低对每个物理设备的要求,使得媒体投放服务器303的功能更容易实现。
以媒体投放服务器303具备的功能被集中部署在一个物理设备上为例,媒体投放服务器303可以包括媒体决策模块3031、媒体应用模块3032和媒体资源管理模块3033。其中,媒体应用模块3032可以用于接收UE发送的用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息。媒体决策模块3031可以用于根据该指示信息确定在呼叫业务进行期间是否向UE投放媒体内容,或者,用于根据该指示信息确定待投放媒体内容。媒体资源管理模块3033可以用于在呼叫业务进行期间向UE投放该 待投放媒体内容。
以媒体投放服务器303具备的功能部署在多个物理设备上为例,媒体应用模块3032具备的功能可以部署在Media AS(图3A未示出)上,用于实现媒体应用模块3032的功能。媒体决策模块3031具备的功能可以部署在媒体决策服务器(图3A未示出)上,用于实现媒体决策模块3031的功能。媒体资源管理模块3033具备的功能可以部署在MRS(图3A未示出)上,用于实现媒体资源管理模块3033的功能。
如图3B所示,为本申请实施例提供的又一种通信系统的架构示意图。图3B所示的通信系统可以包括媒体投放服务器306、UE 304和UE 305。其中,媒体投放服务器306、UE 304和UE 305可以通过通信网络连接。该通信网络可以为4G或5G的网络。
图3B中的UE,例如UE 304或UE 305,可以是一种安装了RTC应用,并且具备媒体内容投放功能的设备。其中,UE具备媒体内容投放功能可以理解为UE能够接收媒体内容,并将媒体内容呈现出来。示例性的,图3B中的UE可以是具有无线通信功能的手持式设备、车载设备、可穿戴设备或计算设备。例如,图3B中的UE可以是手机、平板电脑、带无线收发功能的电脑或智能手表等。
图3B中的媒体投放服务器306可以接收用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定在呼叫业务进行期间是否向UE投放媒体内容。或者,图3B中的媒体投放服务器306可以接收用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定待投放媒体内容,并在呼叫业务进行期间向UE投放该待投放媒体内容。
可以理解的,媒体投放服务器306具备的功能可以被集中部署在一个物理设备上,以提高媒体投放服务器306的内聚性,进而提高媒体投放服务器306的性能。媒体投放服务器306具备的功能也可以部署在多个物理设备上,以降低对每个物理设备的要求,使得媒体投放服务器306的功能更容易实现。
以媒体投放服务器306具备的功能被集中部署在一个物理设备上为例,媒体投放服务器306可以包括媒体决策模块3061和媒体资源管理模块3062。其中,媒体决策模块3061可以用于接收UE发送的用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定在呼叫业务进行期间是否向UE投放媒体内容;或者,媒体决策模块3061可以用于接收UE发送的用于指示在呼叫业务进行期间、UE对应的用户的人机交互环境的指示信息,根据该指示信息确定待投放媒体内容。媒体资源管理模块3062可以用于在呼叫业务进行期间向UE投放该待投放媒体内容。
以媒体投放服务器306具备的功能部署在多个物理设备上为例,媒体决策模块3061具备的功能可以部署在媒体决策服务器(图3B未示出)上,用于实现媒体决策模块3061的功能。媒体资源管理模块3062具备的功能可以部署在MRS(图3B未示出)上,用于实现媒体资源管理模块3062的功能。
可选的,图3B所示的通信系统还包括RTC服务器(RTC Server)307。RTC Server307可以提供高可用、高品质、超低延时的语音和视频通信服务。UE可以基于RTC Server 307提供的软件开发工具包(software development kit,SDK),集成即时通讯能力。RTC Server 307还可以负责呼叫相关的信令消息的路由。对接主被叫UE以及 媒体投放服务器306。
一种可能的实现方式,RTC Server 307可以包括STUN Server和Signal Server。其中,STUN是一种网络协议,它允许位于NAT(或多重NAT)后的客户端找出自己的公网地址,查出自己位于哪种类型的NAT之后以及NAT为哪一个本地端口所绑定的因特网(Internet)端端口。这些信息被用来在两个同时处于NAT路由器之后的主机之间创建用户数据报协议(user datagram protocol,UDP)通信。STUN Server是处理STUN的服务器。Signal Server是处理RTC信令的服务器。可以理解的,STUN Server和Signal Server可以部署在同一个物理设备上,也可以部署在不同的物理设备上,不予限制。
可以理解的,图3A或图3B所示的通信系统仅用于举例,并非用于限制本申请的技术方案。本领域的技术人员应当明白,在具体实现过程中,图3A或图3B所示的通信系统还可以包括其他设备,同时也可根据具体需要来确定UE、媒体投放服务器、RTC服务器的数量,不予限制。
可选的,本申请实施例图3A或图3B中的各设备(例如媒体投放服务器或UE等)可以是一个通用设备或者是一个专用设备,本申请实施例对此不作具体限定。
可选的,本申请实施例图3A或图3B中的各设备的相关功能可以由一个设备实现,也可以由多个设备共同实现,还可以是由一个设备内的一个或多个功能模块实现,本申请实施例对此不作具体限定。可以理解的是,上述功能既可以是硬件设备中的元件,也可以是在专用硬件上运行的软件功能,或者硬件与软件的结合,或者平台(例如,云平台)上实例化的虚拟化功能。
在具体实现时,图3A或图3B中的各设备都可以采用图4所示的组成结构,或者包括图4所示的部件。图4所示为可适用于本申请实施例的设备的硬件结构示意图。该设备40包括至少一个处理器401和至少一个通信接口404,用于实现本申请实施例提供的方法。该设备40还可以包括通信线路402和存储器403。
处理器401可以是一个通用中央处理器(central processing unit,CPU),微处理器,特定应用集成电路(application-specific integrated circuit,ASIC),或一个或多个用于控制本申请方案程序执行的集成电路。
通信线路402可包括一通路,在上述组件之间传送信息,例如总线。
通信接口404,用于与其他设备或通信网络通信。通信接口404可以是任何收发器一类的装置,如可以是以太网接口、无线接入网(radio access network,RAN)接口、无线局域网(wireless local area networks,WLAN)接口、收发器、管脚、总线、或收发电路等。
存储器403可以是只读存储器(read-only memory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(random access memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(electrically erasable programmable read-only memory,EEPROM)、只读光盘(compact disc read-only memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取 的任何其他介质,但不限于此。存储器可以是独立存在,通过通信线路402与处理器401相耦合。存储器403也可以和处理器401集成在一起。本申请实施例提供的存储器通常可以具有非易失性。
其中,存储器403用于存储执行本申请实施例提供的方案所涉及的计算机执行指令,并由处理器401来控制执行。处理器401用于执行存储器403中存储的计算机执行指令,从而实现本申请实施例提供的方法。或者,可选的,本申请实施例中,也可以是处理器401执行本申请下述实施例提供的方法中的处理相关的功能,通信接口404负责与其他设备或通信网络通信,本申请实施例对此不作具体限定。
可选的,本申请实施例中的计算机执行指令也可以称之为应用程序代码,本申请实施例对此不作具体限定。
本申请实施例中的耦合是装置、单元或模块之间的间接耦合或通信连接,可以是电性,机械或其它的形式,用于装置、单元或模块之间的信息交互。
作为一种实施例,处理器401可以包括一个或多个CPU,例如图4中的CPU0和CPU1。
作为一种实施例,设备40可以包括多个处理器,例如图4中的处理器401和处理器407。这些处理器中的每一个可以是一个单核(single-CPU)处理器,也可以是一个多核(multi-CPU)处理器。这里的处理器可以指一个或多个设备、电路、和/或用于处理数据(例如计算机程序指令)的处理核。
作为一种实施例,设备40还可以包括输出设备405和/或输入设备406。输出设备405和处理器401耦合,可以以多种方式来显示信息。例如,输出设备405可以是液晶显示器(liquid crystal display,LCD),发光二级管(light emitting diode,LED)显示设备,阴极射线管(cathode ray tube,CRT)显示设备,或投影仪(projector)等。输入设备406和处理器401耦合,可以以多种方式接收用户的输入。例如,输入设备406可以是鼠标、键盘、触摸屏设备或传感设备等。
可以理解的,图4中示出的组成结构并不构成对该设备的限定,除图4所示部件之外,该设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
下面将结合附图,对本申请实施例提供的媒体内容的投放方法进行描述。下述实施例中的各设备可以具备图4所示部件,不予赘述。
可以理解的,本申请实施例提供的媒体内容的投放方法可以应用于多种场景。例如,本申请实施例提供的媒体内容的投放方法可以应用于主叫UE呼叫被叫UE之后、被叫UE振铃之前(即主叫UE发起呼叫,但被叫UE还未振铃期间)、振铃过程中(即主叫用户听到回铃音期间)、呼叫中(主被叫在通话过程中)、呼叫结束后(主被叫双方通话结束,一方用户挂机之后,另一方用户挂机之前)、呼叫失败(主叫UE呼叫被叫UE之后,被叫UE由于关机,欠费、或网络不好等原因导致无法接通,并且主叫用户挂机之前)等场景。
需要说明的是,本申请下述实施例中各个网元之间的消息名字或消息中各参数的名字等只是一个示例,具体实现中也可以是其他的名字,本申请实施例对此不作具体限定。
需要说明的是,在本申请实施例中,“和/或”可以用于描述关联对象存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,其中A,B可以是单数或者复数。此外,类似于“A、B和C中的至少一项”或“A、B或C中的至少一项”的表述通常用于表示如下中任一项:单独存在A;单独存在B;单独存在C;同时存在A和B;同时存在A和C;同时存在B和C;同时存在A、B和C。以上是以A、B和C共三个元素进行举例来说明该项目的可选用条目,当表述中具有更多元素时,该表述的含义可以按照前述规则获得。
为了便于描述本申请实施例的技术方案,在本申请实施例中,可以采用“第一”、“第二”等字样对功能相同或相似的技术特征进行区分。该“第一”、“第二”等字样并不对数量和执行次序进行限定,并且“第一”、“第二”等字样也并不限定一定不同。在本申请实施例中,“示例性的”或者“例如”等词用于表示例子、例证或说明,被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念,便于理解。
需要说明的是,在本申请实施例中,对于一种技术特征,通过“第一”、“第二”、“第三”、“A”、“B”、“C”和“D”等区分该种技术特征中的技术特征,该“第一”、“第二”、“第三”、“A”、“B”、“C”和“D”描述的技术特征间无先后顺序或者大小顺序。
可以理解的,本申请实施例中同一个步骤或者具有相同功能的步骤或者技术特征在不同实施例之间可以互相参考借鉴。
可以理解的,本申请实施例中,UE和/或媒体投放服务器可以执行本申请实施例中的部分或全部步骤,这些步骤仅是示例,本申请实施例还可以执行其它步骤或者各种步骤的变形。此外,各个步骤可以按照本申请实施例呈现的不同的顺序来执行,并且有可能并非要执行本申请实施例中的全部步骤。
如图5所示,为本申请实施例提供的一种媒体内容的投放方法,该媒体内容的投放方法包括S501-S505a,或者,该媒体内容的投放方法包括S501-S502以及S503b。
S501:UE获取呼叫业务人机交互环境指示信息。
其中,UE可以是图3A或图3B中的任一UE。例如,该UE可以为图3A中的UE301或UE 302;或者,该UE可以为图3B中的UE 304或UE 305。
本申请实施例中,呼叫业务人机交互环境指示信息可以指示在呼叫业务进行期间UE对应的用户的人机交互环境。该人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,呼叫业务人机交互环境可以用于媒体投放服务器确定在呼叫业务进行期间是否适合向UE投放媒体内容。在不适合向UE投放媒体内容的情况下,媒体投放服务器可以不向UE投放媒体内容,在适合向UE投放媒体内容的情况下,媒体投放服务器才向UE投放媒体内容,提高了用户体验和媒体内容的投放效果。或者,呼叫业务人机交互环境可以用于媒体投放服务器确定待投放媒体内容。因为媒体投放服务器确定的待投放媒体内容是根据用户当前的状态确定的,所以符合用户的需求,可以提高用户体验和媒体内容的投放效果。
作为一种示例,人机交互环境可以包含以下任意一项或任意组合:UE的屏幕是否 点亮、UE的呼叫程序的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在所述用户设备的可视范围内。
本申请实施例中,呼叫程序可以是呼叫业务对应的应用程序。以安卓(Android)系统为例,呼叫程序可以是UE上的电话应用(Telephony APP)或UE上的RTC软件。呼叫程序的界面可以是呼叫程序的图形用户界面(graphical user interface,GUI)。UE的呼叫程序的界面可见可以理解为UE的呼叫程序在前台运行。UE的呼叫程序的界面不可见可以理解为UE的呼叫程序在后台运行。
本申请实施例中,UE的有线耳机插入可以理解为UE连接了有线耳机,UE可以通过与UE连接的有线耳机播放声音。UE的有线耳机未插入可以理解为UE未连接有线耳机,UE可以通过UE的扬声器播放声音。需要说明的是,UE的有线耳机插入,但有线耳机没有用于呼叫业务也可以认为是UE的有线耳机未插入。
本申请实施例中,UE的无线耳机连接可以理解为UE连接了无线耳机,UE可以通过与UE连接的无线耳机播放声音。UE的无线耳机未连接可以理解为UE未连接无线耳机,UE可以通过UE的扬声器播放声音。无线耳机可以是蓝牙耳机或者有通话功能的其他蓝牙设备(如:智能手环、智能手表等)。需要说明的是,UE的无线耳机连接,但无线耳机没有用于呼叫业务也可以认为是UE的无线耳机未连接。
本申请实施例中,用户在UE的可视范围内可以理解为用户在UE的屏幕的“视野”范围内,或者说,用户可以看到UE的屏幕。用户未在UE可视范围内可以理解为用户在UE的屏幕“视野”外,或者说,用户看不到屏幕。可以理解的,若用户看不到屏幕,用户可以通过有线耳机、蓝牙耳机等设备进行通话。
一种可能的实现方式,呼叫业务人机交互环境指示信息可以包括多个指示信息,每个指示信息用于指示人机交互环境包括的一种状态。
示例性的,以人机交互环境包括UE的屏幕是否点亮、UE的呼叫程序的界面是否可见和UE的免提功能是否开启为例,呼叫业务人机交互环境指示信息至少包括3个指示信息,第一个指示信息可以指示UE的屏幕是否点亮,第二个指示信息可以指示UE的呼叫程序的界面是否可见,第三个指示信息可以指示UE的免提功能是否开启。
一种可能的实现方式,在呼叫业务即将开始,或者在呼叫业务已经开始的情况下,UE获取呼叫业务人机交互环境指示信息。以图1所示的呼叫过程为例,S501可以在S125之前执行。以图2所示的呼叫过程为例,S501可以在S222之前执行。
一种可能的实现方式,UE可以通过调用UE的操作系统提供的应用程序编程接口(application programming interface,API),获取呼叫业务人机交互环境指示信息。可选的,在用户授权后,UE通过调用UE的操作系统提供的API获取呼叫业务人机交互环境指示信息。
可以理解的,对于不同的操作系统(如:Android、iOS或鸿蒙),或者对于同一操作系统的不同版本,UE通过调用UE的操作系统提供的API获取呼叫业务人机交互环境指示信息的过程不同,本申请实施例以Android为例进行介绍。具体的,可以参考下述图7所示的方法中所述,此处不做赘述。
S502:UE向媒体投放服务器发送呼叫业务人机交互环境指示信息。对应的,媒体投放服务器接收UE发送的呼叫业务人机交互环境指示信息。
本申请实施例中,若UE为图3A中的UE 301或UE 302,则媒体投放服务器可以为图3A中的媒体投放服务器303。若UE为图3B中的UE 304或UE 305,则媒体投放服务器可以是图3B中的媒体投放服务器306。下面分别以媒体投放服务器为图3A中的媒体投放服务器303,以及媒体投放服务器为图3B中的媒体投放服务器306为例,对S502的具体过程进行阐述。
示例1:媒体投放服务器为图3A中的媒体投放服务器303。
一种可能的实现方式,UE向媒体投放服务器发送的呼叫业务人机交互环境指示信息,包括:UE向媒体投放服务器发送SIP-info消息。该SIP-info消息包括呼叫业务人机交互环境指示信息。也就是说,通过扩展SIP-info消息,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器。
示例性的,可以在Messenger Header中扩展UEScrInfo参数,UEScrInfo参数包括SCRS、TAPS、HDFS、WEPS、WLES、RLOP等参数作为扩展参数填充,以实现呼叫业务人机交互环境指示信息的功能。SCRS可以指示UE的屏幕是否点亮。TAPS可以指示UE的呼叫程序的界面是否可见。HDFS可以指示UE的免提功能是否开启。WEPS可以指示UE的有线耳机是否插入。WLES可以指示UE的无线耳机是否连接。RLOP可以指示用户是否在UE的可视范围内。若UEScrInfo参数如图6A所示,则UEScrInfo参数可以指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机插入、UE的无线耳机未连接、且用户在UE的可视范围内。
另一种可能的实现方式,UE向媒体投放服务器发送呼叫业务人机交互环境指示信息,包括:UE向媒体投放服务器发送会话发起协议的通知(SIP-Notifiication)消息。该SIP-Notifiication消息包括呼叫业务人机交互环境指示信息。在这种情况下,S502之前,UE可以接收来自媒体投放服务器的订阅(SIP-Subscribe)消息。该订阅消息可以用于订阅呼叫业务人机交互环境指示信息。也就是说,媒体投放服务器可以向UE订阅呼叫业务人机交互环境指示信息,订阅之后,UE可以向媒体投放服务器发送呼叫业务人机交互环境指示信息。
示例性的,通过扩展SIP-Subscribe消息,媒体投放服务器可以向UE订阅呼叫业务人机交互环境指示信息。例如,如图6B所示,在SIP-Subscribe消息的消息头中,增加订阅呼叫业务人机交互环境指示信息参数ReqScr:request,以实现向UE订阅呼叫业务人机交互环境指示信息的功能。
示例性的,通过扩展SIP-Notifiication消息,UE可以向媒体投放服务器发送呼叫业务人机交互环境指示信息。例如,在SIP-Notifiication消息的消息头中扩展UEScrInfo参数,UEScrInfo参数包括SCRS、TAPS、HDFS、WEPS、WLES、RLOP等参数作为扩展参数填充,以实现呼叫业务人机交互环境指示信息的功能。UEScrInfo参数的介绍可以参考上述示例中所述。
如前文所述,媒体投放服务器303具备的功能可以被集中部署在一个物理设备,也可以被部署在多个物理设备上。以图3A所示的通信系统为例,若媒体投放服务器303具备的功能被集中部署在一个物理设备,则UE向媒体应用模块3032发送呼叫业务人机交互环境指示信息。对应的,媒体应用模块3032接收UE发送的呼叫业务人机交互环境指示信息。后续,媒体应用模块3032可以向媒体决策模块3031发送呼叫业 务人机交互环境指示信息。
若媒体投放服务器303具备的功能被部署在多个物理设备上,则UE向Media AS发送呼叫业务人机交互环境指示信息。对应的,Media AS接收UE发送的呼叫业务人机交互环境指示信息。该指示信息可以包括在SIP-info消息或SIP-Notifiication消息中。后续,Media AS可以向媒体决策服务器发送呼叫业务人机交互环境指示信息。以图1所示的流程为例,Media AS可以通过S125中的请求消息向媒体决策服务器发送呼叫业务人机交互环境指示信息,也就是说,呼叫业务人机交互环境指示信息可以包括在S125中的请求消息中。
示例2:媒体投放服务器为图3B中的媒体投放服务器306。
一种可能的实现方式,UE向媒体投放服务器发送呼叫业务人机交互环境指示信息,包括:UE向媒体投放服务器发送请求媒体内容的请求消息。该请求媒体内容的请求消息包括呼叫业务人机交互环境指示信息。作为一种示例,请求媒体内容的请求消息为上述S222的请求消息。
一种可能的实现方式,UE与媒体投放服务器通过超文本传输协议(hypertext transfer protocol,Http)协议或超文本传输安全协议(hypertext transfer protocol over securesocket layer,Https)通信。作为一种示例,请求媒体内容的请求消息中包括的呼叫业务人机交互环境指示信息可以采用可扩展标记语言(extensible markup language,xml)、JavaScript对象简谱(JavaScript object notation,JSon)等格式。若呼叫业务人机交互环境指示信息采用xml格式,则呼叫业务人机交互环境指示信息可以如下所示:
若呼叫业务人机交互环境指示信息采用JSon格式,则呼叫业务人机交互环境指示信息可以如下所示:
可以理解的,上述采用xml格式或JSon格式的呼叫业务人机交互环境指示信息指 示了UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机插入、UE的无线耳机连接、且用户在UE的可视范围内。
如前文所述,媒体投放服务器306具备的功能可以被集中部署在一个物理设备,也可以被部署在多个物理设备上。以图3B所示的通信系统为例,若媒体投放服务器306具备的功能被集中部署在一个物理设备,则UE向媒体决策模块3061发送呼叫业务人机交互环境指示信息。对应的,媒体决策模块3061接收UE发送的呼叫业务人机交互环境指示信息。若媒体投放服务器306具备的功能被部署在多个物理设备上,则UE向媒体决策服务器发送呼叫业务人机交互环境指示信息。对应的,媒体决策服务器接收UE发送的呼叫业务人机交互环境指示信息。以图2所示的流程为例,UE可以通过S222中的请求消息向媒体决策服务器发送呼叫业务人机交互环境指示信息,也就是说,呼叫业务人机交互环境指示信息可以包括在S222中的请求消息中。
可以理解的,呼叫业务人机交互环境指示信息除了通过上述请求媒体内容的请求消息发送之外,还可以对常规技术中的SDP offer消息进行扩展,通过扩展后的SDP offer消息发送呼叫业务人机交互环境指示信息。
S503a:媒体投放服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容。
一种可能的实现方式,媒体投放服务器可以根据呼叫业务人机交互环境指示信息直接确定待投放媒体内容。或者,媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定媒体形式,并确定符合该媒体形式的媒体内容为待投放媒体内容。或者,媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定用户的群体类型,根据群体类型确定待投放媒体内容。下面对上述三种情况分别介绍。
情况1:媒体投放服务器根据呼叫业务人机交互环境指示信息直接确定待投放媒体内容。
在情况1中,待投放媒体内容可以为通过语音传递媒体信息的媒体内容或通过图像传递信息的媒体内容。通过语音传递媒体信息的媒体内容或通过图像传递信息的媒体内容的介绍可以参考上述对本申请实施例涉及的相关技术术语的解释说明,在此不做赘述。
可以理解的,媒体投放服务器可以根据不同的呼叫业务人机交互环境,确定与该呼叫业务人机交互环境对应的待投放媒体内容。示例性的,若呼叫业务人机交互环境适合用户听UE播放的声音,则媒体投放服务器可以确定待投放媒体内容为通过语音传递媒体信息的媒体内容。若呼叫业务人机交互环境适合用户观看UE播放的视频,则媒体投放服务器可以确定待投放媒体内容为通过图像传递媒体信息的媒体内容。如此,可以向UE投放适合用户的媒体内容,可以提升用户体验和媒体内容的投放效果。
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:若以下任意一项成立,则确定待投放媒体内容为通过语音传递媒体信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。
作为一种示例,若呼叫业务人机交互环境指示信息指示的人机交互环境如表1所示,则媒体投放服务器确定待投放媒体内容为通过语音传递媒体信息的媒体内容。本申请实施例中,“/”表示任何状态都可以,或者呼叫业务人机交互环境指示信息不指示该状态,在此做出统一说明,后面不再赘述。从表1可以看出,若UE的屏幕未点亮,则表示用户可能不想看屏幕,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定待投放媒体内容为通过语音传递媒体信息的媒体内容。若UE的屏幕点亮、且UE的呼叫程序的界面不可见,则表示用户在操作其他应用程序,虽然用户有注视屏幕的可能,但不便在视觉上打扰用户,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定待投放媒体内容为通过语音传递媒体信息的媒体内容。若UE的屏幕点亮、UE的有线耳机插入(或UE的无线耳机连接)、且用户未在UE的可视范围内,则用户注视屏幕的可能性小,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定待投放媒体内容为通过语音传递媒体信息的媒体内容。
表1
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定 待投放媒体内容,包括:若以下任意一项成立,则确定待投放媒体内容为通过图像传递信息的媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能关闭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启。具体的,可以如表2所示。
表2
情况2:媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定媒体形式,并确定符合该媒体形式的媒体内容为待投放媒体内容。
情况2中的媒体形式的介绍可以参考上述对本申请实施例涉及的相关技术术语的解释说明,在此不做赘述。
可以理解的,媒体投放服务器可以根据不同的呼叫业务人机交互环境,确定与该呼叫业务人机交互环境对应的媒体形式。示例性的,若呼叫业务人机交互环境适合用户听UE播放的声音,则媒体投放服务器可以确定媒体形式为音频形式。若呼叫业务人机交互环境适合用户观看UE播放的视频,则媒体投放服务器可以确定媒体形式为有声视频形式。若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放外音,则媒体投放服务器可以确定媒体形式为无声视频形式。若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放的外音过高,则媒体投放服务器可以确定媒体形式为低音视频形式。后续,媒体投放服务器确定符合该媒体形式的媒体内容为待投放媒体内容即可。如此,一方面,可以向UE投放适合用户的媒体内容,提升用户体验和媒体内容的投放效果。另一方面,在呼叫业务人机交互环境适合用户听UE播放的声音的情况下,不会向UE投放视频形式的媒体内容,在提升用户体验的同时还可以减少或避免UE的数据流量的消耗、节约空口资源。
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定媒体形式为音频形式:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内,或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。
作为一种示例,若呼叫业务人机交互环境指示信息指示的人机交互环境如表3所示,则媒体投放服务器确定媒体形式为音频形式。从表3可以看出,若UE的屏幕未点亮,则表示用户可能不想看屏幕,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定媒体形式为音频形式。若UE的屏幕点亮、且UE的呼叫程序的界面不可见,则表示用户在操作其他应用程序,虽然用户有注视屏幕的可能,但不便在视觉上打扰用户,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定媒体形式为音频形式。若UE的屏幕点亮、UE的有线耳机插入(或UE的无线耳机连接)、且用户未在UE的可视范围内,则用户注视屏幕的可能性小,所以呼叫业务人机交互环境适合用户听UE播放的声音,媒体投放服务器可以确定媒体形式为音频形式。
表3
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定媒体形式为有声视频形式:呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在UE的可视范围内。具体的,可以如表4所示。
表4
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。具体的,可以如表5所示。
表5
一种可能的实现方式,媒体投放服务器根据呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定媒体形式为低音视频形式:呼叫业务人机交互环境指示信息指示UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的无线耳机连接;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在UE的可视范围内。具体的,可以如表6所示。
表6
情况3:媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定用户的群体类型,根据群体类型确定待投放媒体内容。
本申请实施例中,群体类型可以根据用户的年龄划分。例如群体类型包括第一类群体,第一类群体可以是青年群体。青年群体的年龄大于或等于第一数值,并且小于或等于第二数值。第一数值和第二数值为正整数,并且第一数值小于第二数值。例如,青年群体的年龄大于或等于18岁,并且小于或等于40岁。
可以理解的,媒体投放服务器可以根据不同的呼叫业务人机交互环境,确定与该呼叫业务人机交互环境对应的群体类型。示例性的,若呼叫业务人机交互环境为适合青年群体的环境,则媒体投放服务器可以确定用户的群体类型为青年群体。后续,媒体投放服务器确定符合该群体类型的媒体内容为待投放媒体内容即可。如此,可以向UE投放适合用户所属的群体的媒体内容,提升用户体验和媒体内容的投放效果。
一种可能的实现方式,媒体投放服务器可以根据呼叫业务人机交互环境指示信息确定用户的群体类型,包括:若以下任意一项成立,则确定用户的群体类型为第一类群体:呼叫业务人机交互环境指示信息指示UE的有线耳机插入;或者,呼叫业务人机交互环境指示信息指示UE的无线耳机连接。具体的,可以如表7所示。
表7
可以理解的,上述表1-表7仅是媒体投放服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容的示例,在具体应用中,媒体投放服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容还可以有其他情况,本申请实施例不进行具体限定。
可以理解的,在S503a中,媒体投放服务器除了根据呼叫业务人机交互环境指示信息确定待投放媒体内容,还可以将呼叫业务人机交互环境指示信息和一些其他信息(如:当前时间、用户标签属性等信息)结合起来,确定待投放媒体内容,使得待投放媒体内容更适合用户。
对于上述情况1-情况3,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3031根据呼叫业务人机交互环境指示信息确定待投放媒体内容。若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容。
对于上述情况1-情况3,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3061根据呼叫业务人机交互环境指示信息确定待投放媒体内容。若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被部署在多个物理设备,则 媒体决策服务器根据呼叫业务人机交互环境指示信息确定待投放媒体内容。
S504a:媒体投放服务器在呼叫业务进行期间向UE投放待投放媒体内容。对应的,UE接收媒体投放服务器发送的待投放媒体内容。
一种可能的实现方式,媒体投放服务器在呼叫业务进行期间、通过媒体通道向UE发送待投放媒体内容。其中,媒体通道的介绍可以参考上述对本申请实施例涉及的相关技术术语中的解释说明,在此不做赘述。
可以理解的,上述媒体通道可以是在S503a之前建立的,也可以是在S503a之后建立的。若媒体通道是在S503a之前建立的,则在S503a之前,媒体投放服务器可以根据呼叫业务建立媒体通道。例如,若呼叫业务为语音通话业务,则媒体投放服务器建立音频媒体通道,若呼叫业务为视频通话业务,则媒体投放服务器建立视频媒体通道。后续,媒体投放服务器确定了待投放媒体内容后(即S503a之后),若媒体投放服务器确定的媒体通道能够传输待投放媒体内容,则媒体投放服务器通过该媒体通道向UE发送待投放媒体内容。若媒体投放服务器确定的媒体通道不能传输待投放媒体内容,则媒体投放服务器切换媒体通道,并通过切换后的媒体通道向UE发送待投放媒体内容。
示例性的,若媒体投放服务器确定的媒体通道为音频媒体通道(或视频媒体通道),且待投放媒体内容的媒体形式为音频形式(或视频形式)(即媒体投放服务器确定的媒体通道能够传输待投放媒体内容),则媒体投放服务器通过该媒体通道向UE发送待投放媒体内容。
示例性的,若媒体投放服务器确定的媒体通道为音频媒体通道,而待投放媒体内容的媒体形式不为音频(即媒体投放服务器确定的媒体通道不能传输待投放媒体内容),则媒体投放服务器将音频媒体通道切换为视频媒体通道,通过视频媒体通道向UE发送待投放媒体内。
示例性的,若媒体投放服务器确定的媒体通道为视频媒体通道,而待投放媒体内容的媒体形式不为视频形式(即媒体投放服务器确定的媒体通道不能传输待投放媒体内容),则媒体投放服务器将视频媒体通道切换为音频媒体通道,通过视频媒体通道向UE发送待投放媒体内。
可以理解的,若媒体通道是在S503a之后建立的,则媒体投放服务器可以根据待投放媒体内容建立媒体通道。例如,若待投放媒体内容的媒体形式为音频,则媒体投放服务器建立音频媒体通道,若待投放媒体内容的媒体形式为视频形式,则媒体投放服务器建立视频媒体通道。
可以理解的,待投放媒体内容投放结束后,若用于传输待投放媒体内容的媒体通道能够用于呼叫业务,则UE通过用于传输待投放媒体内容的媒体通道与其他UE进行呼叫业务。若用于传输待投放媒体内容的媒体通道不能用于呼叫业务,则UE切换媒体通道,并通过切换后的媒体通道与其他UE进行呼叫业务。
示例性的,若用于传输待投放媒体内容的媒体通道为音频媒体通道(或视频媒体通道),且呼叫业务为语音通话业务(或视频通话业务)(即用于传输待投放媒体内容的媒体通道能够用于呼叫业务),则UE通过用于传输待投放媒体内容的媒体通道与其他UE进行呼叫业务。
示例性的,若用于传输待投放媒体内容的媒体通道为音频媒体通道,而呼叫业务为视频通话业务(即用于传输待投放媒体内容的媒体通道不能用于呼叫业务),则UE将音频媒体通道切换为视频媒体通道,并通过视频媒体通道与其他UE进行呼叫业务。
示例性的,若用于传输待投放媒体内容的媒体通道为视频媒体通道,而呼叫业务为音频通话业务(即用于传输待投放媒体内容的媒体通道不能用于呼叫业务),则UE将视频媒体通道切换为音频媒体通道,并通过音频媒体通道与其他UE进行呼叫业务。
一种可能的实现方式,在S504a中,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3031确定了待投放媒体内容后,向媒体应用模块3032发送待投放媒体内容的信息,媒体应用模块3032接收到待投放媒体内容的信息后,向媒体资源管理模块3033发送info消息,以控制媒体资源管理模块3033向UE投放待投放媒体内容。
一种可能的实现方式,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器确定了待投放媒体内容后,向Media AS发送待投放媒体内容的信息,Media AS接收到待投放媒体内容的信息后,向MRS发送info消息,以控制MRS向UE投放待投放媒体内容。若以图1所示的流程为例,则S504a可以对应上述S126-S127。
可以理解的,上述两种可能的实现方式中,待投放媒体内容的信息可以指示待投放媒体内容。
一种可能的实现方式,在S504a中,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3061确定了待投放媒体内容后,向UE发送待投放媒体内容的地址,UE接收到待投放媒体内容的地址后,向媒体资源管理模块3062请求待投放媒体内容,以使得媒体资源管理模块3062向UE投放待投放媒体内容。或者,媒体决策模块3061确定了待投放媒体内容后,控制媒体资源管理模块3062向UE投放待投放媒体内容,例如,媒体决策模块3061控制媒体资源管理模块3062向UE发送上述请求媒体内容的请求消息的响应消息,该响应消息包括待投放媒体内容。
一种可能的实现方式,在S504a中,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器确定了待投放媒体内容后,向UE发送待投放媒体内容的地址,UE接收到待投放媒体内容的地址后,向MRS请求待投放媒体内容,以使得MRS向UE投放待投放媒体内容。若以图2所示的流程为例,则S504a可以对应上述S224-S226。
S505a:UE通过呼叫程序相关的程序单元呈现待投放媒体内容。
本申请实施例中,呼叫程序相关的程序单元可以是呼叫程序的至少一个进程或至少一个线程。呼叫程序相关的程序单元可以有界面,也可以没有界面。若呼叫程序相关的程序单元有界面,则该界面可以占据UE的整个屏幕(如:该界面为全屏窗口),该界面也可以不占据UE的整个屏幕(如:该界面为悬浮窗口,可以悬浮在UE的主页面上,也可以悬浮在UE的前台运行的应用程序的界面上面)。该界面可以是呼叫程序自身的界面,也可以不是呼叫程序自身的界面(如UE接收到待投放媒体内容后,经相关应用程序触发而弹出的界面)。若呼叫程序相关的程序单元没有界面,则该呼 叫程序相关的程序单元可以为后台进程或后台线程。
本申请实施例中,UE通过呼叫程序相关的程序单元呈现待投放媒体内容也可以描述为:UE通过呼叫程序相关的程序单元播放待投放媒体内容。
基于上述S501-S505a,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器,使得媒体投放服务器可以根据该指示信息确定待投放媒体内容。而呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境指示信息确定的待投放媒体内容更符合用户的需求,可以提高用户体验和媒体内容的投放效果。
本申请实施例中,S503a-S505a还可以替换为S503b。
S503b:媒体投放服务器根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容。
可以理解的,媒体投放服务器可以根据不同的呼叫业务人机交互环境,确定是否在呼叫业务进行期间向UE投放媒体内容。示例性的,若呼叫业务人机交互环境适合投放媒体内容,则媒体投放服务器可以确定在呼叫业务进行期间向UE投放媒体内容。若呼叫业务人机交互环境不适合投放媒体内容,则媒体投放服务器可以确定在呼叫业务进行期间不向UE投放媒体内容。如此,可以在呼叫业务人机交互环境不适合投放媒体内容的情况下,不向UE投放媒体内容,提升了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。
一种可能的实现方式,媒体投放服务器根据根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容,包括:若以下任意一项成立,则确定在呼叫业务进行期间不向UE投放媒体内容:呼叫业务人机交互环境指示信息指示UE的屏幕熄灭;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,呼叫业务人机交互环境指示信息指示UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。具体的,可以如表8所示。
表8
可以理解的,上述表8仅是媒体投放服务器根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容的示例,在具体应用中,媒体投放服务器根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容还可以有其他情况,本申请实施例不进行具体限定。
可选的,S503b之后,媒体投放服务器可以向UE发送第一指示信息,该第一指示信息用于指示在呼叫业务进行期间不向UE投放媒体内容。UE接收到第一指示信息后,根据第一指示信息确定不呈现媒体内容。
一种可能的实现方式,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3031可以确定在呼叫业务进行期间不向UE投放媒体内容。后续,媒体决策模块3031可以通过媒体应用模块3032向UE发送第一指示信息。若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器可以确定在呼叫业务进行期间不向UE投放媒体内容。后续,媒体决策服务器可以向Media AS发送第一指示信息,Media AS接收到第一指示信息后,向UE发送第一指示信息。
一种可能的实现方式,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3061可以确定在呼叫业务进行期间不向UE投放媒体内容。后续,媒体决策模块3061可以向UE 发送上述请求媒体内容的请求消息的响应消息,该响应消息包括第一指示信息。若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器可以确定在呼叫业务进行期间不向UE投放媒体内容。后续,媒体决策服务器可以向UE发送上述请求媒体内容的请求消息的响应消息,该响应消息包括第一指示信息。
可以理解的,S503b之后,媒体投放服务器也可以不向UE发送第一指示信息,也就是说,媒体投放服务器可以不向UE指示在呼叫业务进行期间不向UE投放媒体内容。可选的,在这种情况下,UE在预设时间范围内未接收到媒体投放服务器发送的关于呈现媒体内容的指示信息,UE确定不呈现媒体内容。例如,可以为UE配置定时器,UE向媒体投放服务器发送呼叫业务人机交互环境指示信息时,或者UE在向媒体投放服务器发送呼叫业务人机交互环境指示信息之后,或者UE呼叫其他UE之后,开启定时器。在定时器超时,UE还未接收到媒体投放服务器发送的关于呈现媒体内容的指示信息的情况下,UE确定不呈现媒体内容。
可选的,在S503b之前,或者在S503b之后,媒体投放服务器根据呼叫业务建立媒体通道。例如,若呼叫业务为语音通话业务,则媒体投放服务器建立音频媒体通道,若呼叫业务为视频通话业务,则媒体投放服务器建立视频媒体通道。其中,媒体通道的介绍可以参考上述对本申请实施例涉及的相关技术术语中的解释说明,在此不做赘述。
基于上述S501-S502以及S503b,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器,使得媒体投放服务器可以根据该指示信息确定在呼叫业务进行期间不向UE投放媒体内容。而呼叫业务人机交互环境指示信息指示的人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,可以在不适合向UE投放媒体内容的情况下,例如,用户未注视屏幕、或者用户不适合观看和听媒体内容的情况下,不向UE投放媒体内容,提高了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。
其中,上述S501-S505a和S503b中的UE或者媒体投放服务器的动作可以由图4所示的设备40中的处理器401调用存储器403中存储的应用程序代码来执行,本申请实施例对此不做任何限制。
可选的,如图7所示,在图5所示方法的一种可能的实现方式中,S501包括S701-S706中的至少一个步骤。
S701:UE检测UE的屏幕是否点亮。
示例性的,以Android为例,UE可以通过电源管理模块(PowerManager)的能力检测UE的屏幕是否点亮。例如,UE可以通过如下程序代码检测UE的屏幕是否点亮:
import android.os.PowerManager;
PowerManager pm=(PowerManager)
getSystemService(Context.POWER_SERVICE);//如果应用程序不是在Activity里面,则可以获取呼叫业务人机交互环境指示信息,并通过context.getSystemService在呼叫业务人机交互环境指示信息中获取UE的屏幕是否点亮;
boolean isScreenOn=pm.isScreenOn();
其中,在isScreenOn的结果为“真”的情况下,UE的屏幕点亮,在isScreenOn的结果为“假”的情况下,UE的屏幕熄灭。
S702:UE检测UE的呼叫程序的的界面是否可见。
可以理解的,呼叫程序有多种生命周期状态,例如,活动状态(active)、暂停状态(paused)、停止状态(stopped)等。
呼叫程序的活动状态可以指当呼叫程序对应的Activity运行在屏幕前台(即:处于当前任务活动栈的最上面),此时它获取了焦点,能响应用户的操作。同一个时刻会有一个Activity处于活动状态。
呼叫程序的暂停状态可以指呼叫程序对应的Activity失去焦点,但是仍对用户可见,即:呼叫程序的Activity之上有另一个透明的Activity或Toast、AlertDialog等弹出窗口。通常暂停的Activity仍然是存活状态,保留着所有的状态和成员信息并保持和窗口管理器的连接,但是当系统内存极小时可以被系统杀掉。
呼叫程序的停止状态可以指呼叫程序对应的Activity被另一个Activity遮挡时处于停止状态,呼叫程序对应的Activity仍然在内存中保留着所有的状态和成员信息,但是对用户不可见,当其他地方需要内存时呼叫程序对应的Activity往往被系统杀掉。
一种可能的实现方式,UE中的呼叫程序可以感知自己的生命周期状态,UE根据呼叫程序感知到的生命周期状态确定UE的呼叫程序的的界面是否可见。例如,若呼叫程序的生命周期状态为活动状态,则UE确定呼叫程序的的界面可见;若呼叫程序的生命周期状态为暂停状态或停止状态,则UE确定呼叫程序的的界面不可见。
S703:UE检测UE的免提功能是否开启。
示例性的,以Android为例,UE可以通过音频管理模块(AudioManager)检测UE的免提功能是否开启。例如,UE可以通过如下程序代码检测UE的免提功能是否开启:
AudioManager audioManager=
(AudioManager)context.getSystemService(Context.AUDIO_SERVICE);
audioManager.isSpeakerphoneOn();
其中,在isSpeakerphoneOn的结果为“真”的情况下,UE的免提功能开启,在isSpeakerphoneOn的结果为“假”的情况下,UE的免提功能关闭。
S704:UE检测UE的有线耳机是否插入。
示例性的,以Android为例,UE可以通过音频管理模块检测UE的有线耳机是否插入。例如,UE可以通过如下程序代码检测UE的有线耳机是否插入:
AudioManager audioManager=
(AudioManager)context.getSystemService(Context.AUDIO_SERVICE);
audioManager.isWiredHeadsetOn();
其中,在isWiredHeadsetOn的结果为“真”的情况下,UE的有线耳机插入,在isWiredHeadsetOn的结果为“假”的情况下,UE的有线耳机未插入。
S705:UE检测UE的无线耳机是否连接。
示例性的,以Android为例,UE可以通过音频管理模块检测UE的无线耳机是否连接。例如,UE可以通过如下程序代码检测UE的无线耳机是否连接:
AudioManager audioManager=
(AudioManager)context.getSystemService(Context.AUDIO_SERVICE);
audioManager.isBluetoothScoOn();
其中,在isBluetoothScoOn的结果为“真”时,UE的无线耳机连接,在isBluetoothScoOn的结果为“假”时,UE的无线耳机未连接。
S706:UE检测用户是否在UE的可视范围内。
一种可能的实现方式,UE通过UE的摄像头检测用户是否在UE的可视范围内。例如,UE通过UE的前置摄像头获取图像信息,UE根据图像信息识别用户的眼睛是否可能注视屏幕。其中,图像信息可以包括至少一张图像或连续的图像序列(如视频)等。
示例性的,以Android为例,UE通过相机管理(CAMERA),执行下面的代码,开启摄像头,并获取图像信息。
一种可能的实现方式,UE可以通过API,开启前置摄像头,定期拍照获取图像信息。在获取图像信息后,UE可以基于人脸检测技术,识别图像信息中的人脸信息(如:是否包含完整人脸、部分人脸、无人脸,以及存在人脸时识别人脸的大小)。若UE检测不到人脸,或检测的人脸过小,则说明用户可能距离UE的屏幕比较远,用户注视屏幕的概率较低。在这种情况,UE确定用户未在UE的可视范围内。若UE检测到人脸(或部分人脸),并且检测到的人脸(或部分人脸)足够大,则说明用户可能在注视UE的屏幕。在这种情况,UE确定用户在UE的可视范围内。
示例性的,如图8A所示,用户在手机的前置摄像头的拍摄范围之外,所以UE检测不到人脸,UE可以确定用户未在UE的可视范围内。如图8B所示,用户在手机的 前置摄像头的拍摄范围之内并且用户里手机较近,所以UE可以检测到人脸并且人脸足够大,UE可以确定用户在UE的可视范围内。
基于图7所示方法,UE可以检测以下任一项:UE的屏幕是否点亮、UE的呼叫程序的的界面是否可见、UE的免提功能是否开启、UE的有线耳机是否插入、UE的无线耳机是否连接、或用户是否在UE的可视范围内,进而获取呼叫业务人机交互环境指示信息。
其中,上述S701-S706中的UE的动作可以由图4所示的设备40中的处理器401调用存储器403中存储的应用程序代码来执行,本申请实施例对此不做任何限制。
在上述图5所示的方法中,UE可以将呼叫业务人机交互环境指示信息发送给媒体投放服务器,使得媒体投放服务器可以根据该指示信息确定待投放媒体内容,或者,使得媒体投放服务器可以根据该指示信息确定在呼叫业务进行期间不向UE投放媒体内容。在具体应用中,UE也可以自己确定媒体形式,或者确定在呼叫业务进行期间不呈现媒体内容。如此,UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,以保护用户的隐私,提高信息安全。具体的,可以参考下述图9或图10所示的方法。
如图9所示,为本申请实施例提供的又一种媒体内容的投放方法,该媒体内容的投放方法包括S901-S906a,或者,该媒体内容的投放方法包括S901以及S902b。
S901:UE确定呼叫业务人机交互环境。
其中,UE可以是图3A或图3B中的任一UE。例如,该UE可以为图3A中的UE 301或UE 302;或者,该UE可以为图3B中的UE 304或UE 305。
本申请实施例中,呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境。具体的,可以参考上述S501中对应的描述,在此不做赘述。
一种可能的实现方式,在呼叫业务即将开始,或者在呼叫业务已经开始的情况下,UE确定呼叫业务人机交互环境。以图1所示的呼叫过程为例,S901可以在S125之前执行。以图2所示的呼叫过程为例,S901可以在S222之前执行。
一种可能的实现方式,UE确定呼叫业务人机交互环境,包括以下至少一项:UE检测UE的屏幕是否点亮;或者,UE检测UE的呼叫程序的的界面是否可见;或者,UE检测UE的免提功能是否开启;或者,UE检测UE的有线耳机是否插入;或者,UE检测UE的无线耳机是否连接;或者,UE检测用户是否在UE的可视范围内。具体的,可以参考上述图7所示的方法中所述,此处不做赘述。
S902a:UE根据呼叫业务人机交互环境确定媒体形式。
本申请实施例中,媒体形式的介绍可以参考上述对本申请实施例涉及的相关技术术语的解释说明,在此不做赘述。
可以理解的,UE可以根据不同的呼叫业务人机交互环境,确定与该呼叫业务人机交互环境对应的媒体形式。示例性的,若呼叫业务人机交互环境适合用户听UE播放的声音,则UE可以确定媒体形式为音频形式。若呼叫业务人机交互环境适合用户观看UE播放的视频,则UE可以确定媒体形式为有声视频形式。若呼叫业务人机交互环境适合用户观看UE播放的视频,但呼叫业务人机交互环境不适合UE播放外音,则UE可以确定媒体形式为无声视频形式。若呼叫业务人机交互环境适合用户观看UE 播放的视频,但呼叫业务人机交互环境不适合UE播放的外音过高,则UE可以确定媒体形式为低音视频形式。后续,UE可以向媒体投放服务器请求符合该媒体形式的媒体内容,并呈现该媒体内容。如此,一方面,UE可以呈现适合用户的媒体内容,提升用户体验和媒体内容的投放效果。另一方面,在呼叫业务人机交互环境适合用户听UE播放的声音的情况下,UE不会向媒体投放服务器请求视频形式的媒体内容,在提升用户体验的同时还可以减少或避免UE的数据流量的消耗,节约空口资源。
一种可能的实现方式,UE根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为音频形式:检测到UE的屏幕熄灭,或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见,或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内,或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。具体的,可以参考上述S503a中所述,在此不做赘述。
一种可能的实现方式,UE根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为有声视频形式:检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的有线耳机插入;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的无线耳机连接、且用户在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的有线耳机插入、且用户在UE的可视范围内。具体的,可以参考上述S503a中所述,在此不做赘述。
一种可能的实现方式,UE根据呼叫业务人机交互环境确定媒体形式,包括:若检测到UE的屏幕点亮、UE的呼叫程序的界面可见、且UE的免提功能开启,则确定媒体形式为无声视频形式。具体的,可以参考上述S503a中所述,在此不做赘述。
一种可能的实现方式,UE根据呼叫业务人机交互环境确定媒体形式,包括:若检测到以下任一环境,则确定媒体形式为低音视频形式:检测到UE的有线耳机插入;或者,检测到UE的无线耳机连接;或者,检测到UE的屏幕点亮、UE的呼叫程序的界面可见、UE的免提功能关闭、UE的有线耳机未插入、UE的无线耳机未连接、且用户在UE的可视范围内。具体的,可以参考上述S503a中所述,在此不做赘述。
S903a:UE向媒体投放服务器发送媒体形式的指示信息。对应的,媒体投放服务器接收UE发送的媒体形式的指示信息。
本申请实施例中,若UE为图3A中的UE 301或UE 302,则媒体投放服务器可以为图3A中的媒体投放服务器303。若UE为图3B中的UE 304或UE 305,则媒体投放服务器可以是图3B中的媒体投放服务器306。
本申请实施例中,媒体形式的指示信息可以包括至少1比特。该至少1比特可以指示UE确定的媒体形式。
作为一种示例,若媒体形式包括音频形式或视频形式,则媒体形式的指示信息包括1比特。若UE确定的媒体形式为音频形式,则该1比特的值为“0”,若UE确定的媒体形式为视频形式,则该1比特的值为“1”,反之亦然。
作为另一种示例,若媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式,则媒体形式的指示信息包括2比特。若UE确定的媒体形式为音频形式, 则该2比特的值为“00”,若UE确定的媒体形式为无声视频形式,则该2比特的值为“01”,若UE确定的媒体形式为有声视频形式,则该2比特的值为“10”,若UE确定的媒体形式为低音视频形式,则该2比特的值为“11”。
可以理解的,如前文所述,媒体投放服务器具备的功能可以被集中部署在一个物理设备,也可以被部署在多个物理设备上。以图3A所示的通信系统为例,若媒体投放服务器303具备的功能被集中部署在一个物理设备,则UE向媒体应用模块3032发送媒体形式的指示信息。对应的,媒体应用模块3032接收UE发送的媒体形式的指示信息。后续,媒体应用模块3032可以向媒体决策模块3031发送媒体形式的指示信息。若媒体投放服务器303具备的功能被部署在多个物理设备上,则UE向Media AS发送媒体形式的指示信息。对应的,Media AS接收UE发送的媒体形式的指示信息。后续,Media AS可以向媒体决策服务器发送媒体形式的指示信息。以图1所示的流程为例,Media AS可以通过S125中的请求消息向媒体决策服务器发送媒体形式的指示信息,也就是说,媒体形式的指示信息可以包括在S125中的请求消息中。
以图3B所示的通信系统为例,若媒体投放服务器306具备的功能被集中部署在一个物理设备,则UE向媒体决策模块3061发送媒体形式的指示信息。对应的,媒体决策模块3061接收UE发送的媒体形式的指示信息。若媒体投放服务器306具备的功能被部署在多个物理设备上,则UE向媒体决策服务器发送媒体形式的指示信息。对应的,媒体决策服务器接收UE发送的媒体形式的指示信息。以图2所示的流程为例,UE可以通过S222中的请求消息向媒体决策服务器发送媒体形式的指示信息,也就是说,媒体形式的指示信息可以包括在S222中的请求消息中。
S904a:媒体投放服务器根据媒体形式的指示信息,确定符合媒体形式的媒体内容。
示例性的,若媒体形式的指示信息指示UE确定的媒体形式为音频形式,则媒体投放服务器确定音频形式的媒体内容为符合媒体形式的媒体内容。若媒体形式的指示信息指示UE确定的媒体形式为无声视频形式,则媒体投放服务器确定无声视频形式的媒体内容为符合媒体形式的媒体内容。若媒体形式的指示信息指示UE确定的媒体形式为有声视频形式,则媒体投放服务器确定有声视频形式的媒体内容为符合媒体形式的媒体内容。若媒体形式的指示信息指示UE确定的媒体形式为低音视频形式,则媒体投放服务器确定低音视频形式的媒体内容为符合媒体形式的媒体内容。
S905a:媒体投放服务器向UE发送符合媒体形式的媒体内容。对应的,UE接收媒体投放服务器发送的符合媒体形式的媒体内容。
一种可能的实现方式,媒体投放服务器通过媒体通道向UE发送符合媒体形式的媒体内容。其中,媒体通道的介绍可以参考上述对本申请实施例涉及的相关技术术语中的解释说明,在此不做赘述。
可以理解的,上述媒体通道可以是在S904a之前建立的,也可以是在S904a之后建立的。若媒体通道是在S904a之前建立的,则在S904a之前,媒体投放服务器可以根据呼叫业务建立媒体通道。例如,若呼叫业务为语音通话业务,则媒体投放服务器建立音频媒体通道,若呼叫业务为视频通话业务,则媒体投放服务器建立视频媒体通道。后续,媒体投放服务器确定了符合媒体形式的媒体内容后(即S904a之后),若媒体投放服务器确定的媒体通道能够传输符合媒体形式的媒体内容,则媒体投放服务 器通过该媒体通道向UE发送符合媒体形式的媒体内容。若媒体投放服务器确定的媒体通道不能传输符合媒体形式的媒体内容,则媒体投放服务器切换媒体通道,并通过切换后的媒体通道向UE发送符合媒体形式的媒体内容。
可以理解的,若媒体通道是在S904a之后建立的,则媒体投放服务器可以根据UE确定的媒体形式建立媒体通道。例如,若UE确定的媒体形式为音频形式,则媒体投放服务器建立音频媒体通道,若UE确定的媒体形式为视频形式,则媒体投放服务器建立视频媒体通道。
可以理解的,符合媒体形式的媒体内容投放结束后,若用于传输符合媒体形式的媒体内容的媒体通道能够用于呼叫业务,则UE通过用于传输符合媒体形式的媒体内容的媒体通道与其他UE进行呼叫业务。若用于传输符合媒体形式的媒体内容的媒体通道不能用于呼叫业务,则UE切换媒体通道,并通过切换后的媒体通道与其他UE进行呼叫业务。
一种可能的实现方式,在S905a中,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3031确定了符合媒体形式的媒体内容后,向媒体应用模块3032发送符合媒体形式的媒体内容的信息,媒体应用模块3032接收到符合媒体形式的媒体内容的信息后,向媒体资源管理模块3033发送info消息,以控制媒体资源管理模块3033向UE投放符合媒体形式的媒体内容。
一种可能的实现方式,若媒体投放服务器为图3A中的媒体投放服务器303,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器确定了符合媒体形式的媒体内容后,向Media AS发送符合媒体形式的媒体内容的信息,Media AS接收到符合媒体形式的媒体内容的信息后,向MRS发送info消息,以控制MRS向UE投放符合媒体形式的媒体内容。若以图1所示的流程为例,则S905a可以对应上述S126-S127。
可以理解的,上述两种可能的实现方式中,符合媒体形式的媒体内容的信息可以指示待投放媒体内容。
一种可能的实现方式,在S905a中,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被集中部署在一个物理设备,则媒体决策模块3061确定了符合媒体形式的媒体内容后,向UE发送符合媒体形式的媒体内容的地址,UE接收到符合媒体形式的媒体内容的地址后,向媒体资源管理模块3062请求符合媒体形式的媒体内容,以使得媒体资源管理模块3062向UE投放符合媒体形式的媒体内容。或者,媒体决策模块3061确定了符合媒体形式的媒体内容后,控制媒体资源管理模块3062向UE投放符合媒体形式的媒体内容,例如,媒体决策模块3061控制媒体资源管理模块3062向UE发送上述请求媒体内容的请求消息的响应消息,该响应消息包括符合媒体形式的媒体内容。
一种可能的实现方式,在S905a中,若媒体投放服务器为图3B中的媒体投放服务器306,并且媒体投放服务器具备的功能被部署在多个物理设备,则媒体决策服务器确定了符合媒体形式的媒体内容后,向UE发送符合媒体形式的媒体内容的地址,UE接收到符合媒体形式的媒体内容的地址后,向MRS请求符合媒体形式的媒体内容, 以使得MRS向UE投放符合媒体形式的媒体内容。若以图2所示的流程为例,则S905a可以对应上述S224-S226。
S906a:UE通过呼叫程序相关的程序单元呈现媒体内容。
S906a的介绍可以参考上述S505a中对应的介绍,在此不做赘述。
基于上述S901-S906a,UE可以确定呼叫业务人机交互环境,根据该呼叫业务人机交互环境确定媒体形式,向媒体投放服务器指示该媒体形式,使得媒体投放服务器可以根据该媒体形式确定符合该媒体形式的媒体内容,并向UE发送该媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境确定的媒体形式更符合用户的需求,可以提高用户体验和媒体内容的投放效果。
本申请实施例中,S902a-S906a还可以替换为S902b。
S902b:UE根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
可以理解的,UE可以根据不同的呼叫业务人机交互环境,确定是否在呼叫业务进行期间呈现媒体内容。示例性的,若呼叫业务人机交互环境适合投放媒体内容,则UE可以确定在呼叫业务进行期间呈现媒体内容。若呼叫业务人机交互环境不适合投放媒体内容,则UE可以确定在呼叫业务进行期间不呈现媒体内容。如此,UE可以在呼叫业务人机交互环境不适合投放媒体内容的情况下,不呈现媒体内容,提升了用户体验,还可以减少或避免UE的数据流量的消耗。
一种可能的实现方式,UE根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容,包括:若检测到以下任一环境,则确定在呼叫业务进行期间不呈现媒体内容:检测到UE的屏幕熄灭;或者,检测到UE的屏幕点亮、且UE的呼叫程序的界面不可见;或者,检测到UE的屏幕点亮、UE的有线耳机插入、且用户不在UE的可视范围内;或者,检测到UE的屏幕点亮、UE的无线耳机连接、且用户不在UE的可视范围内。具体的,可以参考上述S503b中所述,在此不做赘述。
可选的,在S902b之前,或者在S902b之后,UE根据呼叫业务建立媒体通道。例如,若呼叫业务为语音通话业务,则UE建立音频媒体通道,若呼叫业务为视频通话业务,则UE建立视频媒体通道。其中,媒体通道的介绍可以参考上述对本申请实施例涉及的相关技术术语中的解释说明,在此不做赘述。
基于上述S901以及S902b,UE可以确定呼叫业务人机交互环境,根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,可以在UE不适合呈现媒体内容的情况下,例如,用户未注视屏幕、或者用户不适合观看和听媒体内容的情况下,不呈现媒体内容,提高了用户体验。另外,UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,以保护用户的隐私,提高信息安全。
其中,上述S901-S906a和S902b中的UE或者媒体投放服务器的动作可以由图4所示的设备40中的处理器401调用存储器403中存储的应用程序代码来执行,本申请实施例对此不做任何限制。
如图10所示,为本申请实施例提供的又一种媒体内容的投放方法,该媒体内容的 投放方法包括S1001-S1004a,或者,该媒体内容的投放方法包括S1001-S1002以及S1003b。
S1001:UE获取媒体内容的信息。
S1001中,媒体内容的信息可以包括多个媒体内容。多个媒体内容对应的媒体形式包括多种。例如,媒体内容的信息包括6个媒体内容,其中,2个媒体内容的形式为音频形式,2个媒体内容的形式为有声视频形式,2个媒体内容的形式为无声视频形式。
一种可能的实现方式,UE接收媒体投放服务器发送的媒体内容的信息。也就是说,媒体投放服务器可以提前将媒体内容的信息发送给UE。如此,UE确定了媒体形式后,即可将媒体内容的信息中、符合媒体形式的媒体内容呈现出来。
S1002:UE确定呼叫业务人机交互环境。
S1003a:UE根据呼叫业务人机交互环境确定媒体形式。
上述S1002-S1003a的介绍可以参考上述S901-S902a中对应的描述,在此不做赘述。
S1004a:UE通过呼叫程序相关的程序单元呈现媒体内容的信息中、符合媒体形式的媒体内容。
一种可能的实现方式,UE可以在媒体内容的信息中确定符合媒体形式的媒体内容。示例性的,若UE确定的媒体形式为音频形式,则UE确定媒体内容的信息中、音频形式的媒体内容为符合媒体形式的媒体内容。若UE确定的媒体形式为无声视频形式,则UE确定媒体内容的信息中、无声视频形式的媒体内容为符合媒体形式的媒体内容。若UE确定的媒体形式为有声视频形式,则UE确定媒体内容的信息中、有声视频形式的媒体内容为符合媒体形式的媒体内容。若UE确定的媒体形式为低声视频形式,则UE确定媒体内容的信息中、低声视频形式的媒体内容为符合媒体形式的媒体内容。后续,UE通过呼叫程序相关的程序单元呈现符合媒体形式的媒体内容。具体的,可以参考上述S505a中对应的介绍,在此不做赘述。
基于上述S1001-S1004a,UE可以先获取媒体内容的信息,确定呼叫业务人机交互环境,再根据该呼叫业务人机交互环境确定媒体形式。如此,UE可以在确定了媒体形式后,即可将媒体内容的信息中、符合媒体形式的媒体内容呈现出来。一方面,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,根据呼叫业务人机交互环境确定的媒体形式更符合用户的需求,可以提高用户体验和媒体内容的投放效果。另一方面,UE在确定了媒体形式后,不需要向媒体投放服务器请求媒体内容,直接在本地确定符合媒体形式的媒体内容,并呈现该媒体内容即可,可以及时呈现媒体内容,缩减了UE确定了媒体形式到UE呈现媒体内容的时间。而且UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,保护了用户的隐私,提高了信息安全。
本申请实施例中,S1003a-S1004a还可以替换为S1003b。
S1003b:UE根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
S1003b的介绍可以参考上述S902b中对应的描述,在此不做赘述。
基于上述S1001-S1002以及S1003b,UE可以先获取媒体内容的信息,确定呼叫 业务人机交互环境,根据该呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。其中,呼叫业务人机交互环境可以反映用户当前的状态,例如,用户是否注视UE的屏幕,用户是否适合观看媒体内容或听媒体内容等。因此,可以在UE不适合呈现媒体内容的情况下,例如,用户未注视屏幕、或者用户不适合观看和听媒体内容的情况下,不呈现媒体内容,提高了用户体验,还可以减少或避免UE的数据流量的消耗,节约空口资源。而且UE可以不向媒体投放服务器发送呼叫业务人机交互环境指示信息,保护了用户的隐私,提高了信息安全。
其中,上述S1001-S1004a和S1003b中的UE或者媒体投放服务器的动作可以由图4所示的设备40中的处理器401调用存储器403中存储的应用程序代码来执行,本申请实施例对此不做任何限制。
上述主要从各个设备之间交互的角度对本申请实施例提供的方案进行了介绍。可以理解的,上述媒体投放服务器或者UE等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法操作,本申请能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
本申请实施例可以根据上述方法示例对媒体投放服务器或UE进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
比如,以采用集成的方式划分各个功能模块的情况下,图11示出了一种媒体投放服务器110的结构示意图。媒体投放服务器110包括收发模块1101和处理模块1102。收发模块1101,也可以称为收发单元用以实现收发功能,例如可以是收发电路,收发机,收发器或者通信接口。
示例性地,媒体投放服务器110用于实现上述方法实施例中的媒体投放服务器的功能。媒体投放服务器110例如为图5所示的实施例或图7所示的实施例所述的媒体投放服务器。
其中,收发模块1101,用于接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在该呼叫业务进行期间该UE对应的用户的人机交互环境。处理模块1102,用于根据该呼叫业务人机交互环境指示信息确定待投放媒体内容。收发模块1101,还用于在该呼叫业务进行期间向该UE投放该待投放媒体内容。
或者,收发模块1101,用于接收UE发送的呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在该呼叫业务进行期间该UE对应的用户的人机交互环境。处理模块1102,用于根据呼叫业务人机交互环境指示信息确定在呼叫业务进行期间不向UE投放媒体内容。
当用于实现媒体投放服务器的功能时,关于媒体投放服务器110所能实现的其他 功能,可参考图5所示的实施例或图7所示的实施例的相关介绍,不多赘述。
在一个简单的实施例中,本领域的技术人员可以想到媒体投放服务器110可以采用图4所示的形式。比如,图4中的处理器401可以通过调用存储器403中存储的计算机执行指令,使得媒体投放服务器110执行上述方法实施例中所述的方法。
示例性的,图11中的收发模块1101和处理模块1102的功能/实现过程可以通过图4中的处理器401调用存储器403中存储的计算机执行指令来实现。或者,图11中的处理模块1102的功能/实现过程可以通过图4中的处理器401调用存储器403中存储的计算机执行指令来实现,图11中的收发模块1101的功能/实现过程可以通过图4中的通信接口404来实现。
比如,以采用集成的方式划分各个功能模块的情况下,图12示出了一种UE 120的结构示意图。UE 120包括处理模块1201和收发模块1202。收发模块1202,也可以称为收发单元用以实现收发功能,例如可以是收发电路,收发机,收发器或者通信接口。
示例性地,UE 120用于实现上述方法实施例中的UE的功能。UE 120例如为图5所示的实施例或图7所示的实施例所述的UE。
其中,处理模块1201,用于获取呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境。收发模块1202,用于向媒体投放服务器发送呼叫业务人机交互环境指示信息。收发模块1202,还用于接收媒体投放服务器发送的待投放媒体内容。处理模块1201,还用于通过呼叫程序相关的程序单元呈现待投放媒体内容。
或者,处理模块1201,用于获取呼叫业务人机交互环境指示信息,该呼叫业务人机交互环境指示信息指示在呼叫业务进行期间UE对应的用户的人机交互环境。收发模块1202,用于向媒体投放服务器发送呼叫业务人机交互环境指示信息。处理模块1201,还用于确定不呈现媒体内容。
当用于实现UE的功能时,关于UE 120所能实现的其他功能,可参考图5所示的实施例或图7所示的实施例的相关介绍,不多赘述。
或者,示例性地,UE 120例如为图9所示的实施例所述的UE。
其中,处理模块1201,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间该UE对应的用户的人机交互环境。处理模块1201,还用于根据呼叫业务人机交互环境确定媒体形式。收发模块1202,用于向媒体投放服务器发送媒体形式的指示信息。收发模块1202,还用于接收媒体投放服务器发送的符合媒体形式的媒体内容。处理模块1201,还用于通过呼叫程序相关的程序单元呈现该媒体内容。
或者,处理模块1201,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间该UE对应的用户的人机交互环境。处理模块1201,还用于根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
当用于实现UE的功能时,关于UE 120所能实现的其他功能,可参考图9所示的实施例的相关介绍,不多赘述。
或者,示例性地,UE 120例如为图10所示的实施例所述的UE。
其中,收发模块1202,用于获取媒体内容的信息。处理模块1201,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境。处理模块1201,还用于根据呼叫业务人机交互环境确定媒体形式,并通过呼叫程序相关的程序单元呈现该媒体内容的信息中,符合该媒体形式的媒体内容。
或者,收发模块1202,用于获取媒体内容的信息。处理模块1201,用于确定呼叫业务人机交互环境,该呼叫业务人机交互环境为在呼叫业务进行期间UE对应的用户的人机交互环境。处理模块1201,还用于根据呼叫业务人机交互环境确定在呼叫业务进行期间不呈现媒体内容。
当用于实现UE的功能时,关于UE 120所能实现的其他功能,可参考图10所示的实施例的相关介绍,不多赘述。
在一个简单的实施例中,本领域的技术人员可以想到UE 120可以采用图4所示的形式。比如,图4中的处理器401可以通过调用存储器403中存储的计算机执行指令,使得UE 120执行上述方法实施例中所述的方法。
示例性的,图12中的处理模块1201和收发模块1202的功能/实现过程可以通过图4中的处理器401调用存储器403中存储的计算机执行指令来实现。或者,图12中的处理模块1201的功能/实现过程可以通过图4中的处理器401调用存储器403中存储的计算机执行指令来实现,图12中的收发模块1202的功能/实现过程可以通过图4中的通信接口404来实现。
需要说明的是,以上模块或单元的一个或多个可以软件、硬件或二者结合来实现。当以上任一模块或单元以软件实现的时候,所述软件以计算机程序指令的方式存在,并被存储在存储器中,处理器可以用于执行所述程序指令并实现以上方法流程。该处理器可以内置于SoC(片上系统)或ASIC,也可是一个独立的半导体芯片。该处理器内处理用于执行软件指令以进行运算或处理的核外,还可进一步包括必要的硬件加速器,如现场可编程门阵列(field programmable gate array,FPGA)、PLD(可编程逻辑器件)、或者实现专用逻辑运算的逻辑电路。
当以上模块或单元以硬件实现的时候,该硬件可以是CPU、微处理器、数字信号处理(digital signal processing,DSP)芯片、微控制单元(microcontroller unit,MCU)、人工智能处理器、ASIC、SoC、FPGA、PLD、专用数字电路、硬件加速器或非集成的分立器件中的任一个或任一组合,其可以运行必要的软件或不依赖于软件以执行以上方法流程。
可选的,本申请实施例还提供了一种芯片系统,包括:至少一个处理器和接口,该至少一个处理器通过接口与存储器耦合,当该至少一个处理器执行存储器中的计算机程序或指令时,使得上述任一方法实施例中的方法被执行。在一种可能的实现方式中,该芯片系统还包括存储器。可选的,该芯片系统可以由芯片构成,也可以包含芯片和其他分立器件,本申请实施例对此不作具体限定。
可选的,本申请实施例还提供了一种计算机可读存储介质。上述方法实施例中的全部或者部分流程可以由计算机程序来指令相关的硬件完成,该程序可存储于上述计算机可读存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。计算机 可读存储介质可以是前述任一实施例的媒体投放服务器或UE的内部存储单元,例如媒体投放服务器或UE的硬盘或内存。上述计算机可读存储介质也可以是上述媒体投放服务器或UE的外部存储设备,例如上述媒体投放服务器或UE上配备的插接式硬盘,智能存储卡(smart media card,SMC),安全数字(secure digital,SD)卡,闪存卡(flash card)等。进一步地,上述计算机可读存储介质还可以既包括上述媒体投放服务器或UE的内部存储单元也包括外部存储设备。上述计算机可读存储介质用于存储上述计算机程序以及上述媒体投放服务器或UE所需的其他程序和数据。上述计算机可读存储介质还可以用于暂时地存储已经输出或者将要输出的数据。
可选的,本申请实施例还提供了一种计算机程序产品。上述方法实施例中的全部或者部分流程可以由计算机程序来指令相关的硬件完成,该程序可存储于上述计算机程序产品中,该程序在执行时,可包括如上述各方法实施例的流程。
可选的本申请实施例还提供了一种计算机指令。上述方法实施例中的全部或者部分流程可以由计算机指令来指令相关的硬件(如计算机、处理器、接入网设备、移动性管理网元或会话管理网元等)完成。该程序可被存储于上述计算机可读存储介质中或上述计算机程序产品中。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。
Claims (54)
- 一种媒体内容的投放方法,应用于媒体投放服务器,其特征在于,所述方法包括:接收用户设备发送的呼叫业务人机交互环境指示信息,所述呼叫业务人机交互环境指示信息指示在所述呼叫业务进行期间所述用户设备对应的用户的人机交互环境;根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容,且在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容;或者,根据所述呼叫业务人机交互环境指示信息确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容。
- 根据权利要求1所述的方法,其特征在于,所述人机交互环境包含以下任意一项或任意组合:所述用户设备的屏幕是否点亮、所述用户设备的呼叫程序的界面是否可见、所述用户设备的免提功能是否开启、所述用户设备的有线耳机是否插入、所述用户设备的无线耳机是否连接、或所述用户是否在所述用户设备的可视范围内。
- 根据权利要求1所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:根据所述呼叫业务人机交互环境指示信息确定媒体形式,所述媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式,所述低音视频形式的媒体内容的缺省音量大于0且小于预设阈值;确定符合所述媒体形式的媒体内容为所述待投放媒体内容。
- 根据权利要求3所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定所述媒体形式为音频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求3所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定所述媒体形式为有声视频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的有线耳机插入;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的无线耳机连接;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的无线耳机连接、且所述用户在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的有线耳机插入、且所述用户在所述用户设备的可视范围内。
- 根据权利要求3所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定媒体形式,包括:若所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能开启,则确定所述媒体形式为无声视频形式。
- 根据权利要求3所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定媒体形式,包括:若以下任意一项成立,则确定所述媒体形式为低音视频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的有线耳机插入;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的无线耳机连接;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的免提功能关闭、所述用户设备的有线耳机未插入、所述用户设备的无线耳机未连接、且所述用户在所述用户设备的可视范围内。
- 根据权利要求2所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:若以下任意一项成立,则确定所述待投放媒体内容为通过语音传递媒体信息的媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求2所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容,包括:若以下任意一项成立,则确定所述待投放媒体内容为通过图像传递信息的媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能关闭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能开启。
- 根据权利要求1或2所述的方法,其特征在于,所述根据所述呼叫业务人机 交互环境指示信息确定待投放媒体内容,包括:根据所述呼叫业务人机交互环境指示信息确定所述用户的群体类型;根据所述群体类型确定所述待投放媒体内容。
- 根据权利要求2所述的方法,其特征在于,所述根据所述呼叫业务人机交互环境指示信息确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容,包括:若以下任意一项成立,则确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求1-11中任一项所述的方法,其特征在于,所述接收用户设备发送的呼叫业务人机交互环境指示信息,包括:接收所述用户设备发送的会话发起协议的信息上报SIP-info消息,所述SIP-info消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求1-11中任一项所述的方法,其特征在于,所述接收用户设备发送的呼叫业务人机交互环境指示信息,包括:接收所述用户设备发送的会话发起协议的通知SIP-Notifiication消息,所述SIP-Notifiication消息包括所述呼叫业务人机交互环境指示信息;在接收用户设备发送的呼叫业务人机交互环境指示信息之前,所述方法还包括:向所述用户设备发送订阅消息,所述订阅消息用于订阅所述呼叫业务人机交互环境指示信息。
- 根据权利要求1-11中任一项所述的方法,其特征在于,所述接收用户设备发送的呼叫业务人机交互环境指示信息,包括:接收所述用户设备发送的请求媒体内容的请求消息,所述请求媒体内容的请求消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求14所述的方法,其特征在于,在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容,包括:在所述呼叫业务进行期间向所述用户设备发送所述请求消息的响应消息,所述响应消息包括所述待投放媒体内容。
- 根据权利要求14所述的方法,其特征在于,若根据所述呼叫业务人机交互环境指示信息确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容,所述方法还包括:向所述用户设备发送所述请求消息的响应消息,所述响应消息包括第一指示信息,所述第一指示信息用于指示在所述呼叫业务进行期间不向所述用户设备投放媒体内容。
- 根据权利要求1-13中任一项所述的方法,其特征在于,根据所述呼叫业务人 机交互环境指示信息确定待投放媒体内容之后,所述方法还包括:根据所述待投放媒体内容建立媒体通道,所述媒体通道的类型包括音频媒体通道或视频媒体通道,所述音频媒体通道用于传输音频形式的媒体内容,和/或,所述音频媒体通道用于传输所述呼叫业务进行期间、所述呼叫业务对应的用户设备之间的语音信息,所述视频媒体通道用于传输视频形式的媒体内容;在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容,包括:在所述呼叫业务进行期间通过所述媒体通道,向所述用户设备投放所述待投放媒体内容。
- 根据权利要求1-13中任一项所述的方法,其特征在于,根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容之前,所述方法还包括:根据所述呼叫业务建立媒体通道,所述媒体通道的类型包括音频媒体通道或视频媒体通道,所述音频媒体通道用于传输音频形式的媒体内容,和/或,所述音频媒体通道用于传输所述呼叫业务进行期间、所述呼叫业务对应的用户设备之间的语音信息,所述视频媒体通道用于传输视频形式的媒体内容。
- 根据权利要求18所述的方法,其特征在于,根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容之后,所述方法还包括:若所述媒体通道不能传输所述待投放媒体内容,则切换媒体通道;在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容,包括:在所述呼叫业务进行期间通过切换后的媒体通道,向所述用户设备投放所述待投放媒体内容。
- 根据权利要求18所述的方法,其特征在于,若所述媒体通道能够传输所述待投放媒体内容,在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容,包括:在所述呼叫业务进行期间通过所述媒体通道,向所述用户设备投放所述待投放媒体内容。
- 根据权利要求1-13中任一项所述的方法,其特征在于,若根据所述呼叫业务人机交互环境指示信息确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容,所述方法还包括:根据所述呼叫业务建立媒体通道,所述媒体通道的类型包括音频媒体通道或视频媒体通道,所述音频媒体通道用于传输音频形式的媒体内容,和/或,所述音频媒体通道用于传输所述呼叫业务进行期间、所述呼叫业务对应的用户设备之间的语音信息,所述视频媒体通道用于传输视频形式的媒体内容。
- 一种媒体内容的投放方法,应用于用户设备,其特征在于,所述方法包括:获取呼叫业务人机交互环境指示信息,所述呼叫业务人机交互环境指示信息指示在呼叫业务进行期间所述用户设备对应的用户的人机交互环境;向媒体投放服务器发送所述呼叫业务人机交互环境指示信息;接收所述媒体投放服务器发送的待投放媒体内容,且通过呼叫程序相关的程序单元呈现所述待投放媒体内容;或者,确定不呈现媒体内容。
- 根据权利要求22所述的方法,其特征在于,所述获取所述呼叫业务人机交互 环境指示信息,包括以下至少一项:检测所述用户设备的屏幕是否点亮;或者,检测所述用户设备的呼叫程序的的界面是否可见;或者,检测所述用户设备的免提功能是否开启;或者,检测所述用户设备的有线耳机是否插入;或者,检测所述用户设备的无线耳机是否连接;或者,检测所述用户是否在所述用户设备的可视范围内。
- 根据权利要求22或23所述的方法,其特征在于,所述向所述媒体投放服务器发送所述呼叫业务人机交互环境指示信息,包括:向所述媒体投放服务器发送会话发起协议的信息上报SIP-info消息,所述SIP-info消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求22或23所述的方法,其特征在于,所述向所述媒体投放服务器发送所述呼叫业务人机交互环境指示信息,包括:向所述媒体投放服务器发送会话发起协议的通知SIP-Notifiication消息,所述SIP-Notifiication消息包括所述呼叫业务人机交互环境指示信息;所述向所述媒体投放服务器发送所述呼叫业务人机交互环境指示信息之前,所述方法还包括:接收来自所述媒体投放服务器的订阅消息,所述订阅消息用于订阅所述呼叫业务人机交互环境指示信息。
- 根据权利要求22或23所述的方法,其特征在于,所述向所述媒体投放服务器发送所述呼叫业务人机交互环境指示信息,包括:向所述媒体投放服务器发送请求媒体内容的请求消息,所述请求媒体内容的请求消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求26所述的方法,其特征在于,接收所述媒体投放服务器发送的待投放媒体内容,包括:接收所述媒体投放服务器发送的所述请求消息的响应消息,所述响应消息包括所述待投放媒体内容。
- 根据权利要求22-27中任一项所述的方法,其特征在于,所述确定不呈现媒体内容,包括:接收所述媒体投放服务器发送的第一指示信息,所述第一指示信息用于指示在所述呼叫业务进行期间不向所述用户设备投放媒体内容;根据所述第一指示信息确定不呈现媒体内容;或者,在预设时间范围内未接收到所述媒体投放服务器发送的关于呈现媒体内容的指示信息,确定不呈现媒体内容。
- 根据权利要求28所述的方法,其特征在于,若所述呼叫业务人机交互环境指示信息包括在请求媒体内容的请求消息中,则所述接收所述媒体投放服务器发送的第一指示信息,包括:接收所述媒体投放服务器发送的所述请求消息的响应消息,所述响应消息包括所述第一指示信息。
- 一种媒体投放服务器,其特征在于,所述媒体投放服务器包括收发模块和处理模块;所述收发模块,用于接收用户设备发送的呼叫业务人机交互环境指示信息,所述呼叫业务人机交互环境指示信息指示在所述呼叫业务进行期间所述用户设备对应的用户的人机交互环境;所述处理模块,用于根据所述呼叫业务人机交互环境指示信息确定待投放媒体内容,所述收发模块,还用于在所述呼叫业务进行期间向所述用户设备投放所述待投放媒体内容;或者,所述处理模块,用于根据所述呼叫业务人机交互环境指示信息确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容。
- 根据权利要求30所述的媒体投放服务器,其特征在于,所述人机交互环境包含以下任意一项或任意组合:所述用户设备的屏幕是否点亮、所述用户设备的呼叫程序的界面是否可见、所述用户设备的免提功能是否开启、所述用户设备的有线耳机是否插入、所述用户设备的无线耳机是否连接、或所述用户是否在所述用户设备的可视范围内。
- 根据权利要求30所述的媒体投放服务器,其特征在于,所述处理模块,具体用于根据所述呼叫业务人机交互环境指示信息确定媒体形式,所述媒体形式包括音频形式、无声视频形式、有声视频形式或低音视频形式,所述低音视频形式的媒体内容的缺省音量大于0且小于预设阈值;所述处理模块,还具体用于确定符合所述媒体形式的媒体内容为所述待投放媒体内容。
- 根据权利要求32所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定所述媒体形式为音频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内,或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求32所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定所述媒体形式为有声视频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的有线耳机插入;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的无线耳机连接;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的无线耳机连接、且所述用户在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的有线耳机插入、且所述用户在所述用户设备的可视范围内。
- 根据权利要求32所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能开启,则确定所述媒体形式为无声视频形式。
- 根据权利要求32所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定所述媒体形式为低音视频形式:所述呼叫业务人机交互环境指示信息指示所述用户设备的有线耳机插入;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的无线耳机连接;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、所述用户设备的免提功能关闭、所述用户设备的有线耳机未插入、所述用户设备的无线耳机未连接、且所述用户在所述用户设备的可视范围内。
- 根据权利要求31所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定所述待投放媒体内容为通过语音传递媒体信息的媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求31所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定所述待投放媒体内容为通过图像传递信息的媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能关闭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的呼叫程序的界面可见、且所述用户设备的免提功能开启。
- 根据权利要求30或31所述的媒体投放服务器,其特征在于,所述处理模块,具体用于根据所述呼叫业务人机交互环境指示信息确定所述用户的群体类型;所述处理模块,还具体用于根据所述群体类型确定所述待投放媒体内容。
- 根据权利要求31所述的媒体投放服务器,其特征在于,所述处理模块,具体用于若以下任意一项成立,则确定在所述呼叫业务进行期间不向所述用户设备投放媒体内容:所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕熄灭;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、且所述用户设备的呼叫程序的界面不可见;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的有线耳机插入、且所述用户不在所述用户设备的可视范围内;或者,所述呼叫业务人机交互环境指示信息指示所述用户设备的屏幕点亮、所述用户设备的无线耳机连接、且所述用户不在所述用户设备的可视范围内。
- 根据权利要求30-40中任一项所述的媒体投放服务器,其特征在于,所述收发模块,具体用于接收所述用户设备发送的会话发起协议的信息上报SIP-info消息,所述SIP-info消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求30-40中任一项所述的媒体投放服务器,其特征在于,所述收发模块,具体用于接收所述用户设备发送的会话发起协议的通知SIP-Notifiication消息,所述SIP-Notifiication消息包括所述呼叫业务人机交互环境指示信息;所述收发模块,还用于向所述用户设备发送订阅消息,所述订阅消息用于订阅所述呼叫业务人机交互环境指示信息。
- 根据权利要求30-40中任一项所述的媒体投放服务器,其特征在于,所述收发模块,具体用于接收所述用户设备发送的请求媒体内容的请求消息,所述请求媒体内容的请求消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求43所述的媒体投放服务器,其特征在于,所述收发模块,具体用于在所述呼叫业务进行期间向所述用户设备发送所述请求消息的响应消息,所述响应消息包括所述待投放媒体内容。
- 一种用户设备,其特征在于,所述用户设备包括处理模块和收发模块;所述处理模块,用于获取呼叫业务人机交互环境指示信息,所述呼叫业务人机交互环境指示信息指示在呼叫业务进行期间所述用户设备对应的用户的人机交互环境;所述收发模块,用于向媒体投放服务器发送所述呼叫业务人机交互环境指示信息;所述收发模块,还用于接收所述媒体投放服务器发送的待投放媒体内容,所述处理模块,还用于通过呼叫程序相关的程序单元呈现所述待投放媒体内容;或者,所述处理模块,还用于确定不呈现媒体内容。
- 根据权利要求45所述的用户设备,其特征在于,所述获取所述呼叫业务人机交互环境指示信息,包括以下至少一项:检测所述用户设备的屏幕是否点亮;或者,检测所述用户设备的呼叫程序的的界面是否可见;或者,检测所述用户设备的免提功能是否开启;或者,检测所述用户设备的有线耳机是否插入;或者,检测所述用户设备的无线耳机是否连接;或者,检测所述用户是否在所述用户设备的可视范围内。
- 根据权利要求45或46所述的用户设备,其特征在于,所述收发模块,具体用于向所述媒体投放服务器发送会话发起协议的信息上报SIP-info消息,所述SIP-info消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求45或46所述的用户设备,其特征在于,所述收发模块,具体用于向所述媒体投放服务器发送会话发起协议的通知SIP-Notifiication消息,所述SIP-Notifiication消息包括所述呼叫业务人机交互环境指示信息;所述收发模块,还用于接收来自所述媒体投放服务器的订阅消息,所述订阅消息用于订阅所述呼叫业务人机交互环境指示信息。
- 根据权利要求45或46所述的用户设备,其特征在于,所述收发模块,具体用于向所述媒体投放服务器发送请求媒体内容的请求消息,所述请求媒体内容的请求消息包括所述呼叫业务人机交互环境指示信息。
- 根据权利要求49所述的用户设备,其特征在于,所述收发模块,具体用于接收所述媒体投放服务器发送的所述请求消息的响应消息,所述响应消息包括所述待投放媒体内容。
- 根据权利要求45-50中任一项所述的用户设备,其特征在于,所述处理模块,具体用于通过所述收发模块接收所述媒体投放服务器发送的第一指示信息,所述第一指示信息用于指示在所述呼叫业务进行期间不向所述用户设备投放媒体内容;所述处理模块,还具体用于根据所述第一指示信息确定不呈现媒体内容;或者,所述处理模块,具体用于在预设时间范围内未接收到所述媒体投放服务器发送的关于呈现媒体内容的指示信息,确定不呈现媒体内容。
- 一种媒体投放服务器,其特征在于,包括:处理器,所述处理器与存储器耦合,所述存储器用于存储程序或指令,当所述程序或指令被所述处理器执行时,使得所述媒体投放服务器执行如权利要求1至21中任一项所述的方法。
- 一种用户设备,其特征在于,包括:处理器,所述处理器与存储器耦合,所述存储器用于存储程序或指令,当所述程序或指令被所述处理器执行时,使得所述用户设备执行如权利要求22至29中任一项所述的方法。
- 一种通信系统,其特征在于,包括:媒体投放服务器和用户设备,所述媒体投放服务器用于执行权利要求1至21中任一项所述的方法,所述用户设备用于执行权利要求22至29中任一项所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22844836.1A EP4362424A4 (en) | 2021-07-23 | 2022-02-17 | METHOD FOR DISTRIBUTION OF MULTIMEDIA CONTENT AND DEVICE |
US18/419,145 US20240163323A1 (en) | 2021-07-23 | 2024-01-22 | Media content delivery method and device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110838469.2A CN115695379A (zh) | 2021-07-23 | 2021-07-23 | 媒体内容的投放方法及设备 |
CN202110838469.2 | 2021-07-23 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/419,145 Continuation US20240163323A1 (en) | 2021-07-23 | 2024-01-22 | Media content delivery method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023000662A1 true WO2023000662A1 (zh) | 2023-01-26 |
Family
ID=84980584
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/076629 WO2023000662A1 (zh) | 2021-07-23 | 2022-02-17 | 媒体内容的投放方法及设备 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20240163323A1 (zh) |
EP (1) | EP4362424A4 (zh) |
CN (1) | CN115695379A (zh) |
WO (1) | WO2023000662A1 (zh) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106162034A (zh) * | 2015-03-31 | 2016-11-23 | 上海秀我数字广告传媒有限公司 | 用于在通话过程中插播视频的方法和系统 |
US20160349973A1 (en) * | 2015-05-29 | 2016-12-01 | Microsoft Technology Licensing, Llc | Video Messaging |
CN106713381A (zh) * | 2015-08-20 | 2017-05-24 | 上海触乐信息科技有限公司 | 推送服务信息的方法、装置和用户设备 |
CN110310139A (zh) * | 2018-03-27 | 2019-10-08 | 腾讯科技(深圳)有限公司 | 数据投放方法以及数据投放引擎 |
CN111031273A (zh) * | 2020-01-09 | 2020-04-17 | 翟长斌 | 一种移动终端的语音视频通话广告管理系统 |
CN113014474A (zh) * | 2021-02-19 | 2021-06-22 | 咪咕音乐有限公司 | 一种即时通信中的多媒体实现方法和系统 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2488120A (en) * | 2011-02-15 | 2012-08-22 | Vodafone Ip Licensing Ltd | Facilitating communication between devices by requesting a status indicator of the ability of a second device to use a second communication method. |
EP2528296A1 (en) * | 2011-05-27 | 2012-11-28 | TELEFONAKTIEBOLAGET LM ERICSSON (publ) | Methods and arrangements for interactive communication during call setup |
US9426242B2 (en) * | 2013-01-29 | 2016-08-23 | Apple Inc. | Determining an invitational content item type based on predicted user attention |
-
2021
- 2021-07-23 CN CN202110838469.2A patent/CN115695379A/zh active Pending
-
2022
- 2022-02-17 EP EP22844836.1A patent/EP4362424A4/en active Pending
- 2022-02-17 WO PCT/CN2022/076629 patent/WO2023000662A1/zh active Application Filing
-
2024
- 2024-01-22 US US18/419,145 patent/US20240163323A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106162034A (zh) * | 2015-03-31 | 2016-11-23 | 上海秀我数字广告传媒有限公司 | 用于在通话过程中插播视频的方法和系统 |
US20160349973A1 (en) * | 2015-05-29 | 2016-12-01 | Microsoft Technology Licensing, Llc | Video Messaging |
CN106713381A (zh) * | 2015-08-20 | 2017-05-24 | 上海触乐信息科技有限公司 | 推送服务信息的方法、装置和用户设备 |
CN110310139A (zh) * | 2018-03-27 | 2019-10-08 | 腾讯科技(深圳)有限公司 | 数据投放方法以及数据投放引擎 |
CN111031273A (zh) * | 2020-01-09 | 2020-04-17 | 翟长斌 | 一种移动终端的语音视频通话广告管理系统 |
CN113014474A (zh) * | 2021-02-19 | 2021-06-22 | 咪咕音乐有限公司 | 一种即时通信中的多媒体实现方法和系统 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4362424A4 |
Also Published As
Publication number | Publication date |
---|---|
EP4362424A4 (en) | 2024-09-25 |
CN115695379A (zh) | 2023-02-03 |
US20240163323A1 (en) | 2024-05-16 |
EP4362424A1 (en) | 2024-05-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11250858B2 (en) | Transcription presentation of communication sessions | |
KR102327571B1 (ko) | 영상 통화 데이터의 디스플레이 | |
US20170085835A1 (en) | Shared Scene Mesh Data Synchronization | |
US20180375907A1 (en) | Parallel peer to peer connection establishment in webrtc conferencing | |
TW202147834A (zh) | 同步本地房間和遠端共享 | |
JP2023508130A (ja) | テレカンファレンスの方法 | |
US10812757B2 (en) | Communication system | |
US10530932B2 (en) | Seamless mechanism to connect an active call to another device | |
JP7508586B2 (ja) | 没入型テレカンファレンスおよびテレプレゼンスのためのマルチグルーピングの方法、装置、およびコンピュータプログラム | |
WO2017215100A1 (zh) | 视频通话数据处理的方法和装置 | |
US20160212180A1 (en) | Shared Scene Object Synchronization | |
US8976223B1 (en) | Speaker switching in multiway conversation | |
WO2023000662A1 (zh) | 媒体内容的投放方法及设备 | |
US10230780B2 (en) | Methods and apparatus for collaborative content rendering | |
WO2024045877A1 (zh) | 设备的连接方法、装置、电子设备以及存储介质 | |
WO2023213274A1 (zh) | 数据处理方法、装置、终端、网络侧设备及介质 | |
WO2024060750A1 (zh) | 蓝牙切换方法和装置、蓝牙连接方法和装置及电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22844836 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022844836 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2022844836 Country of ref document: EP Effective date: 20240124 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |