CN117812049A

CN117812049A - Desktop sharing scaling method and device, electronic equipment and storage medium

Info

Publication number: CN117812049A
Application number: CN202311594338.XA
Authority: CN
Inventors: 郭嘉; 王凯迪; 张铮; 张庆达; 刘晓丰; 刘鲲
Original assignee: China Unicom Online Information Technology Co Ltd
Current assignee: China Unicom Online Information Technology Co Ltd
Priority date: 2023-11-27
Filing date: 2023-11-27
Publication date: 2024-04-02

Abstract

The invention relates to a desktop sharing scaling method, a desktop sharing scaling device, electronic equipment and a storage medium, wherein the method comprises the following steps: and sending a first switching instruction to the media server through the customer service terminal so as to switch the current voice call into a video call, and transmitting desktop sharing information through a video channel of the audio terminal. And initiating a first renegotiation request to the customer service terminal through the media server, and responding to the first renegotiation request by the customer service terminal to reply the first information. And sending a second renegotiation request to the IMS core network through the media server so as to call the IMS core network to transmit the second renegotiation request to the user terminal. And the first information of the user terminal is transmitted to the media server through the IMS core network, and the customer service terminal selects the first desktop information needing to be shared in the desktop sharing information. The media server carries out media encoding and decoding processing on the first desktop information, the first desktop information is transmitted to the user terminal through the IMS core network, and the user terminal scales the first desktop information through operating the sharing screen.

Description

Desktop sharing scaling method and device, electronic equipment and storage medium

Technical Field

The present invention relates to the field of artificial intelligence technologies, and in particular, to a desktop sharing scaling method, device, electronic device, and storage medium.

Background

With the popularization of VOLTE (Voice over Long Term Evolution, high-definition voice), the mobile network bandwidth is greatly improved compared with 2G/3G, the mobile bandwidth can meet the transmission requirement of video, and the user is converted into a rich media form integrating audio, video and interaction from the original single audio experience. Video experience can be realized in the ringing and response stages, and video services such as video color ring, video customer service, video call, video conference, video advertisement, desktop sharing and the like are derived. The customer service is a conference control system with a central node, namely, the VOLTE terminal and the agent terminal need to carry out call lap joint through the customer service conference control system, receive the dispatching of the customer service conference control system and carry out mixed screen processing of a plurality of calls by the customer service conference control system.

Currently, in the traditional manual customer service scenario, a customer service call is mainly dialed by a user, and the VOLTE terminal sends an INVITE (request) message through an SIP protocol, carrying SDP (audio decoder) information, including media resource IP addresses of the VOLTE terminal, port numbers of audio and video, encoding and decoding of the audio and video, and a control platform, so as to complete negotiation of media resources. Secondly, after the control platform finishes the analysis of the SIP (Session Initiation Protocol, text-based application layer protocol) protocol of the VOLTE terminal, a call notification message is sent to the service system through a restoration interface, the notification message comprises a calling number, a called number, audio and video coding and decoding information to notify the service system that a call is incoming, and the service system notifies the control platform to play a video IVR (Interactive Voice Response ) and transfer video labor according to the access code information. The control platform sends a video playing (Play) request to the media platform, and after the media platform receives the Play (Play) request sent by the control platform, the media platform sends media content to the SBC (System Basis Chip, integrated with a multi-functional chip), where the media content may be an enterprise propaganda/advertisement video, a service remote guidance video, and the like. The mobile terminal decodes and plays the video content, so that video images played by the media platform or video images played by the seat proxy equipment can be seen, and the seat proxy equipment can share a desktop for a user, make service guidance related to the customer, and the like. However, in the existing manual customer service scene, the customer can only hear the voice of the operator or watch the desktop information of the operator through the guiding video pushed by the video playing interface, so that the operation of amplifying or shrinking the desktop information is difficult, the key information is difficult to view, and the working efficiency of the customer service personnel is reduced to a certain extent.

Therefore, in order to improve the working efficiency of the customer service personnel in the manual customer service scene, a desktop sharing function based on VOLTE needs to be introduced, and a function of enlarging and reducing the desktop by the user terminal is supported.

Disclosure of Invention

Accordingly, in order to solve the above-mentioned problems, it is necessary to provide a desktop sharing scaling method, apparatus, electronic device, and storage medium.

The invention provides a desktop sharing scaling method, which comprises the following steps:

a first switching instruction is sent to a media server through a customer service terminal so as to switch the current voice call into a video call, and desktop sharing information is transmitted through a video channel of an audio terminal;

initiating a first renegotiation request carrying audio decoding information to the customer service terminal through a media server, wherein the customer service terminal responds to the first renegotiation request and replies first information carrying audio decoding information;

sending a second renegotiation request carrying audio decoding information to an IMS core network through the media server so as to call the IMS core network to transmit the second renegotiation request to a user terminal, and responding to the second renegotiation request by the user terminal to reply the first information carrying the audio decoding information;

The IMS core network is used for transmitting the first information of the user terminal to the media server, and the customer service terminal is used for selecting first desktop information needing to be shared in the desktop sharing information and transmitting the first desktop information to the media server;

media encoding and decoding processing is carried out on the first desktop information through a media server, the first desktop information after encoding and decoding processing is transmitted to the user terminal through the IMS core network, and the user terminal scales the first desktop information through operating a sharing screen;

the desktop sharing information at least comprises an IP address, a port number, audio decoding information and license permission, the first information comprises the IP address, the audio port number, the audio encoding and decoding information, the video port number and the video encoding and decoding information of the media resource, and the first desktop information comprises the whole desktop, designated files on the desktop and designated areas.

In one embodiment, the sending, by the customer service terminal, a first switching instruction to the media server to switch the current voice call to a video call, and transferring desktop sharing information through a video channel of the audio terminal, includes:

Transmitting an audio call request carrying audio decoding information to an IMS core network through the audio terminal according to an SIP protocol, wherein the IMS core network responds to the audio call request and transparently transmits the audio call of the audio terminal to the media server;

responding to the audio call by the media server and replying to a first message carrying audio decoding information, wherein the first message is used for representing that the media server is in a ringing state.

In one embodiment, the responding to the audio call by the media server and replying to the first message carrying audio decoding information comprises:

transmitting a first message of the media server to an audio terminal through the IMS core network, wherein the media server responds to the first message and replies a first response message to the IMS core network, and the first response message is used for representing that the media server is in a response state;

when the IMS core network transparently transmits the first response message to the audio terminal, the media server plays an audio IVR flow or transfers the audio IVR flow to artificial audio for the audio terminal.

In one embodiment, the method further comprises:

When the audio terminal is switched to the artificial audio, the media server receives RTP media stream from the user terminal, distributes corresponding artificial agents after detecting the manual switching request, and initiates an audio calling request carrying audio decoding information to the artificial agents;

and based on the audio call request carrying audio decoding information initiated to the manual agent, the customer service terminal replies the first information to the media server after responding, and the media server carries the audio decoding information and sends media renegotiation information to the IMS core network.

In one embodiment, the sending, based on the sending, to the manual agent, an audio call request carrying audio decoding information, after the customer service terminal replies to the media server with the first information, the media server carrying audio decoding information and sending media renegotiation information to the IMS core network, and then includes:

the media renegotiation information is transmitted to the user terminal through the IMS core network, the user terminal replies first information carrying audio decoding information based on the media renegotiation information, and the first information of the user terminal is transmitted to the media server through the IMS core network;

Based on the first information carrying the audio decoding information replied by the user terminal, the media server initiates a third renegotiation request to the customer service terminal, wherein the third renegotiation request is a media renegotiation request based on the media renegotiation information;

responding to the third renegotiation request through the customer service terminal and replying the first information carrying the audio decoding information.

In one embodiment, the media encoding and decoding processing is performed on the first desktop information by using a media server, and the encoded and decoded first desktop information is transmitted to the user terminal through the IMS core network, and the user terminal scales the first desktop information by operating a sharing screen, which includes:

based on the operation of the user on the shared screen, acquiring the position information of the touch screen and the moving distance of the touch screen, and sending the position information and the moving distance to the media server through an INFO message so as to expand a desktop scaling identifier in a file of the INFO message;

and sending desktop scaling information of the user terminal to a media server through one or more INFO messages, and transmitting the INFO messages to the media server through an IMS core network, wherein the media server responds to the INFO messages to reply to the first information.

In one embodiment, the method further comprises:

receiving first information of the INFO message transmitted by the IMS core network through the media server, and analyzing the INFO message scaled by the desktop of the user terminal to obtain touch screen or press information of a user and change conditions of the touch screen or press information;

and carrying out re-encoding and decoding processing on the first desktop information based on the touch screen or pressing information of the user and the change condition of the touch screen or pressing information, and carrying out scaling processing on the first desktop information in the same proportion.

The invention also provides a desktop sharing and zooming device, which comprises:

the information switching and transmitting module is used for transmitting a first switching instruction to the media server through the customer service terminal so as to switch the current voice call into a video call and transmitting desktop sharing information through a video channel of the audio terminal;

the first renegotiation module is used for initiating a first renegotiation request carrying audio decoding information to the customer service terminal through the media server, and the customer service terminal responds to the first renegotiation request to reply the first information carrying the audio decoding information;

The second renegotiation module is used for sending a second renegotiation request carrying audio decoding information to the IMS core network through the media server so as to call the IMS core network to transmit the second renegotiation request to the user terminal, and the user terminal replies the first information carrying the audio decoding information in response to the second renegotiation request;

the first information processing module is used for transmitting first information of the user terminal to the media server through the IMS core network, and the customer service terminal selects first desktop information needing to be shared in the desktop sharing information and transmits the first desktop information to the media server;

the desktop scaling module is used for carrying out media encoding and decoding processing on the first desktop information through the media server, and transmitting the encoded and decoded first desktop information to the user terminal through the IMS core network, and the user terminal scales the first desktop information through operating a sharing screen;

The invention also provides electronic equipment, which comprises a memory and a processor, wherein the memory stores a computer program, and the processor realizes the desktop sharing scaling method according to any one of the above when executing the computer program.

The invention also provides a computer storage medium storing a computer program which when executed by a processor implements a desktop sharing scaling method as described in any one of the above.

According to the desktop sharing scaling method, the desktop sharing scaling device, the electronic equipment and the storage medium, the first switching instruction is sent to the media server through the customer service terminal so as to switch the current voice call into the video call, the desktop sharing information is transmitted through the video channel of the audio terminal, then a renegotiation request carrying audio decoding information is sent to the customer service terminal through the media server, and the customer service terminal responds to the renegotiation request and replies corresponding information carrying the audio decoding information. The media server sends a renegotiation request carrying audio decoding information to the IMS core network to call the IMS core network to transmit the renegotiation request to the user terminal, and the user terminal replies corresponding information carrying audio decoding information in response to the renegotiation request. And the first information of the user terminal is transmitted to the media server through the IMS core network, and the customer service terminal selects desktop information needing to be shared in the desktop sharing information and sends the desktop information to the media server. And performing media encoding and decoding processing on the desktop information through a media server, and transmitting the first desktop information subjected to encoding and decoding processing to a user terminal through an IMS core network, wherein the user terminal scales the desktop information through operating a sharing screen. According to the method, in a VOLTE video customer service scene, operation information of desktop scaling is transmitted by means of a media channel of a VOLTE video call, and the VOLTE video customer service and desktop scaling functions are achieved. For example, the desktop of the operator can be subjected to zoom-in and zoom-out operations, key part desktop information is checked or panoramic information of the desktop is checked, the working efficiency of customer service personnel is improved, and the probability of on-site handling is reduced.

Drawings

In order to more clearly illustrate the invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the invention, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.

FIG. 1 is a schematic flow chart of a desktop sharing scaling method according to the present invention;

FIG. 2 is a schematic diagram of a network system architecture of a desktop sharing scaling method according to an embodiment of the present invention;

fig. 3 is a schematic view of a VOLTE customer service scene interaction flow of a desktop sharing scaling method in a specific embodiment provided by the present invention;

FIG. 4 is a second flowchart of a desktop sharing scaling method according to the present invention;

FIG. 5 is a third flowchart of a desktop sharing scaling method according to the present invention;

FIG. 6 is a flowchart of a desktop sharing scaling method according to the present invention;

FIG. 7 is a flowchart of a desktop sharing scaling method according to the present invention;

FIG. 8 is a flowchart illustrating a desktop sharing scaling method according to the present invention;

FIG. 9 is a flowchart of a desktop sharing scaling method according to the present invention;

FIG. 10 is a schematic diagram of a desktop sharing zoom apparatus according to the present invention;

fig. 11 is an internal structural diagram of a computer device provided by the present invention.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

The desktop sharing scaling method, apparatus, electronic device and storage medium of the present invention are described below with reference to fig. 1 to 11.

As shown in fig. 1, in one embodiment, a desktop sharing scaling method includes the steps of:

step S110, a first switching instruction is sent to a media server through a customer service terminal so as to switch the current voice call into a video call, and desktop sharing information is transmitted through a video channel of an audio terminal.

Specifically, the total server sends a first switching instruction to the media server through the customer service terminal to switch the current voice call into a video call, and transmits desktop sharing information through a video channel of the audio terminal.

Step S120, a first renegotiation request carrying audio decoding information is initiated to the customer service terminal through the media server, and the customer service terminal responds to the first renegotiation request to reply the first information carrying the audio decoding information.

Specifically, the total server initiates a renegotiation request carrying decoding information, namely a first renegotiation request, to the customer service terminal through the media server, and the customer service terminal responds to the first renegotiation request to reply a message carrying audio decoding information, namely first information, to the media server.

Step S130, the second renegotiation request carrying the audio decoding information is sent to the IMS core network through the media server, so as to call the IMS core network to transmit the second renegotiation request to the user terminal, and the user terminal replies the first information carrying the audio decoding information in response to the second renegotiation request.

Specifically, the total server sends a renegotiation request carrying audio decoding information, namely a second renegotiation request, to the IMS core network through the media server so as to invoke the IMS core network to transparently transmit the second renegotiation request to the user terminal, and the user terminal responds to the second renegotiation request to reply a message carrying audio decoding information, namely the first information.

Step S140, the first information of the user terminal is transmitted to the media server through the IMS core network, the customer service terminal selects the first desktop information needing to be shared in the desktop sharing information, and the first desktop information is transmitted to the media server.

Specifically, the total server transmits first information of the user terminal to the media server through the IMS core network, and the customer service terminal selects desktop information needing to be shared in the desktop sharing information, namely the first desktop information, and transmits the desktop information needing to be shared to the media server.

Step S150, media encoding and decoding processing is carried out on the first desktop information through the media server, the encoded and decoded first desktop information is transmitted to the user terminal through the IMS core network, and the user terminal scales the first desktop information through operating the sharing screen.

Specifically, the total server performs media encoding and decoding processing on desktop information to be shared through the media server, and transmits the first desktop information after encoding and decoding processing to the user terminal through the IMS core network, and the user terminal performs scaling processing on the first desktop information through the sharing screen.

According to the desktop sharing scaling method, the client terminal sends the first switching instruction to the media server to switch the current voice call into the video call, the desktop sharing information is transmitted through the video channel of the audio terminal, then a renegotiation request carrying audio decoding information is initiated to the client terminal through the media server, and the client terminal responds to the renegotiation request to reply corresponding information carrying the audio decoding information. The media server sends a renegotiation request carrying audio decoding information to the IMS core network to call the IMS core network to transmit the renegotiation request to the user terminal, and the user terminal replies corresponding information carrying audio decoding information in response to the renegotiation request. And the first information of the user terminal is transmitted to the media server through the IMS core network, and the customer service terminal selects desktop information needing to be shared in the desktop sharing information and sends the desktop information to the media server. And performing media encoding and decoding processing on the desktop information through a media server, and transmitting the first desktop information subjected to encoding and decoding processing to a user terminal through an IMS core network, wherein the user terminal scales the desktop information through operating a sharing screen. According to the method, in a VOLTE video customer service scene, operation information of desktop scaling is transmitted by means of a media channel of a VOLTE video call, and the VOLTE video customer service and desktop scaling functions are achieved. For example, the desktop of the operator can be subjected to zoom-in and zoom-out operations, key part desktop information is checked or panoramic information of the desktop is checked, the working efficiency of customer service personnel is improved, and the probability of on-site handling is reduced.

Referring to fig. 2, in a specific embodiment, the desktop sharing scaling method provided by the present invention relates to the following network elements:

the media server: the media platform is responsible for processing and playing audio and video media, applying and releasing a meeting place, encoding and decoding audio and video and sharing a desktop.

The signaling server: is responsible for the negotiation and processing of signaling. Controlling the meeting and the meeting of the user seat.

Service system: and is responsible for judging and retransmitting different business processes (video IVR, video call, video advertisement, desktop sharing, enterprise and television show and the like) according to the calling number and the called number and the access code.

S-CSCF: the central node of IMS core network is mainly used for user registration, authentication control, session routing and service triggering control, and maintains session state information.

I-CSCF: the unified preliminary entry point of the IMS network is responsible for the assignment and query of the S-CSCF for user registration.

P-CSCF: the SIP user accesses the ingress node of the IMS network and is mainly responsible for the proxy of signaling and messages.

SBC: providing secure access and media handling.

S/P-GW: is the core equipment of the EPC network and provides the functions of a service gateway and a PDN gateway logic entity. The service gateway faces to a wireless access network (UE+eNodeB) to transmit service plane data, and the PDN gateway faces to other data networks and is an EPS anchor point to realize access interaction with a plurality of public data networks.

UPF/AMF: the UPF is responsible for user plane functions, packet routing forwarding, policy enforcement, traffic reporting, qos handling, AMF is responsible for access and mobility management functions, performing registration, connection, reachability, mobility management. And providing a session management message transmission channel for the UE and the SMF, and providing authentication and authentication functions for the user when accessing, and providing a terminal and a wireless core network control plane access point.

Referring to fig. 3, in a specific embodiment, in the desktop sharing zoom method provided by the present invention, in a VOLTE customer service scene of two or more parties (greater than or equal to three parties), a process of performing zoom-in and zoom-out interaction with a client VOLTE terminal for a desktop shared by customer service seat terminals mainly includes the following steps:

(1) The VOLTE (user, user terminal) audio dials the customer service access code, the VOLTE terminal (audio terminal) sends an INVITE message (audio call request) to the IMS core network (CSCF network element) through the SIP protocol, and the VOLTE terminal carries audio SDP (audio decoder) information, including information such as an IP address, an audio port number, an audio codec and the like of media resources, and the user can dial the customer service access code.

(2) The IMS core network transparently transmits the audio call of the VOLTE terminal to a media server.

(3) The media server replies 18 x message (first message) carrying audio SDP information indicating that the media server is already in a ringing state.

(4) And transmitting 18-time information of the media server to the VOLTE terminal by the IMS core network.

(5) The media server replies 200 a reply message (first reply message) to the IMS core indicating that the media server is already in a reply state.

(6) And the IMS core network transparently transmits 200 the response message to the VOLTE terminal.

(7) The media server plays the audio IVR flow to the VOLTE terminal, and can also directly convert the audio to manual work. When VOLTE user presses a button or carries out voice transfer, the media server receives RTP media stream at the user side, after detecting correct transfer manual request, the media server allocates a manual seat, initiates a call to the manual seat, sends an INVITE message and carries audio SDP information.

(8) And replying 200 messages (first information) to the media server after the customer service terminal replies.

(9) The media server carries SDP information and sends a Reinvite message (media renegotiation information) to the IMS core network to perform media renegotiation.

(10) The IMS core network transparently transmits the Reinvite message to the user terminal.

(11) The user terminal replies 200 a message (first information) carrying audio SDP information.

(12) The IMS core network transparently transmits 200 messages of the user terminal to the media server.

(13) And the media server initiates a Reinvite media renegotiation request (third renegotiation request) to the customer service terminal.

(14) The customer service terminal replies 200 messages and carries audio SDP information.

(15) And the customer service terminal initiates audio and video switching to the media server, switches the current voice call into a video call, and supports the subsequent desktop sharing function.

(16) The desktop sharing information is transmitted by means of a video channel of the VOLTE terminal, and comprises an IP address, a port number, audio/video SDP information, license permission and the like.

(17) And the media server initiates a renegotiation request of the media resource to the customer service terminal, and the renegotiation request carries audio and video SDP information.

Note that: or the customer service terminal directly initiates reinvite media resource renegotiation to the media server.

The SDP information uses the port number of the M lines of the video of the VOLTE original.

a = sendrecv identifies a two-way video call

m=video 12082 RTP/AVP 114 113 identifies the port number inside the M lines of video using VOLTE original, without adding M lines and port number

v＝0

o＝HuaWeiUAP9600 12 12 IN IP4 10.137.2.167

s＝Sip Call

c=in IP4 10.137.2.176// IP address

t＝0 0

m=audio 12080 RTP/AVP 104 103 102 101 80 18 96 97// audio port number

b＝AS:41

b＝RS:600

b＝RR:2000

a=rtpmap 104 AMR-WB/16000/1// audio codec

a＝fmtp:104 mode-change-capability＝2；max-red＝0

a＝rtpmap:103 AMR-WB/16000/1

a＝fmtp:103 octet-align＝1；mode-change-capability＝2；max-red＝0

a＝rtpmap:102 AMR/8000/1

a＝fmtp:102 mode-change-capability＝2；max-red＝0

a＝rtpmap:101 AMR/8000/1

a＝fmtp:101 octet-align＝1；mode-change-capability＝2；max-red＝0

a＝rtpmap:96 telephone-event/16000

a＝fmtp:96 0-15

a＝rtpmap:97 telephone-event/8000

a＝fmtp:97 0-15

a＝curr:qos local none

a＝curr:qos remote none

a＝des:qos mandatory local sendrecv

a＝des:qos optional remote sendrecv

a＝sendrecv

a＝maxptime:240

a＝ptime:20

m=video 12082 RTP/AVP 114 113// video port number

b＝AS:2154

b＝RS:8000

b＝RR:6000

a=rtpmap:114 h264/90000// video codec

a＝fmtp:114

profile-level-id＝42C01F；sprop-parameter-sets＝Z0LAH9oC0ChoBtChNQ＝＝,aM4

G4g＝＝；packetization-mode＝1；sar-understood＝16；sar-supported＝1

a＝imageattr:114 send[x＝720,y＝1280]recv[x＝720,y＝1280]

a＝rtpmap:113 H264/90000

a＝fmtp:113

profile-level-id＝42C01F；sprop-parameter-sets＝Z0LAH9oC0ChoBtChNQ＝＝,aM4

G4g＝＝；packetization-mode＝0；sar-understood＝16；sar-supported＝1

a＝imageattr:113 send[x＝720,y＝1280]recv[x＝720,y＝1280]

a＝curr:qos local none

a＝curr:qos remote none

a＝des:qos mandatory local sendrecv

a＝des:qos optional remote sendrecv

a＝rtcp-fb:*nack

a＝rtcp-fb:*nack pli

a＝rtcp-fb:*ccm fir

a＝rtcp-fb:*ccm tmmbr

a＝sendrecv

a＝tcap:1 RTP/AVPF

a＝pcfg:1 t＝1

a＝extmap:2 urn:3gpp:video-orientation

(18) The customer service terminal replies 200 messages (first information) carrying SDP information including IP address, audio port number, audio codec, video port number and video codec of the media asset.

(19) The media server sends a reinvite message to an IMS core network (CSCF), carrying SDP information, including an IP address, an audio port number, an audio codec, a video port number and a video codec, and carrying sendrecv (identification bidirectional video call) under M rows of the video SDP information.

The carried SIP header field and SDP information, see step (17).

(20) The IMS core network transmits a renegotiation request message of the media server to the user terminal.

(21) And the user terminal analyzes the SDP information of the SIP message and plays the frame, and the user clicks the consent in the prompt frame of the audio/video switching request.

(22) The user terminal replies 200 a message (first information) carrying SDP information including media asset IP address, audio port number, audio codec, video port number and video codec information.

(23) The IMS core network transparently transmits 200 messages of the user terminal to the media server.

(24) The customer service terminal selects the information to be shared, which can be the whole desktop, the designated file and the designated area.

(25) The customer service terminal sends desktop sharing information to the media server, and the desktop sharing information can be sent through a main flow channel video of the customer service terminal or through an auxiliary flow channel of the customer service terminal.

(26) And the media server carries out media processing and media encoding and decoding processing on the desktop of the customer service terminal, and carries out desktop transmission according to SDP negotiated with the mobile phone SIP of the terminal.

(27) And the IMS core network transmits desktop sharing information of the customer service terminal to the user terminal through the video channel.

(28) After the user sees the desktop sharing information, the user can operate the sharing screen to realize the functions of enlarging and reducing the desktop. The two fingers press the desktop-shared screen and move outwards (desktop magnifying function), the two fingers press the desktop-shared screen and move inwards and outwards (desktop reducing function), the position information of the two touch screens and the distance of the inner and outer movement are sent to the media server through an INFO message, and the zoom information is carried by expanding a zoom tag function (zoom tag) in xml (format file) of the INFO message:

INFO sip:10.30.13.14:5060SIP/2.0

Via:SIP/2.0/UDP 10.30.13.82:5060；branch＝z9hG4bK6v7bxvw8yhwvgv3w666857x7g；rport,SIP/2.0/UDP 10.30.13.233:5060；branch＝z9hG4bKp70x99llmqr9m7pplpr0ilkp3

Call-ID:jq6800g0xii080qr1876q8iqwq7nz0w7@UAP9600

From:<sip:77777770586@10.30.13.82；user＝phone>；tag＝m709o72p

To:

<sip:668889042@10.30.13.14；user＝phone>；tag＝mr7m07m9-CC-58-E2ECALLID-22696

CSeq:9INFO

Max-Forwards:69

Contact:<sip:77777770586@10.30.13.82:5060>；isfocus

Content-Length:295

Content-Type:application/media_control_hw+xml

<？xml version＝"1.0"encoding＝"utf-8"？>

< media_control xmlns= "http:// www.huawei.com/media-control" version= "2.0" >// media control identity

< media_zoom >// desktop zoom flag

<opContent_S>x:105；y:570</opContent_S>

<opContent_P>x:125；y:590</opContent_P>

The/(screen touch or press action), the touch location is transferred by x and y with respect to the co-ordinate pixel value in the upper left corner of the screen. The opContent_S starts the touch screen or press position and opContent_P targets the touch screen or press position.

</media_zoomtag>

</media_control>

Note that: multiple VOLTE end users may simultaneously perform a zoom operation on the desktop.

(29) The terminal sends information of the desktop scaling of the VOLTE terminal to the media server through one or more INFO messages.

Wherein the INFO message is a SIP message for sending call signaling information to another user agent after the media session is established.

(30) The IMS core network transparently transmits INFO messages to the media server.

(31) The media server replies 200 messages as a response to the INFO message.

(32) The IMS core network transparently transmits the 200 response message of INFO.

(33) The media server analyzes the INFO message of the desktop zoom of the VOLTE user, analyzes the touch screen or pressing information of the user and the change condition of the touch screen or the pressing information, records the change condition, and simultaneously re-encodes and decodes the picture of the desktop, and performs the zooming-in and zooming-out processes in the same proportion. And the desktop sharing page of each subsequent frame is enlarged and reduced according to the recorded proportion until the user performs zoom operation on the desktop again. The record zoom information only takes effect on the current call.

(34) And the media server sends the scaled desktop sharing information to the IMS core network.

(35) And the IMS core network sends the scaled desktop sharing information to the VOLTE terminal.

As shown in fig. 4, in one embodiment, the desktop sharing scaling method provided by the present invention sends a first switching instruction to a media server through a customer service terminal to switch a current voice call to a video call, and transfers desktop sharing information through a video channel of an audio terminal, and the method includes the following steps:

in step S410, the audio terminal sends an audio call request (INVITE message) carrying audio decoding information (audio SDP information) to the IMS core network according to the SIP protocol, and the IMS core network transparently transmits an audio call of the audio terminal (VOLTE terminal) to the media server in response to the audio call request.

Specifically, the total server sends an audio call request carrying audio decoding information to the IMS core network through the audio terminal according to the SIP protocol, and the IMS core network responds to the audio call request to transmit the audio call of the audio terminal to the media server.

Step S420, responding to the audio call by the media server and replying to the first message carrying audio decoding information, wherein the first message is used for indicating that the media server is already in a ringing state.

Specifically, the overall server responds to the audio call through the media server and replies with a first message (18 x message) carrying audio decoding information (audio SDP information), which is used to characterize that the media server is already in a ringing state.

As shown in fig. 5, in one embodiment, the desktop sharing zoom method provided by the present invention responds to an audio call through a media server and replies to a first message carrying audio decoding information, and then includes:

step S510, the media server responds to the first message and replies a first response message to the IMS core network by transmitting the first message of the media server to the audio terminal through the IMS core network, wherein the first response message is used for representing that the media server is in a response state.

Specifically, the total server transmits a first message (18×message) of the media server to the audio terminal (VOLTE terminal) through the IMS core network, and the media server responds to the first message and replies a first response message (200 response message) to the IMS core network, where the first response message is used to characterize that the media server is already in a response state.

In step S520, when the IMS core network transparently transmits the first response message to the audio terminal, the media server plays the audio IVR procedure or goes to the manual audio for the audio terminal.

As shown in fig. 6, in an embodiment, the desktop sharing scaling method provided by the present invention further includes the following steps:

in step S610, when the audio terminal goes to the artificial audio, the media server receives the RTP media stream from the user terminal, allocates a corresponding artificial seat after detecting the transfer manual request, and initiates an audio call request carrying audio decoding information to the artificial seat.

Specifically, when the VOLTE user presses a button or performs voice transfer, the media server receives RTP media stream of the user side, after detecting correct transfer manual request, the media server allocates a manual seat, initiates a call to the manual seat, sends an INVITE message, and carries audio SDP information.

Step S620, based on the audio call request carrying the audio decoding information to the manual agent, the customer service terminal replies the first information to the media server after responding, and the media server carries the audio decoding information to send the media renegotiation information to the IMS core network.

Specifically, based on initiating an audio call request (INVITE message) carrying audio decoding information to a manual agent, after a customer service terminal responds, replying first information (200 message) to a media server, and the media server carrying the audio decoding information sends media renegotiation information to an IMS core network, namely sends Reinvite message to the IMS core network carrying SDP information, so as to perform media renegotiation.

As shown in fig. 7, in one embodiment, the desktop sharing scaling method provided by the present invention, based on initiating an audio call request carrying audio decoding information to a manual agent, replies first information to a media server after a customer service terminal replies, and the media server carries the audio decoding information to send media renegotiation information to an IMS core network, and then includes the following steps:

step S710, the user terminal replies the first information carrying the audio decoding information based on the media renegotiation information by transmitting the media renegotiation information to the user terminal through the IMS core network, and the user terminal transmits the first information of the user terminal to the media server through the IMS core network.

Specifically, the total server transmits media renegotiation information (Reinvite message) to the user terminal through the IMS core network, the user terminal replies first information (200 message) carrying audio decoding information (audio SDP information) based on the media renegotiation information, and transmits the first information of the user terminal to the media server through the IMS core network.

Step S720, based on the first information carrying the audio decoding information returned by the user terminal, the media server initiates a third renegotiation request to the customer service terminal, where the third renegotiation request is a media renegotiation request based on the media renegotiation information.

Specifically, the total server initiates a third renegotiation request (renegotiation request) to the customer service terminal based on the first information (200 messages) carrying the audio decoding information, which is replied by the user terminal, where the third renegotiation request is a media renegotiation request based on the media renegotiation information.

Step S730, responding to the third renegotiation request by the customer service terminal and replying to the first information carrying the audio decoding information.

As shown in fig. 8, in one embodiment, the method for scaling desktop sharing provided by the present invention performs media encoding and decoding processing on first desktop information through a media server, and transmits the encoded and decoded first desktop information to a user terminal through an IMS core network, where the user terminal scales the first desktop information by operating a sharing screen, and specifically includes the following steps:

step S152, based on the operation of the user on the shared screen, the position information of the touch screen and the moving distance of the touch screen are obtained, and the position information and the moving distance are sent to the media server through the INFO message, so that the desktop scaling identification is expanded in the file of the INFO message.

Specifically, the total server is based on the operation of the user on the shared screen, that is, the user presses the screen shared by the desktop with two fingers and simultaneously moves outwards (desktop enlarging function), the screen shared by the desktop is pressed by two fingers and simultaneously moves inwards and outwards (desktop reducing function), the position information of the two touch screens and the distance between the inner and the outer movement are sent to the media server through an INFO message, and the zoom information is carried by expanding the zoom tag function in xml of the INFO message.

Step S154, the desktop scaling information of the user terminal is sent to the media server through one or more INFO messages, and the INFO messages are transmitted to the media server through the IMS core network, and the media server replies the first information in response to the INFO messages.

As shown in fig. 9, in an embodiment, the desktop sharing scaling method provided by the present invention further includes the following steps:

step S910, the media server receives the first information of the INFO message transmitted by the IMS core network, and parses the INFO message scaled on the desktop of the user terminal to obtain the touch screen or press information of the user and the change condition of the touch screen or press information.

Step S920, based on the touch screen or the press information of the user and the change condition of the touch screen or the press information, the first desktop information is re-encoded and decoded, and scaled according to the same proportion.

Specifically, the media server analyzes the INFO message scaled by the desktop of the VOLTE user, analyzes the touch screen or press information of the user and the change condition of the touch screen or press information, records the change condition, and performs recoding and decoding processing on the picture of the desktop, and performs zooming-in and zooming-out processing in the same proportion. And the desktop sharing page of each subsequent frame is enlarged and reduced according to the recorded proportion until the user performs zoom operation on the desktop again.

The desktop sharing zoom device provided by the invention is described below, and the desktop sharing zoom device described below and the desktop sharing zoom method described above can be referred to correspondingly.

As shown in fig. 10, in one embodiment, a desktop sharing scaling apparatus includes an information switching delivery module 1010, a first renegotiation module 1020, a second renegotiation module 1030, a first information processing module 1040, and a desktop scaling module 1050.

The information switching and transferring module 1010 is configured to send a first switching instruction to the media server through the customer service terminal, so as to switch the current voice call to a video call, and transfer desktop sharing information through a video channel of the audio terminal.

The first renegotiation module 1020 is configured to initiate a first renegotiation request carrying audio decoding information to the customer service terminal through the media server, where the customer service terminal responds to the first renegotiation request, and replies to the first information carrying audio decoding information.

The second renegotiation module 1030 is configured to send a second renegotiation request carrying audio decoding information to the IMS core network through the media server, so as to invoke the IMS core network to transparently transmit the second renegotiation request to the user terminal, where the user terminal replies the first information carrying audio decoding information in response to the second renegotiation request.

The first information processing module 1040 is configured to transparently transmit first information of a user terminal to a media server through an IMS core network, and the customer service terminal selects first desktop information that needs to be shared in desktop sharing information, and sends the first desktop information to the media server.

The desktop scaling module 1050 is configured to perform media encoding and decoding processing on the first desktop information through the media server, and transmit the encoded and decoded first desktop information to the user terminal through the IMS core network, where the user terminal scales the first desktop information by operating the shared screen.

The desktop sharing information at least comprises an IP address, a port number, audio decoding information and license permission, the first information comprises the IP address, the audio port number, audio encoding and decoding information, video port number and video encoding and decoding information of media resources, and the first desktop information comprises the whole desktop, specified files on the desktop and specified areas.

In this embodiment, the desktop sharing zoom apparatus provided by the present invention further includes a ringing state module, configured to:

and sending an audio call request carrying audio decoding information to an IMS core network through the audio terminal according to an SIP protocol, and responding the audio call request by the IMS core network to transmit the audio call of the audio terminal to a media server.

Responding to the audio call by the media server and replying to a first message carrying audio decoding information, the first message being used to characterize that the media server is already in a ringing state.

In this embodiment, the desktop sharing scaling device provided by the present invention further includes a response status module, configured to:

the media server responds to the first message and replies a first response message to the IMS core network through the first message of the media server to the audio terminal, wherein the first response message is used for representing that the media server is in a response state.

When the IMS core network transparently transmits the first response message to the audio terminal, the media server plays an audio IVR flow or transfers to manual audio for the audio terminal.

In this embodiment, the desktop sharing scaling device provided by the present invention further includes a media renegotiation information module, configured to:

when the audio terminal is switched to the artificial audio, the media server receives the RTP media stream from the user terminal, distributes corresponding artificial agents after detecting the manual switching request, and initiates an audio call request carrying audio decoding information to the artificial agents.

Based on the audio call request carrying the audio decoding information initiated to the manual agent, the customer service terminal replies the first information to the media server after responding, and the media server carries the audio decoding information and sends media renegotiation information to the IMS core network.

In this embodiment, the desktop sharing scaling device provided by the present invention further includes a media negotiation request module, configured to:

the IMS core network is used for transmitting the media renegotiation information to the user terminal, the user terminal replies the first information carrying the audio decoding information based on the media renegotiation information, and the IMS core network is used for transmitting the first information of the user terminal to the media server.

Based on the first information carrying the audio decoding information replied by the user terminal, the media server initiates a third renegotiation request to the customer service terminal, wherein the third renegotiation request is a media renegotiation request based on the media renegotiation information.

In this embodiment, the desktop sharing scaling device provided by the present invention, the desktop scaling module is specifically configured to:

based on the operation of the user on the shared screen, the position information of the touch screen and the moving distance of the touch screen are acquired, and the position information and the moving distance are sent to the media server through the INFO message, so that the desktop scaling identification is expanded in the file of the INFO message.

And sending the desktop scaling information of the user terminal to the media server through one or more INFO messages, and transmitting the INFO messages to the media server through an IMS core network, wherein the media server responds to the INFO messages to reply to the first information.

In this embodiment, the desktop sharing scaling device provided by the present invention further includes a desktop scaling sub-module, configured to:

and receiving the first information of the INFO message transmitted by the IMS core network through the media server, and analyzing the INFO message scaled by the desktop of the user terminal to obtain the touch screen or pressing information of the user and the change condition of the touch screen or pressing information.

Fig. 11 illustrates a physical structure diagram of an electronic device, which may be an intelligent terminal, and an internal structure diagram thereof may be as shown in fig. 11. The electronic device includes a processor, an internal memory, and a network interface connected by a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the electronic device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements the desktop sharing scaling method described above.

It will be appreciated by those skilled in the art that the structure shown in fig. 11 is merely a block diagram of a portion of the structure associated with the present inventive arrangements and is not limiting of the electronic device to which the present inventive arrangements are applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

On the other hand, the invention also provides a computer storage medium which stores a computer program, and the computer program realizes the desktop sharing scaling method when being executed by a processor.

In yet another aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the electronic device reads the computer instructions from the computer readable storage medium, and the processor implements the desktop sharing scaling method when executing the computer instructions.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory.

By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The foregoing examples illustrate only a few embodiments of the invention and are described in detail herein without thereby limiting the scope of the invention. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the invention, which are all within the scope of the invention. Accordingly, the scope of protection of the present invention is to be determined by the appended claims.

Claims

1. A desktop sharing scaling method, the method comprising:

2. The desktop sharing scaling method according to claim 1, wherein the step of sending, by the customer service terminal, a first switching instruction to the media server to switch the current voice call to a video call and to transfer desktop sharing information through a video channel of the audio terminal, includes:

3. The desktop sharing scaling method of claim 2, wherein responding to the audio call and replying to the first message carrying audio decoding information through the media server, then comprises:

4. A desktop sharing scaling method as claimed in claim 3, characterized in that the method further comprises:

5. The desktop sharing scaling method according to claim 4, wherein the responding the first information to the media server based on the initiating the audio call request carrying audio decoding information to the manual agent, the media server carrying audio decoding information to send media renegotiation information to the IMS core network, and then comprises:

6. The desktop sharing scaling method according to claim 1, wherein the performing media codec processing on the first desktop information by the media server, and transmitting the first desktop information after the codec processing to the user terminal by the IMS core network, the user terminal scaling the first desktop information by operating a sharing screen, includes:

7. The desktop sharing scaling method of claim 6, further comprising:

8. A desktop sharing zoom apparatus, the apparatus comprising:

9. An electronic device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any one of claims 1 to 7 when the computer program is executed.

10. A computer storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the method of any one of claims 1 to 7.