CN105100673A - Voice over long term evolution (VoLTE) based desktop sharing method and device - Google Patents

Voice over long term evolution (VoLTE) based desktop sharing method and device Download PDF

Info

Publication number
CN105100673A
CN105100673A CN201510317523.3A CN201510317523A CN105100673A CN 105100673 A CN105100673 A CN 105100673A CN 201510317523 A CN201510317523 A CN 201510317523A CN 105100673 A CN105100673 A CN 105100673A
Authority
CN
China
Prior art keywords
information
screen picture
module
image
volte
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510317523.3A
Other languages
Chinese (zh)
Other versions
CN105100673B (en
Inventor
姚胜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201510317523.3A priority Critical patent/CN105100673B/en
Publication of CN105100673A publication Critical patent/CN105100673A/en
Application granted granted Critical
Publication of CN105100673B publication Critical patent/CN105100673B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention discloses a voice over long term evolution (VoLTE) based desktop sharing method and device. The method comprises steps of capturing a screen image, and acquiring first image information of the screen image and sending the first image information to an opposite terminal, wherein the first image information comprises parameter information of the screen image; and receiving second image information of the screen image returned from the opposite terminal, analyzing the second image information according to the parameter information, acquiring an operational order of the opposite terminal for the screen image and performing the operational order. Through adoption of the method, desktop sharing and remote control of the mobile terminal are realized, the practicability, flexibility and interest of a video call are enhanced, and the user experience is improved.

Description

Based on desktop sharing method and the device of VoLTE
Technical field
The present invention relates to communication technical field, particularly relate to a kind of desktop sharing method based on VoLTE and device.
Background technology
VoLTE and VoiceoverLTE, it is a kind of IP data transmission technology, and without the need to 2G/3G net, whole service bearer, on 4G network, can realize data and the unification of speech business under consolidated network.Existing VoLTE video calling, session both sides by movement camera function and IMS ((IPMultimediaSubsystem, IP multimedia system) protocol stack process, by image transfer to the other side, to enable the clear picture seeing oneself of the other side.
Specifically as shown in Figure 1, catch sound and image by Mike and shooting (camera) module and send to APP (application) processor, APP processor processes transmitting ADSP module after sound and image procossing, ADSP module is controlled simultaneously, sound after ADSP resume module and image become data packet format, transfer to IMS protocol stack and LTE (LongTermEvolution again, Long Term Evolution) protocol stack carries out adding the process such as packet header, compressed encoding, sends finally by radio-frequency module.
But, existing VoLTE video call function, the image before the other side can only be made to see oneself mobile phone camera, can not with the other side's share desktop, more can not realize Long-distance Control, practicality and interest are not enough, have impact on Consumer's Experience.
Summary of the invention
Main purpose of the present invention is to propose a kind of desktop sharing method based on VoLTE and device, achieves Desktop Share and the Long-distance Control of mobile terminal, the practicality of augmented video call and interest.
For achieving the above object, the present invention proposes a kind of desktop sharing method based on VoLTE, comprises step:
Screen printing image, obtain the first image information of described screen picture and send to distant terminal, described first image information comprises the parameter information of described screen picture;
Receive the second image information of the screen picture that described distant terminal returns, resolve described second image information according to described parameter information, obtaining described distant terminal to the operational order of described screen picture performs.
Preferably, described parameter information is according to parameter information corresponding during RFB agreement transmission image.
Preferably, described parameter information at least comprises pixel information in pixel information, color depth information, syllable sequence information and coding type information and coding type information.
Preferably, also comprise after the step of described screen printing image: after carrying out format conversion to described screen picture, transfer to photographing module to process accordingly.
Preferably, describedly resolve described second image information according to described parameter information, obtaining distant terminal to the operational order of described screen picture performs, and comprising:
According to described parameter information, described second image information is decoded, the operational order of distant terminal to described screen picture is reduced to corresponding pixel information, and processed by corresponding desktop processing unit.
The present invention proposes a kind of Desktop Share device based on VoLTE simultaneously, comprising:
Screen capture module, for screen printing image;
First processing module, for obtaining the first image information of described screen picture, described first image information comprises the parameter information of described screen picture;
Transceiver module, for sending described first image information to distant terminal, and receives the second image information of the screen picture that described distant terminal returns;
Second processing module, for resolving described second image information according to described parameter information, obtaining described distant terminal to the operational order of described screen picture performs.
Preferably, also comprise photographing module, described screen capture module is used for: send to described photographing module after carrying out format conversion to described screen picture; Described photographing module: send to described first processing module after described screen picture is processed accordingly.
Preferably, described second processing module comprises resolution unit and desktop processing unit, described resolution unit is used for: decode to described second image information according to described parameter information, the operational order of distant terminal to described screen picture is reduced to corresponding pixel information, and sends to corresponding desktop processing unit to process.
A kind of desktop sharing method based on VoLTE proposed by the invention, utilize the high speed of systematic function and operation readiness that existing intelligent mobile terminal is good and LTE network, when carrying out VOLTE voice or video calling, intercept the screen picture of the machine and send distant terminal to, and receive the operational order of distant terminal to screen picture, the operational order received is reduced to local operation instruction, and operates accordingly.Achieve Desktop Share and the Long-distance Control of mobile terminal, enhance the practicality of video calling, flexibility and interest, improve Consumer's Experience.
Accompanying drawing explanation
Fig. 1 is the mutual schematic diagram of each unit module when mobile terminal carries out video calling in prior art;
Fig. 2 is the hardware configuration schematic diagram of the mobile terminal realizing each embodiment of the present invention;
Fig. 3 is the wireless communication system schematic diagram of mobile terminal as shown in Figure 2;
Fig. 4 is the flow chart of desktop sharing method one embodiment that the present invention is based on VoLTE;
Fig. 5 is the mutual schematic diagram of each unit module when mobile terminal carries out Desktop Share in the present invention;
Fig. 6 is the module diagram of Desktop Share device one embodiment that the present invention is based on VoLTE.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix of such as " module ", " parts " or " unit " for representing element only in order to be conducive to explanation of the present invention, itself is specific meaning not.Therefore, " module " and " parts " can mixedly use.
Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as mobile terminal of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desktop computer etc.Below, suppose that terminal is mobile terminal.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.
Fig. 2 is the hardware configuration signal of the mobile terminal realizing each embodiment of the present invention.
Mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) input unit 120, user input unit 130, sensing cell 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190 etc.Fig. 2 shows the mobile terminal with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Will be discussed in more detail below the element of mobile terminal.
Wireless communication unit 110 generally includes one or more assembly, and it allows the radio communication between mobile terminal 100 and wireless communication system or network.Such as, wireless communication unit can comprise at least one in broadcast reception module 111, mobile communication module 112, wireless Internet module 113, short range communication module 114 and positional information module 115.
Broadcast reception module 111 via broadcast channel from external broadcasting management server receiving broadcast signal and/or broadcast related information.Broadcast channel can comprise satellite channel and/or terrestrial channel.Broadcast management server can be generate and send the server of broadcast singal and/or broadcast related information or the broadcast singal generated before receiving and/or broadcast related information and send it to the server of terminal.Broadcast singal can comprise TV broadcast singal, radio signals, data broadcasting signal etc.And broadcast singal may further include the broadcast singal combined with TV or radio signals.Broadcast related information also can provide via mobile communications network, and in this case, broadcast related information can be received by mobile communication module 112.Broadcast singal can exist in a variety of manners, such as, it can exist with the form of the electronic service guidebooks (ESG) of the electronic program guides of DMB (DMB) (EPG), digital video broadcast-handheld (DVB-H) etc.Broadcast reception module 111 can by using the broadcast of various types of broadcast system Received signal strength.Especially, broadcast reception module 111 can by using such as multimedia broadcasting-ground (DMB-T), DMB-satellite (DMB-S), digital video broadcasting-hand-held (DVB-H), forward link media (MediaFLO ) the digit broadcasting system receiving digital broadcast of Radio Data System, received terrestrial digital broadcasting integrated service (ISDB-T) etc.Broadcast reception module 111 can be constructed to be applicable to providing the various broadcast system of broadcast singal and above-mentioned digit broadcasting system.The broadcast singal received via broadcast reception module 111 and/or broadcast related information can be stored in memory 160 (or storage medium of other type).
Radio signal is sent at least one in base station (such as, access point, Node B etc.), exterior terminal and server and/or receives radio signals from it by mobile communication module 112.Such radio signal can comprise voice call signal, based on the Desktop Share signal of VoLTE or various types of data of sending according to text and/or Multimedia Message and/or receive.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be inner or be externally couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can comprise WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.
Short range communication module 114 is the modules for supporting junction service.Some examples of short-range communication technology comprise bluetooth tM, radio-frequency (RF) identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee tMetc..
Positional information module 115 is the modules of positional information for checking or obtain mobile terminal.The typical case of positional information module is GPS (global positioning system).According to current technology, GPS module 115 calculates from the range information of three or more satellite and correct time information and for the Information application triangulation calculated, thus calculates three-dimensional current location information according to longitude, latitude and pin-point accuracy.Current, the method for calculating location and temporal information uses three satellites and by the error of the position that uses an other satellite correction calculation to go out and temporal information.In addition, GPS module 115 can carry out computational speed information by Continuous plus current location information in real time.
A/V input unit 120 is for audio reception or vision signal.A/V input unit 120 can comprise camera 121 and microphone 1220, and the view data of camera 121 to the static images obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display module 151.Picture frame after camera 121 processes can be stored in memory 160 (or other storage medium) or via wireless communication unit 110 and send, and can provide two or more cameras 1210 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by microphone 122.Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when telephone calling model.Microphone 122 can be implemented various types of noise and eliminate (or suppress) algorithm and receiving and sending to eliminate (or suppression) noise or interference that produce in the process of audio signal.
User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and keyboard, the young sheet of pot, touch pad (such as, detecting the touch-sensitive assembly of the change of the resistance, pressure, electric capacity etc. that cause owing to being touched), roller, rocking bar etc. can be comprised.Especially, when touch pad is superimposed upon on display module 151 as a layer, touch-screen can be formed.
Sensing cell 140 detects the current state of mobile terminal 100, (such as, mobile terminal 100 open or close state), the position of mobile terminal 100, user for mobile terminal 100 contact (namely, touch input) presence or absence, the orientation of mobile terminal 100, the acceleration or deceleration of mobile terminal 100 move and direction etc., and generate order or the signal of the operation for controlling mobile terminal 100.Such as, when mobile terminal 100 is embodied as sliding-type mobile phone, sensing cell 140 can sense this sliding-type phone and open or close.In addition, whether whether sensing cell 140 can detect power subsystem 190 provides electric power or interface unit 170 to couple with external device (ED).Sensing cell 140 can comprise proximity transducer 1410 and will be described this in conjunction with touch-screen below.
Interface unit 170 is used as at least one external device (ED) and is connected the interface that can pass through with mobile terminal 100.Such as, external device (ED) can comprise wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port, audio frequency I/O (I/O) port, video i/o port, ear port etc. of the device with identification module.Identification module can be that storage uses the various information of mobile terminal 100 for authentication of users and can comprise subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc.In addition, the device (hereinafter referred to " recognition device ") with identification module can take the form of smart card, and therefore, recognition device can be connected with mobile terminal 100 via port or other jockey.Interface unit 170 may be used for receive from external device (ED) input (such as, data message, electric power etc.) and the input received be transferred to the one or more element in mobile terminal 100 or may be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it electric power to be provided to the path of mobile terminal 100 from base or can be used as the path that allows to be transferred to mobile terminal by it from the various command signals of base input.The various command signal inputted from base or electric power can be used as and identify whether mobile terminal is arranged on the signal base exactly.Output unit 150 is constructed to provide output signal (such as, audio signal, vision signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can comprise display module 151, dio Output Modules 152, alarm modules 153 etc.
Display module 151 may be displayed on the information of process in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display module 151 can show with call or other communicate (such as, text messaging, multimedia file are downloaded etc.) be correlated with user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in based on the Desktop Share pattern of VoLTE or image capture mode, display module 151 can the image of display capture and/or the image of reception, UI or GUI that video or image and correlation function are shown etc.
Meanwhile, when display module 151 and touch pad as a layer superposed on one another to form touch-screen time, display module 151 can be used as input unit and output device.Display module 151 can comprise at least one in liquid crystal display (LCD), thin-film transistor LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc.Some in these displays can be constructed to transparence and watch from outside to allow user, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc.According to the specific execution mode wanted, mobile terminal 100 can comprise two or more display modules (or other display unit), such as, mobile terminal can comprise outside display module (not shown) and inner display module (not shown).Touch-screen can be used for detecting touch input pressure and touch input position and touch and inputs area.
When dio Output Modules 152 can be under the isotypes such as call signal receiving mode, call mode, logging mode, speech recognition mode, broadcast reception mode at mobile terminal, voice data convert audio signals that is that wireless communication unit 110 is received or that store in memory 160 and exporting as sound.And dio Output Modules 152 can provide the audio frequency relevant to the specific function that mobile terminal 100 performs to export (such as, call signal receives sound, message sink sound etc.).Dio Output Modules 152 can comprise loud speaker, buzzer etc.
Alarm modules 153 can provide and export that event informed to mobile terminal 100.Typical event can comprise calling reception, message sink, key signals input, touch input etc.Except audio or video exports, alarm modules 153 can provide in a different manner and export with the generation of notification event.Such as, alarm modules 153 can provide output with the form of vibration, when receive calling, message or some other enter communication (incomingcommunication) time, alarm modules 153 can provide sense of touch to export (that is, vibrating) to notify to user.By providing such sense of touch to export, even if when the mobile phone of user is in the pocket of user, user also can identify the generation of various event.Alarm modules 153 also can provide the output of the generation of notification event via display module 151 or dio Output Modules 152.
Memory 160 software program that can store process and the control operation performed by controller 180 etc., or temporarily can store oneself through exporting the data (such as, telephone directory, message, still image, video etc.) that maybe will export.And, memory 160 can store about when touch be applied to touch-screen time the vibration of various modes that exports and the data of audio signal.
Memory 160 can comprise the storage medium of at least one type, described storage medium comprises flash memory, hard disk, multimedia card, card-type memory (such as, SD or DX memory etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc.And mobile terminal 100 can be connected the memory function of execute store 160 network storage device with by network cooperates.
Controller 180 controls the overall operation of mobile terminal usually.Such as, controller 180 perform to voice call, data communication, based on the relevant control of the Desktop Share etc. of VoLTE and process.In addition, controller 180 can comprise the multi-media module 1810 for reproducing (or playback) multi-medium data, and multi-media module 1810 can be configured in controller 180, or can be configured to be separated with controller 180.Controller 180 can pattern recognition process, is identified as character or image so that input is drawn in the handwriting input performed on the touchscreen or picture.
Power subsystem 190 receives external power or internal power and provides each element of operation and the suitable electric power needed for assembly under the control of controller 180.
Various execution mode described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, execution mode described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such execution mode can be implemented in controller 180.For implement software, the execution mode of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in memory 160 and to be performed by controller 180.
So far, oneself is through the mobile terminal according to its functional description.Below, for the sake of brevity, by the slide type mobile terminal that describes in various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.
Mobile terminal 100 as shown in Figure 2 can be constructed to utilize and send the such as wired and wireless communication system of data via frame or grouping and satellite-based communication system operates.
Describe wherein according to the communication system that mobile terminal of the present invention can operate referring now to Fig. 3.
Such communication system can use different air interfaces and/or physical layer.Such as, the air interface used by communication system comprises such as frequency division multiple access (FDMA), time division multiple access (TDMA), code division multiple access (CDMA) and universal mobile telecommunications system (UMTS) (especially, Long Term Evolution (LTE)), global system for mobile communications (GSM) etc.As non-limiting example, description below relates to cdma communication system, but such instruction is equally applicable to the system of other type.
With reference to figure 3, cdma wireless communication system can comprise multiple mobile terminal 100, multiple base station (BS) 270, base station controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is constructed to form interface with Public Switched Telephony Network (PSTN) 290.MSC280 is also constructed to form interface with the BSC275 that can be couple to base station 270 via back haul link.Back haul link can construct according to any one in some interfaces that oneself knows, described interface comprises such as E1/T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL.Will be appreciated that system as shown in Figure 3 can comprise multiple BSC2750.
Each BS270 can serve one or more subregion (or region), by multidirectional antenna or point to specific direction each subregion of antenna cover radially away from BS270.Or each subregion can by two or more antenna covers for diversity reception.Each BS270 can be constructed to support multiple parallel compensate, and each parallel compensate has specific frequency spectrum (such as, 1.25MHz, 5MHz etc.).
Subregion can be called as CDMA Channel with intersecting of parallel compensate.BS270 also can be called as base station transceiver subsystem (BTS) or other equivalent terms.Under these circumstances, term " base station " may be used for broadly representing single BSC275 and at least one BS270.Base station also can be called as " cellular station ".Or each subregion of particular B S270 can be called as multiple cellular station.
As shown in Figure 3, broadcast singal is sent to the mobile terminal 100 at operate within systems by broadcsting transmitter (BT) 295.Broadcast reception module 111 as shown in Figure 2 is arranged on mobile terminal 100 and sentences the broadcast singal receiving and sent by BT295.In figure 3, several global positioning system (GPS) satellite 300 is shown.Satellite 300 helps at least one in the multiple mobile terminal 100 in location.
In figure 3, depict multiple satellite 300, but understand, the satellite of any number can be utilized to obtain useful locating information.GPS module 115 as shown in Figure 2 is constructed to coordinate to obtain the locating information wanted with satellite 300 usually.Substitute GPS tracking technique or outside GPS tracking technique, can use can other technology of position of tracking mobile terminal.In addition, at least one gps satellite 300 optionally or extraly can process satellite dmb transmission.
As a typical operation of wireless communication system, BS270 receives the reverse link signal from various mobile terminal 100.Mobile terminal 100 participates in call usually, information receiving and transmitting communicates with other type.Each reverse link signal that certain base station 270 receives is processed by particular B S270.The data obtained are forwarded to relevant BSC275.BSC provides call Resourse Distribute and comprises the mobile management function of coordination of the soft switching process between BS270.The data received also are routed to MSC280 by BSC275, and it is provided for the extra route service forming interface with PSTN290.Similarly, PSTN290 and MSC280 forms interface, and MSC and BSC275 forms interface, and BSC275 correspondingly control BS270 so that forward link signals is sent to mobile terminal 100.
Based on above-mentioned mobile terminal hardware configuration and communication system, desktop sharing method one embodiment that the present invention is based on VoLTE is proposed.As shown in Figure 4, Figure 5, said method comprising the steps of:
S11, in video call process, start Desktop Share function.
Concrete, as shown in Figure 5, after terminal starts video calling, carry out traditional LTE video calling, catch sound and image by Mike and photographing module, APP processor processes transmitting ADSP module after sound and image procossing, ADSP module is controlled simultaneously, sound after ADSP resume module and image become data packet format, then transfer to IMS protocol stack and LTE protocol stack to carry out adding the process such as packet header, compressed encoding, send finally by radio-frequency module.
Meanwhile, in video call process, user can start Desktop Share function at any time, can be started by menu option, also can pass through programmable button, preset the startup such as gesture or phonetic order.
In certain embodiments, user also directly can directly start Desktop Share function at main interface, and restarts Desktop Share function after first starting video call function.
S12, screen printing image.
When after startup Desktop Share function, the screen capture module of terminal intercepts a screen picture every Preset Time, UI (user) interface of described screen picture and the current display of terminal.
First image information of S13, acquisition screen picture, this first image information comprises the parameter information of screen picture.
Concrete, as shown in Figure 5, when after startup Desktop Share function, first transmit one and close camera function mark to photographing module, close camera function, but do not close the port that photographing module obtains view data.When after screen capture module screen printing image, first format conversion is carried out to the view data of screen picture, be converted to the form that photographing module can process, then send to photographing module to process accordingly, form frame structure data, then screen picture is sent to the first processing module process.Thus the FPDP that photographing module is ready-made can be utilized, without the need to other setting data port, cost-saving.Certainly, in certain embodiments, also screen picture can be sent to first processing module by setting data port in addition.
First processing module obtains the first image information of screen picture, and carry out compression process, this first image information comprises the view data, parameter information etc. of screen picture, wherein parameter information is according to RFB (RemoteFrameBuffer, Remote Frame Buffer) agreement corresponding parameter information when transmitting image, this parameter information at least comprises pixel information and coding type information, can also comprise color depth information, syllable sequence information etc.Then APP processor is sent to process accordingly the first image information.
Preferably, last screen picture and this screen picture can compare by the first processing module, the more new data of this screen picture is calculated based on last screen picture, only the data upgraded are processed, and the data after process are sent to APP processor, and retain this screen picture.Thus data processing amount and transmission quantity can be reduced, improve treatment effeciency and efficiency of transmission.
After the process of APP processor, send to ADSP resume module, then send to radio-frequency module after carrying out particular procedure via IMS protocol stack and LTE protocol stack.APP processor, ADSP module, IMS protocol stack and LTE protocol stack are identical with the processing mode of traditional LTE video in video call process image to the processing mode of the first image information, do not repeat them here.
S14, send the first image information to distant terminal.
After radio-frequency module receives the first image information, send this first image information to distant terminal.
Second image information of the screen picture that S15, reception distant terminal return.
Concrete, distant terminal reduces to screen picture according to the first image information after receiving the first image information of screen picture, and on screen, show this screen picture.Start screen printing image simultaneously, as step S12, a screen picture can be intercepted every Preset Time, also can detecting that the screen picture of user to current display intercepts a screen picture when operating.
After distant terminal has intercepted screen picture, its follow-up processing mode is identical with step S13, obtains the second image information of the screen picture intercepted, and sends the second image information by radio-frequency module.
S16, resolve the second image information according to parameter information, obtaining distant terminal to the operational order of screen picture performs.
Concrete, as shown in Figure 5, after radio-frequency module receives the second image information, send the second processing module to successively after LTE protocol stack, IMS protocol stack, ADSP module and APP processor carry out respective handling, this second processing module comprises resolution unit and desktop processing unit.The resolution unit of the second processing module is decoded to the second image information according to the parameter information such as pixel information, coding type information of screen picture, obtain distant terminal to the operational order of screen picture, this operational order is reduced to corresponding pixel information, and send to the interface function of corresponding desktop processing unit, to make desktop processing unit process accordingly, perform this operational order.
Thus, the present invention is based on the desktop sharing method of VoLTE, utilize the high speed of systematic function and operation readiness that existing intelligent mobile terminal is good and LTE network, when carrying out VOLTE voice or video calling, intercept the screen picture of the machine and send distant terminal to, and receive the operational order of distant terminal to screen picture, the operational order received is reduced to local operation instruction, and operates accordingly.Achieve Desktop Share and the Long-distance Control of mobile terminal, enhance the practicality of video calling, flexibility and interest, improve Consumer's Experience.
The present invention further provides a kind of Desktop Share device based on VoLTE, be applied to aforementioned mobile terminal.Now based on above-mentioned mobile terminal hardware configuration and communication system, Desktop Share device one embodiment that the present invention is based on VoLTE is proposed.As shown in Figure 6, described device comprises the screen capture module, photographing module, the first processing module, APP processor, ADSP module, IMS protocol stack, LTE protocol stack, the transceiver module that connect successively, and connects the second processing module of APP processor, wherein:
Screen capture module: for after startup Desktop Share function, intercept a screen picture every Preset Time, and format conversion is carried out to the view data of screen picture, be converted to the form that photographing module can process, then send to photographing module.UI (user) interface of described screen picture and the current display of terminal.
Photographing module: for processing accordingly screen picture, is frame structure data by the image real time transfer of screen picture, and sends to the first processing module.
First processing module: for obtaining the first image information of screen picture, and carry out compression process, this first image information comprises the view data, parameter information etc. of screen picture, wherein parameter information is according to parameter information corresponding during RFB agreement transmission image, this parameter information at least comprises pixel information and coding type information, can also comprise color depth information, syllable sequence information etc.Then APP processor is sent to process accordingly the first image information.
Preferably, last screen picture and this screen picture can compare by the first processing module, the more new data of this screen picture is calculated based on last screen picture, only the data upgraded are processed, and the data after process are sent to APP processor, and retain this screen picture.Thus data processing amount and transmission quantity can be reduced, improve treatment effeciency and efficiency of transmission.
APP processor sends to ADSP resume module after carrying out respective handling to the first image information that the first processing module sends, then sends to sending module after carrying out particular procedure via IMS protocol stack and LTE protocol stack.APP processor, ADSP module, IMS protocol stack and LTE protocol stack are identical with the processing mode of traditional LTE video in video call process image to the processing mode of the first image information, do not repeat them here.
Transceiver module: for sending the first image information to distant terminal, and receive the second image information of the screen picture that distant terminal returns, the transmitting-receiving of information is carried out preferably by radio-frequency module.
After transceiver module receives the second image information, after LTE protocol stack, IMS protocol stack, ADSP module and APP processor carry out respective handling, send the second processing module to successively.
Second processing module: for resolving the second image information according to parameter information, obtains distant terminal and performs the operational order of described screen picture.
Second processing module comprises resolution unit and desktop processing unit.Resolution unit is used for decoding to the second image information according to the parameter information such as pixel information, coding type information of screen picture, obtain distant terminal to the operational order of screen picture, this operational order is reduced to corresponding pixel information, and send to the interface function of corresponding desktop processing unit, to make desktop processing unit process accordingly, perform this operational order.
Thus, the present invention is based on the Desktop Share device of VoLTE, utilize the high speed of systematic function and operation readiness that existing intelligent mobile terminal is good and LTE network, when carrying out VOLTE voice or video calling, intercept the screen picture of the machine and send distant terminal to, and receive the operational order of distant terminal to screen picture, the operational order received is reduced to local operation instruction, and operates accordingly.Achieve Desktop Share and the Long-distance Control of mobile terminal, enhance the practicality of video calling, flexibility and interest, improve Consumer's Experience.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computer, server, air conditioner, or the network equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.

Claims (10)

1. based on a desktop sharing method of VoLTE, it is characterized in that, comprise step:
Screen printing image, obtain the first image information of described screen picture and send to distant terminal, described first image information comprises the parameter information of described screen picture;
Receive the second image information of the screen picture that described distant terminal returns, resolve described second image information according to described parameter information, obtaining described distant terminal to the operational order of described screen picture performs.
2. the desktop sharing method based on VoLTE according to claim 1, is characterized in that, described parameter information is according to parameter information corresponding during RFB agreement transmission image.
3. the desktop sharing method based on VoLTE according to claim 1, is characterized in that, described parameter information at least comprises pixel information in pixel information, color depth information, syllable sequence information and coding type information and coding type information.
4. the desktop sharing method based on VoLTE according to any one of claim 1-3, is characterized in that, also comprises after the step of described screen printing image: transfer to photographing module to process accordingly after carrying out format conversion to described screen picture.
5. the desktop sharing method based on VoLTE according to any one of claim 1-3, is characterized in that, describedly resolve described second image information according to described parameter information, obtains distant terminal to the operational order of described screen picture to perform, and comprising:
According to described parameter information, described second image information is decoded, the operational order of distant terminal to described screen picture is reduced to corresponding pixel information, and processed by corresponding desktop processing unit.
6., based on a Desktop Share device of VoLTE, it is characterized in that, comprising:
Screen capture module, for screen printing image;
First processing module, for obtaining the first image information of described screen picture, described first image information comprises the parameter information of described screen picture;
Transceiver module, for sending described first image information to distant terminal, and receives the second image information of the screen picture that described distant terminal returns;
Second processing module, for resolving described second image information according to described parameter information, obtaining described distant terminal to the operational order of described screen picture performs.
7. the Desktop Share device based on VoLTE according to claim 6, is characterized in that, described parameter information is according to parameter information corresponding during RFB agreement transmission image.
8. the Desktop Share device based on VoLTE according to claim 6, is characterized in that, described parameter information at least comprises pixel information in pixel information, color depth information, syllable sequence information and coding type information and coding type information.
9. the Desktop Share device based on VoLTE according to any one of claim 6-8, it is characterized in that, also comprise photographing module, described screen capture module is used for: send to described photographing module after carrying out format conversion to described screen picture; Described photographing module: send to described first processing module after described screen picture is processed accordingly.
10. the Desktop Share device based on VoLTE according to any one of claim 6-8, it is characterized in that, described second processing module comprises resolution unit and desktop processing unit, described resolution unit is used for: decode to described second image information according to described parameter information, the operational order of distant terminal to described screen picture is reduced to corresponding pixel information, and sends to corresponding desktop processing unit to process.
CN201510317523.3A 2015-06-10 2015-06-10 Desktop sharing method and device based on VoLTE Active CN105100673B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510317523.3A CN105100673B (en) 2015-06-10 2015-06-10 Desktop sharing method and device based on VoLTE

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510317523.3A CN105100673B (en) 2015-06-10 2015-06-10 Desktop sharing method and device based on VoLTE

Publications (2)

Publication Number Publication Date
CN105100673A true CN105100673A (en) 2015-11-25
CN105100673B CN105100673B (en) 2019-07-19

Family

ID=54580104

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510317523.3A Active CN105100673B (en) 2015-06-10 2015-06-10 Desktop sharing method and device based on VoLTE

Country Status (1)

Country Link
CN (1) CN105100673B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107509051A (en) * 2017-08-14 2017-12-22 宇龙计算机通信科技(深圳)有限公司 Long-range control method, device, terminal and computer-readable recording medium
CN107872426A (en) * 2016-09-26 2018-04-03 中兴通讯股份有限公司 A kind of long-range control establishing method and device based on VOLTE
CN108270734A (en) * 2016-12-30 2018-07-10 展讯通信(上海)有限公司 Mobile terminal realizes the method and device of Desktop Share
CN110493482A (en) * 2019-07-05 2019-11-22 潘子萌 A kind of cloud desktop throwing screen phone
CN111885393A (en) * 2020-07-31 2020-11-03 广州华多网络科技有限公司 Live broadcast method, system, storage medium and equipment
CN111885015A (en) * 2020-07-06 2020-11-03 惠州市源医科技有限公司 Method for remotely controlling equipment based on RTP

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110881082A (en) * 2019-10-10 2020-03-13 袁建平 Cloud desktop layering method

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010109151A1 (en) * 2009-03-25 2010-09-30 Sagem Communications Sas Method for the remote sharing of computer office(s)
CN101964798A (en) * 2010-10-15 2011-02-02 德讯科技股份有限公司 Multi-graphic protocol unified proxy system based on remote desktop protocol
CN102340792A (en) * 2010-07-22 2012-02-01 上海贝尔股份有限公司 Switching method and equipment
CN102855866A (en) * 2011-06-30 2013-01-02 联想(北京)有限公司 Terminal, display terminal, display system and display method
CN103546629A (en) * 2012-07-13 2014-01-29 Lg电子株式会社 Mobile terminal and controlling method thereof
CN103618884A (en) * 2013-12-16 2014-03-05 东方网力科技股份有限公司 Video transmission method, device and tablet computer

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010109151A1 (en) * 2009-03-25 2010-09-30 Sagem Communications Sas Method for the remote sharing of computer office(s)
CN102340792A (en) * 2010-07-22 2012-02-01 上海贝尔股份有限公司 Switching method and equipment
CN101964798A (en) * 2010-10-15 2011-02-02 德讯科技股份有限公司 Multi-graphic protocol unified proxy system based on remote desktop protocol
CN102855866A (en) * 2011-06-30 2013-01-02 联想(北京)有限公司 Terminal, display terminal, display system and display method
CN103546629A (en) * 2012-07-13 2014-01-29 Lg电子株式会社 Mobile terminal and controlling method thereof
CN103618884A (en) * 2013-12-16 2014-03-05 东方网力科技股份有限公司 Video transmission method, device and tablet computer

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107872426A (en) * 2016-09-26 2018-04-03 中兴通讯股份有限公司 A kind of long-range control establishing method and device based on VOLTE
CN108270734A (en) * 2016-12-30 2018-07-10 展讯通信(上海)有限公司 Mobile terminal realizes the method and device of Desktop Share
CN107509051A (en) * 2017-08-14 2017-12-22 宇龙计算机通信科技(深圳)有限公司 Long-range control method, device, terminal and computer-readable recording medium
CN110493482A (en) * 2019-07-05 2019-11-22 潘子萌 A kind of cloud desktop throwing screen phone
CN111885015A (en) * 2020-07-06 2020-11-03 惠州市源医科技有限公司 Method for remotely controlling equipment based on RTP
CN111885393A (en) * 2020-07-31 2020-11-03 广州华多网络科技有限公司 Live broadcast method, system, storage medium and equipment

Also Published As

Publication number Publication date
CN105100673B (en) 2019-07-19

Similar Documents

Publication Publication Date Title
CN105159533A (en) Mobile terminal and automatic verification code input method thereof
CN104850259A (en) Combination operation method, combination operation apparatus, touch screen operating method and electronic device
CN104660912A (en) Photographing method and photographing device
CN104954553A (en) Mobile terminal split-screen display method and device
CN104883658A (en) Virtual card information processing method and system
CN104735255A (en) Split screen display method and system
CN105100673A (en) Voice over long term evolution (VoLTE) based desktop sharing method and device
CN105101052A (en) Method, system and mobile terminal for transferring SIM card
CN105282245A (en) Server-crossing message pushing system and method
CN105227892A (en) Video call system, apparatus and method
CN105100482A (en) Mobile terminal and system for realizing sign language identification, and conversation realization method of the mobile terminal
CN105119825A (en) Data transmission device and data transmission method
CN104657482A (en) Method for displaying application interface and terminal
CN104731512A (en) Method, device and terminal for sharing pictures
CN104968033A (en) Terminal network processing method and apparatus
CN105243126A (en) Cross-screen screen capture method and apparatus
CN104951236A (en) Wallpaper configuration method for terminal device, and terminal device
CN104850325A (en) Mobile terminal application processing method and device
CN104917965A (en) Shooting method and device
CN104853088A (en) Method for rapidly focusing a photographing mobile terminal and mobile terminal
CN104679890A (en) Image pushing method and device
CN105338245A (en) Photo-taking sharing method, photo-taking sharing terminal and photo-taking sharing system
CN105430258A (en) Method and device for taking self-timer group photos
CN105278995A (en) Management method of application, system, server and mobile terminal
CN105242483A (en) Focusing realization method and device and shooting realization method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant