CN104349110A - Terminal remote interaction method and system - Google Patents
Terminal remote interaction method and system Download PDFInfo
- Publication number
- CN104349110A CN104349110A CN201410493587.4A CN201410493587A CN104349110A CN 104349110 A CN104349110 A CN 104349110A CN 201410493587 A CN201410493587 A CN 201410493587A CN 104349110 A CN104349110 A CN 104349110A
- Authority
- CN
- China
- Prior art keywords
- terminal
- video
- expert
- video data
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a terminal remote interaction method. When an audio and video connection request sent by a first terminal is detected, a server builds an audio and video channel between the first terminal and a second terminal; when the audio data an the video data sent by the first terminal are received, a background region in the video data is determined by the server; the server carries out pre-processing on the determined background region, in addition, the audio data and the pre-processed video data are sent to the second terminal on the basis of the video channel, so that the second terminal displays the pre-processed video data, and meanwhile, the audio data is played. The invention also provides a terminal remote interaction system. The invention also provides a terminal remote interaction system. The influence of other images in the video data on the current video communication is avoided, and the service processing efficiency is improved.
Description
Technical field
The present invention relates to the mutual field of teledata, particularly relate to terminal remote exchange method and system.
Background technology
Bank is the comprehensive raising Consumer's Experience improving its service, the cabinet dough figurine person that at least 5-7 name possesses complete banking knowledge must be equipped with in each site, even if in the site that complicated business is considerably less, above-mentioned high-quality personnel depaly can not be cut down, and this basic personnel depaly requires the height enterprise and the waste that cause bank's cost.
For solving the problem, cabinet dough figurine person can rely on when processing complicated business the timely communication that phone and video etc. carry out business, but owing to may there is interference in the video data of the process terminal demonstration carrying out linking up, causes Business Processing efficiency lower.
A great deal of employee possessing relatively senior professional skill still must be possessed in bank outlets' cabinet face, to the Rapid Expansion of bank outlets, promotes customer experience, reduces bank's operating cost totally unfavorable
Summary of the invention
Main purpose of the present invention is to solve the lower technical problem of Business Processing efficiency.
For achieving the above object, a kind of terminal remote exchange method provided by the invention, described terminal remote exchange method comprises the following steps:
When detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal;
When receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
Described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, while the pretreated video data of the second terminal demonstration, playing audio data;
The Voice & Video data retransmission that second terminal sends based on described video frequency channel by described server, to first terminal, while showing the video data that the second terminal sends, plays the voice data that the second terminal sends for first terminal;
Preferably, described when detecting the audio frequency and video connection request that first terminal sends, after server sets up the step of the audio frequency and video path between first terminal and the second terminal, described terminal remote exchange method also comprises:
Detect the second terminal based on video data display interface trigger zoom in or out operation time, described server determines the video data zoomed in or out, and the ratio zoomed in or out;
Described server to zoom in or out operation according to the ratio determined to video data corresponding in current display interface, and sends to described second terminal by zooming in or out the video data display interface after operation, shows for the second terminal.
Preferably, described when detecting the audio frequency and video connection request that first terminal sends, after server sets up the step of the audio frequency and video path between first terminal and the second terminal, described terminal remote exchange method also comprises:
When detecting the annotations and comments operation that the second terminal triggers based on video data display interface, described server obtains positional information corresponding to described annotations and comments operation;
Described positional information is sent to first terminal by described server, for first terminal based on the endorsement information of described positional information in its display screen display correspondence.
Preferably, Voice & Video data retransmission to the second terminal that described first terminal sends based on described video frequency channel by described server, for while the video data that the second terminal demonstration first terminal sends, before playing the step of the voice data that first terminal sends, described terminal remote exchange method also comprises:
Described first terminal carries out transposition or cutting process to the video data collected, and the video data after voice data and transposition or cutting is sent to described server.
Preferably, described when detecting the video connection request that first terminal sends, before server sets up the step of the video frequency channel between first terminal and the second terminal, described terminal remote exchange method comprises:
When detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
When described log-on message is the log-on message of preset kind, described server sends video request to described first terminal and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
Preferably, described when detecting the audio frequency and video connection request that first terminal sends, the step of the audio frequency and video path that server is set up between first terminal and the second terminal comprises:
When detecting the audio frequency and video connection request that first terminal sends, described server pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
When detecting the selection request that first terminal sends, described server is based on the described expert selecting the correspondence of request locking;
Described server is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
Preferably, described when detecting the audio frequency and video connection request that first terminal sends, the step of the audio frequency and video path that server is set up between first terminal and the second terminal comprises:
When detecting the audio frequency and video connection request that first terminal sends, described server determines idle expert;
The idle expert determined for time multiple, described server determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Described server is based on the contact details corresponding to the highest expert of priority, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
In addition, for achieving the above object, the present invention also proposes a kind of terminal remote interactive system, and described terminal remote interactive system comprises:
Audio frequency and video path setting module, for when detecting the video connection request that first terminal sends, sets up the audio frequency and video path between first terminal and the second terminal;
Determination module, for when receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
Processing module, for carrying out preliminary treatment to the background area determined;
Sending module, for the video data after described voice data and preliminary treatment being sent to described second terminal based on described video frequency channel, while the pretreated video data of the second terminal demonstration, playing audio data, and the Voice & Video data retransmission the second terminal to be sent based on described video frequency channel is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends;
Preferably, described determination module, also for detect the second terminal based on video data display interface trigger zoom in or out operation time, determine the video data zoomed in or out, and the ratio zoomed in or out; Described processing module, also for zooming in or out operation according to the ratio determined to video data corresponding in current display interface; Described sending module, also for sending to described second terminal by zooming in or out the video data display interface after operation, shows for the second terminal.
Preferably, described terminal remote interactive system also comprises:
Acquisition module, for when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, obtains the positional information that described annotations and comments operation is corresponding;
Described sending module, also for described positional information is sent to first terminal, shows corresponding endorsement information based on described positional information at its display screen for first terminal.
Preferably, described terminal remote interactive system also comprises:
Described determination module, also for when detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
Interface provides module, and for when described log-on message is the log-on message of preset kind, described first terminal sends video request and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
Preferably, described audio frequency and video path setting module comprises:
Interface push unit, for when detecting the connection request that first terminal sends, pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
Lock cell, for when detecting the selection request that first terminal sends, based on the described expert selecting the correspondence of request locking;
Transmitting element is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, sets up the audio frequency and video path between first terminal and the second terminal.
Preferably, described audio frequency and video path setting module comprises:
Determining unit, for when detecting the video connection request that first terminal sends, determines idle expert, and the idle expert determined for time multiple, determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Transmitting element, for based on the contact details corresponding to the highest expert of priority, the second terminal to correspondence sends and connects video request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described video connection request, sets up the video frequency channel between first terminal and the second terminal.
The terminal remote exchange method that the present invention proposes and system, when detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal; When receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data; Described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, while the pretreated video data of the second terminal demonstration, playing audio data; The Voice & Video data retransmission that second terminal sends based on described video frequency channel by described server is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends, with the impact avoiding other image in video data to converse on current video, improve Business Processing efficiency.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of terminal remote exchange method first embodiment of the present invention;
Fig. 2 is the schematic flow sheet of terminal remote exchange method second embodiment of the present invention;
Fig. 3 is the schematic flow sheet of terminal remote exchange method the 3rd embodiment of the present invention;
Fig. 4 is the schematic flow sheet of terminal remote exchange method the 4th embodiment of the present invention;
Fig. 5 is the schematic diagram of video transposition in terminal remote exchange method of the present invention;
Fig. 6 is the schematic flow sheet of terminal remote exchange method the 5th embodiment of the present invention;
Fig. 7 is the high-level schematic functional block diagram of terminal remote interactive system first embodiment of the present invention;
Fig. 8 is the high-level schematic functional block diagram of terminal remote interactive system second embodiment of the present invention;
Fig. 9 is the high-level schematic functional block diagram of terminal remote interactive system the 3rd embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The invention provides a kind of terminal remote exchange method.
With reference to the schematic flow sheet that Fig. 1, Fig. 1 are terminal remote exchange method first embodiment of the present invention.
The terminal remote exchange method that the present embodiment proposes, comprising:
Step S10, when detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal;
In the present embodiment, first terminal and the second terminal can comprise display unit, microphone, video acquisition device (as camera) and audio output device (loud speaker), this microphone is preferably shotgun microphone in the present embodiment, reduce the noise signal in the audio signal of picking up, improve recognition accuracy, audio output device is preferably directional loudspeaker simultaneously, ensure that other people of voice data exported can not hear, this display unit, microphone, video acquisition device and audio output device can integrated setting, or the convenience in order to data acquisition can be provided separately in different places, and communicate to connect.
In the present embodiment, user can after transmission audio frequency and video connection request, and carry out the selection of line expert, concrete mode is as follows:
A, described step S10 comprise:
When detecting the audio frequency and video connection request that first terminal sends, described server pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
When detecting the selection request that first terminal sends, described server is based on the described expert selecting the correspondence of request locking;
Described server is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
In the present embodiment, user can select corresponding expert based on select expert interface, flexibility is higher, simultaneously for improving the success rate connected, can in the state information of each expert of select expert interface display, as currently in this expert be in busy or idle condition, busy condition refer to the second terminal corresponding to this expert with other terminal communication, and idle condition refer to the second terminal corresponding to this expert not with other terminal communication, user can seek advice from based on the expert that the condition selecting of each expert is corresponding; Further, for improving Business Processing efficiency, the traffic type information can be good at each expert of select expert interface display, user can select fast based on this traffic type information, there will not be situation about reselecting.Contact details corresponding to this expert may correspond to the account information with expert.
B, described step S10 comprise:
When detecting the audio frequency and video connection request that first terminal sends, described server determines idle expert;
The idle expert determined for time multiple, described server determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Described server is based on the contact details corresponding to the highest expert of priority, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
In the present embodiment, contact details corresponding to expert can be the account information of expert, and this expert's priority preset can be default expert and puts in order or the professional ability rank etc. from low to high of each expert.In the present embodiment, can save the selection course of user, efficiency is higher.
C, described step S10 comprise:
When detecting the audio frequency and video connection request that first terminal sends, described server determines idle expert;
The idle expert determined for time multiple, described server initiates to group busy to the second terminal that each idle expert is corresponding;
Receive based on described group busy the response message of feedback time, described server stops grouping busy, and sets up the audio frequency and video path between first terminal and the second terminal of feedback response information.
The program to each idle expert corresponding second terminal initiate group busy time, first the contact details that each idle expert is corresponding can be determined, and initiate to group busy to the second terminal that each contact details are corresponding, second terminal receive group busy request time, can show response confirmation interface, the select expert for the second terminal side responds or refusal grouies busy request; When request is grouied busy in the response receiving expert's input, described second terminal to server feedback response information.
Three kinds that enumerate above modes of carrying out the selection of line expert are only exemplary; those skilled in the art utilize technological thought of the present invention; other modes of carrying out the selection of line expert proposed according to its real needs, all in protection scope of the present invention, are not carried out exhaustive one by one at this.
In the present embodiment, the second terminal is one and also can be multiple, can connect different experts based on business demand.It will be understood by those skilled in the art that, for improving the intellectuality of system, when detecting the audio frequency and video connection request that first terminal sends, server, to terminal transmission service type selection interface, selects interface to select corresponding type of service for user based on described type of service; When receiving the traffic type information that user selects interface to send based on described type of service, described server is based on the mapping relations between the traffic type information preset and expert's contact details, determine the expert's contact details corresponding to present type of service, and set up the audio frequency and video path between first terminal and the second terminal corresponding to volume expert info determined.Further, described server is based on the mapping relations between the traffic type information preset and expert's contact details, when expert's contact details corresponding to the present type of service determined are multiple, select expert interface can be pushed to first terminal and select corresponding expert for user, also can select corresponding expert based on the expert's priority preset.
Step S20, when receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
In the present embodiment, the background area in video data can be stated based on humanoid outline technology identification, such as, the boundary profile of each colour switching is identified based on the conversion of color in video data, and each boundary profile and the humanoid profile preset are compared, obtain corresponding humanoid profile, then the region outside humanoid profile is background area.
Step S30, described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, and while the pretreated video data of the second terminal demonstration, playing audio data;
In the present embodiment; various ways is comprised to the preliminary treatment of background area; default picture is replaced with as virtualization background area or by background area; the pretreatment mode of this background area can have multiple; do not limit at this; those skilled in the art utilize technological thought of the present invention, and the pretreatment mode of the background area proposed according to its real needs is all in protection scope of the present invention.
Step S40, the Voice & Video data retransmission that the second terminal sends based on described video frequency channel by described server, to first terminal, while showing the video data that the second terminal sends, plays the voice data that the second terminal sends for first terminal;
In the present embodiment, step S20 and step S40 does not have sequencing.
In the present embodiment, due to the multi-path video data that first terminal sends, when terminal as bank cashier place is first terminal, this first terminal can gather the video data of bank cashier, the video data of document and contract etc. and the video data of client, now Ke Jiangmei road video data is added into the corresponding position in default display interface, and pushes to the second terminal show adding the video data display interface of video data.The video data of the second terminal is sent to the principle of first terminal in like manner by server.
The terminal remote exchange method that the present embodiment proposes, when detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal; When receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data; Described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, while the pretreated video data of the second terminal demonstration, playing audio data; The Voice & Video data retransmission that second terminal sends based on described video frequency channel by described server is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends, with the impact avoiding other image in video data to converse on current video, improve Business Processing efficiency.
Further, for improving the diversity of user function, improving business handling efficiency, with reference to Fig. 2, proposing terminal interaction method second embodiment of the present invention based on the first embodiment, also comprising step after step S10 in the present embodiment:
Step S50, detect the second terminal based on video data display interface trigger zoom in or out operation time, described server determines the video data zoomed in or out, and the ratio zoomed in or out;
Step S60, described server to zoom in or out operation according to the ratio determined to video data corresponding in current display interface, and send to described second terminal by zooming in or out the video data display interface after operation, show for the second terminal.
In the present embodiment, user can carry out amplifieroperation to the video data that video display interface shows, to make the information such as document in video terminal clearly, or reduction operation is carried out to the video data that video display interface shows, to carry out global observing.
Further, for improving the diversity of user function, improving business handling efficiency, with reference to Fig. 3, proposing terminal interaction method of the present invention 3rd embodiment based on the second embodiment, in the present embodiment, also comprising after described step S10:
Step S70, when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, described server obtains positional information corresponding to described annotations and comments operation and annotations and comments content, to generate endorsement information;
In the present embodiment; user can trigger annotations and comments operation based on various ways; such as trigger annotations and comments operation based on the control of criticizing on video data display interface; or trigger annotations and comments operation based on producing sliding trace on the touchscreen; these annotations and comments operation triggering mode can have multiple; do not limit at this, those skilled in the art utilize technological thought of the present invention, operate triggering mode all in protection scope of the present invention according to the annotations and comments that its real needs propose.
When detecting annotations and comments operation, obtaining the positional information that annotations and comments operation is corresponding, carrying out the positional information of the pixel of annotations and comments operation, or annotating and commenting on the positional information operated on current video data display interface.
Step S80, described positional information is sent to first terminal by described server, for first terminal based on the endorsement information of described positional information in its display screen display correspondence.
In the present embodiment, first terminal can in the endorsement information of its display screen display correspondence based on this positional information, and such as, first terminal changes the color at correspondence position information place in its video data display interface, or add mark etc., form final endorsement information.
The terminal remote exchange method that the present embodiment proposes, when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, described server obtains positional information corresponding to described annotations and comments operation and described positional information is sent to first terminal, for first terminal based on the endorsement information of described positional information in the corresponding position of its display screen display correspondence, make first terminal can show the annotations and comments content of the second terminal based on the video data of current display in time, so that user knows the problem in the data such as document in time, improve Business Processing efficiency.
Further, for improving functional diversity, with reference to Fig. 4, proposing terminal remote exchange method the 4th embodiment of the present invention based on the first to the 3rd any embodiment, in the present embodiment, before step S20, also comprising step:
Step S90, described first terminal carries out transposition or cutting process to the video data collected, and the video data after voice data and transposition or cutting is sent to described server.
In the present embodiment, as shown in Figure 5, video data is in like manner cut to default size to the transposed way of video data by cutting method.
Further, for improving user security and functional diversity, with reference to Fig. 6, proposing terminal remote exchange method the 5th embodiment of the present invention based on first to fourth any embodiment, also comprising before described step S10 in the present embodiment:
Step S100, when detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
Step S110, when described log-on message is the log-on message of preset kind, described server sends video request to described first terminal and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
In the present embodiment, log-on message can be the login account of user, such as, in banking system, the information of this preset kind can be the login account of bank cashier, when logon account is the login account of bank cashier, just sends video request to first terminal and trigger interface, to ensure fail safe.It will be appreciated by those skilled in the art that and be, different interfaces can be set for dissimilar log-on message, such as during bank's transacting business, bank cashier and user use different interfaces, now after step S80, the method is also included in described log-on message when not being the information of preset kind, and described server sends control inerface to described first terminal.
The present invention also proposes a kind of terminal remote interactive system.
With reference to the high-level schematic functional block diagram that Fig. 7, Fig. 7 are terminal remote interactive system first embodiment of the present invention.
It is emphasized that, to one skilled in the art, functional block diagram shown in Fig. 7 is only the exemplary plot of a preferred embodiment, and those skilled in the art, around the functional module of the terminal remote interactive system shown in Fig. 7, can carry out supplementing of new functional module easily; The title of each functional module is self-defined title, only for auxiliary each program function block understanding this terminal remote interactive system, be not used in and limit technical scheme of the present invention, the core of technical solution of the present invention is, the function that the functional module of respective define name will be reached.
The terminal remote interactive system that the present embodiment proposes, comprising:
Audio frequency and video path setting module 10, for when detecting the video connection request that first terminal sends, sets up the audio frequency and video path between first terminal and the second terminal;
In the present embodiment, first terminal and the second terminal can comprise display unit, microphone, video acquisition device (as camera) and audio output device (loud speaker), this microphone is preferably shotgun microphone in the present embodiment, reduce the noise signal in the audio signal of picking up, improve recognition accuracy, audio output device is preferably directional loudspeaker simultaneously, ensure that other people of voice data exported can not hear, this display unit, microphone, video acquisition device and audio output device can integrated setting, or the convenience in order to data acquisition can be provided separately in different places, and communicate to connect.
In the present embodiment, user can after transmission audio frequency and video connection request, and carry out the selection of line expert, concrete mode is as follows:
A, described audio frequency and video path setting module 10 comprise:
Interface push unit, for when detecting the connection request that first terminal sends, pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
Lock cell, for when detecting the selection request that first terminal sends, based on the described expert selecting the correspondence of request locking;
Transmitting element is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, sets up the audio frequency and video path between first terminal and the second terminal.
In the present embodiment, user can select corresponding expert based on select expert interface, flexibility is higher, simultaneously for improving the success rate connected, can in the state information of each expert of select expert interface display, as currently in this expert be in busy or idle condition, busy condition refer to the second terminal corresponding to this expert with other terminal communication, and idle condition refer to the second terminal corresponding to this expert not with other terminal communication, user can seek advice from based on the expert that the condition selecting of each expert is corresponding; Further, for improving Business Processing efficiency, the traffic type information can be good at each expert of select expert interface display, user can select fast based on this traffic type information, there will not be situation about reselecting.Contact details corresponding to this expert may correspond to the account information with expert.
B, described audio frequency and video path setting module 10 comprise:
Determining unit, for when detecting the video connection request that first terminal sends, determines idle expert, and the idle expert determined for time multiple, determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Transmitting element, for based on the contact details corresponding to the highest expert of priority, the second terminal to correspondence sends and connects video request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described video connection request, sets up the video frequency channel between first terminal and the second terminal.
In the present embodiment, contact details corresponding to expert can be the account information of expert, and this expert's priority preset can be default expert and puts in order or the professional ability rank etc. from low to high of each expert.In the present embodiment, can save the selection course of user, efficiency is higher.
Two kinds that enumerate above modes of carrying out the selection of line expert are only exemplary; those skilled in the art utilize technological thought of the present invention; other modes of carrying out the selection of line expert proposed according to its real needs, all in protection scope of the present invention, are not carried out exhaustive one by one at this.
In the present embodiment, the second terminal is one and also can be multiple, can connect different experts based on business demand.It will be understood by those skilled in the art that, for improving the intellectuality of system, when detecting the audio frequency and video connection request that first terminal sends, interface push unit, to terminal transmission service type selection interface, selects interface to select corresponding type of service for user based on described type of service; When receiving the traffic type information that user selects interface to send based on described type of service, determining unit, based on the mapping relations between the traffic type information preset and expert's contact details, determines the expert's contact details corresponding to present type of service; Processing unit sets up the audio frequency and video path between first terminal and the second terminal corresponding to expert info determined.Further, described server is based on the mapping relations between the traffic type information preset and expert's contact details, when expert's contact details corresponding to the present type of service determined are multiple, interface push unit can push select expert interface to first terminal and select corresponding expert for user, also can select corresponding expert based on the expert's priority preset.
Determination module 20, for when receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
In the present embodiment, the background area in video data can be stated based on humanoid outline technology identification, such as, the boundary profile of each colour switching is identified based on the conversion of color in video data, and each boundary profile and the humanoid profile preset are compared, obtain corresponding humanoid profile, then the region outside humanoid profile is background area.
Processing module 30, for carrying out preliminary treatment to the background area determined;
In the present embodiment; various ways is comprised to the preliminary treatment of background area; default picture is replaced with as virtualization background area or by background area; the pretreatment mode of this background area can have multiple; do not limit at this; those skilled in the art utilize technological thought of the present invention, and the pretreatment mode of the background area proposed according to its real needs is all in protection scope of the present invention.
Sending module 40, for the video data after described voice data and preliminary treatment being sent to described second terminal based on described video frequency channel, while the pretreated video data of the second terminal demonstration, playing audio data, and the Voice & Video data retransmission the second terminal to be sent based on described video frequency channel is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends.
In the present embodiment, due to the multi-path video data that first terminal sends, when terminal as bank cashier place is first terminal, this first terminal can gather the video data of bank cashier, the video data of document and contract etc. and the video data of client, now Ke Jiangmei road video data is added into the corresponding position in default display interface, and pushes to the second terminal show adding the video data display interface of video data.The video data of the second terminal is sent to the principle of first terminal in like manner by server.
The terminal remote interactive system that the present embodiment proposes, when detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal; When receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data; Described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, while the pretreated video data of the second terminal demonstration, playing audio data; The Voice & Video data retransmission that second terminal sends based on described video frequency channel by described server is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends, with the impact avoiding other image in video data to converse on current video, improve Business Processing efficiency.
Further, for improving the diversity of user function, improve business handling efficiency, described determination module 20, also for detect the second terminal based on video data display interface trigger zoom in or out operation time, determine the video data zoomed in or out, and the ratio zoomed in or out; Described processing module 30, also for zooming in or out operation according to the ratio determined to video data corresponding in current display interface; Described sending module 20, also for sending to described second terminal by zooming in or out the video data display interface after operation, shows for the second terminal.
In the present embodiment, user can carry out amplifieroperation to the video data that video display interface shows, to make the information such as document in video terminal clearly, or reduction operation is carried out to the video data that video display interface shows, to carry out global observing.
Further, for improving the diversity of user function, improve business handling efficiency, with reference to Fig. 8, propose terminal remote interactive system second embodiment of the present invention based on the first embodiment, described terminal interaction system also comprises in the present embodiment:
Acquisition module 50, for when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, obtains the positional information that described annotations and comments operation is corresponding;
In the present embodiment; user can trigger annotations and comments operation based on various ways; such as trigger annotations and comments operation based on the control of criticizing on video data display interface; or trigger annotations and comments operation based on producing sliding trace on the touchscreen; these annotations and comments operation triggering mode can have multiple; do not limit at this, those skilled in the art utilize technological thought of the present invention, operate triggering mode all in protection scope of the present invention according to the annotations and comments that its real needs propose.
When detecting annotations and comments operation, acquisition module 50 obtains positional information corresponding to annotations and comments operation, carries out the positional information of the pixel of annotations and comments operation, or annotates and comments on the positional information operated on current video data display interface.
Described sending module 20, also for described positional information is sent to first terminal, shows corresponding endorsement information based on described positional information at its display screen for first terminal.
In the present embodiment, first terminal can in the endorsement information of its display screen display correspondence based on this positional information, and such as, first terminal changes the color at correspondence position information place in its video data display interface, or add mark etc., form final endorsement information.
The terminal remote interactive system that the present embodiment proposes, when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, endorsement information generation module obtains positional information corresponding to described annotations and comments operation and described positional information is sent to first terminal, for first terminal based on the endorsement information of described positional information in the corresponding position of its display screen display correspondence, make first terminal can show the annotations and comments content of the second terminal based on the video data of current display in time, so that user knows the problem in the data such as document in time, improve Business Processing efficiency.
Further, for improving user security and functional diversity, with reference to Fig. 9, propose terminal remote interactive system the 3rd embodiment of the present invention based on the first and second embodiments, described terminal interaction system also comprises in the present embodiment:
Described determination module 20, also for when detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
Interface provides module 60, and for when described log-on message is the log-on message of preset kind, described first terminal sends video request and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
In the present embodiment, log-on message can be the login account of user, such as, in banking system, the information of this preset kind can be the login account of bank cashier, when logon account is the login account of bank cashier, just sends video request to first terminal and trigger interface, to ensure fail safe.It will be appreciated by those skilled in the art that and be, different interfaces can be set for dissimilar log-on message, such as during bank's transacting business, bank cashier and user use different interfaces, interface provides module 70 also for when described log-on message is not the information of preset kind, and described server sends control inerface to described first terminal.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or system and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or system.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the system comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better execution mode.Based on such understanding, technical scheme of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprising some instructions in order to make a station terminal equipment (can be mobile phone, computer, server, air conditioner, or the network equipment etc.) perform method described in each embodiment of the present invention.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (13)
1. a terminal remote exchange method, is characterized in that, described terminal remote exchange method comprises the following steps:
When detecting the audio frequency and video connection request that first terminal sends, server sets up the audio frequency and video path between first terminal and the second terminal;
When receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
Described server carries out preliminary treatment to the background area determined, and based on described video frequency channel, the video data after described voice data and preliminary treatment is sent to described second terminal, while the pretreated video data of the second terminal demonstration, playing audio data;
The Voice & Video data retransmission that second terminal sends based on described video frequency channel by described server, to first terminal, while showing the video data that the second terminal sends, plays the voice data that the second terminal sends for first terminal.
2. terminal remote exchange method as claimed in claim 1, it is characterized in that, described when detecting the audio frequency and video connection request that first terminal sends, after server sets up the step of the audio frequency and video path between first terminal and the second terminal, described terminal remote exchange method also comprises:
Detect the second terminal based on video data display interface trigger zoom in or out operation time, described server determines the video data zoomed in or out, and the ratio zoomed in or out;
Described server to zoom in or out operation according to the ratio determined to video data corresponding in current display interface, and sends to described second terminal by zooming in or out the video data display interface after operation, shows for the second terminal.
3. terminal remote exchange method as claimed in claim 2, it is characterized in that, described when detecting the audio frequency and video connection request that first terminal sends, after server sets up the step of the audio frequency and video path between first terminal and the second terminal, described terminal remote exchange method also comprises:
When detecting the annotations and comments operation that the second terminal triggers based on video data display interface, described server obtains positional information corresponding to described annotations and comments operation;
Described positional information is sent to first terminal by described server, for first terminal based on the endorsement information of described positional information in its display screen display correspondence.
4. the terminal remote exchange method as described in any one of claim 1-3, it is characterized in that, Voice & Video data retransmission to the second terminal that described first terminal sends based on described video frequency channel by described server, for while the video data that the second terminal demonstration first terminal sends, before playing the step of the voice data that first terminal sends, described terminal remote exchange method also comprises:
Described first terminal carries out transposition or cutting process to the video data collected, and the video data after voice data and transposition or cutting is sent to described server.
5. the terminal remote exchange method as described in any one of claim 1-3, it is characterized in that, described when detecting the video connection request that first terminal sends, before server sets up the step of the video frequency channel between first terminal and the second terminal, described terminal remote exchange method comprises:
When detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
When described log-on message is the log-on message of preset kind, described server sends video request to described first terminal and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
6. terminal remote exchange method as claimed in claim 1, is characterized in that, described when detecting the audio frequency and video connection request that first terminal sends, the step of the audio frequency and video path that server is set up between first terminal and the second terminal comprises:
When detecting the audio frequency and video connection request that first terminal sends, described server pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
When detecting the selection request that first terminal sends, described server is based on the described expert selecting the correspondence of request locking;
Described server is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
7. terminal remote exchange method as claimed in claim 1, is characterized in that, described when detecting the audio frequency and video connection request that first terminal sends, the step of the audio frequency and video path that server is set up between first terminal and the second terminal comprises:
When detecting the audio frequency and video connection request that first terminal sends, described server determines idle expert;
The idle expert determined for time multiple, described server determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Described server is based on the contact details corresponding to the highest expert of priority, and the second terminal to correspondence sends audio frequency and video connection request;
When receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, described server sets up the audio frequency and video path between first terminal and the second terminal.
8. a terminal remote interactive system, is characterized in that, described terminal remote interactive system comprises:
Audio frequency and video path setting module, for when detecting the video connection request that first terminal sends, sets up the audio frequency and video path between first terminal and the second terminal;
Determination module, for when receiving voice data and the video data of first terminal transmission, described server determines the background area in described video data;
Processing module, for carrying out preliminary treatment to the background area determined;
Sending module, for the video data after described voice data and preliminary treatment being sent to described second terminal based on described video frequency channel, while the pretreated video data of the second terminal demonstration, playing audio data, and the Voice & Video data retransmission the second terminal to be sent based on described video frequency channel is to first terminal, show the video data of the second terminal transmission for first terminal while, play the voice data that the second terminal sends.
9. terminal remote interactive system as claimed in claim 8, it is characterized in that, described determination module, also for detect the second terminal based on video data display interface trigger zoom in or out operation time, determine the video data zoomed in or out, and the ratio zoomed in or out; Described processing module, also for zooming in or out operation according to the ratio determined to video data corresponding in current display interface; Described sending module, also for sending to described second terminal by zooming in or out the video data display interface after operation, shows for the second terminal.
10. terminal remote interactive system as claimed in claim 9, it is characterized in that, described terminal remote interactive system also comprises:
Acquisition module, for when detecting the annotations and comments operation that the second terminal triggers based on video data display interface, obtains the positional information that described annotations and comments operation is corresponding;
Described sending module, also for described positional information is sent to first terminal, shows corresponding endorsement information based on described positional information at its display screen for first terminal.
11. terminal remote interactive systems as described in any one of claim 8-10, it is characterized in that, described terminal remote interactive system also comprises:
Described determination module, also for when detecting the logging request that first terminal sends, described server determines corresponding log-on message based on the logging request that first terminal sends;
Interface provides module, and for when described log-on message is the log-on message of preset kind, described first terminal sends video request and triggers interface, triggers interface triggering video request for user based on first terminal based on described video request.
12. terminal remote interactive systems as claimed in claim 8, is characterized in that, described audio frequency and video path setting module comprises:
Interface push unit, for when detecting the connection request that first terminal sends, pushes select expert interface to first terminal, and corresponding expert is selected at the select expert interface shown based on first terminal for user;
Lock cell, for when detecting the selection request that first terminal sends, based on the described expert selecting the correspondence of request locking;
Transmitting element is based on the contact details corresponding to the expert locked, and the second terminal to correspondence sends audio frequency and video connection request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described audio frequency and video connection request, sets up the audio frequency and video path between first terminal and the second terminal.
13. terminal remote interactive systems as claimed in claim 8, is characterized in that, described audio frequency and video path setting module comprises:
Determining unit, for when detecting the video connection request that first terminal sends, determines idle expert, and the idle expert determined for time multiple, determines based on the expert's priority preset the expert that multiple idle expert's medium priority is the highest;
Transmitting element, for based on the contact details corresponding to the highest expert of priority, the second terminal to correspondence sends and connects video request;
Processing unit, for when receiving the confirmation that the second terminal is fed back based on described video connection request, sets up the video frequency channel between first terminal and the second terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410493587.4A CN104349110A (en) | 2014-09-24 | 2014-09-24 | Terminal remote interaction method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410493587.4A CN104349110A (en) | 2014-09-24 | 2014-09-24 | Terminal remote interaction method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104349110A true CN104349110A (en) | 2015-02-11 |
Family
ID=52503808
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410493587.4A Pending CN104349110A (en) | 2014-09-24 | 2014-09-24 | Terminal remote interaction method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104349110A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109327608A (en) * | 2018-09-12 | 2019-02-12 | 广州酷狗计算机科技有限公司 | Method, terminal, server and the system that song is shared |
| CN109889759A (en) * | 2019-02-02 | 2019-06-14 | 视联动力信息技术股份有限公司 | A kind of exchange method and system regarding networked video meeting |
| CN111666055A (en) * | 2020-04-24 | 2020-09-15 | 华为技术有限公司 | Data transmission method and device |
| CN112949667A (en) * | 2019-12-09 | 2021-06-11 | 北京金山云网络技术有限公司 | Image recognition method, system, electronic device and storage medium |
| US11947998B2 (en) | 2020-09-02 | 2024-04-02 | Huawei Technologies Co., Ltd. | Display method and device |
| US12073071B2 (en) | 2020-07-29 | 2024-08-27 | Huawei Technologies Co., Ltd. | Cross-device object drag method and device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101739611A (en) * | 2009-12-08 | 2010-06-16 | 上海华平信息技术股份有限公司 | High-resolution remote collaborative vehicle loss assessment system and method |
| CN102446176A (en) * | 2010-10-09 | 2012-05-09 | 上海博路信息技术有限公司 | Multimedia user data recording and loading method used in electronic reading |
| CN102572218A (en) * | 2012-01-16 | 2012-07-11 | 唐桥科技(杭州)有限公司 | Video label method based on network video meeting system |
| US8279254B2 (en) * | 2007-08-02 | 2012-10-02 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and system for video conferencing in a virtual environment |
| CN102968112A (en) * | 2012-10-19 | 2013-03-13 | 深圳市元征科技股份有限公司 | System and method of expert remote network video assistance based on automobile diagnosis device |
| CN103024587A (en) * | 2012-12-31 | 2013-04-03 | Tcl数码科技（深圳）有限责任公司 | Video-on-demand message marking and displaying method and device |
| CN103558811A (en) * | 2013-08-20 | 2014-02-05 | 北京市农林科学院 | Crop condition monitoring and diagnosis method based on internet of things |
-
2014
- 2014-09-24 CN CN201410493587.4A patent/CN104349110A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8279254B2 (en) * | 2007-08-02 | 2012-10-02 | Siemens Enterprise Communications Gmbh & Co. Kg | Method and system for video conferencing in a virtual environment |
| CN101739611A (en) * | 2009-12-08 | 2010-06-16 | 上海华平信息技术股份有限公司 | High-resolution remote collaborative vehicle loss assessment system and method |
| CN102446176A (en) * | 2010-10-09 | 2012-05-09 | 上海博路信息技术有限公司 | Multimedia user data recording and loading method used in electronic reading |
| CN102572218A (en) * | 2012-01-16 | 2012-07-11 | 唐桥科技(杭州)有限公司 | Video label method based on network video meeting system |
| CN102968112A (en) * | 2012-10-19 | 2013-03-13 | 深圳市元征科技股份有限公司 | System and method of expert remote network video assistance based on automobile diagnosis device |
| CN103024587A (en) * | 2012-12-31 | 2013-04-03 | Tcl数码科技（深圳）有限责任公司 | Video-on-demand message marking and displaying method and device |
| CN103558811A (en) * | 2013-08-20 | 2014-02-05 | 北京市农林科学院 | Crop condition monitoring and diagnosis method based on internet of things |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109327608A (en) * | 2018-09-12 | 2019-02-12 | 广州酷狗计算机科技有限公司 | Method, terminal, server and the system that song is shared |
| CN109327608B (en) * | 2018-09-12 | 2021-01-22 | 广州酷狗计算机科技有限公司 | Song sharing method, terminal, server and system |
| CN109889759A (en) * | 2019-02-02 | 2019-06-14 | 视联动力信息技术股份有限公司 | A kind of exchange method and system regarding networked video meeting |
| CN112949667A (en) * | 2019-12-09 | 2021-06-11 | 北京金山云网络技术有限公司 | Image recognition method, system, electronic device and storage medium |
| CN111666055A (en) * | 2020-04-24 | 2020-09-15 | 华为技术有限公司 | Data transmission method and device |
| CN111666055B (en) * | 2020-04-24 | 2021-12-14 | 华为技术有限公司 | Data transmission method and device |
| US12073071B2 (en) | 2020-07-29 | 2024-08-27 | Huawei Technologies Co., Ltd. | Cross-device object drag method and device |
| US11947998B2 (en) | 2020-09-02 | 2024-04-02 | Huawei Technologies Co., Ltd. | Display method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104349110A (en) | Terminal remote interaction method and system | |
| CN102196238B (en) | Transmission managing system, transmission managing method and transmitting system | |
| CN102208994B (en) | Log management system, and transmission system, and log management method | |
| CN105594201A (en) | Device pairing | |
| CN102256378A (en) | Wireless communication device, wireless communication method, program, and wireless communication system | |
| CN104967721A (en) | Method and apparatus for processing unread messages | |
| CN106713418B (en) | Reset result confirmation method, device, server and mobile terminal | |
| CN205830040U (en) | Automobile friend's interactive device and automobile friend's interactive system | |
| CN102209158B (en) | Terminal apparatus, control system, and control method for controlling collaboration among a plurality of devices | |
| CN103124283A (en) | Electronic device and method capable of collaboratively editing with a plurality of mobile devices | |
| CN105323403A (en) | Cloud print method using automatic response system and cloud print system for performing the same | |
| CN103874019A (en) | Voice interaction method and device | |
| CN105429845A (en) | Schedule information processing method and system and associated equipment | |
| CN106303350A (en) | A kind of multimodal video call method and device | |
| CN101409871A (en) | Long-distance remote-control method, system and remote-control device | |
| KR20150021928A (en) | Transmitting initiation details from a mobile device | |
| CN108170285A (en) | The interaction control method and device of a kind of electronic equipment | |
| CN105227893A (en) | Based on terminal call admission method and the system of on-line meeting | |
| CN114760321B (en) | Device data synchronization method and device, terminal device and storage medium | |
| CN103686404B (en) | A kind of method and system of mobile terminal playing set-top box picture | |
| CN104333729A (en) | Terminal remote interaction method and system | |
| CN102868766B (en) | A kind of mthods, systems and devices for realizing remote control | |
| CN104299128B (en) | Utilize the method for payment of smart television, mobile terminal and smart television | |
| CN103905483A (en) | Audio and video sharing method, equipment and system | |
| CN107346197A (en) | A kind of method for information display and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150211 |