CN114501048A - Cross-screen real-time communication interaction method and system with large-screen display as center - Google Patents
Cross-screen real-time communication interaction method and system with large-screen display as center Download PDFInfo
- Publication number
- CN114501048A CN114501048A CN202210053767.5A CN202210053767A CN114501048A CN 114501048 A CN114501048 A CN 114501048A CN 202210053767 A CN202210053767 A CN 202210053767A CN 114501048 A CN114501048 A CN 114501048A
- Authority
- CN
- China
- Prior art keywords
- information
- data information
- content
- sending
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 52
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000003993 interaction Effects 0.000 title claims abstract description 26
- 230000002452 interceptive effect Effects 0.000 claims abstract description 17
- 230000005540 biological transmission Effects 0.000 claims description 36
- 238000012544 monitoring process Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 7
- 238000001514 detection method Methods 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 abstract description 13
- 208000003464 asthenopia Diseases 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 244000141359 Malus pumila Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 235000021016 apples Nutrition 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/168—Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
- H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Graphics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a cross-screen real-time communication interaction method and a cross-screen real-time communication interaction system with large-screen display as a center, which relate to the technical field of data communication methods and cross-screen display, wherein the cross-screen real-time communication interaction system with the large-screen end is realized by taking an OTT large screen as the center, through application programs loaded in a mobile end and the OTT large screen end and depending on a mobile 4G/5G, WiFi network; the method comprises the steps of establishing an information communication channel between people by constructing an interactive link between a mobile terminal and an OTT large screen, solving the problems of inconvenient operation, complex functions, narrow screen and visual fatigue of a mobile phone, focusing information communication and sharing between a small mobile phone screen and a television large screen by the OTT large screen, and constructing a communication channel between the small mobile phone screen and the large mobile phone screen, so that people can realize multimedia information connection of characters, voice, pictures and video between people in a very convenient mode, and the most basic and common communication requirements of people are met.
Description
Technical Field
The invention relates to the technical field of data communication methods and cross-screen display, in particular to a cross-screen real-time communication interaction method and a cross-screen real-time communication interaction system with large-screen display as a center.
Background
The mobile client is provided with a mobile terminal and realizes an instant messaging function, and simultaneously can realize a multimedia instant messaging service APP between the mobile terminal and an OTT large screen. The OTT large screen APP is used for downloading and installing in an OTT smart television, an OTT smart projection or an OTT set top box, and the mobile terminal APP is used for downloading and installing in a mobile phone (including android and apples).
The functions, operation UI, UE and the like of the OTT large-screen end APP and the mobile end small-screen APP are different from each other, so that the realization of 'person-to-person' channel establishment and communication between different terminals, different users, different scenes and different requirements is met respectively. Wherein, remove the factor such as piece, the removal and the transform in place of the busy of user's life, time of end APP fully having considered, special factors such as middle-aged and old people crowd user demand, characteristics, ability, scene, physiology have more been considered in the design of the big screen end APP of OTT, strive for providing for both sides and use convenient, powerful communication means.
Disclosure of Invention
The invention aims to provide a cross-screen real-time communication interaction method and a cross-screen real-time communication interaction system with large-screen display as a center, so as to solve one or more technical problems in the prior art and provide at least one beneficial selection or creation condition.
The invention relates to a cross-screen real-time communication interaction system which is established by taking an OTT large screen as a center, realizing the cross-screen real-time communication interaction system of a mobile terminal and the large screen by relying on a mobile 4G/5G, wifi network through an application program loaded in the mobile terminal and the OTT large screen terminal, and comprising a service platform, a mobile client and OTT large screen client software, wherein the cross-screen real-time communication interaction method comprises a sending terminal (information sending), a platform terminal and an information receiving terminal (information receiving).
In order to achieve the above object, according to an aspect of the present invention, there is provided a cross-screen real-time communication interaction method centering on a large-screen display, the method including the steps of:
s100, a sending end selects an information receiving object;
s200, the sending end sends data information to the platform end and displays a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;
s300, after the platform receives the data information, the platform checks the validity of the received data information, if illegal contents are monitored, the sending process is stopped, illegal reminding of the sent contents and reminding of sending failure are returned to the sending end, and if the illegal contents pass the validity check, the platform goes to the step S400;
s400, if the content contract rule is adopted, the data information is stored in a storage medium of the platform end, and meanwhile, a successful sending message is returned to a sending end for sending the data information;
s500, the platform terminal analyzes the information receiving object in the data information, judges whether the contact person of the information receiving object is online, transmits the data information to the information receiving terminal corresponding to the online receiving object if the contact person of the information receiving object is online, and enters the step S700; if the contact of the information receiving object is off-line, the step S600 is carried out;
s600, when the contact person of the information receiving object is monitored to be offline, the data information is suspended, meanwhile, an object online monitoring process is started, and until the contact person of the information receiving object is monitored to be online, the data information is transmitted to an information receiving end corresponding to the online receiving object; namely, if the contact person of the information receiving object is off-line, the data information is suspended, meanwhile, the object on-line monitoring process is started, and when the contact person of the monitoring information receiving object is on-line, the data information is transmitted to the on-line receiving object;
s700, the platform end generates a thumbnail of the data information and sends the thumbnail to the information receiving end, and the information receiving end receives the thumbnail of the data information and then carries out information reminding;
s800, when the information receiving end displays the thumbnail of the data information and requests a platform end to download the clear view of the data information, the platform end generates the clear view of the data information and sends the clear view of the data information to the information receiving end, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information so as to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end; the clear view is a video screenshot of the data information or a first frame image of the data information; the step is mainly set in consideration of the fact that the storage space of the OTT large screen end is generally limited, and if the cache is not set, the system space is easily insufficient;
s900, the information receiving end sends the information receiving completion receipt to the platform end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.
Further, in S100, the information receiving object includes one or more mobile end users, one or more OTT large-screen terminals, and any one or more combinations in a group of a mobile end and an OTT large-screen end combination.
Further, in S200, the data information includes any one of the input text content, the picture content, the video content, the audio content, the instant-recorded voice content, and the instant-captured audio/video content, where the input text content, the instant-recorded voice content, and the instant-captured audio/video content only occur one at a time, and a plurality of files selected for transmission may be selected at a time.
Further, in S100, the transmitting end selecting the information receiving object further includes the steps of:
s101, entering a two-dimensional rich media content editing interface; wherein the two-dimensional rich media comprises information of animation, sound, video or interactivity;
s102, selecting and editing cover content to obtain two-dimensional rich media theme cover content; selecting cover content refers to selecting one of input text content, picture content, video content, audio content, input voice content and real-time shot audio and video content as two-dimensional rich media cover content;
s103, confirming the selected or edited two-dimensional rich media cover content, wherein the confirmed cover content is the first-dimensional content of the two-dimensional rich media, namely one-dimensional information;
s104, selecting second-dimension content in the two-dimension rich media, wherein the second-dimension content can be a combination of one or more pictures, one or more videos, one or more audios and one or more type files in one or more PDF documents;
s105, editing, sorting and sequencing the selected second-dimension content;
s106, confirming the whole two-dimensional rich media content, and forming a two-dimensional rich media information set at the mobile terminal, wherein the two-dimensional rich media information set is two-dimensional information;
s107, compressing the pictures and the video documents in the two-dimensional information to generate thumbnails;
s108, taking a data set of the two-dimensional rich media as data information, wherein the data information comprises a two-dimensional rich media data structure document, a cover file, a thumbnail file and a two-dimensional file package; the two-dimensional rich media data structure document comprises contact information and two-dimensional information structure content; the two-dimensional information structure content comprises a cover page content record, text content, thumbnail size, name and the like.
Further, in S200, the sending the data information to the platform side by the sending side further includes the following steps:
s201, performing picture processing on the content of the data information, generating a silhouette thumbnail for the picture and the video, and correspondingly generating a default icon for the text file;
s202, displaying a cartoon to be sent on an interface of a sending end;
s203, adding the content of the data information into a sending queue to wait for sending;
s204, sending the content of the data information one by one according to the sequence of the sending queue; transmitting a notification to an information receiving object when the content starts to be transmitted;
s205, when receiving the sending notice, stopping waiting for sending the animation and displaying the sending progress;
s206, judging whether the content in the transmission queue is successfully transmitted or not, and if the transmission is unsuccessful, returning a transmission unsuccessful notification;
s207, when receiving the transmission unsuccessful notification, displaying the transmission failure and displaying the re-transmission button identification;
s208, if the transmission is successful, checking whether the transmission of the transmitted content is completed, and if the transmission is completed, transmitting the next content in the queue according to the sequence of the transmission queue;
s209, if the transmission is completed, returning a transmission completion notice and displaying that the information transmission is successful.
Further, in S300, the method for checking the validity of the received data information specifically includes compliance checking and copyright checking; the object related to the compliance problem comprises illegal information and violation information; auditing and checking work is usually completed by technical means and/or manual auditing; the technical approach uses deep learning model-related literature (Goodfellow, Ian J., Jonathon Shens, and Christian Szegedy. "expanding and harnessing adaptive algorithms." arXiv preprint arXiv:1412.6572 (2014)) for validity checks.
Further, in S800, all the received information is browsed, where the browsing is a piece of information that is automatically played, and the content can be switched from left to right through a remote controller.
The sending end is a mobile end, and the mobile end refers to a smart phone or a smart tablet computer loaded with a mobile end APP.
The platform end refers to a cloud service platform loaded with a management system, and comprises a cloud computing platform and a cloud storage platform.
The information receiving end can be one or more mobile ends, an OTT large-screen end corresponding to the one or more mobile ends, and a combination of the mobile ends and the OTT large-screen ends corresponding to the mobile ends, wherein the OTT large-screen end refers to terminal equipment which is provided with an OTT large-screen APP and can display on a large screen, such as an intelligent television, an intelligent projection or an intelligent set-top box; the mobile terminal can be an information sending party or an information receiving party; the OTT large screen end can only be an information receiver corresponding to the mobile end.
The invention also provides a cross-screen real-time communication interactive system taking large-screen display as a center, which comprises the following components: a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to run in the units of the system:
a receiving object selection unit, which is used for the sending end to select the information receiving object;
the information sending unit is used for sending data information to the platform end by the sending end and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;
the legality checking unit is used for checking the legality of the received data information after the platform end receives the data information, stopping a sending process and returning illegal sending content reminding and sending failure reminding to a sending end if illegal content is monitored, and transferring to the information storage unit if the illegal content passes the legality checking;
the information storage unit is used for storing the data information in a storage medium of the platform end if the content contract rule is satisfied, and simultaneously returning a successful sending message to a sending end for sending the data information;
the online judging unit is used for analyzing the information receiving object in the data information by the platform end, judging whether the contact person of the information receiving object is online or not, and if the contact person of the information receiving object is online, transmitting the data information to the information receiving end corresponding to the online receiving object and entering the information receiving unit; if the contact of the information receiving object is offline, entering an offline detection unit;
the offline detection unit is used for suspending the data information when the contact person monitoring the information receiving object is offline, starting an object online monitoring process at the same time, and transmitting the data information to an information receiving end corresponding to the online receiving object when the contact person monitoring the information receiving object is online;
the information receiving unit is used for generating a thumbnail of data information by the platform end and sending the thumbnail of the data information to the information receiving end, and the information receiving end receives the thumbnail of the data information and then carries out information reminding;
the clear view downloading unit is used for generating a clear view of the data information and sending the clear view of the data information to the information receiving end when the information receiving end displays the thumbnail of the data information and requests the platform end to download the clear view of the data information, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information so as to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end; the unit is arranged mainly in consideration of the fact that the storage space of the OTT large screen end is generally limited, and if a cache is not arranged, the system space is easily insufficient;
and the information receiving completion unit is used for sending the information receiving completion receipt to the platform end by the information receiving end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.
The invention has the beneficial effects that: the invention provides a cross-screen real-time communication interaction method and a cross-screen real-time communication interaction system with large-screen display as a center, and an information communication channel between people is established by constructing a mobile terminal and an OTT large-screen interaction link. Although the mobile phone WeChat and the like can provide rich interactive communication means, the mobile phone is inconvenient to operate, complicated in function, narrow in screen and tired in vision. The OTT large screen focuses on information exchange and sharing between the small mobile phone screen and the large television screen, and a communication channel between the small mobile phone screen and the large mobile phone screen is established, so that people can realize multimedia information connection of characters, voice, pictures and video between people in a very convenient mode, and the most basic and common communication requirements of people are met.
Drawings
The above and other features of the present invention will become more apparent by describing in detail embodiments thereof with reference to the attached drawings in which like reference numerals designate the same or similar elements, it being apparent that the drawings in the following description are merely exemplary of the present invention and other drawings can be obtained by those skilled in the art without inventive effort, wherein:
FIG. 1 is a flow diagram illustrating a cross-screen real-time communication interaction method centered around large screen display;
FIG. 2 is a flow diagram illustrating two-dimensional rich media content processing;
FIG. 3 is a two-dimensional rich media delivery flow diagram;
fig. 4 is a diagram showing a cross-screen real-time communication interactive system structure with a large screen display as a center.
Detailed Description
The conception, the specific structure and the technical effects of the present invention will be clearly and completely described in conjunction with the embodiments and the accompanying drawings to fully understand the objects, the schemes and the effects of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Referring to fig. 1, a flowchart of a cross-screen real-time communication interaction method centering on a large-screen display according to the present invention is shown, and the cross-screen real-time communication interaction method centering on the large-screen display according to an embodiment of the present invention is described below with reference to fig. 1.
The invention provides a cross-screen real-time communication interaction method taking large-screen display as a center, which specifically comprises the following steps:
1. the application objects of the method comprise an information sending party, a platform end and an information receiving party;
2. the information sender can only be a mobile terminal, and the mobile terminal refers to a smart phone or a smart tablet computer loaded with a mobile terminal APP;
3. the platform end refers to a cloud service platform loaded with a management system, and comprises a cloud computing platform and a cloud storage platform;
4. the information receiving end can be one or more mobile ends, an OTT large screen end corresponding to the one or more mobile ends, and a combination of the plurality of mobile ends and the OTT large screen end corresponding to the plurality of mobile ends;
5. the mobile terminal can be an information sender or an information receiver;
and 6, the OTT large screen end can only be an information receiver corresponding to the mobile end.
And 7, the OTT large screen end refers to terminal equipment which is provided with an OTT large screen APP and can display on a large screen, such as an intelligent television, an intelligent projection or an intelligent set top box.
The method is characterized in that:
A. selecting an information receiving object, which can be a group of one or more mobile end users and OTT large-screen end terminal combinations corresponding to the one or more mobile end users;
B. one-dimensional information is selected to be sent aiming at an object A, the sent content can be input text content, picture content, video content, audio content, instant input voice content, instant shooting audio and video content and the like, and the sent content can only be sent one time, wherein the input text content, the instant input voice content and the instant shooting audio and video content can only be sent one time, and a plurality of files can be selected once;
C. selecting two-dimensional rich media content for the object A, wherein the content comprises a cover page, a content set and the like;
D. sending information;
E. displaying the thumbnail at the sending end;
F. sending the sent information set D to a platform end through an X network;
G. the platform side carries out validity check on the received information;
H. if the platform end monitors illegal contents, stopping the sending process, and returning the illegal reminding of the sent contents and the reminding of failed sending to the mobile end;
I. if the content contract rule formally stores the information in the platform storage medium, and simultaneously returns a successful sending message J to the mobile terminal sending the information;
K. and (4) after the platform end completes the step H, analyzing the information receiving object in the two-dimensional information set, and monitoring whether the information receiving object is on-line or not. The receiving object transmits the information to the online receiving object through the Y network when the receiving object is online; if the receiving object is off-line, entering step M;
m, suspending the information when the receiving object is not on line, starting an object on-line monitoring process, and transmitting the information to the on-line receiving object through a Y network when the object which is not on line is monitored to be on line;
receiving the thumbnail information content by the online receiving object;
p, the information receiving end receives the abbreviated information and then carries out information reminding;
q, checking the thumbnail information, simultaneously requesting to download the clear view from the platform end I, replacing the thumbnail for displaying after the downloading is finished, and synchronously storing the clear view in the cache R; when the information is viewed again, the cache R is checked firstly, if the information has a clear view, the content in the cache R is read, and if the information does not have a clear view, a request is sent to the platform end I again; the step is mainly set in consideration of the fact that the storage space of the OTT large screen end is generally limited, and if the cache is not set, the system space is easily insufficient;
s, displaying information in three modes, wherein S is to browse the information according to information reminding;
t, all the received information is browsed, namely, browsing is an automatic playing mode, and meanwhile, the content can be switched left and right through a remote controller;
u, displaying all information thumbnails below after opening the information, and selecting the playing information left and right through a remote controller;
v, thumbnails are also displayed firstly in information browsing, and clear views can be displayed during formal viewing;
w, sending information to the platform end to receive the receipt;
n, the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process;
X/Y: 3G, 4G, 5G, WIFI or wired networks;
as shown in fig. 2, wherein the method further comprises the steps of the two-dimensional rich media content processing in fig. 2:
B1. entering a two-dimensional rich media content editing interface;
B2/B3, selecting and editing a two-dimensional rich media subject cover; the cover content can be input text content, picture content, video content, audio content, recorded voice content, real-time shot audio and video content and the like, and only one of the two-dimensional rich media cover content can be selected;
B4. confirming the selected or edited two-dimensional rich media cover content, wherein the confirmed content is the first dimension of the two-dimensional rich media;
B5/B6. selecting a second-dimensional content in the two-dimensional rich media, the content of which may be a combination of one or more pictures, one or more videos, one or more audios, one or more types of files in one or more PDF documents;
B7. editing, sorting and sequencing the selected second-dimension content;
B8. confirming the whole two-dimensional rich media content;
B9. forming a two-dimensional rich media information set at the mobile terminal after the step B8;
B10. performing secondary processing according to the information set content, and compressing the pictures and the video documents in the information set content to generate thumbnails;
B11. generating a two-dimensional rich media data set, wherein the two-dimensional rich media data set comprises a two-dimensional rich media data structure document, a cover file, a thumbnail file and a two-dimensional file package; the document comprises receiver information and two-dimensional information structure content;
B12. the document comprises receiving object information and two-dimensional information structure content, wherein the structure content comprises a cover content record, text content, a thumbnail size, a name and the like;
B13. one-dimensional cover file packages;
B14. a thumbnail file;
B15. a two-dimensional content package.
As shown in fig. 3, wherein the step C further includes the two-dimensional rich media sending process in fig. 3:
C1. determining the content to send goes to C2;
C2. performing picturization processing on the content determined to be sent by the C1, generating a silhouette thumbnail on the picture and the video, and correspondingly generating a default icon on the text file;
C3. displaying the animation to be sent on the interface of the mobile phone end;
C4. adding the content into a sending queue to wait for sending, and entering a C5 mobile terminal sending function module;
C5. the mobile terminal content sending function module belongs to the middleware;
C6. the sending content enters a sending queue of a mobile terminal sending function module;
C7/C8. content transmission, which is transmitted one by one according to the C8 transmission queue sequence; when the content starts to be sent, the function module goes to C9 to return a message to start sending a notice;
C10. when receiving a sending notification returned from the sending function module, stopping waiting for sending the animation and displaying a sending progress;
C11. detecting whether the content in the transmission queue is transmitted successfully or not, and if the content in the transmission queue is transmitted unsuccessfully, returning an unsuccessful notification;
C12. displaying a transmission failure and displaying a re-transmission button identifier when receiving a transmission unsuccessful notification;
C13. if the transmission is successful, checking whether the transmitted content is transmitted completely, if the transmission is completed, entering C8 to transmit the next content in the queue in sequence;
C14. if the transmission is completed, a transmission completion notice is returned, and the information transmission is successfully displayed on the display layer.
The cross-screen real-time communication interactive system using large-screen display as a center provided by the embodiment of the present invention is, as shown in fig. 4, a structure diagram of the cross-screen real-time communication interactive system using large-screen display as a center of the present invention, and the cross-screen real-time communication interactive system using large-screen display as a center of the embodiment includes: the system comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program to realize the steps in the cross-screen real-time communication interactive system embodiment which is centered on large-screen display.
The system comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to run in the units of the following system:
a receiving object selection unit, which is used for the sending end to select the information receiving object;
the information sending unit is used for sending data information to the platform end by the sending end and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;
the legality checking unit is used for checking the legality of the received data information after the platform end receives the data information, stopping a sending process and returning illegal sending content reminding and sending failure reminding to a sending end if illegal content is monitored, and transferring to the information storage unit if the illegal content passes the legality checking;
the information storage unit is used for storing the data information in a storage medium of the platform end if the content contract rule is satisfied, and simultaneously returning a successful sending message to a sending end for sending the data information;
the online judging unit is used for analyzing the information receiving object in the data information by the platform end, judging whether the contact person of the information receiving object is online or not, and if the contact person of the information receiving object is online, transmitting the data information to the information receiving end corresponding to the online receiving object and entering the information receiving unit; if the contact of the information receiving object is offline, entering an offline detection unit;
the offline detection unit is used for suspending the data information when the contact person monitoring the information receiving object is offline, starting an object online monitoring process at the same time, and transmitting the data information to an information receiving end corresponding to the online receiving object when the contact person monitoring the information receiving object is online;
the information receiving unit is used for generating a thumbnail of data information by the platform end and sending the thumbnail of the data information to the information receiving end, and the information receiving end receives the thumbnail of the data information and then carries out information reminding;
the clear view downloading unit is used for generating a clear view of the data information and sending the clear view of the data information to the information receiving end when the information receiving end displays the thumbnail of the data information and requests the platform end to download the clear view of the data information, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information so as to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end; the unit is arranged mainly in consideration of the fact that the storage space of the OTT large screen end is generally limited, and if a cache is not arranged, the system space is easily insufficient;
and the information receiving completion unit is used for sending the information receiving completion receipt to the platform end by the information receiving end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.
The cross-screen real-time communication interactive system taking large-screen display as the center can be operated in computing equipment such as desktop computers, notebooks, palm computers, cloud servers and the like. The cross-screen real-time communication interactive system taking the large-screen display as the center can be operated by a system comprising but not limited to a processor and a memory. It will be understood by those skilled in the art that the examples are merely examples of the cross-screen real-time communication interactive system centered on the large-screen display, and do not constitute a limitation of the cross-screen real-time communication interactive system centered on the large-screen display, and may include more or less components than the large-screen display, or combine some components, or different components, for example, the cross-screen real-time communication interactive system centered on the large-screen display may further include an input-output device, a network access device, a bus, and the like.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, or the like. The general processor can be a microprocessor or the processor can be any conventional processor and the like, the processor is a control center of the cross-screen real-time communication interactive system operation system taking the large-screen display as the center, and various interfaces and lines are utilized to connect all parts of the whole cross-screen real-time communication interactive system operable system taking the large-screen display as the center.
The memory can be used for storing the computer program and/or the module, and the processor can realize various functions of the cross-screen real-time communication interactive system taking the large-screen display as the center by running or executing the computer program and/or the module stored in the memory and calling the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
Although the present invention has been described in considerable detail and with reference to certain illustrated embodiments, it is not intended to be limited to any such details or embodiments or any particular embodiment, so as to effectively encompass the intended scope of the invention. Furthermore, the foregoing describes the invention in terms of embodiments foreseen by the inventor for which an enabling description was available, notwithstanding that insubstantial modifications of the invention, not presently foreseen, may nonetheless represent equivalent modifications thereto.
Claims (8)
1. The cross-screen real-time communication interaction method taking large-screen display as a center is characterized by comprising the following steps of:
s100, a sending end selects an information receiving object;
s200, the sending end sends data information to the platform end and displays a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;
s300, after the platform receives the data information, the platform checks the validity of the received data information, if illegal contents are monitored, the sending process is stopped, illegal reminding of the sent contents and reminding of sending failure are returned to the sending end, and if the illegal contents pass the validity check, the platform goes to the step S400;
s400, if the content contract rule is adopted, the data information is stored in a storage medium of the platform end, and meanwhile, a successful sending message is returned to a sending end for sending the data information;
s500, the platform terminal analyzes the information receiving object in the data information, judges whether the contact person of the information receiving object is online, transmits the data information to the information receiving terminal corresponding to the online receiving object if the contact person of the information receiving object is online, and enters the step S700; if the contact of the information receiving object is off-line, the step S600 is carried out;
s600, when the contact person of the information receiving object is monitored to be offline, the data information is suspended, meanwhile, an object online monitoring process is started, and until the contact person of the information receiving object is monitored to be online, the data information is transmitted to an information receiving end corresponding to the online receiving object;
s700, the platform terminal generates a thumbnail of the data information and sends the thumbnail of the data information to the information receiving terminal, and the information receiving terminal receives the thumbnail of the data information and then carries out information reminding;
s800, when the information receiving end displays a thumbnail of the data information and requests a platform end to download a clear view of the data information, the platform end generates the clear view of the data information and sends the clear view of the data information to the information receiving end, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end;
s900, the information receiving end sends the information receiving completion receipt to the platform end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.
2. The method according to claim 1, wherein in S100, the information receiving object includes any one or more of a group consisting of one or more mobile end users, one or more OTT large-screen terminals, and a combination of a mobile end and an OTT large-screen end.
3. The cross-screen real-time communication interaction method centered on large-screen display according to claim 1, wherein in S200, the data information includes any one of input text content, picture content, video content, audio content, instant-entry voice content, and instant-taken audio/video content, wherein the input text content, the instant-entry voice content, and the instant-taken audio/video content can only occur one at a time, and a plurality of files can be selected at a time when the selected file is sent.
4. The method for cross-screen real-time communication interaction centered on large-screen display of claim 1, wherein in S100, the step of the sender selecting the information receiving object further comprises the steps of:
s101, entering a two-dimensional rich media content editing interface; wherein the two-dimensional rich media comprises information of animation, sound, video or interactivity;
s102, selecting and editing cover content to obtain two-dimensional rich media theme cover content; selecting cover content refers to selecting one of input text content, picture content, video content, audio content, input voice content and real-time shot audio and video content as two-dimensional rich media cover content;
s103, confirming the selected or edited two-dimensional rich media cover content, wherein the confirmed cover content is the first-dimensional content of the two-dimensional rich media, namely one-dimensional information;
s104, selecting second-dimension content in the two-dimension rich media, wherein the second-dimension content can be a combination of one or more pictures, one or more videos, one or more audios and one or more type files in one or more PDF documents;
s105, editing, sorting and sequencing the selected second-dimension content;
s106, confirming the whole two-dimensional rich media content, and forming a two-dimensional rich media information set at the mobile terminal, wherein the two-dimensional rich media information set is two-dimensional information;
s107, compressing the pictures and the video documents in the two-dimensional information to generate thumbnails;
s108, taking a data set of the two-dimensional rich media as data information, wherein the data information comprises a two-dimensional rich media data structure document, a cover file, a thumbnail file and a two-dimensional file package; the two-dimensional rich media data structure document comprises contact information and two-dimensional information structure content; the two-dimensional information structure content comprises a cover page content record, text content, a thumbnail size, a thumbnail name and the like.
5. The cross-screen real-time communication interaction method based on large-screen display as a center according to claim 1, wherein in S200, the step of sending the data information to the platform end by the sending end further comprises the steps of:
s201, performing picture processing on the content of the data information, generating a silhouette thumbnail for the picture and the video, and correspondingly generating a default icon for the text file;
s202, displaying a to-be-sent animation on an interface of a sending end;
s203, adding the content of the data information into a sending queue to wait for sending;
s204, sending the content of the data information one by one according to the sequence of the sending queue, and sending a notice to an information receiving object when the content starts to be sent;
s205, when receiving the sending notice, stopping waiting for sending the animation and displaying the sending progress;
s206, judging whether the content in the transmission queue is successfully transmitted or not, and if the transmission is unsuccessful, returning a transmission unsuccessful notification;
s207, when receiving the transmission unsuccessful notification, displaying the transmission failure and displaying the re-transmission button identification;
s208, if the transmission is successful, checking whether the transmission of the transmitted content is completed, and if the transmission is completed, transmitting the next content in the queue according to the sequence of the transmission queue;
s209, if the transmission is completed, returning a transmission completion notice and displaying that the information transmission is successful.
6. The method for cross-screen real-time communication interaction centered on large-screen display as claimed in claim 1, wherein in S800, all received information is browsed, wherein the browsing is a piece of information that automatically plays the received information, and the content can be switched from left to right through a remote controller.
7. The cross-screen real-time communication interaction method taking large-screen display as a center according to claim 1, wherein the information receiving end can be one or more mobile ends, an OTT large-screen end corresponding to the one or more mobile ends, or a combination of the plurality of mobile ends and the OTT large-screen end corresponding to the plurality of mobile ends, and the OTT large-screen end refers to a terminal device which can display on a large screen, such as an intelligent television, an intelligent projection or an intelligent set-top box, and the like, and is provided with an OTT large-screen APP; the mobile terminal can be an information sending party or an information receiving party; the OTT large screen end can only be an information receiver corresponding to the mobile end.
8. A cross-screen real-time communication interactive system taking large-screen display as a center is characterized by comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the computer program to run in the units of the following system:
a receiving object selection unit, which is used for the sending end to select the information receiving object;
the information sending unit is used for sending data information to the platform end by the sending end and displaying a thumbnail of one-dimensional information or two-dimensional information contained in the sent data information;
the legality checking unit is used for checking the legality of the received data information after the platform end receives the data information, stopping a sending process and returning illegal sending content reminding and sending failure reminding to a sending end if illegal content is monitored, and transferring to the information storage unit if the illegal content passes the legality checking;
the information storage unit is used for storing the data information in a storage medium of the platform end if the content contract rule is satisfied, and simultaneously returning a successful sending message to a sending end for sending the data information;
the online judging unit is used for analyzing the information receiving object in the data information by the platform end, judging whether the contact person of the information receiving object is online or not, and if the contact person of the information receiving object is online, transmitting the data information to the information receiving end corresponding to the online receiving object and entering the information receiving unit; if the contact of the information receiving object is offline, entering an offline detection unit;
the offline detection unit is used for suspending the data information when the contact person monitoring the information receiving object is offline, starting an object online monitoring process at the same time, and transmitting the data information to an information receiving end corresponding to the online receiving object when the contact person monitoring the information receiving object is online;
the information receiving unit is used for generating a thumbnail of data information by the platform end and sending the thumbnail of the data information to the information receiving end, and the information receiving end receives the thumbnail of the data information and then carries out information reminding;
the clear view downloading unit is used for generating a clear view of the data information and sending the clear view of the data information to the information receiving end when the information receiving end displays the thumbnail of the data information and requests the platform end to download the clear view of the data information, and the information receiving end replaces the thumbnail of the data information after downloading the clear view of the data information so as to display the clear view of the data information and synchronously stores the clear view of the data information in a cache; when the information receiving end checks the data information again, the cache is checked first, if the clear view of the data information exists, the clear view of the data information in the cache is read, and if the clear view of the data information does not exist, the clear view of the data information is downloaded from the platform end;
and the information receiving completion unit is used for sending the information receiving completion receipt to the platform end by the information receiving end, and the platform end receives the information receiving completion receipt, changes the information state and completes the whole information sending and receiving process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210053767.5A CN114501048A (en) | 2022-01-18 | 2022-01-18 | Cross-screen real-time communication interaction method and system with large-screen display as center |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210053767.5A CN114501048A (en) | 2022-01-18 | 2022-01-18 | Cross-screen real-time communication interaction method and system with large-screen display as center |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114501048A true CN114501048A (en) | 2022-05-13 |
Family
ID=81511025
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210053767.5A Pending CN114501048A (en) | 2022-01-18 | 2022-01-18 | Cross-screen real-time communication interaction method and system with large-screen display as center |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114501048A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180167426A1 (en) * | 2015-10-29 | 2018-06-14 | CrankWheel ehf. | Multiplatform Screen Sharing Solution for Software Demonstration |
| US20180167443A1 (en) * | 2016-12-08 | 2018-06-14 | Sap Se | Hybrid cloud integration systems and methods |
| US20180275948A1 (en) * | 2017-03-27 | 2018-09-27 | Lenovo (Beijing) Co., Ltd. | Information processing method and electronic device |
| CN109445733A (en) * | 2018-10-16 | 2019-03-08 | 杭州橙鹰数据技术有限公司 | Across screen methods of exhibiting, device, calculate equipment and storage medium |
| CN110430314A (en) * | 2018-10-11 | 2019-11-08 | 彩云之端文化传媒(北京)有限公司 | A kind of intelligence between different screen is across screen connecting platform |
| CN110474948A (en) * | 2019-06-18 | 2019-11-19 | 北京世纪超星信息技术发展有限责任公司 | A kind of exchange method between the network equipment |
| CN111988382A (en) * | 2020-08-07 | 2020-11-24 | 浙江讯盟科技有限公司 | Method and system for performing application interface interaction across terminals |
| CN113286191A (en) * | 2021-05-20 | 2021-08-20 | Oppo广东移动通信有限公司 | Content collaboration method, device, electronic equipment and storage medium |
-
2022
- 2022-01-18 CN CN202210053767.5A patent/CN114501048A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180167426A1 (en) * | 2015-10-29 | 2018-06-14 | CrankWheel ehf. | Multiplatform Screen Sharing Solution for Software Demonstration |
| US20180167443A1 (en) * | 2016-12-08 | 2018-06-14 | Sap Se | Hybrid cloud integration systems and methods |
| US20180275948A1 (en) * | 2017-03-27 | 2018-09-27 | Lenovo (Beijing) Co., Ltd. | Information processing method and electronic device |
| CN110430314A (en) * | 2018-10-11 | 2019-11-08 | 彩云之端文化传媒(北京)有限公司 | A kind of intelligence between different screen is across screen connecting platform |
| CN109445733A (en) * | 2018-10-16 | 2019-03-08 | 杭州橙鹰数据技术有限公司 | Across screen methods of exhibiting, device, calculate equipment and storage medium |
| CN110474948A (en) * | 2019-06-18 | 2019-11-19 | 北京世纪超星信息技术发展有限责任公司 | A kind of exchange method between the network equipment |
| CN111988382A (en) * | 2020-08-07 | 2020-11-24 | 浙江讯盟科技有限公司 | Method and system for performing application interface interaction across terminals |
| CN113286191A (en) * | 2021-05-20 | 2021-08-20 | Oppo广东移动通信有限公司 | Content collaboration method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11792241B2 (en) | Method, system, and non-transitory computer-readable record medium for displaying reaction during VoIP-based call | |
| US8943164B2 (en) | Apparatus and methods for retrieving/ downloading content on a communication device | |
| CN102710789B (en) | Interaction method, system and device for data between intelligent terminals | |
| US10419804B2 (en) | Cooperative provision of personalized user functions using shared and personal devices | |
| EP2239703B1 (en) | Method of sharing image based files between a group of communication devices | |
| CN103166941A (en) | Data sharing method and device | |
| CN112839238B (en) | Screen projection playing method and device and storage medium | |
| JP2006343830A (en) | File conversion system | |
| CN111093094A (en) | Video transcoding method, device and system, electronic equipment and readable storage medium | |
| CN111526411A (en) | Video processing method, device, equipment and medium | |
| CN102460410A (en) | Apparatus and method for transmitting and receiving user interface in communication system | |
| CN106599323A (en) | Method and apparatus for realizing distributed pipeline in distributed file system | |
| CN112016280B (en) | File editing method and device and computer readable medium | |
| CN113282590A (en) | Interface joint debugging method and device based on 5G message | |
| CN117542543A (en) | Video file processing method, device, electronic equipment and computer readable medium | |
| CN114501048A (en) | Cross-screen real-time communication interaction method and system with large-screen display as center | |
| CN113766255B (en) | Video stream merging method, device, electronic equipment and computer medium | |
| US10491681B2 (en) | Method and a device for enriching a call | |
| CN112243135B (en) | Multimedia playing method and device | |
| CN116777438A (en) | Resource processing method, device, equipment and computer readable storage medium | |
| CN115079889A (en) | Information processing method, device, equipment, medium and product | |
| CN115037991A (en) | Browser video playing method and device, terminal equipment and readable storage medium | |
| CN117692668A (en) | Live broadcast examination transcoding method, system, device and storage medium | |
| CN116320616A (en) | Multimedia file processing method and device, electronic equipment and storage medium | |
| CN114979451A (en) | Image preview method and device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |