CN113053374A - Large screen control system - Google Patents

Large screen control system Download PDF

Info

Publication number
CN113053374A
CN113053374A CN202110245360.8A CN202110245360A CN113053374A CN 113053374 A CN113053374 A CN 113053374A CN 202110245360 A CN202110245360 A CN 202110245360A CN 113053374 A CN113053374 A CN 113053374A
Authority
CN
China
Prior art keywords
large screen
data
mobile terminal
processing
identification code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110245360.8A
Other languages
Chinese (zh)
Other versions
CN113053374B (en
Inventor
江国球
庞成龙
宋明站
张鹏
王永超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjiu Sharing Network Technology Group Co ltd
Original Assignee
Tianjiu Sharing Network Technology Group Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjiu Sharing Network Technology Group Co ltd filed Critical Tianjiu Sharing Network Technology Group Co ltd
Priority to CN202110245360.8A priority Critical patent/CN113053374B/en
Publication of CN113053374A publication Critical patent/CN113053374A/en
Application granted granted Critical
Publication of CN113053374B publication Critical patent/CN113053374B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W56/00—Synchronisation arrangements
    • H04W56/001—Synchronization between nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/11—Allocation or use of connection identifiers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/30—Connection release
    • H04W76/38—Connection release triggered by timers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W80/00—Wireless network protocols or protocol adaptations to wireless operation
    • H04W80/06—Transport layer protocols, e.g. TCP [Transport Control Protocol] over wireless
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention relates to a large screen control system, comprising: the mobile terminal comprises a first large screen and a plurality of first mobile terminals; the first mobile terminal is used for carrying out first connection establishment processing with the first large screen; the voice interaction processing module is also used for carrying out first voice interaction processing with the first large screen; the first heartbeat connection processing module is also used for carrying out first heartbeat connection processing with the first large screen; the system is also used for performing first disconnection processing according to a plurality of disconnection mechanisms; the first large screen is also used for performing second disconnection processing according to a plurality of disconnection mechanisms. According to the system provided by the invention, interconnection is established between the large screen and the mobile terminal, the instruction data from the mobile terminal is received, and the large screen is operated by identifying the instruction data. The system provided by the invention is used for improving the traditional large screen control system, so that the problem that the traditional large screen cannot be separated from the auxiliary control equipment can be solved, and the intellectualization of the large screen is improved.

Description

Large screen control system
Technical Field
The invention relates to the technical field of data processing, in particular to a large screen control system.
Background
With the maturity and development of network technology, remote office becomes a common office model. In the remote office mode, a large office screen for holding a multi-party conference naturally becomes one of the necessary office equipment of many companies. However, in practical application, it is found that most of existing large office screens can be operated manually by using auxiliary control devices such as a mouse, a keyboard, or a remote controller; moreover, voice recognition function is basically not supported; in addition, control connections with mobile terminals are also not supported.
Disclosure of Invention
The invention aims to provide a large screen control system aiming at the defects of the prior art, which establishes interconnection between a large screen and a mobile terminal, receives instruction data from the mobile terminal and operates the large screen by identifying the instruction data. The system provided by the invention is used for improving the traditional large screen control system, so that the problem that the traditional large screen cannot be separated from the auxiliary control equipment can be solved, and the intellectualization of the large screen is improved.
In order to achieve the above object, an embodiment of the present invention provides a large screen control system, where the system includes: the mobile terminal comprises a first large screen and a plurality of first mobile terminals;
each first mobile terminal is connected with the first large screen through a first wireless network; in a plurality of first mobile terminals, the first large screen is connected with at most one first mobile terminal;
the first mobile terminal is used for performing first connection establishment processing with the first large screen when connection with the first large screen is not established;
the first mobile terminal is further used for performing first voice interaction processing with the first large screen according to a voice signal acquired from a user when performing voice interaction with the first large screen after the first connection establishment processing is successful;
the first mobile terminal is further used for performing first heartbeat connection processing with the first large screen at regular time according to a preset heartbeat time interval when voice interaction is not performed with the first large screen after the first connection establishment processing is successful;
the first mobile terminal is further used for performing first disconnection processing with the first large screen according to a mobile terminal active disconnection mechanism, a mobile terminal heartbeat timeout disconnection mechanism or a response large screen disconnection mechanism when voice interaction with the first large screen is not performed after the first connection establishment processing is successful;
and the first large screen is also used for performing second disconnection processing with the first mobile terminal according to a large screen active disconnection mechanism, a large screen heartbeat timeout disconnection mechanism or a response mobile terminal disconnection mechanism after the first connection establishment processing is successful and when voice interaction is not performed with the first mobile terminal.
Preferably, the first and second liquid crystal materials are,
locally at said first mobile terminal, storing a first identification code for uniquely identifying the mobile terminal;
a second identification code for identifying the currently connected mobile terminal is stored locally on the first large screen;
the first wireless network comprises a wireless local area network and a mobile communication network; the mobile communication network comprises a second generation mobile communication network 2G, a third generation mobile communication network 3G, a fourth generation mobile communication network 4G and a fifth generation mobile communication network 5G;
assembling communication data between the first mobile terminal and the first large screen according to a preset first communication protocol; the first communication protocol comprises a Transmission Control Protocol (TCP).
Preferably, the first and second liquid crystal materials are,
the first mobile terminal is specifically configured to generate, according to the first communication protocol, first connection instruction data including the first identification code by assembly when the first connection establishment process is performed; sending the first connection instruction data to the first large screen; receiving first connection instruction return data sent back from the first large screen; according to the first communication protocol, first state data are analyzed from the first connection instruction return data;
when the first state data is in a successful state, the first connection establishment processing is successful;
when the first state data is in an occupied state, displaying and processing the occupied prompt information of the large screen to a user; acquiring first input data input by a user; if the first input data is preset forced occupation information, assembling and generating first forced connection instruction data containing the first identification code according to the first communication protocol; sending the first forced connection instruction data to the first large screen; receiving first forced connection instruction return data sent back from the first large screen; according to the first communication protocol, second state data are analyzed from the first forced connection instruction return data; and if the second state data is in a successful state, the first connection establishment processing is successful.
Further, in the above-mentioned case,
the first large screen is specifically used for receiving the first connection instruction data sent from the first mobile terminal; according to the first communication protocol, the first identification code is analyzed from the first connection instruction data; if the local second identification code is empty, setting the second identification code as the first identification code, and setting the first state data as a success state; if the second identification code is not empty, setting the first state data as an occupied state; then according to the first communication protocol, assembling and generating the first connection instruction return data containing the first state data; returning the first connection instruction to the data and sending the data back to the first mobile terminal;
the first large screen is specifically used for receiving the first forced connection instruction data sent from the first mobile terminal; analyzing the first identification code from the first mandatory connection instruction data according to the first communication protocol; setting the local second identification code as the first identification code, and setting the second state data as a success state; then according to the first communication protocol, assembling and generating the first forced connection instruction return data containing the second state data; and returning the first forced connection instruction to the data and sending the data back to the first mobile terminal.
Preferably, the first and second liquid crystal materials are,
the first mobile terminal is specifically used for carrying out sectional acquisition on voice signals of a user according to preset voice signal duration during the first voice interaction processing so as to generate a plurality of first voice signals; when one first voice signal is obtained, audio data sampling processing is carried out on the first voice signal according to a preset audio sampling parameter, and corresponding first audio stream data is generated; when one piece of first audio stream data is obtained, assembling and generating first voice instruction data containing the first identification code and the first audio stream data according to the first communication protocol, and sending the first voice instruction data to the first large screen; the audio sampling parameters comprise the number of audio sampling channels, the audio sampling rate and the number of audio sampling points; the number of the audio sampling channels is default to 4 channels, the default of the audio sampling rate is 16000 Hz, and the default of the number of the audio sampling points is 16 bits.
Further, in the above-mentioned case,
the first large screen is specifically used for receiving the first voice instruction data sent from the first mobile terminal; analyzing the first identification code and the first audio stream data from the first voice instruction data according to the first communication protocol; when the first identification code is matched with the local second identification code, sequentially storing the first audio stream data; after receiving all the first voice instruction data, sequentially splicing all the stored first audio stream data to generate first complete audio stream data; performing voice recognition processing on the first complete audio stream data to generate first recognition data; and identifying the control instruction with the highest matching degree with the first identification data from a preset control instruction set as first control instruction data, and executing an instruction processing flow corresponding to the first control instruction data.
Preferably, the first and second liquid crystal materials are,
the first mobile terminal is specifically configured to assemble and generate first heartbeat instruction data including the first identification code according to the first communication protocol at an interval of the heartbeat time during the first heartbeat connection processing; sending the first heartbeat instruction data to the first large screen; receiving first heartbeat instruction return data sent back from the first large screen; according to the first communication protocol, third state data are analyzed from the first heartbeat instruction return data; and when the third state data is a success state, the first heartbeat connection processing is successful.
Further, in the above-mentioned case,
the first large screen is specifically used for receiving the first heartbeat instruction data sent from the first mobile terminal; according to the first communication protocol, the first identification code is analyzed from the first heartbeat instruction data; when the first identification code is matched with the local second identification code, setting the third state data as a success state; assembling and generating the first heartbeat instruction return data containing the third state data according to the first communication protocol; and returning the first heartbeat instruction to the data and sending the data back to the first mobile terminal.
Preferably, the first mobile terminal is specifically configured to, during the first disconnection process,
when the acquired second input data input by the user is preset disconnection information, activating an active disconnection mechanism of the mobile terminal to perform disconnection processing of the first mobile terminal; according to the first communication protocol, assembling and generating first disconnection instruction data containing the first identification code; sending the first disconnection instruction data to the first large screen; releasing occupied resources locally used for processing communication with the first large screen;
when all the first heartbeat connection processing with the first large screen fails within a preset maximum heartbeat time interval, activating a heartbeat timeout disconnection mechanism of the mobile terminal to perform disconnection processing of a second mobile terminal; releasing occupied resources locally used for processing communication with the first large screen;
when receiving first large screen disconnection instruction data sent from the first large screen, activating the response large screen disconnection mechanism to perform third mobile terminal disconnection processing; and releasing occupied resources locally used for processing communication with the first large screen.
Further, the first large screen is specifically used for displaying a first display screen when the first screen is disconnected,
when a user actively disconnects the large screen through voice control, activating the large screen active disconnection mechanism to disconnect the first large screen; according to the first communication protocol, assembling and generating the first large screen disconnection instruction data; sending the disconnection instruction data of the first large screen to the first mobile terminal; setting the second identification code stored locally to be null, and releasing occupied resources used for processing communication with the first mobile terminal locally;
when the first heartbeat instruction data sent from the first mobile terminal cannot be received within the maximum heartbeat time interval, activating the large-screen heartbeat timeout disconnection mechanism to perform second large-screen disconnection processing; setting the second identification code stored locally to be empty, and releasing occupied resources used for processing communication with the first mobile terminal locally;
when the first disconnection instruction data sent from the first mobile terminal is received, activating a disconnection mechanism of the response mobile terminal to perform disconnection processing on a third large screen; according to the first communication protocol, the first identification code is analyzed from the first disconnection instruction data; and when the first identification code is matched with the local second identification code, setting the locally stored second identification code to be null, and releasing occupied resources locally used for processing communication with the first mobile terminal.
The embodiment of the invention provides a large screen control system, which is used for establishing interconnection between a large screen and a mobile terminal, receiving instruction data from the mobile terminal and operating the large screen by identifying the instruction data. The system provided by the invention is used for improving the traditional large screen control system, so that the problem that the traditional large screen cannot be separated from the auxiliary control equipment can be solved, and the intellectualization of the large screen is improved.
Drawings
Fig. 1 is a schematic structural diagram of a large screen control system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is apparent that the described embodiments are only a part of the embodiments of the present invention, not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic structural diagram of a large screen control system according to an embodiment of the present invention, where a first mobile terminal 101 in the system may be a mobile phone, a mobile terminal, a tablet computer, a notebook computer, a desktop computer, or a server with a wireless communication function, or may be a device connected to the mobile phone, the mobile terminal, the tablet computer, the notebook computer, the desktop computer, or the server to implement functions according to an embodiment of the present invention, for example, the device may be a device or a chip system of the mobile phone, the mobile terminal, the tablet computer, the notebook computer, the desktop computer, or the server; the first large screen 102 in the system may be a large screen or a display device with a wireless communication function, or may also be a device connected to the large screen or the display device to implement the functions of the embodiment of the present invention, for example, the device may be a device or a chip system of the large screen or the display device; as shown in fig. 1, the system includes: a plurality of first mobile terminals 101 and a first large screen 102.
In the system, each first mobile terminal 101 can be connected with a first large screen 102 through a first wireless network; in the plurality of first mobile terminals 101, the first large screen 102 remains connected to only one of the first mobile terminals 101 at most.
Wherein, locally at the first mobile terminal 101, a first identification code for uniquely identifying the mobile terminal is stored; locally on the first large screen 102, a second identification code for identifying the currently connected mobile terminal is stored; the first wireless network comprises a wireless local area network and a mobile communication network; the mobile communication networks include a 2-Generation with a free telephone technology (2G), a Third Generation mobile communication network (3G), a fourth Generation mobile communication network (4G), and a fifth Generation mobile communication network (5G); assembling communication data between the first mobile terminal 101 and the first large screen 102 according to a preset first communication protocol; the first communication Protocol includes a Transmission Control Protocol (TCP) Protocol.
Here, in the system according to the embodiment of the present invention, if the connection is performed through the wireless lan, the first large screen 102 and the first mobile terminal 101 should be in the same lan; in addition, although each first mobile terminal 101 can be connected to the first large screen 102, in order to improve the accuracy of controlling the large screen by the mobile terminal, the first large screen 102 is only allowed to be connected to 1 first mobile terminal 101 at the same time; the first identifier is a unique identifier stored locally in the first Mobile terminal 101, and the unique identifier may be a unique product sequence code, a unique Multiple Access Channel (MAC) code, or a unique International Mobile Equipment Identifier (IMEI); correspondingly, the second identification code is stored in the first large screen 102 locally, and is used for identifying the unique identification code of the current first mobile terminal 101 connected to the first large screen 102, that is, the first identification code of the current first mobile terminal 101.
The first mobile terminal 101 is configured to perform a first connection establishment process with the first large screen 102 when a connection with the first large screen 102 is not established.
In a specific implementation manner provided in the embodiment of the present invention, the first mobile terminal 101 is specifically configured to assemble and generate first connection instruction data including a first identification code according to a first communication protocol when performing the first connection establishment processing; sending the first connection instruction data to the first large screen 102; receiving the first connection instruction return data sent back from the first large screen 102; according to a first communication protocol, analyzing first state data from the first connection instruction return data;
when the first state data is in a successful state, the first connection establishment processing is successful;
when the first state data is in an occupied state, displaying and processing the occupied prompt information of the large screen to a user; acquiring first input data input by a user; if the first input data is preset forced occupation information, assembling and generating first forced connection instruction data containing a first identification code according to a first communication protocol; sending the first forced connection instruction data to the first large screen 102; receiving a first forced connection instruction return data sent back from the first large screen 102; according to a first communication protocol, second state data are analyzed from the first forced connection instruction return data; and if the second state data is a successful state, the first connection establishment processing is successful.
Here, before the user needs to control the first large screen 102 by voice to complete the designated operation, the first mobile terminal 101 needs to be used to establish a connection relationship with the first large screen 102, that is, the first establishment connection process described above is performed. When the first connection establishment processing is performed, the first mobile terminal 101 should send the appointed connection instruction data, that is, the first connection instruction data, to the first large screen 102; during transmission, the first mobile terminal 101 shall package the first connection instruction data according to an agreed communication data assembly protocol, that is, a first communication protocol, for example, when the first communication protocol is a TCP protocol, the data packaging format of the first connection instruction data shall be a TCP data packet; in the first connection instruction data, a first identification code of the sender should be given, so that the first large screen 102 can identify the first mobile terminal 101 requesting connection after receiving the instruction data; after receiving the first connection instruction data, the first large screen 102 completes corresponding connection processing, and returns a connection processing result, that is, first connection instruction return data packed according to the TCP protocol, to the first mobile terminal 101; the first connection instruction return data contains processing state data of a specific first connection instruction, namely first state data; the first state data specifically includes two state information, i.e., a successful state and an occupied state, if the first state is the successful state, it indicates that the first large screen 102 has completed connection binding with the current first mobile terminal 101, and the connection request is successful this time, i.e., the first establishment connection processing is successful, and correspondingly, the first mobile terminal 101 locally performs setting and allocation processing of standard communication resources such as a conventional communication port, communication parameters, a communication cache region, a channel socket, and the like;
if the first state is the occupied state, it indicates that the first large screen 102 is currently in a connection binding relationship with other mobile terminals, and the connection request fails this time; in the embodiment of the present invention, if the connection request fails, the first mobile terminal 101 displays a large-screen occupied prompt message to the user through its own display device, such as a normal display screen and a touch screen, or through a display device connected to itself, such as a normal display, a touch screen, and the like, for example, displays "is a large screen currently connected occupied, and whether another connection terminal is forcibly kicked off the line? When the user selects "yes" or "no", the content of the first input data is set as forced occupation information, where the forced occupation information is data preset to correspond to the "yes" option, and is, for example, 1; when the content of the first input data is forced occupation information, it indicates that the user requires to perform forced kicking removal and replacement operations on other mobile terminals bound to the first large screen 102, and then the first mobile terminal 101 assembles and generates first forced connection instruction data, where the instruction data is forced connection instruction data agreed between the mobile terminal and the large screen, and the instruction data also includes a first identification code of the sender; after receiving the first forced connection instruction data, the first large screen 102 kicks off the previously connected mobile terminal, establishes a connection binding relationship with the mobile terminal which currently initiates the forced connection, and then returns a forced connection processing result, that is, the first forced connection instruction return data, to the first mobile terminal 101; the first forced connection instruction return data contains processing state data of a specific first forced connection instruction, namely second state data; if the second state data is in a successful state, it indicates that the first large screen 102 has already completed connection binding with the current first mobile terminal 101, and the forced connection request is successful, that is, the first connection establishment process is successful, and correspondingly, the first mobile terminal 101 may locally perform setting and allocation processing of standard communication resources such as a conventional communication port, communication parameters, a communication buffer, and a channel socket.
In another specific implementation manner provided in the embodiment of the present invention, the first large screen 102 is specifically configured to receive first connection instruction data sent from the first mobile terminal 101; according to a first communication protocol, a first identification code is analyzed from the first connection instruction data; if the local second identification code is empty, setting the second identification code as the first identification code, and setting the first state data as a success state; if the second identification code is not empty, setting the first state data as an occupied state; according to a first communication protocol, assembling and generating first connection instruction return data containing first state data; returning the first connection instruction to the data and sending the data back to the first mobile terminal 101;
the first large screen 102 is specifically configured to receive first forced connection instruction data sent from the first mobile terminal 101; according to a first communication protocol, a first identification code is analyzed from the first mandatory connection instruction data; setting the local second identification code as the first identification code, and setting the second state data as a success state; according to a first communication protocol, assembling and generating first forced connection instruction return data containing second state data; and returns the first forced connection instruction to the data and sends the data back to the first mobile terminal 101.
Here, after receiving the first connection instruction data, the first large screen 102 first parses the first connection instruction data according to a first communication protocol, for example, a TCP protocol, and extracts a first identification code from the first connection instruction data; after the first identification code is obtained, the first large screen 102 needs to identify whether the first large screen is currently in a connection binding state with other mobile terminals by reading a second identification code stored locally;
if the second identification code is empty, it indicates that there is no mobile terminal currently bound, and naturally, a connection binding relationship with the first mobile terminal 101 currently initiating the first connection instruction data can be immediately established, and when the connection binding relationship is established, in addition to setting and allocating standard communication resources such as a conventional communication port, communication parameters, a communication cache region, a channel socket, and the like, the second identification code needs to be set as the first identification code, and after the connection binding relationship is successfully established, the first large screen 102 sets data reflecting the processing state of the first connection instruction, that is, the first state data, as a successful state, and packages the data into return data of the first connection instruction data, that is, the return data of the first connection instruction, and sends the return data back to the first mobile terminal 101;
if the second identification code is not null, it indicates that there is another bound mobile terminal at present, and then a connection binding relationship with the first mobile terminal 101 that currently initiates the first connection instruction data cannot be established, and the first large screen 102 sets the data reflecting the processing state of the first connection instruction, that is, the first state data, to an occupied state, packs the data into the return data of the first connection instruction data, that is, the first connection instruction return data, and sends the data back to the first mobile terminal 101;
if the first mobile terminal 101 recognizes that the first state data is the occupied state from the first connection instruction return data, and the user confirms that the forced kicking replacement is to be performed on the mobile terminal bound additionally, the first large screen 102 receives the first forced connection instruction data sent from the first mobile terminal 101; after the first large screen 102 receives the first forced connection instruction data, kicking off the previous mobile terminal, and establishing a connection binding relationship with the first mobile terminal 101 initiating the forced connection this time; in this processing procedure, the first large screen 102 needs to modify the second identification code into the first identification code of the current first mobile terminal 101, in addition to releasing the communication resource allocated to the previous binding relationship and resetting and allocating the communication resource corresponding to the current binding relationship; after the kicking and the binding with the connection are successfully completed, the first large screen 102 sets the data reflecting the processing state of the first forced connection instruction, that is, the second state data, to a successful state, packages the data into the return data of the first forced connection instruction data, that is, the first forced connection instruction return data, and sends the data back to the first mobile terminal 101.
The first mobile terminal 101 is further configured to, after the first connection establishment process is successful, perform a first voice interaction process with the first large screen 102 according to a voice signal acquired from the user when performing a voice interaction with the first large screen 102.
In another specific implementation manner provided in the embodiment of the present invention, the first mobile terminal 101 is specifically configured to perform segmented acquisition on a voice signal of a user according to a preset voice signal duration during the first voice interaction processing, so as to generate a plurality of first voice signals; when a first voice signal is obtained, audio data sampling processing is carried out on the first voice signal according to a preset audio sampling parameter, and corresponding first audio stream data is generated; when a first audio stream data is obtained, assembling and generating a first voice instruction data containing a first identification code and the first audio stream data according to a first communication protocol, and sending the first voice instruction data to the first large screen 102; the audio sampling parameters comprise the number of audio sampling channels, the audio sampling rate and the number of audio sampling points; the number of audio sampling channels is default to 4 channels, the default audio sampling rate is 16000 Hz, and the number of audio sampling points is default to 16 bits.
Here, in the embodiment of the present invention, after the user establishes a connection with the first large screen 102 through the first mobile terminal 101, the user can control the operation of the first large screen 102 by sending voice information to the first large screen 102 through the first mobile terminal 101, and this processing procedure is referred to as a first voice interaction processing; when the first voice interaction processing is performed, the first mobile terminal 101 is responsible for acquiring a voice signal of a user and performing audio sampling on the voice signal, generating audio stream data, and sending the audio stream data to the first large screen 102 for subsequent voice recognition and instruction execution; in the embodiment of the present invention, the audio stream data adopts a Pulse Code Modulation (PCM) data stream format; when audio sampling is carried out, the more the number of audio sampling channels, the higher the audio sampling rate and the more the number of audio sampling points in audio sampling parameters are, the more the generated audio stream data has a high simulation effect, in the embodiment of the invention, the number of the audio sampling channels is default to 4 channels, the audio sampling rate is 16000 Hz, and the number of the audio sampling points is default to 16 bits, so that the setting can be compatible with the sound card configuration of most mobile terminals and can obtain a high simulation effect; when the first mobile terminal 101 collects a voice signal, the difference from the traditional method of uniformly collecting, then uniformly sampling and uniformly sending the voice signal is that a real-time voice data transmission method is adopted between the first mobile terminal 101 and the first large screen 102: the first mobile terminal 101 performs signal acquisition in a segmented acquisition manner, while acquiring a next segment of first voice signal, audio data sampling processing can be performed on the acquired previous segment of first voice signal to obtain corresponding first audio stream data, and the first audio stream data is immediately sent to the first large screen 102 after being generated.
In another specific implementation manner provided by the embodiment of the present invention, the first large screen 102 is specifically configured to receive first voice instruction data sent from the first mobile terminal 101; according to a first communication protocol, a first identification code and first audio stream data are analyzed from first voice instruction data; when the first identification code is matched with a local second identification code, sequentially storing the first audio stream data; after receiving all the first voice instruction data, sequentially splicing all the stored first audio stream data to generate first complete audio stream data; performing voice recognition processing on the first complete audio stream data to generate first recognition data; and identifying the control instruction with the highest matching degree with the first identification data from a preset control instruction set as first control instruction data, and executing an instruction processing flow corresponding to the first control instruction data.
Here, each time the first large screen 102 receives the first voice instruction data sent by the first mobile terminal 101, the first identification code is extracted from the first large screen and compared with the second identification code stored locally, if the first identification code and the second identification code are matched, it is indicated that the mobile terminal having the binding relationship with the first large screen 102 uploads the first voice instruction data, and the uploaded first audio stream data is valid audio data and can be stored for subsequent splicing; after the first large screen 102 completes the pickup of all the first voice instruction data, sequentially splicing all the first audio stream data according to the sequence of time to obtain final complete audio stream data, namely first complete audio stream data; after the first complete audio stream data is obtained, the first large screen 102 also performs voice recognition processing on the first complete audio stream data, and the processing process reduces environmental noise in the first complete audio stream data, recognizes the human voice, queries a preset voice dictionary according to each pronunciation, and finally obtains a corresponding segment of text information, namely first recognition data; after the first identification data is obtained, the first large screen 102 continues to display the first identification data according to a preset control instruction set containing a plurality of pieces of control instruction information, and the first identification data is processed by instruction fuzzy matching, and in the processing process, the first large screen 102 uses the first identification data to perform data matching operation with each piece of control instruction information, in the data matching operation, the matching degree is 100% if the first identification data is identical to a certain piece of control instruction information, the matching degree is 0 if there is no overlapping content between the first identification data and the certain piece of control instruction information, the matching degree of the first identification data and each piece of control instruction information can be obtained through the data matching operation, and the control instruction information corresponding to the maximum matching degree is selected from the first large screen 102 and used as the control instruction with the highest matching degree with the first identification data, namely the first control instruction data; the first large screen 102 locally stores in advance an instruction processing program or a hardware function interface corresponding to each piece of control instruction information, and after the first large screen 102 obtains the first control instruction data, the instruction processing program or the hardware function interface corresponding thereto may be called to perform a specific program execution operation or a hardware function execution operation, that is, to execute an instruction processing flow corresponding to the first control instruction data.
The first mobile terminal 101 is further configured to perform the first heartbeat connection processing with the first large screen 102 at regular time according to a preset heartbeat time interval when the first mobile terminal does not perform the voice interaction with the first large screen 102 after the first connection establishment processing is successful.
In another specific implementation manner provided in the embodiment of the present invention, the first mobile terminal 101 is specifically configured to assemble and generate first heartbeat instruction data including the first identification code according to the first communication protocol at a heartbeat time interval during the first heartbeat connection processing; sending the first heartbeat instruction data to the first large screen 102; receiving first heartbeat instruction return data sent back from the first large screen 102; according to the first communication protocol, third state data are analyzed from the first heartbeat instruction return data; and when the third state data is in a success state, the first heartbeat connection processing is successful.
Here, in the embodiment of the present invention, after the user establishes a connection with the first large screen 102 through the first mobile terminal 101, the user may not be constantly in a voice interaction state, and when no voice interaction is performed, in order to ensure that the first mobile terminal 101 and the first large screen 102 can keep effective connection for a long time, the embodiment of the present invention further provides a heartbeat connection mechanism, that is, every an agreed heartbeat time interval, for example, 5 seconds, the first mobile terminal 101 sends a first heartbeat instruction data to the first large screen 102, and if response data sent back from the first large screen 102 can be received in time, that is, the first heartbeat instruction return data, and it is determined that third state data in the first heartbeat instruction return data is in a successful state, it is determined that the first mobile terminal 101 and the first large screen 102 still keep connected; the third state data is used to identify the processing result of the first heartbeat instruction data by the first large screen 102.
In another specific implementation manner provided by the embodiment of the present invention, the first large screen 102 is specifically configured to receive first heartbeat instruction data sent from the first mobile terminal 101; according to a first communication protocol, a first identification code is analyzed from the first heartbeat instruction data; when the first identification code is matched with the local second identification code, setting the third state data as a success state; according to a first communication protocol, assembling and generating first heartbeat instruction return data containing third state data; and returns the first heartbeat instruction to the data and sends the data back to the first mobile terminal 101.
Here, after receiving the first heartbeat instruction data each time, the first large screen 102 extracts the first identification code from the first heartbeat instruction data and compares the first identification code with the second identification code stored locally, and if the first identification code and the second identification code are matched, it is indicated that the mobile terminal having a binding relationship with the first large screen 102 uploads the first heartbeat instruction data; subsequently, the third state data is set to a success state to indicate that the first large screen 102 has successfully received and processed the first heartbeat instruction data; next, the first heartbeat instruction return data including the third state data is transmitted back to the first mobile terminal 101 as response data of the first heartbeat instruction data.
The first mobile terminal 101 is further configured to, after the first connection establishment process is successful, perform a first disconnection process with the first large screen 102 according to a mobile terminal active disconnection mechanism, a mobile terminal heartbeat timeout disconnection mechanism, or a response large screen disconnection mechanism when voice interaction is not performed with the first large screen 102.
In another specific implementation manner provided in the embodiment of the present invention, the first mobile terminal 101 is specifically configured to, during the first disconnection process:
when the acquired second input data input by the user is preset disconnection information, activating an active disconnection mechanism of the mobile terminal to perform disconnection processing of the first mobile terminal; according to a first communication protocol, assembling and generating first disconnection instruction data containing a first identification code; sending the first disconnection instruction data to the first large screen 102; and releasing the occupied resources locally used for processing communication with the first large screen 102;
when all first heartbeat connection processing with the first large screen 102 fails within a preset maximum heartbeat time interval, activating a heartbeat timeout disconnection mechanism of the mobile terminal to perform disconnection processing of the second mobile terminal; releasing occupied resources locally used for processing communication with the first large screen 102;
when receiving first large screen disconnection instruction data sent from the first large screen 102, activating a response large screen disconnection mechanism, and performing third mobile terminal disconnection processing; the occupied resources locally used for processing the communication with the first large screen 102 are released.
Here, in the embodiment of the present invention, for the first mobile terminal 101, at least three disconnection processing manners are supported, which correspond to three disconnection mechanisms: the mobile terminal active disconnection mechanism, the mobile terminal heartbeat timeout disconnection mechanism or the response large screen disconnection mechanism;
for the active disconnection mechanism of the mobile terminal, it means that the user actively selects a processing mechanism for disconnecting the connection with the first large screen 102 on the first mobile terminal 101; after the user selects the disconnection option through the keyboard or the touch screen, second input data for identifying the user input result is correspondingly generated, the content of the second input data is set as disconnection information, the disconnection information is data preset to correspond to the disconnection option, for example, 1, after the first mobile terminal 101 obtains the second input data specifically as the disconnection information, the mobile terminal active disconnection mechanism is activated, corresponding first mobile terminal disconnection processing is executed, that is, first disconnection instruction data is actively sent to the first large screen 102, the purpose is to inform that the first large screen 102 is actively disconnected on the first mobile terminal 101 side, the instruction data does not require to return response data, and in the case that the instruction data does not have response data, after the first disconnection instruction data is sent, the first mobile terminal 101 only needs to release the communication resource for processing communication with the first large screen 102, which is allocated when the connection is established, subsequently;
the heartbeat timeout disconnection mechanism of the mobile terminal refers to a processing mechanism for selecting disconnection of the first mobile terminal 101 from the first large screen 102 after failure of multiple first heartbeat connection processing with the first large screen 102 within a preset maximum heartbeat time interval; the maximum heartbeat time interval is greater than a preset heartbeat time interval, for example, the heartbeat time interval is 5 seconds, and the maximum heartbeat time interval is 15 seconds; in 15 seconds, the first mobile terminal 101 initiates the first heartbeat connection processing with the first large screen 102 for 3 times, which indicates that the first mobile terminal 101 and the first large screen 102 actually have a communication interruption problem, under such a situation, a disconnection instruction cannot be continuously sent to the first large screen 102, and only on one side of the first mobile terminal 101, a heartbeat timeout disconnection mechanism of the mobile terminal is activated to perform disconnection processing of the second mobile terminal, that is, the first mobile terminal 101 releases communication resources which are distributed when establishing connection and used for processing communication with the first large screen 102;
the large screen disconnection responding mechanism refers to a processing mechanism for selecting disconnection with the first large screen 102 when the first mobile terminal 101 receives first large screen disconnection instruction data initiated by the first large screen 102 in a state where the first mobile terminal is normally connected with the first large screen 102; the first large screen disconnection instruction data is sent by the first large screen 102 to the first mobile terminal 101 actively, the purpose of the instruction is to inform that the first mobile terminal 101 is disconnected actively on the first large screen 102 side, the instruction data does not require to return response data, and in the case that the instruction data does not have response data, the first mobile terminal 101 activates a response large screen disconnection mechanism to perform disconnection processing of the third mobile terminal, that is, communication resources distributed for processing communication with the first large screen 102 are released when connection is established.
The first large screen 102 is further configured to perform, after the first connection establishment process is successful, a second connection disconnection process with the first mobile terminal 101 according to a large screen active disconnection mechanism, a large screen heartbeat timeout disconnection mechanism, or a response mobile terminal disconnection mechanism when voice interaction with the first mobile terminal 101 is not performed.
In another specific implementation manner provided in the embodiment of the present invention, the first large screen 102 is specifically configured to, during the second disconnection process:
when a user actively disconnects the large screen through voice control, activating a large screen active disconnection mechanism to disconnect the first large screen; according to a first communication protocol, assembling and generating first large screen disconnection instruction data; the first large screen disconnection instruction data is sent to the first mobile terminal 101; setting the second identification code stored locally to be null, and releasing occupied resources used for processing communication with the first mobile terminal 101 locally;
when the first heartbeat instruction data sent from the first mobile terminal 101 cannot be received within the maximum heartbeat time interval, activating a large-screen heartbeat timeout disconnection mechanism to perform disconnection processing on a second large screen; setting the second identification code stored locally to be null, and releasing occupied resources used for processing communication with the first mobile terminal 101 locally;
when first disconnection instruction data sent from the first mobile terminal 101 is received, activating a response mobile terminal disconnection mechanism, and performing disconnection processing on the third large screen; according to a first communication protocol, a first identification code is analyzed from first disconnection instruction data; when the first identification code is matched with the second identification code of the local, the second identification code stored locally is set to be null, and occupied resources used for processing communication with the first mobile terminal 101 locally are released.
Here, in the embodiment of the present invention, for the first large screen 102, at least three disconnection processing manners are supported, which correspond to three disconnection mechanisms: a large screen active disconnection mechanism, a large screen heartbeat timeout disconnection mechanism or a response mobile terminal disconnection mechanism;
the large screen active disconnection mechanism refers to a processing mechanism that when a user actively executes disconnection operation through controlling a large screen by voice, for example, power off, the first large screen 102 selects to disconnect from the first mobile terminal 101; when a user actively executes disconnection operation through a voice-controlled large screen, activating a mobile terminal active disconnection mechanism to execute corresponding first large screen disconnection processing, namely actively sending first large screen disconnection instruction data to a first mobile terminal 101, wherein the purpose of the instruction is to inform that the first mobile terminal 101 can be actively disconnected on the first large screen 102 side, the instruction data does not require to return response data, and when the instruction data does not have the response data, and after the first large screen disconnection instruction data is sent, the first large screen 102 sets a second identification code which is locally stored and is used for identifying a currently connected and bound mobile terminal to be empty, and simultaneously releases communication resources which are distributed when connection is established and used for processing communication with the first mobile terminal 101;
for the large-screen heartbeat timeout disconnection mechanism, it means that the first large screen 102 does not receive any first heartbeat connection instruction data sent from the first mobile terminal 101 within a preset maximum heartbeat time interval, so as to select a processing mechanism for disconnecting the connection with the first mobile terminal 101; as mentioned above, the maximum heartbeat time interval is greater than the heartbeat time interval, for example, the heartbeat time interval is 5 seconds, and the maximum heartbeat time interval is 15 seconds; the first large screen 102 does not receive any first heartbeat connection instruction data sent from the first mobile terminal 101 within 15 seconds, which indicates that the first large screen 102 and the first mobile terminal 101 actually have a communication interruption problem, under such a condition, a large screen disconnection instruction cannot be continuously sent to the first mobile terminal 101, only on one side of the first large screen 102, a large screen heartbeat timeout disconnection mechanism is activated, a second large screen disconnection process is performed, that is, the first large screen 102 sets a second identification code which is locally stored and is used for identifying a current connection binding mobile terminal to be null, and simultaneously releases communication resources which are distributed when connection is established and used for processing communication with the first mobile terminal 101;
for the mobile terminal disconnection responding mechanism, the disconnection responding mechanism refers to a processing mechanism that selects to disconnect the connection with the first mobile terminal 101 when the first large screen 102 receives first disconnection instruction data initiated by the first mobile terminal 101 in a state where the first large screen is in normal connection with the first mobile terminal 101; the first disconnection instruction data is actively sent to the first large screen 102 by the first mobile terminal 101, the purpose of the first disconnection instruction data is to inform that the first large screen 102 can be actively disconnected on the first mobile terminal 101 side, the instruction data does not require to return response data, when the instruction data does not have the response data, the first large screen 102 activates a disconnection mechanism of a response mobile terminal to disconnect the third large screen, after the first identification code of the first disconnection instruction data is identified to be matched with the second identification code of the local, the second identification code which is locally stored and is used for identifying the current connection binding mobile terminal is set to be empty, and meanwhile, communication resources which are distributed when the connection is established and used for processing communication with the first mobile terminal 101 are released.
According to the large screen control system provided by the embodiment of the invention, interconnection is established between the large screen and the mobile terminal, the instruction data from the mobile terminal is received, and the large screen is operated by identifying the instruction data. The system provided by the invention is used for improving the traditional large screen control system, so that the problem that the traditional large screen cannot be separated from the auxiliary control equipment can be solved, and the intellectualization of the large screen is improved.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the present invention in further detail, and it should be understood that the above-mentioned embodiments are merely exemplary embodiments of the present invention, and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (10)

1. A large screen control system, characterized in that the system comprises: the mobile terminal comprises a first large screen and a plurality of first mobile terminals;
each first mobile terminal is connected with the first large screen through a first wireless network; in a plurality of first mobile terminals, the first large screen is connected with at most one first mobile terminal;
the first mobile terminal is used for performing first connection establishment processing with the first large screen when connection with the first large screen is not established;
the first mobile terminal is further used for performing first voice interaction processing with the first large screen according to a voice signal acquired from a user when performing voice interaction with the first large screen after the first connection establishment processing is successful;
the first mobile terminal is further used for performing first heartbeat connection processing with the first large screen at regular time according to a preset heartbeat time interval when voice interaction is not performed with the first large screen after the first connection establishment processing is successful;
the first mobile terminal is further used for performing first disconnection processing with the first large screen according to a mobile terminal active disconnection mechanism, a mobile terminal heartbeat timeout disconnection mechanism or a response large screen disconnection mechanism when voice interaction with the first large screen is not performed after the first connection establishment processing is successful;
and the first large screen is also used for performing second disconnection processing with the first mobile terminal according to a large screen active disconnection mechanism, a large screen heartbeat timeout disconnection mechanism or a response mobile terminal disconnection mechanism after the first connection establishment processing is successful and when voice interaction is not performed with the first mobile terminal.
2. The large screen control system according to claim 1,
locally at said first mobile terminal, storing a first identification code for uniquely identifying the mobile terminal;
a second identification code for identifying the currently connected mobile terminal is stored locally on the first large screen;
the first wireless network comprises a wireless local area network and a mobile communication network; the mobile communication network comprises a second generation mobile communication network 2G, a third generation mobile communication network 3G, a fourth generation mobile communication network 4G and a fifth generation mobile communication network 5G;
assembling communication data between the first mobile terminal and the first large screen according to a preset first communication protocol; the first communication protocol comprises a Transmission Control Protocol (TCP).
3. The large screen control system according to claim 2,
the first mobile terminal is specifically configured to generate, according to the first communication protocol, first connection instruction data including the first identification code by assembly when the first connection establishment process is performed; sending the first connection instruction data to the first large screen; receiving first connection instruction return data sent back from the first large screen; according to the first communication protocol, first state data are analyzed from the first connection instruction return data;
when the first state data is in a successful state, the first connection establishment processing is successful;
when the first state data is in an occupied state, displaying and processing the occupied prompt information of the large screen to a user; acquiring first input data input by a user; if the first input data is preset forced occupation information, assembling and generating first forced connection instruction data containing the first identification code according to the first communication protocol; sending the first forced connection instruction data to the first large screen; receiving first forced connection instruction return data sent back from the first large screen; according to the first communication protocol, second state data are analyzed from the first forced connection instruction return data; and if the second state data is in a successful state, the first connection establishment processing is successful.
4. The large screen control system according to claim 3,
the first large screen is specifically used for receiving the first connection instruction data sent from the first mobile terminal; according to the first communication protocol, the first identification code is analyzed from the first connection instruction data; if the local second identification code is empty, setting the second identification code as the first identification code, and setting the first state data as a success state; if the second identification code is not empty, setting the first state data as an occupied state; then according to the first communication protocol, assembling and generating the first connection instruction return data containing the first state data; returning the first connection instruction to the data and sending the data back to the first mobile terminal;
the first large screen is specifically used for receiving the first forced connection instruction data sent from the first mobile terminal; analyzing the first identification code from the first mandatory connection instruction data according to the first communication protocol; setting the local second identification code as the first identification code, and setting the second state data as a success state; then according to the first communication protocol, assembling and generating the first forced connection instruction return data containing the second state data; and returning the first forced connection instruction to the data and sending the data back to the first mobile terminal.
5. The large screen control system according to claim 2,
the first mobile terminal is specifically used for carrying out sectional acquisition on voice signals of a user according to preset voice signal duration during the first voice interaction processing so as to generate a plurality of first voice signals; when one first voice signal is obtained, audio data sampling processing is carried out on the first voice signal according to a preset audio sampling parameter, and corresponding first audio stream data is generated; when one piece of first audio stream data is obtained, assembling and generating first voice instruction data containing the first identification code and the first audio stream data according to the first communication protocol, and sending the first voice instruction data to the first large screen; the audio sampling parameters comprise the number of audio sampling channels, the audio sampling rate and the number of audio sampling points; the number of the audio sampling channels is default to 4 channels, the default of the audio sampling rate is 16000 Hz, and the default of the number of the audio sampling points is 16 bits.
6. The large screen control system according to claim 5,
the first large screen is specifically used for receiving the first voice instruction data sent from the first mobile terminal; analyzing the first identification code and the first audio stream data from the first voice instruction data according to the first communication protocol; when the first identification code is matched with the local second identification code, sequentially storing the first audio stream data; after receiving all the first voice instruction data, sequentially splicing all the stored first audio stream data to generate first complete audio stream data; performing voice recognition processing on the first complete audio stream data to generate first recognition data; and identifying the control instruction with the highest matching degree with the first identification data from a preset control instruction set as first control instruction data, and executing an instruction processing flow corresponding to the first control instruction data.
7. The large screen control system according to claim 2,
the first mobile terminal is specifically configured to assemble and generate first heartbeat instruction data including the first identification code according to the first communication protocol at an interval of the heartbeat time during the first heartbeat connection processing; sending the first heartbeat instruction data to the first large screen; receiving first heartbeat instruction return data sent back from the first large screen; according to the first communication protocol, third state data are analyzed from the first heartbeat instruction return data; and when the third state data is a success state, the first heartbeat connection processing is successful.
8. The large screen control system according to claim 7,
the first large screen is specifically used for receiving the first heartbeat instruction data sent from the first mobile terminal; according to the first communication protocol, the first identification code is analyzed from the first heartbeat instruction data; when the first identification code is matched with the local second identification code, setting the third state data as a success state; assembling and generating the first heartbeat instruction return data containing the third state data according to the first communication protocol; and returning the first heartbeat instruction to the data and sending the data back to the first mobile terminal.
9. The large screen control system according to claim 2, wherein the first mobile terminal is specifically configured to, during the first disconnection process,
when the acquired second input data input by the user is preset disconnection information, activating an active disconnection mechanism of the mobile terminal to perform disconnection processing of the first mobile terminal; according to the first communication protocol, assembling and generating first disconnection instruction data containing the first identification code; sending the first disconnection instruction data to the first large screen; releasing occupied resources locally used for processing communication with the first large screen;
when all the first heartbeat connection processing with the first large screen fails within a preset maximum heartbeat time interval, activating a heartbeat timeout disconnection mechanism of the mobile terminal to perform disconnection processing of a second mobile terminal; releasing occupied resources locally used for processing communication with the first large screen;
when receiving first large screen disconnection instruction data sent from the first large screen, activating the response large screen disconnection mechanism to perform third mobile terminal disconnection processing; and releasing occupied resources locally used for processing communication with the first large screen.
10. The large screen control system according to claim 9, wherein the first large screen is specifically configured to, upon the second disconnection process,
when a user actively disconnects the large screen through voice control, activating the large screen active disconnection mechanism to disconnect the first large screen; according to the first communication protocol, assembling and generating the first large screen disconnection instruction data; sending the disconnection instruction data of the first large screen to the first mobile terminal; setting the second identification code stored locally to be null, and releasing occupied resources used for processing communication with the first mobile terminal locally;
when the first heartbeat instruction data sent from the first mobile terminal cannot be received within the maximum heartbeat time interval, activating the large-screen heartbeat timeout disconnection mechanism to perform second large-screen disconnection processing; setting the second identification code stored locally to be empty, and releasing occupied resources used for processing communication with the first mobile terminal locally;
when the first disconnection instruction data sent from the first mobile terminal is received, activating a disconnection mechanism of the response mobile terminal to perform disconnection processing on a third large screen; according to the first communication protocol, the first identification code is analyzed from the first disconnection instruction data; and when the first identification code is matched with the local second identification code, setting the locally stored second identification code to be null, and releasing occupied resources locally used for processing communication with the first mobile terminal.
CN202110245360.8A 2021-03-05 2021-03-05 Large screen control system Active CN113053374B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110245360.8A CN113053374B (en) 2021-03-05 2021-03-05 Large screen control system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110245360.8A CN113053374B (en) 2021-03-05 2021-03-05 Large screen control system

Publications (2)

Publication Number Publication Date
CN113053374A true CN113053374A (en) 2021-06-29
CN113053374B CN113053374B (en) 2022-08-26

Family

ID=76510210

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110245360.8A Active CN113053374B (en) 2021-03-05 2021-03-05 Large screen control system

Country Status (1)

Country Link
CN (1) CN113053374B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116271582A (en) * 2023-03-03 2023-06-23 河南翔宇医疗设备股份有限公司 Focused ultrasound therapeutic apparatus, control method, device and medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102377823A (en) * 2011-10-18 2012-03-14 北京优朋普乐科技有限公司 Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens
CN104023050A (en) * 2014-05-16 2014-09-03 中国科学院计算技术研究所 Equipment cooperation multi-screen interactive system under equipment cloud environment and method thereof
CN104122979A (en) * 2013-04-25 2014-10-29 深圳市快播科技有限公司 Method and device for control over large screen through voice
CN105100950A (en) * 2014-04-30 2015-11-25 阿里巴巴集团控股有限公司 Intelligent television mobile side switching and television side information acquisition method and device and system
CN105139850A (en) * 2015-08-12 2015-12-09 西安诺瓦电子科技有限公司 Speech interaction device, speech interaction method and speech interaction type LED asynchronous control system terminal
WO2017012417A1 (en) * 2015-07-23 2017-01-26 深圳Tcl数字技术有限公司 Control method between multi-screen interactive devices, multi-screen interactive device, and system
CN107809807A (en) * 2017-10-20 2018-03-16 广州小鹏汽车科技有限公司 The communication means and device of large-size screen monitors and mobile terminal are controlled in a kind of Android

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102377823A (en) * 2011-10-18 2012-03-14 北京优朋普乐科技有限公司 Method and system for realizing interactive sharing among multiple screens and multiple users by sliding screens
CN104122979A (en) * 2013-04-25 2014-10-29 深圳市快播科技有限公司 Method and device for control over large screen through voice
CN105100950A (en) * 2014-04-30 2015-11-25 阿里巴巴集团控股有限公司 Intelligent television mobile side switching and television side information acquisition method and device and system
CN104023050A (en) * 2014-05-16 2014-09-03 中国科学院计算技术研究所 Equipment cooperation multi-screen interactive system under equipment cloud environment and method thereof
WO2017012417A1 (en) * 2015-07-23 2017-01-26 深圳Tcl数字技术有限公司 Control method between multi-screen interactive devices, multi-screen interactive device, and system
CN105139850A (en) * 2015-08-12 2015-12-09 西安诺瓦电子科技有限公司 Speech interaction device, speech interaction method and speech interaction type LED asynchronous control system terminal
CN107809807A (en) * 2017-10-20 2018-03-16 广州小鹏汽车科技有限公司 The communication means and device of large-size screen monitors and mobile terminal are controlled in a kind of Android

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116271582A (en) * 2023-03-03 2023-06-23 河南翔宇医疗设备股份有限公司 Focused ultrasound therapeutic apparatus, control method, device and medium
CN116271582B (en) * 2023-03-03 2024-03-01 河南翔宇医疗设备股份有限公司 Focused ultrasound therapeutic apparatus, control method, device and medium

Also Published As

Publication number Publication date
CN113053374B (en) 2022-08-26

Similar Documents

Publication Publication Date Title
CN110417915B (en) Push message transmission method and device, storage medium and electronic equipment
CN109660584A (en) A kind of method and communication means and communication system of client and the long connection of server foundation
CN105493621B (en) Terminal, server and terminal control method
CN107864469A (en) Wireless connection method and equipment
CN112767936B (en) Voice dialogue method and device, storage medium and electronic equipment
CN113825258B (en) FirefoxOS-based multimode communication method and operating system
CN108933946B (en) Voice-control-based live broadcasting attention method, storage medium, electronic equipment and system
CN103841466A (en) Screen projection method, computer end and mobile terminal
WO2016045214A1 (en) Decision method and device, terminal and computer storage medium
CN107948566A (en) Method and device for realizing plug-and-play screen transmission
CN104122979A (en) Method and device for control over large screen through voice
CN113053374B (en) Large screen control system
CN109684114A (en) Message distributing method, device, terminal and medium based on iOS system
CN109918140A (en) A kind of cloud application method of controlling operation thereof and device
CN113452948B (en) Conference terminal control method, device, equipment and storage medium
CN109327726A (en) A kind of processing method, device, terminal and the storage medium of barrage message
CN110225287A (en) Audio-frequency processing method and device
CN111477229B (en) Voice recognition request processing method and device
CN114461233A (en) System and method for realizing automatic deployment of data center software based on cloud environment
US9485458B2 (en) Data processing method and device
CN115914466B (en) Voice interaction method and device based on voice stream robot and storage medium
EP4250684B1 (en) Method and apparatus for processing streaming media service, and storage medium
CN110111790B (en) Method, device and equipment for processing external equipment access of intelligent equipment
CN111431925B (en) Message data processing method and device
US20230309191A1 (en) Emergency call method and apparatus, storage medium, and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant