CN112714272A - Inter-device control method, terminal, and computer-readable storage medium - Google Patents
Inter-device control method, terminal, and computer-readable storage medium Download PDFInfo
- Publication number
- CN112714272A CN112714272A CN202011470015.6A CN202011470015A CN112714272A CN 112714272 A CN112714272 A CN 112714272A CN 202011470015 A CN202011470015 A CN 202011470015A CN 112714272 A CN112714272 A CN 112714272A
- Authority
- CN
- China
- Prior art keywords
- event
- control
- touch
- video stream
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
Abstract
The application discloses an inter-device control method, a terminal and a computer readable storage medium, wherein the inter-device control method comprises the following steps: receiving a video stream sent by controlled equipment; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding the control operation corresponding to the event information by the controlled equipment. The technical problem of poor operability of traditional video terminal equipment is solved, independent equipment with a touch screen is additionally arranged for the traditional video terminal equipment, the video terminal equipment is indirectly controlled based on the independent equipment, and the effect of facilitating control operation of the equipment is achieved.
Description
Technical Field
The present application relates to the field of video conference terminal technologies, and in particular, to a method, a terminal, and a computer-readable storage medium for controlling devices.
Background
With the development of mobile communication technology, various intelligent video conference terminals are increasingly popularized in use, and most of the operation of the current intelligent video conference terminals can be realized through a touch screen. However, the conventional video conference terminal device is usually operated in a remote control mode, which often causes the problems of inconvenient operation and poor application software adaptation. Therefore, there is an urgent need for an improved way to facilitate the use of conventional video terminal equipment.
Disclosure of Invention
The embodiment of the application aims to solve the problem of poor operability of the traditional video terminal equipment by providing an inter-equipment control method, a terminal and a computer readable storage medium.
In order to achieve the above object, an aspect of the present application provides an inter-device control method, including:
receiving a video stream sent by controlled equipment;
and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment.
Optionally, before the step of obtaining the control event corresponding to the video stream, the method further includes:
performing screen setting based on the event type of the control event;
if the event type is a touch event, setting a touch area on the screen; alternatively, the first and second electrodes may be,
and if the event type is a key event, setting a virtual key on the screen.
Optionally, the step of acquiring a control event corresponding to the video stream and sending event information of the control event to the controlled device includes:
acquiring a touch event corresponding to the video stream, wherein the touch event is generated by a user touching the touch area;
and sending the touch parameters of the touch event to the controlled equipment.
Optionally, the step of acquiring a control event corresponding to the video stream and sending event information of the control event to the controlled device further includes:
acquiring a key event corresponding to the video stream, wherein the key event is generated by clicking the virtual key by a user;
and sending the key value of the key event to the controlled equipment.
Optionally, if the event type is a touch event, after the step of setting a touch area on the screen, the method further includes:
if the resolutions of the touch screen and the display screen of the controlled device are not consistent, acquiring coordinate data generated when a user touches the touch screen;
and carrying out coordinate conversion based on the coordinate data to obtain converted display coordinate data.
In addition, to achieve the above object, another aspect of the present application further provides an inter-device control method for a controlled device, including:
acquiring a current video stream, and sending the video stream to the main control equipment;
and receiving the event information sent by the master control equipment, and responding to the control operation corresponding to the event information.
Optionally, the step of acquiring the current video stream includes:
collecting video data;
and encoding the video data to obtain the video stream.
Optionally, after the step of receiving the event information sent by the master device, the method further includes:
initializing an input device;
and writing the event information into the corresponding input equipment.
In addition, in order to achieve the above object, another aspect of the present application further provides a terminal, where the terminal includes a memory, a processor, and an inter-device control program stored in the memory and running on the processor, and the processor implements the steps of the inter-device control method when executing the inter-device control program.
In addition, to achieve the above object, another aspect of the present application further provides a computer-readable storage medium having stored thereon an inter-device control program, which when executed by a processor, implements the steps of the inter-device control method as described above.
The embodiment receives a video stream sent by a controlled device; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding the control operation corresponding to the event information by the controlled equipment. The technical problem of poor operability of traditional video terminal equipment is solved, independent equipment with a touch screen is additionally arranged for the traditional video terminal equipment, the video terminal equipment is indirectly controlled based on the independent equipment, and the effect of facilitating control operation of the equipment is achieved.
Drawings
Fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present application;
FIG. 2 is a schematic flowchart of a first embodiment of an inter-device control method according to the present application;
FIG. 3 is a schematic flowchart of a second embodiment of an inter-device control method according to the present application;
FIG. 4 is a schematic flowchart of a third embodiment of an inter-device control method according to the present application;
fig. 5 is a schematic flowchart of a process before a step of acquiring a control event corresponding to the video stream in the inter-device control method according to the present application;
fig. 6 is a schematic flow chart illustrating a process of acquiring a control event corresponding to the video stream and sending event information of the control event to the controlled device in the inter-device control method according to the present application;
fig. 7 is a schematic flowchart of a process of acquiring a control event corresponding to the video stream and sending event information of the control event to the controlled device in the inter-device control method according to the present application;
fig. 8 is a schematic flowchart of the inter-device control method according to the present application after the step of receiving the event information sent by the master device.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The main solution of the embodiment of the application is as follows: receiving a video stream sent by controlled equipment; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment.
Because the traditional video conference terminal equipment is usually operated in a remote control mode, the problems of inconvenient operation and poor application software adaptation are often caused. The method comprises the steps of receiving a video stream sent by controlled equipment; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding the control operation corresponding to the event information by the controlled equipment. The technical problem of poor operability of traditional video terminal equipment is solved, independent equipment with a touch screen is additionally arranged for the traditional video terminal equipment, the video terminal equipment is indirectly controlled based on the independent equipment, and the effect of facilitating control operation of the equipment is achieved.
As shown in fig. 1, fig. 1 is a schematic terminal structure diagram of a hardware operating environment according to an embodiment of the present application.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the terminal may further include a camera, a Radio Frequency (RF) circuit, a sensor, a remote controller, an audio circuit, a WiFi module, a detector, and the like. Of course, the terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer and a temperature sensor, which are not described herein again.
Those skilled in the art will appreciate that the terminal structure shown in fig. 1 does not constitute a limitation of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer-readable storage medium, may include therein an operating system, a network communication module, a user interface module, and an inter-device control program.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a backend server and performing data communication with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to invoke the inter-device control program in the memory 1005 and perform the following operations:
receiving a video stream sent by controlled equipment;
and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment.
Referring to fig. 2, fig. 2 is a schematic flowchart of a first embodiment of the inter-device control method according to the present application.
While the logic sequence is shown in the flow chart, in some cases, the steps shown or described may be performed in a different order than that shown or described.
The inter-device control method comprises the following steps:
step S10, receiving a video stream sent by a controlled device;
the application is provided with two devices, one is a master control device, the master control device can be a common mobile terminal, such as a mobile phone or a tablet computer, and the like, and is provided with a touch screen, and the running system can be an android system or an IOS system. The other is controlled equipment which can be a traditional video conference terminal, such as a video conference large screen, a television and the like, has the capability of video recording and video output, and can operate in an android system or an IOS system. Wherein, two equipment are connected through the USB line, or through setting up the wireless hot point connection in the environment between. Taking USB cable connection as an example, the physical layer is a USB data cable, and network port mapping is performed on the basis of the USB data cable through an ADB (android debug bridge), so that network communication can be performed between the two ends. Wherein, TCP is used as a transmission protocol during communication, and the top-layer software has no perception on the transmission principle of the bottom layer and is the same as the common network communication application. Using a TCP protocol to distinguish a server and a client, wherein control equipment is used as the server to monitor a port; and initiating connection to a target port by using the controlled equipment as a client. To cope with unexpected connection interruptions, the server needs to listen to the port continuously after disconnection in order to reconnect after the client recovers. It should be noted that the ADB is used as a tool for port mapping only for convenience of development and description, and other ways for mapping network ports may be used.
After the master control device establishes communication connection with the controlled device, the controlled device collects the current video stream and sends the collected video stream to the master control device through a USB (universal serial bus) line or a wireless local area network.
Step S20, acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled device, and the controlled device responding to a control operation corresponding to the event information.
The method comprises the steps that after receiving a video stream sent by controlled equipment, the main control equipment decodes the video stream to obtain video data and renders the video data stream on a screen, specifically, the video data is sent to a rendering unit, the rendering unit performs rendering operation on the video data according to rendering parameters such as coloring parameters, layout parameters and special effect adding parameters to obtain a rendered video image, and furthermore, multithreading can be established for performing the rendering operation to guarantee the smoothness of video rendering.
When a user watches a video, a control operation instruction can be sent to the controlled device by clicking the touch screen of the main control device, specifically, the main control device detects the touch operation of the user in real time, and the touch operation refers to the operation generated by the user touching the touch screen and includes the error touch operation and the normal touch operation of the user. In an embodiment, the main control device may detect whether a user performs a touch operation on the touch screen through the pressure sensor, and when the touch operation of the user on the touch screen is detected, obtain touch parameters, such as a coordinate parameter, a pressure parameter, an area parameter, a shape parameter, and the like, and determine a touch instruction according to the touch parameters, for example: respectively comparing the currently acquired area, shape and position with the prestored effective touch area, shape and position, and acquiring a touch instruction associated with the range if the acquired area, shape and position are within the prestored range of the effective touch area, shape and position; if not, the touch operation is ignored. And further acquiring a control event corresponding to the touch instruction, such as a volume adjustment event, a brightness adjustment event and the like, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment. For example: if the current control event is a volume adjustment event, the volume is adjusted from 30% to 60% at present, the master control device sends the volume value of 60% to the controlled device, and the controlled device automatically adjusts the volume of the current video playing by 60% after receiving the volume value.
Further, referring to fig. 5, before the step of acquiring the control event corresponding to the video stream, the method further includes:
step S21, setting a screen based on the event type of the control event;
step S22, if the event type is a touch event, setting a touch area on the screen; alternatively, the first and second electrodes may be,
step S23, if the event type is a key event, setting a virtual key on the screen.
The main control device performs different settings on the screen based on different event types of the control event, and when the event type is a touch event, a touch area is set on the screen, wherein the touch area can be the whole area or a part of area of the touch screen of the main control device, and when a user slides or clicks in the touch area, a corresponding touch event can be generated. In one embodiment, a user may set a plurality of touch areas on the screen of the master device, each touch area being set with a different touch icon, each touch icon representing a different touch function, for example: icon a may adjust the volume of the video, icon B may adjust the brightness of the video, icon C may adjust the respective rates of the videos, and so on. Further, a touch gesture can be set, and different touch instructions can be generated based on different touch gestures, for example, double-clicking the touch area to indicate "confirm", single-clicking the touch area to indicate "pause", and the like.
And when the event type is a key event, virtual keys are arranged on the screen, wherein the virtual keys can be a return key, a confirm key, a task key and the like, and the touch type of the virtual keys can be sliding touch or clicking touch. In one embodiment, the virtual keys may be provided in the form of a virtual keyboard in which a plurality of virtual keys are provided, each virtual key representing a different function, or each combination key representing a different function, for example: "Esc key" means cancel or exit, "F11 key" means full screen display, "Fn + F5" means dim screen, "Fn + F11" means loud tone, and so on. Wherein, each key marks the function of the key by characters, letters, numbers or special symbols, for example, the key 'volume +' indicates that the current video volume is increased.
Further, referring to fig. 6, the step of acquiring a control event corresponding to the video stream and sending event information of the control event to the controlled device includes:
step S24, acquiring a touch event corresponding to the video stream, where the touch event is generated when a user touches the touch area;
and step S25, sending the touch parameters of the touch event to the controlled device.
When a touch event corresponding to the video stream acquired by the main control device occurs, sending the touch parameter of the touch event to the controlled device, where the touch event is generated by a user touching the touch area, and the touch parameter may be a sliding direction parameter, a sliding distance parameter, a sliding track parameter, a pressure parameter, and the like.
Further, referring to fig. 7, the step of acquiring the control event corresponding to the video stream and sending the event information of the control event to the controlled device further includes:
step S26, acquiring a key event corresponding to the video stream, wherein the key event is generated by clicking the virtual key by a user;
and step S27, sending the key value of the key event to the controlled device.
When the main control device acquires a key event corresponding to the video stream, sending a key value of the key event to the controlled device, where the key event is generated by a user clicking the virtual key, and the key value may be an ASCII code corresponding to the virtual key, for example, a key value of an "Esc key" is "0 x 1B", a key value of a "delete key" is "0 x 2E", and the like.
The embodiment receives a video stream sent by a controlled device; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding the control operation corresponding to the event information by the controlled equipment. The technical problem of poor operability of traditional video terminal equipment is solved, independent equipment with a touch screen is additionally arranged for the traditional video terminal equipment, the video terminal equipment is indirectly controlled based on the independent equipment, and the effect of facilitating control operation of the equipment is achieved.
Further, referring to fig. 3, a second embodiment of the inter-device control method of the present application is proposed.
The difference between the second embodiment of the inter-device control method and the first embodiment of the inter-device control method is that, if the event type is a touch event, after the step of setting a touch area on the screen, the method further includes:
step S220, if the resolutions of the touch screen and the display screen of the controlled device are not consistent, coordinate data generated when a user touches the touch screen is obtained;
step S221, coordinate conversion is carried out based on the coordinate data, and converted display coordinate data are obtained.
In the prior art of the video conference terminal, resolution required by a display screen of the video conference terminal and a touch screen needs to be consistent, that is, when a user performs touch operation on the touch screen, a touch coordinate of the video conference terminal is consistent with a display coordinate, that is, a touch coordinate of a main control device is consistent with a display coordinate of a controlled device.
When the respective rates of the touch screen of the master control device and the display screen of the controlled device are not consistent, the touch screen of the master control device and the display screen of the controlled device are equivalent to have respective coordinate systems, for example, the coordinate systems are (X, Y) and (X, Y), respectively; and acquiring coordinate data generated when a user touches the touch screen of the main control equipment, and performing coordinate conversion based on the coordinate data to obtain converted display coordinate data. Specifically, the main control device detects a touch operation of a user on the touch screen, acquires touch point coordinate data touched by the user on the touch screen through a touch data signal transmitting end of the touch screen, further acquires resolution of the touch screen and resolution of the display screen, and sends the acquired touch point coordinate data and resolution to the coordinate conversion module. And the coordinate conversion module performs coordinate conversion according to the coordinate data of the touch point, the resolution of the touch screen and the resolution of the display screen to obtain display coordinate data, sends the display coordinate data to the controlled equipment, and the controlled equipment displays the display coordinate data. The coordinate conversion module performs coordinate conversion operation according to a preset coordinate conversion formula.
In this embodiment, the coordinate data of the touch point, the resolution of the touch screen, and the resolution of the display screen are obtained, and coordinate conversion is performed based on the obtained data, so that the consistency of the resolution of the touch screen of the master control device and the display screen of the controlled device is ensured.
Further, referring to fig. 4, a third embodiment of the inter-device control method of the present application is proposed.
The third embodiment of the inter-device control method differs from the first and second embodiments of the inter-device control method in that the inter-device control method is for a controlled device, the method including:
step S30, acquiring a current video stream, and sending the video stream to the main control equipment;
step S40, receiving the event information sent by the master control device, and responding to a control operation corresponding to the event information.
The controlled device sends the video stream to the main control device by acquiring the current video stream, further receives event information sent by the main control device, and responds to the control operation corresponding to the event information. Specifically, the controlled device can establish a virtual Display, namely a virtual Display, by adopting a screen recording interface of the android system; the method includes the steps that a video picture is obtained based on the display, the obtained video picture is coded to obtain a coded video stream, such as an H.264 format, and the coded video stream is sent to a main control device through a socket, wherein the socket contains ip and port numbers of a sender and a receiver, so that the controlled device can send the video stream to the corresponding main control device. When the controlled device receives the event information sent by the main control device, the controlled device analyzes the event information to obtain corresponding setting parameters, and responds to the setting parameters, for example, if the event information sent by the main control device is a touch parameter, and if the display brightness is 85%, the display brightness corresponding to the display screen of the controlled device is adjusted to 85%; or the event information sent by the master device is a key value, such as 0x1B (Esc key), and the controlled device exits the current video display.
And after the controlled equipment responds the control operation corresponding to the event information, the controlled equipment sends response information to the main control equipment, the main control equipment judges whether the current event information is successfully responded or not based on the response information, and if the response is failed, the event information is sent to the controlled equipment again.
Further, referring to fig. 8, after the step of receiving the event information sent by the master device, the method further includes:
step S41, initializing the input device;
and step S42, writing the event information into the corresponding input device.
After receiving the event information, the controlled device can inject the event information into the system through a virtual touch screen and a keyboard, specifically, an input device is newly built on the android system, the corresponding device is initialized to be the touch screen and the keyboard, the received event is a standard android event, and the event information comprises coordinates, pressure, an event type and the like. And further writing the event information into the corresponding equipment node, and reporting the event information to the android system by the driver, thereby realizing the event writing of the controlled end.
The embodiment acquires a current video stream and sends the video stream to the main control equipment; and receiving the event information sent by the main control equipment, and responding to the control operation corresponding to the event information. The controlled device responds to the control operation of the main control device, so that the traditional video conference terminal is easy to control.
The present application further provides an inter-device control apparatus, which in an embodiment includes a memory, a processor, and an inter-device control program stored on the memory and executable on the processor, and when executed by the processor, the inter-device control program implements the following steps:
receiving a video stream sent by controlled equipment;
and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment.
In one embodiment, the inter-device control apparatus includes a receiving module and an obtaining module.
The receiving module is used for receiving a video stream sent by the controlled device;
the acquisition module is configured to acquire a control event corresponding to the video stream, send event information of the control event to the controlled device, and the controlled device responds to a control operation corresponding to the event information.
Further, the acquisition module comprises a setting unit;
the setting unit is used for carrying out screen setting based on the event type of the control event;
the setting unit is further configured to set a touch area on the screen if the event type is a touch event; alternatively, the first and second electrodes may be,
the setting unit is further configured to set a virtual key on the screen if the event type is a key event.
Further, the acquiring module further comprises an acquiring unit and a sending unit;
the acquiring unit is used for acquiring a touch event corresponding to the video stream, wherein the touch event is generated by a user touching the touch area;
and the sending unit is used for sending the touch parameters of the touch events to the controlled equipment.
Further, the obtaining unit is further configured to obtain a key event corresponding to the video stream, where the key event is generated by a user clicking the virtual key;
the sending unit is further configured to send the key value of the key event to the controlled device.
Further, the setting unit comprises a judging subunit and a converting subunit;
the judging subunit is configured to, if the resolutions of the touch screen and the display screen of the controlled device are not the same, obtain coordinate data generated when a user touches the touch screen;
the conversion subunit is used for carrying out coordinate conversion based on the coordinate data to obtain converted display coordinate data
Further, the obtaining module is further configured to obtain a current video stream, and send the video stream to the main control device;
the receiving module is further configured to receive the event information sent by the master control device, and respond to a control operation corresponding to the event information.
Furthermore, the acquisition module further comprises an acquisition unit and a coding unit;
the acquisition unit is used for acquiring video data;
and the encoding unit is used for encoding the video data to obtain the video stream.
Further, the receiving module comprises an initialization unit and an input unit;
the initialization unit is used for initializing the input equipment;
the input unit is used for writing the event information into the corresponding input equipment.
The implementation of the functions of each module of the inter-device control apparatus is similar to the process in the above method embodiment, and is not described in detail here.
In addition, the application also provides a terminal, the terminal comprises a memory, a processor and an inter-device control program which is stored on the memory and runs on the processor, and the terminal receives the video stream sent by the controlled device; and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding the control operation corresponding to the event information by the controlled equipment. The technical problem of poor operability of traditional video terminal equipment is solved, independent equipment with a touch screen is additionally arranged for the traditional video terminal equipment, the video terminal equipment is indirectly controlled based on the independent equipment, and the effect of facilitating control operation of the equipment is achieved.
Furthermore, the present application provides a computer-readable storage medium having stored thereon an inter-device control program, which when executed by a processor implements the steps of the inter-device control method as described above.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should be noted that in the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The application can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
While alternative embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following appended claims be interpreted as including alternative embodiments and all such alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. An inter-device control method, used for a master device, the method comprising:
receiving a video stream sent by controlled equipment;
and acquiring a control event corresponding to the video stream, sending event information of the control event to the controlled equipment, and responding to a control operation corresponding to the event information by the controlled equipment.
2. The inter-device control method according to claim 1, wherein the step of obtaining the control event corresponding to the video stream is preceded by:
performing screen setting based on the event type of the control event;
if the event type is a touch event, setting a touch area on the screen; alternatively, the first and second electrodes may be,
and if the event type is a key event, setting a virtual key on the screen.
3. The inter-device control method according to claim 1, wherein the step of acquiring the control event corresponding to the video stream and sending event information of the control event to the controlled device includes:
acquiring a touch event corresponding to the video stream, wherein the touch event is generated by a user touching the touch area;
and sending the touch parameters of the touch event to the controlled equipment.
4. The method according to claim 1, wherein the step of acquiring the control event corresponding to the video stream and sending event information of the control event to the controlled device further comprises:
acquiring a key event corresponding to the video stream, wherein the key event is generated by clicking the virtual key by a user;
and sending the key value of the key event to the controlled equipment.
5. The inter-device control method according to claim 2, wherein after the step of setting a touch area on the screen if the event type is a touch event, the method further comprises:
if the resolutions of the touch screen and the display screen of the controlled device are not consistent, acquiring coordinate data generated when a user touches the touch screen;
and carrying out coordinate conversion based on the coordinate data to obtain converted display coordinate data.
6. An inter-device control method for a controlled device, the method comprising:
acquiring a current video stream, and sending the video stream to the main control equipment;
and receiving the event information sent by the master control equipment, and responding to the control operation corresponding to the event information.
7. The inter-device control method according to claim 6, wherein the step of acquiring the current video stream comprises:
collecting video data;
and encoding the video data to obtain the video stream.
8. The method according to claim 6, wherein after the step of receiving the event information sent by the master device, the method further comprises:
initializing an input device;
and writing the event information into the corresponding input equipment.
9. A terminal, characterized in that the terminal comprises a memory, a processor and an inter-device control program stored on the memory and running on the processor, the processor implementing the steps of the method according to any one of claims 1 to 8 when executing the inter-device control program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon an inter-device control program which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011470015.6A CN112714272A (en) | 2020-12-14 | 2020-12-14 | Inter-device control method, terminal, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011470015.6A CN112714272A (en) | 2020-12-14 | 2020-12-14 | Inter-device control method, terminal, and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112714272A true CN112714272A (en) | 2021-04-27 |
Family
ID=75542021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011470015.6A Pending CN112714272A (en) | 2020-12-14 | 2020-12-14 | Inter-device control method, terminal, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112714272A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113411634A (en) * | 2021-05-08 | 2021-09-17 | 青岛海尔科技有限公司 | Video stream operation method and device, storage medium and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060103508A1 (en) * | 2004-11-18 | 2006-05-18 | Canon Kabushiki Kaisha | Remote-control system, remote-control apparatus, apparatus to be controlled, remote-control method, computer program, and storage medium |
| CN203120046U (en) * | 2013-03-08 | 2013-08-07 | 成都飞视美视频技术有限公司 | Visualization control system based on video conference terminal |
| CN103440099A (en) * | 2013-08-14 | 2013-12-11 | 深圳市同洲电子股份有限公司 | Multi-screen interactive method, terminal and system |
| US20170230510A1 (en) * | 2014-08-04 | 2017-08-10 | Huawei Technologies Co., Ltd. | Terminal, server, and terminal control method |
| CN108055704A (en) * | 2017-12-22 | 2018-05-18 | 广州视源电子科技股份有限公司 | interaction control method, system, terminal and storage medium |
| CN108459836A (en) * | 2018-01-19 | 2018-08-28 | 广州视源电子科技股份有限公司 | Annotate display methods, device, equipment and storage medium |
-
2020
- 2020-12-14 CN CN202011470015.6A patent/CN112714272A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060103508A1 (en) * | 2004-11-18 | 2006-05-18 | Canon Kabushiki Kaisha | Remote-control system, remote-control apparatus, apparatus to be controlled, remote-control method, computer program, and storage medium |
| CN203120046U (en) * | 2013-03-08 | 2013-08-07 | 成都飞视美视频技术有限公司 | Visualization control system based on video conference terminal |
| CN103440099A (en) * | 2013-08-14 | 2013-12-11 | 深圳市同洲电子股份有限公司 | Multi-screen interactive method, terminal and system |
| US20170230510A1 (en) * | 2014-08-04 | 2017-08-10 | Huawei Technologies Co., Ltd. | Terminal, server, and terminal control method |
| CN108055704A (en) * | 2017-12-22 | 2018-05-18 | 广州视源电子科技股份有限公司 | interaction control method, system, terminal and storage medium |
| CN108459836A (en) * | 2018-01-19 | 2018-08-28 | 广州视源电子科技股份有限公司 | Annotate display methods, device, equipment and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113411634A (en) * | 2021-05-08 | 2021-09-17 | 青岛海尔科技有限公司 | Video stream operation method and device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9913301B2 (en) | Content sharing method and device | |
| US20120146884A1 (en) | Control transfer apparatus, control transfer system and method thereof | |
| WO2022062623A1 (en) | Remote control method and apparatus, and device, and storage medium, and system | |
| CN104618793B (en) | A kind of information processing method and electronic equipment | |
| EP3163972B1 (en) | Terminal, server, and terminal control method | |
| CN107071551B (en) | Multi-screen interactive screen response method applied to smart television system | |
| CN105808181B (en) | Image mediating device, interactive display system and its operating method | |
| CN111629239B (en) | Screen projection processing method, device, equipment and computer readable storage medium | |
| US20140340344A1 (en) | Display processor and display processing method | |
| WO2014077411A1 (en) | Transmission system and program | |
| US20190051147A1 (en) | Remote control method, apparatus, terminal device, and computer readable storage medium | |
| CN106325789B (en) | Information processing method, terminal and system | |
| WO2014036974A1 (en) | Terminal device, and method and system for display in one screen | |
| TW201723762A (en) | Splicing touch screen apparatus and touch detection method for touch screens thereof | |
| CN114281288A (en) | Screen projection processing method and device and electronic equipment | |
| JP6540367B2 (en) | Display control apparatus, communication terminal, communication system, display control method, and program | |
| CN107038024B (en) | Operation configuration method and equipment thereof | |
| CN112714272A (en) | Inter-device control method, terminal, and computer-readable storage medium | |
| US20140104183A1 (en) | Method and device for controlling at least one apparatus by at least one other apparatus, system implementing such a device | |
| CN114025227A (en) | Electronic equipment and control method | |
| CN113038251B (en) | Control method and control device | |
| CN103473170A (en) | Test system and test method | |
| JP2014146228A (en) | Terminal device, external display device, and information system comprising terminal device and external display device | |
| CN110162284B (en) | Control interface device and control system thereof | |
| CN112491973A (en) | Equipment control method and device and nonvolatile storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |