CN117201721A

CN117201721A - Control method and device of terminal equipment, electronic equipment and storage medium

Info

Publication number: CN117201721A
Application number: CN202311119459.9A
Authority: CN
Inventors: 朱帅; 潘廷勇; 杨文静; 段文玲
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2023-08-31
Filing date: 2023-08-31
Publication date: 2023-12-08

Abstract

The embodiment of the invention provides a control method, a device, electronic equipment and a storage medium of terminal equipment, which are applied to the technical field of data transmission, wherein the method is applied to first terminal equipment, and the first terminal equipment performs multimedia data transmission with at least one second terminal equipment through a multimedia interface, and the method comprises the following steps: receiving a control signal for controlling the second terminal device; generating a target signaling message adapted to the multimedia interface according to the control signal, and selecting a target terminal device matched with the control signal from the at least one second terminal device; and sending the target signaling message to the target terminal equipment through the multimedia interface, wherein the target signaling message is used for indicating the target terminal equipment to execute the operation corresponding to the control signal.

Description

Control method and device of terminal equipment, electronic equipment and storage medium

Technical Field

The present invention relates to the field of data transmission technologies, and in particular, to a method for controlling a terminal device, a device for controlling a terminal device, an electronic device, and a computer readable storage medium.

Background

With the development of network technology, video conferencing is increasingly used. In video conferencing, the communication architecture between devices is also diversified to adapt to different conference scenarios. For example, in some video scenes, when a video conference is performed using terminal devices, the terminal devices are disposed in other spaces outside the conference room, and because of physical isolation in the spaces, users cannot effectively control the terminal devices disposed outside the conference room, which is easy to affect the conference process. If the terminal equipment in different spaces is controlled, corresponding hardware equipment needs to be additionally added, so that on one hand, additional cost needs to be increased, and on the other hand, certain requirements are met for the current hardware equipment, and the universality is poor.

Disclosure of Invention

The embodiment of the invention provides a control method and device of terminal equipment, electronic equipment and a computer readable storage medium, which are used for solving or partially solving the problems that the terminal equipment cannot be controlled in different places and the equipment is controlled with high cost and poor universality in the video conference process.

The embodiment of the invention discloses a control method of terminal equipment, which is applied to first terminal equipment, wherein the first terminal equipment performs multimedia data transmission with at least one second terminal equipment through a multimedia interface, and the method comprises the following steps:

Receiving a control signal for controlling the second terminal device;

generating a target signaling message adapted to the multimedia interface according to the control signal, and selecting a target terminal device matched with the control signal from the at least one second terminal device;

and sending the target signaling message to the target terminal equipment through the multimedia interface, wherein the target signaling message is used for indicating the target terminal equipment to execute the operation corresponding to the control signal.

Optionally, the generating, according to the control signal, a target signaling packet adapted to the multimedia interface includes:

acquiring an initial signaling message communicated with the second terminal equipment through the multimedia interface;

writing the control signal into a reserved field in the initial signaling message to obtain a target signaling message containing the control signal.

Optionally, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the first terminal device includes a processor and an HDMI transmitting module corresponding to the HDMI interface, writing the control signal into a reserved field in the initial signaling message, and obtaining a target signaling message including the control signal, where the target signaling message includes:

Writing the control signal into a register corresponding to a reserved field in the initial signaling message by the processor to obtain a target signaling message containing the control signal;

wherein the sending the target signaling message to the target terminal device through the multimedia interface includes:

and sending the target signaling message to the target terminal equipment based on the HDMI through the HDMI sending module.

Optionally, the selecting, from the at least one second terminal device, a target terminal device that matches the control signal includes:

acquiring a first identification code corresponding to the control signal and a second identification code of each second terminal device, and comparing the first identification code with the second identification code;

and taking the second terminal equipment which belongs to the second identification code which is the same as the first identification code as target terminal equipment corresponding to the control signal.

The embodiment of the invention also discloses a control method of the terminal equipment, which is applied to the second terminal equipment, and comprises the following steps:

receiving a target signaling message through a multimedia interface, wherein the target signaling message comprises a control signal corresponding to the second terminal equipment, and the target signaling message is a signaling message which is generated by the first terminal equipment according to the control signal and is adapted to the multimedia interface;

And executing an operation corresponding to the control signal.

Optionally, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the second terminal device at least includes a processor and an HDMI receiving module communicatively connected to the processor through an IIC bus, the HDMI receiving module includes a register, and the receiving of the target signaling packet through the multimedia interface includes:

receiving, by the HDMI receiving module, a target signaling packet sent by the first terminal device based on the HDMI interface;

and reading a reserved field of the target signaling message stored in the register by the processor to obtain the infrared signal.

The embodiment of the invention also discloses a control device of the terminal equipment, which is applied to the first terminal equipment, wherein the first terminal equipment performs multimedia data transmission with at least one second terminal equipment through a multimedia interface, and the device comprises:

a signal receiving module, configured to receive a control signal for controlling the second terminal device;

the instruction conversion module is used for generating a target signaling message adapted to the multimedia interface according to the control signal and selecting target terminal equipment matched with the control signal from the at least one second terminal equipment;

The instruction sending module is used for sending the target signaling message to the target terminal equipment through the multimedia interface, wherein the target signaling message is used for indicating the target terminal equipment to execute the operation corresponding to the control signal.

Optionally, the instruction conversion module is specifically configured to:

Optionally, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the first terminal device includes a processor and an HDMI transmitting module corresponding to the HDMI interface, and the instruction converting module is specifically configured to:

the instruction sending module is specifically configured to:

transmitting the target signaling message to the target terminal equipment based on the HDMI through the HDMI transmitting module

Optionally, the instruction conversion module is specifically configured to:

Optionally, the first terminal device at least includes one of an image acquisition device, an image display device, and an audio device.

The embodiment of the invention also discloses a control device of the terminal equipment, which is applied to the second terminal equipment, and comprises the following steps:

the signaling message receiving module is used for receiving a target signaling message through a multimedia interface, wherein the target signaling message comprises a control signal corresponding to the second terminal equipment, and the target signaling message is a signaling message which is generated by the first terminal equipment according to the control signal and is adaptive to the multimedia interface;

and the signal response module is used for executing the operation corresponding to the control signal.

Optionally, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the second terminal device at least includes a processor and an HDMI receiving module communicatively connected to the processor through an IIC bus, the HDMI receiving module includes a register, and the signaling message receiving module is specifically configured to:

The embodiment of the invention also discloses electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

the memory is used for storing a computer program;

the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.

Embodiments of the present invention also disclose a computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method according to the embodiments of the present invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, in the video conference process, the first terminal equipment and at least one second terminal equipment are deployed in different physical spaces, and multimedia data transmission can be performed between the first terminal equipment and each second terminal equipment through a multimedia interface, wherein a participant user is in the first space where the first terminal equipment is located, the second terminal equipment is located in the second space, when the participant user in the first space needs to control the second terminal equipment, the first terminal equipment receives a control signal special for controlling the second terminal equipment, generates a target signaling message matched with the control signal according to the control signal, selects a target terminal equipment matched with the control signal from each second terminal equipment, and then transmits the target signaling message to the target terminal equipment through the multimedia interface, and the target signaling message is used for indicating the target terminal equipment to execute an operation corresponding to the control signal.

Drawings

Fig. 1 is a step flowchart of a control method of a terminal device provided in an embodiment of the present invention;

FIG. 2 is a diagram of an apparatus architecture provided in an embodiment of the present invention;

fig. 3 is a schematic diagram of an application scenario provided in an embodiment of the present invention;

FIG. 4 is a schematic diagram of yet another application scenario provided in an embodiment of the present invention;

FIG. 5 is a schematic diagram of yet another application scenario provided in an embodiment of the present invention;

fig. 6 is a block diagram of a control apparatus of a terminal device according to an embodiment of the present invention;

fig. 7 is a block diagram of a control apparatus of a terminal device according to an embodiment of the present invention;

fig. 8 is a block diagram of an electronic device provided in an embodiment of the invention.

Detailed Description

In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.

In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the following explains some technical features related to the embodiments of the present invention:

HDMI: a high definition multimedia interface (High Definition Multimedia Interface).

DDC: display data channel, (Display Data Channel) is used for data exchange between Source (sender) and Sink (receiver) in HDMI protocol, and is based on a set of communication mechanism of I2C standard.

Infrared code value: an infrared signal emitted when the infrared remote controller presses a key.

Infrared user code: and part of the infrared code value is used for distinguishing different remote controllers, when a button on the remote controller is pressed, the remote controller can send an infrared signal, and after receiving the signal, the infrared receiving equipment can judge whether the signal is the infrared signal sent by the remote controller matched with the remote controller according to the user code.

Infrared key value code: and part of the infrared code value corresponds to different keys on the remote controller.

As an example, in some conference scenarios, terminal devices for performing video conferences are deployed in other physical spaces, but not in the physical space in which the participating users are located, and when the terminal devices need to be controlled in the conference, the participating users cannot effectively control the terminal devices due to physical barriers between the control devices and the terminal devices, so that the conference process is easily affected. If, in order to control the terminal device in different spaces, a corresponding hardware device needs to be added or the terminal device needs to be modified, the remote control of the device is limited by the hardware device, the control mode is poor in universality, for example, limited by a space distance, an additional transmission cable needs to be added to improve the data transmission distance of the terminal device, or if the CEC (Consumer Electronics Control) function is not supported, the terminal device needs to be modified to support the CEC function, so that no hardware device is added or the terminal device needs to be modified, and additional cost is required to be increased.

In the invention, the remote control of the terminal equipment is realized based on the existing hardware basis, so that not only is the cost of the video conference reduced without adding additional hardware equipment, but also the terminal equipment for controlling another space can be realized by the participating user in the current space, the convenience of equipment control in the video conference process is improved, and the orderly progress of the video conference is ensured.

Referring to fig. 1, a step flow chart of a control method of a terminal device provided in an embodiment of the present invention is applied to a first terminal device, where the first terminal device performs multimedia data transmission with at least one second terminal device through a multimedia interface, and specifically may include the following steps:

step 101, receiving a control signal for controlling the second terminal device;

as a possible example, referring to fig. 2, an apparatus architecture diagram provided in an embodiment of the present invention is shown, where a control apparatus and a first terminal apparatus are located in a first space, and a second terminal apparatus is located in a second space, where the first space and the second space are two physical spaces that are independent of each other. The first terminal device and the second terminal device may be in communication connection through a multimedia interface, for example, the multimedia interface may be an HDMI interface, and the multimedia data transmission between the first terminal device and the second terminal device is implemented by connecting corresponding HDMI cables to the corresponding HDMI interfaces between the first terminal device and the second terminal device. In addition, in one case, a plurality of first terminal devices can be deployed in the first space, and a second terminal device can be deployed in the second space, where each first terminal device can receive a corresponding control signal to control the second terminal device; in another case, a first terminal device may be disposed in the first space, and a plurality of second terminal devices may be disposed in the second space, where the first terminal device may control the second terminal devices according to a mapping relationship between the control signal and the second terminal devices; in another case, a plurality of first terminal devices may be disposed in the first space, a plurality of second terminal devices may be disposed in the second space, and the first terminal devices may control the second terminal devices according to a mapping relationship between the control signals and the second terminal devices, etc., which is not limited in the present invention.

Alternatively, the control device may include a device capable of controlling the first terminal device and/or the second terminal device, and it should be noted that, in the present invention, the control device refers to a control device specifically controlling the second terminal device, for example, a remote controller having an infrared function, or the like; the first terminal device may include one of an image capturing device, an image display device, and an audio device, the image capturing device may be a camera, the image display device may be a display, a display screen, a projector, and the audio device may include a sound, a microphone, and the like; the second terminal device may be a device supporting video conference, such as a television, a computer, a notebook computer, or the like, which is not limited in the present invention.

In addition, in some scenarios, the user may further directly input a corresponding control signal on the first terminal device, so that the control signal is transmitted to the second terminal device through the first terminal device, so as to realize control over the second terminal device.

In a specific implementation, a user may input a corresponding operation on the control device, the control device determines a control signal corresponding to the control operation in response to the control operation input by the user, and then sends the control signal to the first terminal device, so that the first terminal device performs subsequent data processing on the control signal. Different control devices can correspond to different identification codes (such as infrared user codes, etc.), and the control devices establish corresponding mapping relations between the identification codes and the first terminal device and the second terminal device, so that a user can control the first terminal device and the second terminal device through the control devices.

Optionally, the control device is assumed to be a remote controller, and the remote controller includes a plurality of different physical keys, where the different physical keys correspond to different control functions, such as increasing volume, decreasing volume, closing display, setting a system, returning a menu, opening a menu, rotating control, controlling a focal length, switching a resolution, and so on.

Step 102, generating a target signaling message adapted to the multimedia interface according to the control signal, and selecting a target terminal device matched with the control signal from the at least one second terminal device;

the multimedia interface can be used for transmitting multimedia data between the first terminal equipment and the second terminal equipment, and the control signal sent by the control equipment can be written into a signaling message of data transmission between the first terminal equipment and the second terminal equipment so as to transmit the target signaling message to the second terminal equipment while transmitting the multimedia data, thereby realizing the remote transmission of the target signaling message based on the existing hardware equipment and further realizing the remote control of the second terminal equipment.

For the control signal sent by the control device, the control signal carries a corresponding target identification code, the identification code is used for representing the identity of the control device, and different second terminal devices can respectively establish corresponding mapping relations with different control devices, for example, a control relation is established between the remote controller (1) and the second terminal device A, a control relation is established between the remote controller (2) and the second terminal device B, and the like, when the first terminal device receives the control signal, the first identification code corresponding to the control signal and the second identification code of each second terminal device can be obtained, the first identification code and the second identification code are compared, and then the second terminal device which belongs to the second identification code which is identical to the first identification code is used as the target terminal device which corresponds to the control signal, so that the target terminal device executes corresponding operation.

In some possible embodiments, the control signal sent by the control device may be an infrared signal, the multimedia interface is an HDMI interface, and the first terminal device includes a processor, an HDMI sending module corresponding to the HDMI interface, and a register corresponding to the HDMI sending module, so that the first terminal device may write the control signal into the register corresponding to the reserved field in the initial signaling message through the processor, obtain a target signaling message containing the control signal, and send the target signaling message to the target terminal device through the HDMI sending module based on the HDMI interface, so as to send the target signaling message to the second terminal device, thereby writing the corresponding control signal into the signaling message transmitted between the first terminal device and the second terminal device through the processor, the HDMI sending module, and the HDMI interface, so that the first terminal device may transmit multimedia data to the second terminal device, and write the control signal into the corresponding reserved field to the second terminal device, thereby realizing the remote control of the second terminal device, not only needing no additional hardware device, but also ensuring that the current conference space of the user device can be controlled in a conference. Optionally, a corresponding register may be configured in the HDMI transmitting module, for storing the signaling packet.

For the HDMI protocol, in addition to transmitting multimedia data, a signaling message, a line-field synchronization signal, etc., the first terminal device may transmit a control signal (such as infrared information, etc.) sent by the control device by using the HDMI reserved field to implement remote control on the second terminal device by adding a corresponding reserved field in the signaling message, for example, the first terminal device may transmit an avinfoframe audio/video auxiliary signaling to the second terminal device, and may add a target signaling message for performing system setting on the second terminal device, etc. in the signaling.

Step 103, sending the target signaling message to the target terminal device through the multimedia interface, where the target signaling message is used to instruct the target terminal device to execute an operation corresponding to the control signal.

In the embodiment of the invention, for the target signaling message used for controlling the second terminal equipment, the first terminal equipment can send the target signaling message to the second terminal equipment through the multimedia interface, and after the second terminal equipment receives the target signaling message, the second terminal equipment extracts the control signal from the target signaling message and executes the operation corresponding to the control signal, thereby realizing the 'off-site' control of the terminal equipment on the basis of the existing multimedia interfaces of the first terminal equipment and the second terminal equipment, not only needing to add additional hardware equipment, reducing the cost of the video conference, but also realizing the control of the terminal equipment in another space by a participating user in the current space, improving the convenience of equipment control in the video conference process and ensuring the orderly progress of the video conference.

In a specific implementation, based on an HDMI protocol, a first terminal device establishes a corresponding display data channel between the first terminal device and a second terminal device through an HDMI interface, and then the first terminal device may send, to the second terminal device, a target signaling message sent by an HDMI sending module through the display data channel. Optionally, when the control signal is an infrared signal, the target signaling packet may include an infrared code value, an infrared user code, an infrared key value code, and the like, and after receiving the target signaling packet, the second terminal device may perform corresponding parsing to execute a corresponding operation.

Specifically, for the second terminal device, the second terminal device may include an HDMI receiving module and a processor, where the processor and the HDMI receiving module may be communicatively connected through an IIC (Inter-Integrated Circuit, serial communication protocol) bus, where the HDMI receiving module is configured with a corresponding register, and is configured to store a signaling packet received from the first terminal device, where the processor of the second terminal device may utilize the IIC bus connected to the HDMI receiving module to read a reserved field in a target signaling packet stored in the register of the HDMI receiving module, parse and process the read information, obtain a corresponding infrared code value, an infrared user code, and an infrared key code, and send the infrared user code and the infrared key code to the infrared processing program, and the infrared processing program executes a corresponding operation according to the infrared key code, so that "off-site" control of the terminal device is implemented, no additional hardware device is required to be added, cost of the video conference is reduced, and a user can be located in a current space to implement terminal device controlling another space, thereby improving control of the video conference device, and ensuring convenience in the conference.

In addition, for the second terminal device, the infrared signal received by the self infrared receiving module can be directly received by the second terminal device infrared receiving module and processed accordingly, while the infrared signal sent to the second terminal device by the first terminal device through the HDMI wire can be obtained by the second terminal device reading the register of the HDMI receiving module. It should be noted that, although the two signals are processed by the infrared processing program finally, the two signals may be distinguished by the infrared processing program due to different sources of the signals, and the priority of the two sources may be set by setting the judging signal source in the infrared processing program so as to judge that the second terminal device finally uses the infrared signal of the corresponding source, for example, the priority corresponding to the infrared signal received by the infrared receiving module may be set to be higher than the priority corresponding to the infrared signal received by the register of the HDMI receiving module, which is not limited in the present invention.

In order to enable a person skilled in the art to better understand the technical solutions according to the embodiments of the present invention, the following are illustrated by some possible examples:

referring to fig. 3, a television is disposed in a machine room, a cradle head camera is disposed in a conference room, when a user in the conference room wants to control the television through a remote controller, control cannot be achieved due to wall blocking, and in the invention, an infrared code value corresponding to the remote controller can be transmitted to the television by using an HDMI cable, so that control of the television is achieved. Assuming that the pan-tilt camera is associated with the infrared remote controller (1), the television is associated with the infrared remote controller (2), that is, the infrared code value to be transmitted to the television is an infrared signal sent by the infrared remote controller (2), the infrared signal sent by the infrared remote controller (1) is executed by the pan-tilt camera, as shown in fig. 4, the identification process of the infrared code value may include:

step1: the cradle head camera receives the infrared code value;

step2: the cradle head camera analyzes the received infrared code value;

step3: judging whether the infrared user code in the analyzed infrared code value is the terminal user code corresponding to the infrared remote controller (2) associated with the terminal;

step4: if the terminal user code is the terminal user code corresponding to the infrared remote controller (2), transmitting the infrared code value to the television; if the cloud platform user code corresponding to the infrared remote controller (1) is the cloud platform user code, the cloud platform user code is not transmitted to a television, and the corresponding processing is carried out by a cloud platform camera.

Referring to fig. 5, after the pan-tilt camera determines that the pan-tilt camera is an infrared signal sent by the infrared remote controller (2), a processor (CPU) of the pan-tilt camera parses the received infrared signal and writes the parsed infrared signal into a reserved field in the initial signaling message (the reserved field is written into a register corresponding to the HDMI transmitting module), so as to obtain a target signaling message containing a control signal, and then the target signaling message can be transmitted to an HDMI receiving module of the television by the HDMI transmitting module along with the transmission of HDMI data through a DDC channel of the HDMI.

After receiving the HDMI data through the HDMI receiving module, the television can store the reserved field in the target signaling message in a register corresponding to the HDMI receiving module, then the processor of the television can read the reserved field in the target signaling message stored in the register of the HDMI receiving module by using an IIC bus connected with the HDMI receiving module, analyze and process the read information to obtain an infrared user code and an infrared key value code corresponding to the infrared code value, then send the infrared user code and the infrared key value code to an infrared processing program, and the infrared processing program executes corresponding operation according to the infrared key value code.

It should be noted that, in the above process, the control performed by the user through the remote controllers corresponding to the pan-tilt camera and the television is taken as an example for performing the explanation, it is understood that the control of different televisions may refer to the same or similar process, and will not be described herein.

Through the process, on the basis of the existing multimedia interfaces of the first terminal equipment and the second terminal equipment, the remote control of the terminal equipment is realized, extra hardware equipment is not required to be added, the cost of the video conference is reduced, a participant can realize the terminal equipment for controlling the other space when being positioned in the current space, the convenience of equipment control in the video conference process is improved, and the orderly progress of the video conference is ensured.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Referring to fig. 6, a block diagram of a control device of a terminal device according to an embodiment of the present invention is shown and applied to a first terminal device, where the first terminal device performs multimedia data transmission with at least one second terminal device through a multimedia interface, and the control device specifically may include the following modules:

a signal receiving module 601, configured to receive a control signal for controlling the second terminal device;

an instruction conversion module 602, configured to generate a target signaling packet adapted to the multimedia interface according to the control signal, and select a target terminal device matched with the control signal from the at least one second terminal device;

the instruction sending module 603 is configured to send the target signaling packet to the target terminal device through the multimedia interface, where the target signaling packet is used to instruct the target terminal device to perform an operation corresponding to the control signal.

In some possible embodiments, the instruction conversion module 602 is specifically configured to:

In some possible implementations, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the first terminal device includes a processor and an HDMI transmitting module corresponding to the HDMI interface, and the instruction converting module 602 is specifically configured to:

the instruction sending module is specifically configured to:

and transmitting the target signaling message stored by the HDMI transmitting module to the target terminal equipment through the display data channel.

In some possible embodiments, the first terminal device includes at least one of an image acquisition device, an image display device, and an audio device.

Referring to fig. 7, there is shown a block diagram of a control apparatus for a terminal device, which is applied to a second terminal device and includes:

a signaling message receiving module 701, configured to receive a target signaling message through a multimedia interface, where the target signaling message includes a control signal corresponding to the second terminal device, and the target signaling message is a signaling message generated by the first terminal device according to the control signal and adapted to the multimedia interface;

and a signal response module 702, configured to perform an operation corresponding to the control signal.

In some possible implementations, the control signal is an infrared signal, the multimedia interface is an HDMI interface, the second terminal device includes at least a processor and an HDMI receiving module communicatively connected to the processor through an IIC bus, the HDMI receiving module includes a register, and the signaling message receiving module 701 is specifically configured to:

For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.

In addition, the embodiment of the invention also provides electronic equipment, which comprises: the processor, the memory, store the computer program on the memory and can run on the processor, this computer program realizes each process of the control method embodiment of the above-mentioned terminal equipment when being carried out by the processor, and can reach the same technical result, in order to avoid repetition, will not be repeated here.

The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, realizes the processes of the control method embodiment of the terminal device, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.

The electronic device 800 includes, but is not limited to: radio frequency unit 801, network module 802, audio output unit 803, input unit 804, sensor 805, display unit 806, user input unit 807, interface unit 808, memory 809, processor 810, and power supply 811. It will be appreciated by those skilled in the art that the structure of the electronic device according to the embodiments of the present invention is not limited to the electronic device, and the electronic device may include more or less components than those illustrated, or may combine some components, or may have different arrangements of components. In the embodiment of the invention, the electronic equipment comprises, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer and the like.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 801 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, specifically, receiving downlink data from a base station, and then processing the received downlink data by the processor 810; and, the uplink data is transmitted to the base station. In general, the radio frequency unit 801 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 801 may also communicate with networks and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user through the network module 802, such as helping the user to send and receive e-mail, browse web pages, access streaming media, and the like.

The audio output unit 803 may convert audio data received by the radio frequency unit 801 or the network module 802 or stored in the memory 809 into an audio signal and output as sound. Also, the audio output unit 803 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the electronic device 800. The audio output unit 803 includes a speaker, a buzzer, a receiver, and the like.

The input unit 804 is used for receiving an audio or video signal. The input unit 804 may include a graphics processor (Graphics Processing Unit, GPU) 8041 and a microphone 8042, the graphics processor 8041 processing image data of still pictures or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 806. The image frames processed by the graphics processor 8041 may be stored in the memory 809 (or other storage medium) or transmitted via the radio frequency unit 801 or the network module 802. The microphone 8042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 801 in case of a telephone call mode.

The electronic device 800 also includes at least one sensor 805 such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 8061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 8061 and/or the backlight when the electronic device 800 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for recognizing the gesture of the electronic equipment (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; the sensor 805 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not described herein.

The display unit 806 is used to display information input by a user or information provided to the user. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 807 is operable to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the electronic device. In particular, the user input unit 807 includes a touch panel 8081 and other input devices 8072. The touch panel 8081, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 8081 or thereabout using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 8081 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, sends the touch point coordinates to the processor 810, and receives and executes commands sent from the processor 810. In addition, the touch panel 8081 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 8081, the user input unit 807 can include other input devices 8072. In particular, other input devices 8072 may include, but are not limited to, physical keyboards, function keys (e.g., volume control keys, switch keys, etc.), trackballs, mice, joysticks, and so forth, which are not described in detail herein.

Further, the touch panel 8081 may be overlaid on the display panel 8061, and when the touch panel 8081 detects a touch operation thereon or thereabout, the touch panel is transferred to the processor 810 to determine a type of touch event, and then the processor 810 provides a corresponding visual output on the display panel 8061 according to the type of touch event. It will be appreciated that in one embodiment, the touch panel 8081 and the display panel 8061 are implemented as two separate components to implement the input and output functions of the electronic device, but in some embodiments, the touch panel 8081 and the display panel 8061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.

The interface unit 808 is an interface to which an external device is connected to the electronic apparatus 800. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 808 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 800 or may be used to transmit data between the electronic apparatus 800 and an external device.

The memory 809 can be used to store software programs as well as various data. The memory 809 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, the memory 809 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 810 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 809, and invoking data stored in the memory 809, thereby performing overall monitoring of the electronic device. The processor 810 may include one or more processing units; preferably, the processor 810 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 810.

The electronic device 800 may also include a power supply 811 (e.g., a battery) for powering the various components, and the power supply 811 may preferably be logically coupled to the processor 810 through a power management system that provides for managing charge, discharge, and power consumption.

In addition, the electronic device 800 includes some functional modules, which are not shown, and will not be described herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims

1. A control method of a terminal device, applied to a first terminal device, where the first terminal device performs multimedia data transmission with at least one second terminal device through a multimedia interface, the method comprising:

receiving a control signal for controlling the second terminal device;

2. The method according to claim 1, wherein generating a target signaling message adapted to the multimedia interface from the control signal comprises:

3. The method according to claim 2, wherein the control signal is an infrared signal, the multimedia interface is an HDMI interface, the first terminal device includes a processor and an HDMI transmitting module corresponding to the HDMI interface, the writing the control signal into a reserved field in the initial signaling message, and obtaining a target signaling message including the control signal includes:

4. The method according to claim 1, wherein said selecting a target terminal device from said at least one second terminal device that matches said control signal comprises:

5. The method of claim 1, wherein the first terminal device comprises at least one of an image acquisition device, an image display device, and an audio device.

6. A control method of a terminal device, applied to a second terminal device, the method comprising:

and executing an operation corresponding to the control signal.

7. The method of claim 6, wherein the control signal is an infrared signal, the multimedia interface is an HDMI interface, the second terminal device comprises at least a processor and an HDMI receiving module communicatively connected to the processor via an IIC bus, the HDMI receiving module comprises a register, and the receiving the target signaling message via the multimedia interface comprises:

8. A control device of a terminal device, applied to a first terminal device, where the first terminal device performs multimedia data transmission with at least one second terminal device through a multimedia interface, the device comprising:

9. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

The memory is used for storing a computer program;

the processor is configured to implement the method according to any one of claims 1-7 when executing a program stored on a memory.

10. A computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-7.