CN111836091A

CN111836091A - Response method and device of remote control equipment, electronic equipment and storage medium

Info

Publication number: CN111836091A
Application number: CN202010486118.5A
Authority: CN
Inventors: 乔岩; 卢燕青; 安君超; 杨春晖
Original assignee: Visionvera Information Technology Co Ltd
Current assignee: Visionvera Information Technology Co Ltd
Priority date: 2020-06-01
Filing date: 2020-06-01
Publication date: 2020-10-27

Abstract

The embodiment of the invention provides a response method and a response device of remote control equipment, electronic equipment and a storage medium, which are used for a video network terminal, wherein the video network terminal is provided with the remote control equipment, and the method comprises the following steps: when a target key on the remote control equipment is triggered, detecting whether a new key is triggered within a preset time length; when a new key is triggered within the preset time length, judging whether the new key is a response key associated with the target key; if so, executing shortcut operations corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key; and if not, executing the preset operation corresponding to the new key. The embodiment of the invention can improve the response efficiency of the remote control equipment and shorten the time consumed by operating the video networking service.

Description

Response method and device of remote control equipment, electronic equipment and storage medium

Technical Field

The present invention relates to the field of communications technologies, and in particular, to a response method and apparatus for a remote control device, an electronic device, and a storage medium.

Background

The video networking adopts the most advanced worldwide Vision Vera real-time high-definition video exchange technology, realizes the real-time transmission of the whole-network high-definition video which cannot be realized by the current Internet, integrates dozens of services such as high-definition video conferences, video monitoring, remote training, intelligent monitoring analysis, emergency command, video telephone, live broadcast, television mails, information distribution and the like into a system platform, and realizes the real-time interconnection and intercommunication of high-definition quality video communication through various terminal devices.

With the expansion of video networking services, a video conference needs to be performed between two independent video networks, and the video conference is called a converged video conference, namely, a plurality of terminals respectively located in the two independent video networks perform audio and video transmission with each other. Generally speaking, for meeting monitoring of each member participating in a video meeting, one of the video networks has a monitoring terminal, and the monitoring terminal can monitor videos of each member participating in the converged video meeting.

In the video networking, a video networking terminal is generally used for performing some video networking services, such as performing an audio and video call service, a monitoring call service, a video conference service, and the like. In these video networking services, a user needs to control the progress of the video networking services, for example, in the whole process of a video conference, a participant terminal needs to be switched, and simultaneously, the angle of a camera needs to be changed so that the camera is aligned with the participant terminal to collect a video of the user who uses the participant terminal to speak. In the related art, the above control is generally performed by a remote control device, but when the control is performed by the remote control device, the operation is complicated, and it takes a long time to change or switch the service, so that the efficiency of performing the video networking service is reduced.

Disclosure of Invention

In view of the above problems, embodiments of the present invention provide a response method and apparatus for a remote control device, an electronic device, and a storage medium, so as to overcome the above problems or at least partially solve the above problems.

In a first aspect of the embodiments of the present invention, a response method for a remote control device is disclosed, which is applied to a video networking terminal, where the video networking terminal is configured with the remote control device, and the method includes:

when a target key on the remote control equipment is triggered, detecting whether a new key is triggered within a preset time length;

when a new key is triggered within the preset time length, judging whether the new key is a response key associated with the target key;

if so, executing shortcut operations corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key;

and if not, executing the preset operation corresponding to the new key.

Optionally, the method further comprises:

executing a preset operation corresponding to the target key when the new key is not detected to be triggered within the preset time length;

and the preset operation corresponding to the target key is an operation of displaying a menu interface and/or an operation of switching a display interface.

Optionally, a plurality of shortcut instructions are prestored in the terminal, and different shortcut instructions are associated with different combination keys; according to the operation logic sequence between the target key and the new key, executing shortcut operations corresponding to the operation logic sequence, wherein the shortcut operations comprise:

screening out a target shortcut instruction corresponding to a combined key combined by the target key and the new key from the shortcut instructions;

and executing the shortcut operation corresponding to the target shortcut instruction.

Optionally, according to an operation logic sequence between the target key and the new key, executing a shortcut operation corresponding to the operation logic sequence, including:

determining an operation instruction corresponding to the target key according to the key value of the target key, and determining an instruction value corresponding to the new key according to the key value of the new key;

according to the operation instruction and the instruction value, generating a shortcut instruction corresponding to a combined key combined by the target key and the new key;

and executing the operation corresponding to the shortcut instruction.

Optionally, the video network terminal is in communication connection with a monitoring terminal and a plurality of participant terminals, and executes shortcut operations corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key, including:

when the target key is a preset position adjusting key, controlling the angle of the monitoring terminal to be a preset angle corresponding to the new key;

and when the target key is a speaker switching key, controlling a preset participant terminal corresponding to the new key to be a current participant terminal for speaking so that the audio stream collected by the preset participant terminal is sent to other participant terminals connected with the terminal.

And when the target key is in a split screen switching mode, switching the current split screen mode into a preset split screen mode corresponding to the new key.

In a second aspect of the embodiments of the present invention, a response apparatus for a remote control device is further disclosed, which is located at a terminal of a video network, and includes:

the key detection module is used for detecting whether a new key is triggered within a preset time length when a target key on the remote control equipment is triggered;

the judging module is used for judging whether a new key is a response key related to the target key or not when the new key is triggered within the preset time length;

the first response module is used for executing shortcut operations corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key when the new key is the response key associated with the target key;

and the second response module is used for displaying the preset operation corresponding to the new key when the new key is not the response key associated with the target key.

Optionally, the apparatus further comprises:

the third response module is used for displaying the preset operation corresponding to the target key when the new key is not detected to be triggered within the preset time length;

Optionally, a plurality of shortcut instructions are prestored in the video network terminal, and different shortcut instructions are associated with different combination keys; the first response module includes:

the command determining unit is used for screening out a target shortcut command corresponding to a combined key combined by the target key and the new key from the shortcut commands;

and the instruction response unit is used for executing the operation corresponding to the target shortcut instruction.

Optionally, the first response module may specifically include the following units:

the determining unit is used for determining an operation instruction corresponding to the target key according to the key value of the target key and determining an instruction value corresponding to the new key according to the key value of the new key;

the instruction generating unit is used for generating a shortcut instruction corresponding to a combined key combined by the target key and the new key according to an operation instruction and the instruction value;

and the execution unit is used for executing the operation corresponding to the shortcut instruction.

Optionally, the video networking terminal is in communication connection with the monitoring terminal and the multiple participating terminals, and the first response module may specifically include the following units:

the first response unit is used for controlling the angle of the monitoring terminal to be a preset angle corresponding to the new key when the target key is a preset position adjusting key;

and the second response unit is used for controlling the preset participant terminal corresponding to the new key to be the current participant terminal for speaking when the target key is the speaker switching key, so that the audio stream collected by the preset participant terminal is sent to other participant terminals connected with the terminal.

And the second response unit is used for switching the current screen splitting mode into a preset screen splitting mode corresponding to the new key when the target key is in the screen splitting switching mode.

The embodiment of the invention also discloses an electronic device, which comprises:

one or more processors; and

one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the device to perform a method of responding to a remote control device as described in the first aspect of embodiments of the invention.

The embodiment of the invention also discloses a computer readable storage medium, which stores a computer program for enabling a processor to execute the response method of the remote control device according to the first aspect of the embodiment of the invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, when a target key on the remote control equipment is triggered, the video network terminal detects whether a new key is triggered within a preset time length; when a new key is triggered within a preset time length, judging whether the new key is a response key associated with the target key; and if the new key is a response key associated with the target key, executing shortcut operation corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key. And when the new key is not the response key, independently executing the preset operation corresponding to the new key. Within the preset time, if the user triggers the target key and the response key in sequence, the quick operation is executed directly according to the operation sequence between the target key and the response key, so that the time consumed in controlling the video networking service is reduced, the interruption time of the video networking service is prevented from being too long, and the efficiency of the video networking service is improved. And when the new key triggered by the user is not the response key, the operation originally possessed by the new key can still be executed, the response to the key of the remote control equipment is perfected, and the user experience is optimized.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a schematic networking diagram of a video network of the present invention;

FIG. 2 is a schematic diagram of a hardware architecture of a node server according to the present invention;

fig. 3 is a schematic diagram of a hardware structure of an access switch of the present invention;

fig. 4 is a schematic diagram of a hardware structure of an ethernet protocol conversion gateway according to the present invention;

fig. 5 is a communication architecture diagram of a response method of a remote control device according to an embodiment of the present invention;

FIG. 6 is a flow chart of steps of a response method of a remote control device in accordance with an embodiment of the present invention;

FIG. 7 is a schematic diagram of a remote control device according to an embodiment of the present invention;

FIG. 8 is a flow chart of steps in a method for responding to a remote control device in accordance with an embodiment of the present invention;

fig. 9 is a schematic structural diagram of a response unit of a remote control device according to an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The video networking is an important milestone for network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of internet applications to high-definition video, and high-definition faces each other.

The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.

To better understand the embodiments of the present invention, the following description refers to the internet of view:

some of the technologies applied in the video networking are as follows:

network Technology (Network Technology)

Network technology innovation in video networking has improved the traditional Ethernet (Ethernet) to face the potentially huge first video traffic on the network. Unlike pure network Packet Switching (Packet Switching) or network Circuit Switching (Circuit Switching), the Packet Switching is adopted by the technology of the video networking to meet the Streaming requirement. The video networking technology has the advantages of flexibility, simplicity and low price of packet switching, and simultaneously has the quality and safety guarantee of circuit switching, thereby realizing the seamless connection of the whole network switching type virtual circuit and the data format.

Switching Technology (Switching Technology)

The video network adopts two advantages of asynchronism and packet switching of the Ethernet, eliminates the defects of the Ethernet on the premise of full compatibility, has end-to-end seamless connection of the whole network, is directly communicated with a user terminal, and directly bears an IP data packet. The user data does not require any format conversion across the entire network. The video networking is a higher-level form of the Ethernet, is a real-time exchange platform, can realize the real-time transmission of the whole-network large-scale high-definition video which cannot be realized by the existing Internet, and pushes a plurality of network video applications to high-definition and unification.

Server Technology (Server Technology)

The server technology on the video networking and unified video platform is different from the traditional server, the streaming media transmission of the video networking and unified video platform is established on the basis of connection orientation, the data processing capacity of the video networking and unified video platform is independent of flow and communication time, and a single network layer can contain signaling and data transmission. For voice and video services, the complexity of video networking and unified video platform streaming media processing is much simpler than that of data processing, and the efficiency is greatly improved by more than one hundred times compared with that of a traditional server.

Storage Technology (Storage Technology)

The super-high speed storage technology of the unified video platform adopts the most advanced real-time operating system in order to adapt to the media content with super-large capacity and super-large flow, the program information in the server instruction is mapped to the specific hard disk space, the media content is not passed through the server any more, and is directly sent to the user terminal instantly, and the general waiting time of the user is less than 0.2 second. The optimized sector distribution greatly reduces the mechanical motion of the magnetic head track seeking of the hard disk, the resource consumption only accounts for 20% of that of the IP internet of the same grade, but concurrent flow which is 3 times larger than that of the traditional hard disk array is generated, and the comprehensive efficiency is improved by more than 10 times.

Network Security Technology (Network Security Technology)

The structural design of the video network completely eliminates the network security problem troubling the internet structurally by the modes of independent service permission control each time, complete isolation of equipment and user data and the like, generally does not need antivirus programs and firewalls, avoids the attack of hackers and viruses, and provides a structural carefree security network for users.

Service Innovation Technology (Service Innovation Technology)

The unified video platform integrates services and transmission, and is not only automatically connected once whether a single user, a private network user or a network aggregate. The user terminal, the set-top box or the PC are directly connected to the unified video platform to obtain various multimedia video services in various forms. The unified video platform adopts a menu type configuration table mode to replace the traditional complex application programming, can realize complex application by using very few codes, and realizes infinite new service innovation.

Networking of the video network is as follows:

the video network is a centralized control network structure, and the network can be a tree network, a star network, a ring network and the like, but on the basis of the centralized control node, the whole network is controlled by the centralized control node in the network.

As shown in fig. 1, the video network is divided into an access network and a metropolitan network.

The devices of the access network part can be mainly classified into 3 types: node server, access switch, terminal (including various set-top boxes, coding boards, memories, etc.). The node server is connected to an access switch, which may be connected to a plurality of terminals and may be connected to an ethernet network.

The node server is a node which plays a centralized control function in the access network and can control the access switch and the terminal. The node server can be directly connected with the access switch or directly connected with the terminal.

Similarly, devices of the metropolitan network portion may also be classified into 3 types: a metropolitan area server, a node switch and a node server. The metro server is connected to a node switch, which may be connected to a plurality of node servers.

The node server is a node server of the access network part, namely the node server belongs to both the access network part and the metropolitan area network part.

The metropolitan area server is a node which plays a centralized control function in the metropolitan area network and can control a node switch and a node server. The metropolitan area server can be directly connected with the node switch or directly connected with the node server.

Therefore, the whole video network is a network structure with layered centralized control, and the network controlled by the node server and the metropolitan area server can be in various structures such as tree, star and ring.

The access network part can form a unified video platform (the part in the dotted circle), and a plurality of unified video platforms can form a video network; each unified video platform may be interconnected via metropolitan area and wide area video networking.

Video networking device classification

1.1 devices in the video network of the embodiment of the present invention can be mainly classified into 3 types: server, exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, code board, memory, etc.). The video network as a whole can be divided into a metropolitan area network (or national network, global network, etc.) and an access network.

1.2 wherein the devices of the access network part can be mainly classified into 3 types: node server, access exchanger (including Ethernet protocol conversion gateway), terminal (including various set-top boxes, coding board, memory, etc.).

The specific hardware structure of each access network device is as follows:

a node server:

as shown in fig. 2, the system mainly includes a network interface module 201, a switching engine module 202, a CPU module 203, and a disk array module 204;

the network interface module 201, the CPU module 203, and the disk array module 204 all enter the switching engine module 202; the switching engine module 202 performs an operation of looking up the address table 205 on the incoming packet, thereby obtaining the direction information of the packet; and stores the packet in a queue of the corresponding packet buffer 206 based on the packet's steering information; if the queue of the packet buffer 206 is nearly full, it is discarded; the switching engine module 202 polls all packet buffer queues for forwarding if the following conditions are met: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero. The disk array module 204 mainly implements control over the hard disk, including initialization, read-write, and other operations on the hard disk; the CPU module 203 is mainly responsible for protocol processing with an access switch and a terminal (not shown in the figure), configuring an address table 205 (including a downlink protocol packet address table, an uplink protocol packet address table, and a data packet address table), and configuring the disk array module 204.

The access switch:

as shown in fig. 3, the network interface module mainly includes a network interface module (a downlink network interface module 301 and an uplink network interface module 302), a switching engine module 303 and a CPU module 304;

wherein, the packet (uplink data) coming from the downlink network interface module 301 enters the packet detection module 305; the packet detection module 305 detects whether the Destination Address (DA), the Source Address (SA), the packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id) and enters the switching engine module 303, otherwise, discards the stream identifier; the packet (downstream data) coming from the upstream network interface module 302 enters the switching engine module 303; the incoming data packet of the CPU module 304 enters the switching engine module 303; the switching engine module 303 performs an operation of looking up the address table 306 on the incoming packet, thereby obtaining the direction information of the packet; if the packet entering the switching engine module 303 is from the downstream network interface to the upstream network interface, the packet is stored in the queue of the corresponding packet buffer 307 in association with the stream-id; if the queue of the packet buffer 307 is nearly full, it is discarded; if the packet entering the switching engine module 303 is not from the downlink network interface to the uplink network interface, the data packet is stored in the queue of the corresponding packet buffer 307 according to the guiding information of the packet; if the queue of the packet buffer 307 is nearly full, it is discarded.

The switching engine module 303 polls all packet buffer queues and may include two cases:

if the queue is from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queued packet counter is greater than zero; 3) obtaining a token generated by a code rate control module;

if the queue is not from the downlink network interface to the uplink network interface, the following conditions are met for forwarding: 1) the port send buffer is not full; 2) the queue packet counter is greater than zero.

The rate control module 308 is configured by the CPU module 304, and generates tokens for packet buffer queues from all downstream network interfaces to upstream network interfaces at programmable intervals to control the rate of upstream forwarding.

The CPU module 304 is mainly responsible for protocol processing with the node server, configuration of the address table 306, and configuration of the code rate control module 308.

Ethernet protocol conversion gateway：

As shown in fig. 4, the apparatus mainly includes a network interface module (a downlink network interface module 401 and an uplink network interface module 402), a switching engine module 403, a CPU module 404, a packet detection module 405, a rate control module 408, an address table 406, a packet buffer 407, a MAC adding module 409, and a MAC deleting module 410.

Wherein, the data packet coming from the downlink network interface module 401 enters the packet detection module 405; the packet detection module 405 detects whether the ethernet MAC DA, the ethernet MAC SA, the ethernet length or frame type, the video network destination address DA, the video network source address SA, the video network packet type, and the packet length of the packet meet the requirements, and if so, allocates a corresponding stream identifier (stream-id); then, the MAC deletion module 410 subtracts MAC DA, MAC SA, length or frame type (2byte) and enters the corresponding receiving buffer, otherwise, discards it;

the downlink network interface module 401 detects the sending buffer of the port, and if there is a packet, obtains the ethernet MAC DA of the corresponding terminal according to the destination address DA of the packet, adds the ethernet MAC DA of the terminal, the MACSA of the ethernet coordination gateway, and the ethernet length or frame type, and sends the packet.

The other modules in the ethernet protocol gateway function similarly to the access switch.

A terminal:

the system mainly comprises a network interface module, a service processing module and a CPU module; for example, the set-top box mainly comprises a network interface module, a video and audio coding and decoding engine module and a CPU module; the coding board mainly comprises a network interface module, a video and audio coding engine module and a CPU module; the memory mainly comprises a network interface module, a CPU module and a disk array module.

1.3 devices of the metropolitan area network part can be mainly classified into 2 types: node server, node exchanger, metropolitan area server. The node switch mainly comprises a network interface module, a switching engine module and a CPU module; the metropolitan area server mainly comprises a network interface module, a switching engine module and a CPU module.

2. Video networking packet definition

2.1 Access network packet definition

The data packet of the access network mainly comprises the following parts: destination Address (DA), Source Address (SA), reserved bytes, payload (pdu), CRC.

As shown in the following table, the data packet of the access network mainly includes the following parts:

DA

SA

Reserved

Payload

CRC

wherein:

the Destination Address (DA) is composed of 8 bytes (byte), the first byte represents the type of the data packet (such as various protocol packets, multicast data packets, unicast data packets, etc.), there are 256 possibilities at most, the second byte to the sixth byte are metropolitan area network addresses, and the seventh byte and the eighth byte are access network addresses;

the Source Address (SA) is also composed of 8 bytes (byte), defined as the same as the Destination Address (DA);

the reserved byte consists of 2 bytes;

the payload part has different lengths according to different types of datagrams, and is 64 bytes if the datagram is various types of protocol packets, and is 32+1024 or 1056 bytes if the datagram is a unicast packet, of course, the length is not limited to the above 2 types;

the CRC consists of 4 bytes and is calculated in accordance with the standard ethernet CRC algorithm.

2.2 metropolitan area network packet definition

The topology of a metropolitan area network is a graph and there may be 2, or even more than 2, connections between two devices, i.e., there may be more than 2 connections between a node switch and a node server, a node switch and a node switch, and a node switch and a node server. However, the metro network address of the metro network device is unique, and in order to accurately describe the connection relationship between the metro network devices, parameters are introduced in the embodiment of the present invention: a label to uniquely describe a metropolitan area network device.

In this specification, the definition of the Label is similar to that of the Label of MPLS (Multi-Protocol Label Switch), and assuming that there are two connections between the device a and the device B, there are 2 labels for the packet from the device a to the device B, and 2 labels for the packet from the device B to the device a. The label is classified into an incoming label and an outgoing label, and assuming that the label (incoming label) of the packet entering the device a is 0x0000, the label (outgoing label) of the packet leaving the device a may become 0x 0001. The network access process of the metro network is a network access process under centralized control, that is, address allocation and label allocation of the metro network are both dominated by the metro server, and the node switch and the node server are both passively executed, which is different from label allocation of MPLS, and label allocation of MPLS is a result of mutual negotiation between the switch and the server.

As shown in the following table, the data packet of the metro network mainly includes the following parts:

DA

SA

Reserved

label (R)

Payload

CRC

Namely Destination Address (DA), Source Address (SA), Reserved byte (Reserved), tag, payload (pdu), CRC. The format of the tag may be defined by reference to the following: the tag is 32 bits with the upper 16 bits reserved and only the lower 16 bits used, and its position is between the reserved bytes and payload of the packet.

In the related art, in the video networking service performed on the video networking terminal, a user may call out a screen menu through a screen button in a remote control device, so as to perform some functional operations, for example: the preset position is used for switching the position of the camera which is set in advance by a user; the combination of 9 video streams may be switched. However, in the existing operation mode, a user needs to operate a remote control device to call out a screen display menu, and control over the video networking service is finally completed after a series of operations are performed on the screen display menu. However, in this way, since the on-screen menu is called out, the conference process is interrupted, seamless switching cannot be achieved, and user experience is affected.

In view of the above, based on the characteristics of the above-mentioned video network, one of the core concepts of the present invention is proposed: monitoring the keys of the remote control equipment, triggering the monitoring of the combined key when a specific trigger key is pressed, triggering the function of the combined key when another response key is pressed in a short time, and completing the shortcut operation according to the combination of the keys.

Referring to fig. 5 and 6, fig. 5 is a communication environment diagram of an embodiment of the present invention, and fig. 6 is a flow chart illustrating steps of a response method of a remote control device of an embodiment of the present invention.

As shown in fig. 5, the video network includes a video network terminal 501 and a remote control device 502, where the remote control device 502 is a remote control device associated with the video network terminal 502, for example, the remote control device 502 may be a remote controller, and the remote controller is provided with a plurality of keys, and different keys have different operation functions. In the video network, the video network terminal 501 may first register in the video network through the video network server 503 to perform video network services in the video network.

The video networking service may include a video conference service, a surveillance video calling service, a video call service, and the like. Of course, in practice, when the terminal 501 performs different services of the video network, it can communicate with different other terminals through the video network server 503 to complete the above services. For example, as shown in fig. 5, in a video conference service, a video networking terminal 501 may be communicatively connected to a monitoring terminal 504 and a plurality of participant terminals 505 through a video networking server 503, where the monitoring terminal 504 is configured to collect videos of speaking participant terminals in the video conference, and when switching speaking participant terminals, the monitoring terminal 504 switches the camera angle under the control of the video networking terminal 501 to collect videos of subsequent participant terminals to be spoken.

In fig. 5, the video network terminal 501 may be connected to the monitoring terminal 504 through the video network server 503, and of course, in some practical cases, the video network terminal 501 may also be directly connected to the monitoring terminal 504, that is, the video network terminal 501 may be directly connected to the monitoring terminal 504 in a wireless or wired manner, so as to establish direct communication between the video network terminal 501 and the monitoring terminal 504.

With reference to the communication environment diagram shown in fig. 5, a response method of the remote control device of this embodiment is described, as shown in fig. 6, specifically including the following steps:

step S601: and when the target key on the remote control equipment is triggered, detecting whether a new key is triggered within a preset time length.

In this embodiment, the remote control device may include a plurality of keys, and different keys have different functions, where the target key may be a key having a key combination mark, and the key combination mark may be used to represent that the target key may be combined with other keys to form a combination key for shortcut operation. In practice, there may be more than one key on the remote control device with the key combination mark, and each target key may be combined with one or more other keys on the remote control device to form a combined key.

As shown in fig. 7, a key distribution diagram of a remote control device is shown, in which keys F1 through F4 may be target keys. When the F1 key is pressed, the F1 key is determined to be combined with other keys to form a combined key by the key combination mark of the key F1.

In this embodiment, the preset time duration may be understood as a countdown for defining the time duration between triggering the target key and triggering the new key. Specifically, when it is detected that the target key is triggered, monitoring of a new key may be immediately started, and it is monitored whether a new key is triggered within a preset time period, that is, whether a new key is triggered on the remote control device is monitored within a specified countdown period, where the new key may refer to another key different from the triggered target key.

In practice, the preset time period may be set according to the requirement, but it is not suitable to set too long, and generally, the preset time period may be set to a time within 1 second, for example, 500 ms.

Step S602: and when a new key is triggered within the preset time length, judging whether the new key is a response key associated with the target key.

In this embodiment, if it is detected that a new key is triggered within the preset time period during which the target key is triggered, it is further determined whether the new key is a response key in the combination keys corresponding to the target key. The response key can be understood as a key which is combined with the target key to form a key combination, so that shortcut operation can be performed.

In practice, one target key may be combined with a plurality of key distributions, so as to obtain a plurality of key combinations, that is, one target key corresponds to a plurality of key combinations. For example, as shown in fig. 7, F1 may be combined with 4 keys "1", "2", "3", and "4", respectively, to obtain 4 key combinations, "F1 + 1", "F1 + 2", "F1 + 3", and "F1 + 4", respectively. Different keys combine corresponding different functions.

In specific implementation, when a new key is triggered, the key value of the new key can be obtained, and comparison is performed according to the key value of the new key and the key values in the combined keys, so that whether the new key is a response key or not can be obtained.

If the new key is the response key, step S603 is executed, and if the new key is not the response key, step S604 is executed.

Step S603: and under the condition that the new key is a response key associated with the target key, executing shortcut operation corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key.

When the new key is a response key, the target key and the response key which are continuously triggered are combined into a key combination, the key combination has operation logic sequences which are respectively and independently triggered when the target key and the response key are triggered, namely, the functions finished by the key combination can be consistent with the functions finished by respectively and independently triggering the target key and the response key.

Illustratively, as shown in FIG. 7, target key F1 is actuated and key "1" is actuated within 500ms, key 1 being the response key to key F1, which are combined into combination key "F1 + 1". Wherein the background thus directly executes the shortcut operations of logical sequence of "F1 + 1".

Taking the video conference service as an example, the technology of this embodiment will be described in detail:

in the related technology, a menu interface for adjusting the camera angle is skipped by pressing F1, then, a user selects a camera in the menu interface to adjust the angle of the participant terminal collecting the current speech through the remote control device, at this time, a "1" key is pressed on the remote control device to indicate that the angle of the participant terminal corresponding to the "1" needs to be adjusted, that is, the whole process of adjusting the camera angle needs to go through the processes of pressing the "F1" key, jumping out of the menu interface and pressing the "1" key, the visible process is complicated sometimes, the menu interface is complicated, the user needs to perform operations such as sliding up and down in the menu interface to find the desired interface button, and then control is performed through the remote control device, and the time consumption is long.

In the embodiment of the invention, when the F1 key is triggered, if the '1' key is pressed within 500ms, the camera is directly adjusted to the angle of the participant terminal corresponding to the '1' number at the background without popping up a menu interface, so that the shortcut operation is completed in a short time, and the interference to the video conference service when the menu interface is called out is avoided.

Step S604: and executing a preset operation corresponding to the new key under the condition that the new key is not the response key associated with the target key.

In this embodiment, when the new key is not a response key, it indicates that the new key is not combined with the target key to form a key combination, and in this case, the original operation logic of the new key, i.e. the corresponding preset operation, may be executed separately. For example, if the new key pops up a certain menu page, the menu page may be popped up, and if the new key closes a certain video picture, the corresponding video picture may be directly closed.

By adopting the embodiment of the invention, the user can trigger the target key and the response key in succession, and the video networking terminal directly executes the quick operation according to the operation sequence between the target key and the response key, so that the time consumed when the video networking service is controlled is reduced, the interruption time of the video networking service is avoided from being too long, and the efficiency of the video networking service is improved.

Referring to fig. 8, which is a flow chart illustrating steps of a response method of a remote control device according to another embodiment of the present invention, as shown in fig. 8, the method may include the following steps:

step S801: and when the target key on the remote control equipment is triggered, detecting whether a new key is triggered within a preset time length.

In this embodiment, if it is detected that a new key is triggered within the preset time period, step S802 is performed, and if it is not monitored that the new key is triggered within the preset time period, step S803 is performed.

Step S802: and when a new key is triggered within the preset time length, judging whether the new key is a response key associated with the target key.

In this embodiment, when a new key is triggered within the preset time and the new key is a response key, step S8021 is executed; if the new key is not the response key, go to step S8022.

Step S8021: and under the condition that the new key is a response key associated with the target key, executing shortcut operation corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key.

In this embodiment, when the shortcut operation corresponding to the operation logic sequence is executed, in an implementation manner, a plurality of shortcut instructions may be pre-stored in the video networking terminal, and different shortcut instructions are associated with different combination keys. The method comprises the following steps that a plurality of prestored shortcut instructions can be burnt into a bottom program of the video networking terminal in the following mode:

firstly, different key combinations are determined, and the target key bearing the trigger key in each key combination.

And then, for each key combination, determining an operation instruction of a target key in the key combination and an instruction value corresponding to the operation instruction of a response key in the key combination.

And finally, burning the operation instruction of the target key and the instruction value of the response key in each key combination to a program bottom layer, thereby finishing the function shortcut setting.

Through the process, a plurality of shortcut instructions are built in the video network terminal, and under the condition, a target shortcut instruction corresponding to a combined key combined by the target key and the new key can be screened out from the shortcut instructions, and shortcut operation corresponding to the target shortcut instruction is executed.

Of course, in another embodiment, the shortcut operation corresponding to the logical order of operations may also be performed by:

step S8021-1: and determining an operation instruction corresponding to the target key according to the key value of the target key, and determining an instruction value corresponding to the new key according to the key value of the new key.

Step S8021-2: and generating a shortcut instruction corresponding to a combined key combined by the target key and the new key according to the operation instruction and the instruction value.

Step S8021-3: and executing the operation corresponding to the shortcut instruction.

In this embodiment, the key value of each key on the remote control device may be pre-stored in the terminal of the video network, and the key value of one key is used to uniquely identify the key. Of course, the operation instructions corresponding to different key values can be prestored in the video network terminal. Under the condition, when the new key is determined to be the response key, the shortcut operation can be executed according to the operation instruction corresponding to the key values of the target key and the response key.

Specifically, the operation instruction corresponding to the target key may be obtained according to the key value of the target key, the instruction value corresponding to the new key may be determined according to the key value of the response key, and then a shortcut instruction may be generated according to the operation instruction and the instruction value, where the shortcut instruction may be considered as an operation result that can be achieved when the operation instruction and the operation instruction of the response key are sequentially executed.

Step S8022: and executing a preset operation corresponding to the new key under the condition that the new key is not the response key associated with the target key.

In this embodiment, when the new key is not a response key, it indicates that the new key is not combined with the target key to form a key combination, in this case, the preset operation corresponding to the new key may be executed separately, for example, if the new key pops up a certain menu page, the menu page may be popped up, and if the new key closes a certain video picture, the corresponding video picture may be closed directly.

Step S803: and executing preset operation corresponding to the target key when the new key is not detected to be triggered within the preset time length.

The preset operation is an operation of displaying a menu interface and/or an operation of switching a display interface.

In this embodiment, if it is not monitored that a new key is triggered after the preset duration is over, a preset operation corresponding to the target key may be executed, specifically, a menu interface may be popped up, or a display interface is switched from a current display interface to another display interface, or a certain video networking service is closed, and of course, specifically, the preset operation corresponding to the target key may be set according to an actual situation, which is not limited herein.

In practice, a plurality of target keys on the remote control device may be provided, and different target keys correspond to different operation functions for different video networking services, then in this embodiment, as shown in fig. 5, the video networking terminal may further be in communication connection with the monitoring terminal 504 and the plurality of participant terminals 505 in practice, and when a shortcut operation corresponding to the operation logic sequence is executed according to the operation logic sequence between the target key and the new key, the following operations may be executed:

operation one: and when the target key is a preset position adjusting key, controlling the angle of the monitoring terminal to be a preset angle corresponding to the new key.

In this operation, the preset adjusting key may be a key for controlling the camera angle of the monitoring terminal to change, and in this case, the key value of the new key may be understood as the camera angle of the monitoring terminal. When a new key is triggered, the angle of the monitoring terminal can be directly set to be a preset angle corresponding to the new key, so that a specific menu interface is prevented from being popped up, and the angle of the camera is controlled from the menu interface.

And operation II: and when the target key is a speaker switching key, controlling a preset participant terminal corresponding to the new key to be a current participant terminal for speaking so that the audio stream collected by the preset participant terminal is sent to other participant terminals connected with the terminal.

In this operation, the speaker switching button may be a button for controlling a participant terminal currently speaking, when the target button is triggered, it indicates that the speaking terminal needs to be switched, at this time, the response button is triggered immediately, and then the participant terminal corresponding to the response button may be directly controlled to be the participant terminal currently speaking, specifically, once the response button is triggered, the video network terminal executes a corresponding instruction to send an audio stream acquired by the participant terminal corresponding to the response button to other participant terminals connected to the video network, so that the other participant terminals can receive the speech made by the participant terminal currently speaking.

Operation three: and when the target key is in a split screen switching mode, switching the current split screen mode into a preset split screen mode corresponding to the new key.

The split screen switching mode may be a split screen mode of a display screen connected to the video networking terminal, and the split screen mode may be a display mode in which a plurality of surveillance video streams are displayed in a split area. For example, in a service of calling a monitoring video, monitoring videos of a plurality of monitoring terminals need to be viewed simultaneously, in this case, the monitoring videos collected by the plurality of monitoring terminals are displayed simultaneously on a display screen of the video network terminal in a split screen manner, and the monitoring video of each monitoring terminal is displayed through a display area on one display screen.

When the target key is triggered, it can indicate that the split screen mode needs to be switched, for example, the display position of each path of video stream on the display screen is adjusted, for example, the monitoring video stream a is adjusted from the display position No. 1 to the display position No. 2; alternatively, the number of video streams displayed on the display screen is adjusted, for example, from 9-division to 6-division. When the response key is triggered next time, the current split screen mode is directly switched to the split screen mode corresponding to the response key, so that the time consumption caused by popping up a menu interface first and then selecting on the menu interface is avoided.

When the embodiment of the invention is adopted, compared with the related technology, the invention has the following advantages:

first, when the user successively presses the target key and the response key associated therewith within a short time, the shortcut operation resulting from the combination of the two keys can be executed, thereby avoiding the time consumption resulting from the user operating through the menu interface and realizing the shortcut response.

Second, if the user presses a key not associated with the target key within a short time. The operation corresponding to the new key can be executed, namely, a menu interface is popped up or other operations are executed, so that the response flexibility of the remote control equipment is enhanced, the key pressed by a user has related response, and the user experience is optimized.

Thirdly, because the original logic of the target key can still be executed when the new key is not pressed within the preset duration, for example, an original menu interface is popped up, the response mechanism of the remote control device is enriched, so that the remote control device can not only enter a shortcut operation mode, but also enter a normal operation mode, the use flexibility is improved, the requirement that a user can operate according to own operation habits or service current situations is met, and the user experience is optimized.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 9, there is shown a block diagram of a response device of a remote control device, which may be located in a terminal of a video network to which the remote control device may be connected, as shown in fig. 9, which may include the following modules:

the key detection module 901 may be configured to detect whether a new key is triggered within a preset time period when a target key on the remote control device is triggered;

a determining module 902, configured to determine whether a new key is a response key associated with the target key when the new key is triggered within the preset time duration;

a first response module 903, configured to, when the new key is a response key associated with the target key, execute a shortcut operation corresponding to an operation logic sequence according to the operation logic sequence between the target key and the new key;

the second response module 904 may be configured to display a preset operation corresponding to the new key when the new key is not the response key associated with the target key.

Optionally, the apparatus may further include the following modules:

An embodiment of the present invention further provides an electronic device, including:

one or more processors; and

one or more machine-readable media having instructions stored thereon, which when executed by the one or more processors, cause the device to perform a response method of a remote control device as described in embodiments of the invention.

Embodiments of the present invention also provide a computer-readable storage medium storing a computer program for causing a processor to execute a response method of a remote control device according to an embodiment of the present invention.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The foregoing detailed description of the response method, apparatus, electronic device and readable storage medium of the remote control device provided by the present invention has been provided, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the descriptions of the foregoing examples are only used to help understand the method and core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A response method of a remote control device is applied to a video network terminal, the video network terminal is provided with the remote control device, and the method comprises the following steps:

and if not, executing the preset operation corresponding to the new key.

2. The method of claim 1, further comprising:

3. The method according to claim 1, wherein a plurality of shortcut commands are prestored in the terminal, and different shortcut commands are associated with different combination keys; according to the operation logic sequence between the target key and the new key, executing shortcut operations corresponding to the operation logic sequence, wherein the shortcut operations comprise:

4. The method according to claim 1, wherein performing shortcut operations corresponding to the operation logic sequence according to the operation logic sequence between the target key and the new key comprises:

and executing the operation corresponding to the shortcut instruction.

5. The method according to claim 1, wherein the video networking terminal is in communication connection with a monitoring terminal and a plurality of participant terminals, and according to the operation logic sequence between the target key and the new key, a shortcut operation corresponding to the operation logic sequence is executed, including:

6. A response apparatus for a remote control device, located at a terminal of a video network, comprising:

7. The apparatus of claim 6, further comprising:

8. The device according to claim 6, wherein a plurality of shortcut commands are prestored in the video network terminal, and different shortcut commands are associated with different combination keys; the first response module includes:

9. An electronic device, comprising:

one or more processors; and

one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the device to perform a response method of a remote control device of any of claims 1-5.

10. A computer-readable storage medium characterized by a stored computer program causing a processor to execute the response method of the remote control device according to any one of claims 1 to 5.